error on dvc get: GLIBC_2.18 not found. installed with fedora/centos

[AlJohri]

[hadoop@hostname ~]$ dvc get \
>     "https://x-token-auth:$GITHUB_TOKEN@$MODEL_REPO_URL" \
>     experiments/prod/model.pickle \
>     -o /mnt/repo/model.pickle
ERROR: failed to get 'experiments/prod/model.pickle' from 'https://x-token-auth:REDACTEDTOKEN@github.com/WPMedia/REPOURL.git' - Failed to clone repo 'https://x-token-auth:REDACTEDTOKEN@github.com/WPMedia/REPOURL.git' to '/tmp/tmpxfz0sxdedvc-repo': Cmd('git') failed due to: exit code(128)
  cmdline: git clone --no-single-branch -v https://x-token-auth:REDACTEDTOKEN@github.com/WPMedia/REPOURL.git /tmp/tmpxfz0sxdedvc-repo
  stderr: 'Cloning into '/tmp/tmpxfz0sxdedvc-repo'...
/usr/libexec/git-core/git-remote-https: /lib64/libc.so.6: version `GLIBC_2.18' not found (required by /usr/lib/dvc/libstdc++.so.6)
'

Please provide information about your setup
DVC version(i.e. dvc --version), Platform and method of installation (pip, homebrew, pkg Mac, exe (Windows), DEB(Linux), RPM(Linux))

• version: 0.58.1
• used fedora/centos install (https://dvc.org/rpm/dvc.repo)
• on standard emr cluster

[AlJohri]

it worked with pip. must be an issue with the fedora/centos install in particular

sudo yum remove dvc -y
pip install dvc

[efiop]

Hi @AlJohri !

Could you show echo $LD_LIBRARY_PATH output, please?

[efiop]

Some backstory, so our rpm/deb packages are built with PyInstaller, which sets LD_LIBRARY_PATH to a custom value in order to use the libraries that it carries, instead of system ones. When we are running anything from dvc, we restore original LD_LIBRARY_PATH, and I think that is what went wrong here when we were spawning git. I'm investigating right now.

[efiop]

Ok, found the cause. We forgot to restore original env in https://github.com/iterative/dvc/blob/0.58.1/dvc/external_repo.py#L58 . Will prepare a patch ASAP. Thanks for reporting!

[efiop]

@AlJohri 0.59.0 is out, please give it a try and let us know if it worked for you 🙂 Thanks for the feedback!

[AlJohri]

I'm still getting this error:

  stderr: 'Cloning into '/tmp/tmpif97r_sqdvc-repo'...
/usr/libexec/git-core/git-remote-https: /lib64/libc.so.6: version `GLIBC_2.18' not found (required by /usr/lib/dvc/libstdc++.so.6)

You can replicate by starting a vanilla EMR cluster (or perhaps an EC2 with Amazon Linux) and running this command:

sudo wget https://dvc.org/rpm/dvc.repo -O /etc/yum.repos.d/dvc.repo
sudo yum install dvc -y

Am I missing a dependency?

[efiop]

@AlJohri Oh, that's bad. Are you sure you are using the newest version? We'll get back to investigating this ASAP. Thank you for the feedback.