Git hangs with a ssh remote URI after 10.15.4 update

catalinagitssh

After updating to Catalina 10.15.4, git started hanging indefinitely when trying to push or pull from a repo that was previously accessible.

$ git push origin master
^C

The URL for origin looks like:

$ git remote -v
origin  ssh://git@gitlab.example.com:30814/username/project.git (fetch)
origin  ssh://git@gitlab.example.com:30814/username/project.git (push)

Attempting to ssh directly to the remote results in a hang:

$ /usr/bin/ssh -p 30814 git@gitlab.example.com -vvv
OpenSSH_8.1p1, LibreSSL 2.7.3
debug1: Reading configuration data /Users/username/.ssh/config
debug1: Reading configuration data /etc/ssh/ssh_config
debug1: /etc/ssh/ssh_config line 47: Applying options for *
debug1: Connecting to gitlab.example.com port 30814.
^C

Which seems to indicate the underlying problem with git is the ssh:// URI for the remote repository. I confirmed this by successfully cloning the repo using a https:// URI.

Best Answer

Debugging steps:

Attempted to connect with netcat:

$ nc -v gitlab.example.com 30814
Connection to gitlab.example.com port 30814 [tcp/*] succeeded!
SSH-2.0-OpenSSH_7.2
^C

Suspecting a broken ssh client, I installed openssh using brew:

$ brew install openssh
...
$ /usr/local/bin/ssh  -V
OpenSSH_8.2p1, OpenSSL 1.1.1d  10 Sep 2019

$ /usr/local/bin/ssh -p 30814 git@gitlab.example.com
Welcome to GitLab, @username!
Connection to gitlab.example.com closed.

After refreshing my shell environment to ensure that the new ssh is found in my $PATH, git operations began functioning as expected with ssh:// URIs.

Searching turned up this user submitted bug: ssh fails when using -p flag

The workaround detailed in the bug is to use the remote host's IP address instead of the DNS name. I can confirm that this worked for me:

$ /usr/bin/ssh -V
OpenSSH_8.1p1, LibreSSL 2.7.3

$ /usr/bin/ssh -p 30814 git@192.168.1.1
Welcome to GitLab, @username!
Connection to gitlab.example.com closed.

The apparent trigger for this bug is using ports greater than 8192 in conjunction with a host's DNS name.

Related Solutions

MacOS – Git clone error after OS X Mountain Lion update

This error is caused by not having git installed. Your previous installation was probably lost in the update (don't worry, your repos will still be intact).

You can download git from its official page, here.

If you're a member of an Apple developer program you can also install git by installing the Xcode command line tools, found in the Downloads tab of Xcode's preferences.

Can no longer ssh in to machine as git user after upgrading to Mavericks

Double check git is a user who's allowed to ssh in to this machine.

Go to System Preferences -> Sharing and select Remote Login from the list on the left hand side of the pane.

Make sure Remote Login is turned on my checking the box next to it in the list (sounds like it is though, since you can ssh in as your own user account).

Make sure the right side of the pane either says Allow access for: All users or in the box below this option your git user appears in the list of allowed users. If it's not in the box below, press the + button to find it in a list of users registered with the system and add it to the list.

Now make sure that /Users/Shared/git is accessible to the git user.

Open Terminal and do:

cd /Users/Shared/git

Use ls -la to view the permissions on the folder:

/Users/Shared/git [ian@iansimac] [20:22]
> ls -lah
total 0
drwxr-xr-x   2 ian   wheel    68B  6 Nov 20:22 .
drwxrwxrwt  14 root  wheel   476B  6 Nov 20:22 ..

If . in the list shows the owner to be an account other than git or the permissions to be something that git can't use to access this directory you'll need to change them.

If git is the only user who should access this location, consider something like:

sudo chown -R git /Users/Shared/git
sudo chmod 755 /Users/Shared/git

If that doesn't lead to a solution, try watching your Console while attempting to ssh in to the machine as the git user to see what it says. You can filter console messages for sshd to see just ssh-related messages:

11/6/2013 8:25:54.006 PM sshd: ian [priv][53178]: USER_PROCESS: 53189 ttys001
11/6/2013 8:26:37.217 PM sshd: ian [priv][53178]: DEAD_PROCESS: 53189 ttys001
11/6/2013 8:26:41.164 PM sshd: unknown [pam][53214]: in od_record_create(): failed: 13
11/6/2013 8:26:41.164 PM sshd: unknown [pam][53214]: in od_record_create_cstring(): failed: 13
11/6/2013 8:26:42.538 PM sshd: unknown [pam][53214]: in od_record_create(): failed: 13
11/6/2013 8:26:42.538 PM sshd: unknown [pam][53214]: in od_record_create_cstring(): failed: 13
11/6/2013 8:26:42.538 PM sshd: unknown [pam][53214]: in pam_sm_authenticate(): OpenDirectory - Unable to get user record.
v11/6/2013 8:26:42.540 PM sshd[53212]: error: PAM: unknown user for illegal user foo from localhost via ::1

And failed login attempts look like the last line in the output above.

Best Answer

Related Solutions

MacOS – Git clone error after OS X Mountain Lion update

Can no longer ssh in to machine as git user after upgrading to Mavericks

Related Question