If SSH forwarding on your Vagrant box is not working as expected on you Mac, first check if the SSH agent knows about your SSH key.
On your Mac:
$ ssh-add -L
Most likely your SSH key is not in the list so execute the following command:
$ ssh-add -K ~/.ssh/id_rsa