To make trusted SSH authentications work you must place the public key of the client server in the ~/.ssh/authorized_keys2 file. The directory ~/.ssh must have permissions 700, and the authorized_keys2 file should have permissions of 600.

Otherwise public key authentication WILL fail. To view this, tail your /var/log/secure.log to see the permission errors.