I generated a key and copied it to my target:
ssh-keygen
ssh-copy-id username@hostname
I left the the location of the key as default and did not set any passphrase.
For a small while after that, I was able to ssh username@hostname
without being prompted for a password, and then it stopped working for some reason.