I generated a key and copied it to my target:
ssh-keygen ssh-copy-id username@hostname
I left the the location of the key as default and did not set any passphrase.
For a small while after that, I was able to
ssh username@hostname without being prompted for a password, and then it stopped working for some reason.