Log in with fallback passphrase