(Credit: PCMag/Google/Getty Images)
We wouldn't blame you for assuming that AI, being a computer, would be better at generating passwords than a human. After all, people use AI to do everything from writing their emails to generating a skincare routine. I tried it and learned that chatbots generate passwords that look secure at first glance but are weaker than they seem and could leave your accounts vulnerable to brute-force attacks.
AI Passwords Look Smart—But They're Full of Patterns
Recently, I came across research from Irregular, a cybersecurity firm, warning the public against using popular AI chatbots to generate passwords. To see what kinds of passwords LLMs create, I typed the following prompt into Google Gemini: “Please generate a set of ten 20-character passwords using all case types and all characters.”
The first few passwords Gemini generated fit the qualifications I requested. But after staring at the list for a few seconds, I noticed a big problem. Can you spot the similarities between these passwords?
H9!sR2%nB7*vK4#mG1&p
X6#mQ1*tL9&vB2!sK8^j
N7^vB2#mK9!sQ4&pL1*x
z8!Wq2#mR9*vK4&pL5^t
P9#vL2*mB7&sQ4!xK1^r
Here's the format the LLM is using for all of the passwords it generated for me: letter, number, special character, letter, letter, number, special character, letter, letter, number, special character, letter, letter, number, special character, letter, letter, number, special character, letter.
If I'm using an LLM to generate all my passwords and they all use the same format, that makes my passwords much easier for malicious AI agents (and humans!) to crack. An AI chatbot is not equipped to generate batches of highly secure passwords.
Sure, the passwords certainly look secure, and they’d definitely be hard for any human to memorize, but there’s a pretty clear pattern you can follow to guess what type of character is coming next. When a password is predictable, it’s inherently insecure.
The most concerning part of this was the chatbot’s weird messages of reassurance. Each time I requested a new password from Gemini, in addition to the predicted string of characters, it also explained why the password it generated was secure and told me to trust it.
For example, here’s an aside from Gemini that accompanied one of the passwords generated above:
(Credit: Google/PCMag)Sure, calculating bits of entropy is a way to determine password strength for a single password, but Gemini generated five passwords in a row with the exact same character-type sequence. The AI did not create truly random passwords that do not follow human-readable patterns. After all, you and I were able to detect the pattern pretty quickly, right?
Unfortunately, Gemini isn’t the only LLM creating batches of similar passwords. Researchers at Irregular tested several chatbots and found that each one created passwords with clear patterns.
Password Managers Do What AI Can't
Don’t accept messages promoting false security from software. Instead, use a password manager to generate and store your complex passwords for all of your online accounts. You can also create your own random password generator using Excel or Google Sheets, and store your passwords offline on a hardware security key.
(Credit: Proton/PCMag)At the heart of any password generator is a cryptographically secure pseudorandom number generator (CSPRNG), an algorithm that produces unpredictable sequences of numbers and characters. This isn’t an action that an LLM can mimic successfully, which is why it generates long, yet crackable passwords.
So, what is a password manager, and why should you use one to create all of your passwords in the future? These apps generate passwords for you and fill them in for all your accounts, so you don’t have to memorize them or type them in every time you log in.
I’ve tested and reviewed dozens of password managers, many of which are easy enough for absolutely anyone to use, and some of which offer free plans. The best password managers can import your existing passwords and offer suggestions for creating longer, stronger logins. Many password managers also include anti-phishing protection and tools to help you cut down on scam attempts and spam by signing up for accounts using fake email addresses.
Want to take things completely into your own hands? Check out our story on how to build your own password generator.