PCMag editors select and review products independently. If you buy through affiliate links, we may earn commissions, which help support our testing.

Amazon's AI Chatbot Q Has Some Serious Accuracy and Privacy Issues

Some workers say the issues could 'potentially induce cardiac incidents in Legal.'

 & Emily Price Weekend Reporter

Our team tests, rates, and reviews more than 1,500 products each year to help you make better buying decisions and get more from technology.

Our Expert
LOOK INSIDE PC LABS HOW WE TEST
65 EXPERTS
43 YEARS
41,500+ REVIEWS
(Credit: Shutterstock / gguy)

Last Tuesday at its annual Amazon Web Services developer conference, Amazon announced Q, the company’s AI chatbot for business. As it turns out, Q might not be quite ready for primetime.

According to leaked documents viewed by tech newsletter Platformer, Q is “experiencing severe hallucinations and leaking confidential data.” Some of those leaks include the location of AWS data centers, internal discount programs, and even unreleased features.

In a statement to Platformer, an Amazon representative refuted claims that the chatbot is leaking confidential information.

“Some employees are sharing feedback through internal channels and ticketing systems, which is standard practice at Amazon,” a spokesperson said. “No security issue was identified as a result of that feedback. We appreciate all of the feedback we’ve already received and will continue to tune Q as it transitions from being a product in preview to being generally available.”

Q is a business-focused chatbot that can be customized to assist employees with a variety of different job functions as well as answer questions and generate content.

When it announced the product, Amazon said several companies are already using Q, including Accenture, Amazon, BMW Group, Gilead, Mission Cloud, Orbit Irrigation, and Wunderkind.

Rather than pull information from the web as many other chatbots do, Q instead pulls answers from the "company's information repositories, code bases, and enterprise systems,” making it even more problematic if that information is incorrect or is shared with the wrong people.

In November, OpenAI debuted its customizable chatbots, called GPTs, that can answer questions using in-house data rather than the web at large, though the rollout of its GPT Store has been delayed due to the CEO-related turmoil.

About Our Expert

Emily Price

Emily Price

Weekend Reporter

Emily is a freelance writer based in Durham, NC. Her work has appeared in The Wall Street Journal, The New York Times, Lifehacker, Popular Mechanics, Macworld, Engadget, Computerworld, and more. You can also snag a copy of her book Productivity Hacks: 500+ Easy Ways to Accomplish More at Work--That Actually Work! online through Simon & Schuster or wherever books are sold.

Read full bio