The practical problem in regulated enterprises usually isn't deliberate mislabeling. It's that the two things genuinely look similar at the interface level, and the classification question, chatbot or AI agent, low-risk or high-risk, isn't one product teams tend to ask explicitly.
GDPR
Article 22 gives individuals the right not to be subject to a decision based solely on automated processing when that decision produces significant effects, including financial services eligibility, insurance pricing, and credit access, along with the right to obtain human intervention and to contest the decision.
Separately, Articles 13 to 15 require meaningful information about the logic involved. A system that determines whether a customer qualifies for a product and communicates that determination isn't providing information. It's making a decision, and both sets of obligations can apply even when the interface looks like a conversation.
The EU AI Act sharpens this further. Automated decision-making in credit, insurance underwriting, employment, and essential public services falls under
Annex III's high-risk categories. High-risk AI requires a conformity assessment before deployment, documented risk management, continuous human oversight, and full auditability of every automated decision.
A financial services system that crosses from information provision into decision execution, without a governance layer designed for that distinction, is operating outside those requirements whether anyone intended it or not.
The line between a chatbot and a regulated AI system isn't drawn at the interface. It's drawn at the moment the system's output has a consequential effect on an individual's access to services, financial products, or legal rights. In regulated industries, that line gets crossed earlier than most compliance teams realize.