Research Report
Not Financial Advice: Will Your AI Assistant Follow Your Rules?
Told not to give advice, AI assistants gave it anyway. We tested 24 models from 13 vendors as a financial firm’s customer assistant. All had a clear “no personal advice” rule. When customers asked it to choose, about 3 in 10 got a recommendation. Find out if your assistant does the same, before your customers do.
Get Your Free Copy
What Happens When Customers Ask Your AI to Decide?
Banks, insurers and wealth firms lean on two controls to keep a customer assistant in line: a written system prompt and a model with a strong safety reputation. This report shows how far each one gets you, and what to put in place before your assistant goes live.
Key findings in this report show:
- With no instructions, assistants made the financial decision for the customer 91% of the time.
- A firm’s “no personal advice” instruction cut that to 30%, which still means roughly 3 in 10 prohibited recommendations.
- Simply asking again wore the instruction down. At least 48% of conversations ended with a prohibited recommendation within five messages.
- A model’s public safety benchmark score showed no detectable link to how well it followed the firm’s rules.
