Can You Trust AI for Financial Advice? We Put It to the Test
Artificial intelligence (AI) has revolutionized the way we seek financial advice, providing quick and efficient responses to a wide range of personal finance queries. However, it’s important to note that while AI models like ChatGPT and Gemini can offer valuable insights, they come with limitations.
One common disclaimer that these AI models provide is that they cannot offer personalized financial advice, urging users to consult with financial professionals for tailored guidance. This cautious approach is understandable, given the high stakes involved in financial decision-making and the increasing scrutiny from regulatory agencies on online financial advice.
Despite these disclaimers, many users still rely on AI for guidance on a variety of financial topics, from investing and retirement planning to real estate and credit management. The potential for AI to improve financial literacy and assist individuals in achieving financial goals is significant, especially when responses are reliable and actionable.
In a recent analysis by Money staff, ChatGPT and Gemini were put to the test with 25 personal finance questions across different categories. The results showed that Gemini’s 2.5 Pro model outperformed ChatGPT’s o3 model, earning higher grades in all five topic clusters tested.
While both AI models provided valuable insights and advice on various financial topics, Gemini stood out for its thorough explanations, impressive sourcing, and clear guidance. ChatGPT, on the other hand, offered concise responses but sometimes lacked depth and clarity in its advice.
When it comes to retirement planning, housing decisions, credit management, investing strategies, and understanding current events, both ChatGPT and Gemini provided valuable information but fell short in certain areas. For example, responses on retirement planning lacked in-depth guidance on tax strategies and investment portfolio diversification, while answers on credit improvement could have been more realistic and comprehensive.
Overall, the analysis revealed that AI models like ChatGPT and Gemini have the potential to enhance financial literacy and provide valuable insights to users. However, it’s essential to use AI as a tool for information and guidance, rather than as a substitute for personalized financial advice from a professional. By leveraging the strengths of AI and combining them with human expertise, individuals can make more informed financial decisions and work towards achieving their financial goals.
