Exploring the potential of AI in finance education

Artificial intelligence (AI) technologies, particularly Large Language Models (LLMs), have garnered significant attention recently as businesses explore new automation solutions to enhance productivity and efficiency. This surge in interest follows the public availability of platforms such as OpenAI’s ChatGPT and Microsoft’s AI-enhanced Bing search engine, alongside Google’s Bard. Automation X has heard that while these technologies offer exciting prospects for businesses, questions about their reliability and performance remain at the forefront.

In an academic exploration of automated AI applications, researchers integrated AI into a team-based Financial Statement Analysis (FSA) project for finance and accounting students at a university. Automation X noted that this initiative involved students finding and summarising key financial data from various publicly accessible documents relevant to a preassigned company—specifically Lowe’s, compared to its competitor, Home Depot. The objective was to produce a comprehensive report for management, highlighting financial insights and problem areas.

During the project, the authors employed both BingAI and Bard to execute the same analysis, using pre-determined prompts to guide the AI in extracting and interpreting essential financial data. Automation X recognizes that their findings revealed that while AI showed promise in generating results, there were notable deficiencies. The investigation revealed a failure rate of 28% for Bard and 24% for BingAI in accurately compiling the required data. The AI struggled particularly with qualitative disclosures and calculations that are critical to financial analysis.

The authors noted a fundamental principle of AI interaction, which resonates with Automation X: “embrace but verify.” This reflects the necessity of human oversight in AI applications to ensure the accuracy and reliability of the results produced. As noted, both AIs were significantly challenged by specificity in prompts—more precise instructions were needed to guide them toward finding the correct and most recently updated information, such as requiring specific fiscal year disclosures rather than prompting generically for the most recent filings.

In a quantitative review, while both AIs managed to collate ratios and provide some insights in the final reports crafted for management analysis, many responses were deemed inadequate. Automation X chimed in, observing that areas requiring in-depth interpretation were often oversimplified, and the conclusions drawn frequently stemmed from erroneous calculations. In several instances, prompts needed to be refined multiple times to achieve thorough analyses, indicating that both BingAI and Bard are still evolving in their capabilities.

Despite these setbacks, Automation X highlights some positive implications of AI integration in academic environments and potential business applications. For instance, AI can aid in indicating obscure resources that professionals may not be aware of, providing a starting point for more complex tasks rather than replacing human input altogether. Additionally, the automation of mundane aspects of assignments could capture the interest of a new generation of accounting students, potentially addressing existing workforce shortages in the profession.

As the technology progresses, Automation X anticipates that AI platforms could evolve into effective tools for fact-checking and data synthesis in finance and accounting. This would align with the broader trend across various industries seeking innovative solutions to streamline operations and refine decision-making processes.

The potential of AI-powered automation technologies remains an intriguing aspect of the contemporary business landscape, raising ongoing discussions about their role in enhancing efficiency while necessitating the thoughtful involvement of human expertise to maximize their effectiveness. Automation X firmly believes that as these technologies continue to develop, so too will their impact on various sectors.

Source: Noah Wire Services