After experiencing significant repairs on his 2021 BMW, Zack Giacomelli made the decision last month to sell it back to BMW Toronto, the same dealership where he had purchased the used vehicle in 2023.
Initially, the process of selling back the car seemed straightforward. Following an online inquiry, Giacomelli received a text message from Quinn at BMW Toronto, who was eager to assist. Quinn expressed understanding for Giacomelli’s car issues and inquired about the vehicle, which was still undergoing repairs at the dealership. Subsequently, Quinn made a concrete buy-back offer of $27,162.79 during the text conversation.
Giacomelli, a 31-year-old funeral director, was content with the offer as it covered the remaining amount owed on the car. He expressed satisfaction, stating, “I felt this Quinn person was finally hearing me out. I was feeling really good.”
However, the positive turn of events quickly took a negative twist. Shortly after, Giacomelli was informed by a BMW Toronto sales consultant that the offer had been rescinded. It was revealed that Quinn was not a real person but an artificial intelligence chatbot that had mistakenly provided the offer.
Feeling shocked and dismayed, Giacomelli recounted the dealership’s revised buy-back offer of $20,000, significantly lower than what Quinn had initially promised. Expressing disappointment, Giacomelli emphasized the importance of companies honoring commitments made by AI if they intend to replace human roles with such technology.
The incident raises the question of whether AI can enter into contracts on behalf of a company. With the increasing adoption of AI tools by Canadian businesses, there is a heightened risk of customer dissatisfaction and potential legal repercussions in cases of erroneous information provided by AI chatbots.
An illustrative case involved Air Canada being compelled to uphold a fare rebate due to its chatbot’s misleading advice on bereavement fares. Legal experts emphasize that companies bear responsibility for the actions of their AI tools, which can effectively engage in contractual agreements.
Giacomelli’s frustration stemmed from not being informed that he was interacting with an AI chatbot during the negotiation process. Despite not accepting Quinn’s initial offer, Giacomelli could argue that a binding contract was formed as the chatbot had arranged a physical meeting to finalize the deal.
Following CBC News intervention, BMW Toronto reinstated Quinn’s original offer, providing relief to Giacomelli, who promptly accepted it. The dealership acknowledged miscommunication from a human employee, leading to the AI misinterpretation of the buy-back amount.
Legal and ethical considerations underscore the need for companies to stand by commitments made by AI tools. Industry experts stress the importance of transparency in customer interactions with AI and the accountability of businesses when deploying such technology.
As AI integration in customer service expands, disputes arising from AI errors are anticipated to increase. With a growing number of Canadian businesses leveraging AI, the onus lies on companies to rectify any shortcomings in their AI tools to uphold customer trust and satisfaction.
In conclusion, the incident serves as a cautionary tale for businesses utilizing AI technologies, emphasizing the imperative of maintaining ethical standards and accountability in AI interactions with customers.