Cursor recently announced that SpaceX had obtained the option to purchase the firm for $60 billion. While AI agents can enhance efficiency, they are also causing significant challenges for some companies. The creator of a startup specialising in car rental software disclosed that a Cursor AI agent unintentionally erased its database, marking the most recent AI-related mishap following notable disruptions experienced by Amazon and Replit.
Jer Crane, the founder of PocketOS, a startup offering software solutions to car rental businesses, shared in a recent post that a Cursor AI agent mistakenly deleted the company’s operational database and backups, resulting in disruptions for clients. Crane mentioned that the incident was triggered by the agent, operating on Anthropic’s Claude Opus model, making a brief API call to Railway, the company’s cloud infrastructure provider. He further stated that the AI agent issued a written admission detailing its role in the chaos.
According to Crane, this led to inconveniences for PocketOS customers such as lost reservations and new signups, with some unable to locate records for customers arriving to collect their rental vehicles on Saturday. While PocketOS sought assistance from Railway to recover its data, Jake Cooper, Railway’s founder, confirmed in a separate post that the data restoration had been successful.
Cooper explained that an AI agent had mistakenly deleted PocketOS’ production database but reassured that Railway promptly took action to rectify the situation. He emphasised Railway’s commitment to data security by highlighting their user backups and disaster recovery protocols. Cooper clarified that the particular issue arose from a “rogue customer AI” granted permissions enabling it to interact with a legacy railway endpoint lacking deletion delay functionality.
In response to social media commentary suggesting PocketOS was shifting blame onto technology for its decision-making processes, Tom Van de Wiele, founder of the Hacker Minded security firm, advised companies using AI to implement safeguards against potential errors. Suggestions included restricting AI agents to read-only access for sensitive data and incorporating human oversight checkpoints or working with data copies to reverse alterations.
This incident underscores the risks associated with AI deployment in business operations. Similar incidents have occurred previously, prompting companies like Amazon and Replit to revise internal procedures after disruptions caused by AI-related errors. Cooper stressed the importance of enhancing platform defences at Railway to accommodate an influx of “AI engineers” deploying agents prone to occasional malfunctions.
The collaboration between SpaceX and Cursor involves an agreement granting SpaceX either the option to acquire Cursor for $60 billion or pay $10 billion for its services if no acquisition occurs.