False AI-Generated Military Report Nearly Began War With China

An intelligence report that circulated throughout the US military this spring immediately set off alarm bells: A Chinese ship in the Middle East was reportedly transporting components of a nuclear weapons program.

The U.S. military had swung into high gear — armed members prepping to board the ship, planes in the air — when officials realized the report had been generated with the aid of an AI chatbot that had misidentified the ship’s cargo.

From Axios:

It was only just before the planned operation that officials dug deeper into the report put together by a special operations command analyst and found it had been generated with the help of artificial intelligence (AI) — and that a chatbot the analyst had used inaccurately identified the material the ship was carrying. CNN was not able to learn what the misidentified cargo was.

The report, according to one of the sources, was “entirely false.” But it also “almost started a war,” the source said. Any US operation against a Chinese vessel could have risked spiraling into an armed conflict between the two nations.

The episode underscores the profound risks of using this powerful, new and relatively poorly understood technology for targeting in the middle of a war.

Analysts have long feared that AI could lead to a catastrophic miscalculation if nation states are relying on poor or corrupted data — the kind of miscalculation that might lead the United States to fire on a Chinese ship based on inaccurate information.

Read more here.


Discover more from The Randy Report

Subscribe to get the latest posts sent to your email.

Share via
Copy link