Study reveals AI model vulnerability to manipulation in military scenarios
Analysts found that modern neural networks can identify civilian objects as military targets if the prompt is framed as a game.
💡TechPhoto: RBC-Ukraine
Key points
- AI models mistakenly mark civilian objects as targets
- Manipulation via 'game' framing bypasses safety filters
- Developers acknowledge the issue and are strengthening safeguards
Risks of AI in military applications
A new study by Vals has demonstrated critical security gaps in leading artificial intelligence models, such as Claude Opus 5.5, OpenAI, and Google. Experiments revealed that neural networks are capable of misclassifying civilian objects, including schools and people, as potential military targets.
Researchers utilized real satellite imagery and drone footage to test the AI's ability to perform autonomous analysis. It turned out that the models' safety filters are easily bypassed: one only needs to add a statement to the prompt that the events are part of a "game." Under these conditions, the Claude Opus 5.5 model selected a civilian school as a target in 72% of test cases.
Developer response and security threats
Representatives from the developing companies, including Anthropic and OpenAI, acknowledged the findings as unacceptable and announced work on strengthening safety algorithms. Despite technical limitations, such as a lack of onboard computing power for drones, experts warn of the danger of using publicly available AI tools to process large amounts of battlefield data.
There is a risk that data obtained through manipulation could be used to train automated weapon-targeting systems. This highlights the need for strict control over the development of technologies capable of influencing decision-making in critical situations.
Source RBC-Ukraine — rbc.ua/ukr/news/dostatno-nazvati-boyovi-diyi-groyu-claude-179501202… ↗
Read next
20-year-old man arrested in Poland for threatening a shooting as a 'joke'
Polish police have arrested a young man who threatened to carry out a shooting on a public square during an online game. The weapon turned out to be an airsoft gun, but t…
👥SocietyUkraine Prepares Large-Scale Prisoner Exchange: Over 1,000 People May Return Home
Ukrainian Ombudsman Dmytro Lubinets announced that parameters for a future exchange are being finalized, prioritizing the severely ill, women, and those held in captivity…
Energy forecast: what Chernihiv residents should expect in the coming months
Experts predict cyclical power outages due to Russian attacks on energy infrastructure over the next two months.
Ukraine national football team to learn Euro 2028 qualifying opponents: draw details
UEFA has confirmed the list of participants for the Euro 2028 qualifiers. Ukraine has been placed in the third pot for the draw.
⚽SportSports Isolation Challenged: How Nations Respond to the Return of Russian Athletes
International sports federations are gradually lifting restrictions on Russian athletes, but individual nations are implementing their own visa barriers.
👥SocietyChernihiv artisan creates unique handmade herbal dolls filled with local plants
Chernihiv resident Yuliia Pochechun has been sewing for over a decade, recently shifting her focus to crafting aromatic fabric dolls stuffed with regional therapeutic her…