A radio transmission between several Russian soldiers in Ukraine in early March, captured from an unencrypted channel, reveals panicked and confused comrades retreating after coming under artillery fire.

“Vostok, I am Sneg 02. On the highway we have to turn left, fuck,” one of the soldiers says in Russian using code names meaning “East” and “Snow 02.”

“Got it. No need to move further. Switch to defense. Over,” another responds.

Later, a third soldier tries to make contact with another codenamed “South 95”: “Yug 95, do you have contact with a senior? Warn him on the highway artillery fire. On the highway artillery fire. Don’t go by column. Move carefully.”

The third Russian soldier continues, becoming increasingly agitated: “Get on the radio. Tell me your situation and the artillery location, approximately what weapon they are firing.” Later, the third soldier speaks again: “Name your square. Yug 95, answer my questions. Name the name of your square!”

As the soldiers spoke, an AI was listening. Their words were automatically captured, transcribed, translated, and analyzed using several artificial intelligence algorithms developed by Primer, a US company that provides AI services for intelligence analysts. While it isn’t clear whether Ukrainian troops also intercepted the communication, the use of AI systems to surveil Russia’s army at scale shows the growing importance of sophisticated open source intelligence in military conflicts.

A number of unsecured Russian transmissions have been posted online, translated, and analyzed on social media. Other sources of data, including smartphone video clips and social media posts, have similarly been scrutinized. But it’s the use of natural language processing technology to analyze Russian military communications that is especially novel. For the Ukrainian army, making sense of intercepted communications still typically involves human analysts working away in a room somewhere, translating messages and interpreting commands.

The tool developed by Primer also shows how valuable machine learning could become for parsing intelligence information. The past decade has seen significant advances in AI’s capabilities around image recognition, speech transcription, translation, and language processing thanks to large neural network algorithms that learn from vast tranches of training data. Off-the-shelf code and APIs that use AI can now transcribe speech, identify faces, and perform other tasks, often with high accuracy. In the face of Russia’s numerical and artillery advantages, intercepting communications may well be making a difference for Ukrainian troops on the ground.

Primer already sells AI algorithms trained to transcribe and translate phone calls, as well as ones that can pull out key terms or phrases. Sean Gourley, Primer’s CEO, says the company’s engineers modified these tools to carry out four new tasks: To gather audio captured from web feeds that broadcast communications captured using software that emulates radio receiver hardware; to remove noise, including background chatter and music; to transcribe and translate Russian speech; and to highlight key statements relevant to the battlefield situation. In some cases this involved retraining machine learning models to recognize colloquial terms for military vehicles or weapons.

The ability to train and retrain AI models on the fly will become a critical advantage in future wars, says Gourley. He says the company made the tool available to outside parties but refuses to say who. “We won’t say who’s using it or for what they’re using it for,” Gourley says. Several other American companies have made technologies, information, and expertise available to Ukraine as it fights against Russian invaders.

The fact that some Russian troops are using unsecured radio channels has surprised military analysts. It seems to point to an under-resourced and under-prepared operation, says Peter W. Singer, a senior fellow at the think tank New America who specializes in modern warfare. “Russia used intercepts of open communications to target its foes in past conflicts like Chechnya, so they, of all forces, should have known the risks,” Singer says. He adds that these signals could undoubtedly have helped the Ukrainians, although analysis was most likely done manually. “It is indicative of comms equipment failures, some arrogance, and possibly, the level of desperation at the higher levels of the Russian military,” adds Mick Ryan, a retired Australian general and author.