Very interesting and not at all surprising. I could not work out in the article was this in a training flight sim or did they load the AI into an F16 and they performed this test in Real Life skies?
-------------
My thoughts on Combat AI, because no one asked:
Humans make mistakes and are limited to their life experiences in making observations and forming perceptions to then act upon.
I've seen weapons POV footage of an attack helecopter eviscerating a whole crowd of people because one of them was a photojournalist with a camera with a long tube-like lens which the (human) pilot thought was a ground to air missile launcher. In hindsite an obvious mistake, however 20+ people no longer exist because one mans judgement of a situation was not correct and he shot a group of dudes all full of holes.
But that was just one man. Had another pilot been rota'd in to patrol that day and been in the same position, would he have made the same mistake? Would another pilot who in their down time owned and used that type of camera recreationally, have seen a camera or a missile launcher? Maybe. Maybe not. Probably not.
A valid concern with granting the power of life and death to a mass-produced intelligence system is with cookie-cutter ability, judgement and execution of action, if there is a flaw in that ability, even if it is a justifiable mistake as with the helicopter pilot, that misconception isn't just in one individual - it's the entire production run of potentially many thousands of individuals. And you thought the Boing 737 Max issue was a biggie?
View: https://www.youtube.com/watch?v=fOUFdQmLVR8
I am not anti AI, I believe there is great potential for human/AI coexistence. But as demonstrated by these excellent abilities, if an intelligence is good enough to be as pinpoint accurate in regard to lethality, I dearly hope it would be able to perform, and choose to perform, its function in a less lethal manner... Although I do say that in regard to Human intelligence as well as machine, because (to quote Guy Martin) when you dead, you dead. If AI's are to be permitted to learn and grow and expand, and also possess the power to end another sentient intelligent individuals existence, an important lesson for them as well as every human being, is that due to their learning and experiences every individual both meat and machine is unique and once gone is gone permanently and irreversibly.