The latest Star Wars movie, Rogue One introduces us to a new droid K-2SO that is the robotic lead of the story.
Without giving away too many spoilers, K-2SO is part of the Rebellion freedom fighter group that are tasked with stealing the plans to the first Death Star, the infamous moon-sized battle station from the original Star Wars movie.
The significance of K-2SO is his back-story. K-2SO is an autonomous military robot that used to fight for the Rebellion’s enemy – the Imperial Empire. He was captured and reprogrammed by the rebels and is now a core member of Rogue One group.
K-2SO is not the first robot to swap sides in a movie. Remember the Terminator’s initial mission was to kill Sarah Connor in the first movie, before being reprogrammed in later movies to protect her and her son John Connor.
This does then raise the question of whether in real life a programmed military machine could be encouraged, reprogrammed or hacked to defect.
Soldiers swapping sides
The idea of human soldiers swapping sides during wars and conflicts is nothing new. There are numerous examples of soldiers surrendering and then announcing that they have information and would like to help and sometimes fight for their captors.
It is the information about battle plans and tactics that these defecting soldiers have that could potentially change the course of a battle or a military campaign.
One of the most famous defectors was General Benedict Arnold. Arnold was a general of the American Army during the American War of Independence, but he defected to the British Army and became a brigadier general. He led British forces against the Americans and retired to London after the war.
Weapons technology
The industrial revolution and the rise of mechanical weapons such as tanks, aircraft and submarines in the early 20th century changed the nature of defecting.
It was the development of more and more advanced weapons that gave a nation its advantage over its military rivals. Stealing an enemy’s new weapons was almost impossible and so it was up to defectors to deliver the plans of the new weapons or sometimes, examples of the actual weapons to the other side.
Martin Monti, of the United States Army Air Corps, defected to Italy during 1944 and handed over a photographic reconnaissance version of the P-38 Lightning aircraft to the Nazi military. He then joined the Nazi SS.
In 1976, during the Cold War, Viktor Belenko, flew his highly-secret MiG-25 jet fighter from the USSR to Japan.
NATO had long wanted to get the technical details of this aircraft as it was rumoured to be able to fly three times faster than the speed of sound.
Japan gave the US access to the MiG and Belenko was eventually granted citizenship of the US. The plane was stripped and analysed by the Americans who also had a copy of the aircraft’s technical manual that Belenko had also brought with him.
Defectors not necessary
In the 21st century we have seen the development of remotely controlled systems for reconnaissance, surveillance and the delivery of weapons to targets. Such systems are likely to be very important in the future of defence capabilities.
As this equipment does not require a person on-board, it means that human defectors or spies are no longer required to deliver this robotic hardware to the opposition.
It is impossible to know for sure when the first unmanned system was successfully captured. But because these systems rely on external radio commands and infrastructure, such as GPS, it is plausible that they can be taken over and captured and it has almost certainly already happened.
In 2011, a US Air Force drone came down in Iran and was recovered by the Iranian state. That aircraft was a highly secretive RQ-170 stealth drone and the Iranians claimed that they had “spoofed” the drone into landing in Iran by creating fake GPS signals.
Experts in the US doubted those claims, but however the drone was captured, Iran ended up with a nearly intact state-of-the-art stealth drone.
They put it on display to international media and stated that they would reverse engineer it and create their own version of this high-tech robotic surveillance aircraft. Iran now appears to have a squadron of these stealth drones, all based on the original captured aircraft.
Trusting autonomous robots
An obvious way to prevent the claimed GPS-spoofing or other similar hacks is to create systems that are truly autonomous and do not require or use external communication systems.
Such robots should be immune to hacking once deployed on their missions. But the development and use of truly autonomous robot weapon systems is a controversial topic.
The Campaign to Stop Killer Robots was launched in 2013 to both educate the general public about the possible dangers of autonomous killer robots and to try and influence the highest-level decision makers in governments and at the United Nations that such robots should be banned.
The principal of the campaign is that a human should make the final decision before a weapon is launched at its intended target.
The International Committee of the Red Cross has pointed out that the so-called “rules of war” must be coded into autonomous military robots of the future.
Some robotics engineers and researchers are working on exactly this and have started to develop the algorithms that will enable autonomous military robots to be ethical. They propose that robots may be able to be protect civilians better than human soldiers.
But all of this assumes that the human creators of the robots are acting ethically and want the robots to also be ethical.
What happens if a future autonomous soldier robot is tasked with doing something that it decides goes against its code of ethics? Will it just say “no”, or will it conclude that the most appropriate action is to turn on its owner? Would it defect to the other side? How would loyalty be built into an autonomous robot and how would the robot’s creator ensure that it could be trusted to not switch sides?
In the coming years you are likely to read dozens of stories about research into trusted autonomy. It is a hot research topic and a critically important one as the world begins to outsource its fighting to robots.
Rogue One: A Star Wars Story may be set a long time ago in a galaxy far, far away, but its plot lines are actually based in our reality.
Dealing with states that build frightening new weapons, stealing plans to those weapons and then fighting back with robots is not science fiction. And it may be that soon we see those fighting robots turn on their creators.
This article was originally published on The Conversation.
Comments
26 responses to “‘Rogue One’ Highlights An Uncomfortable Fact: Military Robots Can Change Sides”
I thought we figured that out already, over and over, from the Terminator series.
Not to mention in the third movie, that T-800 was actually responsible for killing John Connor in the future, before being sent back by his wife to save them in the past. More to the point, that T-800 was chosen by Skynet specifically because of the emotional connection that John would have to its appearance.
Cheers for the spoiler in the title for those of us who haven’t seen it ? grrrr!!!
100% this, what the fuck Kotaku?!
It’s in the initial teaser and trailer, the toys, the colouring books, the posters, and K2’s first line when he appears on screen. Even I knew what K2SO was and I avoided all the media leading up to the film. It’s hardly a spoiler.
It’s hardly a spoiler for the movie. A droid character is introduced as having been, in the past, reprogrammed. That’s it.
But if I have avoided spoilers so far how am I to know this? Is your answer that I should read further into this topic and expose myself to further spoilers?
Yup I have basically avoided all contact with Rogue One media for some time now and that info about the droid wasn’t privy to me before hand. Haven’t seen any toys etc so yes for some of us……..it is considered a spoiler, albeit as you say a mild one but a spoiler nonetheless
Sorry spoonie was meant to reply to the aptly named ‘itsinthetrailer’
All good, I’m in the same case, seen very little about it, but happy to hear its a minor spoiler.
Just about to see it, regret jumping on Kotaku now…
Is that a fucking spoiler in the title of the article?
no.
Terminator isn’t the only prime example, there’s also a certain robotic entity from a certain other well known space game series as well. If science fiction, beginning with Asimov, has taught us anything it’s that truly autonomous robots are going to either be too human or too logical in their decisions. Ultimately though, a robot is only as good as the person who programmed it and since at this point it’s humans programming robots, there are all sorts of opportunities for mistakes to be made.
Wtf is with the potential spoiler in the headline!?
It’s really not a spoiler guys. K-2SO doesn’t “defect” during the film, it’s just mentioned when he is introduced that he used to be an imperial droid.
Yes but people who haven’t seen the film don’t know that.
Then don’t flip the fk out on an assumption lol
You even see him in the trailer with Imperial Logos clearly displayed on him, while he helps the Rogue One crew.
As someone who went into the cinema with zero knowledge of the movie beyond “it’s a side-story tie-in,” and thought it would be set between 6-7 or 7-8… what is and isn’t a spoiler is pretty darn subjective.
This isn’t new information. Yet again something plucked from the bones of the EU. There’s numerous sentient droid species capable of choosing their own morality.
That had better not be a fucking spoiler in the title of the article. >:|
It’s not. But if it was, would it really ruin your enjoyment of the movie?
This one is a bit vague so maybe not, but it sets a bad precedent if headlines become fair game for plot twists.
And a major plot point in The Force Awakens was spoiled for me in the first week of its release, so I’m really trying to be more spoiler avoidy this year.
-edit-
Further back, David Letterman ruined the Sixth Sense before it was even released in Australia. Not cool.
I infuriated a bunch of Cracked.com readers on the day of its release by spoiling the two biggest points, it was glorious 😀
That being said though I’m the kind of person that doesn’t give a shit about spoilers and I genuinely do not and don’t think I ever will understand people that get so uppity about knowing what happens in a [media of choice] before consuming said media. In some ways, I welcome them; especially if it’s a garbage plot that doesn’t get any better (or worse!) as the movie goes on.
Interestingly, every single book of the OT spoiled the movie – each book was released ahead of the movies.
Back to the point though – a spoiler really would affect your enjoyment of a movie? I find it so peculiar.