I reported on this 3 months ago; and glad to see others seeing the light.
While debate has focused on moral and legal issues of autonomous weapons, too little attention has been paid to the material dangers of an AI-powered war.
With huge leaps taking place in the world of artificial intelligence (AI), right now, experts have started asking questions about the new forms of protection we might need against the formidable smarts and potential dangers of computers and robots of the near future.
But do robots need protection from us too? As the ‘minds’ of machines evolve ever closer to something that’s hard to tell apart from human intelligence, new generations of technology may need to be afforded the kinds of moral and legal protections we usually think of as ‘human’ rights, says mathematician Marcus du Sautoy from the University of Oxford in the UK.
Du Sautoy thinks that once the sophistication of computer thinking reaches a level basically akin to human consciousness, it’s our duty to look after the welfare of machines, much as we do that of people.
Posted in biotech/medical, ethics, genetics, law
As specialists gather in private to discuss a grand plan for constructing a human genome, Drew Endy and Laurie Zoloth argue that such an enormous moral gesture should not be discussed behind closed doors.
Credit: Mario Tama/Getty Images.
At Harvard today, an invitation-only group of about 150 scientists, lawyers, and entrepreneurs, met to discuss if and how to construct from scratch an entire human genome – the heritable genetic material that in nature is transferred from parents to children.
This is NOT the way to encourage people to use this device, nor develop anything for it at all. Shame on them!
“By submitting User Content through the Services, you grant Oculus a worldwide, irrevocable, perpetual (i.e. lasting forever), non-exclusive, transferable, royalty-free and fully sublicensable (i.e. we can grant this right to others) right to use, copy, display, store, adapt, publicly perform and distribute such User Content in connection with the Services. You irrevocably consent to any and all acts or omissions by us or persons authorized by us that may infringe any moral right (or analogous right) in your User Content.”
The Oculus Rift is starting to ship, and we’re pretty happy with it. While it’s cool, like any interesting gadget, it’s worth looking through the Terms of Service, because there are some worrisome things included.
Quite a few of the items in the document are pretty typical in any sort of Terms of Service agreement. These include details like waiving your right to a juried trial and agreeing to go into arbitration instead. Oculus can also terminate your service for myriad reasons, and third parties can collect information on you. However, there are some even more devilish details in the Rift’s full Terms of Service.
Oculus (and basically Facebook) owns creative content
If you create something with the Rift, the Terms of Service say that you surrender all rights to that work and that Oculus can use it whenever it wants, for whatever purposes:
Interesting Question to ask.
The battle between the FBI and Apple over the unlocking of a terrorist’s iPhone will likely require Congress to create new legislation. That’s because there really aren’t any existing laws which encompass technologies such as these. The battle is between security and privacy, with Silicon Valley fighting for privacy. The debates in Congress will be ugly, uninformed, and emotional. Lawmakers won’t know which side to pick and will flip flop between what lobbyists ask and the public’s fear du jour. And because there is no consensus on what is right or wrong, any decision they make today will likely be changed tomorrow.
This is a prelude of things to come, not only with encryption technologies, but everything from artificial intelligence to drones, robotics, and synthetic biology. Technology is moving faster than our ability to understand it, and there is no consensus on what is ethical. It isn’t just the lawmakers who are not well-informed, the originators of the technologies themselves don’t understand the full ramifications of what they are creating. They may take strong positions today based on their emotions and financial interests, but as they learn more, they too will change their views.
Imagine if there was a terror attack in Silicon Valley — at the headquarters of Facebook or Apple. Do you think that Tim Cook or Mark Zuckerberg would continue to put privacy ahead of national security?
In SELF/LESS, a dying old man (Academy Award winner Ben Kingsley) transfers his consciousness to the body of a healthy young man (Ryan Reynolds). If you’re into immortality, that’s pretty good product packaging, no?
But this thought-provoking psychological thriller also raises fundamental and felicitous ethical questions about extending life beyond its natural boundaries. Postulating the moral and ethical issues that surround mortality have long been defining characteristics of many notable stories within the sci-fi genre. In fact, the Mary Shelley’s age-old novel, Frankenstein, while having little to no direct plot overlaps [with SELF/LESS], it is considered by many to be among the first examples of the science fiction genre.
Screenwriters and brothers David and Alex Pastor show the timelessness of society’s fascination with immortality. However, their exploration reflects a rapidly growing deviation from the tale’s derivation as it lies within traditional science fiction. This shift can be defined, on the most basic level as the genre losing it’s implied fictitious base. Sure, while we have yet to clone dinosaurs, many core elements of beloved past sic-fi films are growing well within our reach, if not in our present and every-day lives. From Luke Skywalker’s prosthetic hand in Star Wars Episode V: The Empire Strikes Back (1980) to the Matrix Sentinal’s (1999) of our past science fiction films help define our current reality to Will Smith’s bionic arm in I, Robot.
I see articles and reports like the following about military actually considering fully autonomous missals, drones with missals, etc. I have to ask myself what happened to the logical thinking.
A former Pentagon official is warning that autonomous weapons would likely be uncontrollable in real-world situations thanks to design failures, hacking, and external manipulation. The answer, he says, is to always keep humans “in the loop.”
The new report, titled “ Autonomous Weapons and Operational Risk,” was written by Paul Scharre, a director at the Center for a New American Security. Scharre used to work at the office of the Secretary of Defense where he helped the US military craft its policy on the use of unmanned and autonomous weapons. Once deployed, these future weapons would be capable of choosing and engaging targets of their own choosing, raising a host of legal, ethical, and moral questions. But as Scharre points out in the new report, “They also raise critically important considerations regarding safety and risk.”
As Scharre is careful to point out, there’s a difference between semi-autonomous and fully autonomous weapons. With semi-autonomous weapons, a human controller would stay “in the loop,” monitoring the activity of the weapon or weapons system. Should it begin to fail, the controller would just hit the kill switch. But with autonomous weapons, the damage that be could be inflicted before a human is capable of intervening is significantly greater. Scharre worries that these systems are prone to design failures, hacking, spoofing, and manipulation by the enemy.
I am not an astronomer or astrophysicist. I have never worked for NASA or JPL. But, during my graduate year at Cornell University, I was short on cross-discipline credits, and so I signed up for Carl Sagan’s popular introductory course, Astronomy 101. I was also an amateur photographer, occasionally freelancing for local media—and so the photos shown here, are my own.
By the end of the 70’s, Sagan’s star was high and continuing to rise. He was a staple on the Tonight Show with Johnny Carson, producer and host of the PBS TV series, Cosmos, and he had just written Dragons of Eden, which won him a Pulitzer Prize. He also wrote Contact, which became a blockbuster movie, starring Jodie Foster.
Sagan died in 1996, after three bone marrow transplants to compensate for an inability to produce blood cells. Two years earlier, Sagan wrote a book and narrated a film based on a photo taken from space.
Pale Blue Dot is a photograph of Earth taken in February 1990, by Voyager 1 from a distance of 3.7 billion miles (40 times the distance between earth and the sun). At Sagan’s request (and with some risk to the ongoing scientific mission), the space probe was turned around to take this last photo of Earth. In the photo, Earth is less than a pixel in size. Just a tiny dot against the vastness of space, it appears to be suspended in bands of sunlight scattered by the camera lens.
Four years later, Sagan wrote a book and narrated the short film, Pale Blue Dot, based on the landmark 1990 photograph. He makes a compelling case for reconciliation between humans and a commitment to care for our shared environment. In just 3½ minutes, he unites humanity, appealing to everyone with a conscience. [Full text]
—Which brings us to a question: How are we doing? Are we getting along now? Are we treating the planet as a shared life-support system, rather than a dumping ground?
Sagan points out that hate and misunderstanding plays into so many human interactions. He points to a deteriorating environment and that that we cannot escape war and pollution by resettling to another place. Most importantly, he forces us to face the the fragility of our habitat and the need to protect it. He drives home this point by not just explaining it, but by framing it as an urgent choice between life and death.
It has been 22 years since Sagan wrote and produced Pale Blue Dot. What has changed? Change is all around us, and yet not much has changed. To sort it all out, let’s break it down into technology, our survivable timeline and sociology.
Technology & Cosmology
Survivable Timeline
We have an insatiable appetite for raw materials, open spaces, cars and luxury. Yet no one seems to be doing the math. As the vast populations of China and India finally come to the dinner table (2 billion humans), it is clear that they have the wealth to match our gluttony. From where will the land, water, and materials come? And what happens to the environment then? In Beijing, the sky is never blue. Every TV screen is covered in a thick film of dust. On many days, commuters wear filter masks. There is no grass in the parks and no birds in the sky. Something is very wrong. With apologies for a mixed metaphor, the canary is already dead while the jester continues to dance.
Sociology: Man’s Inhumanity to Man
Is it time to revisit Pale Blue Dot? Is it still relevant? The urgency of teaching and heeding Carl Sagan’s words has never been more urgent than now.
Postscript:
Carl Sagan probably didn’t like me. When I was his student, I was a jerk.
Sagan was already a TV personality and author when I took Astronomy 101 in 1977. Occasionally, he discussed material from the pages of his just-released Dragons of Eden, or slipped a photo of himself with Johnny Carson into a slide presentation. He clearly was a star attraction during parent’s weekend before classes started.
Indeed, he often used the phrase “Billions and Billions” even before it led as his trademark. Although he seemed mildly mused that people noticed his annunciation and emphasis, he explained that he thought it was a less distracting alternate to the phrase “That’s billions with a ‘B’ ” when generating appreciation for the vast scope of creation.
At this time that Sagan was my professor, he appeared on the cover of Newsweek magazine. Like a lunkhead, I wrote to Newsweek, claiming that his adulation as a scientist was misplaced and that he was nothing more than an PR huckster for NASA and JPL in the vein of Isaac Asimov. I acknowledged his a gift for popularizing science, but argued that he didn’t have the brains to contribute in any tangible way.
I was wrong, of course. Even in the role of education champion, I failed to appreciate the very powerful and important role that he played in influencing an entire generation of scientists, including, Neil DeGrasse Tyson. Although Newsweek did not publish my letter to the editor, someone on staff sent it to Professor Sagan! When the teaching assistant, a close friend of Sagan, showed me my letter, I was mortified.
Incidentally, I always sat in the front row of the big Uris lecture hall. As a student photographer, I took many photos, which show up on various university web sites from time to time. In the top photo, Professor Sagan is crouching down and clasping hands as he addresses the student seated next to me.