Can AI Remain Safe As Companies Race To Develop It?

Artificial intelligence could bestow incredible benefits on society, from faster, more accurate medical diagnoses to more sustainable management of energy resources, and so much more. But in today’s economy, the first to achieve a technological breakthrough are the winners, and the teams that develop AI technologies first will reap the benefits of money, prestige, and market power. With the stakes so high, AI builders have plenty of incentive to race to be first.

When an organization is racing to be the first to develop a product, adherence to safety standards can grow lax. So it’s increasingly important for researchers and developers to remember that, as great as AI could be, it also comes with risks, from unintended bias and discrimination to potential accidental catastrophe. These risks will be exacerbated if teams struggling to develop some product or feature first don’t take the time to properly vet and assess every aspect of their programs and designs.

Yet, though the risk of an AI race is tremendous, companies can’t survive if they don’t compete.

As Elon Musk said recently:

You have companies that are racing – they kind of have to race – to build AI or they’re going to be made uncompetitive. If your competitor is racing toward AI and you don’t, they will crush you.
Is Cooperation Possible?

With signs that an AI race may already be underway, some are worried that cooperation will be hard to achieve.

“It’s quite hard to cooperate,” said AI professor Susan Craw:

… especially if you’re trying to race for the product, and I think it’s going to be quite difficult to police that, except, I suppose, by people accepting the principle. For me safety standards are paramount and so active cooperation to avoid corner cutting in this area is even more important. But that will really depend on who’s in this space with you.
Susan Schneider, a philosopher focusing on advanced AI, added, “Cooperation is very important. The problem is going to be countries or corporations that have a stake in secrecy. … If superintelligent AI is the result of this race, it could pose an existential risk to humanity.”

However, just because something is difficult, that doesn’t mean it’s impossible, and AI philosopher Patrick Lin may offer a glimmer of hope.

“I would lump race avoidance into the research culture. … Competition is good, and an arms race is bad, but how do you get people to cooperate to avoid an arms race? Well, you’ve got to develop the culture first,” Lin suggests, referring to a comment he made in our previous piece on the Research Culture Principle. Lin argued that the AI community lacks cohesion because researchers come from so many different fields.

Developing a cohesive culture is no simple task, but it’s not an insurmountable challenge.

An App That Can Identify The Animal You Saw On Your Hike

The legendary naturalist John Muir once wrote: “Whenever I met a new plant, I would sit down beside it for a minute or a day, to make its acquaintance, hear what it had to tell.” The first step to making an acquaintance is to get a name — and naming nature is not easy. This weekend, while walking through Great Falls Park, a butterfly landed on my friend’s leg. It was large, with yellow and black wings — clearly a swallowtail, but what species? That same day, a large black insect landed on a flower in front of me, and I snapped a portrait of it before it flew off. It was a dragonfly, but what kind of dragonfly?

Many of our experiences of nature take this form. You see something, but you don’t know what it is. You are surrounded by life, but much of it is anonymous. “People don’t identify as a naturalist but if you ask them if they’ve ever been outside, seen something, and wondered what it is, they’ll say: Oh yeah, sure,” says Scott Loarie from the California Academy of Sciences.

You are surrounded by life, but much of it is anonymous.
Loarie and his team have developed an app that can help. Known as iNaturalist, it began as a crowdsourced community, where people can upload photos of animals and plants for other users to identify. But a month ago, the team updated the app so that an artificial intelligence now identifies what you’re looking at. In some cases, it’ll nail a particular species — it correctly pegged the dragonfly I spotted as a slaty skimmer (Libellula incesta). For the butterfly, it was less certain. “We’re pretty sure this is in the genus Papilio,” it offered, before listing ten possible species.