Abril 23, 2018

DeepMind's AlphaGo Zero removes humans from AI equation

19 Octubre 2017, 07:55 | Bibiana Flor

DeepMind's AlphaGo Zero removes humans from AI equation

DeepMind's AlphaGo Zero removes humans from AI equation

Well, here's something to chew on: Google's AI research arm DeepMind, the same benevolent creator that spawned AlphaGo, has already rendered that gluteus maximus-spanking version obsolete.

There are other technical elements that define the new AI, which you can dig into courtesy of DeepMind's paper, published in the scientific journal Nature.

When building the first iterations of AlphaGo, the team explored working on a system like AlphaGo Zero, but then the technology didn't work.

Perhaps we should have seen this coming.

Though extremely impressive, AlphaGo Zero won't replace humans anytime soon.

If, in order to function, AlphaGo learned by basing itself on millions of examples of parts played by humans, AlphaGo Zero - The name of new version - does not need any example.

So, this is why it's taken so long for computers to surpass humans at the game.

Responding to the announcement in a separate editorial for Nature, Satinder Singh, the director of the University of Michigan's AI lab, said Zero "massively outperforms the already superhuman AlphaGo" and could be one of the biggest AI advances so far.

Although DeepMind gained prominence by defeating human Go players, the company has also turned its attention to StarCraft II.

All it needed was a basic set of rules for the game. DeepMind's first paper in Nature past year showed that the algorithm learned for a while from how humans played the game, and then started to play itself to refine those skills. In 21 days, it had beaten the previous version that defeated Ke Jei in all three games.

AlphaGo Zero shows great improvements with respect to all its predecessors.

Approaches using purely reinforcement learning have struggled in AI because ability does not always progress consistently, said David Silver, a scientist at DeepMind who has been leading the development of AlphaGo, at the briefing. "Instead, it is able to learn tabula rasa from the strongest player in the world: AlphaGo itself". AlphaGo Zero, along with AlphaGo Master, each only require a single machine with four TPUs.

The fact that human-guided AlphaGo that defeated Sedol couldn't muster a single win against self-taught AlphaGo Zero had researchers arriving at some rather mind-blowing, and perhaps spine-chilling conclusions.

The latest iteration, however, differs from its predecessors: AlphaGo Zero abandons all hand-engineered features, runs only one neural network (versus the two found in earlier models), and relies exclusively on its own knowledge to evaluate positions. By combining tree search with policy and value networks, AlphaGo has finally reached a professional level in Go, providing hope that human-level performance can now be achieved in other seemingly intractable artificial intelligence domains. Furthermore, the AI will be subject to human limits, since its learning is bounded to pre-existent human knowledge. The game has a rich history, and there's a reason it still captures the imagination of people today. Zero performed so well that it won all 100 matches played. All in less than two months. That's because machines will need to figure out solutions to hard problems even when there isn't a large amount of training data to learn from. Go has fixed rules while humans employ general knowledge and add layers of creativity to it.

They provided no information about how the algorithm has fared in solving other problems.

As for Go, the effects of AlphaGo Zero are likely to be seismic. After three hours, the system's strategy was "greedy stone-capturing", indicative of the human novice. Sure, the behaviors that emerged here are novel, and perhaps unprecedented.

AlphaGo Zero could beat the version of AlphaGo that faced Lee Sedol after training for just 36 hours and earned its 100-o score after 72 hours.

Otras noticias

Tendencias Ahora

ZTE Axon M's Two Screens Support Three Unique Viewing Modes
Finally, there's a traditional mode , which enables to users to interact with the Axon M just like any other smartphone. Both of the displays on the device are full HD in panels and boast of a pixel density of 428ppi.

Microsoft tries again with troubled Surface Book line
Both models have a 3:2 aspect ratio, with resolutions of 3000×2000 and 3240×2160 - a pretty unusual decision on Microsoft's part. Surface Book 2 models come with Intel's eight-gen Core CPU, up to 16GB of RAM, and up to NVIDIA GeForce 1060 graphics inside.

Dozens of Victims and 900 Missing after the Fires in California (Updated)
It's really going to be hard to tell and we'll be talking about the fires from this week from years to come", Kaiser said. Fire officials were investigating whether downed power lines or other utility failures could have sparked the fires.

Girl Scouts of Greater South Texas responds to new Boy Scout changes
The Girl Scouts learned back in January that the Boy Scouts were considering opening their ranks to girls, Margosian said. In fact, what's happening to the Scouts is a microcosm of what's happening to boys around the country - feminization.

Huawei unveils new series of Mate smartphones with top processor
They also support Huawei's SuperCharge tech, which sounds just as fast and reliable as the charging tech on the P10 and P10 Plus . The Chinese smartphone maker also unveiled a Porsche Design Huawei Mate 10 , which is priced at Euro 1,395 (roughly Rs 1,06,600).

Maduro's popularity increases, opposition expected to make gains in regional elections — Venezuela
Sunday's election would seem the perfect forum for Venezuelans to show their displeasure with the socialist government. Even if opposition politicians win 20 states, there are no guarantees they would be able to effectively wield power.

Harvey Weinstein was 'furious' after I rejected his advances — Lena Headey
For me, it has been extremely disturbing, alarming and shocking to see many people I know sharing their stories at #MeToo . How on earth can he not be mentioned? Stirred by the status, men too haven't been far behind in expressing solidarity.

Trump tweets FEMA can't keep aid in Puerto Rico forever
That's a far cry from the president's comments to Puerto Rico on Thursday, when he threatened to cease aid to the island. Several lawmakers, like New York Senator Kirsten Gillibrand (D-NY), already said they're on board.

The ultimate combined XI of Real Madrid and Tottenham
All eyes were on prolific forwards Ronaldo and Kane, who arrived as the tournament's top scorers after two group-stage matches. Real's equaliser came minutes before half-time after the hosts had regained some momentum, but it was avoidable for Spurs.

#MeToo prompts #HowIWillChange for men to discuss harassment
More importantly, it makes room for action that's not stemmed in blame or in Hallmark greeting cards of empathy. She also added that if anybody has been sexually harassed then they can reply to her tweet using '#MeToo '.