StemCell Therapy

In a study earlier this year accepted to the Genetic and Evolutionary Computation Conference (GECCO) 2020, Google researchers investigate the properties of AI software agents that employ self-attention bottlenecks. They claim that these agents not only demonstrate an aptitude for solving challenging vision-based tasks, but that theyre better at tackling slight modifications of the tasks, due to their blindness to details that might confuse them.

Inattentional blindness is the phenomenon that causes a person to miss things in plain sight; its a consequence of selective attention, a mechanism thats believed to enable humans to condense information into a form compact enough for decision-making. Luminaries like Yann LeCunassert it can inspire the design of AI systems that better mimic the elegance and efficiency of biological organisms.

The Google researchers proposed agent AttentionAgent aims to devote most of its attention to task-relevant elements, ignoring distractions. To achieve this, the system segments input images into patches and relies on a self-attention architecture to vote on patches and elect a subset. The elected patches guide AttentionAgents actions as it keeps apprised of changes in the input data, tracking how important factors evolve over time.

In experiments, the team showed that AttentionAgent learned to attend to a range of regions in the images. For instance, they trained it to survive on a level within VizDoom, a digital research environment built on the first-person shooter game Doom, even in environments with walls, floor textures, and signage that it hadnt encountered before. And on the CarRacing game within OpenAIs Gym, a toolkit for developing and comparing reinforcement learning algorithms, AttentionAgent learned to drive during a sunny day and transfer its skills to driving at night, on a rainy day, in a different car, with brighter or darker scenery, and in the presence of visual artifacts. Perhaps more impressively, training in CarRacing required 1,000 times fewer parameters the variables internal to the system that inform its predictions than conventional methods that fail to generalize.

Despite the encouraging results, the researchers note AttentionAgent has serious limitations. It doesnt generalize to cases where dramatic background changes are involved, for example; an agent trained on the CarRacing with a green grass background failed to generalize when the background was replaced with distracting YouTube videos. When the background was replaced with uniform noise, the agent attended to random patches of noise. And while training an agent from scratch with the noisy background enabled it to get around the track, its performance was mediocre.

To motivate future, improved work in selective attention, the researchers released a suite of car racing tasks that involve environmental modifications. Its now available in open source on GitHub. The simplistic method we use to extract information from important patches may be inadequate for more complicated tasks, wrote coauthors Yujin Tang, a research software engineer at Google, and David Ha, a staff research scientist at Google Research in Tokyo. How we can learn more meaningful features, and perhaps even extract symbolic information from the visual input will be an exciting future direction.

See original here:
Google builds AI agent that learns to generalize to new environments by ignoring distractions - VentureBeat

This entry was posted on June 22, 2020 at 5:45 am and is filed under Blindness. You can follow any responses to this entry through the RSS 2.0 feed. Both comments and pings are currently closed. |