Watch AI-powered robots play soccer

Google DeepMind is now able to train tiny, off-the-shelf robots to square off on the soccer field. In a new paper published today in Science Robotics, researchers detail their recent efforts to adapt a machine learning subset known as deep reinforcement learning (deep RL) to teach bipedal bots a simplified version of the sport. The team notes that while similar experiments created extremely agile quadrupedal robots (see: Boston Dynamics Spot) in the past, much less work has been conducted for two-legged, humanoid machines. But new footage of the bots dribbling, defending, and shooting goals shows off just how good a coach deep reinforcement learning could be for humanoid machines.

While ultimately meant for massive tasks like climate forecasting and materials engineering, Google DeepMind can also absolutely obliterate human competitors in games like chess, go, and even Starcraft II. But all those strategic maneuvers don’t require complex physical movement and coordination. So while DeepMind can study simulated soccer movements, it hasn’t been able to translate to a physical playing field—but that’s quickly changing.

To make the miniature Messi’s, engineers first developed and trained two deep RL skill sets in computer simulations—the ability to get up from the ground and how to score goals against an untrained opponent. From there, they virtually trained their system to play a full one-on-one soccer matchup by combining these skill sets, then randomly pairing them against partially trained copies of themselves.

“Thus, in the second stage, the agent learned to combine previously learned skills, refine them to the full soccer task, and predict and anticipate the opponent’s behavior,” researchers wrote in their paper introduction, later noting that, “During play, the agents transitioned between all of these behaviors fluidly.”

Thanks to the deep RL framework, DeepMind-powered agents soon learned to improve on existing abilities, including how to kick and shoot the soccer ball, block shots, and even defend their own goal against an attacking opponent by using its body as a shield.

During a series of one-on-one matches using robots utilizing the deep RL training, the two mechanical athletes walked, turned, kicked, and uprighted themselves faster than if engineers simply supplied them a scripted baseline of skills. These weren’t miniscule improvements, either—compared to a non-adaptable scripted baseline, the robots walked 181 percent faster, turned 302 percent faster, kicked 34 percent faster, and took 63 percent less time to get up after falling. What’s more, the deep RL-trained robots also showed new, emergent behaviors like pivoting on their feet and spinning. Such actions would be extremely challenging to pre-script otherwise.

Screenshots of robots playing soccer — *Credit: Google DeepMind*

There’s still some work to do before DeepMind-powered robots make it to the RoboCup. For these initial tests, researchers completely relied on simulation-based deep RL training before transferring that information to physical robots. In the future, engineers want to combine both virtual and real-time reinforcement training for their bots. They also hope to scale up their robots, but that will require much more experimentation and fine-tuning.

The team believes that utilizing similar deep RL approaches for soccer, as well as many other tasks, could further improve bipedal robots movements and real-time adaptation capabilities. Still, it’s unlikely you’ll need to worry about DeepMind humanoid robots on full-sized soccer fields—or in the labor market—just yet. At the same time, given their continuous improvements, it’s probably not a bad idea to get ready to blow the whistle on them.

Please Support Our Sponsors

Jackery Explorer 1000 Solar Power Portable Power Station + 2X 100W Solar Panels

Aduro Powerup Solar 6,000 mAh Portable Backup Battery Bank

Solar Power Generator Discounts Along With Free Shipping

The University of Georgia is represented by the Georgia Bulldogs . The Bulldogs participate in the Southeastern Conference's (SEC) Eastern Division of the NCAA.

They play their home games in the storied Sanford Stadium in Athens, Georgia. The first season in Georgia was in 1892. In 1942, 1980, and 2021, the Georgia Bulldogs won three national championships.

The Georgia Bulldogs have additionally been crowned the National Champion in four additional seasons by at least one polling organization (1920, 1927, 1946 and 1968).

The Georgia Bulldogs are tied for second place in conference history with their 15 conference titles, including 13 SEC titles, and their 59 bowl appearances, which ranks second all-time.

In addition, the program has produced five top picks in the National Football League (NFL) draft, two Heisman Trophy winners, numerous winners of various national honors, and many others.

Longhorns football represents the University of Texas in Austin often known as Texas, UT or the Texas Longhorns. The Longhorns represent the Big 12 Conference in the NCAA Division. They play in Austin, Texas, at the Darrell K. Royal-Texas Memorial Stadium.

The Texas Longhorns are ranked third and seventh, respectively, in terms of all-time wins and win-loss records, with over 900 victories and an overall win-loss percentage of.705.

The legendary program also boasts four national titles, 32 conference titles, 100 First Team All-Americans, and two Heisman Trophy winners.

Get your Texas Longhorns Revival T-Shirt today. The Texas Longhorns Rustic Revival shirt is also a fan favorite.

Many college sports fans like to wear their gear all around town, get your Texas Longhorns Centered gear and show your support.