Saturday, May 21, 2022
  • About us
    • Write for us
    • Disclaimer
    • Terms of use
    • Privacy Policy
  • RSS Feeds
  • Advertise with us
  • Contact us
DefenceTalk
  • Home
  • Defense News
    • Defense & Geopolitics News
    • War Conflicts News
    • Army News
    • Air Force News
    • Navy News
    • Missiles Systems News
    • Nuclear Weapons
    • Defense Technology
    • Cybersecurity News
  • Military Photos
  • Defense Forum
  • Military Videos
  • Military Weapon Systems
    • Weapon Systems
    • Reports
No Result
View All Result
  • Home
  • Defense News
    • Defense & Geopolitics News
    • War Conflicts News
    • Army News
    • Air Force News
    • Navy News
    • Missiles Systems News
    • Nuclear Weapons
    • Defense Technology
    • Cybersecurity News
  • Military Photos
  • Defense Forum
  • Military Videos
  • Military Weapon Systems
    • Weapon Systems
    • Reports
No Result
View All Result
DefenceTalk
No Result
View All Result

US Army research leads to more effective training model for robots

by Army News Service
January 4, 2021
in Army News
2 min read
0
US Army research leads to more effective training model for robots

New Army research reduces the unpredictability of current training reinforcement learning policies so that they are more practically applicable to physical systems, especially ground robots. These learning components will permit autonomous agents to reason and adapt to changing battlefield conditions. (Photo illustration / U.S. Army)

14
VIEWS

Multi-domain operations, the Army’s future operating concept, requires autonomous agents with learning components to operate alongside the warfighter. New Army research reduces the unpredictability of current training reinforcement learning policies so that they are more practically applicable to physical systems, especially ground robots.

These learning components will permit autonomous agents to reason and adapt to changing battlefield conditions, said Army researcher Dr. Alec Koppel from the U.S. Army Combat Capabilities Development Command, now known as DEVCOM, Army Research Laboratory.

The underlying adaptation and re-planning mechanism consists of reinforcement learning-based policies. Making these policies efficiently obtainable is critical to making the MDO operating concept a reality, he said.

According to Koppel, policy gradient methods in reinforcement learning are the foundation for scalable algorithms for continuous spaces, but existing techniques cannot incorporate broader decision-making goals such as risk sensitivity, safety constraints, exploration and divergence to a prior.

Designing autonomous behaviors when the relationship between dynamics and goals are complex may be addressed with reinforcement learning, which has gained attention recently for solving previously intractable tasks such as strategy games like go, chess and videogames such as Atari and Starcraft II, Koppel said.

Prevailing practice, unfortunately, demands astronomical sample complexity, such as thousands of years of simulated gameplay, he said. This sample complexity renders many common training mechanisms inapplicable to data-starved settings required by MDO context for the Next-Generation Combat Vehicle, or NGCV.

“To facilitate reinforcement learning for MDO and NGCV, training mechanisms must improve sample efficiency and reliability in continuous spaces,” Koppel said. “Through the generalization of existing policy search schemes to general utilities, we take a step towards breaking existing sample efficiency barriers of prevailing practice in reinforcement learning.”

Koppel and his research team developed new policy search schemes for general utilities, whose sample complexity is also established. They observed that the resulting policy search schemes reduce the volatility of reward accumulation, yield efficient exploration of an unknown domains and a mechanism for incorporating prior experience.

“This research contributes an augmentation of the classical Policy Gradient Theorem in reinforcement learning,” Koppel said. “It presents new policy search schemes for general utilities, whose sample complexity is also established. These innovations are impactful to the U.S. Army through their enabling of reinforcement learning objectives beyond the standard cumulative return, such as risk sensitivity, safety constraints, exploration and divergence to a prior.”

Notably, in the context of ground robots, he said, data is costly to acquire.

“Reducing the volatility of reward accumulation, ensuring one explores an unknown domain in an efficient manner, or incorporating prior experience, all contribute towards breaking existing sample efficiency barriers of prevailing practice in reinforcement learning by alleviating the amount of random sampling one requires in order to complete policy optimization,” Koppel said.

The future of this research is very bright, and Koppel has dedicated his efforts towards making his findings applicable for innovative technology for Soldiers on the battlefield.

“I am optimistic that reinforcement-learning equipped autonomous robots will be able to assist the warfighter in exploration, reconnaissance and risk assessment on the future battlefield,” Koppel said. “That this vision is made a reality is essential to what motivates which research problems I dedicate my efforts.”

The next step for this research is to incorporate the broader decision-making goals enabled by general utilities in reinforcement learning into multi-agent settings and investigate how interactive settings between reinforcement learning agents give rise to synergistic and antagonistic reasoning among teams.

According to Koppel, the technology that results from this research will be capable of reasoning under uncertainty in team scenarios.

Tags: Autonomous vehiclesrobotstrainingus army
Previous Post

German government at odds over armed drones

Next Post

Microsoft says ‘SolarWinds’ hackers viewed internal code

Related Posts

German Weapons Exports Decline Significantly

Prague to get German tanks in exchange for Ukraine aid

May 19, 2022

The Czech Republic will receive 15 Leopard 2 A4 tanks from Germany in exchange for military equipment it sent Ukraine,...

PzH 2000 Self-propelled Howitzer

Germany to send self-propelled howitzers to Ukraine

May 6, 2022

Germany will send seven self-propelled howitzers to Ukraine, the defence ministry said Friday, ramping up deliveries of heavy weapons to...

Next Post
US government says agencies hit by massive cyberattack

Microsoft says 'SolarWinds' hackers viewed internal code

Latest Defense News

EU warns Belarus opening door to Russian nukes after vote

New military bases in western Russia in response to NATO expansion: minister

May 20, 2022
NATO warns Russia readying for ‘full-scale attack’ on Ukraine

Signs multiply Russia seeks control of south Ukraine

May 20, 2022
Biden to announce anti-gun violence measures

Biden begins Asia trip in South Korea, under North nuclear shadow

May 20, 2022
Russian Army Receives More Iskander-M Tactical Ballistic Missile System

Belarus buys S-400, Iskander missiles from Russia: Lukashenko

May 20, 2022
Turkey seeks alternatives to Russian energy after warplane crisis

Erdogan urges NATO allies to ‘respect’ concerns over Finland, Sweden

May 19, 2022
North Korea

North Korea ‘ready for nuclear test’ with Biden due in Seoul

May 19, 2022

Defense Forum Discussions

  • Republic of Korea AF (ROKAF)
  • Helo Jumping with Dutch Marines
  • The Russian-Ukrainian War Thread
  • The German Bundeswehr - a "Paper Tiger?"
  • China - Geostrategic & Geopolitical.
  • NZDF General discussion thread
  • Royal Australian Navy Discussions and Updates 2.0
  • Australian Army Discussions and Updates
  • International Army News Thread
  • Royal Australian Air Force [RAAF] News, Discussions and Updates
DefenceTalk

© 2003-2020 DefenceTalk.com

Navigate Site

  • Defence Forum
  • Military Photos
  • RSS Feeds
  • About us
  • Advertise with us
  • Contact us

Follow Us

No Result
View All Result
  • Home
  • Defense News
    • Defense & Geopolitics News
    • War Conflicts News
    • Army News
    • Air Force News
    • Navy News
    • Missiles Systems News
    • Nuclear Weapons
    • Defense Technology
    • Cybersecurity News
  • Military Photos
  • Defense Forum
  • Military Videos
  • Military Weapon Systems
    • Weapon Systems
    • Reports

© 2003-2020 DefenceTalk.com