Telegram Group & Telegram Channel
This media is not supported in your browser
VIEW IN TELEGRAM
Еще интересный подход по созданию агентов (на базе Vision language модели) с RLем которые могут пользоваться Android телефоном через GUI

Вначале трейнят offline RL на данных, потом offline-to-online где агент уже сам доучивается в среде. Создали распараллеленный симулятор который одновременно может запускать 64 эмулятора андроида.

Тестировались на датасете Android-in-the-Wild (AitW). VLMка на 1.3B параметров.

* success rate подняли до 67.2%

у другого RL агента который учился через Behavior cloning был - 57.8%

GPT-4V - 8.3%
Gemini 1.5 Pro - 17.7%
17B CogAgent - 38.5%

DigiRL: Training In-The-Wild Device-Control Agents with Autonomous Reinforcement Learning
https://arxiv.org/abs/2406.11896

https://digirl-agent.github.io/
https://github.com/DigiRL-agent/digirl
🔥7👍2



group-telegram.com/AGI_and_RL/800
Create:
Last Update:

Еще интересный подход по созданию агентов (на базе Vision language модели) с RLем которые могут пользоваться Android телефоном через GUI

Вначале трейнят offline RL на данных, потом offline-to-online где агент уже сам доучивается в среде. Создали распараллеленный симулятор который одновременно может запускать 64 эмулятора андроида.

Тестировались на датасете Android-in-the-Wild (AitW). VLMка на 1.3B параметров.

* success rate подняли до 67.2%

у другого RL агента который учился через Behavior cloning был - 57.8%

GPT-4V - 8.3%
Gemini 1.5 Pro - 17.7%
17B CogAgent - 38.5%

DigiRL: Training In-The-Wild Device-Control Agents with Autonomous Reinforcement Learning
https://arxiv.org/abs/2406.11896

https://digirl-agent.github.io/
https://github.com/DigiRL-agent/digirl

BY Агенты ИИ | AGI_and_RL


Share with your friend now:
group-telegram.com/AGI_and_RL/800

View MORE
Open in Telegram


Telegram | DID YOU KNOW?

Date: |

The War on Fakes channel has repeatedly attempted to push conspiracies that footage from Ukraine is somehow being falsified. One post on the channel from February 24 claimed without evidence that a widely viewed photo of a Ukrainian woman injured in an airstrike in the city of Chuhuiv was doctored and that the woman was seen in a different photo days later without injuries. The post, which has over 600,000 views, also baselessly claimed that the woman's blood was actually makeup or grape juice. On Feb. 27, however, he admitted from his Russian-language account that "Telegram channels are increasingly becoming a source of unverified information related to Ukrainian events." Some privacy experts say Telegram is not secure enough Ukrainian forces have since put up a strong resistance to the Russian troops amid the war that has left hundreds of Ukrainian civilians, including children, dead, according to the United Nations. Ukrainian and international officials have accused Russia of targeting civilian populations with shelling and bombardments. Soloviev also promoted the channel in a post he shared on his own Telegram, which has 580,000 followers. The post recommended his viewers subscribe to "War on Fakes" in a time of fake news.
from vn


Telegram Агенты ИИ | AGI_and_RL
FROM American