Home

Awesome

Python Plays Grand Theft Auto 5 - Reboot

<p align="center"><img src="_media/charles.webp"></p>

This is a reboot of the project from 2017, but with a whole new approach. This time, instead of collecting data by hand and training a classification model, we opted to create a whole new system for the data collecting, training and playing, and to do all of that live. Our models are now using regression (with other output types being still possible), training data is collected automatically and we stream models during their training phase so anyone can join and watch the progress.

Our AI, besides having multiple alter-egos (models), is still called Charles, like in 2017.

For a full explanation, refer to the System page, but for a quick summary - we’re using a central server that all other parts connect to. The Data Collectors run in separate GTA5 instances and our NPCs are collecting and Balancing the data, which is sent through the Server to the Trainer. The Trainer buffers these data, trains the model and updates the Player. The Player is using the Dual-Camera system to play so we can watch the 3rd person camera (also called cinematic camera) while the model is fed the Hood Camera.

For more information, refer to these other pages:

<br/> <br/>

Stream and current stream layout:

The progress is being streamed on Twitch: https://www.twitch.tv/sentdex. Below we keep a list of dates and streamed models.

Stream's layout consists of: layout.jpg

<br/> <br/>

Driving examples:

<a href="https://clips.twitch.tv/GiftedRespectfulParrotGOWSkull-17xBRPKKdDvr_3Wf"><img src="_media/AT-cm_qfUNoNe8QUTyinQ76_91nw.jpg" width="49.4%"></a>  <a href="https://clips.twitch.tv/HealthyRichWeaselPlanking-6oB5PoNygm5ikonY"><img src="_media/AT-cm_F6V9NuqAeT6DcoJuYpKJ2A.jpg" width="49.4%"></a>

<br/> <br/>

Model list:

<br/> <br/>

Streaming timeline

May 1st:

May 2nd:

May 7th:

May 8th:

May 14th:

May 16th:

May 28th:

May 29th:

July 5th:

<br/> <br/>

Project timeline

This is not a full project log and contains only the key changes that are visible on the stream (and a few from before the stream has started). There are many more things going on "behind the scenes".

2017:

November 2021:

Early 2022:

April 8th:

April 9th:

April 10th:

April 11th:

April 15th:

April 19th:

April 22nd:

April 24th:

April 30th:

May 1st:

May 2nd:

May 3rd:

May 7th:

May 8th:

May 13th:

May 14th:

May 14th:

May 16th:

May 22nd:

May 23th:

May 24th:

May 25th:

May 26th:

May 28th:

May 29th:

May 30th:

May 31th:

June 1th:

June 3rd:

June 4th:

June 9th:

June 10th:

June 13th:

July 5th: