Home

Awesome

<div align="center"> <h1>BMList</h1>

A List of Big Models

</div>

Introduction

Welcome to BMList! We wish to use this list to show the recent trend of big models.

In BMList, we list models that:

  1. Have at least 1 billion parameters;
  2. Have been publicly released either by a paper, an artice or a piece of news.

If you find any typos or mistakes in this repo, please feel free to create issues or pull requests!

What's New

Model Expo

We maintain a website to show statistics of big models from multiple perspectives.

Big Model List

We show all information of big models in a multi-dimensional table, in which you can easily classify models by organizations, languages, domains, etc.

<img src="figures/bmlist.png" width="1000px">

Big Model Gallery

We also host a gallery to present figures about big models. Currently, there are five figures, previewed below, and any ideas for new figures are welcomed!

Big Model Trend

<img src="figures/scatter.png" width="1000px">

Model Numbers by Organizations

<img src="figures/affiliation_cnt.png" width="1000px">

Model Parameters by Organizations

<img src="figures/affiliation_params.png" width="1000px">

Model Numbers by Time

<img src="figures/time_cnt.png" width="1000px">

Model Parameters by Time

<img src="figures/time_params.png" width="1000px">

Contribution

We welcome everyone to add new models. Please check our contributing guidelines to see how to contribute.

Once you added a model, the multi-dimensional table and the website will be automatically updated. Don't worry about that!

Contributors

<a href="https://github.com/OpenBMB/BMList/graphs/contributors"> <img src="https://contrib.rocks/image?repo=OpenBMB/BMList" /> </a>