Artificial intelligence model size and complexity, 2006-2022

Sources

IEA (2024) analysis based on data from Sun, Y., Agostini, N. B., Dong, S., & Kaeli, D. (2020). Summarizing CPU and GPU Design Trends with Product Data (arXiv:1911.11313). arXiv.( http://arxiv.org/abs/1911.11313), Maltinsky, B., Gallagher, J., & Taylor, J. (2018). Feasibility of Training an AGI using Deep RL: A Very Rough Estimate. Median Group. (http://mediangroup.org/rough_agi.html)

Notes

The underlying data refers to the Training Compute (FLOP). FLOP= Floating Point Operations.