Moore’s law is the observation that the number of transistors in an integrated circuit (IC) doubles about every two years.
Is there anything similar for the sophistication of AI, or AGI in particular?
Moore’s law is the observation that the number of transistors in an integrated circuit (IC) doubles about every two years.
Is there anything similar for the sophistication of AI, or AGI in particular?
Some in the AI industry have proposed concepts similar to Moore’s Law to describe the rapid growth of AI capabilities.
Although there is no universally accepted law or principle akin to Moore’s Law for AI, people often refer to trends that describe the doubling of model sizes or capabilities over a specific time frame.
For instance, OpenAI has previously described a trend where the amount of computing power used to train the largest AI models has been doubling roughly every 3.5 months since 2012.
Source