The company claimed that GPT-4 will have 100 trillion parameters, as opposed to 175 billion parameters that GPT-3 is currently trained on.
OpenAI dropped a teaser on the release of GPT-4 on Wednesday from its official social media handles of ChatGPT. Unless you live under a rock, you already know about ChatGPT and the sheer revolution it has sought to bring about in how we perform hundreds of daily tasks.
In more straightforward terms, GPT, which stands for Generative Pre-trained Transformer, refers to a deep-learning neural network model that has been trained on data sets and content found across the internet to create large volumes of machine-generated text. GPT-3 is the third generation of this technology and is one of the most advanced AI text-generation models known to humans.
The company claimed that GPT-4 will have 100 trillion parameters, as opposed to the 175 billion parameters that GPT-3 is currently trained on. However, this lofty claim may not be completely effective as more parameters mean higher data processions and server requirements costs.