Friday, 23 June 2023, Bengaluru, India
To create “personal AI for everyone,” Inflection, a well-funded AI startup, has unveiled the expansive language model that powers its Pi conversational robot. It’s challenging to assess these items’ quality in any way, much less consistently and objectively, but some competition is healthy.
According to the processing power utilized to train them, the model, dubbed Inflection-1, has capabilities and a size equivalent to GPT-3.5 (also known as ChatGPT). A “technical memo” explaining the benchmarks it did on its model, GPT-3.5, LLaMA, Chinchilla, and PaLM-540B, supports the company’s assertion that it is competitive with or superior to other models in this tier.
Inflection-1 does perform well on a variety of benchmarks, including middle- and high-school test tasks (think biology 101) and “common sense” benchmarks (questions like “if Jack throws the ball on the roof and Jill throws it back down, where is the ball? “), according to the findings they released. It mainly lags in coding, where GPT-3.5 easily defeats it, and, as a comparison, GPT-4 annihilates the competition; this is not surprising since OpenAI‘s largest model was known to have been a considerable leap in quality there.
Although Inflection anticipates publishing results for a larger model similar to GPT-4 and PaLM-2(L), it is likely to wait until the findings deserve publication. Inflection-2, Inflection-1-XL, or whatever is currently baking but still needs to be completed.
The community still needs to categorise AI models into the machine learning equivalent of boxing weight classes, even if the notions complement one another very well. Because their sports are so dissimilar, a flyweight and a heavyweight should not compete against one another. The same applies to AI models: a smaller model can operate well on the phone, despite being less powerful than a larger one requiring a data centre. It would be like contrasting apples and oranges.
Given the relative youth of the subject and the need for a clear consensus over what sizes and forms of AI models should be regarded as a feather, it is still too early to attempt such a thing.
The proof of the pudding is in the eating, of course, and until Inflection makes its model widely available for use and impartial assessment, all of its lauded criteria must be taken with a grain of salt. You can add Pi to one of your messaging apps or communicate with it online here if you want to try it.
[Source of Information : Techcrunch.com]
