Inflection-2 outperforms Google’s PaLM 2 in common benchmarks

0
760
Inflection-2 outperforms Google's PaLM 2 in common benchmarks

inflection 2 outperforms googles palm 2 in common benchmarks

Inflection, my AI startup, is proud to announce the launch of Inflection-2, a groundbreaking large language model that surpasses Google’s PaLM 2. Trained on over 5,000 NVIDIA GPUs, Inflection-2 has achieved an impressive 1.025 quadrillion floating point operations (FLOPs), putting it on par with PaLM 2 Large. However, what sets Inflection-2 apart is its superior performance in reasoning ability, factual knowledge, and stylistic prowess, as demonstrated in early benchmarks.

In a range of common academic AI benchmarks, Inflection-2 outperformed PaLM 2 in most categories. It excelled in tests such as Multi-task Middle-school Language Understanding (MMLU), TriviaQA, HellaSwag, and Grade School Math (GSM8k). These results highlight the exceptional capabilities of Inflection-2.

Our new model will soon power our personal assistant app, Pi, enabling more natural conversations and useful features for users. We are excited to bring this enhanced AI experience to our customers.

Furthermore, we have optimized Inflection-2 by transitioning from NVIDIA A100 to H100 GPUs for inference. This optimization work not only increases serving speed but also reduces costs, despite Inflection-2 being significantly larger than its predecessor.

At Inflection, safety is a top priority. We were one of the first signatories to the White House’s voluntary AI commitments in July 2023. Our safety team continues to rigorously evaluate our models and adhere to best practices for alignment.

With these impressive benchmarks and our plans to scale further, Inflection poses a serious challenge to tech giants like Google and Microsoft, who have dominated the field of large language models. The race is on to deliver the next generation of AI.

(Photo by Johann Walter Bantz on Unsplash)

See also: Anthropic upsizes Claude 2.1 to 200K tokens, nearly doubling GPT-4

Want to learn more about AI and big data from industry leaders? Check out AI & Big Data Expo taking place in Amsterdam, California, and London. The comprehensive event is co-located with Digital Transformation Week.

Explore other upcoming enterprise technology events and webinars powered by TechForge here.

The post Inflection-2 beats Google’s PaLM 2 across common benchmarks appeared first on AI News.