Tuesday, April 16, 2024
HomeAi in BusinessStanford Researchers Publish AI Transparency Report, Call for Tech Companies to Increase...

Stanford Researchers Publish AI Transparency Report, Call for Tech Companies to Increase Disclosure


Stanford University researchers issued a report on Wednesday measuring the transparency of artificial intelligence foundation models from companies like OpenAI and Google, and the authors urged the companies to reveal more information such as the data and human labor used to train models.

“It is clear over the last three years that transparency is on the decline while capability is going through the roof,” said Stanford professor Percy Liang, a researcher behind the Foundation Model Transparency Index. “We view this as highly problematic because we’ve seen in other areas like social media that when transparency goes down, bad things can happen as a result.”

Elevate Your Tech Prowess with High-Value Skill Courses

Offering College Course Website
Indian School of Business ISB Professional Certificate in Product Management Visit
Indian School of Business ISB Product Management Visit
IIM Kozhikode IIMK Advanced Data Science For Managers Visit

Foundation models are AI systems trained on massive datasets that can perform a variety of tasks from writing to coding. Companies that develop foundation models are driving the surge in generative AI, which since the launch of Microsoft-backed OpenAI’s hit product ChatGPT has captivated businesses of all sizes.

In a world increasingly relying on these models for decision-making and automation, understanding their limitations and biases is crucial, the report’s authors say.

The index graded 10 popular models on 100 different transparency indicators, such as training data and how much compute was used. All models scored “unimpressively”: even the most transparent model, Meta’s Llama 2, received a score of 53 out of 100. Amazon’s Titan model ranked the lowest, at 11 out of 100. OpenAI’s GPT-4 model received a score of 47 out of 100.

The index’s authors hope that the report will encourage companies to increase their foundation model transparency, and also serve as a starting point for governments grappling with how to regulate the burgeoning field.

Discover the stories of your interest


The index is a project from the Stanford Institute for Human-Centered Artificial Intelligence’s Center for Research on Foundation Models.

Stay on top of technology and startup news that matters. Subscribe to our daily newsletter for the latest and must-read tech news, delivered straight to your inbox.
Leah Sirama
Leah Sirama
Leah Sirama, a lifelong enthusiast of Artificial Intelligence, has been exploring technology and the digital realm since childhood. Known for his creative thinking, he's dedicated to improving AI experiences for all, making him a respected figure in the field. His passion, curiosity, and creativity drive advancements in the AI world.
RELATED ARTICLES

LEAVE A REPLY

Please enter your comment!
Please enter your name here

- Advertisment -

Most Popular