With the number of large language models (LLMs) in the market expected to grow and branch out, businesses will need a governance framework to manage their generative artificial intelligence (AI) applications.
Organizations will require layers of intelligence that pull together internal and external capabilities, said Frederic Giron, Forrester’s vice president and senior research director.
Also: 3 ways to secure the best AI partner for your business
This approach will encompass the use of paid and open-source LLMs from third parties, such as OpenAI’s ChatGPT, Anthropic’s Claude, and Meta’s Llama, and embedded AI tools, such as Salefsforce Einstein GPT. Organizations will also have their own AI models, including using generative AI, tapping general-purpose and specialized LLMs, and running various AI applications alongside key processes, policies, and business rules.
User response and behavior should also be fed into a feedback loop and used to fine-tune the system.
These requirements underscore the need for businesses to have a generative AI application architecture to govern and ensure the use of these tools is safe and efficient, he said.
The complexities around AI governance mean it might take a while before businesses will see real results from their adoption of a framework.
Also: 4 ways generative AI can stimulate the creator economy
To help businesses plug the gaps, he noted that service providers are investing in transforming how they operate and deliver their service models, including expanding their industry partnerships and releasing new platforms, such as AI studios and model comparisons.
This investment will drive better pricing models and, over a longer term, impact commercial models. The results will be more outcome-based and solution-based pricing structures, among others.
Also: Businesses need a new operating model to compete in an AI-powered economy
The analyst added that 56% of organizations expect employee productivity to be the leading use case for generative AI, followed by 48% that point to software development and testing. Another 48% see generative AI as an enabler of self-service data and analytics.
Unsurprisingly, generative AI is the biggest tech thunderstorm to hit in 40 years, according to Dane Anderson, Forrester’s senior vice president of international research and product.
Some of these innovations brought about greater changes than others, creating both opportunities and challenges, he added. With the emergence of generative AI, the analyst predicted that “static” websites will gradually be abandoned over the next 20 years.
Also: Generative AI will far surpass what ChatGPT can do. Here’s everything on how the tech advances
Users will instead evolve to prompt or ask a query, to which they will get a response that is continually updated in the backend — powered by generative AI — and customized for an improved interactive experience.
These changes to websites will further impact search, which will no longer be as central or critical as it is now, Anderson said.
Such significant transformations will play out over several years. In the shorter term, the anticipated emergence of more LLMs in the market means organizations will need to carefully assess their options and determine which models are best suited for the outcomes they want.
Anderson also noted the potential for more market players to start embedding generative AI capabilities for free into their existing customer enterprise applications.
Ultimately, the value for businesses is not in the layer where LLMs operate, said Leslie Joseph, Forrester’s principal analyst, as this market segment will be commoditized as more LLMs pop up, he added.
Joseph urged software vendors to start integrating generative AI features into their products, rather than offering these tools primarily as their version of a ChatGPT equivalent. This refined approach will help drive a workplace environment where generative AI capabilities are more ingrained into how employees work and make the technology more affordable for businesses, he said.
Regarding this subject, there is undoubtedly a great lot that is still unknown. The points that you present are both well-reasoned and convincing. We are quite grateful that you shared the content with us; each of the quotations was outstanding. Never stop sharing, and never stop being an inspiration to other people.