GenAI Commons
Overview
Note: this is an Add-On module. It is required if your project contains one of the main (platform-supported) GenAI connectors that depend on it.
The GenAI Commons module combines common GenAI patterns found in a variety of generative AI models on the market. Platform-supported GenAI-connectors use the underlying data structures and their operations, for example both the OpenAI or Amazon Bedrock connector depend on this module.
If two different connectors both adhere to the GenAI Commons module, they can be easily swapped, which reduces dependency on the model providers. In addition, the initial implementation of AI capabilities using the connectors becomes a drag and drop experience, so that developers can quickly get started.
The module exposes useful operations which developers can use to build a request to a large language model (LLM), and to handle the response. Additionally the basis for storing usage data for monitoring purposes is provided.
This module is compatible with the Conversational UI module, which contains UI elements and logic for a chat interface, next to a set of page elements that enable displaying usage data for monitoring.
Developers who want to connect to another LLM provider or their own service are advised to use the GenAI Commons module as well. This speeds up development and ensures that common principles are considered. Lastly, other developers or consumers of the connector can adapt to it more quickly.
For more information, visit the official documentation.
Documentation
See official documentation
Dependencies
- Community Commons module v10.0.6 or higher
Implementation examples
For implementation examples, see the GenAI showcase app.
Connector development examples
Do you want to build your own connector to an LLM with GenAI Commons? Check out the OpenAI or Amazon Bedrock connector for inspiration.