Amazon Bedrock Connector

Content Type: Module
Categories: Connectors,AWS,Artificial Intelligence

Overview

Amazon Bedrock is a fully managed service that offers a choice of high-performing foundation models (FMs) from leading AI companies like AI21 Labs, Anthropic, Cohere, Meta, Stability AI, Mistral AI and Amazon via a single API, along with a broad set of capabilities you need to build generative AI applications, simplifying development while maintaining privacy and security.

The Amazon Bedrock Connector allows you to integrate with Amazon Bedrock.

As of version 3.0.0 the connector depends on the GenAICommons module. Since 4.0.0 it provides the following out-of-the box implementations:

  • ChatCompletions (without history) (Converse API)
  • ChatCompletions (with history) (Converse API)
  • Retrieve and Generate
  • Retrieve
  • Image generation (Amazon Titan)
  • Embeddings (Single String input) (Cohere Embed + Amazon Titan Embeddings v2)
  • Embeddings (Chunk collection) input (Cohere Embed + Amazon Titan Embeddings v2).

 

Thanks to these implementations, it is possible to leverage the large language models available via Amazon Bedrock in both the GenAI Showcase App as well as the AI Bot Starter app out of the box. Please have a look into the GenAICommons documentation to find more information about how to build the required request structure and connection object to reuse the operations. 

 

In addition, the connector provides the following actions:

  • List Foundation Models
  • Invoke Model (generic)
  • StartIngestionJob and GetIngestionJob (make it possible to sync changes to KnowledgeBases)
  • List Knowledge Bases
  • Invoke Agent
  • Get Agent
  • List Agents

 

For more information about our AWS Connector strategy, please see the Mendix Evaluation Guide.

 

Attention:

For modeler version 9.24.2 until 9.24.29 remove the older version libraries manually from the userlib folder to avoid java compilation errors

Documentation

Please see the documentation on Mendix Docs

Releases

Version: 5.4.0
Framework Version: 9.24.2
Release Notes: * Token monitoring is now available for Chat Completions actions and Embeddings
Version: 5.3.2
Framework Version: 9.24.2
Release Notes: Bug fix: The empty "Prompt Template" error
Version: 5.3.1
Framework Version: 9.24.2
Release Notes: -"Retrieve and Generate" action now supports ''Prompt Templates" - All the widgets have been upgraded
Version: 5.3.0
Framework Version: 9.24.2
Release Notes: - The Amazon Bedrock Connector has been updated to Mendix version 9.24.2. - The Bedrock SDK was updated to version 2.27.17 to be in line with the AWS Authentication 3.2.0 modules SDK version. - Some jar files where centralized to the AWS Authentication connector. - Improved handling of enumerations was introduced.
Version: 5.2.1
Framework Version: 9.24.2
Release Notes: - an issue was fixed for ChatCompletions_withoutHistory_AmazonBedrock where the wrong $Request input parameter was used
Version: 5.2.0
Framework Version: 9.24.2
Release Notes: - ChatCompletions operation now supports Document Chat - Helper operation to obtain RetrieveAndGenerate Response from GenAICommons.Response now exposed - Compatibility with latest version of GenAICommons (FileContent.FileExtension instead of MediaType enumeration) - Function Calling now supports function microflows without input parameters
Version: 5.1.0
Framework Version: 9.24.2
Release Notes: - Operations to persist and synchronize information about available models, knowledge-bases and agents added - Admin snippet to view/update/delete and manage authentication settings added - Cohere Embed operation now returns the amount of input tokens used - More example flows that show how to use the different connector capabilities added
Version: 5.0.1
Framework Version: 9.24.2
Release Notes: - a bug was fixed where an error occurred for Retrieve, Retrieve and Generate, Invoke Agent for Knowledgebases with a different data source than S3 for applications in Mendix 10
Version: 5.0.0
Framework Version: 9.24.2
Release Notes: - fixed a bug where using a knowledge base with a different data source than S3 caused an error. The error does not longer occur but different data sources than S3 are still not fully-supported (attributes such as the source URL might be empty). - Retrieve operation now depends on GenAICommons module.
Version: 4.0.0
Framework Version: 9.24.2
Release Notes: - added operations depending on GenAICommons to generate embeddings - added logic depending on GenAICommons to generate images with Amazon Titan - ChatCompletions: invokeModel call replaced with call to Converse API - ListAgents operation - GetAgents operation