LLaMa 2 connector

Content Type: Module
Categories: Connectors,Artificial Intelligence

Overview

Unlock the Full Potential of LLaMa 2 for Your Mendix Applications!

Are you looking for a simple, efficient, and cost-effective way to integrate the powerful LLaMa 2 model into your Mendix applications? Our LLaMa 2 connector is the perfect solution! With this easy-to-use tool, you can seamlessly link your Mendix apps with the latest versions of LLaMa 2, unleashing its advanced natural language processing capabilities for a wide range of use cases.

Take your chatbots to the next level by utilizing LLaMa 2's superior performance in text classification, sentiment analysis, named entity recognition, question answering, and more. Streamline your content creation process by leveraging LLaMa 2's ability to generate, structure, and rephrase text. Our LLaMa 2 connector makes all this possible, saving you valuable time and resources while helping you deliver innovative solutions that meet your client's needs.

Here are some key advantages of our LLaMa 2 connector:

  • Simplified Integration: Say goodbye to complex coding and API struggles. Our connector provides a user-friendly interface that lets you integrate LLaMa 2 into your Mendix apps quickly and efficiently.
  • Time-Saving: Focus on developing your application rather than worrying about integration. With the LLaMa 2 connector, you can speed up your development process and allocate resources to other critical areas.
  • Cost-Effective: Harness the potential of LLaMa 2 at a fraction of the cost of ChatGPT's API.
  • Performance: LLaMa 2 outperforms other models in its class, including ChatGPT's 3.5-turbo model. While Technology Innovation Institute's Falcon (180b) model and Anthropic's Claude V2 offer strong competition, LLaMa 2 remains a top performer in natural language processing tasks.

The variants that the LLaMa 2 connector currently supports are the following:

Click on the listed model for more information as provided by DeepInfra.

With our LLaMa 2 connector, you can take advantage of the powerful capabilities of LLaMa 2 without breaking the bank. Whether you're building chatbots, generating content, or tackling other natural language processing tasks, our connector simplifies the integration process, saves you time, and helps you achieve better results.


Do you reckon LLaMa 2 generated this description?

Documentation

Introduction

The LLaMa 2 connector is a powerful tool that enables Mendix developers to easily integrate the LLaMa 2 model into their applications. With this connector, you can harness the advanced natural language processing capabilities of LLaMa 2, including text classification, sentiment analysis, named entity recognition, question answering, and more.

In this document, we will guide you through the process of setting up and using the LLaMa 2 connector in your Mendix projects.


Getting Started

Before you begin, ensure that you have the following components installed:

  • Mendix Studio Pro 9.18.0+
  • LLaMa 2 connector
  • DeepInfra API key

Once you have all the necessary components, follow these steps to set up the LLaMa 2 connector:

  1. Open Mendix Studio Pro.
  2. Configure your DeepInfra API key in the LLaMa2Connector.APIKey constant variable.
  3. You're good to go!


Using the LLaMa 2 connector

Now that the LLaMa 2 connector is configured, you can start using it in your Mendix application. To do so you, follow these steps:

  1. In a Microflow, create an object of type TextGenerationRequest.
  2. Consult the attribute documentation to see how each attribute affects the text generation.
  3. In your Toolbox, drag the Text Generation activity from the LLaMa 2 Connector category onto your Microflow.
  4. Configure a method to trigger the Microflow that you created, i.e., using a Button widget.

Alternatively, you can use the LLaMa 2 connector example implementation for inspiration (which borrows from Amazon Bedrock example implementation's interface).


Disclaimer

Invoking DeepInfra's API incurs costs whereas the use of the LLaMa 2 connector is free. Happy hacking!

Releases

Version: 1.0.0
Framework Version: 9.18.0
Release Notes: Initial release