LLaMa 2 connector example implementation

Content Type: Module
Categories: Artificial Intelligence

Overview

This example implementation of the LLaMa 2 connector demonstrates how to use the connector to generate text.

The example implementation includes the following components:

  1. An interface to use the LLaMa 2 connector.
  2. An example implementation of invoking the TextGeneration API.

This example implementation demonstrates the basic functionality of the LLaMa 2 connector and shows how it can be used to generate text. Mendix developers can use this example as a reference to build their own applications that require natural language processing capabilities.

Documentation

Getting Started

Before you begin, ensure that you have the following components installed:

  • Mendix Studio Pro 9.18.0+
  • LLaMa 2 connector
  • DeepInfra API key

Once you have all the necessary components, follow these steps to set up the example implementation:

  1. Open Mendix Studio Pro
  2. Configure the NAV_PromptOverview microflow to access the interface.
  3. Optionally: Configure the NAV_Prompt_Delete to delete all objects of type Prompt.
  4. You're good to go!


Disclaimer

Invoking DeepInfra's API incurs costs whereas the use of the LLaMa 2 connector is free. Happy hacking!

Releases

Version: 1.0.0
Framework Version: 9.18.0
Release Notes: Initial release