Skip to main content

​
Prerequisites

Before creating an endpoint, ensure that you have integrated the desired AI provider with Rapida. To set up integrations:
  1. Navigate to the Integrations section in your Rapida dashboard.
  2. Select the AI provider you want to integrate (e.g., OpenAI, Anthropic, Google AI).
  3. Follow the provider-specific instructions to complete the integration.
For detailed instructions on setting up integrations, refer to the provider-specific documentation in the Integrations section:
1

Choose Model

Select the LLM Provider you want to use for your endpoint. The interface shows various options.
Each model may have different capabilities and pricing structures, so choose the one that best fits your needs.
Choose Model Interface
2

Select Provider Credential

Choose the appropriate credential for the selected provider from the dropdown menu. If you haven’t set up credentials for this provider yet, you can:
  • Click the ”+” button to add a new credential
  • Click the refresh button to update the list of available credentials
Make sure you’ve already configured credentials for your chosen provider in the Integrations section.
3

Configure Model Settings

Depending on the chosen provider, configure various settings such as Frequency Penalty, Temperature, Top P, Max Completion Tokens, Response Format, and Stop Sequences by clicking on the settings icon next to the selected model.Configure Model Settings
4

Set Up Instructions

Create a system message and user message template. Define the role or context for the AI, set up the structure for user inputs, and define custom arguments that can be dynamically inserted into your prompts.Set Up Instructions
5

Define Endpoint Profile

Provide a unique name for your endpoint, a brief description of its purpose, and add relevant tags to categorize it.Define Endpoint Profile

​
Additional Notes

  • New versions of the assistant will not be deployed automatically. Manual deployment is required to update the production version.
  • You can add multiple messages to create more complex conversation flows.
  • The interface allows for easy editing and rearranging of messages.

​
Finalizing Your Endpoint

After configuring all settings, click the “Create endpoint” or “Configure instruction” button to finalize your endpoint creation. Your new endpoint will then be listed in the Hosted Endpoints dashboard, where you can monitor its status, run count, error rate, and other performance metrics. By following these steps, you can create a custom endpoint that leverages powerful LLMs to enhance your application’s capabilities.