OPENAI_API_KEY
environment variable. You can obtain the OpenAI API key from the OpenAI Platform.
Once you have obtained the key, you can use it like this:
Pydantic Model
Python function
OpenAI tool dictionary
GOOGLE_API_KEY
environment variable. You can obtain the Google API key from the Google Maker Suite
ANTHROPIC_API_KEY
which you find on their Account Settings Page.
COHERE_API_KEY
as environment variable which you can find on their Account settings page.
Once you have the API key, you are all set to use it with Embedchain.
TOGETHER_API_KEY
as environment variable which you can find on their Account settings page.
Once you have the API key, you are all set to use it with Embedchain.
CLARIFAI_PAT
as environment variable which you can find in the security page. Optionally you can also pass the PAT key as parameters in LLM/Embedder class.
Now you are all set with exploring Embedchain.
JINACHAT_API_KEY
in environment variable which you can obtain from their platform.
Once you have the key, load the app using the config yaml file:
HUGGINGFACE_ACCESS_TOKEN
in environment variable which you can obtain from their platform.
You can load the LLMs from Hugging Face using three ways:
HUGGINGFACE_ACCESS_TOKEN
as above.
Then, load the app using the config yaml file:
text-generation
and text2text-generation
for now [ref].
See langchain’s hugging face endpoint for more information.
REPLICATE_API_TOKEN
in environment variable which you can obtain from their platform.
Once you have the token, load the app using the config yaml file:
boto3
client by using a method in the AWS documentationAWS_REGION
GROQ_API_KEY
environment variable or pass in your app configuration to use the model as given below in the example.
NVIDIA_API_KEY
environment variable. Note that the NVIDIA_API_KEY
will start with nvapi-
.
Below is an example of how to use LLM model and embedding model from NVIDIA AI:
token_usage
to True
in the config file. This will return the token details: prompt_tokens
, completion_tokens
, total_tokens
, total_cost
, cost_currency
.
The list of paid LLMs that support token usage are:
model_prices_and_context_window.json
, please feel free to open a PR.