Integrate with Chainlit to create LLM chat apps
In this example, we will learn how to use Chainlit and Embedchain together.
First, install the required packages:
pip install embedchain chainlit
Create a new file called app.py and add the following code:
app.py
import chainlit as cl from embedchain import App import os os.environ["OPENAI_API_KEY"] = "sk-xxx" @cl.on_chat_start async def on_chat_start(): app = App.from_config(config={ 'app': { 'config': { 'name': 'chainlit-app' } }, 'llm': { 'config': { 'stream': True, } } }) # import your data here app.add("https://www.forbes.com/profile/elon-musk/") app.collect_metrics = False cl.user_session.set("app", app) @cl.on_message async def on_message(message: cl.Message): app = cl.user_session.get("app") msg = cl.Message(content="") for chunk in await cl.make_async(app.chat)(message.content): await msg.stream_token(chunk) await msg.send()
chainlit run app.py
Open the app in your browser and start chatting with it!
Was this page helpful?