↓ Skip to main content
  1. Home projects/

Personas Chat: talk to a local LLM as an uncle or an aunt

··
Table of Contents

Personas Chat is a small chat app. You pick a persona, such as an uncle, an aunt or a wife, and a local language model answers in that voice, in Polish. Nothing leaves the machine.

The frontend is Vue 3 with TypeScript. The backend is FastAPI and runs the model through llama-cpp-python. Replies stream into the chat window as they are generated, and recent chats stay in the browser.

What I did
#

Each persona is a short system prompt in a JSON file. The uncle tells rough, hearty jokes. The aunt is warm and talks about baking. The wife is loving but practical.

The first version was a simple chat that worked. Then I added conversation history and a summary of older messages, so a long talk keeps its thread and the prompt does not grow without limit.

Related