● Covered by 1 source · 1 reportLow impact1 neutral
Jevchat tool converts Jev into a character-by-character chatbot
Key points
- Jevchat converts Jev into a chatbot by sampling one symbol at a time.
- The tool uses various alphabets and sampling strategies.
- It provides real-time generation rate and symbol distribution readouts.
- The project is experimental and was accelerated using Claude.
Jevchat Functionality
Jevchat is a new tool designed to interface with the Jev model, transforming it into a chatbot. The core mechanism involves asking Jev a question at each step: "Given the user's question and the reply written so far, which symbol comes next?" Jev returns a probability for each possible symbol, and the tool samples the next symbol from this normalized distribution. This process continues until a STOP symbol is drawn.
Customization and Experimentation
The tool offers several alphabets and sampling strategies that can be interchanged. Users can choose how the distribution over the next symbol is obtained (strategy) and what that distribution is over (alphabet). Examples include 'choice', which asks one question over the whole alphabet, and 'bisect', which uses yes-no questions to narrow down the options before a final choice.
User Interface and Controls
Jevchat provides an interactive chat experience with real-time feedback. As text is sampled, a panel displays the generation rate (symbols/s, characters/s), API call duration, elapsed time, and the top symbols Jev scored at the last step. Users can cancel generation with Ctrl-C and access various chat commands like /help, /alphabet, /temp, /stop-bias, /reset, /stats, and /exit.
Implementation Details
The project is set up for easy installation via `poetry install` and requires a Jev API key in a `.env` file. The development of the sampling algorithms and strategies was accelerated with the assistance of Claude. While the project is primarily for fun, the cost associated with its operation is noted as somewhat impractical.
✨ This summary was generated by AI from the outlets' reporting listed below. It is not independently verified and may contain errors — check the original sources. How BrevFeed works →
The daily brief
One email each morning: the day's tech stories, clustered across outlets and summarized. No account needed.
One email a day. Unsubscribe in one click, any time.
Today's brief
Spend a few minutes, get the whole day. Every topic's top stories in one hands-free rundown — listen, watch, or read the transcript.
▶ Play today's brief
New every morning, and the back catalogue is archived by date.
Primary sources
GitHub cmc_internal/api GitHub github/collect GitHub kyle-pena-nlp/jevchat GitHub _private/browser GitHub get-started/accessibility GitHub open-source/sponsorsReporting from
A new tool called Jevchat has been developed to turn the Jev model into a chatbot that generates responses one symbol at a time. This experimental project explores different sampling strategies and alphabets for text generation, primarily for fun and demonstration.