Simple framework for LLM inferencing

Simple framework for LLM inferencing

LLM::Graph can be used to efficiently schedule and combine multiple LLM generation steps for an optimal evaluation managing LLM submissions' concurrency.

WWW::LLaMA provides access to the LLaMA playground.

dosh (do shell) - LLM-powered shell commands.

dosh (do shell) - LLM-powered shell commands.

Raku client for the HuggingFace API — model search and tokenizer downloads

Text emotion classifier using Cohee's go-emotions DistilBERT (28 emotions)

Content classification and model routing for LLM data pipelines

Structured LLM task layer with retry, JSON parsing, and query-based routing