NAME

LLM::DWIM -- Do What I Mean, with help from large language models.

SYNOPSIS

use LLM::DWIM;

say dwim "How many miles is it from the earth to the moon?";
# Approximately 238,900 miles (384,400 kilometers)

say dwim "@NothingElse How many miles is it from the earth to the moon? #NumericOnly";
# 238900

sub distance-between($from,$to) {
  dwim "@NothingElse #NumericOnly What is the distance in miles between $from and $to?";
}

say distance-between("earth","sun");
# 92955887.6 miles

my $agent = dwim-chat("Answer every question with an exclamation point!");
say $agent.eval: "My name is bob and I have five dogs.";
# That's great!

say $agent.eval: "How many paws is that?";
# Twenty!

Meanwhile, in ~/.config/llm-dwim.toml:

evaluator = "gemini"
gemini.temperature = 0.5

DESCRIPTION

This is a simple wrapper around LLM::Functions, and LLM::Prompts It provides a single subroutine, dwim, that sends a string to an LLM evaluator, making use of a configuration file to say a little more about what you mean.

FUNCTIONS

dwim

sub dwim(Str $str) returns Str

This function takes a string, expands it using LLM::Prompts, and uses LLM::Functions to evaluate the string.

dwim-chat

sub dwim-chat(Str $prompt) returns Str

Create a chat agent that will have a conversation.

For diagnostics, use Log::Async and add a tap, like so:

use LLM::DWIM;
use Log::Async;

logger.send-to($*ERR);

say dwim "How many miles is it from earth is the moon? #NumericOnly";

CONFIGURATION

This module looks for llm-dwim.toml in either XDG_HOME or HOME/.config. This can be overridden by setting DWIM_LLM_CONF to another filename.

The configuration file should be in TOML format and should contain at least one key, evaluator, which should be the name of the LLM evaluator to use. Evaluators can be configured using TOML syntax, with the evaluator name as the key.

Sample configurations:

Use Gemini (which has a free tier) :

evaluator = "gemini"

Use OpenAI, and modify some parameters:

evaluator = "OpenAI"
OpenAI.temperature = 0.9
OpenAI.max-tokens = 100

See LLM::Functions for all of the configuration options.

COMMAND LINE USAGE

This package has two scripts:

First, llm-dwim can be used to evaluate a string from the command line.

Sample usage:

llm-dwim -h  # get usage
llm-dwim "How many miles is it from the earth to the moon?"
llm-dwim -v how far is it from the earth to the moon\?
echo "what is the airspeed velocity of an unladen swallow?" | llm-dwim -

Second, llm-dwim-chat will have a chat with you.

Sample session:

llm-dwim-chat you are a french tutor --name=Professor

you > Hello
Professor > Bonjour !  Comment allez-vous ?
you > Bien merci
Professor > Et vous ?  (And you?)
you >

AUTHOR

Brian Duggan