← arif.shProject system
PromptPilot
Prompt versioning and A/B testing across AI providers.
What it does
PromptPilot creates prompt YAML files, saves version backups, diffs prompt revisions, and runs provider-backed A/B tests from a CLI.
System map
1input
Prompt YAML
Template, variables, metadata
2storage
Version Store
Backups and history
3decision
Diff
Git or file history
4service
Providers
OpenAI, Claude, local models
5output
A/B Result
Cost, response, winner
Press enter or space to select a node. You can then use the arrow keys to move the node around. Press delete to remove it and escape to cancel.
Press enter or space to select an edge. You can then press delete to remove it or escape to cancel.
Selected node
Prompt YAML
Template, variables, metadata
input
Codebase read
- Prompt files are stored as YAML with metadata, variables, token estimates, and version history.
- Versioning supports manual backups and git diff fallback when a repository is present.
- The CLI lazy-loads heavier dependencies so common commands start quickly.
Key snippet
promptpilot init my-summary \
--description "Summarize text in 3 paragraphs"
promptpilot abtest my-summary \
--input sample.txt \
--provider openai
Tech used
PythonClickYAMLGitPythonOpenAIAnthropicTransformers
Source paths inspected
src/promptpilot/cli.pyversioning.pyutils.py
More project systems
GoVisualZero-config HTTP request visualizer for Go applications.→ FastAPI RadarReal-time request, SQL query, exception, and trace dashboard for FastAPI apps.→ LLMDogTerminal UI for selecting code context and turning it into LLM-ready Markdown.→ GIQAI-enhanced Git workflow assistant that keeps normal Git semantics intact.→