Projects

Project system

PromptPilot

Prompt versioning and A/B testing across AI providers.

What it does

PromptPilot creates prompt YAML files, saves version backups, diffs prompt revisions, and runs provider-backed A/B tests from a CLI.

GitHub repository

Open the source repo for installation, package code, tests, and release details.

System map

1
input
Prompt YAML
Template, variables, metadata
2
storage
Version Store
Backups and history
3
decision
Diff
Git or file history
4
service
Providers
OpenAI, Claude, local models
5
output
A/B Result
Cost, response, winner

Codebase read

  • Prompt files are stored as YAML with metadata, variables, token estimates, and version history.
  • Versioning supports manual backups and git diff fallback when a repository is present.
  • The CLI lazy-loads heavier dependencies so common commands start quickly.

Key snippet

promptpilot init my-summary \
  --description "Summarize text in 3 paragraphs"

promptpilot abtest my-summary \
  --input sample.txt \
  --provider openai

Tech used

PythonClickYAMLGitPythonOpenAIAnthropicTransformers

Source paths inspected

src/promptpilot/cli.pyversioning.pyutils.py

More project systems

GoVisual

Zero-config HTTP request visualizer for Go applications.

FastAPI Radar

Real-time request, SQL query, exception, and trace dashboard for FastAPI apps.

LLMDog

Terminal UI for selecting code context and turning it into LLM-ready Markdown.

GIQ

AI-enhanced Git workflow assistant that keeps normal Git semantics intact.