Concepts overview

Read these pages in order to understand the runner-first model.

Recommended reading order

1. Mental model — workflow and ownership
2. Native model and framework runners
3. Framework runners
4. Data model
5. Evidence and trajectories
6. Scores and gates
7. Annotation — labeling captured sessions (span / trace / session)
8. Environment bundles and dependency tapes — executable worlds for agent eval
9. How it works

By persona

Framework owner

Topic	Page
First run	Quick start
Runner packaging	Prepare a framework run
Promptfoo specifics	Promptfoo integration
Runner semantics	Framework runners

Platform operator

Topic	Page
Trust boundaries	Trust boundaries
Storage and retention	Storage and thelake
Runtime model	Kernel and hosts

CI / release owner

Topic	Page
Compare and promote	Compare and promote
Result status	Result status
Events	Events

Key principle

Softprobe owns the outer workflow and environment, frameworks own inner evaluation semantics.

framework suite + subject + environment + runner
→ WorkflowVersion → framework runner
→ native result bundle + evidence
→ Softprobe compare/gate/governance