Skip to content

Ecosystem mapping

Softprobe integrates frameworks as runners, not as schema replacements.

Mapping in one view

Promptfoo

Promptfoo conceptSoftprobe concept
promptfooconfig.yaml + tests.yamlDefinition artifact bundle
promptfoo evalFramework runner execution inside workflow
.promptfoo resultsNative result artifact + diagnostics
cell pass/failOptional projected measurement (non-authoritative)

DeepEval

DeepEval conceptSoftprobe concept
test case definitionsDefinition artifact bundle
metric executionRunner-owned semantics
metric outputsNative result artifact + optional projection

Braintrust / Langfuse

Softprobe can ingest/export datasets and traces, but release gates and lifecycle remain in Softprobe workflow.

Deliberate difference

Softprobe does not attempt complete parity translation of each framework DSL into a new universal schema.

Zero code changes · Full-context visibility · Cost optimization