Skip to content

Langfuse and Braintrust adoption

Teams migrating from Langfuse or Braintrust keep familiar framework workflows where possible. Softprobe adds portable WorkflowVersions, unified local/managed execution, evidence custody, and governed prod-to-eval — not a replacement eval DSL.

From Langfuse

You have todaySoftprobe path
Datasets / prompt suitesKeep as FrameworkDefinition (or export into Promptfoo/DeepEval)
Evaluator templatesStay in-framework; Softprobe pins RunnerVersion
Experiments on datasetssp eval run with same WorkflowVersion locally or managed
Scores on tracesOptional score projection from framework-reported results
Online eval rulesSoftprobe online policy + framework runner
Annotation queuesFramework / external queues for grader workflows; Softprobe stores evidence. For labeling Softprobe LLM captures, see Annotation (score bound to span / observation, with trace and session ids).

Improvements over Langfuse-only flows:

  • Immutable WorkflowVersion instead of mutable job configuration rows
  • Explicit missing_evidence / unsupported vs silent mapping gaps
  • One kernel for local CI and managed workers

From Braintrust

You have todaySoftprobe path
Eval(data, task, scores)Public API: framework suite + subject + environment + runner
ExperimentsWorkflowRun + ledger
Online scoring rulesOnline policy + framework runner
Logs → datasetProduction-to-eval loop with approval

Improvements:

  • EnvironmentVersion isolation first-class
  • Portable export of workflows and event bundles
  • Federated workers for private data residency

Side-by-side operation

You may run Braintrust or Promptfoo as pinned framework runners while Softprobe owns workflow identity, evidence, and gates during transition.

See Ecosystem mapping.

Zero code changes · Full-context visibility · Cost optimization