Module eval-surface

Variables

paid_claudeEvalDriver

Functions

paid_judge
paid_judged
paid_measure
paid_measureArms
paid_measureTriggerRate
paid_runEval

References

AgentRunArgs → AgentRunArgs
AgentRunner → AgentRunner
ArmReport → ArmReport
ArmsCheckReport → ArmsCheckReport
ArmsMeasureSpec → ArmsMeasureSpec
ArmUsage → ArmUsage
Check → Check
CheckRate → CheckRate
CheckReport → CheckReport
CheckResult → CheckResult
EvalArm → EvalArm
EvalDriver → EvalDriver
EvalReport → EvalReport
EvalSpec → EvalSpec
EvalUsage → EvalUsage
HomeFiles → HomeFiles
HomeSeed → HomeSeed
JudgeFn → JudgeFn
MeasureSpec → MeasureSpec
Metrics → Metrics
MetricStat → MetricStat
ModelOutputParser → ModelOutputParser
ParsedModelRun → ParsedModelRun
PromptDiversityIssue → PromptDiversityIssue
PromptTriggerStat → PromptTriggerStat
RunContext → RunContext
RunEnv → RunEnv
RunOut → RunOut
SelectionTrialResult → SelectionTrialResult
StubCall → StubCall
StubOutcome → StubOutcome
ToolStub → ToolStub
Trace → Trace
TriggerRateReport → TriggerRateReport
TriggerRateSpec → TriggerRateSpec