Details

the metrics validates if a llm output is valid json and optionally conforms to a provided pydantic schema. The implementation spans the Python SDK, frontend UI for online evaluation, an example script

Issues

Resolves #2528

Documentation

Updated in structured_output_compilance.mdx

/claim #2528

Claim

Total prize pool $50
Total paid $0
Status Pending
Submitted June 23, 2025
Last updated June 23, 2025

Contributors

MI

Milan D Vijay

@ibishal

100%

Sponsors

CO

Comet

@comet-ml

$50