Skip to content

(fix): fix to handle non json llm response#40

Merged
murdore merged 1 commit into
juspay:mainfrom
narsimhaReddyJuspay:handle-non-json-llm-responses-for-evaluators
May 10, 2026
Merged

(fix): fix to handle non json llm response#40
murdore merged 1 commit into
juspay:mainfrom
narsimhaReddyJuspay:handle-non-json-llm-responses-for-evaluators

Conversation

@narsimhaReddyJuspay
Copy link
Copy Markdown

  • some llm services might return non json or md responses for evlauator output added support to extract json and parse it if it happens

What does this PR do?

PR title must follow Conventional Commits, for example feat(web): add trace filters or fix: handle empty dataset names.

Fixes # (issue)

Type of change

  • Bug fix (non-breaking change which fixes an issue)
  • Chore (refactoring code, technical debt, workflow improvements)
  • New feature (non-breaking change which adds functionality)
  • Breaking change (fix or feature that would cause existing functionality to not work as expected)
  • Refactor (does not change functionality, e.g. code style improvements, linting)
  • This change requires a documentation update

Mandatory Tasks

  • Make sure you have self-reviewed the code. A decent size PR without self-review might be rejected.

Checklist

  • I haven't read the contributing guide
  • My code doesn't follow the style guidelines of this project (pnpm run format)
  • I haven't commented my code, particularly in hard-to-understand areas
  • I haven't checked if my PR needs changes to the documentation
  • I haven't checked if my changes generate no new warnings (npm run lint)
  • I haven't added tests that prove my fix is effective or that my feature works
  • I haven't checked if new and existing unit tests pass locally with my changes

- some llm services might return non json or md responses for evlauator output
added support to extract json and parse it if it happens
@narsimhaReddyJuspay narsimhaReddyJuspay force-pushed the handle-non-json-llm-responses-for-evaluators branch from 5818191 to 20c824e Compare May 4, 2026 11:01
@murdore murdore merged commit 60479d9 into juspay:main May 10, 2026
15 of 35 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants