Skip to content

feat(groq): add support for json_mode #32396

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 2 commits into
base: master
Choose a base branch
from

Conversation

janzheng
Copy link

@janzheng janzheng commented Aug 4, 2025

Description: Added support for Groq's new json_mode for constrained outputs / structured outputs; these ONLY pertain to certain models, but improves consistency dramatically. Docs here: https://console.groq.com/docs/structured-outputs. Also replaced the default Gemma2 test with a llama-3.3-70b-versatile test since Gemma2 is deprecated. Also bumped the groq-sdk to 0.30.0

Dependencies: groq python sdk: https://pypi.org/project/groq/

Tests and Docs: No new tests have been added, but test_chat_models.py default model has been updated to moonshotai/kimi-k2-instruct. Tests are passing.

Copy link

vercel bot commented Aug 4, 2025

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
langchain 🛑 Canceled (Inspect) Aug 4, 2025 8:25pm

Copy link

codspeed-hq bot commented Aug 4, 2025

CodSpeed WallTime Performance Report

Merging #32396 will not alter performance

Comparing janzheng:master (2beced7) with master (9de0892)

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

Summary

✅ 13 untouched benchmarks

Copy link

codspeed-hq bot commented Aug 4, 2025

CodSpeed Instrumentation Performance Report

Merging #32396 will not alter performance

Comparing janzheng:master (2beced7) with master (9de0892)

Summary

✅ 14 untouched benchmarks

@mdrxy mdrxy changed the title feat(groq): add support for Groq json_mode feat(groq): add support for json_mode Aug 4, 2025
@mdrxy mdrxy added the integration Related to a provider partner package integration label Aug 4, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
integration Related to a provider partner package integration
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants