Skip to content

ci: suppress pytest streaming output in CI#36092

Merged
Mason Daugherty (mdrxy) merged 1 commit into
masterfrom
mdrxy/reduce-verbosity
Mar 19, 2026
Merged

ci: suppress pytest streaming output in CI#36092
Mason Daugherty (mdrxy) merged 1 commit into
masterfrom
mdrxy/reduce-verbosity

Conversation

@mdrxy
Copy link
Copy Markdown
Member

Reduce CI log noise by suppressing pytest's per-test dot/verbose streaming output. The _test.yml workflow now passes PYTEST_EXTRA=-q to make test, which overrides the default verbosity with quiet mode — failures still print in full, but the thousands of ....... progress lines are gone. Local make test is unaffected since PYTEST_EXTRA defaults empty.

Changes

  • Add PYTEST_EXTRA ?= variable to all 21 package Makefiles and inject it into each test target's pytest invocation
  • Pass PYTEST_EXTRA=-q in _test.yml for both the main test step and the min-version retest step

@github-actions github-actions Bot added anthropic `langchain-anthropic` package issues & PRs chroma `langchain-chroma` package issues & PRs core `langchain-core` package issues & PRs deepseek `langchain-deepseek` package issues & PRs exa `langchain-exa` package issues & PRs fireworks `langchain-fireworks` package issues & PRs github_actions Pull requests that update GitHub Actions code groq `langchain-groq` package issues & PRs huggingface `langchain-huggingface` package issues & PRs infra PRs made that include chores, devops, repo meta changes integration PR made that is related to a provider partner package integration internal langchain `langchain` package issues & PRs langchain-classic `langchain-classic` package issues & PRs mistralai `langchain-mistralai` package issues & PRs model-profiles `langchain-model-profiles` package issues & PRs nomic `langchain-nomic` package issues & PRs ollama `langchain-ollama` package issues & PRs openai `langchain-openai` package issues & PRs openrouter `langchain-openrouter` package issues & PRs perplexity `langchain-perplexity` package issues & PRs qdrant `langchain-qdrant` package issues & PRs size: S 50-199 LOC standard-tests Related to the package `standard-tests` text-splitters Related to the package `text-splitters` xai `langchain-xai` package issues & PRs labels Mar 19, 2026
@codspeed-hq
Copy link
Copy Markdown

codspeed-hq Bot commented Mar 19, 2026

Merging this PR will improve performance by ×4.2

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

⚡ 19 improved benchmarks
✅ 7 untouched benchmarks
🆕 4 new benchmarks
⏩ 10 skipped benchmarks1

Performance Changes

Mode Benchmark BASE HEAD Efficiency
WallTime test_import_time[InMemoryVectorStore] 560.1 ms 498.9 ms +12.25%
WallTime test_import_time[LangChainTracer] 418.7 ms 369.9 ms +13.19%
WallTime test_import_time[RunnableLambda] 447.9 ms 400.3 ms +11.9%
WallTime test_import_time[ChatPromptTemplate] 584.9 ms 517.3 ms +13.08%
WallTime test_import_time[CallbackManager] 276.3 ms 251.1 ms +10.05%
WallTime test_import_time[Runnable] 444.4 ms 403.7 ms +10.09%
Simulation test_init_time 3,261.2 ms 785.6 ms ×4.2
Simulation test_init_time 1,514.3 ms 357.3 ms ×4.2
Simulation test_init_time 1,664.9 ms 419.2 ms ×4
Simulation test_init_time 1,618.4 ms 384 ms ×4.2
Simulation test_init_time 1,647.2 ms 406.8 ms ×4
Simulation test_init_time_with_client 2.3 ms 1.8 ms +25.71%
Simulation test_init_time 806.9 µs 646.3 µs +24.85%
Simulation test_qdrant_vectorstore_init_time 224.4 ms 174.8 ms +28.42%
Simulation test_chroma_init_time 60.4 ms 44.8 ms +34.9%
Simulation test_init_time 1,614.9 ms 381.2 ms ×4.2
🆕 WallTime test_init_time N/A 122.9 ms N/A
🆕 WallTime test_init_time N/A 2.7 ms N/A
🆕 WallTime test_init_time N/A 2.7 ms N/A
Simulation test_nomic_embeddings_init_time 1.5 ms 1.1 ms +30.85%
... ... ... ... ... ...

ℹ️ Only the first 20 benchmarks are displayed. Go to the app to view all benchmarks.


Comparing mdrxy/reduce-verbosity (226834a) with master (c4abc91)2

Open in CodSpeed

Footnotes

  1. 10 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports.

  2. No successful run was found on master (9c64cb7) during the generation of this report, so c4abc91 was used instead as the comparison base. There might be some changes unrelated to this pull request in this report.

@mdrxy Mason Daugherty (mdrxy) merged commit faadc1f into master Mar 19, 2026
297 checks passed
@mdrxy Mason Daugherty (mdrxy) deleted the mdrxy/reduce-verbosity branch March 19, 2026 01:24
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

anthropic `langchain-anthropic` package issues & PRs chroma `langchain-chroma` package issues & PRs core `langchain-core` package issues & PRs deepseek `langchain-deepseek` package issues & PRs exa `langchain-exa` package issues & PRs fireworks `langchain-fireworks` package issues & PRs github_actions Pull requests that update GitHub Actions code groq `langchain-groq` package issues & PRs huggingface `langchain-huggingface` package issues & PRs infra PRs made that include chores, devops, repo meta changes integration PR made that is related to a provider partner package integration internal langchain `langchain` package issues & PRs langchain-classic `langchain-classic` package issues & PRs mistralai `langchain-mistralai` package issues & PRs model-profiles `langchain-model-profiles` package issues & PRs nomic `langchain-nomic` package issues & PRs ollama `langchain-ollama` package issues & PRs openai `langchain-openai` package issues & PRs openrouter `langchain-openrouter` package issues & PRs perplexity `langchain-perplexity` package issues & PRs qdrant `langchain-qdrant` package issues & PRs size: S 50-199 LOC standard-tests Related to the package `standard-tests` text-splitters Related to the package `text-splitters` xai `langchain-xai` package issues & PRs

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant