ci: suppress pytest streaming output in CI#36092
Conversation
Merging this PR will improve performance by ×4.2
|
| Mode | Benchmark | BASE |
HEAD |
Efficiency | |
|---|---|---|---|---|---|
| ⚡ | WallTime | test_import_time[InMemoryVectorStore] |
560.1 ms | 498.9 ms | +12.25% |
| ⚡ | WallTime | test_import_time[LangChainTracer] |
418.7 ms | 369.9 ms | +13.19% |
| ⚡ | WallTime | test_import_time[RunnableLambda] |
447.9 ms | 400.3 ms | +11.9% |
| ⚡ | WallTime | test_import_time[ChatPromptTemplate] |
584.9 ms | 517.3 ms | +13.08% |
| ⚡ | WallTime | test_import_time[CallbackManager] |
276.3 ms | 251.1 ms | +10.05% |
| ⚡ | WallTime | test_import_time[Runnable] |
444.4 ms | 403.7 ms | +10.09% |
| ⚡ | Simulation | test_init_time |
3,261.2 ms | 785.6 ms | ×4.2 |
| ⚡ | Simulation | test_init_time |
1,514.3 ms | 357.3 ms | ×4.2 |
| ⚡ | Simulation | test_init_time |
1,664.9 ms | 419.2 ms | ×4 |
| ⚡ | Simulation | test_init_time |
1,618.4 ms | 384 ms | ×4.2 |
| ⚡ | Simulation | test_init_time |
1,647.2 ms | 406.8 ms | ×4 |
| ⚡ | Simulation | test_init_time_with_client |
2.3 ms | 1.8 ms | +25.71% |
| ⚡ | Simulation | test_init_time |
806.9 µs | 646.3 µs | +24.85% |
| ⚡ | Simulation | test_qdrant_vectorstore_init_time |
224.4 ms | 174.8 ms | +28.42% |
| ⚡ | Simulation | test_chroma_init_time |
60.4 ms | 44.8 ms | +34.9% |
| ⚡ | Simulation | test_init_time |
1,614.9 ms | 381.2 ms | ×4.2 |
| 🆕 | WallTime | test_init_time |
N/A | 122.9 ms | N/A |
| 🆕 | WallTime | test_init_time |
N/A | 2.7 ms | N/A |
| 🆕 | WallTime | test_init_time |
N/A | 2.7 ms | N/A |
| ⚡ | Simulation | test_nomic_embeddings_init_time |
1.5 ms | 1.1 ms | +30.85% |
| ... | ... | ... | ... | ... | ... |
ℹ️ Only the first 20 benchmarks are displayed. Go to the app to view all benchmarks.
Comparing mdrxy/reduce-verbosity (226834a) with master (c4abc91)2
Footnotes
-
10 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩
-
No successful run was found on
master(9c64cb7) during the generation of this report, so c4abc91 was used instead as the comparison base. There might be some changes unrelated to this pull request in this report. ↩
Reduce CI log noise by suppressing pytest's per-test dot/verbose streaming output. The
_test.ymlworkflow now passesPYTEST_EXTRA=-qtomake test, which overrides the default verbosity with quiet mode — failures still print in full, but the thousands of.......progress lines are gone. Localmake testis unaffected sincePYTEST_EXTRAdefaults empty.Changes
PYTEST_EXTRA ?=variable to all 21 package Makefiles and inject it into eachtesttarget's pytest invocationPYTEST_EXTRA=-qin_test.ymlfor both the main test step and the min-version retest step