fix(core/lsp): correctly compute ignored files

[ematipico]

Summary

This PR fixes an issue where the Daemon eat a lot of memory during the first scanning session.

Closes biomejs/biome-zed#107
Closes #6058

Scanner

The issue was caused by the fact that the scanner didn't check if a file is ignored before opening the file itself. If a file is ignored, Biome shouldn't care. The thing is, we need to check this only after we compute configuration files and ignore files. The was has been added inside the function open_file inside scanner.rs.

Also, I removed a Vec::with_capacity, because we were creating a vector that contained more items than it should. A small win.

LSP

Similarly, the LSP shouldn't open and store documents that are ignored. So now we check that inside text_document::did_open. All methods that require opening a document, now they check if the document exists inside documents, and we bail early (no error), if a document isn't there.

BiomePath

The kind of BiomePath isn't a bitflag anymore. We don't use it semantically, because the priority that we create for the first time is always one, and we never assign multiple flags. A small win.

Dome

As for now, I removed the usage of Dome because it's useless for now. It's not slow, but evaluated_paths is already a BTreeSet, so there's no reason to create an ad-hoc iterator.

Test Plan

Added a new test. Tested it manually many times. Used the ecosystem CI extensively.

[github-actions]

Parser conformance results on

js/262

Test result	main count	This PR count	Difference
Total	50558	50558	0
Passed	49243	49243	0
Failed	1315	1315	0
Panics	0	0	0
Coverage	97.40%	97.40%	0.00%

jsx/babel

Test result	main count	This PR count	Difference
Total	40	40	0
Passed	37	37	0
Failed	3	3	0
Panics	0	0	0
Coverage	92.50%	92.50%	0.00%

symbols/microsoft

Test result	main count	This PR count	Difference
Total	6650	6650	0
Passed	2229	2229	0
Failed	4421	4421	0
Panics	0	0	0
Coverage	33.52%	33.52%	0.00%

ts/babel

Test result	main count	This PR count	Difference
Total	812	812	0
Passed	722	722	0
Failed	90	90	0
Panics	0	0	0
Coverage	88.92%	88.92%	0.00%

ts/microsoft

Test result	main count	This PR count	Difference
Total	18705	18705	0
Passed	14351	14351	0
Failed	4354	4354	0
Panics	0	0	0
Coverage	76.72%	76.72%	0.00%

[codspeed-hq]

CodSpeed Performance Report

Merging #6052 will not alter performance

_{Comparing fix/correctly-compute-ignored-files (df117c8) with main (64ca243)}

Summary

✅ 94 untouched benchmarks
🆕 1 new benchmarks

Benchmarks breakdown

	Benchmark	BASE	HEAD	Change
🆕	html_formatter[index_1033418810622582172.html]	N/A	462.2 µs	N/A

[arendjr]

Good stuff! Haven't looked at the test failures yet though 😅

[arendjr]

Amazing work 🙇