nightly

What's Changed

Miscellaneous and Others 🔔

• Secrets by @thomas-zahner in #2007
• Document file format support by @thomas-zahner in #2052
• feat: pre-commit should use a fixed version according to yaml 'rev' by @katrinafyi in #2042
• refactor!: add BaseInfo for resolving links, delete Base, cleanup utils by @katrinafyi in #2005
• Fix toc action by @thomas-zahner in #2055
• Add make readme to generate and update the readme's --help text by @katrinafyi in #2047
• Show line & column numbers by @thomas-zahner in #2056
• refactor: add WaitGroup for waiting for a dynamic set of tasks by @katrinafyi in #2046
• Prevent duplicate requests to the same URLs by @thomas-zahner in #2067
• Add JUnit by @thomas-zahner in #2066
• feat: allow accepting timeouts by @cristiklein in #2063
• Remove deduplication of Request after source tracking by @katrinafyi in #2075
• Box ErrorKind within RequestError to fix oversize lint by @katrinafyi in #2079
• Remove file url trailing slash warning by @katrinafyi in #2083
• Nlnet hex sticker by @thomas-zahner in #2085
• Report input source errors rather than tokio panics by @katrinafyi in #2074
• feat: Support sitemap.xml by @cristiklein in #2071
• Remove raw mode by @thomas-zahner in #2086
• Increase value for --max-redirects by @thomas-zahner in #2087
• Adds shell completions for lychee by @mre in #1972
• Fix Windows Absolute Path Parsing and Remove HTTP Assumption by @mre in #1837
• Add RelativeUri enum for types of relative links by @katrinafyi in #2078
• fix(pre-commit): use latest release docker image by @JonZeolla in #2092
• fix: update email test fixture by @thomas-zahner in #2095
• ci: add cargo doc to CI, allowing warnings for now by @katrinafyi in #2096
• Hide progress bar if input is stdin only by @mre in #1938
• refactor: unify input URL fetching with the link-checker's HostPool by @mre in #2100
• fix(cache): never cache errors on disk (#1734) by @mre in #2105

New Contributors

• @cristiklein made their first contribution in #2063
• @JonZeolla made their first contribution in #2092

Full Changelog: lychee-v0.23.0...nightly

lychee-v0.23.0

Added

• Implement per-host rate limiting and statistics (#1929)
• Per-host caching (#1974)
• Replace OpenSSL with rustls (#1928)
• Replace check-if-email-exists with mailify (#1985)
• Redirect hint (#2020)
• Extract URLs from CSS (#1956)
• Improve wikilink parsing and checking (#1799)

Fixed

• CacheableResponse should only download file when needed (#2035)
• Combine host stats with response stats (#1975)
• Use u8 instead of i8 for log level values
• Accept ranges (#1989)
• Rejected urls (#1990)

Other

• Speed up slow tests (#2019)
• Improve README.md UX (#2029)
• Update to reqwest 0.13.1 & cargo update
• Use absolute instead of canonicalize for relative root-dir (#2008)
• Log successful responses only for Debug and Trace
• Only show redirect details in verbose mode
• Show status code in redirect list
• Update comparison table (#1997)
• Specify that Scoop installation is for Windows (#1969)
• Extract record_cache_event & skip mail caching
• Add tldr-pages link to README (#1963)
• (deps) bump the dependencies group across 1 directory with 3 updates (#1961)
• (deps) bump the dependencies group with 2 updates
• (deps) bump the dependencies group across 1 directory with 4 updates
• (deps) bump the dependencies group with 5 updates (#1988)
• (deps) bump the dependencies group with 4 updates (#1978)
• (deps) bump the dependencies group with 4 updates (#1973)

lychee-lib-v0.23.0

Added

• Implement per-host rate limiting and statistics (#1929)
• Per-host caching (#1974)
• Replace OpenSSL with rustls (#1928)
• Replace check-if-email-exists with mailify (#1985)
• Redirect hint (#2020)
• Extract URLs from CSS (#1956)
• Improve wikilink parsing and checking (#1799)
• Show status code in redirect list

Fixed

• CacheableResponse should only download file when needed (#2035)
• GITHUB_TOKEN should not cause rustls CryptoProvider panic (#2036)
• Combine host stats with response stats (#1975)
• Fix overflow when handling rate limit headers
• Try to fix rustls setup after recent reqwest change (#2016)
• Accept ranges (#1989)
• Rejected urls (#1990)

Other

• Speed up slow tests (#2019)
• Improve README.md UX (#2029)
• Update to reqwest 0.13.1 & cargo update
• Use absolute instead of canonicalize for relative root-dir (#2008)
• Update comparison table (#1997)
• Fix source code formatting in ErrorKind::details() (#1993)
• Specify that Scoop installation is for Windows (#1969)
• Extract record_cache_event & skip mail caching
• Improve logging
• Add tldr-pages link to README (#1963)
• (deps) bump the dependencies group with 2 updates
• (deps) bump the dependencies group across 1 directory with 4 updates
• (deps) bump the dependencies group with 5 updates (#1988)
• (deps) bump the dependencies group with 4 updates (#1978)
• (deps) bump the dependencies group with 4 updates (#1973)
• (deps) bump the dependencies group with 2 updates (#1967)
• (deps) bump the dependencies group across 1 directory with 3 updates (#1961)
• (deps) bump the dependencies group with 2 updates (#1948)

lychee-v0.22.0

Added

• support relative --root-dir (#1912)
• propagate input loading/collecting errors to top level (#1864)
• file preprocessing (#1891)

Fixed

• make file matcher respect the hidden option (#1936)
• inverted gitignore behaviour for --dump-inputs (#1882)

Other

• (deps) bump the dependencies group with 5 updates (#1944)
• progress bar (#1914)
• Bump the dependencies group with 3 updates (#1933)
• Fix parsing larger HTML blocks in MDX files (#1924)
• use markdown formatting for files-from help text (#1917)
• Bump the dependencies group across 1 directory with 8 updates (#1916)
• use log::Level's deserialiser, and link example TOML (#1907)
• Config file up to date (#1906)
• check glob validity when parsing input source arguments (#1869)
• Fix typos, and configure the typos tool (#1895)
• Address new clippy lints with version 1.91
• Bump MSRV
• Bump the dependencies group across 1 directory with 7 updates

lychee-lib-v0.22.0

Added

• add github markdown fragment quirk (#1940)
• support relative --root-dir (#1912)
• propagate input loading/collecting errors to top level (#1864)
• file preprocessing (#1891)

Fixed

• make file matcher respect the hidden option (#1936)
• parsing of srcset URLs after the first URL (#1890)

Other

• (deps) bump the dependencies group with 5 updates (#1944)
• progress bar (#1914)
• Bump the dependencies group with 3 updates (#1933)
• Provide a more helpful error message in case of TLS protocol issues (#1927)
• Fix parsing larger HTML blocks in MDX files (#1924)
• Bump the dependencies group with 3 updates (#1921)
• Fix outdated reference to pre
• Make use of more explicit LazyLock::force
• use markdown formatting for files-from help text (#1917)
• Bump the dependencies group across 1 directory with 8 updates (#1916)
• use InputResolver to implement Input::get_sources (#1880)
• Fix extracting links after <pre><code></code></pre> (#1911)
• check glob validity when parsing input source arguments (#1869)
• remove unimportant public library function (#1893)
• Fix typos, and configure the typos tool (#1895)
• Remove an unneeded clone (#1897)
• Address new clippy lints with version 1.91
• clippy --fix
• Bump MSRV
• Bump the dependencies group across 1 directory with 7 updates

lychee-v0.21.0

Added

• print warning if input source matches no files (#1865)
• (base-url) [breaking] disallow relative local base to avoid confusion (#1857)
• improve InvalidIndexFile error to mention index file names (#1859)

Fixed

• move log level padding outside brackets (#1871)
• do not reuse excluded status from cache (#1850)
• fields missing from config.toml parsing logic (#1843)

Other

• Bump the dependencies group across 1 directory with 15 updates (#1874)
• Inline formatting arguments for anyhow macros as per new lint
• Man pages (#1858)
• Add --default-extension argument to force file format (#1842)
• Hard wrap help text for options (#1854)
• Bump the dependencies group with 6 updates (#1855)
• Add exhaustivity check for fold_in! macro (#1848)
• Additional redirect reporting (#1853)
• Redirect reporting (#1725)
• Add WinGet installation instructions (#1849)
• [breaking] Use ResolvedInputSource downstream of InputContent (#1840)
• Bump the dependencies group with 5 updates (#1845)
• Implement --files-from Option (#1836)
• Apply fallback extensions if directory links resolve to a dir (#1826)
• Clarify --base-url and --root-dir and their interactions (#1787)
• Add test for making sure URL inputs always get checked (#1824)
• Add conda install to readme (#1822)
• Bump the dependencies group with 3 updates (#1821)
• Refactor error reporting (#1731)

lychee-lib-v0.21.0

Added

• print warning if input source matches no files (#1865)
• (base-url) [breaking] disallow relative local base to avoid confusion (#1857)
• improve InvalidIndexFile error to mention index file names (#1859)

Fixed

• do not reuse excluded status from cache (#1850)
• fields missing from config.toml parsing logic (#1843)
• add support for name attributes in HTML fragment extraction (#1839)

Other

• Update flag description
• Bump the dependencies group across 1 directory with 15 updates (#1874)
• Man pages (#1858)
• Extract spans (#1870)
• Remove truncate_source logic (#1847)
• Add --default-extension argument to force file format (#1842)
• Hard wrap help text for options (#1854)
• Bump the dependencies group with 6 updates (#1855)
• Additional redirect reporting (#1853)
• Fix extraction of reference links in Markdown (#1841)
• Redirect reporting (#1725)
• Add WinGet installation instructions (#1849)
• [breaking] Use ResolvedInputSource downstream of InputContent (#1840)
• Bump the dependencies group with 5 updates (#1845)
• Implement --files-from Option (#1836)
• Optimize InputSource handling with Cow and add benchmarks (#1832)
• Ignore Links in Markdown Link Text (#1831)
• Separate resolving and checking for easier testing (#1830)
• Refactor Input Handling (#1827)
• Fix links in doc comments (#1828)
• Apply fallback extensions if directory links resolve to a dir (#1826)
• Clarify --base-url and --root-dir and their interactions (#1787)
• Refactor collector and input (#1823)
• Add conda install to readme (#1822)
• Bump the dependencies group with 3 updates (#1821)
• Refactor error reporting (#1731)

lychee-v0.20.1

Other

• Always check files explicitly if specified by user or matched by user glob (#1816)
• (docs) update TOC
• Bump the dependencies group across 1 directory with 3 updates (#1812)
• Update changelog

lychee-lib-v0.20.1

Other

• Always check files explicitly if specified by user or matched by user glob (#1816)
• (docs) update TOC
• Bump the dependencies group across 1 directory with 3 updates (#1812)
• Update changelog

lychee-v0.20.0

Added

• make wikilink extraction and checking opt-in (#1803)
• skip fragment checking for unsupported MIME types (#1744)
• add 'user-content-' prefix to support github markdown fragment (#1750)

Fixed

• do not check the fragment when http response err but accepted (#1763)
• treat a fragment in an empty directory as an error (#1756)
• resolve index file inside a directory (#1752)
• skip fragment check if website URL doesn't contain fragment (#1733)

Other

• Bump dependencies (#1811)
• Skip binary and invalid UTF-8 inputs (#1810)
• Refactor input dumping and path retrieval with extension filtering (#1648)
• Use a HashSet to store inputs and avoid duplicates (#1781)
• add --index-files flag, and turn off index file checking by default (#1777)
• Cleanup input example (#1792)
• Fix missing identifier in snap build action; add snap install to readme (#1793)
• refactor test_fragments to clarify expected successes/fails (#1776)
• Regular expressions for exclude_path (#1766)
• Replace unmaintained human-sort with numeric-sort (#1759)
• Fix basic auth (#1748)
• Update 'Users' section in the README
• Add ProseKit to users
• Migrate to Clippy 1.88 (#1749)
• fix assertion in fragment checks
• Replace unreliable API URL
• display unsupported URLs (#1727)