Forest Mountain (0.1.11)

[EliotJones]

Welcome to version 0.1.11. The changes in this version have mainly focused on stability. There is a breaking API change.

We have also started to run tests against a larger corpus of documents from Common Crawl allowing us to find bugs and malformed files proactively. This release is screened against 6000 additional files.

• Improvements to content and font parsing detected by fuzzing inputs.
• Improvements and resiliency for finding the startxref location when parsing a file..
• Adds build and tests for Mac OS as well as retrieving system fonts on iPad (Mac Catalyst).
• Support clipping when rendering XObjects.
• Prevent malformed files leading to an out-of-memory when decompressing streams.
• Make IGraphicsStateOperationFactory and ReflectionGraphicsStateOperationFactory public.
• Softmask support for images.
• Performance improvements using Span and ReadOnlyMemory where available.
• Handle corrupt files where the stream contains comment tokens.
• Improvements to copying from existing files when using PdfDocumentBuilder, fixes some bugs with copying fonts and dictionary tokens referenced indirectly.
• Handle corrupt files with double endstream definitions.
• More tolerant parsing for a number of invalid PDFs, including invalid USC2 input, CMAP formats, CFF fonts, missing font subtypes, invalid xref table positions, missing /FirstChar entry for font dictionaries and corrupt ASCII 85 encoded data.
• Fix an issue where adding content to an existing PDF using PdfDocumentBuilder could result in upside-down or wrongly positioned text due to global transforms in the source PDF.
• New option to completely skip annotations when building a document.
• Prevent infinite loops in certain documents Detect cyclic references during IndirectReferenceToken resolution #1096.
• Improved performance when tokenizing numbers, this should provide a minor speed improvement.
• When adding a page from an existing PDF to a PdfDocumentBuilder any external link annotations should be preserved.

Breaking changes

The method on PdfDocumentBuilder:

public PdfPageBuilder AddPage(PdfDocument document, int pageNumber, Func<PdfAction, PdfAction?>? copyLink)

Has been changed to wrap the copyLink parameter in an options object to support the KeepAnnotations option:

public PdfPageBuilder AddPage(PdfDocument document, int pageNumber, AddPageOptions options)

You can just set the CopyLinkFunc property in the options object if you need to access this functionality.

Auto generated change log

• Bump version to 0.1.11-alpha001 by @BobLd in Bump version to 0.1.11-alpha001 #1009
• Improve Jpeg2000Helper to support J2K codec and add test by @BobLd in Improve Jpeg2000Helper to support J2K codec and add test #1010
• Add SetStrokeDetails() and SetFillDetails() to PdfPath and tidy up ContentStreamProcessor by @BobLd in Add SetStrokeDetails() and SetFillDetails() to PdfPath and tidy up ContentStreamProcessor #1014
• Implement clipping in ProcessFormXObject() by @BobLd in Implement clipping in ProcessFormXObject() #1015
• Fix Exception thrown when coping pages from Weasyprint generated PDF #1017 by @lofcz in Fix #1017 #1018
• Fix PatternColor Equals() method and fix calling Equals on 2 Letter.Color objects throws a NullException #1016 by @BobLd in Fix PatternColor Equals() method and fix #1016 #1019
• Feature/image mask by @BobLd in Feature/image mask #1012
• Update README.md by @BobLd in Update README.md #1020
• Fix bug where FormXObject bbox needs to be normalised by @BobLd in Fix bug where FormXObject bbox needs to be normalised #1021
• Add MacOS test pipeline and fix failing tests by @BobLd in Add MacOS test pipeline and fix failing tests #1025
• Update README.md by @BobLd in Update README.md #1026
• Seal PdfSubpath class and IPathCommand implementations, fix Close.GetHashCode() and fix Why doesn't the Close class override the Hash method? #1027 by @BobLd in Seal PdfSubpath class and IPathCommand implementations, fix Close.GetHashCode() and fix #1027 #1029
• Fix issue Opening page of PDF document fails with font issue #1013 by @BobLd in Fix issue #1013 #1031
• Add support for MacCatalyst in SystemFontFinder by @BobLd in Add support for MacCatalyst in SystemFontFinder #1033
• Make sure the value of the ImageMask / Im token is check in ColorSpaceDetailsParser by @BobLd in Make sure the value of the ImageMask / Im token is check in ColorSpaceDetailsParser #1038
• Add early support for Stencil masking, rename SoftMaskImage property into MaskImage and make sure IsInlineImage is true for InlineImage by @BobLd in Add early support for Stencil masking, rename SoftMaskImage property into MaskImage and make sure IsInlineImage is true for InlineImage #1039
• Bugfix and optimize GetStartXrefPosition by @ricflams in Bugfix and optimize GetStartXrefPosition #1036
• Fix bug introduced in Add early support for Stencil masking, rename SoftMaskImage property into MaskImage and make sure IsInlineImage is true for InlineImage #1039 by @BobLd in Fix bug introduced in #1039 #1041
• Try to repair xref offset by looking for all startxref and fix An error was reported when I used PdfPig to convert a PDF to text. #1040 by @BobLd in Try to repair xref offset by looking for all startxref and fix #1040 #1044
• Add test to ensure EOF problem with file. #822 is fixed by @BobLd in Add test to ensure #822 is fixed #1045
• Handle TrueType case in CidFontFactory where the font is CFF by @BobLd in Handle TrueType case in CidFontFactory where the font is CFF #1046
• Issues/1048 by @BobLd in Issues/1048 #1049
• Check for infinite recursion in ObjectLocationProvider.TryGetOffset() and fix ReadTrailer causes StackOverflowException when loading a PDF, resulting in a crash. #1050 by @BobLd in Check for infinite recursion in ObjectLocationProvider.TryGetOffset() and fix #1050 #1051
• Improve IFilter memory allocation by @BobLd in Improve IFilter memory allocation #1052
• Modernise PngPredictor and refactor LzwFilter and FlateFilter to reduce memory allocation by @BobLd in Modernise PngPredictor and refactor LzwFilter and FlateFilter to reduce memory allocation #1053
• Do not throw if the Mask dictionary contains a ColorSpace key by @BobLd in Do not throw if the Mask dictionary contains a ColorSpace key #1055
• Make the Diacritics class public for use in external StreamProcessors by @BobLd in Make the Diacritics class public for use in external StreamProcessors #1056
• Add extension method to get Memory from MemoryStream, attempting to do it without allocation and update CMapParser by @BobLd in Add extension method to get Memory<byte> from MemoryStream, attempting to do it without allocation and update CMapParser #1057
• Miscellaneous minor changes by @BobLd in Miscellaneous minor changes #1058
• Optimize internal representation of IndirectReference by @BobLd in Optimize internal representation of IndirectReference #1059
• Skip creating IndirectReference in CrossReferenceTablePartBuilder when generationNumber is more than 65,535 by @BobLd in Skip creating IndirectReference in CrossReferenceTablePartBuilder when generationNumber is more than 65,535 #1060
• Check ColorSpace token as dictionary and fix issue Invalid ColorSpace token encountered in page resource dictionary: <ColorSpace, /DeviceRGB> #1061 by @BobLd in Check ColorSpace token as dictionary and fix issue #1061 #1063
• Make classes related to page content parsing public by @BobLd in Make classes related to page content parsing public #1065
• Prevent RunLengthFilter malicious OOM by @BobLd in Prevent RunLengthFilter malicious OOM #1068
• Use ReadOnlyMemory in ShowText operators and implement MoveToNextLineShowTextWithSpacing parsing by @BobLd in Use ReadOnlyMemory<byte> in ShowText operators and implement MoveToNextLineShowTextWithSpacing parsing #1066
• Fix bug in PngFromPdfImageFactory where softmask is wrongly referenced. by @orrest in Fix bug in PngFromPdfImageFactory where softmask is wrongly referenced. #1069
• Fix issue 926 by @EliotJones in Fix issue 926 #1072
• writer util did not follow reference links System.ApplicationException when using CopyFrom #1032 by @EliotJones in writer util did not follow reference links #1032 #1073
• fix Some pdf stream objects contain two endstreams #670 by ignoring duplicate endstream definitions by @EliotJones in fix #670 by ignoring duplicate endstream definitions #1075
• skip single letter final blocks by @EliotJones in skip single letter final blocks #1076
• fix copying of sub-dictionary when keys collide by @EliotJones in fix copying of sub-dictionary when keys collide #1077
• use correct bounding boxes for standard 14 glyphs Why GlyphRectangle bounding box not correct for letter g? #850 by @EliotJones in use correct bounding boxes for standard 14 glyphs #850 #1080
• back-calculate first char if last char and widths present by @EliotJones in back-calculate first char if last char and widths present #1081
• fix off-by-one and optimize brute force xref search The dictionary did not contain a number with the key /Size #1078 by @EliotJones in fix off-by-one and optimize brute force xref search #1078 #1079
• fall back to times-roman as standard 14 font when lenient by @EliotJones in fall back to times-roman as standard 14 font when lenient #1085
• allow reading to continue if encountering an invalid surrogate pair by @EliotJones in allow reading to continue if encountering an invalid surrogate pair #1084
• fix colorspace error when form xobject contains a transparency group by @EliotJones in fix colorspace error when form xobject contains a transparency group #1088
• support bfrange having incorrect length in a cmap by @EliotJones in support bfrange having incorrect length in a cmap #1089
• add new action to run integration against common crawl corpus by @EliotJones in add new action to run integration against common crawl corpus #1090
• Update run_common_crawl_tests.yml by @BobLd in Update run_common_crawl_tests.yml #1091
• Remove decode parameter application from Stencil color space for consistency by @BobLd in Remove decode parameter application from Stencil color space for consistency #1092
• Update hack for 1bpc + DeviceGray by @BobLd in Update hack for 1bpc + DeviceGray #1093
• when writing content to an existing page inverse any global transform CopyFrom and AddPage both cause AddText to be written upside down #614 by @EliotJones in when writing content to an existing page inverse any global transform #614 #1094
• add option to strip annotation by @EnraH in add option to strip annotation #492
• check for cycles during indirect reference resolution by @jan-sutter in check for cycles during indirect reference resolution #1097
• i merged a pr which broke the build, this updates the build to work by @EliotJones in i merged a pr which broke the build, this updates the build to work #1099
• remove debug asserts causing test failures by @EliotJones in remove debug asserts causing test failures #1098
• Track IndirectReference instead of only ObjectNumber when checking for cycles during indirect reference resolution and add test by @BobLd in Track IndirectReference instead of only ObjectNumber when checking for cycles during indirect reference resolution and add test #1101
• move last uncovered operators to switch statement by @EliotJones in move last uncovered operators to switch statement #1100
• rework numeric tokenizer hot path by @EliotJones in rework numeric tokenizer hot path #1104
• make link copying more tolerant when adding page by @EliotJones in make link copying more tolerant when adding page #1103
• handle additional broken pdf files in the common crawl set by @EliotJones in handle additional broken pdf files in the common crawl set #1108
• update readme to avoid people using page.Text or asking about editing docs by @EliotJones in update readme to avoid people using page.Text or asking about editing docs #1109

New Contributors

Thanks to the following people who made their first contributions to the project in this release:

• @lofcz Fix #1017 #1018
• @ricflams Bugfix and optimize GetStartXrefPosition #1036
• @orrest Fix bug in PngFromPdfImageFactory where softmask is wrongly referenced. #1069
• @EnraH add option to strip annotation #492
• @jan-sutter check for cycles during indirect reference resolution #1097

And thanks to those who reported issues that help us improve the library and fix bugs.

Full Changelog: v0.1.10...v0.1.11

---

This discussion was created from the release Forest Mountain (0.1.11).