3.0.6

Bug Fixes

• sentence: use offset instead of index (80b5528)

3.0.4

Bug Fixes

• sentence: remove value from Sentence node (d092dd9)

3.0.3

Bug Fixes

• sentence: fix column position (6f59eb8)

3.0.2

Bug Fixes

• sentence: correct handle line number for pre-node (f61466c)

3.0.1

Bug Fixes

• sentence: fix to handle last new line of sentence (f8cacbe)

3.0.0

Rewrite library

It is inspired by diasks2/pragmatic_segmenter: Pragmatic Segmenter is a rule-based sentence boundary detection gem that works out-of-the-box across many languages..

Concepts

Sentence Splitter for text and AST.

Changes

• Remove all options
  • BREAKING CHANGE
• Correct handlong number, ABBREVIATIONS, .<space> etc.. #6
• Can accept AST and Output AST
  • textlint needs is from AST to AST textlint/textlint#366
  • It allow the user to transform Paragraph node to Paragraph node with sentence
  • function splitAST(paragraphNode: TxtParentNode): TxtParentNode;
  • See also TxtAST

TODO

Remove all options and drop extensibility.
We want to get an extensibility based on UseCase.
Please file an issue if you want to extend this library.

Migration

From v2 to v3.

When not to use option

Do not noting.

When use some option

v3 remove all option temporary.
If you want to get extensibility, please file issue.

2.3.2

Bug Fixes

• sentence: support continuous whitespace nodes (d3bb665)

2.3.1

Bug Fixes

• fix whitespace handling (eedb106)

2.3.0

Features

• setence: add Whitespace Node between Sentence (#7) (1fddf36)

2.2.0

Features

• add separatorChars insteadof charRegExp option (#5) (e969782)
• separatorChars
  • default: [".", "。", "?", "!", "？", "！"]
  • separator chars of sentences.