Skip to content

Incorrect Rust example for SeparatorTokens settings #642

@hak0

Description

@hak0

In the documentation for update-non-seperator-tokens, examples for other languages correctly use the updateNonSeparatorTokens method. However, the Rust example incorrectly uses the .set_dictionary method.

The Rust example should instead use something like:

.set_non_separator_tokens(&vec!["@".to_string(), "#".to_string()])

This issue applies to all APIs under Separator tokens and Non-separator tokens, where Rust code currently references dictionary-related APIs.

Metadata

Metadata

Assignees

No one assigned

    Labels

    documentationImprovements or additions to documentationgood first issueGood for newcomers

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions