Skip to content

bpo-25324: Move the description of tokenize tokens to token.rst. #1911

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 2 commits into from
Jun 6, 2017

Conversation

serhiy-storchaka
Copy link
Member

Also tweaks the formatting.

@serhiy-storchaka serhiy-storchaka added the docs Documentation in the Doc dir label Jun 1, 2017
@mention-bot
Copy link

@serhiy-storchaka, thanks for your PR! By analyzing the history of the files in this pull request, we identified @birkenfeld, @benjaminp and @vadmium to be potential reviewers.

Following token type values aren't used by the C tokenizer but are needed for
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Add the in front: The following token type values . . .

@serhiy-storchaka serhiy-storchaka merged commit 5cefb6c into python:master Jun 6, 2017
@serhiy-storchaka serhiy-storchaka deleted the token-docs branch June 6, 2017 15:43
@serhiy-storchaka
Copy link
Member Author

Thank you for your review @vadmium.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
docs Documentation in the Doc dir
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants