Skip to content

Conversation

xegulon
Copy link
Contributor

@xegulon xegulon commented Nov 10, 2021

Description

New script for automatically setting up Spark and Spark NLP on AWS SageMaker, in the same fashion as the Google Colab and Kaggle ones.

Motivation and Context

The goal is to make it easier to use Spark NLP along with the good Spark version on AWS SageMaker with a single curl bash command.

How Has This Been Tested?

I have tested it on SageMaker, and I get the good PySpark version (which is different from the one which is already installed).

Screenshots (if appropriate):

Types of changes

  • Bug fix (non-breaking change which fixes an issue)
  • Code improvements with no or little impact
  • New feature (non-breaking change which adds functionality)
  • Breaking change (fix or feature that would cause existing functionality to change)

Checklist:

  • My code follows the code style of this project.
  • My change requires a change to the documentation.
  • I have updated the documentation accordingly.
  • I have read the CONTRIBUTING page.
  • I have added tests to cover my changes.
  • All new and existing tests passed.

@xegulon
Copy link
Contributor Author

xegulon commented Nov 10, 2021

@maziyarpanahi it's here

@maziyarpanahi maziyarpanahi changed the base branch from master to release/333-release-candidate November 17, 2021 10:11
@maziyarpanahi maziyarpanahi merged commit a4c01d9 into JohnSnowLabs:release/333-release-candidate Nov 17, 2021
@xegulon xegulon deleted the add-sagemaker-setup-script branch November 29, 2021 09:27
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
documentation DON'T MERGE Do not merge this PR
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Export from HuggingFace BERT for Sequence Classification didn't work in AWS SageMaker
2 participants