(aws_stepfunctions_tasks): (Add support to start glue crawlers)

[rodgjame]

Describe the feature

As a user of aws-cdk, I would like to create a step function with a step to start a Glue Crawler so I don't have invoke a crawler via a Lambda. Lambdas have a 15 min timeout which is too short for some crawlers of large datasets to be fully crawled.

Use Case

When I'm in the step function design studio, I do see an option for a StartCrawler step. This step is not available in the CDK modules so I'm unable to create step functions that has this step in it.

Proposed Solution

I would like a new task type that allows me to kick off a glue crawler. Something like:

const runGlueCrawler = new tasks.GlueStartCrawler(....

Other Information

No response

Acknowledgements

• I may be able to implement this feature request
• This feature might incur a breaking change

CDK version used

"aws-cdk": "^2.58.1"

Environment details (OS name and version, etc.)

Amazon Linux 2

[amiraliucsc]

We also need the same feature. up voting this.

[khushail]

Hi @rodgjame , Thanks for reaching out. I am marking this issue as p2, the suggested request should adhere to the guidelines of existing Stepfunction task construct.

We use +1s to help prioritize our work, and are happy to revaluate this issue based on community feedback. You can reach out to the cdk.dev community on Slack to solicit support for reprioritization. Sharing the contributing guide for reference.

[amiraliucsc]

+1

[glc-imoussaoui]

+1

[wdesouza]

+1

[bhavin-a]

+1

[zee-fee]

+1

[nkhandelwal1]

+1