Skip to content

Support multiple-queue consumption in workers and default to worker-pool #35

@ankush

Description

@ankush
Image

Both changes save a lot of memory.

  • short worker on its own is rarely used. Set --queue=short,default on one type and --queue=long,short,default on another type.
  • Use bench worker-pool instead of bench worker. Forks from single process, so again more efficient for >1 worker deployments. Set FRAPPE_BACKGROUND_WORKERS_NOFORK to true to avoid forking (saves a ton of CPU usage at risk of bad code breaking workers, same risk exists in web workers though!)

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions