Skip to content

[Feature]: Support submissions across multiple Gunicorn workers #77

Closed

Description

@jkalayan

Feature Request

Problem / Motivation

Submission requests may be handled by different Gunicorn workers. Since workers do not share in-memory state, a later step in a submission can fail to find the workflow created by another worker.

Proposed Solution

Use workflow-specific directories under the shared upload folder so workers can locate and recover workflow data, and configure the Docker image to run Gunicorn with multiple workers and threads.

Expected Impact

  • Submissions can continue when successive requests reach different workers.
  • The container can serve concurrent requests more effectively.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

enhancementNew feature or request

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions