Skip to content

[Broker & Bookie] Configure Bookkeeper client & server backpressure by default #10439

@lhotari

Description

@lhotari

Is your enhancement request related to a problem? Please describe.

Pulsar doesn't take advantage of Bookkeeper's client-side and server-side backpressure features.
apache/bookkeeper#1086 and apache/bookkeeper#1409 are the original Bookkeeper issues about the lack of backpressure handling. Similar problems exist with Pulsar since backpressure handling isn't configured. One of the reported issues is #9562 .

Describe the solution you'd like

Configure waitTimeoutOnBackpressureMs in the Bookkeeper client configuration (Pulsar broker side) and waitTimeoutOnResponseBackpressureMs, maxAddsInProgressLimit, maxReadsInProgressLimit in the Bookkeeper server ("Bookie") configuration with sane default values.

Additional context

#9562

Metadata

Metadata

Assignees

No one assigned

    Labels

    lifecycle/staletype/enhancementThe enhancements for the existing features or docs. e.g. reduce memory usage of the delayed messages

    Type

    No type

    Projects

    No projects

    Milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions