Skip to content

Error bars for runtime profiles #68

@nikohansen

Description

@nikohansen

Following up on issue 1019 in the superseded coco repository: for each problem (like 24x51 in the default aggregation over all functions and 51 for each function), we could annotate the median runtime in the profile with percentile bars. This is different from constructing an entire new runtime profile (though would use the same data as a runtime profile of some percentile as suggested in the last comment of the above issue but plotted in a different order and at different y-values). When all runs were successful, this is also straight forward to understand and undoubtedly "correct". We could see (occasionally) very different bar widths for similar or even the same runtimes which may look quite erratic and difficult to read.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions