Skip to content

Test timing issues for slow github test runners #64

@Charlesworth

Description

@Charlesworth

Some of the tests, in particular the eva_locker_test.py tests use sleeps to ensure thing happen within a set time frame. Unfortunately GitHub's free action test runners are slow enough that these tests can fail in a non-deterministic way if the runner is processing the test a bit slowly. As an example the following test run failed due to a timeout: https://github.com/automata-tech/eva_python_sdk/runs/831475589?check_suite_focus=true

To fix this issue either:

  • increase to duration which is allowed for each test action in eva_locker_test.py (quick and easy but not ideal)
  • remove any reliance on sleeps from eva_locker_test.py (this will be a longer task)

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions