Skip to content

Reuse npse_trained_model fixure for test_npse_map#1461

Open
vagechirkov wants to merge 65 commits intosbi-dev:mainfrom
vagechirkov:speed-up-tests-with-fixtures
Open

Reuse npse_trained_model fixure for test_npse_map#1461
vagechirkov wants to merge 65 commits intosbi-dev:mainfrom
vagechirkov:speed-up-tests-with-fixtures

Conversation

@vagechirkov
Copy link
Collaborator

@vagechirkov vagechirkov requested a review from janfb March 17, 2025 16:13
@vagechirkov vagechirkov self-assigned this Mar 17, 2025
@codecov
Copy link

codecov bot commented Mar 17, 2025

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 84.82%. Comparing base (4d1dc5f) to head (e1fe4bd).
⚠️ Report is 8 commits behind head on main.

Additional details and impacted files
@@            Coverage Diff             @@
##             main    #1461      +/-   ##
==========================================
- Coverage   87.77%   84.82%   -2.96%     
==========================================
  Files         134      137       +3     
  Lines       11126    11473     +347     
==========================================
- Hits         9766     9732      -34     
- Misses       1360     1741     +381     
Flag Coverage Δ
unittests 84.82% <ø> (-2.96%) ⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.
see 48 files with indirect coverage changes

Copy link
Contributor

@janfb janfb left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks great, thanks!
See question in the comments.

What is the speed up you notice through this change?

@janfb
Copy link
Contributor

janfb commented Mar 18, 2025

CI is failing due to testmon error. this will be fixed in a separate PR

@vagechirkov
Copy link
Collaborator Author

What is the speed up you notice through this change?

Basically, we save the time of training a model specifically for `test_npse_map'. But now it would be much cheaper to add more tests that can reuse specific trained models.

@janfb
Copy link
Contributor

janfb commented Mar 18, 2025

One concern I have @vagechirkov is that now all the tests here are marked as slow, right?

Is there a way to have one of the c2st tests "not slow"? e.g., the one with the default settings we use in the class?

@vagechirkov
Copy link
Collaborator Author

Hey @janfb, I think this is more or less how the final test structure should look like, so ready for review 🙃

@vagechirkov vagechirkov requested a review from janfb March 20, 2025 10:18
@janfb
Copy link
Contributor

janfb commented Mar 20, 2025

Hey @janfb, I think this is more or less how the final test structure should look like, so ready for review 🙃

Cool, I will review it now.

Copy link
Contributor

@janfb janfb left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

thanks a lot @schroedk and @vagechirkov ! 👏

it all looks very clean and efficient now. Added a couple of questions for my understanding and some suggestions

@vagechirkov
Copy link
Collaborator Author

An issue with snapshot tests: syrupy-project/syrupy#438

@vagechirkov
Copy link
Collaborator Author

Very nice refactoring, thanks @schroedk! Regression tests run locally for me in 4min without the problem reported here: #1473

Comment on lines +159 to +161
# ToDO check if there is a bug for prior_type='uniform' and num_trial>1
# ToDO validate bug for combination sde_type='ode' and num_trial>1
# ToDO investigate non-determinism for prior_type=None, dim>= 2, ve, auto/jac_gauss
Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I was wondering if we should mark these tests (non-deterministic and those that take too long) as xfail and set the timeout to, say, 20 seconds. This way, we would cover all possible combinations with the regression tests, and failing tests could be resolved later in the separate PRs.

@vagechirkov vagechirkov requested a review from janfb March 24, 2025 09:20
* extract map test
Copy link
Contributor

@janfb janfb left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

"Gut Ding will Weile haben".

Apologies @vagechirkov and @schroedk for taking about 6 months to add a review to this PR, but here we go: the general idea and execution is great! You added core fixtures and organize the numerous test case combinations for NPSE in dataclasses.

Unfortunately, we had a huge refactoring in the NPSE and FMPE classes. They have now been unified into the vector field estimator API. The new test file that covers both methods in the old way of testing is linear_gaussian_vector_field_test.py.

I will merge the current main into your branch and fix the conflicts. From there we will need to basically rewrite your approach for the new test file that now covers both NPSE and FMPE. I am happy to help with this.
We can also have a call @schroedk or @vagechirkov or both.

@vagechirkov
Copy link
Collaborator Author

@janfb, great! I am happy to help finish implementing this issue! I'm down to have a quick meeting about this 🙂

@janfb
Copy link
Contributor

janfb commented Oct 21, 2025

@janfb, great! I am happy to help finish implementing this issue! I'm down to have a quick meeting about this 🙂

Awesome, let's aim for a meeting this week. How about some time Thu after 10:30? or Friday before noon?

@schroedk @vagechirkov

@vagechirkov
Copy link
Collaborator Author

@janfb, great! I am happy to help finish implementing this issue! I'm down to have a quick meeting about this 🙂

Awesome, let's aim for a meeting this week. How about some time Thu after 10:30? or Friday before noon?

@schroedk @vagechirkov

Friday before noon works for me 🙂

@janfb
Copy link
Contributor

janfb commented Oct 23, 2025

@janfb, great! I am happy to help finish implementing this issue! I'm down to have a quick meeting about this 🙂

Awesome, let's aim for a meeting this week. How about some time Thu after 10:30? or Friday before noon?
@schroedk @vagechirkov

Friday before noon works for me 🙂

Cool! I reached out on Discord and suggested 9am.

@janfb
Copy link
Contributor

janfb commented Oct 24, 2025

@vagechirkov I now managed to push the merge of main and some small type fixes I did locally to get this running (pushing was blocked by git-lfs, turning it off temporarily fixed it).

Feel free to undo the changes in the recent commit, some of them are obsolete.

@vagechirkov
Copy link
Collaborator Author

I copied the regression tests to linearGaussian_vector_field_test.py, and continuous integration seems happy with them so far 🙃 The old tests in linearGaussian_vector_field_test.py now need to be refactored. I will work on this in the next few days.

@janfb
Copy link
Contributor

janfb commented Nov 5, 2025

Sounds great 🚀 let me know if you need any input from my side.

@vagechirkov
Copy link
Collaborator Author

Hi, @janfb, @schroedk ,

Sorry for the delay on my end. Please let me know if I'm on the right track and if I'm missing something. The remaining tests that have not yet been refactored are test_vector_field_sde_ode_sampling_equivalence,
test_sample_conditional, and test_iid_log_prob. Please let me know if you have any thoughts or suggestions about them.

Here is the list of the slowest snapshot tests. My laptop is not very fast, so the absolute values might be much smaller.

image

I'm unsure why, for example, it took 30 seconds to generate two posterior samples for the slowest snapshot test, while it took less than a second for most of the other snapshot tests.

I'm also not sure why snapshot tests with prior=None are failing on CI, they work locally without errors.

CI errors
FAILED tests/linearGaussian_vector_field_test.py::test_vector_field_snapshot[None_prior-dim_1-vp-transformer-gauss-sde-trials_16] - NotImplementedError: Sampling from ImproperEmpirical is not supported. If you are using likelihood or ratio estimation, or multi-round inference, you need to define a prior distribution.
FAILED tests/linearGaussian_vector_field_test.py::test_vector_field_snapshot[None_prior-dim_1-vp-transformer-auto_gauss-sde-trials_3] - NotImplementedError: Sampling from ImproperEmpirical is not supported. If you are using likelihood or ratio estimation, or multi-round inference, you need to define a prior distribution.
FAILED tests/linearGaussian_vector_field_test.py::test_vector_field_snapshot[None_prior-dim_1-vp-transformer-jac_gauss-sde-trials_8] - NotImplementedError: Sampling from ImproperEmpirical is not supported. If you are using likelihood or ratio estimation, or multi-round inference, you need to define a prior distribution.
FAILED tests/linearGaussian_vector_field_test.py::test_vector_field_snapshot[None_prior-dim_1-ve-mlp-gauss-sde-trials_16] - NotImplementedError: Sampling from ImproperEmpirical is not supported. If you are using likelihood or ratio estimation, or multi-round inference, you need to define a prior distribution.
FAILED tests/linearGaussian_vector_field_test.py::test_vector_field_snapshot[None_prior-dim_1-ve-mlp-auto_gauss-sde-trials_3] - NotImplementedError: Sampling from ImproperEmpirical is not supported. If you are using likelihood or ratio estimation, or multi-round inference, you need to define a prior distribution.
FAILED tests/linearGaussian_vector_field_test.py::test_vector_field_snapshot[None_prior-dim_1-ve-mlp-jac_gauss-sde-trials_8] - NotImplementedError: Sampling from ImproperEmpirical is not supported. If you are using likelihood or ratio estimation, or multi-round inference, you need to define a prior distribution.
FAILED tests/linearGaussian_vector_field_test.py::test_vector_field_snapshot[None_prior-dim_1-ve-ada_mlp-gauss-sde-trials_16] - NotImplementedError: Sampling from ImproperEmpirical is not supported. If you are using likelihood or ratio estimation, or multi-round inference, you need to define a prior distribution.
FAILED tests/linearGaussian_vector_field_test.py::test_vector_field_snapshot[None_prior-dim_1-ve-ada_mlp-auto_gauss-sde-trials_3] - NotImplementedError: Sampling from ImproperEmpirical is not supported. If you are using likelihood or ratio estimation, or multi-round inference, you need to define a prior distribution.
FAILED tests/linearGaussian_vector_field_test.py::test_vector_field_snapshot[None_prior-dim_1-ve-ada_mlp-jac_gauss-sde-trials_8] - NotImplementedError: Sampling from ImproperEmpirical is not supported. If you are using likelihood or ratio estimation, or multi-round inference, you need to define a prior distribution.
FAILED tests/linearGaussian_vector_field_test.py::test_vector_field_snapshot[None_prior-dim_1-ve-transformer-gauss-sde-trials_16] - NotImplementedError: Sampling from ImproperEmpirical is not supported. If you are using likelihood or ratio estimation, or multi-round inference, you need to define a prior distribution.
FAILED tests/linearGaussian_vector_field_test.py::test_vector_field_snapshot[None_prior-dim_1-ve-transformer-auto_gauss-sde-trials_3] - NotImplementedError: Sampling from ImproperEmpirical is not supported. If you are using likelihood or ratio estimation, or multi-round inference, you need to define a prior distribution.
FAILED tests/linearGaussian_vector_field_test.py::test_vector_field_snapshot[None_prior-dim_1-ve-transformer-jac_gauss-sde-trials_8] - NotImplementedError: Sampling from ImproperEmpirical is not supported. If you are using likelihood or ratio estimation, or multi-round inference, you need to define a prior distribution.
FAILED tests/linearGaussian_vector_field_test.py::test_vector_field_snapshot[None_prior-dim_1-subvp-mlp-gauss-sde-trials_16] - NotImplementedError: Sampling from ImproperEmpirical is not supported. If you are using likelihood or ratio estimation, or multi-round inference, you need to define a prior distribution.
FAILED tests/linearGaussian_vector_field_test.py::test_vector_field_snapshot[None_prior-dim_1-subvp-mlp-auto_gauss-sde-trials_3] - NotImplementedError: Sampling from ImproperEmpirical is not supported. If you are using likelihood or ratio estimation, or multi-round inference, you need to define a prior distribution.
FAILED tests/linearGaussian_vector_field_test.py::test_vector_field_snapshot[None_prior-dim_1-subvp-mlp-jac_gauss-sde-trials_8] - NotImplementedError: Sampling from ImproperEmpirical is not supported. If you are using likelihood or ratio estimation, or multi-round inference, you need to define a prior distribution.
FAILED tests/linearGaussian_vector_field_test.py::test_vector_field_snapshot[None_prior-dim_1-subvp-ada_mlp-gauss-sde-trials_16] - NotImplementedError: Sampling from ImproperEmpirical is not supported. If you are using likelihood or ratio estimation, or multi-round inference, you need to define a prior distribution.
FAILED tests/linearGaussian_vector_field_test.py::test_vector_field_snapshot[None_prior-dim_1-subvp-ada_mlp-auto_gauss-sde-trials_3] - NotImplementedError: Sampling from ImproperEmpirical is not supported. If you are using likelihood or ratio estimation, or multi-round inference, you need to define a prior distribution.
FAILED tests/linearGaussian_vector_field_test.py::test_vector_field_snapshot[None_prior-dim_1-subvp-ada_mlp-jac_gauss-sde-trials_8] - NotImplementedError: Sampling from ImproperEmpirical is not supported. If you are using likelihood or ratio estimation, or multi-round inference, you need to define a prior distribution.
FAILED tests/linearGaussian_vector_field_test.py::test_vector_field_snapshot[None_prior-dim_1-subvp-transformer-gauss-sde-trials_16] - NotImplementedError: Sampling from ImproperEmpirical is not supported. If you are using likelihood or ratio estimation, or multi-round inference, you need to define a prior distribution.
FAILED tests/linearGaussian_vector_field_test.py::test_vector_field_snapshot[None_prior-dim_1-subvp-transformer-auto_gauss-sde-trials_3] - NotImplementedError: Sampling from ImproperEmpirical is not supported. If you are using likelihood or ratio estimation, or multi-round inference, you need to define a prior distribution.
FAILED tests/linearGaussian_vector_field_test.py::test_vector_field_snapshot[None_prior-dim_1-subvp-transformer-jac_gauss-sde-trials_8] - NotImplementedError: Sampling from ImproperEmpirical is not supported. If you are using likelihood or ratio estimation, or multi-round inference, you need to define a prior distribution.
FAILED tests/linearGaussian_vector_field_test.py::test_vector_field_snapshot[None_prior-dim_1-fmpe-mlp-gauss-sde-trials_16] - NotImplementedError: Sampling from ImproperEmpirical is not supported. If you are using likelihood or ratio estimation, or multi-round inference, you need to define a prior distribution.
FAILED tests/linearGaussian_vector_field_test.py::test_vector_field_snapshot[None_prior-dim_1-fmpe-mlp-auto_gauss-sde-trials_3] - NotImplementedError: Sampling from ImproperEmpirical is not supported. If you are using likelihood or ratio estimation, or multi-round inference, you need to define a prior distribution.
FAILED tests/linearGaussian_vector_field_test.py::test_vector_field_snapshot[None_prior-dim_1-fmpe-mlp-jac_gauss-sde-trials_8] - NotImplementedError: Sampling from ImproperEmpirical is not supported. If you are using likelihood or ratio estimation, or multi-round inference, you need to define a prior distribution.
FAILED tests/linearGaussian_vector_field_test.py::test_vector_field_snapshot[None_prior-dim_1-fmpe-ada_mlp-gauss-sde-trials_16] - NotImplementedError: Sampling from ImproperEmpirical is not supported. If you are using likelihood or ratio estimation, or multi-round inference, you need to define a prior distribution.
FAILED tests/linearGaussian_vector_field_test.py::test_vector_field_snapshot[None_prior-dim_1-fmpe-ada_mlp-auto_gauss-sde-trials_3] - NotImplementedError: Sampling from ImproperEmpirical is not supported. If you are using likelihood or ratio estimation, or multi-round inference, you need to define a prior distribution.
FAILED tests/linearGaussian_vector_field_test.py::test_vector_field_snapshot[None_prior-dim_1-fmpe-ada_mlp-jac_gauss-sde-trials_8] - NotImplementedError: Sampling from ImproperEmpirical is not supported. If you are using likelihood or ratio estimation, or multi-round inference, you need to define a prior distribution.
FAILED tests/linearGaussian_vector_field_test.py::test_vector_field_snapshot[None_prior-dim_1-fmpe-transformer-gauss-sde-trials_16] - NotImplementedError: Sampling from ImproperEmpirical is not supported. If you are using likelihood or ratio estimation, or multi-round inference, you need to define a prior distribution.
FAILED tests/linearGaussian_vector_field_test.py::test_vector_field_snapshot[None_prior-dim_1-fmpe-transformer-auto_gauss-sde-trials_3] - NotImplementedError: Sampling from ImproperEmpirical is not supported. If you are using likelihood or ratio estimation, or multi-round inference, you need to define a prior distribution.
FAILED tests/linearGaussian_vector_field_test.py::test_vector_field_snapshot[None_prior-dim_1-fmpe-transformer-jac_gauss-sde-trials_8] - NotImplementedError: Sampling from ImproperEmpirical is not supported. If you are using likelihood or ratio estimation, or multi-round inference, you need to define a prior distribution.
FAILED tests/linearGaussian_vector_field_test.py::test_vector_field_snapshot[None_prior-dim_2-vp-mlp-gauss-sde-trials_3] - NotImplementedError: Sampling from ImproperEmpirical is not supported. If you are using likelihood or ratio estimation, or multi-round inference, you need to define a prior distribution.
FAILED tests/linearGaussian_vector_field_test.py::test_vector_field_snapshot[None_prior-dim_2-vp-mlp-auto_gauss-sde-trials_16] - NotImplementedError: Sampling from ImproperEmpirical is not supported. If you are using likelihood or ratio estimation, or multi-round inference, you need to define a prior distribution.
FAILED tests/linearGaussian_vector_field_test.py::test_vector_field_snapshot[None_prior-dim_2-vp-ada_mlp-gauss-sde-trials_3] - NotImplementedError: Sampling from ImproperEmpirical is not supported. If you are using likelihood or ratio estimation, or multi-round inference, you need to define a prior distribution.
FAILED tests/linearGaussian_vector_field_test.py::test_vector_field_snapshot[None_prior-dim_2-vp-ada_mlp-auto_gauss-sde-trials_16] - NotImplementedError: Sampling from ImproperEmpirical is not supported. If you are using likelihood or ratio estimation, or multi-round inference, you need to define a prior distribution.
FAILED tests/linearGaussian_vector_field_test.py::test_vector_field_snapshot[None_prior-dim_2-vp-transformer-gauss-sde-trials_3] - NotImplementedError: Sampling from ImproperEmpirical is not supported. If you are using likelihood or ratio estimation, or multi-round inference, you need to define a prior distribution.
FAILED tests/linearGaussian_vector_field_test.py::test_vector_field_snapshot[None_prior-dim_2-vp-transformer-auto_gauss-sde-trials_16] - NotImplementedError: Sampling from ImproperEmpirical is not supported. If you are using likelihood or ratio estimation, or multi-round inference, you need to define a prior distribution.
FAILED tests/linearGaussian_vector_field_test.py::test_vector_field_snapshot[None_prior-dim_2-ve-mlp-gauss-sde-trials_8] - NotImplementedError: Sampling from ImproperEmpirical is not supported. If you are using likelihood or ratio estimation, or multi-round inference, you need to define a prior distribution.
FAILED tests/linearGaussian_vector_field_test.py::test_vector_field_snapshot[None_prior-dim_2-ve-mlp-jac_gauss-sde-trials_8] - NotImplementedError: Sampling from ImproperEmpirical is not supported. If you are using likelihood or ratio estimation, or multi-round inference, you need to define a prior distribution.
FAILED tests/linearGaussian_vector_field_test.py::test_vector_field_snapshot[None_prior-dim_2-ve-ada_mlp-auto_gauss-sde-trials_8] - NotImplementedError: Sampling from ImproperEmpirical is not supported. If you are using likelihood or ratio estimation, or multi-round inference, you need to define a prior distribution.
FAILED tests/linearGaussian_vector_field_test.py::test_vector_field_snapshot[None_prior-dim_2-ve-transformer-auto_gauss-sde-trials_8] - NotImplementedError: Sampling from ImproperEmpirical is not supported. If you are using likelihood or ratio estimation, or multi-round inference, you need to define a prior distribution.
FAILED tests/linearGaussian_vector_field_test.py::test_vector_field_snapshot[None_prior-dim_2-subvp-mlp-gauss-sde-trials_16] - NotImplementedError: Sampling from ImproperEmpirical is not supported. If you are using likelihood or ratio estimation, or multi-round inference, you need to define a prior distribution.
FAILED tests/linearGaussian_vector_field_test.py::test_vector_field_snapshot[None_prior-dim_2-subvp-mlp-auto_gauss-sde-trials_3] - NotImplementedError: Sampling from ImproperEmpirical is not supported. If you are using likelihood or ratio estimation, or multi-round inference, you need to define a prior distribution.
FAILED tests/linearGaussian_vector_field_test.py::test_vector_field_snapshot[None_prior-dim_2-subvp-mlp-jac_gauss-sde-trials_8] - NotImplementedError: Sampling from ImproperEmpirical is not supported. If you are using likelihood or ratio estimation, or multi-round inference, you need to define a prior distribution.
FAILED tests/linearGaussian_vector_field_test.py::test_vector_field_snapshot[None_prior-dim_2-subvp-ada_mlp-gauss-sde-trials_16] - NotImplementedError: Sampling from ImproperEmpirical is not supported. If you are using likelihood or ratio estimation, or multi-round inference, you need to define a prior distribution.
FAILED tests/linearGaussian_vector_field_test.py::test_vector_field_snapshot[None_prior-dim_2-subvp-ada_mlp-auto_gauss-sde-trials_3] - NotImplementedError: Sampling from ImproperEmpirical is not supported. If you are using likelihood or ratio estimation, or multi-round inference, you need to define a prior distribution.
FAILED tests/linearGaussian_vector_field_test.py::test_vector_field_snapshot[None_prior-dim_2-subvp-ada_mlp-jac_gauss-sde-trials_8] - NotImplementedError: Sampling from ImproperEmpirical is not supported. If you are using likelihood or ratio estimation, or multi-round inference, you need to define a prior distribution.
FAILED tests/linearGaussian_vector_field_test.py::test_vector_field_snapshot[None_prior-dim_2-subvp-transformer-gauss-sde-trials_16] - NotImplementedError: Sampling from ImproperEmpirical is not supported. If you are using likelihood or ratio estimation, or multi-round inference, you need to define a prior distribution.
FAILED tests/linearGaussian_vector_field_test.py::test_vector_field_snapshot[None_prior-dim_2-subvp-transformer-auto_gauss-sde-trials_3] - NotImplementedError: Sampling from ImproperEmpirical is not supported. If you are using likelihood or ratio estimation, or multi-round inference, you need to define a prior distribution.
FAILED tests/linearGaussian_vector_field_test.py::test_vector_field_snapshot[None_prior-dim_2-subvp-transformer-jac_gauss-sde-trials_8] - NotImplementedError: Sampling from ImproperEmpirical is not supported. If you are using likelihood or ratio estimation, or multi-round inference, you need to define a prior distribution.
FAILED tests/linearGaussian_vector_field_test.py::test_vector_field_snapshot[None_prior-dim_2-fmpe-mlp-gauss-sde-trials_16] - NotImplementedError: Sampling from ImproperEmpirical is not supported. If you are using likelihood or ratio estimation, or multi-round inference, you need to define a prior distribution.
FAILED tests/linearGaussian_vector_field_test.py::test_vector_field_snapshot[None_prior-dim_2-fmpe-mlp-auto_gauss-sde-trials_3] - NotImplementedError: Sampling from ImproperEmpirical is not supported. If you are using likelihood or ratio estimation, or multi-round inference, you need to define a prior distribution.
FAILED tests/linearGaussian_vector_field_test.py::test_vector_field_snapshot[None_prior-dim_2-fmpe-mlp-jac_gauss-sde-trials_8] - NotImplementedError: Sampling from ImproperEmpirical is not supported. If you are using likelihood or ratio estimation, or multi-round inference, you need to define a prior distribution.
FAILED tests/linearGaussian_vector_field_test.py::test_vector_field_snapshot[None_prior-dim_2-fmpe-ada_mlp-gauss-sde-trials_16] - NotImplementedError: Sampling from ImproperEmpirical is not supported. If you are using likelihood or ratio estimation, or multi-round inference, you need to define a prior distribution.
FAILED tests/linearGaussian_vector_field_test.py::test_vector_field_snapshot[None_prior-dim_2-fmpe-ada_mlp-auto_gauss-sde-trials_3] - NotImplementedError: Sampling from ImproperEmpirical is not supported. If you are using likelihood or ratio estimation, or multi-round inference, you need to define a prior distribution.
FAILED tests/linearGaussian_vector_field_test.py::test_vector_field_snapshot[None_prior-dim_2-fmpe-ada_mlp-jac_gauss-sde-trials_8] - NotImplementedError: Sampling from ImproperEmpirical is not supported. If you are using likelihood or ratio estimation, or multi-round inference, you need to define a prior distribution.
FAILED tests/linearGaussian_vector_field_test.py::test_vector_field_snapshot[None_prior-dim_2-fmpe-transformer-gauss-sde-trials_16] - NotImplementedError: Sampling from ImproperEmpirical is not supported. If you are using likelihood or ratio estimation, or multi-round inference, you need to define a prior distribution.
FAILED tests/linearGaussian_vector_field_test.py::test_vector_field_snapshot[None_prior-dim_2-fmpe-transformer-auto_gauss-sde-trials_3] - NotImplementedError: Sampling from ImproperEmpirical is not supported. If you are using likelihood or ratio estimation, or multi-round inference, you need to define a prior distribution.
FAILED tests/linearGaussian_vector_field_test.py::test_vector_field_snapshot[None_prior-dim_2-fmpe-transformer-jac_gauss-sde-trials_8] - NotImplementedError: Sampling from ImproperEmpirical is not supported. If you are using likelihood or ratio estimation, or multi-round inference, you need to define a prior distribution.
FAILED tests/linearGaussian_vector_field_test.py::test_vector_field_snapshot[None_prior-dim_1-vp-mlp-gauss-sde-trials_16] - NotImplementedError: Sampling from ImproperEmpirical is not supported. If you are using likelihood or ratio estimation, or multi-round inference, you need to define a prior distribution.
FAILED tests/linearGaussian_vector_field_test.py::test_vector_field_snapshot[None_prior-dim_1-vp-mlp-auto_gauss-sde-trials_3] - NotImplementedError: Sampling from ImproperEmpirical is not supported. If you are using likelihood or ratio estimation, or multi-round inference, you need to define a prior distribution.
FAILED tests/linearGaussian_vector_field_test.py::test_vector_field_snapshot[None_prior-dim_1-vp-mlp-jac_gauss-sde-trials_8] - NotImplementedError: Sampling from ImproperEmpirical is not supported. If you are using likelihood or ratio estimation, or multi-round inference, you need to define a prior distribution.
FAILED tests/linearGaussian_vector_field_test.py::test_vector_field_snapshot[None_prior-dim_1-vp-ada_mlp-gauss-sde-trials_16] - NotImplementedError: Sampling from ImproperEmpirical is not supported. If you are using likelihood or ratio estimation, or multi-round inference, you need to define a prior distribution.
FAILED tests/linearGaussian_vector_field_test.py::test_vector_field_snapshot[None_prior-dim_1-vp-ada_mlp-auto_gauss-sde-trials_3] - NotImplementedError: Sampling from ImproperEmpirical is not supported. If you are using likelihood or ratio estimation, or multi-round inference, you need to define a prior distribution.
FAILED tests/linearGaussian_vector_field_test.py::test_vector_field_snapshot[None_prior-dim_1-vp-ada_mlp-jac_gauss-sde-trials_8] - NotImplementedError: Sampling from ImproperEmpirical is not supported. If you are using likelihood or ratio estimation, or multi-round inference, you need to define a prior distribution.
FAILED tests/linearGaussian_vector_field_test.py::test_vector_field_snapshot[None_prior-dim_3-vp-mlp-gauss-sde-trials_16] - NotImplementedError: Sampling from ImproperEmpirical is not supported. If you are using likelihood or ratio estimation, or multi-round inference, you need to define a prior distribution.
FAILED tests/linearGaussian_vector_field_test.py::test_vector_field_snapshot[None_prior-dim_3-vp-mlp-auto_gauss-sde-trials_3] - NotImplementedError: Sampling from ImproperEmpirical is not supported. If you are using likelihood or ratio estimation, or multi-round inference, you need to define a prior distribution.
FAILED tests/linearGaussian_vector_field_test.py::test_vector_field_snapshot[None_prior-dim_3-vp-mlp-jac_gauss-sde-trials_8] - NotImplementedError: Sampling from ImproperEmpirical is not supported. If you are using likelihood or ratio estimation, or multi-round inference, you need to define a prior distribution.
FAILED tests/linearGaussian_vector_field_test.py::test_vector_field_snapshot[None_prior-dim_3-vp-ada_mlp-gauss-sde-trials_16] - NotImplementedError: Sampling from ImproperEmpirical is not supported. If you are using likelihood or ratio estimation, or multi-round inference, you need to define a prior distribution.
FAILED tests/linearGaussian_vector_field_test.py::test_vector_field_snapshot[None_prior-dim_3-vp-ada_mlp-auto_gauss-sde-trials_3] - NotImplementedError: Sampling from ImproperEmpirical is not supported. If you are using likelihood or ratio estimation, or multi-round inference, you need to define a prior distribution.
FAILED tests/linearGaussian_vector_field_test.py::test_vector_field_snapshot[None_prior-dim_3-vp-ada_mlp-jac_gauss-sde-trials_8] - NotImplementedError: Sampling from ImproperEmpirical is not supported. If you are using likelihood or ratio estimation, or multi-round inference, you need to define a prior distribution.
FAILED tests/linearGaussian_vector_field_test.py::test_vector_field_snapshot[None_prior-dim_3-vp-transformer-gauss-sde-trials_16] - NotImplementedError: Sampling from ImproperEmpirical is not supported. If you are using likelihood or ratio estimation, or multi-round inference, you need to define a prior distribution.
FAILED tests/linearGaussian_vector_field_test.py::test_vector_field_snapshot[None_prior-dim_3-vp-transformer-auto_gauss-sde-trials_3] - NotImplementedError: Sampling from ImproperEmpirical is not supported. If you are using likelihood or ratio estimation, or multi-round inference, you need to define a prior distribution.
FAILED tests/linearGaussian_vector_field_test.py::test_vector_field_snapshot[None_prior-dim_3-vp-transformer-jac_gauss-sde-trials_8] - NotImplementedError: Sampling from ImproperEmpirical is not supported. If you are using likelihood or ratio estimation, or multi-round inference, you need to define a prior distribution.
FAILED tests/linearGaussian_vector_field_test.py::test_vector_field_snapshot[None_prior-dim_3-ve-mlp-auto_gauss-sde-trials_8] - NotImplementedError: Sampling from ImproperEmpirical is not supported. If you are using likelihood or ratio estimation, or multi-round inference, you need to define a prior distribution.
FAILED tests/linearGaussian_vector_field_test.py::test_vector_field_snapshot[None_prior-dim_3-ve-ada_mlp-gauss-sde-trials_8] - NotImplementedError: Sampling from ImproperEmpirical is not supported. If you are using likelihood or ratio estimation, or multi-round inference, you need to define a prior distribution.
FAILED tests/linearGaussian_vector_field_test.py::test_vector_field_snapshot[None_prior-dim_3-ve-ada_mlp-jac_gauss-sde-trials_8] - NotImplementedError: Sampling from ImproperEmpirical is not supported. If you are using likelihood or ratio estimation, or multi-round inference, you need to define a prior distribution.
FAILED tests/linearGaussian_vector_field_test.py::test_vector_field_snapshot[None_prior-dim_3-ve-transformer-gauss-sde-trials_8] - NotImplementedError: Sampling from ImproperEmpirical is not supported. If you are using likelihood or ratio estimation, or multi-round inference, you need to define a prior distribution.
FAILED tests/linearGaussian_vector_field_test.py::test_vector_field_snapshot[None_prior-dim_3-ve-transformer-jac_gauss-sde-trials_8] - NotImplementedError: Sampling from ImproperEmpirical is not supported. If you are using likelihood or ratio estimation, or multi-round inference, you need to define a prior distribution.
FAILED tests/linearGaussian_vector_field_test.py::test_vector_field_snapshot[None_prior-dim_3-subvp-mlp-gauss-sde-trials_3] - NotImplementedError: Sampling from ImproperEmpirical is not supported. If you are using likelihood or ratio estimation, or multi-round inference, you need to define a prior distribution.
FAILED tests/linearGaussian_vector_field_test.py::test_vector_field_snapshot[None_prior-dim_3-subvp-mlp-auto_gauss-sde-trials_16] - NotImplementedError: Sampling from ImproperEmpirical is not supported. If you are using likelihood or ratio estimation, or multi-round inference, you need to define a prior distribution.
FAILED tests/linearGaussian_vector_field_test.py::test_vector_field_snapshot[None_prior-dim_3-subvp-ada_mlp-gauss-sde-trials_3] - NotImplementedError: Sampling from ImproperEmpirical is not supported. If you are using likelihood or ratio estimation, or multi-round inference, you need to define a prior distribution.
FAILED tests/linearGaussian_vector_field_test.py::test_vector_field_snapshot[None_prior-dim_3-subvp-ada_mlp-auto_gauss-sde-trials_16] - NotImplementedError: Sampling from ImproperEmpirical is not supported. If you are using likelihood or ratio estimation, or multi-round inference, you need to define a prior distribution.
FAILED tests/linearGaussian_vector_field_test.py::test_vector_field_snapshot[None_prior-dim_3-subvp-transformer-gauss-sde-trials_3] - NotImplementedError: Sampling from ImproperEmpirical is not supported. If you are using likelihood or ratio estimation, or multi-round inference, you need to define a prior distribution.
FAILED tests/linearGaussian_vector_field_test.py::test_vector_field_snapshot[None_prior-dim_3-subvp-transformer-auto_gauss-sde-trials_16] - NotImplementedError: Sampling from ImproperEmpirical is not supported. If you are using likelihood or ratio estimation, or multi-round inference, you need to define a prior distribution.
FAILED tests/linearGaussian_vector_field_test.py::test_vector_field_snapshot[None_prior-dim_3-fmpe-mlp-gauss-sde-trials_3] - NotImplementedError: Sampling from ImproperEmpirical is not supported. If you are using likelihood or ratio estimation, or multi-round inference, you need to define a prior distribution.
FAILED tests/linearGaussian_vector_field_test.py::test_vector_field_snapshot[None_prior-dim_3-fmpe-mlp-auto_gauss-sde-trials_16] - NotImplementedError: Sampling from ImproperEmpirical is not supported. If you are using likelihood or ratio estimation, or multi-round inference, you need to define a prior distribution.
FAILED tests/linearGaussian_vector_field_test.py::test_vector_field_snapshot[None_prior-dim_3-fmpe-ada_mlp-gauss-sde-trials_3] - NotImplementedError: Sampling from ImproperEmpirical is not supported. If you are using likelihood or ratio estimation, or multi-round inference, you need to define a prior distribution.
FAILED tests/linearGaussian_vector_field_test.py::test_vector_field_snapshot[None_prior-dim_3-fmpe-ada_mlp-auto_gauss-sde-trials_16] - NotImplementedError: Sampling from ImproperEmpirical is not supported. If you are using likelihood or ratio estimation, or multi-round inference, you need to define a prior distribution.
FAILED tests/linearGaussian_vector_field_test.py::test_vector_field_snapshot[None_prior-dim_3-fmpe-transformer-gauss-sde-trials_3] - NotImplementedError: Sampling from ImproperEmpirical is not supported. If you are using likelihood or ratio estimation, or multi-round inference, you need to define a prior distribution.
FAILED tests/linearGaussian_vector_field_test.py::test_vector_field_snapshot[None_prior-dim_3-fmpe-transformer-auto_gauss-sde-trials_16] - NotImplementedError: Sampling from ImproperEmpirical is not supported. If you are using likelihood or ratio estimation, or multi-round inference, you need to define a prior distribution.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants