Local regeneration of stubs via tox + Clang fixes #287

skarndev · 2026-01-24T13:55:38Z

do not cascade install prefixes for a pure-C++ demo library (fixes Mac OS issues)
fixes for misleading RTTI on Clang with anonymous namespaces. namespace { struct Dummy {}; } in multiple translation units is treated as type redefinition by pybind11 on Clang (presumably due to mangling rules)
added tox.ini for running generation of test stubs locally.

… matrix by mapping the env name) - do not cascade install prefixes for a pure-C++ demo library (fixes Mac OS issues) - fixes for misleading RTTI on Clang with anonymous namespaces

skarndev · 2026-01-26T19:23:24Z

I decided to leave the test matrix intact, and just reuse the .sh scripts in the tox.ini.
In order to run this locally, install requirements-dev.txt. UV can be used to install all of the Python interpreters we use to your system beforehand, e.g. uv install python 3.10.
The stub generation can be run like this: uv run tox

ax3l · 2026-01-26T19:36:44Z

Thanks a lot for your work!

Do you mind adding the "how do I test and regenerate stub files" as a new section in the README file for now?

skarndev · 2026-01-26T20:46:18Z

Thanks a lot for your work!

Do you mind adding the "how do I test and regenerate stub files" as a new section in the README file for now?

done

README.md

…ubgen into feature/tests-via-tox

to development requirements

tests/py-demo/bindings/src/modules/aliases.cpp

tox.ini

README.md

tox.ini

requirements-dev.txt

ax3l · 2026-01-26T23:38:50Z

README.md

+```shell
+uv venv
+source .venv/bin/activate
+uv pip install -r requirements-dev.txt


Should be in the tox env only...

Suggested change

uv pip install -r requirements-dev.txt

But that includes tox itself?

The uv tool install tox --with tox-uv line should add that now.

ax3l · 2026-01-26T23:39:31Z

README.md

+
+During development, you may need to update the reference stubs in tests/stubs. This can be done locally using a convenience tox configuration. Ensure that all Python interpreters required by the test suite are available in your environment. For example, you can install them via uv:
+```shell
+uv python install 3.10 3.11 3.12 3.13


Suggested change

uv python install 3.10 3.11 3.12 3.13

uv python install -r --managed-python 3.10 3.11 3.12 3.13

I agree on the --managed-python flag, even though it should not matter much for the workflow. why -r though?

Oh, I used -r/--reinstall to make sure it did a fresh install (of managed Pythons). Maybe not needed 👍

I think --managed-python is technically also the default of uv from what I saw in the docs.

ax3l · 2026-01-26T23:42:21Z

requirements-dev.txt

 flake8~=6.1.0
 isort==5.10.1
 numpy~=1.20
 scipy~=1.0


Suggested change

scipy~=1.0

pip

scipy~=1.0

ax3l · 2026-01-26T23:44:23Z

tox.ini

+    py313-pb29-naa
+    py313-pb211-naa
+    py313-pb212-naa


The CMake logic in a few of these pybind versions is also a bit old and does not seem to work well with the tox/uv venvs -.-

Hm, let's see if downgrading CMake a little from 3.31 helps... I see

CMake Warning (dev) at /home/axel/src/pybind11-stubgen/tmp/pybind11-v2.13/install/share/cmake/pybind11/FindPythonLibsNew.cmake:101 (message): Policy CMP0148 is not set: The FindPythonInterp and FindPythonLibs modules are removed. Run "cmake --help-policy CMP0148" for policy details. Use the cmake_policy command to set the policy and suppress this warning, or preferably upgrade to using FindPython, either by calling it explicitly before pybind11, or by setting PYBIND11_FINDPYTHON ON before pybind11.

Which was CMake 3.27+

Tried adding a cmake pin to 3.21 in requirements-dev.txt and in tox.ini, removed from allowlist_externals, but does not help.

I am on cmake version 4.2.1, I do see the warnings though, but it builds. I am sure we can somehow pin a specific version of cmake per pybind11 version in tox.

ax3l · 2026-01-26T23:57:17Z

I am a bit stuck, cannot get this to compile with all Pythons on Ubuntu...

ax3l · 2026-01-26T23:58:11Z

tests/py-demo/bindings/src/modules/aliases.cpp

 #include <demo/sublibA/ConsoleColors.h>

-namespace {
+namespace aliases_detail {


Feel free to pull those C++ fixes into a separate PR while we continue to iterate on the tox uv setup..

ax3l · 2026-01-26T23:59:50Z

@sizmailov @gentlegiantJGC how are you updating the silver stub files? I have a hard time to refresh all stubs on Ubuntu 24.04 LTS but someone must have a workflow that works :D

skarndev · 2026-01-27T07:05:33Z

@sizmailov @gentlegiantJGC how are you updating the silver stub files? I have a hard time to refresh all stubs on Ubuntu 24.04 LTS but someone must have a workflow that works :D

I do have a VPS with exactly the same ubuntu version, I will test today there myself.

skarndev · 2026-01-27T08:58:54Z

I am a bit stuck, cannot get this to compile with all Pythons on Ubuntu...

I was succesfully able to build this on Ubuntu 24.04 with a few extra steps, prior to install.
If you use uv to manage python versions, uv itself needs to be installed system-wide, not using pip into a venv. I used their official installer. (https://docs.astral.sh/uv/getting-started/installation/)

Eigen is needed to build the demo project. so apt install libeigen3-dev. Perhaps we need to include FetchContent/CPM thingy into the CMakeLists.txt, so that we do not depend on system-wide Eigen at build time. Not sure how this works on CI though.

cmake == 3.28.3

sizmailov · 2026-01-27T20:55:20Z

@ax3l When I were working on a feature/issue I was mostly focused on single set of stubs. I've made a CI step to produce set of patches on failure which I applied locally. Usually that was the last step on finalizing the PR. I think such setup works for a pet project but not for community-maintained.

skarndev added 2 commits January 24, 2026 16:51

- add tox.ini for regenerating stubs locally (TODO: add into the test…

1e1ae69

… matrix by mapping the env name) - do not cascade install prefixes for a pure-C++ demo library (fixes Mac OS issues) - fixes for misleading RTTI on Clang with anonymous namespaces

prettify tox.ini

aeef714

skarndev requested review from ax3l and virtuald January 26, 2026 19:16

skarndev marked this pull request as ready for review January 26, 2026 19:17

skarndev added 2 commits January 26, 2026 22:19

add tox dependency

eb2889a

remove uv.lock for now

5de9d39

ax3l added enhancement New feature or request documentation Incorrect, incomplete or missing documentation bug Something isn't working labels Jan 26, 2026

readme

285a167

skarndev and others added 3 commits January 26, 2026 23:47

remove extra ;

9c289e0

wording fix

e4a8277

Formatting

6c2bfcf

ax3l reviewed Jan 26, 2026

View reviewed changes

README.md Show resolved Hide resolved

skarndev and others added 4 commits January 26, 2026 23:54

tox job description fix

c0cd8a0

Merge branch 'feature/tests-via-tox' of github.com:pybind/pybind11-st…

535e79b

…ubgen into feature/tests-via-tox

requirements install doc

25a85ae

Add cmeel package

61d0a5b

to development requirements

ax3l reviewed Jan 26, 2026

View reviewed changes

tests/py-demo/bindings/src/modules/aliases.cpp Show resolved Hide resolved

ax3l reviewed Jan 26, 2026

View reviewed changes

tox.ini Show resolved Hide resolved

ax3l reviewed Jan 26, 2026

View reviewed changes

README.md Outdated Show resolved Hide resolved

ax3l reviewed Jan 26, 2026

View reviewed changes

tox.ini Show resolved Hide resolved

ax3l reviewed Jan 26, 2026

View reviewed changes

requirements-dev.txt Outdated Show resolved Hide resolved

venv and uv+tox coupling

992f226

ax3l reviewed Jan 26, 2026

View reviewed changes

requirements-dev.txt

flake8~=6.1.0

isort==5.10.1

numpy~=1.20

scipy~=1.0

Copy link

Contributor

ax3l Jan 26, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change

scipy~=1.0

pip

scipy~=1.0

ax3l reviewed Jan 26, 2026

View reviewed changes

skarndev added 4 commits January 27, 2026 13:24

Merge branch 'main' into feature/tests-via-tox

dcb3b60

resolve merge conflict

2c39b25

isolate builds properly

605b7aa

update cmake in CI to 3.28.x

04c4cdd

	uv python install 3.10 3.11 3.12 3.13
	uv python install -r --managed-python 3.10 3.11 3.12 3.13

Local regeneration of stubs via tox + Clang fixes #287

Are you sure you want to change the base?

Local regeneration of stubs via tox + Clang fixes #287

Uh oh!

Conversation

skarndev commented Jan 24, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

skarndev commented Jan 26, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

ax3l commented Jan 26, 2026

Uh oh!

skarndev commented Jan 26, 2026

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

ax3l Jan 26, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

ax3l commented Jan 26, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Choose a reason for hiding this comment

Uh oh!

ax3l commented Jan 26, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

skarndev commented Jan 27, 2026

Uh oh!

skarndev commented Jan 27, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

sizmailov commented Jan 27, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

skarndev commented Jan 24, 2026 •

edited

Loading

skarndev commented Jan 26, 2026 •

edited

Loading

ax3l Jan 26, 2026 •

edited

Loading

ax3l commented Jan 26, 2026 •

edited

Loading

ax3l commented Jan 26, 2026 •

edited

Loading

skarndev commented Jan 27, 2026 •

edited

Loading