ci(wheels): unbreak wheel release + other enhancements pt 1 #4937

zachlewis · 2025-10-20T13:19:02Z

Description

This PR fixes and improves a handful of wheels-related items:

Fix an issue where wheels produced with v3.1 releases were not getting uploaded to pypi
Update cibuildwheel to latest version (v3.2.1)
Remove the manylinux2014 builds, replace with manylinux_2_28 builds where applicable
Add CPython 3.14 wheels
Update macos-x86 runner to macos-15-intel
Update Python typestubs

Notes

This PR ends support for pre-built wheels for glibc < 2.27 (CentOS-7 etc). However, the module can still be pip-installed locally, provided devtoolset-7+ (e.g., gcc-9+) is available.
Unless we arrive at a more elegant solution, we must remember to change the conditional in the "upload_pypi" step for every major OIIO release.

Signed-off-by: Zach Lewis <[email protected]>

…ux wheels Signed-off-by: Zach Lewis <[email protected]>

Updates the default OpenColorIO build version to 2.5.0, and reconcile dependency required minimum versions accordingly: - expat-2.5 --> 2.6 - yaml-cpp-0.6 --> 0.8 - minizip-ng --> 4.0.10 Also: ci(wheels): macos-15-intel: brew uninstall minizip-ng and expat Signed-off-by: Zach Lewis <[email protected]>

per OCIO-2.5.0 Signed-off-by: Zach Lewis <[email protected]>

Signed-off-by: Zach Lewis <[email protected]>

fixes issue with wheels not getting released to pypi.org! Signed-off-by: Zach Lewis <[email protected]>

For some reason, the build script seems to scream in agony when trying to use ld.gold to link ccache. No matter -- having fixed a typo in build_ccache.bash, we can download a pre-built ccache and be on our way. Signed-off-by: Zach Lewis <[email protected]>

Signed-off-by: Zach Lewis <[email protected]>

also add the -f flag to force homebrew to try to uninstall stuff even if it isn't installed Signed-off-by: Zach Lewis <[email protected]>

Signed-off-by: Zach Lewis <[email protected]>

This is just to silence warnings in the workflow summary view. It shouldn't affect anything about the builds themselves. Signed-off-by: Zach Lewis <[email protected]>

A little while ago, we'd switched to forcing cmake to generate "Unix Makefiles" -- this commit reverts that change, in an effort to remove superstitious settings in our workflow file! Signed-off-by: Zach Lewis <[email protected]>

This reverts commit 9c02b73. Signed-off-by: Zach Lewis <[email protected]>

lgritz · 2025-10-20T16:04:36Z

You seem to be making a lot of adjustments. Let us know when it's ready to review.

.github/workflows/wheel.yml

zachlewis · 2025-10-20T16:09:06Z

This is ready for review -- I don't intend to make any more adjustments.

lgritz · 2025-10-20T16:06:41Z

.github/workflows/wheel.yml

  macos:
    name: Build wheels on macOS
-    runs-on: macos-13
+    runs-on: macos-15-intel


Oops, my bad, I totally didn't think about the wheels when I did this very change on the regular CI.

.github/workflows/wheel.yml

lgritz · 2025-10-20T16:10:36Z

src/build-scripts/build_ccache.bash

 echo "ARCH=$ARCH"

-CCACHE_PREBULT=${CCACHE_PREBULT:=1}
+CCACHE_PREBUILT=${CCACHE_PREBUILT:=1}


Oh boy, that one is embarrassing

lgritz · 2025-10-20T16:12:59Z

src/cmake/build_OpenColorIO.cmake

 ######################################################################

-set_cache (OpenColorIO_BUILD_VERSION 2.4.2 "OpenColorIO version for local builds")
+set_cache (OpenColorIO_BUILD_VERSION 2.5.0 "OpenColorIO version for local builds")


This feels like an orthogonal decision to anything to do with the wheels, because it will change the version of OCIO that anyone will get for the auto-builder. Are we confident enough in 2.5.0 to make it the default?

Good point -- I had only been considering that users locally pip-installing (building) OIIO would want the same OCIO behavior as the available prebuilt wheels. It totally skipped my mind that this affects the default auto-building behavior everywhere!

I am confident enough in 2.5.0 to make it the default, in terms of stuff not breaking; but I agree with you that this change is way out of scope for this PR! I'll revert it here, and open a new PR just for this sucker so we can further discuss.

I feel like without a serious beta/RC cycle, OCIO is treating 2.5.0 as their release candidate and a future 2.5.1 as the one where stuff actually gets fixed. I think 2.5 hasn't actually had a chance to prove itself in production quite yet, so I'm cautious about making it the default. Anybody can override by setting either cmake or env variable OpenColorIO_BUILD_VERSION to 2.5.0, but the default should be playing it safe with a well-tested version we are 100% confident in.

My thinking was that we'd want the version of OCIO available on pypi to match what the version of OIIO available on pypi was built against.

But I think that's a wise decision, to regard 2.5.0 as a release candidate, and I agree with you about holding off until 2.5.1 rolls out. Let's do that.

And if folks really want, they can locally build the OIIO bindings against OCIO 2.5 with:
$ pip install OpenImageIO --config-settings=cmake.define.OpenColorIO_BUILD_VERSION="2.5.0"

keep these commits clean! Signed-off-by: Zach Lewis <[email protected]>

lgritz · 2025-10-20T16:23:54Z

Nice speed bump from not having to build ccache from source on Linux Intel. Is that just because you eliminated the jobs that involved the older glibc? Are there pre-built ccache we can use for the linux arm wheels?

We can address updating to 2.5.0 in another PR Signed-off-by: Zach Lewis <[email protected]>

zachlewis · 2025-10-20T16:58:37Z

Is that just because you eliminated the jobs that involved the older glibc?

I hadn't considered that, but... yeah, having eliminated the manylinux2014 (glibc-2.17) builds, we're able to use the pre-built ccache for the remaining manylinux_2_28 (glibc-2.28) builds for the time being.

Are there pre-built ccache we can use for the linux arm wheels?

Not officially, as far as I can tell. The developers have only recently (as of ccache-4.12.0, I think) started to release aarch64-compatible pre-built binary distributions, and those seem to require a newer version of glibc than we'd like to support (w.r.t. current vfx reference platform recommendations).

One option we could investigate is building ccache in a custom docker image based on the manylinux_2_28 image.

Another option is to try switching from ccache to sccache, which seems to be a more purpose-built solution for what we're trying to do.
(There are sccache binaries available for all platforms / archs we're interested in; the linux binaries are linked against musl, so there are no glibc issues, period).

lgritz

LGTM, if this is ready to go for you, @zachlewis

zachlewis · 2025-10-20T18:36:23Z

Thanks Larry! Seems good to go to me too.

…oftwareFoundation#4937) ## Description This PR fixes and improves a handful of wheels-related items: - Fix an issue where wheels produced with v3.1 releases were not getting uploaded to pypi - Update cibuildwheel to latest version (v3.2.1) - Remove the manylinux2014 builds, replace with manylinux_2_28 builds where applicable - Add CPython 3.14 wheels - Update macos-x86 runner to `macos-15-intel` - Update Python typestubs ## Notes - This PR ends support for pre-built wheels for glibc < 2.27 (CentOS-7 etc). However, the module can still be pip-installed locally, provided devtoolset-7+ (e.g., gcc-9+) is available. - Unless we arrive at a more elegant solution, we must remember to change the conditional in the "upload_pypi" step for every major OIIO release. --------- Signed-off-by: Zach Lewis <[email protected]>

zachlewis added 13 commits October 20, 2025 08:57

ci: Update CIBW to v3.2.1

0d54973

Signed-off-by: Zach Lewis <[email protected]>

ci(wheels): add python 3.14 wheels and use manylinux_2_28 for all lin…

699c776

…ux wheels Signed-off-by: Zach Lewis <[email protected]>

deps(minizip-ng): bump min ver to 4.0.10

6a5677b

per OCIO-2.5.0 Signed-off-by: Zach Lewis <[email protected]>

fix: typo in ccache build script

95f3aa3

Signed-off-by: Zach Lewis <[email protected]>

fix(wheels): upload to pypi on v3.0 OR v3.1 tagged releases

440593b

fixes issue with wheels not getting released to pypi.org! Signed-off-by: Zach Lewis <[email protected]>

fix: update python type stubs

043acb1

Signed-off-by: Zach Lewis <[email protected]>

fix(ci): remove "minizip-ng" from list of stuff to homebrew-uninstall

aa7f34b

also add the -f flag to force homebrew to try to uninstall stuff even if it isn't installed Signed-off-by: Zach Lewis <[email protected]>

ci(wheels): macos-x86: use macos-15-intel runner

efab6ff

Signed-off-by: Zach Lewis <[email protected]>

ci(wheels): coerce "install python" step to use python 3.9

8527d7f

This is just to silence warnings in the workflow summary view. It shouldn't affect anything about the builds themselves. Signed-off-by: Zach Lewis <[email protected]>

ci(wheels): macos -- re-enable Ninja cmake generator

9c02b73

A little while ago, we'd switched to forcing cmake to generate "Unix Makefiles" -- this commit reverts that change, in an effort to remove superstitious settings in our workflow file! Signed-off-by: Zach Lewis <[email protected]>

Revert "ci(wheels): macos -- re-enable Ninja cmake generator"

bc0cc78

This reverts commit 9c02b73. Signed-off-by: Zach Lewis <[email protected]>

lgritz reviewed Oct 20, 2025

View reviewed changes

.github/workflows/wheel.yml Outdated Show resolved Hide resolved

lgritz reviewed Oct 20, 2025

View reviewed changes

cleanup: restore unnecessary changes relative to main

e606d70

keep these commits clean! Signed-off-by: Zach Lewis <[email protected]>

zachlewis force-pushed the ci_wheels_enhancements_pt1 branch from e1422ca to e606d70 Compare October 20, 2025 16:23

build(OpenColorIO): Revert default version to 2.4.2

4fa4d9e

We can address updating to 2.5.0 in another PR Signed-off-by: Zach Lewis <[email protected]>

lgritz approved these changes Oct 20, 2025

View reviewed changes

lgritz changed the title ~~ci(wheels): enhancements pt 1~~ ci(wheels): unbreak wheel release + other enhancements pt 1 Oct 20, 2025

lgritz merged commit 2ae5554 into AcademySoftwareFoundation:main Oct 20, 2025
65 checks passed

ci(wheels): unbreak wheel release + other enhancements pt 1 #4937

ci(wheels): unbreak wheel release + other enhancements pt 1 #4937

Uh oh!

Conversation

zachlewis commented Oct 20, 2025 • edited by lgritz Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Description

Notes

Uh oh!

lgritz commented Oct 20, 2025

Uh oh!

Uh oh!

zachlewis commented Oct 20, 2025

Uh oh!

lgritz Oct 20, 2025

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

lgritz Oct 20, 2025

Choose a reason for hiding this comment

Uh oh!

lgritz Oct 20, 2025

Choose a reason for hiding this comment

Uh oh!

zachlewis Oct 20, 2025

Choose a reason for hiding this comment

Uh oh!

lgritz Oct 20, 2025

Choose a reason for hiding this comment

Uh oh!

zachlewis Oct 20, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

lgritz commented Oct 20, 2025

Uh oh!

zachlewis commented Oct 20, 2025

Uh oh!

lgritz left a comment

Choose a reason for hiding this comment

Uh oh!

zachlewis commented Oct 20, 2025

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

zachlewis commented Oct 20, 2025 •

edited by lgritz

Loading

zachlewis Oct 20, 2025 •

edited

Loading