Henry Schreiner
eec3efa84e
* ci: improve Azure test reliability Azure has intermittent failures, often the macOS framework-Python `posix_spawn: Undefined error: 0` spawn race under load, plus transient download flakiness. Address both: - Retry integration tests via pytest-rerunfailures (already required): add `--reruns=2 --reruns-delay=5` to the serial and non-serial runs so a single transient flake self-heals instead of failing the whole job. - Cap Azure at `--num-processes 3` to reduce concurrent process spawning (the macOS runner was using 4 xdist workers), lowering the spawn-race probability and peak resource pressure. - Cache downloads across runs: relocate CIBW_CACHE_PATH to a stable path and add a Cache@2 task (interpreter downloads + per-worker test pip caches live under it), cutting the network-download flake surface. - Bump the Azure host interpreter to 3.13. Assisted-by: ClaudeCode:claude-opus-4.8 * ci: stabilize iOS tests, bound rerun cost An iOS run on Azure (build 9043) hung for the full 40-min pytest timeout on the second build config of test_ios_platforms, then reran twice (reruns=2), blowing past the 180-min job cap with no useful signal. The hang was a stuck simulator/xcodebuild on the second config, after the first config had run. - Shut down running simulators before each parametrized config via a `clean_ios_simulators` fixture, so a simulator left booted/wedged by the previous config isn't reused. - Drop iOS reruns from 2 to 1. One retry still covers the documented "fails the first time" simulator-boot flake, while halving the worst-case retry cost (3x40=120min -> 2x40=80min) on a hang. Assisted-by: ClaudeCode:claude-opus-4.8 * ci: don't limit num processes Signed-off-by: Henry Schreiner <henryfs@princeton.edu> * ci: rerun OCI unit tests that pull from Docker Hub test_local_image et al. occasionally fail on a transient Docker Hub anonymous-pull blip ("unauthorized: authentication required") when pulling debian:trixie-slim. The integration runs already self-heal via pytest-rerunfailures, but the unit run had no reruns, so a single flake failed the whole job. Mark the three network-dependent OCI tests (test_local_image, test_enter_error, test_multiarch_image) flaky so they retry instead of blanket-rerunning the suite. Assisted-by: ClaudeCode:claude-opus-4.8 * Drop iOS clean step Co-authored-by: Henry Schreiner <HenrySchreinerIII@gmail.com> * ci: scope integration reruns to test_0_basic::test Drop the blanket --reruns from the serial and non-serial integration runs and instead mark test_0_basic.py::test as flaky, so only the known flaky basic test is retried. Assisted-by: ClaudeCode:claude-opus-4.8 --------- Signed-off-by: Henry Schreiner <henryfs@princeton.edu>
92 lines
2.9 KiB
YAML
92 lines
2.9 KiB
YAML
pr:
|
|
paths:
|
|
exclude:
|
|
- .github/**
|
|
- bin/*
|
|
- docs/**
|
|
- examples/github-*
|
|
- examples/ci*
|
|
- examples/travis-ci-*
|
|
- .ci*
|
|
- .pre-commit-config.yaml
|
|
- .readthedocs.yml
|
|
- .travis.yml
|
|
- README.md
|
|
- mkdocs.yml
|
|
- noxfile.py
|
|
|
|
jobs:
|
|
- job: tests
|
|
strategy:
|
|
matrix:
|
|
linux_313:
|
|
imageName: "ubuntu-latest"
|
|
pythonVersion: "3.13"
|
|
testSelect: "native"
|
|
android_313:
|
|
imageName: "ubuntu-latest"
|
|
pythonVersion: "3.13"
|
|
testSelect: "android"
|
|
macos_313:
|
|
imageName: "macos-latest"
|
|
pythonVersion: "3.13"
|
|
testSelect: "native"
|
|
ios_313:
|
|
imageName: "macos-14" # See https://github.com/actions/runner-images/issues/12777
|
|
pythonVersion: "3.13"
|
|
testSelect: "ios"
|
|
android_macos_313:
|
|
imageName: "macos-latest"
|
|
pythonVersion: "3.13"
|
|
testSelect: "android"
|
|
windows_313:
|
|
imageName: "windows-latest"
|
|
pythonVersion: "3.13"
|
|
testSelect: "native"
|
|
timeoutInMinutes: 180
|
|
pool:
|
|
vmImage: $(imageName)
|
|
variables:
|
|
# Relocate cibuildwheel's download cache (interpreters) and the per-worker
|
|
# test pip caches (which live under it) to a stable, cacheable path.
|
|
CIBW_CACHE_PATH: $(Pipeline.Workspace)/.cibw-cache
|
|
|
|
steps:
|
|
- task: UsePythonVersion@0
|
|
inputs:
|
|
versionSpec: $(pythonVersion)
|
|
|
|
- task: Cache@2
|
|
displayName: 'Cache cibuildwheel downloads'
|
|
inputs:
|
|
# build-platforms.toml carries the interpreter pins; bump the version
|
|
# prefix to force a cold cache. restoreKeys lets a stale cache still seed
|
|
# a new run (cibuildwheel re-downloads only what's missing).
|
|
key: 'cibw-cache | v1 | "$(imageName)" | "$(testSelect)" | cibuildwheel/resources/build-platforms.toml'
|
|
restoreKeys: |
|
|
cibw-cache | v1 | "$(imageName)" | "$(testSelect)"
|
|
path: $(CIBW_CACHE_PATH)
|
|
|
|
- task: JavaToolInstaller@0
|
|
condition: and(eq(variables['testSelect'], 'android'), eq(variables['Agent.OS'], 'Linux'))
|
|
inputs:
|
|
versionSpec: '17'
|
|
jdkArchitectureOption: 'x64'
|
|
jdkSourceOption: 'PreInstalled'
|
|
|
|
- bash: docker run --rm --privileged docker.io/tonistiigi/binfmt:latest --install all
|
|
condition: and(eq(variables['imageName'], 'ubuntu-latest'), eq(variables['testSelect'], 'native'))
|
|
displayName: 'Install binfmt on Linux'
|
|
|
|
- bash: python -m pip install -U pip && python -m pip install -e. --group test
|
|
displayName: 'Update pip and install cibuildwheel --group test'
|
|
|
|
- bash: echo "##vso[task.setvariable variable=CIBW_ENABLE;]all"
|
|
condition: eq(variables['Build.SourceBranch'], 'refs/heads/main')
|
|
displayName: Set CIBW_ENABLE to all (main branch)
|
|
|
|
- bash: |
|
|
echo "CIBW_ENABLE = $CIBW_ENABLE"
|
|
python ./bin/run_tests.py --test-select $(testSelect)
|
|
displayName: 'Run tests'
|