2.18.0: pep517 based build fails about pydantic-core

[davidhewitt]

@jm-nab that particular error is a duplicate of #1292

[kloczek]

List of installed modules in build env

Package            Version
------------------ -----------
attrs              23.2.0
build              1.2.1
dirty-equals       0.7.1
exceptiongroup     1.1.3
hypothesis         6.100.0
importlib_metadata 7.1.0
iniconfig          2.0.0
installer          0.7.0
maturin            1.5.1
packaging          24.0
pluggy             1.4.0
py-cpuinfo         9.0.0
pyproject_hooks    1.0.0
pytest             8.1.1
pytest-benchmark   4.0.0
pytest-mock        3.14.0
pytest-timeout     2.3.1
python-dateutil    2.9.0.post0
pytz               2024.1
ruff               0.3.5
sortedcontainers   2.4.0
tokenize_rt        5.2.0
tomli              2.0.1
typing_extensions  4.10.0
wheel              0.43.0
zipp               3.18.1

[samuelcolvin]

Please can you give some details on the environment, os, how, and why your building pydantic-core from source.

[kloczek]

I'm building your module because I'm working on Linux/Solaris distribution.
Currently in that distro is used python 3.10.x.

[samuelcolvin]

No idea why it's failing for you and not others (e.g. our CI) and only now, maybe a subtle change in a patch release.

But I should be about to fix it.

[kloczek]

Is it anything else what I can try to do to provide more diagnostics? 🤔

[samuelcolvin]

The reason is that you have the wrong version of typing extensions installed:

pydantic-core/pyproject.toml

Line 4 in f636403

'typing-extensions >=4.6.0,!=4.7.0'

[samuelcolvin]

oh, I've just re-read the version constraint, maybe that's not it.

[samuelcolvin]

Which patch version of 3.10 are you using?

[kloczek]

Which patch version of 3.10 are you using?

Latest one 3.10.14.

[jm-nab]

Similar issue, which is very peculiar considering the version check should work?:

• pydantic-core/generate_self_schema.py

  Lines 195 to 198 in a762041

  	return type_._evaluate(core_schema.__dict__, None, type_params=set(), recursive_guard=set())
  	except TypeError:
  	# Python 3.9+
  	return type_._evaluate(core_schema.__dict__, None, set())

poetry install --all-extras
Installing dependencies from lock file

Package operations: 218 installs, 6 updates, 0 removals

  - Installing pydantic-core (2.18.2): Failed

  ChefBuildError

  Backend subprocess exited when trying to invoke build_wheel

  Running `maturin pep517 build-wheel -i /tmp/tmpg52uy9h8/.venv/bin/python --compatibility off`
  📦 Including license file "/tmp/tmpjy5611r2/pydantic_core-2.18.2/LICENSE"
  🍹 Building a mixed python/rust project
  🔗 Found pyo3 bindings
  🐍 Found CPython 3.13 at /tmp/tmpg52uy9h8/.venv/bin/python
  📡 Using build options features, bindings from pyproject.toml
     Compiling autocfg v1.1.0
     Compiling target-lexicon v0.12.9
     Compiling python3-dll-a v0.2.9
     Compiling proc-macro2 v1.0.76
     Compiling once_cell v1.18.0
     Compiling unicode-ident v1.0.10
     Compiling libc v0.2.147
     Compiling heck v0.4.1
     Compiling num-traits v0.2.16
     Compiling quote v1.0.35
     Compiling pyo3-build-config v0.21.1
     Compiling syn v2.0.48
     Compiling cfg-if v1.0.0
     Compiling rustversion v1.0.13
     Compiling version_check v0.9.4
     Compiling lock_api v0.4.10
     Compiling num-integer v0.1.45
     Compiling parking_lot_core v0.9.8
     Compiling pyo3-ffi v0.21.1
     Compiling memoffset v0.9.0
     Compiling num-bigint v0.4.4
     Compiling scopeguard v1.1.0
     Compiling smallvec v1.13.2
     Compiling tinyvec_macros v0.1.1
     Compiling portable-atomic v1.6.0
     Compiling static_assertions v1.1.0
     Compiling lexical-util v0.8.5
     Compiling tinyvec v1.6.0
     Compiling pyo3-macros-backend v0.21.1
     Compiling pyo3 v0.21.1
     Compiling ahash v0.8.10
     Compiling serde v1.0.197
     Compiling memchr v2.6.3
     Compiling unicode-normalization v0.1.22
     Compiling aho-corasick v1.0.2
     Compiling strum_macros v0.25.3
     Compiling serde_derive v1.0.197
     Compiling lexical-parse-integer v0.8.6
     Compiling parking_lot v0.12.1
     Compiling pyo3-macros v0.21.1
     Compiling jiter v0.2.1
     Compiling getrandom v0.2.10
     Compiling equivalent v1.0.1
     Compiling unicode-bidi v0.3.13
     Compiling zerocopy v0.7.32
     Compiling regex-syntax v0.8.2
     Compiling hashbrown v0.14.3
     Compiling percent-encoding v2.3.1
     Compiling indoc v2.0.4
     Compiling serde_json v1.0.114
     Compiling unindent v0.2.3
     Compiling form_urlencoded v1.2.1
     Compiling indexmap v2.2.2
     Compiling regex-automata v0.4.5
     Compiling idna v0.5.0
     Compiling strum v0.25.0
     Compiling lexical-parse-float v0.8.5
     Compiling pydantic-core v2.18.2 (/tmp/tmpjy5611r2/pydantic_core-2.18.2)
     Compiling ryu v1.0.14
     Compiling itoa v1.0.8
  error: failed to run custom build command for `pydantic-core v2.18.2 (/tmp/tmpjy5611r2/pydantic_core-2.18.2)`

  Caused by:
    process didn't exit successfully: `/tmp/tmpjy5611r2/pydantic_core-2.18.2/target/release/build/pydantic-core-1802aceee20bb22a/build-script-build` (exit status: 101)
    --- stdout
    cargo:rustc-cfg=Py_3_6
    cargo:rustc-cfg=Py_3_7
    cargo:rustc-cfg=Py_3_8
    cargo:rustc-cfg=Py_3_9
    cargo:rustc-cfg=Py_3_10
    cargo:rustc-cfg=Py_3_11
    cargo:rustc-cfg=Py_3_12
    cargo:rustc-cfg=Py_3_13
    cargo:rustc-cfg=Py_LIMITED_API
    cargo:rerun-if-changed=python/pydantic_core/core_schema.py
    cargo:rerun-if-changed=generate_self_schema.py

    --- stderr
    Traceback (most recent call last):
      File "/tmp/tmpjy5611r2/pydantic_core-2.18.2/generate_self_schema.py", line 193, in eval_forward_ref
        return type_._evaluate(core_schema.__dict__, None, set())
               ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    TypeError: ForwardRef._evaluate() missing 1 required keyword-only argument: 'recursive_guard'

    During handling of the above exception, another exception occurred:

    Traceback (most recent call last):
      File "/tmp/tmpjy5611r2/pydantic_core-2.18.2/generate_self_schema.py", line 241, in <module>
        main()
        ~~~~^^
      File "/tmp/tmpjy5611r2/pydantic_core-2.18.2/generate_self_schema.py", line 211, in main
        value = get_schema(s, definitions)
      File "/tmp/tmpjy5611r2/pydantic_core-2.18.2/generate_self_schema.py", line 55, in get_schema
        return type_dict_schema(obj, definitions)
      File "/tmp/tmpjy5611r2/pydantic_core-2.18.2/generate_self_schema.py", line 153, in type_dict_schema
        field_type = eval_forward_ref(field_type)
      File "/tmp/tmpjy5611r2/pydantic_core-2.18.2/generate_self_schema.py", line 196, in eval_forward_ref
        return type_._evaluate(core_schema.__dict__, None)
               ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    TypeError: ForwardRef._evaluate() missing 1 required keyword-only argument: 'recursive_guard'
    thread 'main' panicked at build.rs:29:9:
    generate_self_schema.py failed with exit status: 1
    note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace
  warning: build failed, waiting for other jobs to finish...
  💥 maturin failed
    Caused by: Failed to build a native library through cargo
    Caused by: Cargo build finished with "exit status: 101": `env -u CARGO PYO3_ENVIRONMENT_SIGNATURE="cpython-3.13-64bit" PYO3_PYTHON="/tmp/tmpg52uy9h8/.venv/bin/python" PYTHON_SYS_EXECUTABLE="/tmp/tmpg52uy9h8/.venv/bin/python" "cargo" "rustc" "--features" "pyo3/extension-module" "--message-format" "json-render-diagnostics" "--manifest-path" "/tmp/tmpjy5611r2/pydantic_core-2.18.2/Cargo.toml" "--release" "--lib" "--crate-type" "cdylib"`
  Error: command ['maturin', 'pep517', 'build-wheel', '-i', '/tmp/tmpg52uy9h8/.venv/bin/python', '--compatibility', 'off'] returned non-zero exit status 1


  at venv_313/lib/python3.13/site-packages/poetry/installation/chef.py:164 in _prepare
      160│
      161│                 error = ChefBuildError("\n\n".join(message_parts))
      162│
      163│             if error is not None:
    → 164│                 raise error from None
      165│
      166│             return path
      167│
      168│     def _prepare_sdist(self, archive: Path, destination: Path | None = None) -> Path:

Note: This error originates from the build backend, and is likely not a problem with poetry but with pydantic-core (2.18.2) not supporting PEP 517 builds. You can verify this by running 'pip wheel --no-cache-dir --use-pep517 "pydantic-core (==2.18.2)"'.