[Failing Test]: Beam ML unit test suite fails on Python 3.11 #31287

tvalentyn · 2024-05-14T16:38:00Z

What happened?

A combination of Beam + TFT is not installable on Python 3.11

python$ pip install apache-beam[gcp]==2.56.0 tensorflow-transform
Collecting apache-beam==2.56.0 (from apache-beam[gcp]==2.56.0)
  Downloading apache_beam-2.56.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (6.7 kB)
Collecting tensorflow-transform
  Using cached tensorflow_transform-1.15.0-py3-none-any.whl.metadata (13 kB)
Collecting crcmod<2.0,>=1.7 (from apache-beam==2.56.0->apache-beam[gcp]==2.56.0)
  Using cached crcmod-1.7-cp311-cp311-linux_x86_64.whl
Collecting orjson<4,>=3.9.7 (from apache-beam==2.56.0->apache-beam[gcp]==2.56.0)
  Using cached orjson-3.10.3-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (49 kB)
Collecting dill<0.3.2,>=0.3.1.1 (from apache-beam==2.56.0->apache-beam[gcp]==2.56.0)
  Using cached dill-0.3.1.1-py3-none-any.whl
Collecting cloudpickle~=2.2.1 (from apache-beam==2.56.0->apache-beam[gcp]==2.56.0)
  Using cached cloudpickle-2.2.1-py3-none-any.whl.metadata (6.9 kB)
Collecting fastavro<2,>=0.23.6 (from apache-beam==2.56.0->apache-beam[gcp]==2.56.0)
  Using cached fastavro-1.9.4-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (5.5 kB)
Collecting fasteners<1.0,>=0.3 (from apache-beam==2.56.0->apache-beam[gcp]==2.56.0)
  Using cached fasteners-0.19-py3-none-any.whl.metadata (4.9 kB)
Collecting grpcio!=1.48.0,!=1.59.*,!=1.60.*,!=1.61.*,!=1.62.0,!=1.62.1,<2,>=1.33.1 (from apache-beam==2.56.0->apache-beam[gcp]==2.56.0)
  Using cached grpcio-1.63.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (3.2 kB)
Collecting hdfs<3.0.0,>=2.1.0 (from apache-beam==2.56.0->apache-beam[gcp]==2.56.0)
  Using cached hdfs-2.7.3-py3-none-any.whl
Collecting httplib2<0.23.0,>=0.8 (from apache-beam==2.56.0->apache-beam[gcp]==2.56.0)
  Using cached httplib2-0.22.0-py3-none-any.whl.metadata (2.6 kB)
Collecting jsonschema<5.0.0,>=4.0.0 (from apache-beam==2.56.0->apache-beam[gcp]==2.56.0)
  Using cached jsonschema-4.22.0-py3-none-any.whl.metadata (8.2 kB)
Collecting jsonpickle<4.0.0,>=3.0.0 (from apache-beam==2.56.0->apache-beam[gcp]==2.56.0)
  Using cached jsonpickle-3.0.4-py3-none-any.whl.metadata (2.6 kB)
Collecting numpy<1.27.0,>=1.14.3 (from apache-beam==2.56.0->apache-beam[gcp]==2.56.0)
  Using cached numpy-1.26.4-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (61 kB)
Collecting objsize<0.8.0,>=0.6.1 (from apache-beam==2.56.0->apache-beam[gcp]==2.56.0)
  Using cached objsize-0.7.0-py3-none-any.whl.metadata (12 kB)
Collecting packaging>=22.0 (from apache-beam==2.56.0->apache-beam[gcp]==2.56.0)
  Using cached packaging-24.0-py3-none-any.whl.metadata (3.2 kB)
Collecting pymongo<5.0.0,>=3.8.0 (from apache-beam==2.56.0->apache-beam[gcp]==2.56.0)
  Using cached pymongo-4.7.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (22 kB)
Collecting proto-plus<2,>=1.7.1 (from apache-beam==2.56.0->apache-beam[gcp]==2.56.0)
  Using cached proto_plus-1.23.0-py3-none-any.whl.metadata (2.2 kB)
Collecting protobuf!=4.0.*,!=4.21.*,!=4.22.0,!=4.23.*,!=4.24.*,<4.26.0,>=3.20.3 (from apache-beam==2.56.0->apache-beam[gcp]==2.56.0)
  Using cached protobuf-4.25.3-cp37-abi3-manylinux2014_x86_64.whl.metadata (541 bytes)
Collecting pydot<2,>=1.2.0 (from apache-beam==2.56.0->apache-beam[gcp]==2.56.0)
  Using cached pydot-1.4.2-py2.py3-none-any.whl.metadata (8.0 kB)
Collecting python-dateutil<3,>=2.8.0 (from apache-beam==2.56.0->apache-beam[gcp]==2.56.0)
  Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB)
Collecting pytz>=2018.3 (from apache-beam==2.56.0->apache-beam[gcp]==2.56.0)
  Using cached pytz-2024.1-py2.py3-none-any.whl.metadata (22 kB)
Collecting redis<6,>=5.0.0 (from apache-beam==2.56.0->apache-beam[gcp]==2.56.0)
  Using cached redis-5.0.4-py3-none-any.whl.metadata (9.3 kB)
Collecting regex>=2020.6.8 (from apache-beam==2.56.0->apache-beam[gcp]==2.56.0)
  Using cached regex-2024.5.10-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (40 kB)
Collecting requests<3.0.0,>=2.24.0 (from apache-beam==2.56.0->apache-beam[gcp]==2.56.0)
  Using cached requests-2.31.0-py3-none-any.whl.metadata (4.6 kB)
Collecting typing-extensions>=3.7.0 (from apache-beam==2.56.0->apache-beam[gcp]==2.56.0)
  Using cached typing_extensions-4.11.0-py3-none-any.whl.metadata (3.0 kB)
Collecting zstandard<1,>=0.18.0 (from apache-beam==2.56.0->apache-beam[gcp]==2.56.0)
  Using cached zstandard-0.22.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (2.9 kB)
Collecting pyarrow<15.0.0,>=3.0.0 (from apache-beam==2.56.0->apache-beam[gcp]==2.56.0)
  Using cached pyarrow-14.0.2-cp311-cp311-manylinux_2_28_x86_64.whl.metadata (3.0 kB)
Collecting pyarrow-hotfix<1 (from apache-beam==2.56.0->apache-beam[gcp]==2.56.0)
  Using cached pyarrow_hotfix-0.6-py3-none-any.whl.metadata (3.6 kB)
Collecting js2py<1,>=0.74 (from apache-beam==2.56.0->apache-beam[gcp]==2.56.0)
  Using cached Js2Py-0.74-py3-none-any.whl.metadata (868 bytes)
Collecting cachetools<6,>=3.1.0 (from apache-beam[gcp]==2.56.0)
  Using cached cachetools-5.3.3-py3-none-any.whl.metadata (5.3 kB)
Collecting google-api-core<3,>=2.0.0 (from apache-beam[gcp]==2.56.0)
  Using cached google_api_core-2.19.0-py3-none-any.whl.metadata (2.7 kB)
Collecting google-apitools<0.5.32,>=0.5.31 (from apache-beam[gcp]==2.56.0)
  Using cached google_apitools-0.5.31-py3-none-any.whl
Collecting google-auth<3,>=1.18.0 (from apache-beam[gcp]==2.56.0)
  Using cached google_auth-2.29.0-py2.py3-none-any.whl.metadata (4.7 kB)
Collecting google-auth-httplib2<0.3.0,>=0.1.0 (from apache-beam[gcp]==2.56.0)
  Using cached google_auth_httplib2-0.2.0-py2.py3-none-any.whl.metadata (2.2 kB)
Collecting google-cloud-datastore<3,>=2.0.0 (from apache-beam[gcp]==2.56.0)
  Using cached google_cloud_datastore-2.19.0-py2.py3-none-any.whl.metadata (5.6 kB)
Collecting google-cloud-pubsub<3,>=2.1.0 (from apache-beam[gcp]==2.56.0)
  Using cached google_cloud_pubsub-2.21.1-py2.py3-none-any.whl.metadata (9.3 kB)
Collecting google-cloud-pubsublite<2,>=1.2.0 (from apache-beam[gcp]==2.56.0)
  Using cached google_cloud_pubsublite-1.10.0-py2.py3-none-any.whl.metadata (5.6 kB)
Collecting google-cloud-storage<3,>=2.14.0 (from apache-beam[gcp]==2.56.0)
  Using cached google_cloud_storage-2.16.0-py2.py3-none-any.whl.metadata (6.1 kB)
Collecting google-cloud-bigquery<4,>=2.0.0 (from apache-beam[gcp]==2.56.0)
  Using cached google_cloud_bigquery-3.22.0-py2.py3-none-any.whl.metadata (8.9 kB)
Collecting google-cloud-bigquery-storage<3,>=2.6.3 (from apache-beam[gcp]==2.56.0)
  Using cached google_cloud_bigquery_storage-2.25.0-py2.py3-none-any.whl.metadata (5.6 kB)
Collecting google-cloud-core<3,>=2.0.0 (from apache-beam[gcp]==2.56.0)
  Using cached google_cloud_core-2.4.1-py2.py3-none-any.whl.metadata (2.7 kB)
Collecting google-cloud-bigtable<3,>=2.19.0 (from apache-beam[gcp]==2.56.0)
  Using cached google_cloud_bigtable-2.23.1-py2.py3-none-any.whl.metadata (5.2 kB)
Collecting google-cloud-spanner<4,>=3.0.0 (from apache-beam[gcp]==2.56.0)
  Using cached google_cloud_spanner-3.46.0-py2.py3-none-any.whl.metadata (10 kB)
Collecting google-cloud-dlp<4,>=3.0.0 (from apache-beam[gcp]==2.56.0)
  Using cached google_cloud_dlp-3.17.0-py2.py3-none-any.whl.metadata (5.3 kB)
Collecting google-cloud-language<3,>=2.0 (from apache-beam[gcp]==2.56.0)
  Using cached google_cloud_language-2.13.3-py2.py3-none-any.whl.metadata (5.3 kB)
Collecting google-cloud-videointelligence<3,>=2.0 (from apache-beam[gcp]==2.56.0)
  Using cached google_cloud_videointelligence-2.13.3-py2.py3-none-any.whl.metadata (5.7 kB)
Collecting google-cloud-vision<4,>=2 (from apache-beam[gcp]==2.56.0)
  Using cached google_cloud_vision-3.7.2-py2.py3-none-any.whl.metadata (5.2 kB)
Collecting google-cloud-recommendations-ai<0.11.0,>=0.1.0 (from apache-beam[gcp]==2.56.0)
  Using cached google_cloud_recommendations_ai-0.10.10-py2.py3-none-any.whl.metadata (5.3 kB)
Collecting google-cloud-aiplatform<2.0,>=1.26.0 (from apache-beam[gcp]==2.56.0)
  Using cached google_cloud_aiplatform-1.51.0-py2.py3-none-any.whl.metadata (30 kB)
Collecting absl-py<2.0.0,>=0.9 (from tensorflow-transform)
  Using cached absl_py-1.4.0-py3-none-any.whl.metadata (2.3 kB)
Collecting pyarrow<15.0.0,>=3.0.0 (from apache-beam==2.56.0->apache-beam[gcp]==2.56.0)
  Using cached pyarrow-10.0.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (3.0 kB)
Collecting tensorflow<2.16,>=2.15 (from tensorflow-transform)
  Using cached tensorflow-2.15.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (4.2 kB)
Collecting tensorflow-metadata<1.16.0,>=1.15.0 (from tensorflow-transform)
  Using cached tensorflow_metadata-1.15.0-py3-none-any.whl.metadata (2.4 kB)
INFO: pip is looking at multiple versions of tensorflow-transform to determine which version is compatible with other requirements. This could take a while.
Collecting tensorflow-transform
  Using cached tensorflow_transform-1.14.0-py3-none-any.whl.metadata (12 kB)
Collecting tensorflow<3,>=2.13 (from tensorflow-transform)
  Using cached tensorflow-2.16.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (4.3 kB)
Collecting tensorflow-metadata<1.15.0,>=1.14.0 (from tensorflow-transform)
  Using cached tensorflow_metadata-1.14.0-py3-none-any.whl.metadata (2.1 kB)
Collecting tensorflow-transform
  Using cached tensorflow_transform-1.13.0-py3-none-any.whl.metadata (12 kB)
Collecting numpy<1.27.0,>=1.14.3 (from apache-beam==2.56.0->apache-beam[gcp]==2.56.0)
  Using cached numpy-1.22.4.zip (11.5 MB)
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
  Preparing metadata (pyproject.toml) ... done
Collecting pyarrow<15.0.0,>=3.0.0 (from apache-beam==2.56.0->apache-beam[gcp]==2.56.0)
  Using cached pyarrow-6.0.1.tar.gz (770 kB)
  Installing build dependencies ... error
  error: subprocess-exited-with-error
  
  × pip subprocess to install build dependencies did not run successfully.
  │ exit code: 1
  ╰─> [8 lines of output]
      Ignoring numpy: markers 'python_version < "3.8"' don't match your environment
      Ignoring numpy: markers 'python_version == "3.8"' don't match your environment
      Ignoring numpy: markers 'python_version == "3.9"' don't match your environment
      Collecting cython>=0.29
        Using cached Cython-3.0.10-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (3.2 kB)
      ERROR: Ignored the following versions that require a different python version: 1.21.2 Requires-Python >=3.7,<3.11; 1.21.3 Requires-Python >=3.7,<3.11; 1.21.4 Requires-Python >=3.7,<3.11; 1.21.5 Requires-Python >=3.7,<3.11; 1.21.6 Requires-Python >=3.7,<3.11
      ERROR: Could not find a version that satisfies the requirement numpy==1.21.3 (from versions: 1.3.0, 1.4.1, 1.5.0, 1.5.1, 1.6.0, 1.6.1, 1.6.2, 1.7.0, 1.7.1, 1.7.2, 1.8.0, 1.8.1, 1.8.2, 1.9.0, 1.9.1, 1.9.2, 1.9.3, 1.10.0.post2, 1.10.1, 1.10.2, 1.10.4, 1.11.0, 1.11.1, 1.11.2, 1.11.3, 1.12.0, 1.12.1, 1.13.0, 1.13.1, 1.13.3, 1.14.0, 1.14.1, 1.14.2, 1.14.3, 1.14.4, 1.14.5, 1.14.6, 1.15.0, 1.15.1, 1.15.2, 1.15.3, 1.15.4, 1.16.0, 1.16.1, 1.16.2, 1.16.3, 1.16.4, 1.16.5, 1.16.6, 1.17.0, 1.17.1, 1.17.2, 1.17.3, 1.17.4, 1.17.5, 1.18.0, 1.18.1, 1.18.2, 1.18.3, 1.18.4, 1.18.5, 1.19.0, 1.19.1, 1.19.2, 1.19.3, 1.19.4, 1.19.5, 1.20.0, 1.20.1, 1.20.2, 1.20.3, 1.21.0, 1.21.1, 1.22.0, 1.22.1, 1.22.2, 1.22.3, 1.22.4, 1.23.0rc1, 1.23.0rc2, 1.23.0rc3, 1.23.0, 1.23.1, 1.23.2, 1.23.3, 1.23.4, 1.23.5, 1.24.0rc1, 1.24.0rc2, 1.24.0, 1.24.1, 1.24.2, 1.24.3, 1.24.4, 1.25.0rc1, 1.25.0, 1.25.1, 1.25.2, 1.26.0b1, 1.26.0rc1, 1.26.0, 1.26.1, 1.26.2, 1.26.3, 1.26.4, 2.0.0b1, 2.0.0rc1, 2.0.0rc2)
      ERROR: No matching distribution found for numpy==1.21.3
      [end of output]

Issue Failure

Failure: Test is failing

Issue Priority

Priority: 2 (backlog / disabled test but we think the product is healthy)

Issue Components

The text was updated successfully, but these errors were encountered:

tvalentyn · 2024-05-14T16:48:18Z

Actually, "tensorflow_transform" alone is also not installable.

(py311c) :python$ pip install "tensorflow_transform"
Collecting tensorflow_transform
Using cached tensorflow_transform-1.15.0-py3-none-any.whl.metadata (13 kB)
Collecting absl-py<2.0.0,>=0.9 (from tensorflow_transform)
Using cached absl_py-1.4.0-py3-none-any.whl.metadata (2.3 kB)
Collecting numpy>=1.22.0 (from tensorflow_transform)
Using cached numpy-1.26.4-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (61 kB)
Collecting pyarrow<11,>=10 (from tensorflow_transform)
Using cached pyarrow-10.0.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (3.0 kB)
Collecting pydot<2,>=1.2 (from tensorflow_transform)
Using cached pydot-1.4.2-py2.py3-none-any.whl.metadata (8.0 kB)
Collecting tensorflow<2.16,>=2.15 (from tensorflow_transform)
Using cached tensorflow-2.15.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (4.2 kB)
Collecting tensorflow-metadata<1.16.0,>=1.15.0 (from tensorflow_transform)
Using cached tensorflow_metadata-1.15.0-py3-none-any.whl.metadata (2.4 kB)
INFO: pip is looking at multiple versions of tensorflow-transform to determine which version is compatible with other requirements. This could take a while.
Collecting tensorflow_transform
Using cached tensorflow_transform-1.14.0-py3-none-any.whl.metadata (12 kB)
Collecting apache-beam<3,>=2.47 (from apache-beam[gcp]<3,>=2.47->tensorflow_transform)
Using cached apache_beam-2.56.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (6.7 kB)
Collecting protobuf<5,>=3.20.3 (from tensorflow_transform)
Using cached protobuf-4.25.3-cp37-abi3-manylinux2014_x86_64.whl.metadata (541 bytes)
Collecting tensorflow<3,>=2.13 (from tensorflow_transform)
Using cached tensorflow-2.16.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (4.3 kB)
Collecting tensorflow-metadata<1.15.0,>=1.14.0 (from tensorflow_transform)
Using cached tensorflow_metadata-1.14.0-py3-none-any.whl.metadata (2.1 kB)
Collecting tensorflow_transform
Using cached tensorflow_transform-1.13.0-py3-none-any.whl.metadata (12 kB)
Collecting numpy~=1.22.0 (from tensorflow_transform)
Using cached numpy-1.22.4.zip (11.5 MB)
Installing build dependencies ... done
Getting requirements to build wheel ... done
Preparing metadata (pyproject.toml) ... done
Collecting pyarrow<7,>=6 (from tensorflow_transform)
Using cached pyarrow-6.0.1.tar.gz (770 kB)
Installing build dependencies ... error
error: subprocess-exited-with-error

× pip subprocess to install build dependencies did not run successfully.
│ exit code: 1
╰─> [8 lines of output]
Ignoring numpy: markers 'python_version < "3.8"' don't match your environment
Ignoring numpy: markers 'python_version == "3.8"' don't match your environment
Ignoring numpy: markers 'python_version == "3.9"' don't match your environment
Collecting cython>=0.29
Using cached Cython-3.0.10-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (3.2 kB)
ERROR: Ignored the following versions that require a different python version: 1.21.2 Requires-Python >=3.7,<3.11; 1.21.3 Requires-Python >=3.7,<3.11; 1.21.4 Requires-Python >=3.7,<3.11; 1.21.5 Requires-Python >=3.7,<3.11; 1.21.6 Requires-Python >=3.7,<3.11
ERROR: Could not find a version that satisfies the requirement numpy==1.21.3 (from versions: 1.3.0, 1.4.1, 1.5.0, 1.5.1, 1.6.0, 1.6.1, 1.6.2, 1.7.0, 1.7.1, 1.7.2, 1.8.0, 1.8.1, 1.8.2, 1.9.0, 1.9.1, 1.9.2, 1.9.3, 1.10.0.post2, 1.10.1, 1.10.2, 1.10.4, 1.11.0, 1.11.1, 1.11.2, 1.11.3, 1.12.0, 1.12.1, 1.13.0, 1.13.1, 1.13.3, 1.14.0, 1.14.1, 1.14.2, 1.14.3, 1.14.4, 1.14.5, 1.14.6, 1.15.0, 1.15.1, 1.15.2, 1.15.3, 1.15.4, 1.16.0, 1.16.1, 1.16.2, 1.16.3, 1.16.4, 1.16.5, 1.16.6, 1.17.0, 1.17.1, 1.17.2, 1.17.3, 1.17.4, 1.17.5, 1.18.0, 1.18.1, 1.18.2, 1.18.3, 1.18.4, 1.18.5, 1.19.0, 1.19.1, 1.19.2, 1.19.3, 1.19.4, 1.19.5, 1.20.0, 1.20.1, 1.20.2, 1.20.3, 1.21.0, 1.21.1, 1.22.0, 1.22.1, 1.22.2, 1.22.3, 1.22.4, 1.23.0rc1, 1.23.0rc2, 1.23.0rc3, 1.23.0, 1.23.1, 1.23.2, 1.23.3, 1.23.4, 1.23.5, 1.24.0rc1, 1.24.0rc2, 1.24.0, 1.24.1, 1.24.2, 1.24.3, 1.24.4, 1.25.0rc1, 1.25.0, 1.25.1, 1.25.2, 1.26.0b1, 1.26.0rc1, 1.26.0, 1.26.1, 1.26.2, 1.26.3, 1.26.4, 2.0.0b1, 2.0.0rc1, 2.0.0rc2)
ERROR: No matching distribution found for numpy==1.21.3
[end of output]

note: This error originates from a subprocess, and is likely not a problem with pip.
error: subprocess-exited-with-error

× pip subprocess to install build dependencies did not run successfully.
│ exit code: 1
╰─> See above for output.

tvalentyn · 2024-05-14T16:49:58Z

According to https://github.com/tensorflow/transform/releases/tag/v1.15.0, Py3.11 support was just added in the release that happened 3 weeks ago.

tvalentyn · 2024-05-14T16:53:03Z

Opened tensorflow/transform#313

tvalentyn · 2024-05-14T21:55:12Z

new error:

_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

checkpoint_file = '/home/runner/.cache/huggingface/hub/models--sentence-transformers--all-mpnet-base-v2/snapshots/84f2bcc00d77236f9e89c8a360a00fb1139bf47d/model.safetensors'
is_quantized = False

    def load_state_dict(checkpoint_file: Union[str, os.PathLike], is_quantized: bool = False):
        """
        Reads a PyTorch checkpoint file, returning properly formatted errors if they arise.
        """
        if checkpoint_file.endswith(".safetensors") and is_safetensors_available():
            # Check format of the archive
>           with safe_open(checkpoint_file, framework="pt") as f:
E           FileNotFoundError: No such file or directory: "/home/runner/.cache/huggingface/hub/models--sentence-transformers--all-mpnet-base-v2/snapshots/84f2bcc00d77236f9e89c8a360a00fb1139bf47d/model.safetensors"

tvalentyn · 2024-05-14T23:12:06Z

possibly a race between test scenarios - looks like using no_xdist has helped.

* Don't install TFT on Python 3.11+ * Add an upper bound to TF due to #31294 . * Run huggingface tests without parallelism: see comments in #31287

tvalentyn added bug failing test awaiting triage labels May 14, 2024

github-actions bot added python tests P2 flake labels May 14, 2024

This was referenced May 14, 2024

Use default Python 3 interpreter, when precise minor version is not specified to gradle. #31282

Draft

Add a subsuite of unit tests for ML package and remove them from 'coverage' GHA workflow. #31255

Merged

tvalentyn added P1 and removed P2 flake labels May 14, 2024

tvalentyn mentioned this issue May 14, 2024

Skip tests using TFT in Beam ML unit test suite on Python 3.11+ #31288

Merged

tvalentyn changed the title ~~[Failing Test]: Pip fails to install apache-beam[gcp]==2.56.0 with tensorflow-transform on Python 3.11~~ [Failing Test]: Beam ML unit test suite fails on Python 3.11 May 14, 2024

jrmccluskey mentioned this issue May 14, 2024

Add ApplyBucketsWithInterpolation TFTransform #31291

Merged

3 tasks

tvalentyn added a commit to tvalentyn/beam that referenced this issue May 14, 2024

Run huggingface tests without parallelism: see comments in apache#31287

9c8fcce

tvalentyn closed this as completed in #31288 May 15, 2024

tvalentyn added a commit that referenced this issue May 15, 2024

Skip tests using TFT in Beam ML unit test suite on Python 3.11+ (#31288)

6de9a60

* Don't install TFT on Python 3.11+ * Add an upper bound to TF due to #31294 . * Run huggingface tests without parallelism: see comments in #31287

github-actions bot added this to the 2.57.0 Release milestone May 15, 2024

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[Failing Test]: Beam ML unit test suite fails on Python 3.11 #31287

[Failing Test]: Beam ML unit test suite fails on Python 3.11 #31287

tvalentyn commented May 14, 2024 •

edited

tvalentyn commented May 14, 2024 •

edited

tvalentyn commented May 14, 2024

tvalentyn commented May 14, 2024

tvalentyn commented May 14, 2024

tvalentyn commented May 14, 2024

[Failing Test]: Beam ML unit test suite fails on Python 3.11 #31287

[Failing Test]: Beam ML unit test suite fails on Python 3.11 #31287

Comments

tvalentyn commented May 14, 2024 • edited

What happened?

Issue Failure

Issue Priority

Issue Components

tvalentyn commented May 14, 2024 • edited

tvalentyn commented May 14, 2024

tvalentyn commented May 14, 2024

tvalentyn commented May 14, 2024

tvalentyn commented May 14, 2024

tvalentyn commented May 14, 2024 •

edited

tvalentyn commented May 14, 2024 •

edited