Spaces:

usm3d

/

S23DR

like 15

Running on CPU Upgrade

Why is the space paused after my submission?

@Siromanec we are updating all previous leaderboard now with a fixed a re-evaluated metrics, you just got unlucky.
The space is expected to go back online in ~1 hour.

Hello, could you please mail me the logs on runs 04d5854d-434a-4cc7-9871-b0971d6fc514, 1ffda7b8-858d-4418-8208-d1733a416fe8, 65758f07-8643-46ce-9a0d-8da12934b4ab? My email: [email protected]

@Siromanec of course, not. The logs reveal too much information and could potentially leak the info about the test set.

However, I can post here some error traces, which hopefully help with debugging.

It seems that there is something wrong with packages on your 04d5854d submission

2024-05-26 20:00:54.203 | INFO     | __main__:generate_submission_file:41 - Generating submission file
Traceback (most recent call last):
  File "/tmp/model/script.py", line 34, in <module>
    import hoho; hoho.setup() # YOU MUST CALL hoho.setup() BEFORE ANYTHING ELSE
ModuleNotFoundError: No module named 'hoho'

1ffda7 finished succesfully.

65758f07 - same as 04d5854d submission

hoho module now is not preinstalled? It is extremely odd that this error did not occur three times in a row. Especially when considering the fact that I did not tweak any of the imports, when comparing to the baseline (or between the three runs).
And now the run identical to 65758f07 is a success?

@Siromanec the hoho module is preinstalled. We do not have a control over the huggingface infrastructure, so some weird stuff is possible. It is also possible, that the 65758f07 has been submitted at the times of the Space restart or something like that. We apologize for possible inconveniences, but, as I said, we do not have control over them.

Any information on 396768ac-d2af-4e66-bf80-c2f4860f0953?
Thanks in advance

@kc92

File "/tmp/model/utils.py", line 6, in
import ipdb
ModuleNotFoundError: No module named 'ipdb'

d6894d8d-e694-4896-a93d-7bbce7a5eb3b

d6894d8d-e694-4896-a93d-7bbce7a5eb3b

Traceback (most recent call last):
  File "/tmp/model/script.py", line 252, in <module>
    pred_vertices, pred_edges = solution_hc(sample)
  File "/tmp/model/script.py", line 222, in solution_hc
    triangulated_corners, triangulated_corner_classes = get_triangulated_corners(gestalt_segmented_images, depth_images, Ks, Rs, ts)
  File "/tmp/model/script.py", line 64, in get_triangulated_corners
    vertices = get_vertices_from_gestalt(gest_seg_np)
  File "/tmp/model/utils.py", line 22, in get_vertices_from_gestalt
    apex_mask = cv2.inRange(gest_seg_np,  apex_color-color_threshold/2, apex_color+color_threshold/2)
cv2.error: OpenCV(4.9.0) :-1: error: (-5:Bad argument) in function 'inRange'
> Overload resolution failed:
>  - src data type = |S41430 is not supported
>  - Expected Ptr<cv::UMat> for argument 'src'

Hi again! Sorry for the trouble but I guess there is no other way of getting to know what's wrong. Seems to work locally.
Info on 6af34f92-4805-4226-8b00-b2aa71e6b737 please!

It looks like all finished well, but the submission.parquet was not generated

2024-05-29 11:44:19.522 | ERROR    | competitions.utils:wrapper:162 - run has failed due to an exception: Traceback (most recent call last):
  File "/app/competitions/utils.py", line 159, in wrapper
    return func(*args, **kwargs)
  File "/app/competitions/evaluate.py", line 122, in run
    generate_submission_file(params)
  File "/app/competitions/evaluate.py", line 83, in generate_submission_file
    api.upload_file(
  File "/app/env/lib/python3.10/site-packages/huggingface_hub/utils/_validators.py", line 118, in _inner_fn
    return fn(*args, **kwargs)
  File "/app/env/lib/python3.10/site-packages/huggingface_hub/hf_api.py", line 1208, in _inner
    return fn(self, *args, **kwargs)
  File "/app/env/lib/python3.10/site-packages/huggingface_hub/hf_api.py", line 4243, in upload_file
    operation = CommitOperationAdd(
  File "<string>", line 5, in __init__
  File "/app/env/lib/python3.10/site-packages/huggingface_hub/_commit_api.py", line 164, in __post_init__
    raise ValueError(f"Provided path: '{path_or_fileobj}' is not a file on the local file system")
ValueError: Provided path: '/tmp/model/submission.parquet' is not a file on the local file system

Any idea why "/tmp/model/submission.parquet" does not exist? Using this part from the sample submission.

May I know the suggested way to install a python package? I guess my recent submissions failed due to missing packages. Thanks.

@kcml it is described in the commented out sections in handcrafted solution example.
https://huggingface.co/usm3d/handcrafted_baseline_submission/blob/main/script.py#L41
In short - you add wheels to your repo, and install from them using example in the script.

You also could request some packages here https://huggingface.co/spaces/usm3d/S23DR/discussions/1 and we will consider adding them to the space ourselves.

@kc92 unfortunately, I cannot help with debugging this. I guess, that the script finished prematurely

@dmytromishkin Added code to install local wheels, but no luck. Would you mind help check the submission ID: e788dbe3-f7ac-4486-b79d-888c6e94ca76

It seems you forgot to do from pathlib import Path
Would mind to check locally first, please?

    pth = str(Path(folder) / package_name)
NameError: name 'Path' is not defined. Did you mean: 'pth'?

could you please check 1c5655cb-d7ef-4de2-88c0-349abb9f51e0 ?
Thanks!

@colin1842

    from handcrafted_solution import predict
                                            ^
IndentationError: unindent does not match any outer indentation level

could you please check this c403c2fa-d16e-4c02-8d64-8965ad8fe3d9 ?
Thanks!

@colin1842

c403c2fa-d16e-4c02-8d64-8965ad8fe3d9

It looks like you are trying to install hoho tools. You don't need to, they are already installed on the test server

Could u check this?
70408be2-e21f-4dda-bf7f-dbe0819a853b

@colin1842

70408be2-e21f-4dda-bf7f-dbe0819a853b

looks like you are trying to install packages by downloading them with pip, but the test server can't connect to the internet. Happy to keep grabbing logs, but could you try disconnecting your computer from the internet and running python script.py? If that's working, but test server fails it is much more likely something on our end :-)

WARNING: Retrying (Retry(total=4, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<pip._vendor.urllib3.connection.HTTPSConnection object at 0x7fd45d8665c0>: Failed to establish a new connection: [Errno 100] Network is down')': 
  ...
WARNING: Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<pip._vendor.urllib3.connection.HTTPSConnection object at 0x7fd45d867b50>: Failed to establish a new connection: [Errno 100] Network is down')': /simple/torch/
ERROR: Could not find a version that satisfies the requirement torch==1.13.1 (from versions: none)
ERROR: No matching distribution found for torch==1.13.1
Failed to download packages. Error: Command '['/app/env/bin/python', '-m', 'pip', 'download', '--platform', 'manylinux1_x86_64', '--python-version', '38', '--only-binary=:all:', '-d', 'packages/torch', 'torch==1.13.1', 'torchvision==0.14.1', 'torchaudio==0.13.1']' returned non-zero exit status 1.
Looking in links: packages/torch/torch
Requirement already satisfied: torch in /app/env/lib/python3.10/site-packages (2.3.0)
Requirement already satisfied: filelock in /app/env/lib/python3.10/site-packages (from torch) (3.13.1)
  ...
Requirement already satisfied: pure-eval in /app/env/lib/python3.10/site-packages (from stack-data->ipython>=6.1.0->ipywidgets>=8.0.4->open3d) (0.2.2)
WARNING: Retrying (Retry(total=4, connect=None, read=None, redirect=None, status=None)) after connection broken by 
  ...
WARNING: Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<pip._vendor.urllib3.connection.HTTPSConnection object at 0x7fda1e8259c0>: Failed to establish a new connection: [Errno 100] Network is down')': /simple/easydict/
ERROR: Could not find a version that satisfies the requirement easydict (from versions: none)
ERROR: No matching distribution found for easydict
Traceback (most recent call last):
  File "/tmp/model/script.py", line 184, in <module>
    setup_environment()
  File "/tmp/model/script.py", line 160, in setup_environment
    subprocess.check_call([sys.executable, "-m", "pip", "install", "easydict"])
  File "/app/env/lib/python3.10/subprocess.py", line 369, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['/app/env/bin/python', '-m', 'pip', 'install', 'easydict']' returned non-zero exit status 1.

thanks for your help, could you please check this?
28a66061-d8be-49db-8fb5-69475b08bc11
and this
3841b447-000f-443b-bef2-aed67b00476f

@colin1842

28a66061-d8be-49db-8fb5-69475b08bc11

Requirement already satisfied: urllib3<3,>=1.21.1 in /app/env/lib/python3.10/site-packages (from requests->dash>=2.6.0->open3d) (2.2.1)
Requirement already satisfied: certifi>=2017.4.17 in /app/env/lib/python3.10/site-packages (from requests->dash>=2.6.0->open3d) (2024.2.2)
Requirement already satisfied: parso<0.9.0,>=0.8.3 in /app/env/lib/python3.10/site-packages (from jedi>=0.16->ipython>=6.1.0->ipywidgets>=8.0.4->open3d) (0.8.4)
Requirement already satisfied: ptyprocess>=0.5 in /app/env/lib/python3.10/site-packages (from pexpect>4.3->ipython>=6.1.0->ipywidgets>=8.0.4->open3d) (0.7.0)
Requirement already satisfied: wcwidth in /app/env/lib/python3.10/site-packages (from prompt-toolkit<3.1.0,>=3.0.41->ipython>=6.1.0->ipywidgets>=8.0.4->open3d) (0.2.13)
Requirement already satisfied: executing>=1.2.0 in /app/env/lib/python3.10/site-packages (from stack-data->ipython>=6.1.0->ipywidgets>=8.0.4->open3d) (2.0.1)
Requirement already satisfied: asttokens>=2.1.0 in /app/env/lib/python3.10/site-packages (from stack-data->ipython>=6.1.0->ipywidgets>=8.0.4->open3d) (2.4.1)
Requirement already satisfied: pure-eval in /app/env/lib/python3.10/site-packages (from stack-data->ipython>=6.1.0->ipywidgets>=8.0.4->open3d) (0.2.2)
Package installed successfully from packages/open3d/open3d
Looking in links: packages/easydict/easydict
WARNING: Location 'packages/easydict/easydict' is ignored: it is either a non-existing path or lacks a specific scheme.
ERROR: Could not find a version that satisfies the requirement easydict (from versions: none)
ERROR: No matching distribution found for easydict
Failed to install package from packages/easydict/easydict. Error: Command '['/app/env/bin/python', '-m', 'pip', 'install', '--no-index', '--find-links', 'packages/easydict/easydict', 'easydict']' returned non-zero exit status 1.
Error: mkl-service + Intel(R) MKL: MKL_THREADING_LAYER=INTEL is incompatible with libgomp.so.1 library.
    Try to import numpy first or set the threading layer accordingly. Set MKL_SERVICE_FORCE_INTEL to force it.
Traceback (most recent call last):
  File "/tmp/model/script.py", line 184, in <module>
    setup_environment()
  File "/tmp/model/script.py", line 166, in setup_environment
    subprocess.check_call([sys.executable, "setup.py", "install"])
  File "/app/env/lib/python3.10/subprocess.py", line 369, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['/app/env/bin/python', 'setup.py', 'install']' returned non-zero exit status 1.
2024-06-03 22:23:03.549 | ERROR    | __main__:generate_submission_file:72 - Subprocess didn't terminate successfully
2024-06-03 22:23:03.549 | INFO     | __main__:generate_submission_file:76 - contents of submission_dir
2024-06-03 22:23:03.549 | INFO     | __main__:generate_submission_file:77 - ['params.json', '.gitattributes', '.gitignore', 'README.md', 'handcrafted_solution.py', 'packages', 'pc_util', 'script.py', 'socket-kit.so', 'data']

3841b447-000f-443b-bef2-aed67b00476f

Requirement already satisfied: pure-eval in /app/env/lib/python3.10/site-packages (from stack-data->ipython>=6.1.0->ipywidgets>=8.0.4->open3d) (0.2.2)
Package installed successfully from packages/open3d
Looking in links: packages/easydict
Processing ./packages/easydict/easydict-1.13-py3-none-any.whl
Installing collected packages: easydict
Successfully installed easydict-1.13
Package installed successfully from packages/easydict
Error: mkl-service + Intel(R) MKL: MKL_THREADING_LAYER=INTEL is incompatible with libgomp.so.1 library.
    Try to import numpy first or set the threading layer accordingly. Set MKL_SERVICE_FORCE_INTEL to force it.
Traceback (most recent call last):
  File "/tmp/model/script.py", line 184, in <module>
    setup_environment()
  File "/tmp/model/script.py", line 166, in setup_environment
    subprocess.check_call([sys.executable, "setup.py", "install"])
  File "/app/env/lib/python3.10/subprocess.py", line 369, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['/app/env/bin/python', 'setup.py', 'install']' returned non-zero exit status 1.
2024-06-03 22:42:56.377 | ERROR    | __main__:generate_submission_file:72 - Subprocess didn't terminate successfully

could u please check 57421595-8b05-4cfa-8aa6-ceb3d8551dd6?

running install
/app/env/lib/python3.10/site-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated.
!!

        ********************************************************************************
        Please avoid running ``setup.py`` directly.
        Instead, use pypa/build, pypa/installer or other
        standards-based tools.

        See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details.
        ********************************************************************************

!!
  self.initialize_options()
/app/env/lib/python3.10/site-packages/setuptools/_distutils/cmd.py:66: EasyInstallDeprecationWarning: easy_install command is deprecated.
!!

        ********************************************************************************
        Please avoid running ``setup.py`` and ``easy_install``.
        Instead, use pypa/build, pypa/installer or other
        standards-based tools.

        See https://github.com/pypa/setuptools/issues/917 for details.
        ********************************************************************************

!!
  self.initialize_options()
running bdist_egg
running egg_info
writing pc_util.egg-info/PKG-INFO
writing dependency_links to pc_util.egg-info/dependency_links.txt
writing top-level names to pc_util.egg-info/top_level.txt
/app/env/lib/python3.10/site-packages/torch/utils/cpp_extension.py:499: UserWarning: Attempted to use ninja as the BuildExtension backend but we could not find ninja.. Falling back to using the slow distutils backend.
  warnings.warn(msg.format('we could not find ninja.'))
reading manifest file 'pc_util.egg-info/SOURCES.txt'
writing manifest file 'pc_util.egg-info/SOURCES.txt'
installing library code to build/bdist.linux-x86_64/egg
running install_lib
running build_ext
/app/env/lib/python3.10/site-packages/torch/utils/cpp_extension.py:428: UserWarning: There are no g++ version bounds defined for CUDA version 12.1
  warnings.warn(f'There are no {compiler_name} version bounds defined for CUDA version {cuda_str_version}')
building 'pc_util' extension
creating build
creating build/temp.linux-x86_64-cpython-310
creating build/temp.linux-x86_64-cpython-310/src
gcc -pthread -B /app/env/compiler_compat -Wno-unused-result -Wsign-compare -DNDEBUG -fwrapv -O2 -Wall -fPIC -O2 -isystem /app/env/include -fPIC -O2 -isystem /app/env/include -fPIC -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c src/ball_query.cpp -o build/temp.linux-x86_64-cpython-310/src/ball_query.o -g -DTORCH_API_INCLUDE_EXTENSION_H -DPYBIND11_COMPILER_TYPE=\"_gcc\" -DPYBIND11_STDLIB=\"_libstdcpp\" -DPYBIND11_BUILD_ABI=\"_cxxabi1011\" -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
src/ball_query.cpp:4:10: fatal error: cuda.h: No such file or directory
    4 | #include <cuda.h>
      |          ^~~~~~~~
compilation terminated.
error: command '/usr/bin/gcc' failed with exit code 1
Traceback (most recent call last):
  File "/tmp/model/script.py", line 188, in <module>
    setup_environment()
  File "/tmp/model/script.py", line 170, in setup_environment
    subprocess.check_call([sys.executable, "setup.py", "install"])
  File "/app/env/lib/python3.10/subprocess.py", line 369, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['/app/env/bin/python', 'setup.py', 'install']' returned non-zero exit status 1.

@colin1842

57421595-8b05-4cfa-8aa6-ceb3d8551dd6

running install
/app/env/lib/python3.10/site-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated.
!!

        ********************************************************************************
        Please avoid running ``setup.py`` directly.
        Instead, use pypa/build, pypa/installer or other
        standards-based tools.

        See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details.
        ********************************************************************************

!!
  self.initialize_options()
/app/env/lib/python3.10/site-packages/setuptools/_distutils/cmd.py:66: EasyInstallDeprecationWarning: easy_install command is deprecated.
!!

        ********************************************************************************
        Please avoid running ``setup.py`` and ``easy_install``.
        Instead, use pypa/build, pypa/installer or other
        standards-based tools.

        See https://github.com/pypa/setuptools/issues/917 for details.
        ********************************************************************************

!!
  self.initialize_options()
running bdist_egg
running egg_info
writing pc_util.egg-info/PKG-INFO
writing dependency_links to pc_util.egg-info/dependency_links.txt
writing top-level names to pc_util.egg-info/top_level.txt
/app/env/lib/python3.10/site-packages/torch/utils/cpp_extension.py:499: UserWarning: Attempted to use ninja as the BuildExtension backend but we could not find ninja.. Falling back to using the slow distutils backend.
  warnings.warn(msg.format('we could not find ninja.'))
reading manifest file 'pc_util.egg-info/SOURCES.txt'
writing manifest file 'pc_util.egg-info/SOURCES.txt'
installing library code to build/bdist.linux-x86_64/egg
running install_lib
running build_ext
/app/env/lib/python3.10/site-packages/torch/utils/cpp_extension.py:428: UserWarning: There are no g++ version bounds defined for CUDA version 12.1
  warnings.warn(f'There are no {compiler_name} version bounds defined for CUDA version {cuda_str_version}')
building 'pc_util' extension
creating build
creating build/temp.linux-x86_64-cpython-310
creating build/temp.linux-x86_64-cpython-310/src
gcc -pthread -B /app/env/compiler_compat -Wno-unused-result -Wsign-compare -DNDEBUG -fwrapv -O2 -Wall -fPIC -O2 -isystem /app/env/include -fPIC -O2 -isystem /app/env/include -fPIC -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c src/ball_query.cpp -o build/temp.linux-x86_64-cpython-310/src/ball_query.o -g -DTORCH_API_INCLUDE_EXTENSION_H -DPYBIND11_COMPILER_TYPE=\"_gcc\" -DPYBIND11_STDLIB=\"_libstdcpp\" -DPYBIND11_BUILD_ABI=\"_cxxabi1011\" -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
src/ball_query.cpp:4:10: fatal error: cuda.h: No such file or directory
    4 | #include <cuda.h>
      |          ^~~~~~~~
compilation terminated.
error: command '/usr/bin/gcc' failed with exit code 1
Traceback (most recent call last):
  File "/tmp/model/script.py", line 188, in <module>
    setup_environment()
  File "/tmp/model/script.py", line 170, in setup_environment
    subprocess.check_call([sys.executable, "setup.py", "install"])
  File "/app/env/lib/python3.10/subprocess.py", line 369, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['/app/env/bin/python', 'setup.py', 'install']' returned non-zero exit status 1.
2024-06-06 14:42:16.150 | ERROR    | __main__:generate_submission_file:72 - Subprocess didn't terminate successfully
2024-06-06 14:42:16.150 | INFO     | __main__:generate_submission_file:76 - contents of submission_dir
2024-06-06 14:42:16.150 | INFO     | __main__:generate_submission_file:77 - ['params.json', '.gitattributes', '.gitignore', 'README.md', 'handcrafted_solution.py', 'packages', 'pc_util', 'script.py', 'socket-kit.so', 'data']
2024-06-06 14:42:16.150 | INFO     | __main__:generate_submission_file:81 - Uploading submission.parquet to the repository
2024-06-06 14:42:16.152 | ERROR    | competitions.utils:wrapper:162 - run has failed due to an exception: Traceback (most recent call last):

If you want you can also post a list of packages you want in https://huggingface.co/spaces/usm3d/S23DR/discussions/1 and we can add them to the shared requirements.txt.

Help on d722e82f-bfa0-4942-a50b-cb7a6bd792e5 please. Nevermind, found a bug.

And also on d226a0c7-d678-4133-9512-22b8d73a8286 please? Nevermind, found a bug.

Could you please check
859d4cdf-8163-4fc3-bc45-0549bda42215 ?
Thanks!

@kc92 ok, you're good? no logs needed?

@colin1842

859d4cdf-8163-4fc3-bc45-0549bda42215

Requirement already satisfied: pure-eval in /app/env/lib/python3.10/site-packages (from stack-data->ipython>=6.1.0->ipywidgets>=8.0.4->open3d) (0.2.2)
Package installed successfully from packages/open3d
Looking in links: packages/easydict
Processing ./packages/easydict/easydict-1.13-py3-none-any.whl
Installing collected packages: easydict
Successfully installed easydict-1.13
Package installed successfully from packages/easydict
running install
/app/env/lib/python3.10/site-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated.
!!

        ********************************************************************************
        Please avoid running ``setup.py`` directly.
        Instead, use pypa/build, pypa/installer or other
        standards-based tools.

        See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details.
        ********************************************************************************

!!
  self.initialize_options()
/app/env/lib/python3.10/site-packages/setuptools/_distutils/cmd.py:66: EasyInstallDeprecationWarning: easy_install command is deprecated.
!!

        ********************************************************************************
        Please avoid running ``setup.py`` and ``easy_install``.
        Instead, use pypa/build, pypa/installer or other
        standards-based tools.

        See https://github.com/pypa/setuptools/issues/917 for details.
        ********************************************************************************

!!
  self.initialize_options()
running bdist_egg
running egg_info
writing pc_util.egg-info/PKG-INFO
writing dependency_links to pc_util.egg-info/dependency_links.txt
writing top-level names to pc_util.egg-info/top_level.txt
/app/env/lib/python3.10/site-packages/torch/utils/cpp_extension.py:499: UserWarning: Attempted to use ninja as the BuildExtension backend but we could not find ninja.. Falling back to using the slow distutils backend.
  warnings.warn(msg.format('we could not find ninja.'))
reading manifest file 'pc_util.egg-info/SOURCES.txt'
writing manifest file 'pc_util.egg-info/SOURCES.txt'
installing library code to build/bdist.linux-x86_64/egg
running install_lib
running build_ext
/app/env/lib/python3.10/site-packages/torch/utils/cpp_extension.py:428: UserWarning: There are no g++ version bounds defined for CUDA version 12.1
  warnings.warn(f'There are no {compiler_name} version bounds defined for CUDA version {cuda_str_version}')
building 'pc_util' extension
creating build/temp.linux-x86_64-cpython-310
creating build/temp.linux-x86_64-cpython-310/src
gcc -pthread -B /app/env/compiler_compat -Wno-unused-result -Wsign-compare -DNDEBUG -fwrapv -O2 -Wall -fPIC -O2 -isystem /app/env/include -fPIC -O2 -isystem /app/env/include -fPIC -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c src/ball_query.cpp -o build/temp.linux-x86_64-cpython-310/src/ball_query.o -g -DTORCH_API_INCLUDE_EXTENSION_H -DPYBIND11_COMPILER_TYPE=\"_gcc\" -DPYBIND11_STDLIB=\"_libstdcpp\" -DPYBIND11_BUILD_ABI=\"_cxxabi1011\" -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
src/ball_query.cpp:4:10: fatal error: cuda.h: No such file or directory
    4 | #include <cuda.h>
      |          ^~~~~~~~
compilation terminated.
error: command '/usr/bin/gcc' failed with exit code 1
Traceback (most recent call last):

@jacklangerman Can you please provide help on a0622754-2174-4b2c-ba97-884ea77a2392? Seems like it processed the whole set but failed later? Thanks!

@colin1842

859d4cdf-8163-4fc3-bc45-0549bda42215

Requirement already satisfied: pure-eval in /app/env/lib/python3.10/site-packages (from stack-data->ipython>=6.1.0->ipywidgets>=8.0.4->open3d) (0.2.2)
Package installed successfully from packages/open3d
Looking in links: packages/easydict
Processing ./packages/easydict/easydict-1.13-py3-none-any.whl
Installing collected packages: easydict
Successfully installed easydict-1.13
Package installed successfully from packages/easydict
running install
/app/env/lib/python3.10/site-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated.
!!

        ********************************************************************************
        Please avoid running ``setup.py`` directly.
        Instead, use pypa/build, pypa/installer or other
        standards-based tools.

        See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details.
        ********************************************************************************

!!
  self.initialize_options()
/app/env/lib/python3.10/site-packages/setuptools/_distutils/cmd.py:66: EasyInstallDeprecationWarning: easy_install command is deprecated.
!!

        ********************************************************************************
        Please avoid running ``setup.py`` and ``easy_install``.
        Instead, use pypa/build, pypa/installer or other
        standards-based tools.

        See https://github.com/pypa/setuptools/issues/917 for details.
        ********************************************************************************

!!
  self.initialize_options()
running bdist_egg
running egg_info
writing pc_util.egg-info/PKG-INFO
writing dependency_links to pc_util.egg-info/dependency_links.txt
writing top-level names to pc_util.egg-info/top_level.txt
/app/env/lib/python3.10/site-packages/torch/utils/cpp_extension.py:499: UserWarning: Attempted to use ninja as the BuildExtension backend but we could not find ninja.. Falling back to using the slow distutils backend.
  warnings.warn(msg.format('we could not find ninja.'))
reading manifest file 'pc_util.egg-info/SOURCES.txt'
writing manifest file 'pc_util.egg-info/SOURCES.txt'
installing library code to build/bdist.linux-x86_64/egg
running install_lib
running build_ext
/app/env/lib/python3.10/site-packages/torch/utils/cpp_extension.py:428: UserWarning: There are no g++ version bounds defined for CUDA version 12.1
  warnings.warn(f'There are no {compiler_name} version bounds defined for CUDA version {cuda_str_version}')
building 'pc_util' extension
creating build/temp.linux-x86_64-cpython-310
creating build/temp.linux-x86_64-cpython-310/src
gcc -pthread -B /app/env/compiler_compat -Wno-unused-result -Wsign-compare -DNDEBUG -fwrapv -O2 -Wall -fPIC -O2 -isystem /app/env/include -fPIC -O2 -isystem /app/env/include -fPIC -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c src/ball_query.cpp -o build/temp.linux-x86_64-cpython-310/src/ball_query.o -g -DTORCH_API_INCLUDE_EXTENSION_H -DPYBIND11_COMPILER_TYPE=\"_gcc\" -DPYBIND11_STDLIB=\"_libstdcpp\" -DPYBIND11_BUILD_ABI=\"_cxxabi1011\" -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
src/ball_query.cpp:4:10: fatal error: cuda.h: No such file or directory
    4 | #include <cuda.h>
      |          ^~~~~~~~
compilation terminated.
error: command '/usr/bin/gcc' failed with exit code 1
Traceback (most recent call last):

should we install the cuda ourselves? or the system can provide which version of cuda?

@colin1842

you don't need to install cuda: your solution runs on a T4 with CUDA Version 12.1.1 pre-installed.

the start of the logs look like this:

===== Application Startup at 2024-06-07 14:01:55 =====


==========
== CUDA ==
==========

CUDA Version 12.1.1

Container image Copyright (c) 2016-2023, NVIDIA CORPORATION & AFFILIATES. All rights reserved.

This container image and its contents are governed by the NVIDIA Deep Learning Container License.
By pulling and using the container, you accept the terms and conditions of this license:
https://developer.nvidia.com/ngc/nvidia-deep-learning-container-license

A copy of this license is made available in this container at /NGC-DL-CONTAINER-LICENSE for your convenience.

INFO:     Started server process [34]
INFO:     Waiting for application startup.
2024-06-07 14:04:46.739 | INFO     | competitions.utils:run_evaluation:81 - ['python', '-m', 'competitions.evaluate', '--config', '/tmp/model/params.json']

@jacklangerman Can you please provide help on a0622754-2174-4b2c-ba97-884ea77a2392? Seems like it processed the whole set but failed later? Thanks!

Anything on this?

@jacklangerman Can you please provide help on a0622754-2174-4b2c-ba97-884ea77a2392? Seems like it processed the whole set but failed later? Thanks!

@jacklangerman Is there something potentially test set revealing about the logs? Wondering as I haven’t heard back and was looking for a direction to debug. Thanks in advance!

@kc92

@jacklangerman Can you please provide help on a0622754-2174-4b2c-ba97-884ea77a2392? Seems like it processed the whole set but failed later? Thanks!

@jacklangerman Is there something potentially test set revealing about the logs? Wondering as I haven’t heard back and was looking for a direction to debug. Thanks in advance!

Apologies for the delay.

The solution was crashing because at least one predicted wireframe had zero edges. There was some internal discussion about whether the solution dying as as a result of this was correct / expected.

the failure was the result of trying to np.stack(...) an empty array (a sample with zero edges).

We have decided to update the evaluation harness to use np.zeros(shape=(0,2)) when a zero length edge array is passed. We have manually re-run your solution.

@jacklangerman Thanks a lot for the clarification! I was checking these corner cases by submitting partially connected graphs and those with no edges :)

could you please check this?
fab377f2-09bc-4592-93f8-b6214e5869fa
could you please indicate the cuda home path?

@colin1842

you're making progress :-)
looks like ninja now (I'll add this to our requirements.txt now -- see here)

...
pc_util/src/sampling.cpp:   0%|          | 0.00/1.51k [00:00<?, ?B/s]
pc_util/src/sampling.cpp: 100%|██████████| 1.51k/1.51k [00:00<00:00, 8.59MB/s]
pc_util/src/sampling_gpu.cu:   0%|          | 0.00/8.13k [00:00<?, ?B/s]
pc_util/src/sampling_gpu.cu: 100%|██████████| 8.13k/8.13k [00:00<00:00, 32.1MB/s]
pc_util/src/sampling_gpu.h:   0%|          | 0.00/1.03k [00:00<?, ?B/s]
pc_util/src/sampling_gpu.h: 100%|██████████| 1.03k/1.03k [00:00<00:00, 6.02MB/s]
script.py:   0%|          | 0.00/10.5k [00:00<?, ?B/s]
script.py: 100%|██████████| 10.5k/10.5k [00:00<00:00, 47.5MB/s]
2024-06-07 20:23:27.931 | INFO     | __main__:generate_submission_file:41 - Generating submission file
/tmp/model
...
WARNING: Retrying (Retry(total=4, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<pip._vendor.urllib3.connection.HTTPSConnection object at 0x7f51cc8b1120>: Failed to establish a new connection: [Errno 100] Network is down')': /simple/ninja/
WARNING: Retrying (Retry(total=3, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<pip._vendor.urllib3.connection.HTTPSConnection object at 0x7f51cc8b12d0>: Failed to establish a new connection: [Errno 100] Network is down')': /simple/ninja/
WARNING: Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<pip._vendor.urllib3.connection.HTTPSConnection object at 0x7f51cc8b1870>: Failed to establish a new connection: [Errno 100] Network is down')': /simple/ninja/
WARNING: Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<pip._vendor.urllib3.connection.HTTPSConnection object at 0x7f51cc8b1a20>: Failed to establish a new connection: [Errno 100] Network is down')': /simple/ninja/
WARNING: Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<pip._vendor.urllib3.connection.HTTPSConnection object at 0x7f51cc8b1bd0>: Failed to establish a new connection: [Errno 100] Network is down')': /simple/ninja/
ERROR: Could not find a version that satisfies the requirement ninja (from versions: none)
ERROR: No matching distribution found for ninja
Traceback (most recent call last):
  File "/tmp/model/script.py", line 224, in <module>
    setup_environment()
  File "/tmp/model/script.py", line 174, in setup_environment
    subprocess.check_call([sys.executable, "-m", "pip", "install", "ninja"])
  File "/app/env/lib/python3.10/subprocess.py", line 369, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['/app/env/bin/python', '-m', 'pip', 'install', 'ninja']' returned non-zero exit status 1.

Regarding CUDA: that is handled by the HF team at the space level: you get the same environment as if you just create a new space yourself with a T4 (unless there is some special difference I'm unaware of: tagging @abhishek just in case).

and could you please check this?
c9b80b3d-6c96-4dc9-b174-b4315c4968b2

@colin1842

c9b80b3d-6c96-4dc9-b174-b4315c4968b2

Package installed successfully from packages/easydict
Error: mkl-service + Intel(R) MKL: MKL_THREADING_LAYER=INTEL is incompatible with libgomp.so.1 library.
    Try to import numpy first or set the threading layer accordingly. Set MKL_SERVICE_FORCE_INTEL to force it.
running install
/app/env/lib/python3.10/site-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated.
!!

        ********************************************************************************
        Please avoid running ``setup.py`` directly.
        Instead, use pypa/build, pypa/installer or other
        standards-based tools.

        See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details.
        ********************************************************************************

!!
  self.initialize_options()
/app/env/lib/python3.10/site-packages/setuptools/_distutils/cmd.py:66: EasyInstallDeprecationWarning: easy_install command is deprecated.
!!

        ********************************************************************************
        Please avoid running ``setup.py`` and ``easy_install``.
        Instead, use pypa/build, pypa/installer or other
        standards-based tools.

        See https://github.com/pypa/setuptools/issues/917 for details.
        ********************************************************************************

!!
  self.initialize_options()
running bdist_egg
running egg_info
writing pc_util.egg-info/PKG-INFO
writing dependency_links to pc_util.egg-info/dependency_links.txt
writing top-level names to pc_util.egg-info/top_level.txt
reading manifest file 'pc_util.egg-info/SOURCES.txt'
writing manifest file 'pc_util.egg-info/SOURCES.txt'
installing library code to build/bdist.linux-x86_64/egg
running install_lib
running build_ext
/app/env/lib/python3.10/site-packages/torch/utils/cpp_extension.py:428: UserWarning: There are no g++ version bounds defined for CUDA version 12.1
  warnings.warn(f'There are no {compiler_name} version bounds defined for CUDA version {cuda_str_version}')
building 'pc_util' extension
creating /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310
creating /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src
/app/env/lib/python3.10/site-packages/torch/utils/cpp_extension.py:1967: UserWarning: TORCH_CUDA_ARCH_LIST is not set, all archs for visible cards are included for compilation. 
If this is not desired, please set os.environ['TORCH_CUDA_ARCH_LIST'].
  warnings.warn(
Emitting ninja build file /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/build.ninja...
Compiling objects...
Allowing ninja to set a default number of workers... (overridable by setting the environment variable MAX_JOBS=N)
[1/11] /app/env/bin/nvcc --generate-dependencies-with-compile --dependency-output /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/cluster_gpu.o.d -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c -c /tmp/model/pc_util/src/cluster_gpu.cu -o /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/cluster_gpu.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -O2 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_75,code=compute_75 -gencode=arch=compute_75,code=sm_75 -std=c++17
FAILED: /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/cluster_gpu.o 
/app/env/bin/nvcc --generate-dependencies-with-compile --dependency-output /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/cluster_gpu.o.d -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c -c /tmp/model/pc_util/src/cluster_gpu.cu -o /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/cluster_gpu.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -O2 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_75,code=compute_75 -gencode=arch=compute_75,code=sm_75 -std=c++17
<command-line>: fatal error: cuda_runtime.h: No such file or directory
compilation terminated.
[2/11] /app/env/bin/nvcc --generate-dependencies-with-compile --dependency-output /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/ball_query_gpu.o.d -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c -c /tmp/model/pc_util/src/ball_query_gpu.cu -o /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/ball_query_gpu.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -O2 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_75,code=compute_75 -gencode=arch=compute_75,code=sm_75 -std=c++17
FAILED: /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/ball_query_gpu.o 
/app/env/bin/nvcc --generate-dependencies-with-compile --dependency-output /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/ball_query_gpu.o.d -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c -c /tmp/model/pc_util/src/ball_query_gpu.cu -o /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/ball_query_gpu.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -O2 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_75,code=compute_75 -gencode=arch=compute_75,code=sm_75 -std=c++17
<command-line>: fatal error: cuda_runtime.h: No such file or directory
compilation terminated.
[3/11] /app/env/bin/nvcc --generate-dependencies-with-compile --dependency-output /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/interpolate_gpu.o.d -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c -c /tmp/model/pc_util/src/interpolate_gpu.cu -o /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/interpolate_gpu.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -O2 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_75,code=compute_75 -gencode=arch=compute_75,code=sm_75 -std=c++17
FAILED: /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/interpolate_gpu.o 
/app/env/bin/nvcc --generate-dependencies-with-compile --dependency-output /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/interpolate_gpu.o.d -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c -c /tmp/model/pc_util/src/interpolate_gpu.cu -o /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/interpolate_gpu.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -O2 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_75,code=compute_75 -gencode=arch=compute_75,code=sm_75 -std=c++17
<command-line>: fatal error: cuda_runtime.h: No such file or directory
compilation terminated.
[4/11] /app/env/bin/nvcc --generate-dependencies-with-compile --dependency-output /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/group_points_gpu.o.d -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c -c /tmp/model/pc_util/src/group_points_gpu.cu -o /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/group_points_gpu.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -O2 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_75,code=compute_75 -gencode=arch=compute_75,code=sm_75 -std=c++17
FAILED: /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/group_points_gpu.o 
/app/env/bin/nvcc --generate-dependencies-with-compile --dependency-output /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/group_points_gpu.o.d -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c -c /tmp/model/pc_util/src/group_points_gpu.cu -o /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/group_points_gpu.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -O2 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_75,code=compute_75 -gencode=arch=compute_75,code=sm_75 -std=c++17
<command-line>: fatal error: cuda_runtime.h: No such file or directory
compilation terminated.
[5/11] c++ -MMD -MF /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/cluster.o.d -pthread -B /app/env/compiler_compat -Wno-unused-result -Wsign-compare -DNDEBUG -fwrapv -O2 -Wall -fPIC -O2 -isystem /app/env/include -fPIC -O2 -isystem /app/env/include -fPIC -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c -c /tmp/model/pc_util/src/cluster.cpp -o /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/cluster.o -g -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
FAILED: /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/cluster.o 
c++ -MMD -MF /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/cluster.o.d -pthread -B /app/env/compiler_compat -Wno-unused-result -Wsign-compare -DNDEBUG -fwrapv -O2 -Wall -fPIC -O2 -isystem /app/env/include -fPIC -O2 -isystem /app/env/include -fPIC -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c -c /tmp/model/pc_util/src/cluster.cpp -o /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/cluster.o -g -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
/tmp/model/pc_util/src/cluster.cpp:4:10: fatal error: cuda.h: No such file or directory
    4 | #include <cuda.h>
      |          ^~~~~~~~
compilation terminated.
[6/11] c++ -MMD -MF /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/ball_query.o.d -pthread -B /app/env/compiler_compat -Wno-unused-result -Wsign-compare -DNDEBUG -fwrapv -O2 -Wall -fPIC -O2 -isystem /app/env/include -fPIC -O2 -isystem /app/env/include -fPIC -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c -c /tmp/model/pc_util/src/ball_query.cpp -o /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/ball_query.o -g -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
FAILED: /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/ball_query.o 
c++ -MMD -MF /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/ball_query.o.d -pthread -B /app/env/compiler_compat -Wno-unused-result -Wsign-compare -DNDEBUG -fwrapv -O2 -Wall -fPIC -O2 -isystem /app/env/include -fPIC -O2 -isystem /app/env/include -fPIC -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c -c /tmp/model/pc_util/src/ball_query.cpp -o /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/ball_query.o -g -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
/tmp/model/pc_util/src/ball_query.cpp:4:10: fatal error: cuda.h: No such file or directory
    4 | #include <cuda.h>
      |          ^~~~~~~~
compilation terminated.
[7/11] c++ -MMD -MF /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/group_points.o.d -pthread -B /app/env/compiler_compat -Wno-unused-result -Wsign-compare -DNDEBUG -fwrapv -O2 -Wall -fPIC -O2 -isystem /app/env/include -fPIC -O2 -isystem /app/env/include -fPIC -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c -c /tmp/model/pc_util/src/group_points.cpp -o /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/group_points.o -g -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
FAILED: /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/group_points.o 
c++ -MMD -MF /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/group_points.o.d -pthread -B /app/env/compiler_compat -Wno-unused-result -Wsign-compare -DNDEBUG -fwrapv -O2 -Wall -fPIC -O2 -isystem /app/env/include -fPIC -O2 -isystem /app/env/include -fPIC -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c -c /tmp/model/pc_util/src/group_points.cpp -o /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/group_points.o -g -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
/tmp/model/pc_util/src/group_points.cpp:2:10: fatal error: cuda.h: No such file or directory
    2 | #include <cuda.h>
      |          ^~~~~~~~
compilation terminated.
[8/11] c++ -MMD -MF /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/interpolate.o.d -pthread -B /app/env/compiler_compat -Wno-unused-result -Wsign-compare -DNDEBUG -fwrapv -O2 -Wall -fPIC -O2 -isystem /app/env/include -fPIC -O2 -isystem /app/env/include -fPIC -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c -c /tmp/model/pc_util/src/interpolate.cpp -o /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/interpolate.o -g -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
FAILED: /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/interpolate.o 
c++ -MMD -MF /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/interpolate.o.d -pthread -B /app/env/compiler_compat -Wno-unused-result -Wsign-compare -DNDEBUG -fwrapv -O2 -Wall -fPIC -O2 -isystem /app/env/include -fPIC -O2 -isystem /app/env/include -fPIC -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c -c /tmp/model/pc_util/src/interpolate.cpp -o /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/interpolate.o -g -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
/tmp/model/pc_util/src/interpolate.cpp:7:10: fatal error: cuda.h: No such file or directory
    7 | #include <cuda.h>
      |          ^~~~~~~~
compilation terminated.
[9/11] c++ -MMD -MF /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/pointnet2_api.o.d -pthread -B /app/env/compiler_compat -Wno-unused-result -Wsign-compare -DNDEBUG -fwrapv -O2 -Wall -fPIC -O2 -isystem /app/env/include -fPIC -O2 -isystem /app/env/include -fPIC -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c -c /tmp/model/pc_util/src/pointnet2_api.cpp -o /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/pointnet2_api.o -g -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
FAILED: /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/pointnet2_api.o 
c++ -MMD -MF /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/pointnet2_api.o.d -pthread -B /app/env/compiler_compat -Wno-unused-result -Wsign-compare -DNDEBUG -fwrapv -O2 -Wall -fPIC -O2 -isystem /app/env/include -fPIC -O2 -isystem /app/env/include -fPIC -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c -c /tmp/model/pc_util/src/pointnet2_api.cpp -o /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/pointnet2_api.o -g -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
In file included from /tmp/model/pc_util/src/pointnet2_api.cpp:4:
/tmp/model/pc_util/src/ball_query_gpu.h:6:10: fatal error: cuda.h: No such file or directory
    6 | #include <cuda.h>
      |          ^~~~~~~~
compilation terminated.
ninja: build stopped: subcommand failed.
Traceback (most recent call last):
  File "/app/env/lib/python3.10/site-packages/torch/utils/cpp_extension.py", line 2107, in _run_ninja_build
    subprocess.run(
  File "/app/env/lib/python3.10/subprocess.py", line 526, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['ninja', '-v']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/tmp/model/pc_util/setup.py", line 4, in <module>
    setup(
  File "/app/env/lib/python3.10/site-packages/setuptools/__init__.py", line 104, in setup
    return distutils.core.setup(**attrs)
  File "/app/env/lib/python3.10/site-packages/setuptools/_distutils/core.py", line 184, in setup
    return run_commands(dist)
  File "/app/env/lib/python3.10/site-packages/setuptools/_distutils/core.py", line 200, in run_commands
    dist.run_commands()
  File "/app/env/lib/python3.10/site-packages/setuptools/_distutils/dist.py", line 969, in run_commands
    self.run_command(cmd)
  File "/app/env/lib/python3.10/site-packages/setuptools/dist.py", line 967, in run_command
    super().run_command(command)
  File "/app/env/lib/python3.10/site-packages/setuptools/_distutils/dist.py", line 988, in run_command
    cmd_obj.run()
  File "/app/env/lib/python3.10/site-packages/setuptools/command/install.py", line 87, in run
    self.do_egg_install()
  File "/app/env/lib/python3.10/site-packages/setuptools/command/install.py", line 139, in do_egg_install
    self.run_command('bdist_egg')
  File "/app/env/lib/python3.10/site-packages/setuptools/_distutils/cmd.py", line 316, in run_command
    self.distribution.run_command(command)
  File "/app/env/lib/python3.10/site-packages/setuptools/dist.py", line 967, in run_command
    super().run_command(command)
  File "/app/env/lib/python3.10/site-packages/setuptools/_distutils/dist.py", line 988, in run_command
    cmd_obj.run()
  File "/app/env/lib/python3.10/site-packages/setuptools/command/bdist_egg.py", line 167, in run
    cmd = self.call_command('install_lib', warn_dir=0)
  File "/app/env/lib/python3.10/site-packages/setuptools/command/bdist_egg.py", line 153, in call_command
    self.run_command(cmdname)
  File "/app/env/lib/python3.10/site-packages/setuptools/_distutils/cmd.py", line 316, in run_command
    self.distribution.run_command(command)
  File "/app/env/lib/python3.10/site-packages/setuptools/dist.py", line 967, in run_command
    super().run_command(command)
  File "/app/env/lib/python3.10/site-packages/setuptools/_distutils/dist.py", line 988, in run_command
    cmd_obj.run()
  File "/app/env/lib/python3.10/site-packages/setuptools/command/install_lib.py", line 11, in run
    self.build()
  File "/app/env/lib/python3.10/site-packages/setuptools/_distutils/command/install_lib.py", line 110, in build
    self.run_command('build_ext')
  File "/app/env/lib/python3.10/site-packages/setuptools/_distutils/cmd.py", line 316, in run_command
    self.distribution.run_command(command)
  File "/app/env/lib/python3.10/site-packages/setuptools/dist.py", line 967, in run_command
    super().run_command(command)
  File "/app/env/lib/python3.10/site-packages/setuptools/_distutils/dist.py", line 988, in run_command
    cmd_obj.run()
  File "/app/env/lib/python3.10/site-packages/setuptools/command/build_ext.py", line 91, in run
    _build_ext.run(self)
  File "/app/env/lib/python3.10/site-packages/setuptools/_distutils/command/build_ext.py", line 359, in run
    self.build_extensions()
  File "/app/env/lib/python3.10/site-packages/torch/utils/cpp_extension.py", line 870, in build_extensions
    build_ext.build_extensions(self)
  File "/app/env/lib/python3.10/site-packages/setuptools/_distutils/command/build_ext.py", line 479, in build_extensions
    self._build_extensions_serial()
  File "/app/env/lib/python3.10/site-packages/setuptools/_distutils/command/build_ext.py", line 505, in _build_extensions_serial
    self.build_extension(ext)
  File "/app/env/lib/python3.10/site-packages/setuptools/command/build_ext.py", line 252, in build_extension
    _build_ext.build_extension(self, ext)
  File "/app/env/lib/python3.10/site-packages/setuptools/_distutils/command/build_ext.py", line 560, in build_extension
    objects = self.compiler.compile(
  File "/app/env/lib/python3.10/site-packages/torch/utils/cpp_extension.py", line 683, in unix_wrap_ninja_compile
    _write_ninja_file_and_compile_objects(
  File "/app/env/lib/python3.10/site-packages/torch/utils/cpp_extension.py", line 1783, in _write_ninja_file_and_compile_objects
    _run_ninja_build(
  File "/app/env/lib/python3.10/site-packages/torch/utils/cpp_extension.py", line 2123, in _run_ninja_build
    raise RuntimeError(message) from e
RuntimeError: Error compiling objects for extension
Traceback (most recent call last):
  File "/tmp/model/script.py", line 224, in <module>
    setup_environment()
  File "/tmp/model/script.py", line 197, in setup_environment
    subprocess.check_call([sys.executable, "setup.py", "install"])
  File "/app/env/lib/python3.10/subprocess.py", line 369, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['/app/env/bin/python', 'setup.py', 'install']' returned non-zero exit status 1.
2024-06-07 20:40:04.869 | ERROR    | __main__:generate_submission_file:72 - Subprocess didn't terminate successfully

Thank you for your assistance! Could you check this?
7c3a7b91-78d1-4054-80bb-1d8f792d2416

@colin1842

7c3a7b91-78d1-4054-80bb-1d8f792d2416

Found existing installation: torch 2.3.0
Uninstalling torch-2.3.0:
  Successfully uninstalled torch-2.3.0
Package torch uninstalled successfully
Found existing installation: torchvision 0.18.0
Uninstalling torchvision-0.18.0:
  Successfully uninstalled torchvision-0.18.0
Package torchvision uninstalled successfully
Found existing installation: torchaudio 2.3.0
Uninstalling torchaudio-2.3.0:
  Successfully uninstalled torchaudio-2.3.0
Package torchaudio uninstalled successfully
Looking in links: packages/torch
ERROR: Could not find a version that satisfies the requirement torch (from versions: none)
ERROR: No matching distribution found for torch
Failed to install package from packages/torch. Error: Command '['/app/env/bin/python', '-m', 'pip', 'install', '--no-index', '--find-links', 'packages/torch', 'torch']' returned non-zero exit status 1.
Looking in links: packages/torch/packages/torch/torchvision-0.16.0-cp38-cp38-manylinux1_x86_64.whl
ERROR: torchvision-0.16.0-cp38-cp38-manylinux1_x86_64.whl is not a supported wheel on this platform.
Failed to install package from packages/torch/packages/torch/torchvision-0.16.0-cp38-cp38-manylinux1_x86_64.whl. Error: Command '['/app/env/bin/python', '-m', 'pip', 'install', '--no-index', '--find-links', 'packages/torch/packages/torch/torchvision-0.16.0-cp38-cp38-manylinux1_x86_64.whl', 'packages/torch/torchvision-0.16.0-cp38-cp38-manylinux1_x86_64.whl']' returned non-zero exit status 1.
Looking in links: packages/torch/packages/torch/torchaudio-2.1.0-cp38-cp38-manylinux1_x86_64.whl
ERROR: torchaudio-2.1.0-cp38-cp38-manylinux1_x86_64.whl is not a supported wheel on this platform.
Failed to install package from packages/torch/packages/torch/torchaudio-2.1.0-cp38-cp38-manylinux1_x86_64.whl. Error: Command '['/app/env/bin/python', '-m', 'pip', 'install', '--no-index', '--find-links', 'packages/torch/packages/torch/torchaudio-2.1.0-cp38-cp38-manylinux1_x86_64.whl', 'packages/torch/torchaudio-2.1.0-cp38-cp38-manylinux1_x86_64.whl']' returned non-zero exit status 1.
Looking in links: packages/easydict
Processing ./packages/easydict/easydict-1.13-py3-none-any.whl
Installing collected packages: easydict
Successfully installed easydict-1.13
Package installed successfully from packages/easydict
Looking in links: packages/setuptools
Requirement already satisfied: setuptools in /app/env/lib/python3.10/site-packages (69.5.1)
Package installed successfully from packages/setuptools
Traceback (most recent call last):
  File "/tmp/model/pc_util/setup.py", line 2, in <module>
    from torch.utils.cpp_extension import BuildExtension, CUDAExtension
ModuleNotFoundError: No module named 'torch'
Traceback (most recent call last):
  File "/tmp/model/script.py", line 241, in <module>
    setup_environment()
  File "/tmp/model/script.py", line 214, in setup_environment
    subprocess.check_call([sys.executable, "setup.py", "install"])
  File "/app/env/lib/python3.10/subprocess.py", line 369, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['/app/env/bin/python', 'setup.py', 'install']' returned non-zero exit status 1.
2024-06-07 21:01:56.356 | ERROR    | __main__:generate_submission_file:72 - Subprocess didn't terminate successfully

could you please check this?
06b1c4ff-d8a1-4f25-9057-197628e8e802 and
26d4bfe2-f626-4b05-9b66-6f638f7b3cbb
We built a HF space ourselves and build successfully, have no clue now :(
Thanks!

@colin1842

Please see the logs below.

Unfortunate you are having to spend so much time on the environment rather than the solution :-(

Next year we'll try to have a better solution for this.

In the meantime: maybe you could build everything in your HF space, download the necessary (prebuilt) files, and include them in your submission rather than trying to build during inference on the test server? Please let me know if there is anything I can do to help more. I'll make sure to be available throughout the weekend.

06b1c4ff-d8a1-4f25-9057-197628e8e802

pc_util/src/sampling_gpu.h:   0%|          | 0.00/1.03k [00:00<?, ?B/s]
pc_util/src/sampling_gpu.h: 100%|██████████| 1.03k/1.03k [00:00<00:00, 8.91MB/s]
script.py:   0%|          | 0.00/11.1k [00:00<?, ?B/s]
script.py: 100%|██████████| 11.1k/11.1k [00:00<00:00, 59.2MB/s]
...
Looking in links: packages/easydict
Processing ./packages/easydict/easydict-1.13-py3-none-any.whl
Installing collected packages: easydict
Successfully installed easydict-1.13
Package installed successfully from packages/easydict
Looking in links: packages/setuptools
Requirement already satisfied: setuptools in /app/env/lib/python3.10/site-packages (69.5.1)
Package installed successfully from packages/setuptools
running install
/app/env/lib/python3.10/site-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated.
!!

        ********************************************************************************
        Please avoid running ``setup.py`` directly.
        Instead, use pypa/build, pypa/installer or other
        standards-based tools.

        See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details.
        ********************************************************************************

!!
  self.initialize_options()
/app/env/lib/python3.10/site-packages/setuptools/_distutils/cmd.py:66: EasyInstallDeprecationWarning: easy_install command is deprecated.
!!

        ********************************************************************************
        Please avoid running ``setup.py`` and ``easy_install``.
        Instead, use pypa/build, pypa/installer or other
        standards-based tools.

        See https://github.com/pypa/setuptools/issues/917 for details.
        ********************************************************************************

!!
  self.initialize_options()
running bdist_egg
running egg_info
writing pc_util.egg-info/PKG-INFO
writing dependency_links to pc_util.egg-info/dependency_links.txt
writing top-level names to pc_util.egg-info/top_level.txt
reading manifest file 'pc_util.egg-info/SOURCES.txt'
writing manifest file 'pc_util.egg-info/SOURCES.txt'
installing library code to build/bdist.linux-x86_64/egg
running install_lib
running build_ext
/app/env/lib/python3.10/site-packages/torch/utils/cpp_extension.py:428: UserWarning: There are no g++ version bounds defined for CUDA version 12.1
  warnings.warn(f'There are no {compiler_name} version bounds defined for CUDA version {cuda_str_version}')
building 'pc_util' extension
creating /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310
creating /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src
/app/env/lib/python3.10/site-packages/torch/utils/cpp_extension.py:1967: UserWarning: TORCH_CUDA_ARCH_LIST is not set, all archs for visible cards are included for compilation. 
If this is not desired, please set os.environ['TORCH_CUDA_ARCH_LIST'].
  warnings.warn(
Emitting ninja build file /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/build.ninja...
Compiling objects...
Allowing ninja to set a default number of workers... (overridable by setting the environment variable MAX_JOBS=N)
[1/11] /app/env/bin/nvcc --generate-dependencies-with-compile --dependency-output /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/group_points_gpu.o.d -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c -c /tmp/model/pc_util/src/group_points_gpu.cu -o /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/group_points_gpu.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -O2 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_75,code=compute_75 -gencode=arch=compute_75,code=sm_75 -std=c++17
FAILED: /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/group_points_gpu.o 
/app/env/bin/nvcc --generate-dependencies-with-compile --dependency-output /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/group_points_gpu.o.d -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c -c /tmp/model/pc_util/src/group_points_gpu.cu -o /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/group_points_gpu.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -O2 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_75,code=compute_75 -gencode=arch=compute_75,code=sm_75 -std=c++17
<command-line>: fatal error: cuda_runtime.h: No such file or directory
compilation terminated.
[2/11] /app/env/bin/nvcc --generate-dependencies-with-compile --dependency-output /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/cluster_gpu.o.d -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c -c /tmp/model/pc_util/src/cluster_gpu.cu -o /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/cluster_gpu.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -O2 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_75,code=compute_75 -gencode=arch=compute_75,code=sm_75 -std=c++17
FAILED: /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/cluster_gpu.o 
/app/env/bin/nvcc --generate-dependencies-with-compile --dependency-output /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/cluster_gpu.o.d -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c -c /tmp/model/pc_util/src/cluster_gpu.cu -o /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/cluster_gpu.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -O2 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_75,code=compute_75 -gencode=arch=compute_75,code=sm_75 -std=c++17
<command-line>: fatal error: cuda_runtime.h: No such file or directory
compilation terminated.
[3/11] /app/env/bin/nvcc --generate-dependencies-with-compile --dependency-output /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/ball_query_gpu.o.d -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c -c /tmp/model/pc_util/src/ball_query_gpu.cu -o /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/ball_query_gpu.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -O2 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_75,code=compute_75 -gencode=arch=compute_75,code=sm_75 -std=c++17
FAILED: /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/ball_query_gpu.o 
/app/env/bin/nvcc --generate-dependencies-with-compile --dependency-output /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/ball_query_gpu.o.d -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c -c /tmp/model/pc_util/src/ball_query_gpu.cu -o /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/ball_query_gpu.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -O2 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_75,code=compute_75 -gencode=arch=compute_75,code=sm_75 -std=c++17
<command-line>: fatal error: cuda_runtime.h: No such file or directory
compilation terminated.
[4/11] /app/env/bin/nvcc --generate-dependencies-with-compile --dependency-output /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/interpolate_gpu.o.d -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c -c /tmp/model/pc_util/src/interpolate_gpu.cu -o /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/interpolate_gpu.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -O2 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_75,code=compute_75 -gencode=arch=compute_75,code=sm_75 -std=c++17
FAILED: /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/interpolate_gpu.o 
/app/env/bin/nvcc --generate-dependencies-with-compile --dependency-output /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/interpolate_gpu.o.d -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c -c /tmp/model/pc_util/src/interpolate_gpu.cu -o /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/interpolate_gpu.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -O2 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_75,code=compute_75 -gencode=arch=compute_75,code=sm_75 -std=c++17
<command-line>: fatal error: cuda_runtime.h: No such file or directory
compilation terminated.
[5/11] c++ -MMD -MF /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/group_points.o.d -pthread -B /app/env/compiler_compat -Wno-unused-result -Wsign-compare -DNDEBUG -fwrapv -O2 -Wall -fPIC -O2 -isystem /app/env/include -fPIC -O2 -isystem /app/env/include -fPIC -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c -c /tmp/model/pc_util/src/group_points.cpp -o /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/group_points.o -g -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
FAILED: /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/group_points.o 
c++ -MMD -MF /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/group_points.o.d -pthread -B /app/env/compiler_compat -Wno-unused-result -Wsign-compare -DNDEBUG -fwrapv -O2 -Wall -fPIC -O2 -isystem /app/env/include -fPIC -O2 -isystem /app/env/include -fPIC -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c -c /tmp/model/pc_util/src/group_points.cpp -o /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/group_points.o -g -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
/tmp/model/pc_util/src/group_points.cpp:2:10: fatal error: cuda.h: No such file or directory
    2 | #include <cuda.h>
      |          ^~~~~~~~
compilation terminated.
[6/11] c++ -MMD -MF /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/cluster.o.d -pthread -B /app/env/compiler_compat -Wno-unused-result -Wsign-compare -DNDEBUG -fwrapv -O2 -Wall -fPIC -O2 -isystem /app/env/include -fPIC -O2 -isystem /app/env/include -fPIC -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c -c /tmp/model/pc_util/src/cluster.cpp -o /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/cluster.o -g -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
FAILED: /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/cluster.o 
c++ -MMD -MF /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/cluster.o.d -pthread -B /app/env/compiler_compat -Wno-unused-result -Wsign-compare -DNDEBUG -fwrapv -O2 -Wall -fPIC -O2 -isystem /app/env/include -fPIC -O2 -isystem /app/env/include -fPIC -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c -c /tmp/model/pc_util/src/cluster.cpp -o /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/cluster.o -g -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
/tmp/model/pc_util/src/cluster.cpp:4:10: fatal error: cuda.h: No such file or directory
    4 | #include <cuda.h>
      |          ^~~~~~~~
compilation terminated.
[7/11] c++ -MMD -MF /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/ball_query.o.d -pthread -B /app/env/compiler_compat -Wno-unused-result -Wsign-compare -DNDEBUG -fwrapv -O2 -Wall -fPIC -O2 -isystem /app/env/include -fPIC -O2 -isystem /app/env/include -fPIC -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c -c /tmp/model/pc_util/src/ball_query.cpp -o /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/ball_query.o -g -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
FAILED: /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/ball_query.o 
c++ -MMD -MF /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/ball_query.o.d -pthread -B /app/env/compiler_compat -Wno-unused-result -Wsign-compare -DNDEBUG -fwrapv -O2 -Wall -fPIC -O2 -isystem /app/env/include -fPIC -O2 -isystem /app/env/include -fPIC -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c -c /tmp/model/pc_util/src/ball_query.cpp -o /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/ball_query.o -g -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
/tmp/model/pc_util/src/ball_query.cpp:4:10: fatal error: cuda.h: No such file or directory
    4 | #include <cuda.h>
      |          ^~~~~~~~
compilation terminated.
[8/11] c++ -MMD -MF /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/pointnet2_api.o.d -pthread -B /app/env/compiler_compat -Wno-unused-result -Wsign-compare -DNDEBUG -fwrapv -O2 -Wall -fPIC -O2 -isystem /app/env/include -fPIC -O2 -isystem /app/env/include -fPIC -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c -c /tmp/model/pc_util/src/pointnet2_api.cpp -o /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/pointnet2_api.o -g -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
FAILED: /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/pointnet2_api.o 
c++ -MMD -MF /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/pointnet2_api.o.d -pthread -B /app/env/compiler_compat -Wno-unused-result -Wsign-compare -DNDEBUG -fwrapv -O2 -Wall -fPIC -O2 -isystem /app/env/include -fPIC -O2 -isystem /app/env/include -fPIC -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c -c /tmp/model/pc_util/src/pointnet2_api.cpp -o /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/pointnet2_api.o -g -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
In file included from /tmp/model/pc_util/src/pointnet2_api.cpp:4:
/tmp/model/pc_util/src/ball_query_gpu.h:6:10: fatal error: cuda.h: No such file or directory
    6 | #include <cuda.h>
      |          ^~~~~~~~
compilation terminated.
[9/11] c++ -MMD -MF /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/interpolate.o.d -pthread -B /app/env/compiler_compat -Wno-unused-result -Wsign-compare -DNDEBUG -fwrapv -O2 -Wall -fPIC -O2 -isystem /app/env/include -fPIC -O2 -isystem /app/env/include -fPIC -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c -c /tmp/model/pc_util/src/interpolate.cpp -o /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/interpolate.o -g -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
FAILED: /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/interpolate.o 
c++ -MMD -MF /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/interpolate.o.d -pthread -B /app/env/compiler_compat -Wno-unused-result -Wsign-compare -DNDEBUG -fwrapv -O2 -Wall -fPIC -O2 -isystem /app/env/include -fPIC -O2 -isystem /app/env/include -fPIC -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c -c /tmp/model/pc_util/src/interpolate.cpp -o /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/interpolate.o -g -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
/tmp/model/pc_util/src/interpolate.cpp:7:10: fatal error: cuda.h: No such file or directory
    7 | #include <cuda.h>
      |          ^~~~~~~~
compilation terminated.
ninja: build stopped: subcommand failed.
Traceback (most recent call last):
  File "/app/env/lib/python3.10/site-packages/torch/utils/cpp_extension.py", line 2107, in _run_ninja_build
    subprocess.run(
  File "/app/env/lib/python3.10/subprocess.py", line 526, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['ninja', '-v']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/tmp/model/pc_util/setup.py", line 4, in <module>
    setup(
  File "/app/env/lib/python3.10/site-packages/setuptools/__init__.py", line 104, in setup
    return distutils.core.setup(**attrs)
  File "/app/env/lib/python3.10/site-packages/setuptools/_distutils/core.py", line 184, in setup
    return run_commands(dist)
  File "/app/env/lib/python3.10/site-packages/setuptools/_distutils/core.py", line 200, in run_commands
    dist.run_commands()
  File "/app/env/lib/python3.10/site-packages/setuptools/_distutils/dist.py", line 969, in run_commands
    self.run_command(cmd)
  File "/app/env/lib/python3.10/site-packages/setuptools/dist.py", line 967, in run_command
    super().run_command(command)
  File "/app/env/lib/python3.10/site-packages/setuptools/_distutils/dist.py", line 988, in run_command
    cmd_obj.run()
  File "/app/env/lib/python3.10/site-packages/setuptools/command/install.py", line 87, in run
    self.do_egg_install()
  File "/app/env/lib/python3.10/site-packages/setuptools/command/install.py", line 139, in do_egg_install
    self.run_command('bdist_egg')
  File "/app/env/lib/python3.10/site-packages/setuptools/_distutils/cmd.py", line 316, in run_command
    self.distribution.run_command(command)
  File "/app/env/lib/python3.10/site-packages/setuptools/dist.py", line 967, in run_command
    super().run_command(command)
  File "/app/env/lib/python3.10/site-packages/setuptools/_distutils/dist.py", line 988, in run_command
    cmd_obj.run()
  File "/app/env/lib/python3.10/site-packages/setuptools/command/bdist_egg.py", line 167, in run
    cmd = self.call_command('install_lib', warn_dir=0)
  File "/app/env/lib/python3.10/site-packages/setuptools/command/bdist_egg.py", line 153, in call_command
    self.run_command(cmdname)
  File "/app/env/lib/python3.10/site-packages/setuptools/_distutils/cmd.py", line 316, in run_command
    self.distribution.run_command(command)
  File "/app/env/lib/python3.10/site-packages/setuptools/dist.py", line 967, in run_command
    super().run_command(command)
  File "/app/env/lib/python3.10/site-packages/setuptools/_distutils/dist.py", line 988, in run_command
    cmd_obj.run()
  File "/app/env/lib/python3.10/site-packages/setuptools/command/install_lib.py", line 11, in run
    self.build()
  File "/app/env/lib/python3.10/site-packages/setuptools/_distutils/command/install_lib.py", line 110, in build
    self.run_command('build_ext')
  File "/app/env/lib/python3.10/site-packages/setuptools/_distutils/cmd.py", line 316, in run_command
    self.distribution.run_command(command)
  File "/app/env/lib/python3.10/site-packages/setuptools/dist.py", line 967, in run_command
    super().run_command(command)
  File "/app/env/lib/python3.10/site-packages/setuptools/_distutils/dist.py", line 988, in run_command
    cmd_obj.run()
  File "/app/env/lib/python3.10/site-packages/setuptools/command/build_ext.py", line 91, in run
    _build_ext.run(self)
  File "/app/env/lib/python3.10/site-packages/setuptools/_distutils/command/build_ext.py", line 359, in run
    self.build_extensions()
  File "/app/env/lib/python3.10/site-packages/torch/utils/cpp_extension.py", line 870, in build_extensions
    build_ext.build_extensions(self)
  File "/app/env/lib/python3.10/site-packages/setuptools/_distutils/command/build_ext.py", line 479, in build_extensions
    self._build_extensions_serial()
  File "/app/env/lib/python3.10/site-packages/setuptools/_distutils/command/build_ext.py", line 505, in _build_extensions_serial
    self.build_extension(ext)
  File "/app/env/lib/python3.10/site-packages/setuptools/command/build_ext.py", line 252, in build_extension
    _build_ext.build_extension(self, ext)
  File "/app/env/lib/python3.10/site-packages/setuptools/_distutils/command/build_ext.py", line 560, in build_extension
    objects = self.compiler.compile(
  File "/app/env/lib/python3.10/site-packages/torch/utils/cpp_extension.py", line 683, in unix_wrap_ninja_compile
    _write_ninja_file_and_compile_objects(
  File "/app/env/lib/python3.10/site-packages/torch/utils/cpp_extension.py", line 1783, in _write_ninja_file_and_compile_objects
    _run_ninja_build(
  File "/app/env/lib/python3.10/site-packages/torch/utils/cpp_extension.py", line 2123, in _run_ninja_build
    raise RuntimeError(message) from e
RuntimeError: Error compiling objects for extension
Traceback (most recent call last):
  File "/tmp/model/script.py", line 241, in <module>
    setup_environment()
  File "/tmp/model/script.py", line 214, in setup_environment
    subprocess.check_call([sys.executable, "setup.py", "install"])
  File "/app/env/lib/python3.10/subprocess.py", line 369, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['/app/env/bin/python', 'setup.py', 'install']' returned non-zero exit status 1.

26d4bfe2-f626-4b05-9b66-6f638f7b3cbb

Package installed successfully from packages/setuptools
running install
/app/env/lib/python3.10/site-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated.
!!

        ********************************************************************************
        Please avoid running ``setup.py`` directly.
        Instead, use pypa/build, pypa/installer or other
        standards-based tools.

        See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details.
        ********************************************************************************

!!
  self.initialize_options()
/app/env/lib/python3.10/site-packages/setuptools/_distutils/cmd.py:66: EasyInstallDeprecationWarning: easy_install command is deprecated.
!!

        ********************************************************************************
        Please avoid running ``setup.py`` and ``easy_install``.
        Instead, use pypa/build, pypa/installer or other
        standards-based tools.

        See https://github.com/pypa/setuptools/issues/917 for details.
        ********************************************************************************

!!
  self.initialize_options()
running bdist_egg
running egg_info
writing pc_util.egg-info/PKG-INFO
writing dependency_links to pc_util.egg-info/dependency_links.txt
writing top-level names to pc_util.egg-info/top_level.txt
reading manifest file 'pc_util.egg-info/SOURCES.txt'
writing manifest file 'pc_util.egg-info/SOURCES.txt'
installing library code to build/bdist.linux-x86_64/egg
running install_lib
running build_ext
/app/env/lib/python3.10/site-packages/torch/utils/cpp_extension.py:428: UserWarning: There are no g++ version bounds defined for CUDA version 12.1
  warnings.warn(f'There are no {compiler_name} version bounds defined for CUDA version {cuda_str_version}')
building 'pc_util' extension
creating /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310
creating /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src
/app/env/lib/python3.10/site-packages/torch/utils/cpp_extension.py:1967: UserWarning: TORCH_CUDA_ARCH_LIST is not set, all archs for visible cards are included for compilation. 
If this is not desired, please set os.environ['TORCH_CUDA_ARCH_LIST'].
  warnings.warn(
Emitting ninja build file /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/build.ninja...
Compiling objects...
Allowing ninja to set a default number of workers... (overridable by setting the environment variable MAX_JOBS=N)
[1/11] /app/env/bin/nvcc --generate-dependencies-with-compile --dependency-output /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/group_points_gpu.o.d -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c -c /tmp/model/pc_util/src/group_points_gpu.cu -o /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/group_points_gpu.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -O2 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_75,code=compute_75 -gencode=arch=compute_75,code=sm_75 -std=c++17
FAILED: /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/group_points_gpu.o 
/app/env/bin/nvcc --generate-dependencies-with-compile --dependency-output /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/group_points_gpu.o.d -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c -c /tmp/model/pc_util/src/group_points_gpu.cu -o /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/group_points_gpu.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -O2 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_75,code=compute_75 -gencode=arch=compute_75,code=sm_75 -std=c++17
<command-line>: fatal error: cuda_runtime.h: No such file or directory
compilation terminated.
[2/11] /app/env/bin/nvcc --generate-dependencies-with-compile --dependency-output /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/interpolate_gpu.o.d -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c -c /tmp/model/pc_util/src/interpolate_gpu.cu -o /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/interpolate_gpu.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -O2 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_75,code=compute_75 -gencode=arch=compute_75,code=sm_75 -std=c++17
FAILED: /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/interpolate_gpu.o 
/app/env/bin/nvcc --generate-dependencies-with-compile --dependency-output /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/interpolate_gpu.o.d -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c -c /tmp/model/pc_util/src/interpolate_gpu.cu -o /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/interpolate_gpu.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -O2 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_75,code=compute_75 -gencode=arch=compute_75,code=sm_75 -std=c++17
<command-line>: fatal error: cuda_runtime.h: No such file or directory
compilation terminated.
[3/11] /app/env/bin/nvcc --generate-dependencies-with-compile --dependency-output /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/ball_query_gpu.o.d -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c -c /tmp/model/pc_util/src/ball_query_gpu.cu -o /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/ball_query_gpu.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -O2 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_75,code=compute_75 -gencode=arch=compute_75,code=sm_75 -std=c++17
FAILED: /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/ball_query_gpu.o 
/app/env/bin/nvcc --generate-dependencies-with-compile --dependency-output /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/ball_query_gpu.o.d -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c -c /tmp/model/pc_util/src/ball_query_gpu.cu -o /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/ball_query_gpu.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -O2 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_75,code=compute_75 -gencode=arch=compute_75,code=sm_75 -std=c++17
<command-line>: fatal error: cuda_runtime.h: No such file or directory
compilation terminated.
[4/11] /app/env/bin/nvcc --generate-dependencies-with-compile --dependency-output /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/cluster_gpu.o.d -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c -c /tmp/model/pc_util/src/cluster_gpu.cu -o /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/cluster_gpu.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -O2 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_75,code=compute_75 -gencode=arch=compute_75,code=sm_75 -std=c++17
FAILED: /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/cluster_gpu.o 
/app/env/bin/nvcc --generate-dependencies-with-compile --dependency-output /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/cluster_gpu.o.d -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c -c /tmp/model/pc_util/src/cluster_gpu.cu -o /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/cluster_gpu.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -O2 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_75,code=compute_75 -gencode=arch=compute_75,code=sm_75 -std=c++17
<command-line>: fatal error: cuda_runtime.h: No such file or directory
compilation terminated.
[5/11] c++ -MMD -MF /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/group_points.o.d -pthread -B /app/env/compiler_compat -Wno-unused-result -Wsign-compare -DNDEBUG -fwrapv -O2 -Wall -fPIC -O2 -isystem /app/env/include -fPIC -O2 -isystem /app/env/include -fPIC -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c -c /tmp/model/pc_util/src/group_points.cpp -o /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/group_points.o -g -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
FAILED: /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/group_points.o 
c++ -MMD -MF /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/group_points.o.d -pthread -B /app/env/compiler_compat -Wno-unused-result -Wsign-compare -DNDEBUG -fwrapv -O2 -Wall -fPIC -O2 -isystem /app/env/include -fPIC -O2 -isystem /app/env/include -fPIC -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c -c /tmp/model/pc_util/src/group_points.cpp -o /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/group_points.o -g -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
/tmp/model/pc_util/src/group_points.cpp:2:10: fatal error: cuda.h: No such file or directory
    2 | #include <cuda.h>
      |          ^~~~~~~~
compilation terminated.
[6/11] c++ -MMD -MF /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/ball_query.o.d -pthread -B /app/env/compiler_compat -Wno-unused-result -Wsign-compare -DNDEBUG -fwrapv -O2 -Wall -fPIC -O2 -isystem /app/env/include -fPIC -O2 -isystem /app/env/include -fPIC -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c -c /tmp/model/pc_util/src/ball_query.cpp -o /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/ball_query.o -g -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
FAILED: /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/ball_query.o 
c++ -MMD -MF /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/ball_query.o.d -pthread -B /app/env/compiler_compat -Wno-unused-result -Wsign-compare -DNDEBUG -fwrapv -O2 -Wall -fPIC -O2 -isystem /app/env/include -fPIC -O2 -isystem /app/env/include -fPIC -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c -c /tmp/model/pc_util/src/ball_query.cpp -o /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/ball_query.o -g -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
/tmp/model/pc_util/src/ball_query.cpp:4:10: fatal error: cuda.h: No such file or directory
    4 | #include <cuda.h>
      |          ^~~~~~~~
compilation terminated.
[7/11] c++ -MMD -MF /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/cluster.o.d -pthread -B /app/env/compiler_compat -Wno-unused-result -Wsign-compare -DNDEBUG -fwrapv -O2 -Wall -fPIC -O2 -isystem /app/env/include -fPIC -O2 -isystem /app/env/include -fPIC -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c -c /tmp/model/pc_util/src/cluster.cpp -o /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/cluster.o -g -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
FAILED: /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/cluster.o 
c++ -MMD -MF /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/cluster.o.d -pthread -B /app/env/compiler_compat -Wno-unused-result -Wsign-compare -DNDEBUG -fwrapv -O2 -Wall -fPIC -O2 -isystem /app/env/include -fPIC -O2 -isystem /app/env/include -fPIC -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c -c /tmp/model/pc_util/src/cluster.cpp -o /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/cluster.o -g -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
/tmp/model/pc_util/src/cluster.cpp:4:10: fatal error: cuda.h: No such file or directory
    4 | #include <cuda.h>
      |          ^~~~~~~~
compilation terminated.
[8/11] c++ -MMD -MF /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/interpolate.o.d -pthread -B /app/env/compiler_compat -Wno-unused-result -Wsign-compare -DNDEBUG -fwrapv -O2 -Wall -fPIC -O2 -isystem /app/env/include -fPIC -O2 -isystem /app/env/include -fPIC -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c -c /tmp/model/pc_util/src/interpolate.cpp -o /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/interpolate.o -g -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
FAILED: /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/interpolate.o 
c++ -MMD -MF /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/interpolate.o.d -pthread -B /app/env/compiler_compat -Wno-unused-result -Wsign-compare -DNDEBUG -fwrapv -O2 -Wall -fPIC -O2 -isystem /app/env/include -fPIC -O2 -isystem /app/env/include -fPIC -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c -c /tmp/model/pc_util/src/interpolate.cpp -o /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/interpolate.o -g -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
/tmp/model/pc_util/src/interpolate.cpp:7:10: fatal error: cuda.h: No such file or directory
    7 | #include <cuda.h>
      |          ^~~~~~~~
compilation terminated.
[9/11] c++ -MMD -MF /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/pointnet2_api.o.d -pthread -B /app/env/compiler_compat -Wno-unused-result -Wsign-compare -DNDEBUG -fwrapv -O2 -Wall -fPIC -O2 -isystem /app/env/include -fPIC -O2 -isystem /app/env/include -fPIC -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c -c /tmp/model/pc_util/src/pointnet2_api.cpp -o /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/pointnet2_api.o -g -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
FAILED: /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/pointnet2_api.o 
c++ -MMD -MF /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/pointnet2_api.o.d -pthread -B /app/env/compiler_compat -Wno-unused-result -Wsign-compare -DNDEBUG -fwrapv -O2 -Wall -fPIC -O2 -isystem /app/env/include -fPIC -O2 -isystem /app/env/include -fPIC -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c -c /tmp/model/pc_util/src/pointnet2_api.cpp -o /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/pointnet2_api.o -g -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
In file included from /tmp/model/pc_util/src/pointnet2_api.cpp:4:
/tmp/model/pc_util/src/ball_query_gpu.h:6:10: fatal error: cuda.h: No such file or directory
    6 | #include <cuda.h>
      |          ^~~~~~~~
compilation terminated.
ninja: build stopped: subcommand failed.
Traceback (most recent call last):
  File "/app/env/lib/python3.10/site-packages/torch/utils/cpp_extension.py", line 2107, in _run_ninja_build
    subprocess.run(
  File "/app/env/lib/python3.10/subprocess.py", line 526, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['ninja', '-v']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/tmp/model/pc_util/setup.py", line 4, in <module>
    setup(
  File "/app/env/lib/python3.10/site-packages/setuptools/__init__.py", line 104, in setup
    return distutils.core.setup(**attrs)
  File "/app/env/lib/python3.10/site-packages/setuptools/_distutils/core.py", line 184, in setup
    return run_commands(dist)
  File "/app/env/lib/python3.10/site-packages/setuptools/_distutils/core.py", line 200, in run_commands
    dist.run_commands()
  File "/app/env/lib/python3.10/site-packages/setuptools/_distutils/dist.py", line 969, in run_commands
    self.run_command(cmd)
  File "/app/env/lib/python3.10/site-packages/setuptools/dist.py", line 967, in run_command
    super().run_command(command)
  File "/app/env/lib/python3.10/site-packages/setuptools/_distutils/dist.py", line 988, in run_command
    cmd_obj.run()
  File "/app/env/lib/python3.10/site-packages/setuptools/command/install.py", line 87, in run
    self.do_egg_install()
  File "/app/env/lib/python3.10/site-packages/setuptools/command/install.py", line 139, in do_egg_install
    self.run_command('bdist_egg')
  File "/app/env/lib/python3.10/site-packages/setuptools/_distutils/cmd.py", line 316, in run_command
    self.distribution.run_command(command)
  File "/app/env/lib/python3.10/site-packages/setuptools/dist.py", line 967, in run_command
    super().run_command(command)
  File "/app/env/lib/python3.10/site-packages/setuptools/_distutils/dist.py", line 988, in run_command
    cmd_obj.run()
  File "/app/env/lib/python3.10/site-packages/setuptools/command/bdist_egg.py", line 167, in run
    cmd = self.call_command('install_lib', warn_dir=0)
  File "/app/env/lib/python3.10/site-packages/setuptools/command/bdist_egg.py", line 153, in call_command
    self.run_command(cmdname)
  File "/app/env/lib/python3.10/site-packages/setuptools/_distutils/cmd.py", line 316, in run_command
    self.distribution.run_command(command)
  File "/app/env/lib/python3.10/site-packages/setuptools/dist.py", line 967, in run_command
    super().run_command(command)
  File "/app/env/lib/python3.10/site-packages/setuptools/_distutils/dist.py", line 988, in run_command
    cmd_obj.run()
  File "/app/env/lib/python3.10/site-packages/setuptools/command/install_lib.py", line 11, in run
    self.build()
  File "/app/env/lib/python3.10/site-packages/setuptools/_distutils/command/install_lib.py", line 110, in build
    self.run_command('build_ext')
  File "/app/env/lib/python3.10/site-packages/setuptools/_distutils/cmd.py", line 316, in run_command
    self.distribution.run_command(command)
  File "/app/env/lib/python3.10/site-packages/setuptools/dist.py", line 967, in run_command
    super().run_command(command)
  File "/app/env/lib/python3.10/site-packages/setuptools/_distutils/dist.py", line 988, in run_command
    cmd_obj.run()
  File "/app/env/lib/python3.10/site-packages/setuptools/command/build_ext.py", line 91, in run
    _build_ext.run(self)
  File "/app/env/lib/python3.10/site-packages/setuptools/_distutils/command/build_ext.py", line 359, in run
    self.build_extensions()
  File "/app/env/lib/python3.10/site-packages/torch/utils/cpp_extension.py", line 870, in build_extensions
    build_ext.build_extensions(self)
  File "/app/env/lib/python3.10/site-packages/setuptools/_distutils/command/build_ext.py", line 479, in build_extensions
    self._build_extensions_serial()
  File "/app/env/lib/python3.10/site-packages/setuptools/_distutils/command/build_ext.py", line 505, in _build_extensions_serial
    self.build_extension(ext)
  File "/app/env/lib/python3.10/site-packages/setuptools/command/build_ext.py", line 252, in build_extension
    _build_ext.build_extension(self, ext)
  File "/app/env/lib/python3.10/site-packages/setuptools/_distutils/command/build_ext.py", line 560, in build_extension
    objects = self.compiler.compile(
  File "/app/env/lib/python3.10/site-packages/torch/utils/cpp_extension.py", line 683, in unix_wrap_ninja_compile
    _write_ninja_file_and_compile_objects(
  File "/app/env/lib/python3.10/site-packages/torch/utils/cpp_extension.py", line 1783, in _write_ninja_file_and_compile_objects
    _run_ninja_build(
  File "/app/env/lib/python3.10/site-packages/torch/utils/cpp_extension.py", line 2123, in _run_ninja_build
    raise RuntimeError(message) from e
RuntimeError: Error compiling objects for extension
Traceback (most recent call last):
  File "/tmp/model/script.py", line 241, in <module>
    setup_environment()
  File "/tmp/model/script.py", line 214, in setup_environment
    subprocess.check_call([sys.executable, "setup.py", "install"])
  File "/app/env/lib/python3.10/subprocess.py", line 369, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['/app/env/bin/python', 'setup.py', 'install']' returned non-zero exit status 1.
2024-06-08 10:04:53.178 | ERROR    | __main__:generate_submission_file:72 - Subprocess didn't terminate successfully

How about this? thanks!
c812c15f-17db-489d-9986-525ca4060eb4

@colin1842

c812c15f-17db-489d-9986-525ca4060eb4

pc_util/src/sampling_gpu.cu: 100%|██████████| 8.13k/8.13k [00:00<00:00, 46.3MB/s]
pc_util/src/sampling_gpu.h:   0%|          | 0.00/1.03k [00:00<?, ?B/s]
pc_util/src/sampling_gpu.h: 100%|██████████| 1.03k/1.03k [00:00<00:00, 5.24MB/s]
script.py:   0%|          | 0.00/11.5k [00:00<?, ?B/s]
script.py: 100%|██████████| 11.5k/11.5k [00:00<00:00, 47.3MB/s]
2024-06-08 17:05:06.777 | INFO     | __main__:generate_submission_file:41 - Generating submission file
/tmp/model
...
Looking in links: packages/easydict
Processing ./packages/easydict/easydict-1.13-py3-none-any.whl
Installing collected packages: easydict
Successfully installed easydict-1.13
Package installed successfully from packages/easydict
Looking in links: packages/setuptools
Requirement already satisfied: setuptools in /app/env/lib/python3.10/site-packages (69.5.1)
Package installed successfully from packages/setuptools
bin
etc
games
include
lib
man
sbin
share
src
cuda-12.1
cuda
cuda-12
running install
/app/env/lib/python3.10/site-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated.
!!

        ********************************************************************************
        Please avoid running ``setup.py`` directly.
        Instead, use pypa/build, pypa/installer or other
        standards-based tools.

        See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details.
        ********************************************************************************

!!
  self.initialize_options()
/app/env/lib/python3.10/site-packages/setuptools/_distutils/cmd.py:66: EasyInstallDeprecationWarning: easy_install command is deprecated.
!!

        ********************************************************************************
        Please avoid running ``setup.py`` and ``easy_install``.
        Instead, use pypa/build, pypa/installer or other
        standards-based tools.

        See https://github.com/pypa/setuptools/issues/917 for details.
        ********************************************************************************

!!
  self.initialize_options()
running bdist_egg
running egg_info
writing pc_util.egg-info/PKG-INFO
writing dependency_links to pc_util.egg-info/dependency_links.txt
writing top-level names to pc_util.egg-info/top_level.txt
/app/env/lib/python3.10/site-packages/torch/utils/cpp_extension.py:499: UserWarning: Attempted to use ninja as the BuildExtension backend but we could not find ninja.. Falling back to using the slow distutils backend.
  warnings.warn(msg.format('we could not find ninja.'))
reading manifest file 'pc_util.egg-info/SOURCES.txt'
writing manifest file 'pc_util.egg-info/SOURCES.txt'
installing library code to build/bdist.linux-x86_64/egg
running install_lib
running build_ext
error: [Errno 2] No such file or directory: 'which'
Traceback (most recent call last):
  File "/tmp/model/script.py", line 253, in <module>
    setup_environment()
  File "/tmp/model/script.py", line 216, in setup_environment
    subprocess.check_call([sys.executable, "setup.py", "install"])
  File "/app/env/lib/python3.10/subprocess.py", line 369, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['/app/env/bin/python', 'setup.py', 'install']' returned non-zero exit status 1.

700f70e7-4b7f-4ffa-a8f1-6da1178320f3
We are trying build and install a package using setup.py inside the script.py, but the process fails because the which command may not be installed on the server, resulting in the error: “error: [Errno 2] No such file or directory: ‘which’“. Could you please install which in the system? @jacklangerman

@colin1842

installing python packages is much easier because I can just add them to our requirements.txt. what does setup.py rely on which or do you need it for something else? have you taken a look here: https://github.com/huggingface/competitions/blob/main/Dockerfile and https://github.com/huggingface/competitions/blob/main/competitions/utils.py#L172?

I'll keep looking at this as well and see if I can make it happen or suggest something else.

@colin1842

installing python packages is much easier because I can just add them to our requirements.txt. what does setup.py rely on which or do you need it for something else? have you taken a look here: https://github.com/huggingface/competitions/blob/main/Dockerfile and https://github.com/huggingface/competitions/blob/main/competitions/utils.py#L172?

I'll keep looking at this as well and see if I can make it happen or suggest something else.

Could you please also check ID: 700f70e7-4b7f-4ffa-a8f1-6da1178320f3, thanks.

@WatsonTang98

700f70e7-4b7f-4ffa-a8f1-6da1178320f3

running install
/app/env/lib/python3.10/site-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated.
!!

        ********************************************************************************
        Please avoid running ``setup.py`` directly.
        Instead, use pypa/build, pypa/installer or other
        standards-based tools.

        See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details.
        ********************************************************************************

!!
  self.initialize_options()
/app/env/lib/python3.10/site-packages/setuptools/_distutils/cmd.py:66: EasyInstallDeprecationWarning: easy_install command is deprecated.
!!

        ********************************************************************************
        Please avoid running ``setup.py`` and ``easy_install``.
        Instead, use pypa/build, pypa/installer or other
        standards-based tools.

        See https://github.com/pypa/setuptools/issues/917 for details.
        ********************************************************************************

!!
  self.initialize_options()
running bdist_egg
running egg_info
writing pc_util.egg-info/PKG-INFO
writing dependency_links to pc_util.egg-info/dependency_links.txt
writing top-level names to pc_util.egg-info/top_level.txt
reading manifest file 'pc_util.egg-info/SOURCES.txt'
writing manifest file 'pc_util.egg-info/SOURCES.txt'
installing library code to build/bdist.linux-x86_64/egg
running install_lib
running build_ext
/app/env/lib/python3.10/site-packages/torch/utils/cpp_extension.py:428: UserWarning: There are no g++ version bounds defined for CUDA version 12.1
  warnings.warn(f'There are no {compiler_name} version bounds defined for CUDA version {cuda_str_version}')
building 'pc_util' extension
creating /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310
creating /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src
/app/env/lib/python3.10/site-packages/torch/utils/cpp_extension.py:1967: UserWarning: TORCH_CUDA_ARCH_LIST is not set, all archs for visible cards are included for compilation. 
If this is not desired, please set os.environ['TORCH_CUDA_ARCH_LIST'].
  warnings.warn(
Emitting ninja build file /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/build.ninja...
Compiling objects...
Allowing ninja to set a default number of workers... (overridable by setting the environment variable MAX_JOBS=N)
[1/11] /app/env/bin/nvcc --generate-dependencies-with-compile --dependency-output /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/interpolate_gpu.o.d -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c -c /tmp/model/pc_util/src/interpolate_gpu.cu -o /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/interpolate_gpu.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -O2 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_75,code=compute_75 -gencode=arch=compute_75,code=sm_75 -std=c++17
FAILED: /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/interpolate_gpu.o 
/app/env/bin/nvcc --generate-dependencies-with-compile --dependency-output /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/interpolate_gpu.o.d -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c -c /tmp/model/pc_util/src/interpolate_gpu.cu -o /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/interpolate_gpu.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -O2 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_75,code=compute_75 -gencode=arch=compute_75,code=sm_75 -std=c++17
<command-line>: fatal error: cuda_runtime.h: No such file or directory
compilation terminated.
[2/11] /app/env/bin/nvcc --generate-dependencies-with-compile --dependency-output /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/ball_query_gpu.o.d -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c -c /tmp/model/pc_util/src/ball_query_gpu.cu -o /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/ball_query_gpu.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -O2 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_75,code=compute_75 -gencode=arch=compute_75,code=sm_75 -std=c++17
FAILED: /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/ball_query_gpu.o 
/app/env/bin/nvcc --generate-dependencies-with-compile --dependency-output /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/ball_query_gpu.o.d -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c -c /tmp/model/pc_util/src/ball_query_gpu.cu -o /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/ball_query_gpu.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -O2 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_75,code=compute_75 -gencode=arch=compute_75,code=sm_75 -std=c++17
<command-line>: fatal error: cuda_runtime.h: No such file or directory
compilation terminated.
[3/11] /app/env/bin/nvcc --generate-dependencies-with-compile --dependency-output /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/cluster_gpu.o.d -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c -c /tmp/model/pc_util/src/cluster_gpu.cu -o /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/cluster_gpu.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -O2 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_75,code=compute_75 -gencode=arch=compute_75,code=sm_75 -std=c++17
FAILED: /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/cluster_gpu.o 
/app/env/bin/nvcc --generate-dependencies-with-compile --dependency-output /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/cluster_gpu.o.d -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c -c /tmp/model/pc_util/src/cluster_gpu.cu -o /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/cluster_gpu.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -O2 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_75,code=compute_75 -gencode=arch=compute_75,code=sm_75 -std=c++17
<command-line>: fatal error: cuda_runtime.h: No such file or directory
compilation terminated.
[4/11] /app/env/bin/nvcc --generate-dependencies-with-compile --dependency-output /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/group_points_gpu.o.d -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c -c /tmp/model/pc_util/src/group_points_gpu.cu -o /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/group_points_gpu.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -O2 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_75,code=compute_75 -gencode=arch=compute_75,code=sm_75 -std=c++17
FAILED: /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/group_points_gpu.o 
/app/env/bin/nvcc --generate-dependencies-with-compile --dependency-output /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/group_points_gpu.o.d -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c -c /tmp/model/pc_util/src/group_points_gpu.cu -o /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/group_points_gpu.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -O2 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_75,code=compute_75 -gencode=arch=compute_75,code=sm_75 -std=c++17
<command-line>: fatal error: cuda_runtime.h: No such file or directory
compilation terminated.
[5/11] c++ -MMD -MF /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/group_points.o.d -pthread -B /app/env/compiler_compat -Wno-unused-result -Wsign-compare -DNDEBUG -fwrapv -O2 -Wall -fPIC -O2 -isystem /app/env/include -fPIC -O2 -isystem /app/env/include -fPIC -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c -c /tmp/model/pc_util/src/group_points.cpp -o /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/group_points.o -g -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
FAILED: /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/group_points.o 
c++ -MMD -MF /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/group_points.o.d -pthread -B /app/env/compiler_compat -Wno-unused-result -Wsign-compare -DNDEBUG -fwrapv -O2 -Wall -fPIC -O2 -isystem /app/env/include -fPIC -O2 -isystem /app/env/include -fPIC -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c -c /tmp/model/pc_util/src/group_points.cpp -o /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/group_points.o -g -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
/tmp/model/pc_util/src/group_points.cpp:2:10: fatal error: cuda.h: No such file or directory
    2 | #include <cuda.h>
      |          ^~~~~~~~
compilation terminated.
[6/11] c++ -MMD -MF /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/interpolate.o.d -pthread -B /app/env/compiler_compat -Wno-unused-result -Wsign-compare -DNDEBUG -fwrapv -O2 -Wall -fPIC -O2 -isystem /app/env/include -fPIC -O2 -isystem /app/env/include -fPIC -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c -c /tmp/model/pc_util/src/interpolate.cpp -o /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/interpolate.o -g -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
FAILED: /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/interpolate.o 
c++ -MMD -MF /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/interpolate.o.d -pthread -B /app/env/compiler_compat -Wno-unused-result -Wsign-compare -DNDEBUG -fwrapv -O2 -Wall -fPIC -O2 -isystem /app/env/include -fPIC -O2 -isystem /app/env/include -fPIC -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c -c /tmp/model/pc_util/src/interpolate.cpp -o /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/interpolate.o -g -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
/tmp/model/pc_util/src/interpolate.cpp:7:10: fatal error: cuda.h: No such file or directory
    7 | #include <cuda.h>
      |          ^~~~~~~~
compilation terminated.
[7/11] c++ -MMD -MF /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/ball_query.o.d -pthread -B /app/env/compiler_compat -Wno-unused-result -Wsign-compare -DNDEBUG -fwrapv -O2 -Wall -fPIC -O2 -isystem /app/env/include -fPIC -O2 -isystem /app/env/include -fPIC -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c -c /tmp/model/pc_util/src/ball_query.cpp -o /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/ball_query.o -g -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
FAILED: /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/ball_query.o 
c++ -MMD -MF /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/ball_query.o.d -pthread -B /app/env/compiler_compat -Wno-unused-result -Wsign-compare -DNDEBUG -fwrapv -O2 -Wall -fPIC -O2 -isystem /app/env/include -fPIC -O2 -isystem /app/env/include -fPIC -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c -c /tmp/model/pc_util/src/ball_query.cpp -o /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/ball_query.o -g -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
/tmp/model/pc_util/src/ball_query.cpp:4:10: fatal error: cuda.h: No such file or directory
    4 | #include <cuda.h>
      |          ^~~~~~~~
compilation terminated.
[8/11] c++ -MMD -MF /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/cluster.o.d -pthread -B /app/env/compiler_compat -Wno-unused-result -Wsign-compare -DNDEBUG -fwrapv -O2 -Wall -fPIC -O2 -isystem /app/env/include -fPIC -O2 -isystem /app/env/include -fPIC -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c -c /tmp/model/pc_util/src/cluster.cpp -o /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/cluster.o -g -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
FAILED: /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/cluster.o 
c++ -MMD -MF /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/cluster.o.d -pthread -B /app/env/compiler_compat -Wno-unused-result -Wsign-compare -DNDEBUG -fwrapv -O2 -Wall -fPIC -O2 -isystem /app/env/include -fPIC -O2 -isystem /app/env/include -fPIC -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c -c /tmp/model/pc_util/src/cluster.cpp -o /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/cluster.o -g -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
/tmp/model/pc_util/src/cluster.cpp:4:10: fatal error: cuda.h: No such file or directory
    4 | #include <cuda.h>
      |          ^~~~~~~~
compilation terminated.
[9/11] c++ -MMD -MF /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/pointnet2_api.o.d -pthread -B /app/env/compiler_compat -Wno-unused-result -Wsign-compare -DNDEBUG -fwrapv -O2 -Wall -fPIC -O2 -isystem /app/env/include -fPIC -O2 -isystem /app/env/include -fPIC -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c -c /tmp/model/pc_util/src/pointnet2_api.cpp -o /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/pointnet2_api.o -g -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
FAILED: /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/pointnet2_api.o 
c++ -MMD -MF /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/pointnet2_api.o.d -pthread -B /app/env/compiler_compat -Wno-unused-result -Wsign-compare -DNDEBUG -fwrapv -O2 -Wall -fPIC -O2 -isystem /app/env/include -fPIC -O2 -isystem /app/env/include -fPIC -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c -c /tmp/model/pc_util/src/pointnet2_api.cpp -o /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/pointnet2_api.o -g -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
In file included from /tmp/model/pc_util/src/pointnet2_api.cpp:4:
/tmp/model/pc_util/src/ball_query_gpu.h:6:10: fatal error: cuda.h: No such file or directory
    6 | #include <cuda.h>
      |          ^~~~~~~~
compilation terminated.
ninja: build stopped: subcommand failed.
Traceback (most recent call last):
  File "/app/env/lib/python3.10/site-packages/torch/utils/cpp_extension.py", line 2107, in _run_ninja_build
    subprocess.run(
  File "/app/env/lib/python3.10/subprocess.py", line 526, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['ninja', '-v']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

@colin1842 @WatsonTang98

What question where you trying to answer with which? I have a shell to the eval space now.

@colin1842

installing python packages is much easier because I can just add them to our requirements.txt. what does setup.py rely on which or do you need it for something else? have you taken a look here: https://github.com/huggingface/competitions/blob/main/Dockerfile and https://github.com/huggingface/competitions/blob/main/competitions/utils.py#L172?

I'll keep looking at this as well and see if I can make it happen or suggest something else.

I have just confirmed which is already installed in the system, not sure why it wasn't found by your script.

thanks for the clarification, how about this one?
9cb4c916-4c2d-4b67-9b6a-1c42e114c910

@colin1842

running install
/app/env/lib/python3.10/site-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated.
!!

        ********************************************************************************
        Please avoid running ``setup.py`` directly.
        Instead, use pypa/build, pypa/installer or other
        standards-based tools.

        See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details.
        ********************************************************************************

!!
  self.initialize_options()
/app/env/lib/python3.10/site-packages/setuptools/_distutils/cmd.py:66: EasyInstallDeprecationWarning: easy_install command is deprecated.
!!

        ********************************************************************************
        Please avoid running ``setup.py`` and ``easy_install``.
        Instead, use pypa/build, pypa/installer or other
        standards-based tools.

        See https://github.com/pypa/setuptools/issues/917 for details.
        ********************************************************************************

!!
  self.initialize_options()
running bdist_egg
running egg_info
writing pc_util.egg-info/PKG-INFO
writing dependency_links to pc_util.egg-info/dependency_links.txt
writing top-level names to pc_util.egg-info/top_level.txt
reading manifest file 'pc_util.egg-info/SOURCES.txt'
writing manifest file 'pc_util.egg-info/SOURCES.txt'
installing library code to build/bdist.linux-x86_64/egg
running install_lib
running build_ext
/app/env/lib/python3.10/site-packages/torch/utils/cpp_extension.py:428: UserWarning: There are no g++ version bounds defined for CUDA version 12.1
  warnings.warn(f'There are no {compiler_name} version bounds defined for CUDA version {cuda_str_version}')
building 'pc_util' extension
creating /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310
creating /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src
/app/env/lib/python3.10/site-packages/torch/utils/cpp_extension.py:1967: UserWarning: TORCH_CUDA_ARCH_LIST is not set, all archs for visible cards are included for compilation. 
If this is not desired, please set os.environ['TORCH_CUDA_ARCH_LIST'].
  warnings.warn(
Emitting ninja build file /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/build.ninja...
Compiling objects...
Allowing ninja to set a default number of workers... (overridable by setting the environment variable MAX_JOBS=N)
[1/11] /app/env/bin/nvcc --generate-dependencies-with-compile --dependency-output /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/ball_query_gpu.o.d -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c -c /tmp/model/pc_util/src/ball_query_gpu.cu -o /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/ball_query_gpu.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -O2 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_75,code=compute_75 -gencode=arch=compute_75,code=sm_75 -std=c++17
FAILED: /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/ball_query_gpu.o 
/app/env/bin/nvcc --generate-dependencies-with-compile --dependency-output /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/ball_query_gpu.o.d -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c -c /tmp/model/pc_util/src/ball_query_gpu.cu -o /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/ball_query_gpu.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -O2 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_75,code=compute_75 -gencode=arch=compute_75,code=sm_75 -std=c++17
<command-line>: fatal error: cuda_runtime.h: No such file or directory
compilation terminated.
[2/11] /app/env/bin/nvcc --generate-dependencies-with-compile --dependency-output /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/interpolate_gpu.o.d -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c -c /tmp/model/pc_util/src/interpolate_gpu.cu -o /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/interpolate_gpu.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -O2 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_75,code=compute_75 -gencode=arch=compute_75,code=sm_75 -std=c++17
FAILED: /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/interpolate_gpu.o 
/app/env/bin/nvcc --generate-dependencies-with-compile --dependency-output /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/interpolate_gpu.o.d -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c -c /tmp/model/pc_util/src/interpolate_gpu.cu -o /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/interpolate_gpu.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -O2 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_75,code=compute_75 -gencode=arch=compute_75,code=sm_75 -std=c++17
<command-line>: fatal error: cuda_runtime.h: No such file or directory
compilation terminated.
[3/11] /app/env/bin/nvcc --generate-dependencies-with-compile --dependency-output /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/group_points_gpu.o.d -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c -c /tmp/model/pc_util/src/group_points_gpu.cu -o /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/group_points_gpu.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -O2 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_75,code=compute_75 -gencode=arch=compute_75,code=sm_75 -std=c++17
FAILED: /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/group_points_gpu.o 
/app/env/bin/nvcc --generate-dependencies-with-compile --dependency-output /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/group_points_gpu.o.d -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c -c /tmp/model/pc_util/src/group_points_gpu.cu -o /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/group_points_gpu.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -O2 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_75,code=compute_75 -gencode=arch=compute_75,code=sm_75 -std=c++17
<command-line>: fatal error: cuda_runtime.h: No such file or directory
compilation terminated.
[4/11] /app/env/bin/nvcc --generate-dependencies-with-compile --dependency-output /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/cluster_gpu.o.d -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c -c /tmp/model/pc_util/src/cluster_gpu.cu -o /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/cluster_gpu.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -O2 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_75,code=compute_75 -gencode=arch=compute_75,code=sm_75 -std=c++17
FAILED: /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/cluster_gpu.o 
/app/env/bin/nvcc --generate-dependencies-with-compile --dependency-output /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/cluster_gpu.o.d -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c -c /tmp/model/pc_util/src/cluster_gpu.cu -o /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/cluster_gpu.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -O2 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_75,code=compute_75 -gencode=arch=compute_75,code=sm_75 -std=c++17
<command-line>: fatal error: cuda_runtime.h: No such file or directory
compilation terminated.
[5/11] c++ -MMD -MF /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/ball_query.o.d -pthread -B /app/env/compiler_compat -Wno-unused-result -Wsign-compare -DNDEBUG -fwrapv -O2 -Wall -fPIC -O2 -isystem /app/env/include -fPIC -O2 -isystem /app/env/include -fPIC -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c -c /tmp/model/pc_util/src/ball_query.cpp -o /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/ball_query.o -g -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
FAILED: /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/ball_query.o 
c++ -MMD -MF /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/ball_query.o.d -pthread -B /app/env/compiler_compat -Wno-unused-result -Wsign-compare -DNDEBUG -fwrapv -O2 -Wall -fPIC -O2 -isystem /app/env/include -fPIC -O2 -isystem /app/env/include -fPIC -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c -c /tmp/model/pc_util/src/ball_query.cpp -o /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/ball_query.o -g -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
/tmp/model/pc_util/src/ball_query.cpp:4:10: fatal error: cuda.h: No such file or directory
    4 | #include <cuda.h>
      |          ^~~~~~~~
compilation terminated.
[6/11] c++ -MMD -MF /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/interpolate.o.d -pthread -B /app/env/compiler_compat -Wno-unused-result -Wsign-compare -DNDEBUG -fwrapv -O2 -Wall -fPIC -O2 -isystem /app/env/include -fPIC -O2 -isystem /app/env/include -fPIC -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c -c /tmp/model/pc_util/src/interpolate.cpp -o /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/interpolate.o -g -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
FAILED: /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/interpolate.o 
c++ -MMD -MF /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/interpolate.o.d -pthread -B /app/env/compiler_compat -Wno-unused-result -Wsign-compare -DNDEBUG -fwrapv -O2 -Wall -fPIC -O2 -isystem /app/env/include -fPIC -O2 -isystem /app/env/include -fPIC -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c -c /tmp/model/pc_util/src/interpolate.cpp -o /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/interpolate.o -g -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
/tmp/model/pc_util/src/interpolate.cpp:7:10: fatal error: cuda.h: No such file or directory
    7 | #include <cuda.h>
      |          ^~~~~~~~
compilation terminated.
[7/11] c++ -MMD -MF /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/cluster.o.d -pthread -B /app/env/compiler_compat -Wno-unused-result -Wsign-compare -DNDEBUG -fwrapv -O2 -Wall -fPIC -O2 -isystem /app/env/include -fPIC -O2 -isystem /app/env/include -fPIC -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c -c /tmp/model/pc_util/src/cluster.cpp -o /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/cluster.o -g -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
FAILED: /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/cluster.o 
c++ -MMD -MF /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/cluster.o.d -pthread -B /app/env/compiler_compat -Wno-unused-result -Wsign-compare -DNDEBUG -fwrapv -O2 -Wall -fPIC -O2 -isystem /app/env/include -fPIC -O2 -isystem /app/env/include -fPIC -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c -c /tmp/model/pc_util/src/cluster.cpp -o /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/cluster.o -g -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
/tmp/model/pc_util/src/cluster.cpp:4:10: fatal error: cuda.h: No such file or directory
    4 | #include <cuda.h>
      |          ^~~~~~~~
compilation terminated.
[8/11] c++ -MMD -MF /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/group_points.o.d -pthread -B /app/env/compiler_compat -Wno-unused-result -Wsign-compare -DNDEBUG -fwrapv -O2 -Wall -fPIC -O2 -isystem /app/env/include -fPIC -O2 -isystem /app/env/include -fPIC -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c -c /tmp/model/pc_util/src/group_points.cpp -o /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/group_points.o -g -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
FAILED: /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/group_points.o 
c++ -MMD -MF /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/group_points.o.d -pthread -B /app/env/compiler_compat -Wno-unused-result -Wsign-compare -DNDEBUG -fwrapv -O2 -Wall -fPIC -O2 -isystem /app/env/include -fPIC -O2 -isystem /app/env/include -fPIC -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c -c /tmp/model/pc_util/src/group_points.cpp -o /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/group_points.o -g -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
/tmp/model/pc_util/src/group_points.cpp:2:10: fatal error: cuda.h: No such file or directory
    2 | #include <cuda.h>
      |          ^~~~~~~~
compilation terminated.
[9/11] c++ -MMD -MF /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/pointnet2_api.o.d -pthread -B /app/env/compiler_compat -Wno-unused-result -Wsign-compare -DNDEBUG -fwrapv -O2 -Wall -fPIC -O2 -isystem /app/env/include -fPIC -O2 -isystem /app/env/include -fPIC -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c -c /tmp/model/pc_util/src/pointnet2_api.cpp -o /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/pointnet2_api.o -g -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
FAILED: /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/pointnet2_api.o 
c++ -MMD -MF /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/pointnet2_api.o.d -pthread -B /app/env/compiler_compat -Wno-unused-result -Wsign-compare -DNDEBUG -fwrapv -O2 -Wall -fPIC -O2 -isystem /app/env/include -fPIC -O2 -isystem /app/env/include -fPIC -I/app/env/lib/python3.10/site-packages/torch/include -I/app/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/app/env/lib/python3.10/site-packages/torch/include/TH -I/app/env/lib/python3.10/site-packages/torch/include/THC -I/app/env/include -I/app/env/include/python3.10 -c -c /tmp/model/pc_util/src/pointnet2_api.cpp -o /tmp/model/pc_util/build/temp.linux-x86_64-cpython-310/src/pointnet2_api.o -g -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=pc_util -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
In file included from /tmp/model/pc_util/src/pointnet2_api.cpp:4:
/tmp/model/pc_util/src/ball_query_gpu.h:6:10: fatal error: cuda.h: No such file or directory
    6 | #include <cuda.h>
      |          ^~~~~~~~
compilation terminated.
ninja: build stopped: subcommand failed.
Traceback (most recent call last):
  File "/app/env/lib/python3.10/site-packages/torch/utils/cpp_extension.py", line 2107, in _run_ninja_build
    subprocess.run(
  File "/app/env/lib/python3.10/subprocess.py", line 526, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['ninja', '-v']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):

Could you please provide info on 4f8ec596-71db-43df-a5e8-6e32f9e38628? Thanks!

@kc92

4f8ec596-71db-43df-a5e8-6e32f9e38628

ModuleNotFoundError: No module named 'skimage'

due to https://huggingface.co/spaces/usm3d/S23DR/discussions/1#6664d3cf3a64c70529a3d808 this should nolonger be an issue

could you please check this?
b08e399f-7080-4acd-909c-4331d40da31e

@colin1842

b08e399f-7080-4acd-909c-4331d40da31e

script.py: 100%|██████████| 12.2k/12.2k [00:00<00:00, 44.3MB/s]
2024-06-08 21:37:14.474 | INFO     | __main__:generate_submission_file:41 - Generating submission file
/tmp/model

Linking /tmp/data/data to data/usm-test-data-x/data (we are in the test environment)
The cache for model files in Transformers v4.22.0 has been updated. Migrating your old cache. This is a one-time only operation. You can interrupt this and resume the migration later on by calling `transformers.utils.move_cache()`.
0it [00:00, ?it/s]
0it [00:00, ?it/s]
running install
/app/env/lib/python3.10/site-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated.
!!

        ********************************************************************************
        Please avoid running ``setup.py`` directly.
        Instead, use pypa/build, pypa/installer or other
        standards-based tools.

        See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details.
        ********************************************************************************

!!
  self.initialize_options()
/app/env/lib/python3.10/site-packages/setuptools/_distutils/cmd.py:66: EasyInstallDeprecationWarning: easy_install command is deprecated.
!!

        ********************************************************************************
        Please avoid running ``setup.py`` and ``easy_install``.
        Instead, use pypa/build, pypa/installer or other
        standards-based tools.

        See https://github.com/pypa/setuptools/issues/917 for details.
        ********************************************************************************

!!
  self.initialize_options()
running bdist_egg
running egg_info
creating pc_util.egg-info
writing pc_util.egg-info/PKG-INFO
writing dependency_links to pc_util.egg-info/dependency_links.txt
writing top-level names to pc_util.egg-info/top_level.txt
writing manifest file 'pc_util.egg-info/SOURCES.txt'
reading manifest file 'pc_util.egg-info/SOURCES.txt'
writing manifest file 'pc_util.egg-info/SOURCES.txt'
installing library code to build/bdist.linux-x86_64/egg
running install_lib
running build_ext
error: [Errno 2] No such file or directory: '/usr/local/cuda/bin/nvcc'
Traceback (most recent call last):
  File "/tmp/model/script.py", line 269, in <module>
    setup_environment()
  File "/tmp/model/script.py", line 234, in setup_environment
    subprocess.check_call([sys.executable, "setup.py", "install"], cwd=pc_util_path)
  File "/app/env/lib/python3.10/subprocess.py", line 369, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['/app/env/bin/python', 'setup.py', 'install']' returned non-zero exit status 1.

0c5eb9f4-aaf9-496c-b882-d4dcf9b7dd95

@colin1842

0c5eb9f4-aaf9-496c-b882-d4dcf9b7dd95

Traceback (most recent call last):
  File "/tmp/model/script.py", line 116, in <module>
    from utils import common_utils
  File "/tmp/model/utils/common_utils.py", line 5, in <module>
    from easydict import EasyDict
ModuleNotFoundError: No module named 'easydict'

I've added easydict to the global requirements.txt

32607fee-ac2f-4d08-8e03-f9308f8d6353

@colin1842

32607fee-ac2f-4d08-8e03-f9308f8d6353

test: 0%| | 0/1 [00:00<?, ?it/s]CUDA kernel failed : no kernel image is available for execution on the device

87a66b43-aadb-4baf-8ac4-4552a634a12c

  0%|          | 0/1 [00:00<?, ?it/s]
Processing entries: 1it [00:02,  2.71s/it]
2024-06-10 10:05:33.726 | INFO     | __main__:generate_submission_file:74 - Subprocess terminated successfully
2024-06-10 10:05:33.726 | INFO     | __main__:generate_submission_file:76 - contents of submission_dir
2024-06-10 10:05:33.727 | INFO     | __main__:generate_submission_file:77 - ['params.json', '.gitattributes', 'LICENSE', 'README.md', '_script.py', 'checkpoint_epoch_90.pth', 'dataset', 'format_dataset.py', 'handcrafted_solution.py', 'hoho_train_checkpoint_epoch_90.pth', 'model', 'model_cfg.yaml', 'output', 'pc_util.cpython-310-x86_64-linux-gnu.so', 'pc_util.py', 'pc_util', 'pointnet2.py', 'script.py', 'test.py', 'test_util.py', 'train.py', 'train_utils.py', 'utils', 'wandb', 'socket-kit.so', 'data', '__pycache__']

And then it didn't save to submission.parquet

38311405-94bb-44e2-bd59-5a0a6397aa02
could u please check this?

135f90c7-e620-4de3-b6d1-a38a8ca00983?

@colin1842

38311405-94bb-44e2-bd59-5a0a6397aa02

you are trying to download Downloading: "http://__________.cz/_____-/models/_______.ckpt" to /app/.cache/torch/hub/checkpoints/____.ckpt

@kc92

135f90c7-e620-4de3-b6d1-a38a8ca00983?

Traceback (most recent call last):
  File "/tmp/model/script.py", line 142, in <module>
    pred_vertices, pred_edges = my_submission(house_data, local = local)        
  File "/tmp/model/script.py", line 91, in my_submission
    house_data.triangulate_all_2d_corner_pairs_new()
  File "/tmp/model/solution.py", line 660, in triangulate_all_2d_corner_pairs_new
    triangulated_corners, vertex_types, image_vertex_inds = triangulate_from_viewpoints(Ks = self.Ks, 
  File "/tmp/model/utils.py", line 148, in triangulate_from_viewpoints
    assert len(Ks) == len(Rs) == len(ts) == len(vertices)
AssertionError