[ad_1]
I am attempting to make use of SYCL as my {hardware} acclerator for utilizing my GPU in Home windows 10
My GPU is
I’ve put in intel OneAPI toolkit.
Im not ready to make use of my GPU regardless of doing the next instructions in command immediate
1. I ran my setvars.bat file in C:Program Information (x86)InteloneAPI listing
2. set CMAKE_ARGS=”-DLLAMA_SYCL=on -DCMAKE_C_COMPILER=icx -DCMAKE_CXX_COMPILER=icpx”
3. set FORCE_CMAKE=1
4. pip set up llama-cpp-python –force-reinstall –upgrade –no-cache-dir –verbose
The llama-cpp-python will get put in correctly however I am getting error when am loading the import assertion
Python 3.11.6 (tags/v3.11.6:8b6ee5b, Oct 2 2023, 14:57:12) [MSC v.1935 64 bit (AMD64)] on win32 Sort “assist”, “copyright”, “credit” or “license” for extra info. >>> from llama_cpp import Llama Traceback (most up-to-date name final): File “C:PythonPython311site-packagesllama_cppllama_cpp.py”, line 70, in _load_shared_library return ctypes.CDLL(str(_lib_path), **cdll_args) # sort: ignore ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File “C:Program FilesPython311Libctypes__init__.py”, line 376, in __init__ self._handle = _dlopen(self._name, mode) ^^^^^^^^^^^^^^^^^^^^^^^^^ OSError: [WinError 193] %1 isn’t a sound Win32 software Throughout dealing with of the above exception, one other exception occurred: Traceback (most up-to-date name final): File “<stdin>”, line 1, in <module> File “C:PythonPython311site-packagesllama_cpp__init__.py”, line 1, in <module> from .llama_cpp import * File “C:PythonPython311site-packagesllama_cppllama_cpp.py”, line 83, in <module> _lib = _load_shared_library(_lib_base_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File “C:PythonPython311site-packagesllama_cppllama_cpp.py”, line 72, in _load_shared_library elevate RuntimeError(f”Did not load shared library ‘{_lib_path}’: {e}”) RuntimeError: Did not load shared library ‘C:PythonPython311site-packagesllama_cppllama.dll’: [WinError 193] %1 isn’t a sound Win32 software
[ad_2]