Home Neural Network SYCL for llama.cpp.python – Intel Group

SYCL for llama.cpp.python – Intel Group

0
SYCL for llama.cpp.python – Intel Group

[ad_1]

I am attempting to make use of SYCL as my {hardware} acclerator for utilizing my GPU in Home windows 10
My GPU is 

Pre2802_0-1712208574092.png

I’ve put in intel OneAPI toolkit.
Im not ready to make use of my GPU regardless of doing the next instructions in command immediate
1. I ran my setvars.bat file in C:Program Information (x86)InteloneAPI listing
2. set CMAKE_ARGS=”-DLLAMA_SYCL=on -DCMAKE_C_COMPILER=icx -DCMAKE_CXX_COMPILER=icpx”
3. set FORCE_CMAKE=1
4. pip set up llama-cpp-python –force-reinstall –upgrade –no-cache-dir –verbose

The llama-cpp-python will get put in correctly however I am getting error when am loading the import assertion

Python 3.11.6 (tags/v3.11.6:8b6ee5b, Oct 2 2023, 14:57:12) [MSC v.1935 64 bit (AMD64)] on win32 Sort “assist”, “copyright”, “credit” or “license” for extra info. >>> from llama_cpp import Llama Traceback (most up-to-date name final): File “C:PythonPython311site-packagesllama_cppllama_cpp.py”, line 70, in _load_shared_library return ctypes.CDLL(str(_lib_path), **cdll_args) # sort: ignore ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File “C:Program FilesPython311Libctypes__init__.py”, line 376, in __init__ self._handle = _dlopen(self._name, mode) ^^^^^^^^^^^^^^^^^^^^^^^^^ OSError: [WinError 193] %1 isn’t a sound Win32 software Throughout dealing with of the above exception, one other exception occurred: Traceback (most up-to-date name final): File “<stdin>”, line 1, in <module> File “C:PythonPython311site-packagesllama_cpp__init__.py”, line 1, in <module> from .llama_cpp import * File “C:PythonPython311site-packagesllama_cppllama_cpp.py”, line 83, in <module> _lib = _load_shared_library(_lib_base_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File “C:PythonPython311site-packagesllama_cppllama_cpp.py”, line 72, in _load_shared_library elevate RuntimeError(f”Did not load shared library ‘{_lib_path}’: {e}”) RuntimeError: Did not load shared library ‘C:PythonPython311site-packagesllama_cppllama.dll’: [WinError 193] %1 isn’t a sound Win32 software

Pre2802_1-1712209751224.png

 

[ad_2]