Hello,
I'm not a C++ developer so my error might sounds pretty simple, I'm sorry for that.
I have a llama.cpp installation which works on my Macbook M3. I want to use your solution to integrate llama in my projects.
I pulled your project and followed the build instructions :
mkdir -p build && cd build
cmake .. -DCMAKE_APPLE_SILICON_PROCESSOR=arm64
The first time, I had a first error telling me that the metal file does not exist :
/grpc-llama.cpp/third_party/llama.cpp/ggml-metal.metal does not exist.
So I copy pasted ggml-metal.h, ggml-metal.m, ggml-metal.metal and ggml-metal.o from the llama.cpp repo (in case it needs all of them) in the indicated directory (which was not existing when I pulled), and now the error is gone.
So I retried the installation, but now I receive this error :
-- Accelerate framework found
-- Metal framework found
-- CMAKE_SYSTEM_PROCESSOR: arm64
-- ARM detected
CMake Error at build/_deps/llama.cpp-src/examples/metal/CMakeLists.txt:3 (install):
install TARGETS given target "grpc-server" which does not exist.
I'm not able to understand the problem here as I don't understand the C++, I'm relying on your gRPC implementation to be able to include it in my projects.
Can you please help me to install and run it locally ?
Hello,
I'm not a C++ developer so my error might sounds pretty simple, I'm sorry for that.
I have a llama.cpp installation which works on my Macbook M3. I want to use your solution to integrate llama in my projects.
I pulled your project and followed the build instructions :
The first time, I had a first error telling me that the metal file does not exist :
So I copy pasted
ggml-metal.h,ggml-metal.m,ggml-metal.metalandggml-metal.ofrom the llama.cpp repo (in case it needs all of them) in the indicated directory (which was not existing when I pulled), and now the error is gone.So I retried the installation, but now I receive this error :
I'm not able to understand the problem here as I don't understand the C++, I'm relying on your gRPC implementation to be able to include it in my projects.
Can you please help me to install and run it locally ?