rpc : add command line option for number of threads for the CPU backend #13060

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Merged

rgerganov merged 1 commit into ggml-org:master from rgerganov:rpc-threads

Apr 23, 2025

Collaborator

rgerganov commented Apr 22, 2025

closes #13051

github-actions bot added the examples label

rgerganov force-pushed the rpc-threads branch 2 times, most recently from 9f3829b to 65de9f5 Compare

April 22, 2025 09:33

ggerganov approved these changes

View reviewed changes

Member

ggerganov left a comment

To fix the builds, define NOMINMAX before including windows.h:

diff --git a/examples/rpc/rpc-server.cpp b/examples/rpc/rpc-server.cpp
index 5f42e019..0277e25c 100644
--- a/examples/rpc/rpc-server.cpp
+++ b/examples/rpc/rpc-server.cpp
@@ -22,6 +22,7 @@
 
 #include "ggml-rpc.h"
 #ifdef _WIN32
+#  define NOMINMAX
 #  define DIRECTORY_SEPARATOR '\\'
 #  include <locale>
 #  include <windows.h>


          rpc : add command line option for number of threads for the CPU backend

3535f08

closes ggml-org#13051

rgerganov force-pushed the rpc-threads branch from 65de9f5 to 3535f08 Compare

April 22, 2025 12:31

rgerganov merged commit 2cca6c0 into ggml-org:master

48 checks passed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels