-
Notifications
You must be signed in to change notification settings - Fork 37
Description
root@eeb5a07d9aa0:/# bash /workspace/run.sh --llm --svc_config_path /workspace/svc.yaml --port 8081
2026-02-03 16:05:07.411 | INFO | main::221 - ['/workspace/run.py', '--llm', '--svc_config_path', '/workspace/svc.yaml', '--port', '8081']
2026-02-03 16:05:07.415 | INFO | main::227 - args.debug: False
Namespace(svc_config_path='/workspace/svc.yaml', sys_config_path=None, apollo_id=None, apollo_cluster=None, apollo_ns=None, apollo_env=None, apollo_svc=None, apollo_sys=None, workflow_init_wait=3600, stub_init_sync_timeout=3600, process_timeout=3600000, offline_batching=False, debug=False, llm=True)
2026-02-03 16:05:07.417 | INFO | main::258 - [Notice] Tap 'Ctrl+C' to exit all processes.
2026-02-03 16:05:07.426 | INFO | main:exec_command:95 - child_pids [603, 604]
red_serving: error while loading shared libraries: /lib/x86_64-linux-gnu/libnvidia-ml.so.1: file too short
2026-02-03 16:05:07.429 | INFO | main::261 - [Warning] redserving exited
2026-02-03 16:05:07.430 | INFO | main::265 - [Warning] python_stub exited