Quick alternative measurement of pod startup latency#1
Quick alternative measurement of pod startup latency#1waltforme wants to merge 21 commits intodumb0002:vllm-testfrom
Conversation
…OCP clusters) Signed-off-by: Braulio Dumba <brauliodumba@gmail.com> Signed-off-by: Braulio Dumba <brauliodumba@gmail.com> Signed-off-by: Braulio Dumba <brauliodumba@gmail.com>
Signed-off-by: Braulio Dumba <brauliodumba@gmail.com>
Signed-off-by: Braulio Dumba <brauliodumba@gmail.com>
Signed-off-by: Braulio Dumba <brauliodumba@gmail.com>
Signed-off-by: Braulio Dumba <brauliodumba@gmail.com>
Signed-off-by: Braulio Dumba <brauliodumba@gmail.com>
Signed-off-by: Braulio Dumba <brauliodumba@gmail.com>
Signed-off-by: Braulio Dumba <brauliodumba@gmail.com>
Signed-off-by: Braulio Dumba <brauliodumba@gmail.com>
Signed-off-by: Jun Duan <jun.duan.phd@outlook.com>
| CLEANUP=${CLEANUP:-false} | ||
|
|
||
| # For MacOS, `brew install coreutils` can make gdate available, if necessary | ||
| START_TIME=$(gdate +%s%3N) |
There was a problem hiding this comment.
bash-3.2$ gdate
bash: gdate: command not foundThere was a problem hiding this comment.
Hi @MikeSpreitzer , this script is supposed to be used from a Mac (which establishes VPN connection to intranet), from where are you trying this?
|
I tested it but I am not sure that it run properly as I see some error messages:
Maybe making it clear from which directory the script needs to be run from will fix this error? |
Signed-off-by: Jun Duan <jun.duan.phd@outlook.com>
|
Sure, done in the latest commit.
|
dumb0002
force-pushed
the
vllm-test
branch
2 times, most recently
from
1bd3d70 to
2b405bb
Compare
3 participants
This PR is a quick alternative of the ClusterLoader-based method to measure vLLM server's pod startup latency. It can and should retire when the ClusterLoader-based method is readily working with OpenShift.