Add gpu metrics to system_metrics.csv#226
Conversation
| from typing import List, Literal, Optional, Tuple | ||
| from uuid import UUID | ||
|
|
||
| import GPUtil |
There was a problem hiding this comment.
This project is not maintained: https://pypi.org/project/GPUtil
Do you know if nvidia-smi is stable?
There was a problem hiding this comment.
From my testing GPUtil works great and we were already using it in the task-runner. Should we switch for another library?
I'm not sure, but wouldn't nvidia-smi only work on nvidia GPUs? We might need to support other types of GPU's (e.g. local machines)
There was a problem hiding this comment.
Please check this comment: https://github.com/inductiva/tasks/issues/1141#issuecomment-2969830897
Unfortunately, the current library and the others I mentioned in that comment are just wrappers of nvidia-smi. It might be enough for now, but if we want to run on different GPUs we may need to research an alternative.
3 participants
For https://github.com/inductiva/console-web/pull/904