Documentation
README
Graphsignal Profiler
Graphsignal observes inference workloads from a sidecar process — the profiler. It never shares a process with CUDA: the profiler watches the workload externally via CUPTI, OTLP/gRPC, Prometheus scraping, and NVML. Auto-instrumentation covers vLLM, SGLang, and PyTorch out of the box.
Install
Two install patterns depending on how you'll launch the profiler.
For graphsignal-run (CLI, recommended): install as a uv tool, isolated from your workload env.
UV_TOOL_BIN_DIR=/usr/local/bin uv tool install 'graphsignal[cu12]' # CUDA 12.x
# or
UV_TOOL_BIN_DIR=/usr/local/bin uv tool install 'graphsignal[cu13]' # CUDA 13.x
This is the opening of the README. Read the full README on GitHub.