Skip to content

Cluster

Admins only.

Cluster

The DGX boxes behind Garrison: the topology (one box, a pair, a box plus a pair), the number of boxes, total unified memory and models served. One card per box shows:

  • its name, address and status (joined, pending);
  • its roles (control, gateway, observability, inference) and GPU;
  • memory and free memory, free disk, serial number;
  • Desktop GUI: headless frees about 2 GiB for models; Bring the desktop back reverses it;
  • Runs: the models (highlighted) and the platform services on it.

Add boxes joins more boxes: see Add boxes.