⚙️ Image setup¶
Image¶
| Component | Version |
|---|---|
| OS | Ubuntu 22.04 x86_64 |
| Python | 3.11.x |
| PyTorch | 2.9.1 |
| CUDA | 12.8 |
| Triton | 3.5.1 |
| onnxruntime-gpu | 1.22.x |
| ComfyUI | 0.6.0 |
| CodeServer | Latest |
Wheels¶
| Package | Version |
|---|---|
| flash_attn | 2.8.3 |
| sageattention | 2.2.0 |
| torch_generic_nms | 0.1 |
| llmama-cpp | 0.3.16 |
Optimised¶
| Processor example | Compute Capability | Family | SM |
|---|---|---|---|
| A40 | 8.6 | Ampere | sm_86 |
| L40S | 8.9 | Ada Lovelace | sm_89 |