vLLM container (and instructions) to run this on SM120 forthcoming until then it may be difficult to run this due to the specialized kernels required.
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy