Grok 1 (PyTorch Version) This repository contains the model and weights of the torch version of Grok 1 open weights model. You could find a complete example code of using the torch version Grok 1 in ColossalAI GitHub Repository. We also applies parallelism techniques from ColossalAI framework (Tensor Parallelism for now) to accelerate the inference. You could find the original weights released by xAI in Hugging Face and the original model in the Grok open release GitHub Repository. Conversion We translated the original modeling written in JAX into PyTorch version, and converted the weights by mapping tensor files with parameter keys, de quantizing the tensors with corresponding packed scales, and save to checkpoint file with torch APIs. A transformers compatible version of tokenizer is contributed by Xenova and ArthurZ. Usage Note: A multi GPU machine is required to test the model with the example code (For now, a 8x80G multi GPU machine is required).
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy