This model is copied from https://huggingface.co/yuhuili/EAGLE llama2 chat 7B with the following modifications to make it compatible with SGLang: Modify the architecture in config.json to LlamaForCausalLMEagle
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy