This is a tiny, dummy version of Jamba, used for debugging and experimentation over the Jamba architecture. It has 128M parameters (instead of 52B), and is initialized with random weights and did not undergo any training.
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy