Small dummy LLama2 type Model useable for Unit/Integration tests. Suitable for CPU only machines, see H2O LLM Studio for an example integration test. Model was created as follows: Below is a small example that will run in ~ 1 second. Tipp: Use fixtures with session scope to load the model only once. This will decrease test runtime further.
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy