litert community/Qwen2.5 1.5B Instruct This model provides a few variants of Qwen/Qwen2.5 1.5B Instruct that are ready for deployment on Android using the LiteRT (fka TFLite) stack, MediaPipe LLM Inference API and LiteRT LM. Use the models Colab Disclaimer: The target deployment surface for the LiteRT models is Android/iOS/Web and the stack has been optimized for performance on these targets. Trying out the system in Colab is an easier way to familiarize yourself with the LiteRT stack, with the caveat that the performance (memory and latency) on Colab could be much worse than on a local device. Android Edge Gallery App Download or build the app from GitHub. Install the app from Google Play. Follow the instructions in the app. LLM Inference API Download and install the apk. Follow the instructions in the app. To build the demo app from source, please follow the instructions from the GitHub repository. iOS Clone the MediaPipe samples repository and follow the instructions to build the LLM Inference iOS Sample App using XCode. Run the app via the iOS simulator or deploy to an iOS device. Performance Android Note that all benchmark stats are from a Samsung S25 Ultra and multiple prefil…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy