InferLLM

MegEngine

a lightweight LLM model inference framework

mobile

View on GitHub

739 Stars

92 Forks

739 Watchers

C++ Language

apache-2.0 License

Cost to Build

$345.6K

Market Value

$1.24M

How is this calculated?

Growth over time

1 data points · 2025-09-21 → 2025-09-21

Stars Forks Watchers

💬

How do you feel about this project?

Ask AI about InferLLM

Question copied to clipboard

What is the MegEngine/InferLLM GitHub project? Description: "a lightweight LLM model inference framework". Written in C++. Explain what it does, its main use cases, key features, and who would benefit from using it.

Question is copied to clipboard — paste it after the AI opens.

How to clone InferLLM

Clone via HTTPS

git clone https://github.com/MegEngine/InferLLM.git

Clone via SSH

[email protected]:MegEngine/InferLLM.git

Download ZIP

Download master.zip

Found an issue?

Report bugs or request features on the InferLLM issue tracker:

Open GitHub Issues

Similar to InferLLM

ionic-framework awesome-react-native NativeScript flutter fastlane weex framework7 framework realm-swift matomo realm-java reactjs101 interact.js Paddle-Lite awesome-test-automation mobi.css awesome-flutter gwt-polymer-elements rax wcdb metrica-sdk-ios vue-ydui slinky mint-ui neutrino mobile-web-favorites Avalonia Yampa Android-Cookbook-Examples the_forge