Update leap-bundle docs for new GGUF support #36
Merged
+49
−28
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
- Update quick-start.mdx to document GGUF as default inference engine - Update cli-spec.mdx with --executorch flag and GGUF quantization options - Add v0.9.0 changelog entry for GGUF bundling features Co-Authored-By: Liren <tuliren@gmail.com>
Contributor
Author
🤖 Devin AI EngineerI'll be helping with this pull request! Here's what you should know: ✅ I will automatically:
Note: I can only respond to comments from users who have write access to this repository. ⚙️ Control Options:
|
|
The latest updates on your projects. Learn more about Vercel for GitHub.
|
tuliren
requested changes
Jan 2, 2026
Contributor
tuliren
left a comment
tuliren
left a comment
There was a problem hiding this comment.
Note in the doc that executorch inference is deprecated, and may be removed in a future version.
…tion link Co-Authored-By: Liren <tuliren@gmail.com>
tuliren
changed the title
tuliren
approved these changes
Jan 2, 2026
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Summary
Updates the leap-bundle documentation to reflect that GGUF is now the default inference engine for model bundling (generating
.gguffiles for llama.cpp), with ExecuteTorch available via the--executorchflag.Changes across three files:
--executorchflag, updated--quantizationoptions for both engines, added--mmproj-quantizationoption for VL/audio modelsUpdates since last revision
Addressed PR feedback:
Review & Testing Checklist for Human
--executorchflag name matches the actual CLI implementation--mmproj-quantizationvalid options (q4, q8, f16) and default (q8) are correctRecommended test plan:
leap-bundle create --helpand verify the documented options match.gguf--executorchand verify it produces.bundleNotes
Documentation changes only - no code changes. I referenced the source code in
leap/apps/leap-bundle-pyto understand the implementation but could not test the CLI directly.Link to Devin run: https://app.devin.ai/sessions/a0796c785423493fb2205ed3458ba6e9
Requested by: Liren (liren@liquid.ai) / @tuliren