Apple has introduced LensVLM, a 9B Vision Language Model (VLM) designed to process long textual contexts more efficiently. The model operates by initially scanning compressed images of text documents.
A core feature of LensVLM is its ability to selectively expand only the relevant pages from their compressed visual representation. This expansion is performed using learned tools, allowing the model to focus computational resources on pertinent information rather than processing an entire uncompressed document.
The LensVLM model files, including Apple's modifications to the Qwen model, are provided under the Apple Machine Learning Research Model License. The accompanying source code is distributed separately under the Apple Sample Code License. Both are available on GitHub.
Users can install LensVLM and run inference via a provided script, specifying the model and compression options (5x, 10x, 15x). The repository includes instructions for data preparation and evaluation. The model's paper, "LensVLM: Selective Context Expansion for Compressed Visual Representation of Text," is available on arXiv.
✨ This summary was generated by AI from the outlets' reporting listed below. It is not independently verified and may contain errors — check the original sources. How BrevFeed works →
One email each morning: the day's tech stories, clustered across outlets and summarized. No account needed.
One email a day. Unsubscribe in one click, any time.
Spend a few minutes, get the whole day. Every topic's top stories in one hands-free rundown — listen, watch, or read the transcript.
▶ Play today's briefNew every morning, and the back catalogue is archived by date.
Apple has released LensVLM, a 9B Vision Language Model (VLM) that processes compressed text images and expands only relevant pages. This model uses learned tools to selectively uncompress pertinent sections, offering a new approach to handling long document contexts.