마이크로소프트 'Lens', 모델 크기보다 상세한 캡션의 중요성 입증

Microsoft Research's Lens proves detailed captions matter more than raw scale for training efficient image generators Jonathan Kemper View the LinkedIn Profile of Jonathan Kemper Jun 8, 2026 Microsoft Research While Microsoft's MAI team grabs the spotlight with souped-up image models, Microsoft Research is proving how far you can go with limited compute, thanks to detailed captions and smart architecture choices. Microsoft Research is introducing Lens, a text-to-image model that aims to compete with much larger rivals while using a fraction of the compute during training. According to the technical report, Lens needs roughly one-fifth the compute that comparable models like Z-Image require for pre-training. It beats models many times its size across several benchmarks. Hunyuan-Image-3.0, for example, has about 80 billion parameters. Lens has just 3.8 billion. Rich captions matter more than raw data volume The researchers credit the efficiency gains to a more compact model, more usable information per training step, and a training process that converges with fewer passes. The Lens-800M dataset sits at the center of this approach: 800 million image-text pairs with captions generated by GPT-4.1 . At an average of roughly 100 words, these captions are far more detailed than standard alt-text scraped from the web. An ablation study shows that training with these long descriptions produces clearly better results than short or mixed captions, according to Microsoft. Web alt-text is often vague or flat-out wrong, which dilutes the learning signal. The team also mixes different resolutions and aspect ratios—portrait through landscape—in each training batch. Even though the model was trained on a fixed set of image sizes, it generalizes to unseen formats and resolutions up to about two megapixels, the researchers say. That saves costly training runs on high-resolution data. For the architecture, the team tested several variants of variational autoencoders, which handle the translation between pixels and a compressed image space. Rather than relying on standard reconstruction metrics, Microsoft tested candidates directly in text-to-image training. The semantic VAE from FLUX.2 performed best and also sped up convergence. The text encoder is GPT-OSS , an openly available language model from OpenAI. Stronger language encoders bring two benefits, according to the ablations: the model learns faster and can handle inputs in languages it was never trained on. Lens was trained only on English image-text pairs, but it accepts prompts in Chinese, French, Japanese, or Spanish. Stronger language encoders also improved prompt fidelity. A reasoner rewrites vague user prompts After pre-training, the model goes through a reinforcement learning phase using a custom prompt set called Lens-RL-8K. The prompts cover ten categories, including people, animals, scenes, food, fictional worlds, and UI design. GPT-4.1 generates matching evaluation criteria for each prompt, and a smaller GPT-4.1-mini serves as the reward model. An ablation shows that shrinking the RL set or removing a category like text-heavy prompts hurts performance in the affected areas. Diversity in the RL prompts matters more than sheer volume. Microsoft places a reasoner in front of the actual image model. It rewrites vague user inputs into detailed prompts. The default is GPT-5.5, but GPT-OSS, already used as the text encoder, works too without needing extra memory. Microsoft also describes a method for iteratively improving the reasoner's system prompt without any additional training. The researchers say this strategy transferred well to the much larger Qwen-Image and showed positive effects there too. Lens-Turbo generates images in under a second For faster inference, Microsoft built a distilled variant called Lens-Turbo that generates an image in just four steps. The standard model takes about three seconds for a one-megapixel image on an H100 GPU. Lens-Turbo does it in under a second. Across benchmarks for prompt fidelity, text rendering, and complex scenes, Lens outperforms FLUX.2-Klein and Z-Image, and in some cases beats Qwen-Image , which has five times as many parameters, according to the report. The team acknowledges weaknesses in rendering text in languages like Japanese or French, which they attribute to gaps in data coverage. Microsoft has released Lens's code and model checkpoints under the MIT license. The model weights are available on Hugging Face , and the inference code is in the GitHub repository . Microsoft notes that Lens is intended for research only and isn't cleared for production use. Because the training data partly comes from web sources, the model can generate biased or problematic content, so users need to add their own safety measures. Microsoft's MAI team, led by Mustafa Suleyman, recently shipped its own image models for consumer products. MAI-Image-2 and its successor MAI-Image-2.5 landed in third place on the Arena.ai leaderboard, on par with Google's Nano Banana 2 but behind OpenAI's ChatGPT Images 2.0 . AI News Without the Hype – Curated by Humans Subscribe to THE DECODER for ad-free reading, a weekly AI newsletter, our exclusive "AI Radar" frontier report six times a year, full archive access, and access to our comment section. Subscribe now --> Read on for the full picture. Subscribe for hype-free coverage. Access to all THE DECODER articles. Read without distractions – no Google ads. Access to comments and community discussions. Weekly AI newsletter. 6 times a year: “AI Radar” – deep dives on key AI topics. Up to 25 % off on KI Pro online events. Access to our full ten-year archive. Get the latest AI news from The Decoder. Subscribe to The Decoder -->