Tencent Releases Hy4 Large Language Model with Visual Understanding and Computer-Use Capabilities

Introduction of Hy4 Model

Tencent announced the release of Hy4, its latest large language model. This model is positioned among the world's leading open-source AI models due to its performance and new capabilities. Tencent plans to release model weights and system cards in the near future, emphasizing responsible open-source AI development with a focus on cybersecurity and biological safety.

New Capabilities and Performance Improvements

Hy4 introduces visual understanding capabilities for the first time, alongside improvements in instruction following, long-context comprehension, and long-horizon agentic tasks. These enhancements contribute to stronger overall performance across various applications. The model supports tasks such as fine-grained image processing, complex chart analysis, and mathematical visual reasoning through its advanced visual understanding, reasoning, and tool-calling features.

Computer-Use Functionality

A new feature in Hy4 is its computer-use capability, allowing it to interact with both command-line interfaces and graphical user interfaces. This enables the model to perform a range of work and everyday tasks. Hy4 has undergone specialized training on professional software like Blender and CAD, which enhances its ability to plan and execute complex, long-horizon tasks.

Real-World Productivity Applications

Hy4's foundational capabilities and model-product co-design are applied to real-world productivity scenarios. In office productivity and collaboration, Hy4 has improved the user experience on Tencent WorkBuddy. Benchmarks on WorkBuddy show an average performance score of 83.18 and a 96.15 percent pass rate, with Hy4 ranking first in nine out of twelve scenarios in the mainland Chinese market. It also improves visual creative tasks, 3D scene construction, web development, document presentation, stability, and usability for human-AI collaborative tasks on WorkBuddy.

Integration with Workflow

With enhanced in-context learning, Hy4 can understand complex information from diverse sources. Integrated with WeCom via WorkBuddy, Hy4 connects with daily workflow data from chats, emails, documents, calendars, and meetings. This allows it to automatically track projects when managing multiple tasks simultaneously.