UniSpark: Exploring Hybrid Attention for Multimodal Understanding and Generation
We present UniSpark-9B, a unified multimodal model that investigates hybrid attention for visual understanding and generation. Built on a Mixture-of-Transformer-Experts backbone with approximately 9B
- Upvotes7