THE RESEARCH ATLAS

Multimodal AI papers

Language, images, speech and video. Explore cross-modal representations and generative systems without collapsing distinct capabilities into one ranking.

2026-10-13 · Google · Model cardGlobal research organization · Google / Google DeepMind 🇺🇸 United States · 🇬🇧 United Kingdom

Gemini 4 Argon — Model Card

Official model documentation covering evaluation, limitations and safety considerations. The date records the listed model-card update.

2026-10-06 · Google · Model cardGlobal research organization · Google / Google DeepMind 🇺🇸 United States · 🇬🇧 United Kingdom

Nano Banana 2.1 — Model Card

Official documentation for an image-and-text model, including inputs, outputs, architecture dependencies and safety evaluation.

2026-10 · Academic · Research paperAffiliations not yet verified · Academic ◌ Affiliations not yet verified

FACT: A Multimodal Force-Action-Track Foundation Model for Human-to-Robot Dexterity

Human and robot demonstrations are combined with force-aware planning for dexterous manipulation.

2026-09-28 · Unitree · Official open-source projectInstitution base · Unitree Robotics 🇨🇳 China

UnifoLM-WLA-1.0: One Model Driven, Whole-Body Coordination

Connects embodied understanding, interaction-centric world modeling and action learning for tabletop and whole-body humanoid manipulation.

2026-09-21 · Qwen · Technical reportInstitution base · Alibaba Qwen 🇨🇳 China

Qwen-Audio-Agent Technical Report

A foreground-background architecture separates voice interaction from asynchronous task execution, coordinating authorization, state and delivery.

2026-09-10 · DeepSeek · Official research articleInstitution base · DeepSeek 🇨🇳 China

DeepSeek-V4.1-Flash: smarter, faster, more efficient

Official release introducing an asymmetric causal encoder-decoder architecture and linking its technical report and model resources.

2026-06-25 · Qwen · Technical reportInstitution base · Alibaba Qwen 🇨🇳 China

Qwen-Image-2.0-RL Technical Report

A diffusion-model post-training pipeline combines task-specific rewards, reinforcement learning and on-policy distillation.

2026-06-15 · Qwen · Technical reportInstitution base · Alibaba Qwen 🇨🇳 China

Qwen-RobotWorld Technical Report: Unifying Embodied World Modeling through Language-Conditioned Video Generation

A language-conditioned video world model predicts future visual trajectories across manipulation, navigation and driving settings.

2026-04-01 · XPeng · Official research articleInstitution base · XPeng 🇨🇳 China

XPeng X-World: Controllable Multi-View Generative World Model for Autonomous Driving

Describes a controllable multi-view world model used for driving simulation, scenario generation, and evaluation.

2026-04 · Qwen · Technical reportInstitution base · Alibaba Qwen 🇨🇳 China

Qwen3.5-Omni Technical Report

The report explores an omni-modal model family and training over heterogeneous visual, textual and audio data.

2026-03 · Academic · Research paperAffiliations not yet verified · Academic ◌ Affiliations not yet verified

UniDex: A Robot Foundation Suite for Universal Dexterous Hand Control from Egocentric Human Videos

A dataset, VLA policy and capture setup connect human demonstrations to control across different dexterous hands.

2026-02-02 · Kimi · Research paperInstitution base · Moonshot AI · Kimi 🇨🇳 China

Kimi K2.5: Visual Agentic Intelligence

Studies joint visual-language training and multi-agent task decomposition in an open multimodal model.

2026-01-29 · Unitree · Official open-source projectInstitution base · Unitree Robotics 🇨🇳 China

UnifoLM-VLA-0: A Vision-Language-Action (VLA) Framework under UnifoLM Family

Continues training on robot manipulation data, connecting visual-language understanding and spatial instructions to action prediction.

2026-01 · Qwen · Technical reportInstitution base · Alibaba Qwen 🇨🇳 China

Qwen3-ASR Technical Report

A speech-recognition family and a forced-alignment model address multilingual transcription and timestamp prediction.

2025-11 · Qwen · Technical reportInstitution base · Alibaba Qwen 🇨🇳 China

Qwen3-VL Technical Report

The Qwen vision-language family integrates text, image and video understanding across several model sizes.

2025-10-30 · NVIDIA · Research paperInstitution base · NVIDIA 🇺🇸 United States

Alpamayo-R1: Bridging Reasoning and Action Prediction for Generalizable Autonomous Driving in the Long Tail

Connects driving reasoning and action prediction through Cosmos-Reason and a diffusion trajectory decoder, studying reasoning-action consistency.

2025-07 · Google · Technical reportGlobal research organization · Google / Google DeepMind 🇺🇸 United States · 🇬🇧 United Kingdom

Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilities

An industrial model-family report covering reasoning, multimodal input, long contexts and agent-related evaluations.

2025-03 · NVIDIA · Research paperInstitution base · NVIDIA 🇺🇸 United States

GR00T N1: An Open Foundation Model for Generalist Humanoid Robots

A coupled vision-language and diffusion architecture combines reasoning with continuous robot-action generation.

2025-03 · Google · Technical reportGlobal research organization · Google / Google DeepMind 🇺🇸 United States · 🇬🇧 United Kingdom

Gemini Robotics: Bringing AI into the Physical World

Gemini-based models address robot manipulation and embodied reasoning, connecting multimodal understanding with physical control.

2025-01-07 · NVIDIA · Technical reportInstitution base · NVIDIA 🇺🇸 United States

Cosmos World Foundation Model Platform for Physical AI

A platform of video curation, tokenizers, pretrained world models and post-training for physical-AI applications.

2024-10-30 · Waymo · Research paperInstitution base · Waymo 🇺🇸 United States

EMMA: End-to-End Multimodal Model for Autonomous Driving

Builds on Gemini to predict driving trajectories, perception objects and road structure from camera inputs and text.

2024-08-01 · Meta FAIR · Research paperInstitution base · Meta Fundamental AI Research 🇺🇸 United States

SAM 2: Segment Anything in Images and Videos

Extends promptable segmentation from images to video using streaming memory and interactive data collection.

2024-06 · Academic · Research paperAffiliations not yet verified · Academic ◌ Affiliations not yet verified

OpenVLA: An Open-Source Vision-Language-Action Model

An open vision-language-action model and adaptation framework make generalist robot policy research more accessible.

2023-09-29 · Wayve · Research paperInstitution base · Wayve 🇬🇧 United Kingdom

GAIA-1: A Generative World Model for Autonomous Driving

Models video, text and vehicle actions as sequences to generate conditioned driving scenes and possible futures.

2023-07 · Google · Research paperGlobal research organization · Google / Google DeepMind 🇺🇸 United States · 🇬🇧 United Kingdom

RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control

Vision-language models are trained to produce robot actions, exploring transfer from web-scale learning to robotic control.

2023-03 · OpenAI · Technical reportInstitution base · OpenAI 🇺🇸 United States

GPT-4 Technical Report

The report describes GPT-4’s capabilities, evaluation results and limitations while leaving important training details undisclosed.

2023-03 · Academic · Research paperAffiliations not yet verified · Academic ◌ Affiliations not yet verified

Diffusion Policy: Visuomotor Policy Learning via Action Diffusion

Robot control is formulated as conditional denoising of action sequences, linking diffusion models to visuomotor learning.

2021-02 · OpenAI · Research paperCredited institutions · OpenAI 🇺🇸 United States

Learning Transferable Visual Models From Natural Language Supervision

Contrastive training aligns images with natural-language descriptions, enabling transfer to new visual categories.

2020-06 · Academic · Research paperCredited institutions · UC Berkeley 🇺🇸 United States

Denoising Diffusion Probabilistic Models

A generative model learns to reverse a gradual noise process, establishing an influential approach to image synthesis.

2018-03-16 · Baidu Apollo · Research paperInstitution base · Baidu Apollo 🇨🇳 China

The ApolloScape Open Dataset for Autonomous Driving and its Application

Documents a driving dataset and applications for sensor fusion, semantic understanding, and localization.

2012 · Academic · Research paperCredited institutions · University of Toronto 🇨🇦 Canada

ImageNet Classification with Deep Convolutional Neural Networks

A deep convolutional network demonstrated how data, GPU computation and learned representations could transform visual recognition.

Institutions working on this topic

Counts are records from that institution that carry this topic in this index.