Frank Bieder
CV
Group Lead, Visual & Spatial Learning · FZI Research Center

Frank Joachim Bieder

Embodied AI · Computer Vision · Machine Learning

My work centers on scalable training data generation and real-world deployment of end-to-end driving stacks — bridging HD maps, LiDAR, and camera perception to train robust real-world models under limited annotation. I've led research groups, served as principal investigator on six-figure industrial grants, published across NeurIPS, CVPR, IROS, RAL, T-ITS, and T-IV, and deployed perception systems on autonomous research vehicles across multiple European cities.

Karlsruhe, Germany KIT & FZI Research Center frank.bieder@kit.edu
Frank Bieder
Dr.-Ing. Frank Joachim Bieder
Research Scientist & Group Leader
KIT · FZI Research Center
Research Focus
Scalable Data Generation · End-to-End Autonomy · Learning from Maps

About

I lead the Visual & Spatial Learning group at the FZI Research Center for Information Technology, where my team works on auto-labeling pipelines for multimodal perception and end-to-end driving systems. I completed my PhD at the Karlsruhe Institute of Technology (KIT), supervised by Prof. Christoph Stiller, defending my thesis "Learning from Maps: Scalable Ground Truth Generation in Autonomous Driving" in March 2026 with Summa cum Laude (1.0/1.0) distinction.

My research bridges maps, perception, and learning to enable robust real-world AI models under limited annotation and significant sensor domain shifts. I am the E2E-owner and co-adviser for the KITScenes Multimodal dataset, and I am particularly interested in leveraging HD maps and multi-drive mapping to overcome data scarcity in autonomous driving.

I co-maintain the software and hardware stacks for up to two autonomous driving research vehicles, and have developed strong proficiency in Python, C++, ROS, and modern deep learning frameworks (PyTorch, TensorFlow). I currently supervise 7 PhD students after having supervised 11 MSc thesis projects.

I actively collaborate with leading research institutions and industry partners worldwide, bridging fundamental research with real-world industrial autonomous driving applications.

Research Interests

My research focuses on enabling robust and scalable embodied AI systems for real-world applications, with emphasis on autonomous driving and mobile robotics.

🗺️
Learning from Maps

Scalable ground truth generation for autonomous driving by leveraging high-definition maps and multi-drive data to overcome annotation bottlenecks and enable data-efficient learning.

🔄
Cross-Sensor Domain Adaptation

Developing robust domain adaptation techniques for embodied AI systems to generalize across different sensor modalities, environmental conditions, and deployment scenarios.

🚗
End-to-End Autonomy

Scaling real-world deployment of end-to-end autonomous driving stacks in complex urban environments, from perception through planning to control.

Selected Publications

XD-MAP: Cross-Modal Domain Adaptation using Semantic Parametric Mapping

CVPR – NexD Workshop 2026

Frank Bieder, Hendrik Königshof, Haohao Hu, Fabian Immel, Yinzhe Shen, Jan-Hendrik Pauls, Christoph Stiller

Cross-modal domain adaptation for robust perception across different sensor modalities.

Domain Adaptation Cross-Sensor

The Road Ahead in Autonomous Driving: The KITScenes Multimodal Dataset

arXiv 2026

Richard Schwarzkopf et al. (incl. Frank Bieder)

Large-scale multimodal dataset for autonomous driving research. Frank is E2E-owner and co-adviser.

SDTagNet: Leveraging Text-Annotated Navigation Maps for Online HD Map Construction

NeurIPS 2025

Fabian Immel, Jan-Hendrik Pauls, Richard Fehler, Frank Bieder, Jonas Merkert, Christoph Stiller

Online HD map construction using text-annotated navigation maps.

HD Maps Deep Learning

M3TR: A Generalist Model for Real-World HD Map Completion

RA-L 2025

Fabian Immel, Richard Fehler, Frank Bieder, Jan-Hendrik Pauls, Christoph Stiller

Generalist transformer model for real-world high-definition map completion.

HD Maps Transformers

Map Learning: Ein Ansatz zur automatisierten Erstellung von Trainingsdaten unter Verwendung von HD-Karten und Mehrfachbefahrungen

🏆 Best Paper Award · FAS 2023

Frank Bieder, Haohao Hu, Johannes Schantz, Oguzahn Kirik, Florian Ries, Martin Haueis, Christoph Stiller

Automated training data generation using HD maps and multi-drive mapping.

HD Maps Training Data

A Dual Evidential Top-View Representation to Model the Semantic Environment of Automated Vehicles

T-IV 2024

Sven Richter, Frank Bieder, Sascha Wirges, Christoph Stiller

Evidential top-view representation for modeling the semantic environment around automated vehicles.

Grid Maps Evidential Theory

TEScalib: Targetless Extrinsic Self-Calibration of LiDAR and Stereo Camera for Automated Driving Vehicles with Uncertainty Analysis

IROS 2022

Haohao Hu, F. Han, Frank Bieder, Jan-Hendrik Pauls, Christoph Stiller

Targetless extrinsic calibration of multi-modal sensors with uncertainty quantification.

Calibration Sensor Fusion

Interaction-Aware Game-Theoretic Motion Planning for Automated Vehicles using Bi-level Optimization

🏆 2nd Best Paper Award · ITSC 2022

Christoph Burger, Johannes Fischer, Frank Bieder, Ömer Tas, Christoph Stiller

Game-theoretic approach to motion planning considering interaction between automated vehicles.

Motion Planning Game Theory

MASS: Multi-Attentional Semantic Segmentation of LiDAR Data for Dense Top-View Understanding

T-ITS 2022

Kunyu Peng, Juncong Fei, Kailun Yang, Alina Roitberg, Jiaming Zhang, Frank Bieder, Philipp Heidenreich, Christoph Stiller, Rainer Stiefelhagen

Multi-attentional approach for dense semantic understanding from LiDAR data.

Semantic Segmentation LiDAR

Improving Lidar-Based Semantic Segmentation of Top-View Grid Maps by Learning Features in Complementary Representations

FUSION 2021

Frank Bieder, Maximilian Link, Simon Romanski, Haohao Hu, Christoph Stiller

Novel approach to semantic segmentation using complementary feature representations.

Grid Maps LiDAR

Exploiting Multi-Layer Grid Maps for Surround-View Semantic Segmentation of Sparse LiDAR Data

IV 2020

Frank Bieder, Sascha Wirges, Johannes Janosovits, Sven Richter, Zheyuan Wang, Christoph Stiller

Multi-layer grid map representation for robust semantic segmentation from sparse sensor data.

Grid Maps LiDAR

Experience

Research Scientist & Group Leader

FZI Research Center for Information Technology

Visual and Spatial Learning for Autonomous Driving · Supervised by Prof. Christoph Stiller

Nov 2025 – Present
  • Leading a team of researchers and PhD students across visual and spatial learning
  • Focus on auto-labeling pipelines for multimodal perception and E2E-driving systems
  • E2E-Owner and Co-adviser for the KITScenes Multimodal dataset

Research Scientist & PhD Candidate

FZI Research Center for Information Technology

Visual and Spatial Learning for Autonomous Driving · Supervised by Prof. Christoph Stiller

May 2019 – Oct 2025
  • Mobile Perception Systems Department
  • 2023–2025: Focus on dissertation – Learning from Maps
  • 2021–2022: Project lead of industrial research project – Map-less driving
  • 2019–2021: Project lead of industrial research project – Flexible Localization
  • Co-maintenance of software and hardware stacks for autonomous driving research vehicles

Visiting PhD Candidate

UC Berkeley – Mechanical Systems Control Lab

Supervised by Prof. Masayoshi Tomizuka

Aug 2022 – Oct 2022
  • Research on map-less driving and map perception for embodied AI
  • Funded by KHYS Exchange Grant

Deep Learning Lead

Atlatec GmbH (acquired by Bosch in 2022)

Supervised by Dr. Julius Ziegler

Oct 2018 – Apr 2019
  • Developed multimodal CNNs & weakly supervised learning methods for automatic generation of high-precision planning maps

Master Thesis – Image Understanding Group

Daimler AG

Supervised by Dr. Uwe Franke & Fiete Botschen

Nov 2017 – Aug 2018
  • Supervised Domain Adaptation for Semantic Segmentation
  • Use of synthetic data to improve pixel-wise semantic classification in real-world applications

Research Assistant

FZI Research Center for Information Technology, Karlsruhe

Supervised by Sascha Wirges

May 2016 – Oct 2017
  • Research projects in environment perception / machine learning

Research Assistant

University of Ottawa VIVA Lab, Ottawa, Canada

Supervised by Robert Laganière

Jan 2016 – May 2016
  • Research project in RGB-D instance segmentation of indoor scenes

Research Internship

Mercedes-Benz Research & Development, Sunnyvale, USA

Supervised by Jörg Hillenbrand · MBRDNA's Vehicle Intelligence Group

Jan 2015 – Jul 2015
  • Developed a framework to evaluate the driving behavior of an autonomous vehicle

🏆 Awards & Honors

1st Best Paper Award
FAS Workshop 2023
2nd Best Paper Award
IEEE ITSC 2022
KSOP Scholarship
PhD funding + MBA program (2019–present)
KHYS Exchange Grant
UC Berkeley exchange (2022)
Daimler Student Partnership
Mentoring & training (2016–2019)
Ontario BaWü Program
Fully funded academic exchange year in Canada (Sep–Dec 2015)
DAAD Promos Scholarship
International studies (2015–2016)
FUSION Travel Grant
Conference fees, travel & accommodation, South Africa (Nov 2021)
GDCH Award
German Chemical Society's award for high school excellence (Jul 2011)

Education

PhD / Dr.-Ing. in Autonomous Systems / Deep Learning

Karlsruhe Institute of Technology (KIT)

Thesis: Learning from Maps: Scalable Ground Truth Generation in Autonomous Driving

Supervisor: Prof. Christoph Stiller · Defended March 2026 · Summa cum Laude (1.0/1.0) with Distinction

May 2020 – Oct 2025

Visiting PhD Candidate

UC Berkeley – Mechanical Systems Control Lab

Research on map-less driving and map perception · Supervised by Prof. Masayoshi Tomizuka

Funded by KHYS Exchange Grant

Aug 2022 – Oct 2022

M.Sc. Electrical Engineering / Computer Science

Karlsruhe Institute of Technology (KIT)

GPA: 1.4/1.0 · Focus: Machine learning, system theory & robotics

Thesis: Supervised Domain Adaptation for Semantic Segmentation (Grade: 1.0/1.0)

Oct 2014 – Aug 2018

Exchange Studies – M.Sc. Electrical Engineering

University of Ottawa, Canada

Canadian GPA: 3.8/4.0 · Focus: Machine learning and data processing

Aug 2015 – May 2016

B.Sc. Electrical Engineering / Computer Science

Karlsruhe Institute of Technology (KIT)

Thesis: Fusion of Data from Stereo Camera and Radar Sensor for Tracking of Extended Objects (Grade: 1.0/1.0)

Oct 2011 – Oct 2014

Skills & Engagements

Languages

German (native), English (fluent), French (upper intermediate)

Technical Skills

Python (PyTorch, TensorFlow, OpenCV, NumPy), C++, ROS, containerized workflows

Supervision

Supervised 11 MSc thesis projects · Currently co-supervising 7 PhD students

Scientific Workshops

1st Organizer: FMAD – Foundation Models for AD (ITSC 24/25), MB2ML – Mapless AD (IV 22/23)

MBA Coursework

Completed MBA Fundamentals Program, Hector School of Engineering and Management

Voluntary Work

Engineers Without Borders (2012–2013) · International Student Mentoring (2019–2022)

Get in Touch

I'm always happy to discuss research collaborations, student projects, and opportunities in autonomous driving and machine learning. Feel free to reach out via email or connect on social media.

Open to: Research collaborations · PhD student supervision · Master's thesis supervision · Industrial partnerships · Speaking engagements