Hi, I'm Hermann, a junior professor at the Lamarr Institute / Uni Bonn. Previously, I worked as a PostDoc in the Computer Vision and Geometry Lab of ETH Zürich. For my PhD I was part of the Autonomous Systems Lab at ETH Zürich.
My research focuses on robotic perception. I strive to build robots that can understand their environment semantically and geometrically, in order to perform manipulation and other safety critical tasks in proximity to humans.
Here is my lab website.
hermannsblumhermannsblum@hermann@sigmoid.social
I have open PhD positions in my new lab from autumn 2024 onwards. Please reach out if you are interested to be part of my new lab on robotic perception and learning.
Here are my recent works:
Learning Where to Look: Self-supervised Viewpoint Selection for Active Localization Using Geometrical Information
L Di Giammarino, B Sun, G Grisetti, M Pollefeys, H Blum, D Barath
OptXR: Optimization of Maintenance Processes with Extended Reality and Digital Twins
Y An, J Chen, H Blum, BT Adey, C Haas, M Pollefeys
DepthSplat: Connecting Gaussian Splatting and Depth
H Xu, S Peng, F Wang, H Blum, D Barath, A Geiger, M Pollefeys
HoloSpot: Intuitive Object Manipulation via Mixed Reality Drag-and-Drop
P Soler Garcia, P Lukovic, L Reynaud, A Sgobbi, F Bruni, M Brun, M Zünd, ...
ARKit LabelMaker: A New Scale for Indoor 3D Scene Understanding
G Ji, S Weder, F Engelmann, M Pollefeys, H Blum
SpotLight: Robotic Scene Understanding through Interaction and Affordance Detection
T Engelbracht, R Zurbrügg, M Pollefeys, H Blum, Z Bauer
NeuSurfEmb: A Complete Pipeline for Dense Correspondence-based 6D Object Pose Estimation without CAD Models
F Milano, JJ Chung, H Blum, R Siegwart, L Ott
OpenDAS: Open-Vocabulary Domain Adaptation for Segmentation
SNI-SLAM: Semantic Neural Implicit SLAM
S Zhu, G Wang, H Blum, J Liu, L Song, M Pollefeys, H Wang
A 3D Mixed Reality Interface for Human-Robot Teaming
J Chen, B Sun, M Pollefeys, H Blum
Active Visual Localization for Multi-Agent Collaboration: A Data-Driven Approach
M Hanlon, B Sun, M Pollefeys, H Blum
OpenDAS: Domain Adaptation for Open-Vocabulary Segmentation
G Yilmaz, S Peng, F Engelmann, M Pollefeys, H Blum
🏆 Best Paper at ICRA 24 Mobile Manipulation Workshop
Spot-Compose: A Framework for Open-Vocabulary Object Retrieval and Drawer Manipulation in Point Clouds
O Lemke, Z Bauer, R Zurbrügg, M Pollefeys, F Engelmann, H Blum
🏆 Best Paper at ICRA 24 Mobile Manipulation Workshop
" Where am I?" Scene Retrieval with Language
J Chen, D Barath, I Armeni, M Pollefeys, H Blum
fully automatic labels on the quality level of ScanNet
LabelMaker: Automatic Semantic Label Generation from RGB-D Trajectories
S Weder*, H Blum*, F Engelmann, M Pollefeys
fully automatic labels on the quality level of ScanNet
Unsupervised Continual Semantic Adaptation through Neural Rendering
Z Liu, F Milano, J Frey, R Siegwart, H Blum, C Cadena
Uncertainty estimation for planetary robotic terrain segmentation
MG Müller, M Durner, W Boerdijk, H Blum, A Gawel, W Stürzl, R Siegwart, ...
my PhD thesis
Self-improving, Open-World Robotic Scene Understanding
my PhD thesis
🏆 Best Paper Runner-up at the 2021 NeurIPS Robot Learning Workshop
Continual Adaptation of Semantic Segmentation Using Complementary 2D-3D Data Representations
🏆 Best Paper Runner-up at the 2021 NeurIPS Robot Learning Workshop
mm-precise RGBD pointclouds
SL Sensor: An open-source, real-time and robot operating system-based structured light sensor for high accuracy construction robotic applications
mm-precise RGBD pointclouds
SCIM: Simultaneous Clustering, Inference, and Mapping for Open-World Semantic Scene Understanding
🏆 Best Paper at IROS 2023 WS 'Frontier Vision & Learning Techniques'
See Yourself in Others: Attending Multiple Tasks for Own Failure Detection
🏆 Best Paper at IROS 2023 WS 'Frontier Vision & Learning Techniques'
Interactive OAISYS: A photorealistic terrain simulation for robotics research
integrates our NeurIPS workshop work into a fully autonomous press-start-and-leave domain adaptation
Embodied Active Domain Adaptation for Semantic Segmentation via Informative Path Planning
integrates our NeurIPS workshop work into a fully autonomous press-start-and-leave domain adaptation
Global Localization in Meshes
Precise Robot Localization in Architectural 3D Plans
Pixel-wise Anomaly Detection in Complex Driving Scenes
G Di Biase*, H Blum*, R Siegwart, C Cadena
Our new concept for robots that learn on their own
Self-Improving Semantic Perception for Indoor Localisation
Our new concept for robots that learn on their own
SegmentMeIfYouCan: A Benchmark for Anomaly Segmentation
R Chan*, K Lis*, S Uhlemeyer*, H Blum*, S Honari, R Siegwart, P Fua, M Salzmann, M Rottmann
Online Synchronization of Building Model for On-Site Mobile Robotic Construction
Fishyscapes: A benchmark for safe semantic segmentation in autonomous driving
first mayor work of our interdisciplinary construction-robotics team
A Fully-Integrated Sensing and Control System for High-Accuracy Mobile Robotic Building Construction
A Gawel, H Blum, J Pankert, K Krämer, L Bartolomei, S Ercan, F Farshidian, M Chli, F Gramazio, R Siegwart, M Hutter, T Sandy
first mayor work of our interdisciplinary construction-robotics team
Active Learning for UAV-based Semantic Mapping
Learning Densities in Feature Space for Reliable Segmentation of Indoor Scenes
The Fishyscapes Benchmark: Measuring Blind Spots in Semantic Segmentation
H Blum*, PE Sarlin*, J Nieto, R Siegwart, C Cadena
Modular Sensor Fusion for Semantic Segmentation
H Blum, A Gawel, R Siegwart, C Cadena
Obstacle avoidance and target acquisition for robot navigation using a mixed signal analog/digital neuromorphic processing system
Thanks to 0melapics / Freepik for the robot decorations.
This website has a low carbon footprint and is hosted on green energy.