Home  |  Centre for Mathematical Sciences  |  LTH  |  LU

Wearable Visual Information Systems


A camera picture has traditionally been considered as a visual recording of a specific isolated moment in place and time and as a permanent link to that moment and its associated memories. However, the advent of digital technologies for capturing, storing and transmitting pictures has dramatically extended our perception of the role of photography. Indeed already the ubiquity and vastness of most people's personal photo collection has begun to stimulate the development of mostly manual tools for managing and searching large image repositories. In fact, the ease with which pictures are captured and stored today opens up many new possibilities for exploiting captured visual information for the purposes of content analysis, guiding, information access and memory enhancement. All these tasks require advanced tools of image analysis and computer vision in order to extract useful information (semi-)automatically from images. It is the purpose of this project to advance these tools and show their usefulness in a set of compelling demonstrators based on personal wearable image capturing devices.

Specific problems that we adress are for example:

  • Automatic tagging of images taken by hand held devices
  • Localization and way finding
  • Locating everyday objects
  • Visual diaries from continuously wearable cameras

Funded by the Swedish Foundation for Strategic Research .
Period: 2009-2013.
Partners: CVAP, KTH

Project publications

Below is a selection of the publications within the project.

A Brute-Force Algorithm for Reconstructing a Scene from Two Projections
Enqvist, Olof; Jiang, Fangyuan; Kahl, Fredrik, 2011, Published at: Conference on Computer Vision and Pattern Recognition, Fulltext: PDF

A Complete Characterization and Solution to the Microphone Position Self-Calibration Problem
Kuang, Yubin; Burgess, Simon; Torstensson, Anna; Åström, Kalle, 2013, Published at: The 38th International Conference on Acoustics, Speech, and Signal Processing, Fulltext: PDF

A Linear Framework for Region-Based Image Segmentation and Inpainting Involving Curvature Penalization
Schoenemann, Thomas; Kahl, Fredrik; Masnou, Simon; Cremers, Daniel, 2012, Published in: International Journal of Computer Vision, Fulltext: PDF

A Public Video Dataset for Road Transportation Applications
Saunier, Nicolas; Ardö, Håkan; Jodoin, Jean-Philippe; Laureshyn, Aliaksei; Nilsson, Mikael; Svensson, Åse; Miranda-Moreno, Luis; Bilodeau, Guillaume-Alexandre; Åström, Kalle, 2014, Published at: 2014 TRB Annual Meeting Workshop on Comparison of Surrogate Measures of Safety Extracted from Video Data, Fulltext: PDF

A Unifying Approach to Minimal Problems in Collinear and Planar TDOA Sensor Network Self-Calibration
Ask, Erik; Kuang, Yubin; Åström, Kalle, 2014, Published at: European Signal Processing Conference (EUSIPCO 2014), Fulltext: PDF

Accurate Localization and Pose Estimation for Large 3D Models
Svärm, Linus; Enqvist, Olof; Oskarsson, Magnus; Kahl, Fredrik, 2014, Published at: Conference on Computer Vision and Pattern Recognition (CVPR), Fulltext: PDF

An Automatic System for Microphone Self-Localization Using Ambient Sound
Simayijiang, Zhayida; Andersson, Fredrik; Kuang, Yubin; Åström, Kalle, 2014, Published at: European Signal Processing Conference (Eusipco 2014), Fulltext: PDF

Automatic Compartment Modelling and Segmentation for Dynamical Renal Scintigraphies
Ståhl, Daniel; Åström, Kalle; Overgaard, Niels Christian; Landgren, Matilda; Sjöstrand, Karl; Edenbrandt, Lars, 2011, Published at: 17th Scandinavian Conference on Image Analysis (SCIA 2011), Fulltext: PDF

Bayesian Formulation of Image Patch Matching Using Cross-correlation
Ardö, Håkan; Åström, Kalle, 2012, Published in: Journal of Mathematical Imaging and Vision, Fulltext: PDF

Bundle Adjustment using Conjugate Gradients with Multiscale Preconditioning
Byröd, Martin; Åström, Kalle, 2009, Published at: ], in Proc. The 20th British Machine Vision Conference

Combining Text Semantics and Image Geometry to Improve Scene Interpretation
Medved, Dennis; Jiang, Fangyuan; Exner, Peter; Oskarsson, Magnus; Nugues, Pierre; Åström, Kalle, 2014, Published at: International Conference on Pattern Recognition Applications and Methods, Fulltext: PDF

Conjugate Gradient Bundle Adjustment
Byröd, Martin; Åström, Kalle, 2010, Published at: European Conference on Computer Vision, Fulltext: PDF

Curvature Regularity for Region-based Image Segmentation and Inpainting: A Linear Programming Relaxation
Schoenemann, Thomas; Kahl, Fredrik; Cremers, Daniel, 2009, Published at: International Conference on Computer Vision, Fulltext: PDF

Discrete Optimization in Early Vision
Strandmark, Petter, 2012, Fulltext: PDF

Efficient Optimization Techniques for Localization and Registration of Images
Svärm, Linus, 2015, Fulltext: PDF

Exploiting p-Fold Symmetries for Faster Polynomial Equation Solving
Ask, Erik; Kuang, Yubin; Åström, Kalle, 2012, Published at: ICPR 2012, Fulltext: PDF

Fast and Reliable Two-View Translation Estimation
Fredriksson, Johan; Enqvist, Olof; Kahl, Fredrik, 2014, Published at: Conference on Computer Vision and Pattern Recognition (CVPR), Fulltext: PDF

Fast and Stable Polynomial Equation Solving and Its Application to Computer Vision
Byröd, Martin; Josephson, Klas; Åström, Kalle, 2009, Published in: International Journal of Computer Vision, Fulltext: PDF

Generalized Convexity in Multiple View Geometry
Olsson, Carl; Kahl, Fredrik, 2010, Published in: Journal of Mathematical Imaging and Vision, Fulltext: PDF

Generalized Roof Duality
Kahl, Fredrik; Strandmark, Petter, 2012, Published in: Discrete Applied Mathematics, Fulltext: PDF

Image Segmentation and Labeling Using Free-form Semantic Annotation
Tegen, Agnes; Weegar, Rebecka; Hammarlund, Linus; Oskarsson, Magnus; Jiang, Fangyuan; Medved, Dennis; Nugues, Pierre; Åström, Kalle, 2014, Published at: International Conference on Pattern Recognition, Fulltext: PDF

Image Segmentation with Context
Eriksson, Anders; Olsson, Carl; Kahl, Fredrik, 2007, Published at: Scandinavian Conference on Image Analysis, Fulltext: PDF

Improved Object Detection and Pose Using Part-Based Models
Jiang, Fangyuan; Enqvist, Olof; Kahl, Fredrik; Åström, Kalle, 2013, Published at: Scandinavian Conference on Image Analysis

In Defense of 3D-Label Stereo
Olsson, Carl; Ulén, Johannes; Boykov, Yuri, 2013, Published at: CVPR 2013, Fulltext: PDF

Learning Based Image Segmentation of Pigs in a Pen
Nilsson, Mikael; Ardö, Håkan; Åström, Kalle; Herlin, Anders; Bergsten, Christer; Guzhva, Oleksiy, 2014, Published at: Visual observation and analysis of Vertebrate And Insect Behavior 2014, Fulltext: PDF

Minimal Solutions for Dual Microphone Rig Self-Calibration
Zhayida, Simayijiang; Burgess, Simon; Kuang, Yubin; Åström, Kalle, 2014, Published at: European Signal Processing Conference (EUSIPCO 2014), Fulltext: PDF

Minimal Solvers for Relative Pose with a Single Unknown Radial Distortion
Kuang, Yubin; Solem, Jan Erik; Kahl, Fredrik; Åström, Kalle, 2014, Published at: IEEE Conference on Computer Vision and Pattern Recognition, Fulltext: PDF

Minimal Solvers for Unsynchronized TDOA Sensor Network Calibration
Burgess, Simon; Kuang, Yubin; Wendeberg, Johannes; Åström, Kalle; Schindelhauer, Christian, 2014, Published at: Algorithms for Sensor Systems

Minimal Structure and Motion Problems for TOA and TDOA Measurements with Collinearity Constraints
Ask, Erik; Burgess, Simon; Åström, Kalle, 2013, Published at: 2nd International Conference on Pattern Recognition Applications and Methods, Fulltext: PDF

Node Localization in Unsynchronized Time of Arrival Sensor Networks
Burgess, Simon; Kuang, Yubin; Åström, Kalle, 2012, Published at: ICPR 2012, Fulltext: PDF

Normalized Cuts Revisited: A Reformulation for Segmentation with Linear Grouping Constraints
Eriksson, Anders P; Olsson, Carl; Kahl, Fredrik, 2007, Published at: International Conference on Computer Vision, Fulltext: PDF

Numerically Stable Optimization of Polynomial Solvers for Minimal Problems
Kuang, Yubin; Åström, Kalle, 2012, Published at: European Conference on Computer Vision, Fulltext: PDF

Optimal Geometric Fitting Under the Truncated L2 -Norm
Ask, Erik; Enqvist, Olof; Kahl, Fredrik, 2013, Published at: CVPR 2013, Fulltext: PDF

Optimizing Visual Vocabularies Using Soft Assignment Entropies
Kuang, Yubin; Åström, Kalle; Kopp, Lars; Oskarsson, Magnus; Byröd, Martin, 2010, Published at: Asian Conference on Computer Vision, Fulltext: PDF

Partial Symmetry in Polynomial Systems and Its Application in Computer Vision
Kuang, Yubin; Zheng, Yinqiang; Åström, Kalle, 2014, Published at: IEEE Conference on Computer Vision and Pattern Recognition, Fulltext: PDF

Pose Estimation with Unknown Focal Length using Points, Directions and Lines
Kuang, Yubin; Åström, Kalle, 2013, Published at: IEEE International Conference on Computer Vision (ICCV2013), Fulltext: PDF

Practical Global Optimization for Multiview Geometry
Kahl, Fredrik; Agarwal, Sameer; Chandraker, Manmohan; Kriegman, David; Belongie, Serge, 2008, Published in: International Journal of Computer Vision, Fulltext: PDF

Prime Rigid Graphs and Multidimensional Scaling with Missing Data
Oskarsson, Magnus; Åström, Kalle; Torstensson, Anna, 2014, Published at: International Conference on Pattern Recognition, Fulltext: PDF

Projective Least-Squares: Global Solutions with Local Optimization
Olsson, Carl; Kahl, Fredrik; Hartley, Richard, 2009, Published at: Conference on Computer Vision and Pattern Recognition, Fulltext: PDF

Revisiting the PnP Problem: A Fast, General and Optimal Solution
Zheng, Yinqiang; Kuang, Yubin; Sugimoto, Shigeki; Åström, Kalle; Okutomi, Masatoshi, 2013, Published at: IEEE International Conference on Computer Vision, ICCV2013, Fulltext: PDF

Robust Fitting for Multiple View Geometry
Enqvist, Olof; Ask, Erik; Kahl, Fredrik; Åström, Kalle, 2012, Published at: European Conference on Computer Vision, Fulltext: PDF

Robust Optimal Pose Estimation
Enqvist, Olof; Kahl, Fredrik, 2008, Published at: The 10th European Conference on Computer Vision, Fulltext: PDF

Shape Modeling by Optimising Description Length Using Gradients and Parameterisation Invariance
Karlsson, Johan; Ericsson, Anders; Åström, Kalle, 2012

Shift-map Image Registration
Svärm, Linus; Strandmark, Petter, 2010, Published at: International Conference on Pattern Recognition (ICPR), Fulltext: PDF

Simultaneous Multiple Rotation Averaging using Lagrangian Duality
Fredriksson, Johan ; Olsson, Carl, 2012, Published at: Asian Conference of Computer Vision, Fulltext: PDF

Single Antenna Anchor-Free UWB Positioning based on Multipath Propagation
Kuang, Yubin; Åström, Kalle; Tufvesson, Fredrik, 2013, Published at: IEEE International Conference on Communications, Fulltext: PDF

Stratified Sensor Network Self-Calibration From TDOA Measurements
Kuang, Yubin; Åström, Kalle, 2013, Published at: 21st European Signal Processing Conference 2013, Fulltext: PDF

Structure from Motion Estimation with Positional Cues
Svärm, Linus; Oskarsson, Magnus, 2013, Published at: Scandinavian Conference on Image Analysis, Fulltext: PDF

Supervised Feature Quantization with Entropy Optimization
Kuang, Yubin; Byröd, Martin; Åström, Kalle, 2011, Published at: IEEE Workshop on Information Theory in Computer Vision and Pattern Recognition, Fulltext: PDF

TOA Sensor Network Calibration for Receiver and Transmitter Spaces with Difference in Dimension
Burgess, Simon; Kuang, Yubin; Åström, Kalle, 2013, Published at: 21st European Signal Processing Conference 2013, Fulltext: PDF

TOA sensor network self-calibration for receiver and transmitter spaces with difference in dimension
Burgess, Simon; Kuang, Yubin; Åström, Kalle, 2015, Published in: Signal Processing

Tighter Relaxations for Higher-Order Models based on Generalized Roof Duality
Fredriksson, Johan; Olsson, Carl; Strandmark, Petter; Kahl, Fredrik, 2012, Published at: HiPot: ECCV 2012 Workshop on Higher-Order Models and Global Constraints in Computer Vision, Fulltext: PDF

Time Delay Estimation for TDOA Self-Calibration using Truncated Nuclear Norm
Jiang, Fangyuan; Kuang, Yubin; Åström, Kalle, 2013, Published at: The 38th International Conference on Acoustics, Speech, and Signal Processing, Fulltext: PDF

Tracking the Motion of Box Jellyfish
Kjellberg, Tobias; Oskarsson, Magnus; Palmér, Tobias; Åström, Kalle, 2014, Published at: Visual observation and analysis of Vertebrate And Insect Behavior 2014, Fulltext: PDF

Understanding TOA and TDOA Network Calibration using Far Field Approximation as Initial Estimate
Kuang, Yubin; Ask, Erik; Burgess, Simon; Åström, Kalle, 2012, Published at: International Conference on Pattern Recognition Applications and Methods, Fulltext: PDF

Verifying Global Minima for L2 Minimization Problems in Multiple View Geometry
Hartley, Richard; Kahl, Fredrik; Olsson, Carl; Seo, Yongduek, 2013, Published in: International Journal of Computer Vision, Fulltext: PDF

Visual Entity Linking: A Preliminary Study
Weegar, Rebecka; Hammarlund, Linus; Tegen, Agnes; Oskarsson, Magnus; Åström, Kalle; Nugues, Pierre, 2014, Published at: AAAI 2014 Workshop on Cognitive Computing for Augmented Human Intelligence, Fulltext: PDF

 

Questions: webmaster
Last updated: 2008-11-26

Centre for Mathematical Sciences, Box 118, SE-22100, Lund. Phone: 046-222 00 00