Postgraduate Thesis: Image point matching in multiple-view object reconstruction from imagesequences
| Title | Image point matching in multiple-view object reconstruction from imagesequences |
|---|---|
| Authors | Zhang, Jian 张简 |
| Issue Date | 2012 |
| Publisher | The University of Hong Kong (Pokfulam, Hong Kong) |
| Abstract | This thesis is concerned with three-dimensional (3D) reconstruction and point registration, which are fundamental topics of numerous applications in the area of computer vision. First, we propose the multiple epipolar lines (MEL) shape recovery method for 3D reconstruction from an image sequence captured under circular motion. This method involves recovering the 3D shape by reconstructing a set of 3D rim curves. The position of each point on a 3D rim curve is estimated by using three or more views. Two or more of these views are chosen close to each other to guarantee good image point matching, while one or more views are chosen far from these views to properly compensate for the error introduced in the triangulation scheme by the short baseline of the close views. Image point matching among all views is performed using a new method that suitably combines epipolar geometry and cross-correlation. Second, we develop the one line search (OLS) method for estimating the 3D model of an object from a sequence of images. The recovered object comprises a set of 3D rim curves. The OLS method determines the image point correspondences of each 3D point through a single line search along the ray defined by the camera center and each two-dimensional (2D) point where a photo-consistency index is maximized. In accordance with the approach, the search area is independently reduced to a line segment on the number of views. The key advantage of the proposed method is that only one variable is focused on in defining the corresponding 3D point, whereas the approaches for multiple-view stereo typically exploit multiple epipolar lines and hence require multiple variables. Third, we propose the expectation conditional maximization for point registration (ECMPR) algorithm to solve the rigid point registration problem by fitting the problem into the framework of maximum likelihood with missing data. The unknown correspondences are handled via mixture models. We derive a maximization criterion based on the expected complete-data log-likelihood. Then, the point registration problem can be solved by an instance of the expectation conditional maximization algorithm, that is, the ECMPR algorithm. Experiments with synthetic and real data are presented in each section. The proposed approaches provide satisfactory and promising results. |
| Advisors | Chesi, G Hung, YS |
| Degree | Doctor of Philosophy |
| Subject | Three-dimensional imaging. Image reconstruction. Image processing. |
| Dept/Program | Electrical and Electronic Engineering |
| dc.contributor.advisor | Chesi, G |
|---|---|
| dc.contributor.advisor | Hung, YS |
| dc.contributor.author | Zhang, Jian |
| dc.contributor.author | 张简 |
| dc.date.hkucongregation | 2012 |
| dc.date.issued | 2012 |
| dc.description.abstract | This thesis is concerned with three-dimensional (3D) reconstruction and point registration, which are fundamental topics of numerous applications in the area of computer vision. First, we propose the multiple epipolar lines (MEL) shape recovery method for 3D reconstruction from an image sequence captured under circular motion. This method involves recovering the 3D shape by reconstructing a set of 3D rim curves. The position of each point on a 3D rim curve is estimated by using three or more views. Two or more of these views are chosen close to each other to guarantee good image point matching, while one or more views are chosen far from these views to properly compensate for the error introduced in the triangulation scheme by the short baseline of the close views. Image point matching among all views is performed using a new method that suitably combines epipolar geometry and cross-correlation. Second, we develop the one line search (OLS) method for estimating the 3D model of an object from a sequence of images. The recovered object comprises a set of 3D rim curves. The OLS method determines the image point correspondences of each 3D point through a single line search along the ray defined by the camera center and each two-dimensional (2D) point where a photo-consistency index is maximized. In accordance with the approach, the search area is independently reduced to a line segment on the number of views. The key advantage of the proposed method is that only one variable is focused on in defining the corresponding 3D point, whereas the approaches for multiple-view stereo typically exploit multiple epipolar lines and hence require multiple variables. Third, we propose the expectation conditional maximization for point registration (ECMPR) algorithm to solve the rigid point registration problem by fitting the problem into the framework of maximum likelihood with missing data. The unknown correspondences are handled via mixture models. We derive a maximization criterion based on the expected complete-data log-likelihood. Then, the point registration problem can be solved by an instance of the expectation conditional maximization algorithm, that is, the ECMPR algorithm. Experiments with synthetic and real data are presented in each section. The proposed approaches provide satisfactory and promising results. |
| dc.description.nature | published_or_final_version |
| dc.description.thesisdiscipline | Electrical and Electronic Engineering |
| dc.description.thesislevel | doctoral |
| dc.description.thesisname | Doctor of Philosophy |
| dc.identifier.hkul | b4807985 |
| dc.language | eng |
| dc.publisher | The University of Hong Kong (Pokfulam, Hong Kong) |
| dc.relation.ispartof | HKU Theses Online (HKUTO) |
| dc.rights | The author retains all proprietary rights, (such as patent rights) and the right to use in future works. |
| dc.rights | Creative Commons: Attribution 3.0 Hong Kong License |
| dc.source.uri | http://hub.hku.hk/bib/B48079856 |
| dc.subject.lcsh | Three-dimensional imaging. |
| dc.subject.lcsh | Image reconstruction. |
| dc.subject.lcsh | Image processing. |
| dc.title | Image point matching in multiple-view object reconstruction from imagesequences |
| dc.type | PG_Thesis |