IEEE Transactions on Pattern Analysis and Machine Intelligence, 1994
... Beckman Institute, 405 N. Mathews, University of Illi-nois at Urbana-Champaign, Urbana, IL 61... more ... Beckman Institute, 405 N. Mathews, University of Illi-nois at Urbana-Champaign, Urbana, IL 61801 USA; e-mail: m-lew@uiuc.edu. ... Lim and Binford [ 131 applied a hierarchical structure ba\ed on different scale feature classes, specifically, bodies, surfaces, junctions, curves, and ...
IEEE Transactions on Pattern Analysis and Machine Intelligence, 2000
Two main results are established in this paper. First, we show that seven point correspondences a... more Two main results are established in this paper. First, we show that seven point correspondences are sufficient to uniquely determine from two perspective views the three-dimensional motion parameters (within a scale factor for the translations) of a rigid object with curved surfaces. The seven points should not be traversed by two planes with one plane containing the origin, nor by a cone containing the origin. Second, a set of ``essential parameters'' are introduced which uniquely determine the motion parameters up to a scale factor for the translations, and can be estimated by solving a set of linear equations which are derived from the correspondences of eight image points. The actual motion parameters can subsequently be determined by computing the singular value decomposition (SVD) of a 3×3 matrix containing the essential parameters.
IEEE Transactions on Pattern Analysis and Machine Intelligence, 2000
Capturing the human hand motion from video involves the estimation of the rigid global hand pose ... more Capturing the human hand motion from video involves the estimation of the rigid global hand pose as well as the nonrigid finger articulation. The complexity induced by the high degrees of freedom of the articulated hand challenges many visual tracking techniques. For example, the particle filtering technique is plagued by the demanding requirement of a huge number of particles and the phenomenon of particle degeneracy. This paper presents a novel approach to tracking the articulated hand in video by learning and integrating natural hand motion priors. To cope with the finger articulation, this paper proposes a powerful sequential Monte Carlo tracking algorithm based on importance sampling techniques, where the importance function is based on an initial manifold model of the articulation configuration space learned from motion-captured data. In addition, this paper presents a divide-and-conquer strategy that decouples the hand poses and finger articulations and integrates them in an iterative framework to reduce the complexity of the problem. Our experiments show that this approach is effective and efficient for tracking the articulated hand. This approach can be extended to track other articulated targets.
IEEE Transactions on Pattern Analysis and Machine Intelligence, 2000
In this paper, we present the logarithmic total variation (LTV) model for face recognition under ... more In this paper, we present the logarithmic total variation (LTV) model for face recognition under varying illumination, including natural lighting conditions, where we rarely know the strength, direction, or number of light sources. The proposed LTV model has the ability to factorize a single face image and obtain the illumination invariant facial structure, which is then used for face recognition. Our model is inspired by the SQI model but has better edge-preserving ability and simpler parameter selection. The merit of this model is that neither does it require any lighting assumption nor does it need any training. The LTV model reaches very high recognition rates in the tests using both Yale and CMU PIE face databases as well as a face database containing 765 subjects under outdoor lighting conditions.
IEEE Transactions on Pattern Analysis and Machine Intelligence, 1992
... In the algorithm implemented, intensity, edgeness, and cornerness attributes are used in conj... more ... In the algorithm implemented, intensity, edgeness, and cornerness attributes are used in conjunction with the constraints arising from intraregional smoothness, field continuity and discontinuity, and occlusions to compute dense displacement fields and occlusion maps along ...
IEEE Transactions on Pattern Analysis and Machine Intelligence, 1990
... 11. NOTATION The geometry of the problem is illustrated in Fig. 1. In the figure, let 0-xyz b... more ... 11. NOTATION The geometry of the problem is illustrated in Fig. 1. In the figure, let 0-xyz be the space coordinate system fixed on the ground. ... tem o-xyz in the parametric form Let us denote a 3-D line 1 in the space coordinate sys-1: p' = iit + Z0 (4) ...
IEEE Transactions on Pattern Analysis and Machine Intelligence, 2000
Automated analysis of human affective behavior has attracted increasing attention from researcher... more Automated analysis of human affective behavior has attracted increasing attention from researchers in psychology, computer science, linguistics, neuroscience, and related disciplines. However, the existing methods typically handle only deliberately displayed and exaggerated expressions of prototypical emotions despite the fact that deliberate behaviour differs in visual appearance, audio profile, and timing from spontaneously occurring behaviour. To address this problem, efforts to develop algorithms that can process naturally occurring human affective behaviour have recently emerged. Moreover, an increasing number of efforts are reported toward multimodal fusion for human affect analysis including audiovisual fusion, linguistic and paralinguistic fusion, and multi-cue visual fusion based on facial expressions, head movements, and body gestures. This paper introduces and surveys these recent advances. We first discuss human emotion perception from a psychological perspective. Next we examine available approaches to solving the problem of machine understanding of human affective behavior, and discuss important issues like the collection and availability of training and test data. We finally outline some of the scientific and engineering challenges to advancing human affect sensing technology.
IEEE Transactions on Pattern Analysis and Machine Intelligence, 1994
... Beckman Institute, 405 N. Mathews, University of Illi-nois at Urbana-Champaign, Urbana, IL 61... more ... Beckman Institute, 405 N. Mathews, University of Illi-nois at Urbana-Champaign, Urbana, IL 61801 USA; e-mail: m-lew@uiuc.edu. ... Lim and Binford [ 131 applied a hierarchical structure ba\ed on different scale feature classes, specifically, bodies, surfaces, junctions, curves, and ...
IEEE Transactions on Pattern Analysis and Machine Intelligence, 2000
Two main results are established in this paper. First, we show that seven point correspondences a... more Two main results are established in this paper. First, we show that seven point correspondences are sufficient to uniquely determine from two perspective views the three-dimensional motion parameters (within a scale factor for the translations) of a rigid object with curved surfaces. The seven points should not be traversed by two planes with one plane containing the origin, nor by a cone containing the origin. Second, a set of ``essential parameters'' are introduced which uniquely determine the motion parameters up to a scale factor for the translations, and can be estimated by solving a set of linear equations which are derived from the correspondences of eight image points. The actual motion parameters can subsequently be determined by computing the singular value decomposition (SVD) of a 3×3 matrix containing the essential parameters.
IEEE Transactions on Pattern Analysis and Machine Intelligence, 2000
Capturing the human hand motion from video involves the estimation of the rigid global hand pose ... more Capturing the human hand motion from video involves the estimation of the rigid global hand pose as well as the nonrigid finger articulation. The complexity induced by the high degrees of freedom of the articulated hand challenges many visual tracking techniques. For example, the particle filtering technique is plagued by the demanding requirement of a huge number of particles and the phenomenon of particle degeneracy. This paper presents a novel approach to tracking the articulated hand in video by learning and integrating natural hand motion priors. To cope with the finger articulation, this paper proposes a powerful sequential Monte Carlo tracking algorithm based on importance sampling techniques, where the importance function is based on an initial manifold model of the articulation configuration space learned from motion-captured data. In addition, this paper presents a divide-and-conquer strategy that decouples the hand poses and finger articulations and integrates them in an iterative framework to reduce the complexity of the problem. Our experiments show that this approach is effective and efficient for tracking the articulated hand. This approach can be extended to track other articulated targets.
IEEE Transactions on Pattern Analysis and Machine Intelligence, 2000
In this paper, we present the logarithmic total variation (LTV) model for face recognition under ... more In this paper, we present the logarithmic total variation (LTV) model for face recognition under varying illumination, including natural lighting conditions, where we rarely know the strength, direction, or number of light sources. The proposed LTV model has the ability to factorize a single face image and obtain the illumination invariant facial structure, which is then used for face recognition. Our model is inspired by the SQI model but has better edge-preserving ability and simpler parameter selection. The merit of this model is that neither does it require any lighting assumption nor does it need any training. The LTV model reaches very high recognition rates in the tests using both Yale and CMU PIE face databases as well as a face database containing 765 subjects under outdoor lighting conditions.
IEEE Transactions on Pattern Analysis and Machine Intelligence, 1992
... In the algorithm implemented, intensity, edgeness, and cornerness attributes are used in conj... more ... In the algorithm implemented, intensity, edgeness, and cornerness attributes are used in conjunction with the constraints arising from intraregional smoothness, field continuity and discontinuity, and occlusions to compute dense displacement fields and occlusion maps along ...
IEEE Transactions on Pattern Analysis and Machine Intelligence, 1990
... 11. NOTATION The geometry of the problem is illustrated in Fig. 1. In the figure, let 0-xyz b... more ... 11. NOTATION The geometry of the problem is illustrated in Fig. 1. In the figure, let 0-xyz be the space coordinate system fixed on the ground. ... tem o-xyz in the parametric form Let us denote a 3-D line 1 in the space coordinate sys-1: p' = iit + Z0 (4) ...
IEEE Transactions on Pattern Analysis and Machine Intelligence, 2000
Automated analysis of human affective behavior has attracted increasing attention from researcher... more Automated analysis of human affective behavior has attracted increasing attention from researchers in psychology, computer science, linguistics, neuroscience, and related disciplines. However, the existing methods typically handle only deliberately displayed and exaggerated expressions of prototypical emotions despite the fact that deliberate behaviour differs in visual appearance, audio profile, and timing from spontaneously occurring behaviour. To address this problem, efforts to develop algorithms that can process naturally occurring human affective behaviour have recently emerged. Moreover, an increasing number of efforts are reported toward multimodal fusion for human affect analysis including audiovisual fusion, linguistic and paralinguistic fusion, and multi-cue visual fusion based on facial expressions, head movements, and body gestures. This paper introduces and surveys these recent advances. We first discuss human emotion perception from a psychological perspective. Next we examine available approaches to solving the problem of machine understanding of human affective behavior, and discuss important issues like the collection and availability of training and test data. We finally outline some of the scientific and engineering challenges to advancing human affect sensing technology.
Uploads
Papers by Thomas Huang