Nothing Special   »   [go: up one dir, main page]

skip to main content
article

Consistent Partial Matching of Shape Collections via Sparse Modeling

Published: 01 January 2017 Publication History

Abstract

Recent efforts in the area of joint object matching approach the problem by taking as input a set of pairwise maps, which are then jointly optimized across the whole collection so that certain accuracy and consistency criteria are satisfied. One natural requirement is cycle-consistency-namely the fact that map composition should give the same result regardless of the path taken in the shape collection. In this paper, we introduce a novel approach to obtain consistent matches without requiring initial pairwise solutions to be given as input. We do so by optimizing a joint measure of metric distortion directly over the space of cycle-consistent maps; in order to allow for partially similar and extra-class shapes, we formulate the problem as a series of quadratic programs with sparsity-inducing constraints, making our technique a natural candidate for analysing collections with a large presence of outliers. The particular form of the problem allows us to leverage results and tools from the field of evolutionary game theory. This enables a highly efficient optimization procedure which assures accurate and provably consistent solutions in a matter of minutes in collections with hundreds of shapes.

References

[1]
{ARBTP09}¿ Albarelli A., Rota Bulò S., Torsello A., Pelillo M.: Matching as a non-cooperative game. In Proceedings of International Conference on Computer VisionKyoto, Japan, 2009, IEEE, pp. pp.1319-1326.
[2]
{ART12}¿ Albarelli A., Rodolí E., Torsello A.: Imposing semi-local geometric constraints for accurate correspondences selection in structure from motion: A game-theoretic perspective. International Journal of Computer Vision Volume 97, Issue 1 2012, pp.36-53.
[3]
{ASC11}¿ Aubry M., Schlickewei U., Cremers D.: The wave kernel signature: A quantum mechanical approach to shape analysis. In Proceedings International Conference on Computer Vision WorkshopsBarcelona, Spain, 2011, IEEE, pp. pp.1626-1633.
[4]
{ASK*05}¿ Anguelov D., Srinivasan P., Koller D., Thrun S., Rodgers J., Davis J.: Scape: Shape completion and animation of people. ACM Transactions on Graphics Volume 24, Issue 3 2005, pp.408-416.
[5]
{BBK08}¿ Bronstein A., Bronstein M., Kimmel R.: Numerical Geometry of Non-Rigid Shapes, 1 ed. Springer Publishing Company, Incorporated, New York, USA, 2008.
[6]
{CG14}¿ Chen Y., Goldsmith A.: Information recovery from pairwise measurements. In Proceedings of ISITHonolulu, USA, 2014, IEEE, pp. pp.2012-2016.
[7]
{CGH14}¿ Chen Y., Guibas L., Huang Q.-X.: Near-optimal joint object matching via convex relaxation. In Proc. ICML2014, pp. pp.100-108.
[8]
{HG13}¿ Huang Q.-X., Guibas L.: Consistent shape maps via semidefinite programming. Computer Graphics Forum Volume 32, Issue 5 2013, pp.177-186.
[9]
{HWG14}¿ Huang Q., Wang F., Guibas L.: Functional map networks for analyzing and exploring large shape collections. ACM Transactions on Graphics Volume 33, Issue 4 July 2014, pp.36:1-36:11.
[10]
{HZG*12}¿ Huang Q.-X., Zhang G.-X., Gao L., Hu S.-M., Butscher A., Guibas L.: An optimization approach for extracting and encoding consistent maps in a shape collection. ACM Transactions on Graphics Volume 31, Issue 6 2012, pp.167:1-167:11.
[11]
{KKBL15}¿ Kezurer I., Kovalsky S. Z., Basri R., Lipman Y.: Tight relaxation of quadratic matching. Computer Graphics Forum Volume 34, Issue 5 2015, pp.115-128.
[12]
{KLF11}¿ Kim V. G., Lipman Y., Funkhouser T.: Blended intrinsic maps. ACM Transactions on Graphics Volume 30, Issue 4 2011, pp.79:1-79:12.
[13]
{KLM*12}¿ Kim V. G., Li W., Mitra N. J., DiVerdi S., Funkhouser T.: Exploring collections of 3d models using fuzzy correspondences. ACM Transactions on Graphics Volume 31, Issue 4 July 2012, pp.54:1-54:11.
[14]
{LH05}¿ Leordeanu M., Hebert M.: A spectral technique for correspondence problems using pairwise constraints. In Proceedings of ICCV Washington, DC, USA, 2005, IEEE Computer Society, pp. pp.1482-1489.
[15]
{LKF12}¿ Liu T., Kim V. G., Funkhouser T.: Finding surface correspondences using symmetry axis curves. Computer Graphics Forum Volume 31, Issue 5 2012, pp.1607-1616.
[16]
{Mém11}¿ Mémoli F.: Gromov-Wasserstein distances and the metric approach to object matching. Foundations of Computational Mathematics Volume 11, Issue 4 2011, pp.1-71.
[17]
{NBCW*11}¿ Nguyen A., Ben-Chen M., Welnicka K., Ye Y., Guibas L. J.: An optimization approach to improving collections of shape maps. Computer Graphics Forum Volume 30, Issue 5 2011, pp.1481-1491.
[18]
{PKS13}¿ Pachauri D., Kondor R., Singh V.: Solving the multi-way matching problem by permutation synchronization. In Proceedings NIPS. C.J.C.Burges, L.Bottou, M.Welling, Z.Ghahramani and K.Q.Weinberger eds. Lake Tahoe, USA, 2013, pp. pp.1860-1868.
[19]
{PSG*06}¿ Podolak J., Shilane P., Golovinskiy A., Rusinkiewicz S., Funkhouser T.: A planar-reflective symmetry transform for 3D shapes. ACM Transactions on Graphics Volume 25, Issue 3 2006, pp.549-559.
[20]
{PSR*14}¿ Pickup D., Sun X., Rosin P. L., et¿al.: SHREC'14 track: Shape retrieval of non-rigid 3d human models. In Proceedings of the 7th Eurographics workshop on 3D Object Retrieval2014, EG 3DOR'14, Eurographics Association.
[21]
{RBA*12}¿ Rodolí E., Bronstein A., Albarelli A., Bergamasco F., Torsello A.: A game-theoretic approach to deformable shape matching. In Proceedings CVPRProvidence, USA, 2012, IEEE, pp. pp.182-189.
[22]
{RBB11}¿ Rota Bulò S., Bomze I. M.: Infection and immunization: A new class of evolutionary game dynamics. Games and Economic Behavior Volume 71, Issue 1 2011, pp.193-211.
[23]
{RBTP09}¿ Rota Bulò S., Torsello A., Pelillo M.: A game-theoretic approach to partial clique enumeration. Image Vision Computers Volume 27, Issue 7 2009, pp.911-922.
[24]
{RCB*16}¿ Rodolí E., Cosmo L., Bronstein M. M., Torsello A., Cremers D.: Partial functional correspondence. Computer Graphics Forum 2016, to appear.
[25]
{RRBC14}¿ Rodolí E., Rota Bulò S., Cremers D.: Robust region detection via consensus segmentation of deformable shapes. Computer Graphics Forum Volume 33, Issue 5 2014, pp.97-106.
[26]
{RRBW*14}¿ Rodolí E., Rota Bulò S., Windheuser T., Vestner M., Cremers D.: Dense non-rigid shape correspondence using random forests. In Proceedings of CVPRColumbus, USA, 2014, IEEE, pp. pp.4177-4184.
[27]
{RTH*13}¿ Rodolí E., Torsello A., Harada T., Kuniyoshi Y., Cremers D.: Elastic net constraints for shape matching. In Proceedings of ICCVSydney, Australia, 2013, IEEE, pp. pp.1169-1176.
[28]
{SRS13}¿ Solé-Ribalta A., Serratosa F.: Graduated assignment algorithm for multiple graph matching based on a common labeling. International Journal of Pattern Recognition and Artificial Intelligence Volume 27, Issue 01 2013.
[29]
{STCB07}¿ Schmidt F. R., Töppe E., Cremers D., Boykov Y.: Intrinsic mean for semi-metrical shape retrieval via graph cuts. In Proceedings DAGM Berlin, Heidelberg, 2007, Springer-Verlag, pp. pp.446-455.
[30]
{SY14}¿ Sahillioğlu Y., Yemez Y.: Multiple shape correspondence by dynamic programming. Computer Graphics Forum Volume 33, Issue 7 2014, pp.121-130.
[31]
{WDB*08}¿ Weber O., Devir Y. S., Bronstein A. M., Bronstein M. M., Kimmel R.: Parallel algorithms for approximation of distance maps on parametric surfaces. ACM Transactions on Graphics Volume 27, Issue 4 2008, pp.104:1-104:16.
[32]
{YLL*14}¿ Yan J., Li Y., Liu W., Zha H., Yang X., Chu S. M.: Graduated consistency-regularized optimization for multi-graph matching. In Proceedings ECCV. D.Fleet, T.Pajdla, B.Schiele and T.Tuytelaars eds. New York, USA, 2014, Springer International Publishing, vol. 8689, pp. pp.407-422.
[33]
{ZKP10}¿ Zach C., Klopschitz M., Pollefeys M.: Disambiguating visual relations using loop constraints. In Proceedings CVPRSan Francisco, USA, 2010, IEEE, pp. pp.1426-1433.

Cited By

View all
  • (2022)Relationship-Based Point Cloud CompletionIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2021.310939228:12(4940-4950)Online publication date: 1-Dec-2022
  • (2022)3D Shape Analysis Through a Quantum Lens: the Average Mixing Kernel SignatureInternational Journal of Computer Vision10.1007/s11263-022-01610-y130:6(1474-1493)Online publication date: 1-Jun-2022
  • (2022)Multi-part shape matching by simultaneous partial functional correspondenceThe Visual Computer: International Journal of Computer Graphics10.1007/s00371-021-02337-639:1(393-412)Online publication date: 8-Jan-2022
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Computer Graphics Forum
Computer Graphics Forum  Volume 36, Issue 1
January 2017
346 pages
ISSN:0167-7055
EISSN:1467-8659
Issue’s Table of Contents

Publisher

The Eurographs Association & John Wiley & Sons, Ltd.

Chichester, United Kingdom

Publication History

Published: 01 January 2017

Author Tags

  1. Computer Graphics I.3.5 Computational Geometry and Object Modelling Shape Analysis
  2. intrinsic geometry
  3. shape collections
  4. shape matching

Qualifiers

  • Article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 30 Sep 2024

Other Metrics

Citations

Cited By

View all
  • (2022)Relationship-Based Point Cloud CompletionIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2021.310939228:12(4940-4950)Online publication date: 1-Dec-2022
  • (2022)3D Shape Analysis Through a Quantum Lens: the Average Mixing Kernel SignatureInternational Journal of Computer Vision10.1007/s11263-022-01610-y130:6(1474-1493)Online publication date: 1-Jun-2022
  • (2022)Multi-part shape matching by simultaneous partial functional correspondenceThe Visual Computer: International Journal of Computer Graphics10.1007/s00371-021-02337-639:1(393-412)Online publication date: 8-Jan-2022
  • (2020)Recent advances in shape correspondenceThe Visual Computer: International Journal of Computer Graphics10.1007/s00371-019-01760-036:8(1705-1721)Online publication date: 1-Aug-2020
  • (2020)LIMP: Learning Latent Shape Representations with Metric Preservation PriorsComputer Vision – ECCV 202010.1007/978-3-030-58580-8_2(19-35)Online publication date: 23-Aug-2020
  • (2020)The Average Mixing Kernel SignatureComputer Vision – ECCV 202010.1007/978-3-030-58565-5_1(1-17)Online publication date: 23-Aug-2020
  • (2019)A condition number for joint optimization of cycle-consistent networksProceedings of the 33rd International Conference on Neural Information Processing Systems10.5555/3454287.3454378(1007-1017)Online publication date: 8-Dec-2019
  • (2019)Tensor maps for synchronizing heterogeneous shape collectionsACM Transactions on Graphics10.1145/3306346.332294438:4(1-18)Online publication date: 12-Jul-2019
  • (2018)Joint Map and Symmetry SynchronizationComputer Vision – ECCV 201810.1007/978-3-030-01228-1_16(257-275)Online publication date: 8-Sep-2018
  • (2017)Deformable shape retrieval with missing partsProceedings of the Workshop on 3D Object Retrieval10.2312/3dor.20171057(85-94)Online publication date: 23-Apr-2017
  • Show More Cited By

View Options

View options

Get Access

Login options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media