Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/2788539.2788559acmotherconferencesArticle/Chapter ViewAbstractPublication PagessccgConference Proceedingsconference-collections
research-article

Dynamic texture editing

Published: 22 April 2015 Publication History

Abstract

A fast simple method for dynamic textures enlargement and editing is presented. The resulting edited dynamic texture is a mixture of several color dynamic textures that realistically matches the given color textures appearance and respects their original optical flows. The method simultaneously allows to spatially and temporarily enlarge the original dynamic textures to fill any required four dimensional dynamic texture space. The method is based on a generalization of the prominent static double toroid-shaped texture modeling roller method to the dynamic texture domain. The presented method keeps the original static texture roller principle of separated analysis and synthesis parts of the algorithm. In its analytical step, the input textures patches are found by an optimal overlap tiling and the subsequent minimum boundary cut. The optimal toroid-shaped dynamic texture patches are created in each spatial and time dimension, respectively. The spatial dimension tile border is derived by textural features, color-tone, and the minimal overlapping error. The time dimension tile border is detected by minimizing the overlapping error and using the input textures optical flow. The realistic appearance of the dynamic textures mix requires to edit the patch color space and to find border patches which consists from more than one type of the texture. These border patches are found similarly to the multi-texture analysis patch step. Since all time-consuming processing, such as the finding of optimal spatio-temporal triple toroidal patches, are done in the analytical step which is completely separated from synthesis part, the synthesis of the edited and enlarged resulting texture can by done very efficiently by applying simple set of repeating rules for these triple toroidal patches. Thus the presented method is extremely fast and capable to synthesize a learned natural dynamic texture spatially and its time span in real-time.

References

[1]
Bar-Joseph, Z., El-Yaniv, R., Lischinski, D., and Werman, M. 2001. Texture mixing and texture movie synthesis using statistical learning. IEEE Transactions on Visualization and Computer Graphics 7, 120--135.
[2]
Bar-Joseph, Z. 1999. Statistical learning of multi-dimensional textures. PhD thesis, The Hebrew University.
[3]
Chan, A. B., and Vasconcelos, N. 2005. Mixtures of dynamic textures. In 10th ICCV 2005), 17-20 October 2005, Beijing, China, IEEE Computer Society, 641--647.
[4]
Chan, A. B., and Vasconcelos, N. 2006. Layered dynamic textures. In Advances in Neural Information Processing Systems 18, MIT Press.
[5]
Chan, A. B., and Vasconcelos, N. 2008. Modeling, clustering, and segmenting video with mixtures of dynamic textures. IEEE Tr. PAMI.
[6]
Chiba, N., Muraoka, K., Takahashi, H., and Miura, M. 1994. Two-dimensional visual simulation of flames, smoke and the spread of fire. The Journal of Visualization and Computer Animation 5, 1, 37--53.
[7]
Constantini, R., Sbaiz, L., and Ssstrunk, S. 2006. Dynamic texture synthesis: Compact models based on luminance-chrominance color representation. In International Conference on Image Processing, 2085--2088.
[8]
Costantini, R., Sbaiz, L., and Ssstrunk, S. 2008. Higher order svd analysis for dynamic texture synthesis. IEEE Transactions on Image Processing, 42--52.
[9]
Doretto, G., Chiuso, A., Wu, Y. N., and Soatto, S. 2003. Dynamic textures. Int. Journal of Computer Vision 51, 2, 91--109.
[10]
Edelman, S. 1992. Visual perception. Encyclopedia of Artifical Intelligence, 2:1655--1663.
[11]
Fahle, M., and Poggio, T. 1981. Visual hyperacuity: spatiotemporal interpolation in human vision. Proceedings of the Royal Society of London. Series B. Biological Sciences 213, 1193, 451--477.
[12]
Filip, J., Haindl, M., and Chetverikov, D. 2006. Fast synthesis of dynamic colour textures. In Pattern Recognition, 2006. ICPR 2006. 18th International Conference on, vol. 4, 25--28.
[13]
Haindl, M., and Filip, J. 2013. Visual Texture. Advances in Computer Vision and Pattern Recognition. Springer-Verlag, London.
[14]
Haindl, M., and Hatka, M. 2005. A roller - fast sampling-based texture synthesis algorithm. In The 13th International Conference in Central Europe on Computer Graphics, Visualization and Computer Vision 2005, University of Western Bohemia, Plzen, V. Skala, Ed., University of Western Bohemia, 80--83.
[15]
Haindl, M., and Richtr, R. 2013. Dynamic texture enlargement. In Spring Conference on Computer Graphics, ACM, New York, NY, USA, SCCG '13, 005:5--005:12.
[16]
Kwatra, V., Schödl, A., Essa, I., Turk, G., and Bobick, A. 2003. Graphcut textures: Image and video synthesis using graph cuts. ACM Trans. Graph. 22, 3 (July), 277--286.
[17]
Kwatra, V., Essa, I., Bobick, A., and Kwatra, N. 2005. Texture optimization for example-based synthesis. ACM Transactions on Graphics, SIGGRAPH 24, 795--802.
[18]
Lizarraga-Morales, R. A., Guo, Y., Zhao, G., Pietikinen, M., and Sanchez-Yanez, R. E. 2014. Local spatiotemporal features for dynamic texture synthesis. EURASIP Journal on Image and Video Processing 2014, 1.
[19]
Perry, C. H., and Picard, R. W. 1994. Synthesizing flames and their spreading. In Proceedings of the Fifth Eurographics Workshop on Animation and Simulation, 1--14.
[20]
Peteri, R., Fazekas, S., and Huiskes, M. J. 2010. Dyntex: A comprehensive database of dynamic textures. Pattern Recognition Letters 31, 12, 1627--1632.
[21]
Phillips, P. M., and Watson, G. 2003. Generalising video textures. In Theory and Practice of Computer Graphics 2003 (TPCG 2003), 3-5 June 2003, Birmingham, UK, 8--15.
[22]
Schödl, A., Szeliski, R., Salesin, D. H., and Essa, I. 2000. Video textures. In Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques, ACM Press/Addison-Wesley Publishing Co., New York, NY, USA, SIGGRAPH '00, 489--498.
[23]
Soatto, S., Doretto, G., and Wu, Y. N. 2001. Dynamic textures. In iccv, vol. 2, 439--446.
[24]
Stam, J., and Fiume, E. 1993. Turbulent wind fields for gaseous phenomena. In Proceedings of the 20th Annual Conference on Computer Graphics and Interactive Techniques, ACM, New York, NY, USA, SIGGRAPH '93, 369--376.
[25]
Szummer, M., and Picard, R. W. 1996. Temporal texture modeling. In IEEE Intl. Conf. Image Processing, vol. 3, 823--826.
[26]
Tian, G. Y., Gledhill, D., Taylor, D., and Clarke, D. 2002. Colour correction for panoramic imaging. In Information Visualisation, 2002. Proceedings. Sixth International Conference on, 483--488.
[27]
Zhu, S. C., Wu, Y., and Mumford, D. 1998. Filters, random fields and maximum entropy (frame) -- towards a unified theory for texture modeling. INTERNATIONAL JOURNAL OF COMPUTER VISION 27, 2, 1--20.

Cited By

View all
  • (2021)A Comprehensive Taxonomy of Dynamic Texture RepresentationACM Computing Surveys10.1145/348789255:1(1-39)Online publication date: 23-Nov-2021

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences
SCCG '15: Proceedings of the 31st Spring Conference on Computer Graphics
April 2015
152 pages
ISBN:9781450336932
DOI:10.1145/2788539
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 22 April 2015

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. computer graphics
  2. dynamic texture
  3. dynamic texture editing
  4. dynamic texture modeling
  5. image generation
  6. patch-based texture synthesis

Qualifiers

  • Research-article

Conference

SCCG'15
SCCG'15: Spring Conference on Computer Graphics
April 22 - 24, 2015
Smolenice, Slovakia

Acceptance Rates

Overall Acceptance Rate 67 of 115 submissions, 58%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)3
  • Downloads (Last 6 weeks)0
Reflects downloads up to 18 Nov 2024

Other Metrics

Citations

Cited By

View all
  • (2021)A Comprehensive Taxonomy of Dynamic Texture RepresentationACM Computing Surveys10.1145/348789255:1(1-39)Online publication date: 23-Nov-2021

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media