demonstration

Public Access

Experiencing a Mirrored World with Geotagged Social Media in Geollery

Authors:

Ruofei Du,

David Li,

Amitabh VarshneyAuthors Info & Claims

CHI EA '19: Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems

Paper No.: INT040, Pages 1 - 4

https://doi.org/10.1145/3290607.3313273

Published: 02 May 2019 Publication History

All formats PDF

Abstract

We demonstrate the online deployment of Geollery, a mixed reality social media platform. We introduce an interactive pipeline to reconstruct a mirrored world at two levels of detail - the street level and the bird's-eye view. Instead of using offline 3D reconstruction approaches, our system streams and renders a mirrored world in real time, while depicting geotagged social media as billboards, balloons, framed photos, and virtual gifts. Geollery allows multiple users to see, chat, and collaboratively sketch with spatial context in this mirrored world. We demonstrate a wide range of use cases including crowdsourced tourism, interactive audio guide with immersive spatial context, and meeting remote friends in mixed reality. We envision Geollery will be inspiring and useful as a standalone social media platform for those looking to explore new areas or looking to share their experiences. Please refer to https://geollery.com for the paper and live demos.

Supplementary Material

ZIP File (int040pvc.zip)

Preview video captions

Download
.99 KB

MP4 File (int040p.mp4)

Preview video

Download
2.95 MB

MP4 File (demo1082.mp4)

Supplemental video

Download
195.57 MB

References

[1]

Abdullah Bulbul and Rozenn Dahyot. 2017. Social Media Based 3D Visual Popularity. Computers & Graphics 63 (2017), 28--36.

Digital Library

Google Scholar

[2]

Ruofei Du. 2018. Fusing Multimedia Data Into Dynamic Virtual Environments. Ph.D. Dissertation. University of Maryland, College Park.

Google Scholar

[3]

Ruofei Du, Ming Chuang, Wayne Chang, Hugues Hoppe, and Amitabh Varshney. 2018. Montage4D: Interactive Seamless Fusion of Multiview Video Textures . In Proceedings of ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games (I3D). ACM, Montreal, Quebec, Canada, 124--133.

Digital Library

Google Scholar

[4]

Ruofei Du, Ming Chuang, Wayne Chang, Hugues Hoppe, and Amitabh Varshney. 2019. Montage4D: Real-Time Seamless Fusion and Stylization of Multiview Video Textures. Journal of Computer Graphics Techniques 1, 15 (17 Jan. 2019), 1--34.

Google Scholar

[5]

Ruofei Du, David Li, and Amitabh Varshney. 2019. Geollery: a Mixed Reality Social Media Platform. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI). ACM, 13.

Digital Library

Google Scholar

[6]

Ruofei Du, David Li, and Amitabh Varshney. 2019. Interactive Fusion of 360° Images for a Mirrored World. In 2019 IEEE Conference on Virtual Reality and 3D User Interfaces.

Crossref

Google Scholar

[7]

Ruofei Du and Amitabh Varshney. 2016. Social Street View: Blending Immersive Street Views With Geo-Tagged Social Media. In Proceedings of the 21st International Conference on Web3D Technology (Web3D). ACM, 77--85.

Digital Library

Google Scholar

[8]

Ruofei Du and Amitabh Varshney. 2016. Systems, Devices, and Methods for Generating a Social Street View. US Patent App. 15/559,955, 15 pages.

Google Scholar

[9]

David Gelernter. 1993. Mirror Worlds: Or: The Day Software Puts the Universe in a Shoebox... How It Will Happen and What It Will Mean. Oxford University Press.

Digital Library

Google Scholar

[10]

Cheuk Yiu Ip, M. Adil Yalçin, David Luebke, and Amitabh Varshney. 2013. PixelPie: Maximal Poisson-Disk Sampling With Rasterization. In Proceedings of the 5th High-Performance Graphics Conference (HPG '13). ACM, 17--26.

Digital Library

Google Scholar

[11]

Hannu Kukka, Minna Pakanen, Mahmoud Badri, and Timo Ojala. 2017. Immersive Street-Level Social Media in the 3D Virtual City: Anticipated User Experience and Conceptual Development. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing. ACM, 2422--2435.

Digital Library

Google Scholar

[12]

Wade Roush. 2007. Second Earth. Technology Review (2007), 38.

Google Scholar

Cited By

View all

Privitera AFontana FGeronazzo M(2024)The Role of Audio in Immersive Storytelling: a Systematic Review in Cultural HeritageMultimedia Tools and Applications10.1007/s11042-024-19288-4Online publication date: 26-Jun-2024
https://doi.org/10.1007/s11042-024-19288-4
Shibuya YHamm ACerratto Pargman T(2022)Mapping HCI research methods for studying social media interactionComputers in Human Behavior10.1016/j.chb.2021.107131129:COnline publication date: 1-Apr-2022
https://dl.acm.org/doi/10.1016/j.chb.2021.107131
Du RLi DVarshney APolys NMcCann MLiu FPlesch A(2019)Project Geollery.com: Reconstructing A Live Mirrored World With Geotagged Social MediaProceedings of the 24th International Conference on 3D Web Technology10.1145/3329714.3338126(1-9)Online publication date: 26-Jul-2019
https://dl.acm.org/doi/10.1145/3329714.3338126
Show More Cited By

Index Terms

Experiencing a Mirrored World with Geotagged Social Media in Geollery
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms

Recommendations

Project Geollery.com: Reconstructing A Live Mirrored World With Geotagged Social Media
Web3D '19: Proceedings of the 24th International Conference on 3D Web Technology

Social media in virtual reality is in a high-growth market segment with influential products and services in virtual tourism, remote education, and business meetings. Nevertheless, previous systems have never achieved an online platform which renders a ...
Geollery: A Mixed Reality Social Media Platform
CHI '19: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems

We present Geollery, an interactive mixed reality social media platform for creating, sharing, and exploring geotagged information. Geollery introduces a real-time pipeline to progressively render an interactive mirrored world with three-dimensional (3D)...
Social street view: blending immersive street views with geo-tagged social media
Web3D '16: Proceedings of the 21st International Conference on Web3D Technology

This paper presents an immersive geo-spatial social media system for virtual and augmented reality environments. With the rapid growth of photo-sharing social media sites such as Flickr, Pinterest, and Instagram, geo-tagged photographs are now ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

CHI EA '19: Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems

May 2019

3673 pages

ISBN:9781450359719

DOI:10.1145/3290607

General Chairs:
Stephen Brewster
University of Glasgow, Scotland, UK
,
Geraldine Fitzpatrick
TU Wien, Austria
,
Program Chairs:
Anna Cox
University College London, UK
,
Vassilis Kostakos
University of Melbourne, Australia

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 May 2019

Check for updates

Author Tags

Qualifiers

Demonstration

Funding Sources

The State of Maryland
National Science Foundation

Conference

CHI '19

Sponsor:

SIGCHI

CHI '19: CHI Conference on Human Factors in Computing Systems

May 4 - 9, 2019

Glasgow, Scotland Uk

Acceptance Rates

Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

Upcoming Conference

CHI '25

Sponsor:
sigchi

CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
436
Total Downloads

Downloads (Last 12 months)74
Downloads (Last 6 weeks)16

Reflects downloads up to 24 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Privitera AFontana FGeronazzo M(2024)The Role of Audio in Immersive Storytelling: a Systematic Review in Cultural HeritageMultimedia Tools and Applications10.1007/s11042-024-19288-4Online publication date: 26-Jun-2024
https://doi.org/10.1007/s11042-024-19288-4
Shibuya YHamm ACerratto Pargman T(2022)Mapping HCI research methods for studying social media interactionComputers in Human Behavior10.1016/j.chb.2021.107131129:COnline publication date: 1-Apr-2022
https://dl.acm.org/doi/10.1016/j.chb.2021.107131
Du RLi DVarshney APolys NMcCann MLiu FPlesch A(2019)Project Geollery.com: Reconstructing A Live Mirrored World With Geotagged Social MediaProceedings of the 24th International Conference on 3D Web Technology10.1145/3329714.3338126(1-9)Online publication date: 26-Jul-2019
https://dl.acm.org/doi/10.1145/3329714.3338126
Du RLi DVarshney A(2019)Interactive Fusion of 360° Images for a Mirrored World2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR)10.1109/VR.2019.8798187(900-901)Online publication date: Mar-2019
https://doi.org/10.1109/VR.2019.8798187

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Project Geollery.com: Reconstructing A Live Mirrored World With Geotagged Social Media

Geollery: A Mixed Reality Social Media Platform

Social street view: blending immersive street views with geo-tagged social media