poster

MemGator - A Portable Concurrent Memento Aggregator: Cross-Platform CLI and Server Binaries in Go

Authors:

Sawood Alam,

Michael L. NelsonAuthors Info & Claims

JCDL '16: Proceedings of the 16th ACM/IEEE-CS on Joint Conference on Digital Libraries

Pages 243 - 244

https://doi.org/10.1145/2910896.2925452

Published: 19 June 2016 Publication History

Get Access

Abstract

The Memento protocol makes it easy to build a uniform lookup service to aggregate the holdings of web archives. However, there is a lack of tools to utilize this capability in archiving applications and research projects. We created MemGator, an open source, easy to use, portable, concurrent, cross-platform, and self-documented Memento aggregator CLI and server tool written in Go. MemGator implements all the basic features of a Memento aggregator (e.g., TimeMap and TimeGate) and gives the ability to customize various options including which archives are aggregated. It is being used heavily by tools and services such as Mink, WAIL, OldWeb.today, and archiving research projects and has proved to be reliable even in conditions of extreme load.

References

[1]

S. Alam, M. L. Nelson, H. V. de Sompel, L. Balakireva, H. Shankar, and D. S. H. Rosenthal. Web Archive Profiling Through CDX Summarization. In Proceedings of 19th International Conference on Theory and Practice of Digital Libraries, TPDL 2015, pages 3--14.

Google Scholar

[2]

M. Kelly, M. L. Nelson, and M. C. Weigle. Mink: Integrating the Live and Archived Web Viewing Experience Using Web Browsers and Memento. In Proceedings of the 14th ACM/IEEE-CS Joint Conference on Digital Libraries, pages 469--470, 2014.

Digital Library

Google Scholar

[3]

H. Van de Sompel, M. L. Nelson, and R. Sanderson. HTTP Framework for Time-Based Access to Resource States -- Memento. RFC 7089, Dec. 2013.

Google Scholar

Cited By

View all

Alam SGarg KWeigle MNelson MGraham MAyala DKlein MBen-David AJäschke RKelly M(2024)TrendMachine: A Temporal Webpage Resilience PortalProceedings of the 2023 ACM/IEEE Joint Conference on Digital Libraries10.1109/JCDL57899.2023.00023(93-97)Online publication date: 26-Jun-2024
https://dl.acm.org/doi/10.1109/JCDL57899.2023.00023
Weigle MNelson MAlam SGraham MKlein MBen-David AJäschke RKelly M(2024)Right HTML, Wrong JSON: Challenges in Replaying Archived Webpages Built with Client-Side RenderingProceedings of the 2023 ACM/IEEE Joint Conference on Digital Libraries10.1109/JCDL57899.2023.00022(82-92)Online publication date: 26-Jun-2024
https://dl.acm.org/doi/10.1109/JCDL57899.2023.00022
Frew LNelson MWeigle MKlein MBen-David AJäschke RKelly M(2024)Making Changes in Webpages Discoverable: A Change-Text Search Interface for Web ArchivesProceedings of the 2023 ACM/IEEE Joint Conference on Digital Libraries10.1109/JCDL57899.2023.00021(71-81)Online publication date: 26-Jun-2024
https://dl.acm.org/doi/10.1109/JCDL57899.2023.00021
Show More Cited By

Index Terms

MemGator - A Portable Concurrent Memento Aggregator: Cross-Platform CLI and Server Binaries in Go
1. Applied computing
  1. Computers in other domains
    1. Digital libraries and archives
2. Information systems
  1. World Wide Web
    1. Web services
      1. RESTful web services

Recommendations

Mobile Mink: Merging Mobile and Desktop Archived Webs
JCDL '15: Proceedings of the 15th ACM/IEEE-CS Joint Conference on Digital Libraries

We describe the mobile app \emph{Mobile Mink} which extends Mink, a browser extension that integrates the live and archived web. Mobile Mink discovers mobile and desktop URIs and provides the user an aggregated TimeMap of both mobile and desktop ...
Only One Out of Five Archived Web Pages Existed as Presented
HT '15: Proceedings of the 26th ACM Conference on Hypertext & Social Media

When a user retrieves a page from a web archive, the page is marked with the acquisition datetime of the root resource, which effectively asserts "this is how the page looked at a that datetime." However, embedded resources, such as images, are often ...
Routing Memento Requests Using Binary Classifiers
JCDL '16: Proceedings of the 16th ACM/IEEE-CS on Joint Conference on Digital Libraries

The Memento protocol provides a uniform approach to query individual web archives. Soon after its emergence, Memento Aggregator infrastructure was introduced that supports querying across multiple archives simultaneously. An Aggregator generates a ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

JCDL '16: Proceedings of the 16th ACM/IEEE-CS on Joint Conference on Digital Libraries

June 2016

316 pages

ISBN:9781450342292

DOI:10.1145/2910896

General Chairs:
Nabil R. Adam
Rutgers University
,
Boots Cassel
Villanova University
,
Yelena Yesha
University of Maryland, Baltimore County
,
Program Chairs:
Richard Furuta
Texas A&M University
,
Michele C. Weigle
Old Dominion University

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 19 June 2016

Check for updates

Author Tags

Qualifiers

Poster

Funding Sources

IIPC

Conference

JCDL '16

Sponsor:

JCDL '16: The 16th ACM/IEEE-CS Joint Conference on Digital Libraries

June 19 - 23, 2016

New Jersey, Newark, USA

Acceptance Rates

JCDL '16 Paper Acceptance Rate 15 of 52 submissions, 29%;

Overall Acceptance Rate 415 of 1,482 submissions, 28%

Upcoming Conference

JCDL '24

Sponsor:
sigir
sigir

The 2024 ACM/IEEE Joint Conference on Digital Libraries

December 16 - 20, 2024

Hong Kong , China

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

24
Total Citations
View Citations
77
Total Downloads

Downloads (Last 12 months)4
Downloads (Last 6 weeks)0

Reflects downloads up to 24 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Alam SGarg KWeigle MNelson MGraham MAyala DKlein MBen-David AJäschke RKelly M(2024)TrendMachine: A Temporal Webpage Resilience PortalProceedings of the 2023 ACM/IEEE Joint Conference on Digital Libraries10.1109/JCDL57899.2023.00023(93-97)Online publication date: 26-Jun-2024
https://dl.acm.org/doi/10.1109/JCDL57899.2023.00023
Weigle MNelson MAlam SGraham MKlein MBen-David AJäschke RKelly M(2024)Right HTML, Wrong JSON: Challenges in Replaying Archived Webpages Built with Client-Side RenderingProceedings of the 2023 ACM/IEEE Joint Conference on Digital Libraries10.1109/JCDL57899.2023.00022(82-92)Online publication date: 26-Jun-2024
https://dl.acm.org/doi/10.1109/JCDL57899.2023.00022
Frew LNelson MWeigle MKlein MBen-David AJäschke RKelly M(2024)Making Changes in Webpages Discoverable: A Change-Text Search Interface for Web ArchivesProceedings of the 2023 ACM/IEEE Joint Conference on Digital Libraries10.1109/JCDL57899.2023.00021(71-81)Online publication date: 26-Jun-2024
https://dl.acm.org/doi/10.1109/JCDL57899.2023.00021
Jayanetti HGarg KAlam SNelson MWeigle M(2024)Robots still outnumber humans in web archives in 2019, but less than in 2015 and 2012International Journal on Digital Libraries10.1007/s00799-024-00397-225:3(537-553)Online publication date: 1-Sep-2024
https://dl.acm.org/doi/10.1007/s00799-024-00397-2
Kelly M(2024)Exploiting the untapped functional potential of Memento aggregators beyond aggregationInternational Journal on Digital Libraries10.1007/s00799-023-00391-025:1(93-104)Online publication date: 1-Mar-2024
https://dl.acm.org/doi/10.1007/s00799-023-00391-0
Aturban MKlein MVan de Sompel HAlam SNelson MWeigle M(2023)Hashes are not suitable to verify fixity of the public archived webPLOS ONE10.1371/journal.pone.028687918:6(e0286879)Online publication date: 9-Jun-2023
https://doi.org/10.1371/journal.pone.0286879
Escamilla EKlein MCooper TRampin VWeigle MNelson M(2023)Cited But Not Archived: Analyzing the Status of Code References in Scholarly ArticlesLeveraging Generative Intelligence in Digital Libraries: Towards Human-Machine Collaboration10.1007/978-981-99-8088-8_17(194-207)Online publication date: 4-Dec-2023
https://dl.acm.org/doi/10.1007/978-981-99-8088-8_17
Kelly M(2022)Aggregator Reuse and Extension for Richer Web Archive InteractionFrom Born-Physical to Born-Virtual: Augmenting Intelligence in Digital Libraries10.1007/978-3-031-21756-2_25(313-328)Online publication date: 7-Dec-2022
https://doi.org/10.1007/978-3-031-21756-2_25
Alam SGraham M(2022)CDX Summary: Web Archival Collection InsightsLinking Theory and Practice of Digital Libraries10.1007/978-3-031-16802-4_25(297-305)Online publication date: 20-Sep-2022
https://dl.acm.org/doi/10.1007/978-3-031-16802-4_25
Jayanetti HGarg KAlam SNelson MWeigle M(2022)Robots Still Outnumber Humans in Web Archives, But Less Than BeforeLinking Theory and Practice of Digital Libraries10.1007/978-3-031-16802-4_19(245-259)Online publication date: 15-Sep-2022
https://doi.org/10.1007/978-3-031-16802-4_19
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Mobile Mink: Merging Mobile and Desktop Archived Webs

Only One Out of Five Archived Web Pages Existed as Presented

Routing Memento Requests Using Binary Classifiers