Article

Passive NFS Tracing of Email and Research Workloads

Authors:

Jonathan Ledlie,

Margo SeltzerAuthors Info & Claims

FAST '03: Proceedings of the 2nd USENIX Conference on File and Storage Technologies

Pages 203 - 216

Published: 31 March 2003 Publication History

Abstract

We present an analysis of a pair of NFS traces of contemporary email and research workloads. We show that although the research workload resembles previously-studied workloads, the email workload is quite different. We also perform several new analyses that demonstrate the periodic nature of file system activity, the effect of out-of-order NFS calls, and the strong relationship between the name of a file and its size, lifetime, and access pattern.

References

[1]

{1} Mary G. Baker, John H. Hartman, Michael D. Kupfer, Ken W. Shirriff, and John K. Ousterhout. Measurements of a Distributed File System. In Proceedings of 13th ACM Symposium on Operating Systems Principles, pages 198- 212, Monterey, CA, October 1991.

[2]

{2} Matthew A. Blaze. NFS Tracing by Passive Network Monitoring. In Proceedings of the USENIX Winter 1992 Technical Conference, pages 333-343, San Fransisco, CA, January 1992.

[3]

{3} Matthew A. Blaze. Caching in Large-Scale Distributed File Systems. PhD thesis, Princeton University, January 1993.

[4]

{4} Pei Cao, Edward W. Felten, and Kai Li. Implementation and Performance of Application-Controlled File Caching. In Proceedings of the First USENIX Symposium on Operating Systems Design and Implementation (OSDI), pages 165-177, Monterey, CA, November 1994.

[5]

{5} Michael Dahlin, Randolph Wang, Thomas E. Anderson, and David A. Patterson. Cooperative Caching: Using Remote Client Memoryto Improve File System Performance. In Proceedings of the First USENIX Symposium on Operating Systems Design and Implementation (OSDI), pages 267-280, Monterey, CA, 1994.

[6]

{6} Nicholas Elprin and Bryan Parno. An Analysis of Database-Driven Mail Servers. Technical Report TR-02- 13, Harvard University DEAS, 2002.

[7]

{7} Riccardo Gusella. The Analysis of Diskless Workstation Traffic on an Ethernet. Technical Report 379, University of California at Berkeley, 1987.

[8]

{8} Andrew W. Moore. Operating System and File System Monitoring: a Comparison of Passive Network Monitoring with Full Kernel Instrumentation Techniques. Master's thesis, Monash University, 1995.

[9]

{9} J. Ousterhout, H. Da Costa, D. Harrison, J. Kunze, M. Kupfer, and J. Thompson. A Trace-Driven Analysis of the UNIX 4.2 BSD File System. In Proceedings of the Tenth ACM Symposium on Operating Systems Principles, pages 15-24, Orcas Island, WA, December 1985.

[10]

{10} B. Pawlowski, S. Shepler, C. Beame, B. Callaghan, M. Eisler, D. Noveck, D. Robinson, and R. Thurlow. The NFS Version 4 Protocol. In Proceedings of the 2nd International System Administration and Networking Conference (SANE2000), Maastricht, The Netherlands, May 2000.

[11]

{11} S. Quinlan and S. Dorward. Venti: a New Approach to Archival Storage. In First USENIX Conference on File and Storage Technologies, pages 89-102, Monterey, CA, 2002.

[12]

{12} Drew Roselli, Jacob Lorch, and Thomas Anderson. A Comparison of File System Workloads. In USENIX 2000 Technical Conference, pages 41-54, San Diego, CA, 2000.

[13]

{13} Mendel Rosenblum and John K. Ousterhout. The Design and Implementation of a Log-Structured File System. ACM Transactions on Computer Systems, 10(1):26- 52, 1992.

[14]

{14} Keith A. Smith and Margo I. Seltzer. File System Aging -Increasing the Relevance of File System Benchmarks. In Proceedings of SIGMETRICS 1997: Measurement and Modeling of Computer Systems, pages 203-213, Seattle, WA, June 1997.

[15]

{15} Werner Vogels. File System Usage in Windows NT. In Proceedings of the Seventeenth ACM Symposium on Operating Systems Principles, pages 93-109, Kiawah Island, SC, December 1999.

Cited By

Wortman PChandy J(2020)A trace-based study of SMB network file system workloads in an academic enterpriseProceedings of the 2020 Summer Simulation Conference10.5555/3427510.3427552(1-8)Online publication date: 20-Jul-2020
https://dl.acm.org/doi/10.5555/3427510.3427552
Hua YJiang HFeng D(2016)Real-Time Semantic Search Using Approximate Methodology for Large-Scale Storage SystemsIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2015.242539927:4(1212-1225)Online publication date: 1-Apr-2016
https://dl.acm.org/doi/10.1109/TPDS.2015.2425399
Huo ZXiao LZhong QLi SLi ARuan LWang SFu L(2016)MBFSThe Journal of Supercomputing10.1007/s11227-015-1464-272:8(3006-3032)Online publication date: 1-Aug-2016
https://dl.acm.org/doi/10.1007/s11227-015-1464-2
Show More Cited By

Index Terms

Passive NFS Tracing of Email and Research Workloads

Recommendations

Passive NFS tracing of email and research workloads
FAST'03: Proceedings of the 2nd USENIX conference on File and storage technologies

We present an analysis of a pair of NFS traces of contemporary email and research workloads. We show that although the research workload resembles previously-studied workloads, the email workload is quite different. We also perform several new analyses ...
NFS-cc: tuning NFS for concurrent read sharing

A common file access pattern found in cluster applications is concurrent read sharing: applications running on multiple sites read access the same data set concurrently. Traditional network file systems are limited by the server's network bandwidth; ...
Metadata logging in an NFS server
TCON'95: Proceedings of the USENIX 1995 Technical Conference Proceedings

Over the last few years, there have been several efforts to use logging to improve performance, reliability, and recovery times of file systems. The two major techniques are metadata logging, where the log records metadata changes and is a supplement to ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Guide Proceedings

FAST '03: Proceedings of the 2nd USENIX Conference on File and Storage Technologies

March 2003

273 pages

Publisher

USENIX Association

United States

Publication History

Published: 31 March 2003

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

50
Total Citations
View Citations
103
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 14 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Wortman PChandy J(2020)A trace-based study of SMB network file system workloads in an academic enterpriseProceedings of the 2020 Summer Simulation Conference10.5555/3427510.3427552(1-8)Online publication date: 20-Jul-2020
https://dl.acm.org/doi/10.5555/3427510.3427552
Hua YJiang HFeng D(2016)Real-Time Semantic Search Using Approximate Methodology for Large-Scale Storage SystemsIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2015.242539927:4(1212-1225)Online publication date: 1-Apr-2016
https://dl.acm.org/doi/10.1109/TPDS.2015.2425399
Huo ZXiao LZhong QLi SLi ARuan LWang SFu L(2016)MBFSThe Journal of Supercomputing10.1007/s11227-015-1464-272:8(3006-3032)Online publication date: 1-Aug-2016
https://dl.acm.org/doi/10.1007/s11227-015-1464-2
Miranda ACortes TSchroeder BThereska E(2014)CRAIDProceedings of the 12th USENIX conference on File and Storage Technologies10.5555/2591305.2591319(133-146)Online publication date: 17-Feb-2014
https://dl.acm.org/doi/10.5555/2591305.2591319
Iritani MYokota H(2012)Effects on performance and energy reduction by file relocation based on file-access correlationsProceedings of the 2012 Joint EDBT/ICDT Workshops10.1145/2320765.2320794(79-86)Online publication date: 30-Mar-2012
https://dl.acm.org/doi/10.1145/2320765.2320794
Skourtis DKato SBrandt SEpema DKielmann TRipeanu M(2012)QBoxProceedings of the 21st international symposium on High-Performance Parallel and Distributed Computing10.1145/2287076.2287087(73-84)Online publication date: 18-Jun-2012
https://dl.acm.org/doi/10.1145/2287076.2287087
Huang HZhang NWang WDas GSzalay AGanger GWilkes J(2011)Just-in-time analytics on large file systemsProceedings of the 9th USENIX conference on File and stroage technologies10.5555/1960475.1960491(16-16)Online publication date: 15-Feb-2011
https://dl.acm.org/doi/10.5555/1960475.1960491
Sinnamohideen SSambasivan RHendricks JLiu LGanger G(2010)A transparently-scalable metadata service for the Ursa Minor storage systemProceedings of the 2010 USENIX conference on USENIX annual technical conference10.5555/1855840.1855853(13-13)Online publication date: 23-Jun-2010
https://dl.acm.org/doi/10.5555/1855840.1855853
Koller RRangaswami R(2010)I/O deduplicationProceedings of the 8th USENIX conference on File and storage technologies10.5555/1855511.1855527(16-16)Online publication date: 23-Feb-2010
https://dl.acm.org/doi/10.5555/1855511.1855527
Yadwadkar NBhattacharyya CGopinath KNiranjan TSusarla S(2010)Discovery of application workloads from network file tracesProceedings of the 8th USENIX conference on File and storage technologies10.5555/1855511.1855525(14-14)Online publication date: 23-Feb-2010
https://dl.acm.org/doi/10.5555/1855511.1855525
Show More Cited By

View Options

View options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents