Failure Trace Archive

The following papers give an overview of the archive and the trace data sets:

• The Failure Trace Archive: Enabling the Comparison of Failure Measurements and Models of Distributed Systems Bahman Javadi, Derrick Kondo, Alex Iosup, Dick Epema, Journal of Parallel and Distributed Computing, Volume 73, Issue 8, August 2013, Pages 1208-1223.
• The Failure Trace Archive: Enabling Comparative Analysis of Failures in Diverse Distributed Systems Derrick Kondo, Bahman Javadi, Alex Iosup, Dick Epema, In the 10th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGrid 2010), Melbourne, Australia, May, 2010. Best Paper Award. Presentation (pdf)

Please cite the above articles to acknowledge use of the Failure Trace Archive.

Below we list which data sets have been used in which publications. Publications are grouped by the data sets used. In cases where authors use multiple data sets, the publications are cited again.

• SETI@home
  • Mining for Statistical Availability Models in Large-Scale Distributed Systems: An Empirical Study of SETI@home. B. Javadi, D. Kondo, JM. Vincent and D.P. Anderson. In 17th IEEE/ACM International Symposium on Modelling, Analysis and Simulation of Computer and Telecommunication Systems (MASCOTS), September 2009. (URL) (BIB)
  • Computing Low Latency Batches with Unreliable Workers in Volunteer Computing Environments. Eric Martin Heien, David P. Anderson and Kenichi Hagihara. J. Grid Comput., 7(4):501-518, 2009. (BIB)
  • On Correlated Availability in Internet Distributed Systems. Kondo, Derrick, Andrzejak, Artur and Anderson, David P.. In IEEE/ACM International Conference on Grid Computing (Grid), Tsukuba,Japan, 2008. (PDF) (BIB)
  • Ensuring Collective Availability in Volatile Resource Pools Via Forecasting. Artur Andrzejak, Derrick Kondo and David P. Anderson. In DSOM, pages 149-161, 2008. (BIB)
• Docking@home
  • On the effectiveness of application-aware self-management for scientific discovery in volunteer computing systems. T. Estrada and M. Taufer. In Proceedings of the IEEE/ACM International Conference for High Performance Computing, Networking, Storage, and Analysis (SC12), Novermber 2012. (BIB)
• Overnet
  • Understanding Availability. Bhagwan, R., Savage, S. and Voelker, G.. In Proceedings of IPTPS'03, 2003. (BIB)
• Microsoft
  • Feasibility of a Serverless Distributed file System Deployed on an Existing Set of Desktop PCs. Bolosky, W., Douceur, J., Ely, D. and Theimer, M.. In Proceedings of SIGMETRICS, 2000. (BIB)
  • Exploiting Availability Prediction in Distributed Systems. James W. Mickens and Brian D. Noble. In Proceedings of the 3rd conference on Networked Systems Design & Implementation, 2006. (URL) (BIB)
• LANL
  • A large scale study of failures in high-performance-computing systems. Bianca Schroeder and Garth A. Gibson. In International Symposium on Dependable Systems and Networks (DSN), June 2006. (URL) (BIB)
  • Fault-tolerant Routing for Multiple Permanent and Non-permanent Faults in HPC Systems. Gonzalo Zarza, Diego Lugones, Daniel Franco and Emilio Luque. In International Conference on Parallel and Distributed Processing Techniques and Applications (PDPTA'10), July 2010. (BIB)
• HPC2
  • Disk failures in the real world: What does an MTTF of 1,000,000 hours mean to you?. Bianca Schroeder and Garth A. Gibson. In 5th Usenix Conference on File and Storage Technologies (FAST) , February 2007. (URL) (BIB)
• HPC4
  • What Supercomputers Say: A Study of Five System Logs. Adam Oliner and Jon Stearley. In International Symposium on Dependable Systems and Networks (DSN), June 2007. (URL) (BIB)
• PNNL
  • MPP2 Syslog Data (2006-2008). DML Brown and GR Smith . Technical Report PNNL-SA-61371, Pacific Northwest National Laboratory, 2008. (BIB)
  • Fault-tolerant Routing for Multiple Permanent and Non-permanent Faults in HPC Systems. Gonzalo Zarza, Diego Lugones, Daniel Franco and Emilio Luque. In International Conference on Parallel and Distributed Processing Techniques and Applications (PDPTA'10), July 2010. (BIB)
• NERSC
  • Reliability Results of NERSC Systems. Akbar Mokhtarani, William Kramer, Jason Hick. Technical Report LBNL-430E, The National Energy Research Scientific Computing Center-LBNL, 2008. (URL) (BIB)
• Skype
  • An Experimental Study of the Skype Peer-to-Peer VoIP System. Saikat Guha, Neil Daswani, and Ravi Jain. In Proceedings of The 5th International Workshop on Peer-to-Peer Systems (IPTPS), February 2006. (BIB)
• Web sites
  • On correlated failures in survivable storage systems. Mehmet Bakkaloglu, Jay J. Wylie, Chenxi Wang, and Gregory R. Ganger. Technical Report MU-CS-02-129, Carnegie Mellon University, May 2002. (BIB)
• DNS
  • Availability,usage, and deployment characteristics of the domain name system. Jeffrey Pang, James Hendricks, Aditya Akella, Bruce Maggs, Roberto De Prisco, and Srinivasan Seshan. In Internet Measurement Conference (IMC), October 2004. (BIB)
• PlanetLab
  • Exploiting Availability Prediction in Distributed Systems. James W. Mickens and Brian D. Noble. In Proceedings of the 3rd conference on Networked Systems Design & Implementation, 2006. (URL) (BIB)
• Grenouille03
  • Resources availability for Peer to Peer systems. Da Costa, Georges, Marchand, Corine, Richard, Olivier and Vincent, Jean-Marc. In 20th International Conference on Advanced Information Networking and Applications (AINA 2006), Vienna University of Technology, Vienna, Austria, apr 2006. (BIB)
• Grenouille05
  • Resources availability for Peer to Peer systems. Da Costa, Georges, Marchand, Corine, Richard, Olivier and Vincent, Jean-Marc. In 20th International Conference on Advanced Information Networking and Applications (AINA 2006), Vienna University of Technology, Vienna, Austria, apr 2006. (BIB)
• EGEE
  • Identifying Failures in Grids through Monitoring and Ranking. Demetrios Zeinalipour-Yazti, Kyriakos Neocleous, Chryssis Georgiou and Marios D. Dikaiakos. In NCA, pages 291-298, 2008. (BIB)
• Grid'5000
  • On the Dynamic Resource Availability in Grids. Alexandru Iosup, Mathieu Jan, Ozan Sonmez,and Dick H.J. Epema. In 8th IEEE/ACM International Conference on Grid Computing, September 2007. (URL) (BIB)
• Notre Dame
  • Multi-State Grid Resource Availability Characterization. Brent Rood and Michael J. Lewis. In 8th Grid Computing Conference, September 2007. (BIB)
• Condor-cae
  • Analysis and Modeling of Time-Correlated Failures in Large-Scale Distributed Systems. Nezih Yigitbasi, Matthieu Gallet, Derrick Kondo, Alexandru Iosup, Dick Epema. In 8th IEEE/ACM International Conference on Grid Computing, October 2010. (URL) (BIB)
• Condor-cs
  • Analysis and Modeling of Time-Correlated Failures in Large-Scale Distributed Systems. Nezih Yigitbasi, Matthieu Gallet, Derrick Kondo, Alexandru Iosup, Dick Epema. In 8th IEEE/ACM International Conference on Grid Computing, October 2010. (URL) (BIB)
• Condor-glow
  • Analysis and Modeling of Time-Correlated Failures in Large-Scale Distributed Systems. Nezih Yigitbasi, Matthieu Gallet, Derrick Kondo, Alexandru Iosup, Dick Epema. In 8th IEEE/ACM International Conference on Grid Computing, October 2010. (URL) (BIB)
• Teragrid
  • Analysis and Modeling of Time-Correlated Failures in Large-Scale Distributed Systems. Nezih Yigitbasi, Matthieu Gallet, Derrick Kondo, Alexandru Iosup, Dick Epema. In 8th IEEE/ACM International Conference on Grid Computing, October 2010. (URL) (BIB)