Loghub maintains a collection of system logs, which are freely accessible for AI-driven log analytics research. Some of the logs are production data released from previous studies, while some others are collected from real systems in our lab environment. Wherever possible, the logs are NOT sanitized, anonymized or modified in any way. These log datasets are freely available for research or academic work.
🤗 We proudly announce that the loghub datasets have attained total by more than 450 organizations from both industry and academia.
🔗 Get raw logs via hyperlinks in the Download column.
Dataset Description Labeled Time Span #Lines Raw Size Download 📂 Distributed systems HDFS_v1 Hadoop distributed file system log ✔️ 38.7 hours 11,175,629 1.47GiB 🔗 HDFS_v2 Hadoop distributed file system log N.A. 71,118,073 16.06GiB 🔗 HDFS_v3 Instrumented HDFS trace log (TraceBench) ✔️ N.A. 14,778,079 2.96GiB 🔗 Hadoop Hadoop mapreduce job log ✔️ (Check #56) N.A. 394,308 48.61MiB 🔗 Spark Spark job log N.A. 33,236,604 2.75GiB 🔗 Zookeeper ZooKeeper service log 26.7 days 74,380 9.95MiB 🔗 OpenStack OpenStack infrastructure log ✔️ N.A. 207,820 58.61MiB 🔗 📂 Super computers BGL Blue Gene/L supercomputer log ✔️ 214.7 days 4,747,963 708.76MiB 🔗 HPC High performance cluster log N.A. 433,489 32.00MiB 🔗 Thunderbird Thunderbird supercomputer log ✔️ 244 days 211,212,192 29.60GiB 🔗 📂 Operating systems Windows Windows event log 226.7 days 114,608,388 26.09GiB 🔗 Linux Linux system log 263.9 days 25,567 2.25MiB 🔗 Mac Mac OS log 7.0 days 117,283 16.09MiB 🔗 📂 Mobile systems Android_v1 Android framework log N.A. 1,555,005 183.37MiB 🔗 Android_v2 Android framework log N.A. 30,348,042 3.38GiB 🔗 HealthApp Health app log 10.5 days 253,395 22.44MiB 🔗 📂 Server applications Apache Apache web server error log 263.9 days 56,481 4.90MiB 🔗 OpenSSH OpenSSH server log 28.4 days 655,146 70.02MiB 🔗 📂 Standalone software Proxifier Proxifier software log N.A. 21,329 2.42MiB 🔗Please cite the following two papers if you use the loghub datasets in your research.
The datasets are freely available for research or academic work. For any usage or distribution of the datasets, please refer to the loghub repository URL https://github.com/logpai/loghub and cite the loghub paper where applicable.
Welcome to open a discussion here for any question and discussion.
RetroSearch is an open source project built by @garambo | Open a GitHub Issue
Search and Browse the WWW like it's 1997 | Search results from DuckDuckGo
HTML:
3.2
| Encoding:
UTF-8
| Version:
0.7.4