Streaming online log parsing method based on heuristic rule
To address the issues of inaccurate parsing and unstable performance in existing log parsing methods, a streaming online log parsing method based on heuristic rules, known as heuristic regex tree (HRTree), was proposed. Based on the drain method of parsing the structure tree, heuristic rules were in...
Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | zho |
| Published: |
Editorial Department of Journal on Communications
2024-04-01
|
| Series: | Tongxin xuebao |
| Subjects: | |
| Online Access: | http://www.joconline.com.cn/zh/article/doi/10.11959/j.issn.1000-436x.2024071/ |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1841539190306635776 |
|---|---|
| author | JIANG Zhongyuan TAO Meiyue ZHAO Xiaoqing FANG Xiaotong LI Xinghua MA Jianfeng |
| author_facet | JIANG Zhongyuan TAO Meiyue ZHAO Xiaoqing FANG Xiaotong LI Xinghua MA Jianfeng |
| author_sort | JIANG Zhongyuan |
| collection | DOAJ |
| description | To address the issues of inaccurate parsing and unstable performance in existing log parsing methods, a streaming online log parsing method based on heuristic rules, known as heuristic regex tree (HRTree), was proposed. Based on the drain method of parsing the structure tree, heuristic rules were introduced to split and construct the log, and some construction methods of the parse structure tree were optimized, so as to solve the problems of over fitting of log parameters and unstable parsing results of different system logs. Not only the classification of parsing results was accurate, but also the parameter content recognition was accurate. A large number of experimental results demonstrate that the proposed HRTree parsing method shows more than 90% parsing accuracy on different system logs. |
| format | Article |
| id | doaj-art-4d68fe74cdbe4301ac757b8bfbe664b0 |
| institution | Kabale University |
| issn | 1000-436X |
| language | zho |
| publishDate | 2024-04-01 |
| publisher | Editorial Department of Journal on Communications |
| record_format | Article |
| series | Tongxin xuebao |
| spelling | doaj-art-4d68fe74cdbe4301ac757b8bfbe664b02025-01-14T07:24:16ZzhoEditorial Department of Journal on CommunicationsTongxin xuebao1000-436X2024-04-01459511359255045Streaming online log parsing method based on heuristic ruleJIANG ZhongyuanTAO MeiyueZHAO XiaoqingFANG XiaotongLI XinghuaMA JianfengTo address the issues of inaccurate parsing and unstable performance in existing log parsing methods, a streaming online log parsing method based on heuristic rules, known as heuristic regex tree (HRTree), was proposed. Based on the drain method of parsing the structure tree, heuristic rules were introduced to split and construct the log, and some construction methods of the parse structure tree were optimized, so as to solve the problems of over fitting of log parameters and unstable parsing results of different system logs. Not only the classification of parsing results was accurate, but also the parameter content recognition was accurate. A large number of experimental results demonstrate that the proposed HRTree parsing method shows more than 90% parsing accuracy on different system logs.http://www.joconline.com.cn/zh/article/doi/10.11959/j.issn.1000-436x.2024071/massive loglog parsingheuristic ruleHRTree methodaccuracy |
| spellingShingle | JIANG Zhongyuan TAO Meiyue ZHAO Xiaoqing FANG Xiaotong LI Xinghua MA Jianfeng Streaming online log parsing method based on heuristic rule Tongxin xuebao massive log log parsing heuristic rule HRTree method accuracy |
| title | Streaming online log parsing method based on heuristic rule |
| title_full | Streaming online log parsing method based on heuristic rule |
| title_fullStr | Streaming online log parsing method based on heuristic rule |
| title_full_unstemmed | Streaming online log parsing method based on heuristic rule |
| title_short | Streaming online log parsing method based on heuristic rule |
| title_sort | streaming online log parsing method based on heuristic rule |
| topic | massive log log parsing heuristic rule HRTree method accuracy |
| url | http://www.joconline.com.cn/zh/article/doi/10.11959/j.issn.1000-436x.2024071/ |
| work_keys_str_mv | AT jiangzhongyuan streamingonlinelogparsingmethodbasedonheuristicrule AT taomeiyue streamingonlinelogparsingmethodbasedonheuristicrule AT zhaoxiaoqing streamingonlinelogparsingmethodbasedonheuristicrule AT fangxiaotong streamingonlinelogparsingmethodbasedonheuristicrule AT lixinghua streamingonlinelogparsingmethodbasedonheuristicrule AT majianfeng streamingonlinelogparsingmethodbasedonheuristicrule |