Feedback-Driven Pattern Matching in Time Series Data
While motif discovery methods have come a long way over the years, they generally match occurrences based on the similar shape of the whole subsequence. As patterns in production network monitoring environments, which monitors and manages entire infrastructures of millions of device metrics over tim...
Saved in:
Main Authors: | , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
IEEE
2025-01-01
|
Series: | IEEE Access |
Subjects: | |
Online Access: | https://ieeexplore.ieee.org/document/10807292/ |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
_version_ | 1841556986104119296 |
---|---|
author | M. Van Onsem V. Ledoux W. Melange D. Dreesen S. Van Hoecke |
author_facet | M. Van Onsem V. Ledoux W. Melange D. Dreesen S. Van Hoecke |
author_sort | M. Van Onsem |
collection | DOAJ |
description | While motif discovery methods have come a long way over the years, they generally match occurrences based on the similar shape of the whole subsequence. As patterns in production network monitoring environments, which monitors and manages entire infrastructures of millions of device metrics over time, frequently exhibit more complex characteristics such as differences in temporal size or expected noise, these methods often remain insufficient for accurately tracking important behavioral patterns such as backup cycles or transcode sessions. This paper therefore proposes a feedback framework that allows a user to select additional motif ranges to be included or excluded from the model. The method uses a distance matrix of subsequences to extract common patterns from feedback samples and defines temporal rules on how these patterns are allowed to occur. The technique was tested on synthetic data as well as production network monitoring data and a publicly available human motion primitives dataset. The tests show that the recall score can be significantly improved with the proposed feedback system, increasing from 37% to 95% while also maintaining a perfect precision score. This is achieved by providing only one to three feedback samples as input. While the scope of this paper is limited to shape based features, the proposed technique can also be used for less exact patterns such as changepoints in noise. |
format | Article |
id | doaj-art-04d7c604835840c9a91d05e96d002fe4 |
institution | Kabale University |
issn | 2169-3536 |
language | English |
publishDate | 2025-01-01 |
publisher | IEEE |
record_format | Article |
series | IEEE Access |
spelling | doaj-art-04d7c604835840c9a91d05e96d002fe42025-01-07T00:01:54ZengIEEEIEEE Access2169-35362025-01-01131764177710.1109/ACCESS.2024.352033710807292Feedback-Driven Pattern Matching in Time Series DataM. Van Onsem0https://orcid.org/0000-0002-3899-064XV. Ledoux1W. Melange2D. Dreesen3S. Van Hoecke4https://orcid.org/0000-0002-7865-6793IDLab, imec, Ghent University, Ghent, BelgiumSkyline Communications, Izegem, BelgiumSkyline Communications, Izegem, BelgiumSkyline Communications, Izegem, BelgiumIDLab, imec, Ghent University, Ghent, BelgiumWhile motif discovery methods have come a long way over the years, they generally match occurrences based on the similar shape of the whole subsequence. As patterns in production network monitoring environments, which monitors and manages entire infrastructures of millions of device metrics over time, frequently exhibit more complex characteristics such as differences in temporal size or expected noise, these methods often remain insufficient for accurately tracking important behavioral patterns such as backup cycles or transcode sessions. This paper therefore proposes a feedback framework that allows a user to select additional motif ranges to be included or excluded from the model. The method uses a distance matrix of subsequences to extract common patterns from feedback samples and defines temporal rules on how these patterns are allowed to occur. The technique was tested on synthetic data as well as production network monitoring data and a publicly available human motion primitives dataset. The tests show that the recall score can be significantly improved with the proposed feedback system, increasing from 37% to 95% while also maintaining a perfect precision score. This is achieved by providing only one to three feedback samples as input. While the scope of this paper is limited to shape based features, the proposed technique can also be used for less exact patterns such as changepoints in noise.https://ieeexplore.ieee.org/document/10807292/Motif discoverynetwork monitoringtime seriesmatrix profile |
spellingShingle | M. Van Onsem V. Ledoux W. Melange D. Dreesen S. Van Hoecke Feedback-Driven Pattern Matching in Time Series Data IEEE Access Motif discovery network monitoring time series matrix profile |
title | Feedback-Driven Pattern Matching in Time Series Data |
title_full | Feedback-Driven Pattern Matching in Time Series Data |
title_fullStr | Feedback-Driven Pattern Matching in Time Series Data |
title_full_unstemmed | Feedback-Driven Pattern Matching in Time Series Data |
title_short | Feedback-Driven Pattern Matching in Time Series Data |
title_sort | feedback driven pattern matching in time series data |
topic | Motif discovery network monitoring time series matrix profile |
url | https://ieeexplore.ieee.org/document/10807292/ |
work_keys_str_mv | AT mvanonsem feedbackdrivenpatternmatchingintimeseriesdata AT vledoux feedbackdrivenpatternmatchingintimeseriesdata AT wmelange feedbackdrivenpatternmatchingintimeseriesdata AT ddreesen feedbackdrivenpatternmatchingintimeseriesdata AT svanhoecke feedbackdrivenpatternmatchingintimeseriesdata |