Feedback-Driven Pattern Matching in Time Series Data

While motif discovery methods have come a long way over the years, they generally match occurrences based on the similar shape of the whole subsequence. As patterns in production network monitoring environments, which monitors and manages entire infrastructures of millions of device metrics over tim...

Full description

Saved in:
Bibliographic Details
Main Authors: M. Van Onsem, V. Ledoux, W. Melange, D. Dreesen, S. Van Hoecke
Format: Article
Language:English
Published: IEEE 2025-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/10807292/
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1841556986104119296
author M. Van Onsem
V. Ledoux
W. Melange
D. Dreesen
S. Van Hoecke
author_facet M. Van Onsem
V. Ledoux
W. Melange
D. Dreesen
S. Van Hoecke
author_sort M. Van Onsem
collection DOAJ
description While motif discovery methods have come a long way over the years, they generally match occurrences based on the similar shape of the whole subsequence. As patterns in production network monitoring environments, which monitors and manages entire infrastructures of millions of device metrics over time, frequently exhibit more complex characteristics such as differences in temporal size or expected noise, these methods often remain insufficient for accurately tracking important behavioral patterns such as backup cycles or transcode sessions. This paper therefore proposes a feedback framework that allows a user to select additional motif ranges to be included or excluded from the model. The method uses a distance matrix of subsequences to extract common patterns from feedback samples and defines temporal rules on how these patterns are allowed to occur. The technique was tested on synthetic data as well as production network monitoring data and a publicly available human motion primitives dataset. The tests show that the recall score can be significantly improved with the proposed feedback system, increasing from 37% to 95% while also maintaining a perfect precision score. This is achieved by providing only one to three feedback samples as input. While the scope of this paper is limited to shape based features, the proposed technique can also be used for less exact patterns such as changepoints in noise.
format Article
id doaj-art-04d7c604835840c9a91d05e96d002fe4
institution Kabale University
issn 2169-3536
language English
publishDate 2025-01-01
publisher IEEE
record_format Article
series IEEE Access
spelling doaj-art-04d7c604835840c9a91d05e96d002fe42025-01-07T00:01:54ZengIEEEIEEE Access2169-35362025-01-01131764177710.1109/ACCESS.2024.352033710807292Feedback-Driven Pattern Matching in Time Series DataM. Van Onsem0https://orcid.org/0000-0002-3899-064XV. Ledoux1W. Melange2D. Dreesen3S. Van Hoecke4https://orcid.org/0000-0002-7865-6793IDLab, imec, Ghent University, Ghent, BelgiumSkyline Communications, Izegem, BelgiumSkyline Communications, Izegem, BelgiumSkyline Communications, Izegem, BelgiumIDLab, imec, Ghent University, Ghent, BelgiumWhile motif discovery methods have come a long way over the years, they generally match occurrences based on the similar shape of the whole subsequence. As patterns in production network monitoring environments, which monitors and manages entire infrastructures of millions of device metrics over time, frequently exhibit more complex characteristics such as differences in temporal size or expected noise, these methods often remain insufficient for accurately tracking important behavioral patterns such as backup cycles or transcode sessions. This paper therefore proposes a feedback framework that allows a user to select additional motif ranges to be included or excluded from the model. The method uses a distance matrix of subsequences to extract common patterns from feedback samples and defines temporal rules on how these patterns are allowed to occur. The technique was tested on synthetic data as well as production network monitoring data and a publicly available human motion primitives dataset. The tests show that the recall score can be significantly improved with the proposed feedback system, increasing from 37% to 95% while also maintaining a perfect precision score. This is achieved by providing only one to three feedback samples as input. While the scope of this paper is limited to shape based features, the proposed technique can also be used for less exact patterns such as changepoints in noise.https://ieeexplore.ieee.org/document/10807292/Motif discoverynetwork monitoringtime seriesmatrix profile
spellingShingle M. Van Onsem
V. Ledoux
W. Melange
D. Dreesen
S. Van Hoecke
Feedback-Driven Pattern Matching in Time Series Data
IEEE Access
Motif discovery
network monitoring
time series
matrix profile
title Feedback-Driven Pattern Matching in Time Series Data
title_full Feedback-Driven Pattern Matching in Time Series Data
title_fullStr Feedback-Driven Pattern Matching in Time Series Data
title_full_unstemmed Feedback-Driven Pattern Matching in Time Series Data
title_short Feedback-Driven Pattern Matching in Time Series Data
title_sort feedback driven pattern matching in time series data
topic Motif discovery
network monitoring
time series
matrix profile
url https://ieeexplore.ieee.org/document/10807292/
work_keys_str_mv AT mvanonsem feedbackdrivenpatternmatchingintimeseriesdata
AT vledoux feedbackdrivenpatternmatchingintimeseriesdata
AT wmelange feedbackdrivenpatternmatchingintimeseriesdata
AT ddreesen feedbackdrivenpatternmatchingintimeseriesdata
AT svanhoecke feedbackdrivenpatternmatchingintimeseriesdata