An Ensemble for Automatic Time Series Forecasting With K-Nearest Neighbors

In this paper a novel approach for automatically configuring a k-nearest neighbors regressor for univariate time series forecasting is presented. The approach uses an ensemble consisting of several k-nearest neighbors models with different configurations for their hyperparameters and model selection...

Full description

Saved in:
Bibliographic Details
Main Authors: Maria P. Frias, Francisco Martinez
Format: Article
Language:English
Published: IEEE 2025-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/10820325/
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1841550820452073472
author Maria P. Frias
Francisco Martinez
author_facet Maria P. Frias
Francisco Martinez
author_sort Maria P. Frias
collection DOAJ
description In this paper a novel approach for automatically configuring a k-nearest neighbors regressor for univariate time series forecasting is presented. The approach uses an ensemble consisting of several k-nearest neighbors models with different configurations for their hyperparameters and model selection choices. One advantage of this scheme is that the uncertainty associated with choosing a wrong configuration for the model is reduced. This approach is compared with the classical way of selecting a configuration by doing a grid search among several configurations of hyperparameters and model selection choices and choosing the one that performs best on a validation set. The experimental results, using datasets from time series forecasting competitions, show that, in line with previous works, the use of an ensemble produces a robust model, outperforming the approach that uses a grid search for obtaining the best configuration on a validation set and almost any specific configuration. The forecast accuracy of the ensemble is similar to state-of-the-art models. Furthermore, this paper also tests the effectiveness of some recent approaches for dealing with trending time series when using the k-nearest neighbors algorithm.
format Article
id doaj-art-10159edab0034e6490dd2686d8033cf8
institution Kabale University
issn 2169-3536
language English
publishDate 2025-01-01
publisher IEEE
record_format Article
series IEEE Access
spelling doaj-art-10159edab0034e6490dd2686d8033cf82025-01-10T00:00:54ZengIEEEIEEE Access2169-35362025-01-01134117412510.1109/ACCESS.2025.352556110820325An Ensemble for Automatic Time Series Forecasting With K-Nearest NeighborsMaria P. Frias0https://orcid.org/0000-0001-6886-0953Francisco Martinez1https://orcid.org/0000-0002-5206-1898Department of Statistics and Operations Research, University of Jaén, Jaén, SpainDepartment of Computer Science, Andalusian Research Institute in Data Science and Computational Intelligence (DaSCI), University of Jaén, Jaén, SpainIn this paper a novel approach for automatically configuring a k-nearest neighbors regressor for univariate time series forecasting is presented. The approach uses an ensemble consisting of several k-nearest neighbors models with different configurations for their hyperparameters and model selection choices. One advantage of this scheme is that the uncertainty associated with choosing a wrong configuration for the model is reduced. This approach is compared with the classical way of selecting a configuration by doing a grid search among several configurations of hyperparameters and model selection choices and choosing the one that performs best on a validation set. The experimental results, using datasets from time series forecasting competitions, show that, in line with previous works, the use of an ensemble produces a robust model, outperforming the approach that uses a grid search for obtaining the best configuration on a validation set and almost any specific configuration. The forecast accuracy of the ensemble is similar to state-of-the-art models. Furthermore, this paper also tests the effectiveness of some recent approaches for dealing with trending time series when using the k-nearest neighbors algorithm.https://ieeexplore.ieee.org/document/10820325/Nearest neighborstrending time seriesunivariate time series forecasting
spellingShingle Maria P. Frias
Francisco Martinez
An Ensemble for Automatic Time Series Forecasting With K-Nearest Neighbors
IEEE Access
Nearest neighbors
trending time series
univariate time series forecasting
title An Ensemble for Automatic Time Series Forecasting With K-Nearest Neighbors
title_full An Ensemble for Automatic Time Series Forecasting With K-Nearest Neighbors
title_fullStr An Ensemble for Automatic Time Series Forecasting With K-Nearest Neighbors
title_full_unstemmed An Ensemble for Automatic Time Series Forecasting With K-Nearest Neighbors
title_short An Ensemble for Automatic Time Series Forecasting With K-Nearest Neighbors
title_sort ensemble for automatic time series forecasting with k nearest neighbors
topic Nearest neighbors
trending time series
univariate time series forecasting
url https://ieeexplore.ieee.org/document/10820325/
work_keys_str_mv AT mariapfrias anensembleforautomatictimeseriesforecastingwithknearestneighbors
AT franciscomartinez anensembleforautomatictimeseriesforecastingwithknearestneighbors
AT mariapfrias ensembleforautomatictimeseriesforecastingwithknearestneighbors
AT franciscomartinez ensembleforautomatictimeseriesforecastingwithknearestneighbors