EventFormer: a hierarchical neural point process framework for spatio-temporal clustering events prediction

Abstract In real-world scenarios, event data often exhibits inherent randomness, complex historical dependencies, and hierarchical spatio-temporal clustering. However, existing neural point process models typically overlook the hierarchical nature of spatial information, or treat temporal and spatia...

Full description

Saved in:
Bibliographic Details
Main Authors: Shanshan Yu, Danhuai Guo, Yanjie Fu, Wei Jin
Format: Article
Language:English
Published: SpringerOpen 2025-07-01
Series:Journal of Big Data
Subjects:
Online Access:https://doi.org/10.1186/s40537-025-01232-4
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Abstract In real-world scenarios, event data often exhibits inherent randomness, complex historical dependencies, and hierarchical spatio-temporal clustering. However, existing neural point process models typically overlook the hierarchical nature of spatial information, or treat temporal and spatial relevance as separate factors. This oversight results in suboptimal performance when handling data with prominent spatio-temporal clustering features. Additionally, current models have not explicitly considered the interdependencies between event types. To remedy these limitations, we introduce a novel neural point process framework named EventFormer. Leveraging the time-oriented and type-oriented multi-head attention modules, along with a Ladder Attention mechanism that progressively refines spatial embeddings across hierarchical levels, EventFormer adeptly captures the nuanced dynamics of event occurrences. Furthermore, EventFormer incorporates a type-aware conditional intensity function to explicitly model interactions between event types, enhancing both predictive accuracy and interpretability. Extensive experiments on real-world datasets demonstrate the outstanding performance of EventFormer in event likelihoods modeling and prediction tasks.
ISSN:2196-1115