VIOLET: Vectorized Invariance Optimization for Language Embeddings Using Twins

We present VIOLET, a novel positive pair-based information maximisation strategy for fine-tuning BERT to generate robust, invariant, and semantically meaningful sentence embeddings. VIOLET extends the Barlow Twins framework by addressing both redundancy reduction and invariance preservation within t...

Full description

Saved in:
Bibliographic Details
Main Authors: Mikhail E. Ram, G. Manju
Format: Article
Language:English
Published: IEEE 2025-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/11086585/
Tags: Add Tag
No Tags, Be the first to tag this record!