Contrastive meta-learning framework for few-shot cross-lingual text classification
Many security risk control issues, such as public opinion analysis in international scenarios, have been identified as text classification problems, which are challenging due to the involvement of multiple languages. Previous studies have demonstrated that the performance of few-shot text classifica...
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
POSTS&TELECOM PRESS Co., LTD
2024-06-01
|
| Series: | 网络与信息安全学报 |
| Subjects: | |
| Online Access: | http://www.cjnis.com.cn/thesisDetails#10.11959/j.issn.2096-109x.2024043 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1841529526218129408 |
|---|---|
| author | GUO Jianming ZHAO Yuran LIU Gongshen |
| author_facet | GUO Jianming ZHAO Yuran LIU Gongshen |
| author_sort | GUO Jianming |
| collection | DOAJ |
| description | Many security risk control issues, such as public opinion analysis in international scenarios, have been identified as text classification problems, which are challenging due to the involvement of multiple languages. Previous studies have demonstrated that the performance of few-shot text classification tasks can be enhanced through cross-lingual semantic knowledge transfer. However, the advancement of cross-lingual text classification is faced with several challenges. Firstly, it has been found difficult to obtain language-agnostic representations that perform well in cross-lingual transfer. Moreover, the differences in grammatical structure and syntactic rules between different languages cause variations in text representation, making it difficult to extract general semantic information. Additionally, the scarcity of labeled data has been identified as a severe constraint on the performance of most existing methods. In many real-world scenarios, only a small amount of labeled data is available, which has been found to severely degrade the performance of many methods. Therefore, effective methods are needed to accurately transfer knowledge in few-shot situations and improve the generalization ability of classification models. To tackle these challenges, a novel framework was proposed that integrates contrastive learning and meta-learning. Within the framework, contrastive learning was utilized to extract general language-agnostic semantic information, while the rapid generalization advantages of meta-learning were leveraged to improve knowledge transfer in few-shot settings. Furthermore, a task-based data augmentation method was proposed to further improve the performance of the framework in few-shot cross-lingual classification. Extensive experiments conducted on two widely used multilingual text classification datasets show that the proposed method outperforms several strong baselines. This indicates that the method can be effectively applied in the field of risk control and security. |
| format | Article |
| id | doaj-art-69f6ef737a794932941844311d8c2720 |
| institution | Kabale University |
| issn | 2096-109X |
| language | English |
| publishDate | 2024-06-01 |
| publisher | POSTS&TELECOM PRESS Co., LTD |
| record_format | Article |
| series | 网络与信息安全学报 |
| spelling | doaj-art-69f6ef737a794932941844311d8c27202025-01-15T03:17:17ZengPOSTS&TELECOM PRESS Co., LTD网络与信息安全学报2096-109X2024-06-011010711667188898Contrastive meta-learning framework for few-shot cross-lingual text classificationGUO JianmingZHAO YuranLIU GongshenMany security risk control issues, such as public opinion analysis in international scenarios, have been identified as text classification problems, which are challenging due to the involvement of multiple languages. Previous studies have demonstrated that the performance of few-shot text classification tasks can be enhanced through cross-lingual semantic knowledge transfer. However, the advancement of cross-lingual text classification is faced with several challenges. Firstly, it has been found difficult to obtain language-agnostic representations that perform well in cross-lingual transfer. Moreover, the differences in grammatical structure and syntactic rules between different languages cause variations in text representation, making it difficult to extract general semantic information. Additionally, the scarcity of labeled data has been identified as a severe constraint on the performance of most existing methods. In many real-world scenarios, only a small amount of labeled data is available, which has been found to severely degrade the performance of many methods. Therefore, effective methods are needed to accurately transfer knowledge in few-shot situations and improve the generalization ability of classification models. To tackle these challenges, a novel framework was proposed that integrates contrastive learning and meta-learning. Within the framework, contrastive learning was utilized to extract general language-agnostic semantic information, while the rapid generalization advantages of meta-learning were leveraged to improve knowledge transfer in few-shot settings. Furthermore, a task-based data augmentation method was proposed to further improve the performance of the framework in few-shot cross-lingual classification. Extensive experiments conducted on two widely used multilingual text classification datasets show that the proposed method outperforms several strong baselines. This indicates that the method can be effectively applied in the field of risk control and security.http://www.cjnis.com.cn/thesisDetails#10.11959/j.issn.2096-109x.2024043cross-lingual text classificationmeta-learningcontrastive learningfew-shot |
| spellingShingle | GUO Jianming ZHAO Yuran LIU Gongshen Contrastive meta-learning framework for few-shot cross-lingual text classification 网络与信息安全学报 cross-lingual text classification meta-learning contrastive learning few-shot |
| title | Contrastive meta-learning framework for few-shot cross-lingual text classification |
| title_full | Contrastive meta-learning framework for few-shot cross-lingual text classification |
| title_fullStr | Contrastive meta-learning framework for few-shot cross-lingual text classification |
| title_full_unstemmed | Contrastive meta-learning framework for few-shot cross-lingual text classification |
| title_short | Contrastive meta-learning framework for few-shot cross-lingual text classification |
| title_sort | contrastive meta learning framework for few shot cross lingual text classification |
| topic | cross-lingual text classification meta-learning contrastive learning few-shot |
| url | http://www.cjnis.com.cn/thesisDetails#10.11959/j.issn.2096-109x.2024043 |
| work_keys_str_mv | AT guojianming contrastivemetalearningframeworkforfewshotcrosslingualtextclassification AT zhaoyuran contrastivemetalearningframeworkforfewshotcrosslingualtextclassification AT liugongshen contrastivemetalearningframeworkforfewshotcrosslingualtextclassification |