Knowledge-Aware Debiased Inference Model Integrating Intervention and Counter-factual
The abductive natural language inference task (Abductive NLI) seeks to select more plausible hypothetical events based on given antecedent events and consequent events. However, inherent biases such as “logical defects” and “single-sentence label leakage” stemming from mediator and confounding varia...
Saved in:
| Main Author: | |
|---|---|
| Format: | Article |
| Language: | zho |
| Published: |
Journal of Computer Engineering and Applications Beijing Co., Ltd., Science Press
2024-12-01
|
| Series: | Jisuanji kexue yu tansuo |
| Subjects: | |
| Online Access: | http://fcst.ceaj.org/fileup/1673-9418/PDF/2403018.pdf |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1846144337951326208 |
|---|---|
| author | SUN Shengjie, MA Tinghuai, HUANG Kai |
| author_facet | SUN Shengjie, MA Tinghuai, HUANG Kai |
| author_sort | SUN Shengjie, MA Tinghuai, HUANG Kai |
| collection | DOAJ |
| description | The abductive natural language inference task (Abductive NLI) seeks to select more plausible hypothetical events based on given antecedent events and consequent events. However, inherent biases such as “logical defects” and “single-sentence label leakage” stemming from mediator and confounding variables in the inference process pose challenge. To address these issues, this paper proposes a novel knowledge-aware debiased inference model integrating intervention and counterfactual (KDIC). The model comprises three key modules: the mediator modulation module, the hypothesis-only bias module, and the external knowledge fusion module. Firstly, the mediator modulation module consists of causal graph intervention and hypothesis contrast learning. Causal graph intervention constructs a potential causal graph from given events and then extracts mediator variables, standing for the potential feature of unobserved events, via self-attention mechanism and graph convolutional network for guiding deep encoding. Concurrently, hypothesis contrast learning encourages the model to discern key factors affecting hypothesis judgment, rectifying logical inconsistencies. Secondly, the hypothesis-only bias module addresses the counterfactual problem by proactively identifying the inference biases arising from “single-sentence label leakage”. This module reduces the model’s reliance on specific words or phrases in the hypothesis, thereby enhancing robustness. Finally, this paper leverages a pre-trained common sense knowledge graph encoder, ComET, within the external knowledge fusion module. This integration enriches the model’s understanding of observed events’ motivations and potential outcomes, bolstering logical coherence across events. Experiments results on the αNLI dataset demonstrate that the inference ability of KDIC is second only to Electra-large-discriminator trained via self-supervised learning. However, KDIC exhibits greater robustness to alleviate biases in the inference process. |
| format | Article |
| id | doaj-art-111d0b23a15b4552b16652c2ebf96a03 |
| institution | Kabale University |
| issn | 1673-9418 |
| language | zho |
| publishDate | 2024-12-01 |
| publisher | Journal of Computer Engineering and Applications Beijing Co., Ltd., Science Press |
| record_format | Article |
| series | Jisuanji kexue yu tansuo |
| spelling | doaj-art-111d0b23a15b4552b16652c2ebf96a032024-12-02T07:42:03ZzhoJournal of Computer Engineering and Applications Beijing Co., Ltd., Science PressJisuanji kexue yu tansuo1673-94182024-12-0118123288329910.3778/j.issn.1673-9418.2403018Knowledge-Aware Debiased Inference Model Integrating Intervention and Counter-factualSUN Shengjie, MA Tinghuai, HUANG Kai01. School of Computer Science, Nanjing University of Information Science & Technology, Nanjing 210044, China 2. School of Software, Nanjing University of Information Science & Technology, Nanjing 210044, China 3. School of Computer Engineering, Jiangsu Ocean University, Lianyungang, Jiangsu 222005, ChinaThe abductive natural language inference task (Abductive NLI) seeks to select more plausible hypothetical events based on given antecedent events and consequent events. However, inherent biases such as “logical defects” and “single-sentence label leakage” stemming from mediator and confounding variables in the inference process pose challenge. To address these issues, this paper proposes a novel knowledge-aware debiased inference model integrating intervention and counterfactual (KDIC). The model comprises three key modules: the mediator modulation module, the hypothesis-only bias module, and the external knowledge fusion module. Firstly, the mediator modulation module consists of causal graph intervention and hypothesis contrast learning. Causal graph intervention constructs a potential causal graph from given events and then extracts mediator variables, standing for the potential feature of unobserved events, via self-attention mechanism and graph convolutional network for guiding deep encoding. Concurrently, hypothesis contrast learning encourages the model to discern key factors affecting hypothesis judgment, rectifying logical inconsistencies. Secondly, the hypothesis-only bias module addresses the counterfactual problem by proactively identifying the inference biases arising from “single-sentence label leakage”. This module reduces the model’s reliance on specific words or phrases in the hypothesis, thereby enhancing robustness. Finally, this paper leverages a pre-trained common sense knowledge graph encoder, ComET, within the external knowledge fusion module. This integration enriches the model’s understanding of observed events’ motivations and potential outcomes, bolstering logical coherence across events. Experiments results on the αNLI dataset demonstrate that the inference ability of KDIC is second only to Electra-large-discriminator trained via self-supervised learning. However, KDIC exhibits greater robustness to alleviate biases in the inference process.http://fcst.ceaj.org/fileup/1673-9418/PDF/2403018.pdfnatural language inference; debiased inference; intervention; counterfactual |
| spellingShingle | SUN Shengjie, MA Tinghuai, HUANG Kai Knowledge-Aware Debiased Inference Model Integrating Intervention and Counter-factual Jisuanji kexue yu tansuo natural language inference; debiased inference; intervention; counterfactual |
| title | Knowledge-Aware Debiased Inference Model Integrating Intervention and Counter-factual |
| title_full | Knowledge-Aware Debiased Inference Model Integrating Intervention and Counter-factual |
| title_fullStr | Knowledge-Aware Debiased Inference Model Integrating Intervention and Counter-factual |
| title_full_unstemmed | Knowledge-Aware Debiased Inference Model Integrating Intervention and Counter-factual |
| title_short | Knowledge-Aware Debiased Inference Model Integrating Intervention and Counter-factual |
| title_sort | knowledge aware debiased inference model integrating intervention and counter factual |
| topic | natural language inference; debiased inference; intervention; counterfactual |
| url | http://fcst.ceaj.org/fileup/1673-9418/PDF/2403018.pdf |
| work_keys_str_mv | AT sunshengjiematinghuaihuangkai knowledgeawaredebiasedinferencemodelintegratinginterventionandcounterfactual |