Internet bad information detection based on Bert model
In view of the business scenario of bad information detection on the internet,the method of detection based on the text content of the website was discussed .Classical text analysis techniques were reviewed.The key technical features and two different usages of Bert model were introduced.The specifi...
Saved in:
Main Author: | |
---|---|
Format: | Article |
Language: | zho |
Published: |
Beijing Xintong Media Co., Ltd
2020-11-01
|
Series: | Dianxin kexue |
Subjects: | |
Online Access: | http://www.telecomsci.com/zh/article/doi/10.11959/j.issn.1000-0801.2020303/ |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
_version_ | 1841528953226919936 |
---|---|
author | Xin CAI |
author_facet | Xin CAI |
author_sort | Xin CAI |
collection | DOAJ |
description | In view of the business scenario of bad information detection on the internet,the method of detection based on the text content of the website was discussed .Classical text analysis techniques were reviewed.The key technical features and two different usages of Bert model were introduced.The specific implementation scheme of using the feature extraction method to detect website bad information was described in detail,and was compared with the traditional TF-IDF model and word2vec+LSTM model.The validity of this method is verified. |
format | Article |
id | doaj-art-97a4a2e4ad804b3e8a620ebe335a0e83 |
institution | Kabale University |
issn | 1000-0801 |
language | zho |
publishDate | 2020-11-01 |
publisher | Beijing Xintong Media Co., Ltd |
record_format | Article |
series | Dianxin kexue |
spelling | doaj-art-97a4a2e4ad804b3e8a620ebe335a0e832025-01-15T03:32:09ZzhoBeijing Xintong Media Co., LtdDianxin kexue1000-08012020-11-013612112659813322Internet bad information detection based on Bert modelXin CAIIn view of the business scenario of bad information detection on the internet,the method of detection based on the text content of the website was discussed .Classical text analysis techniques were reviewed.The key technical features and two different usages of Bert model were introduced.The specific implementation scheme of using the feature extraction method to detect website bad information was described in detail,and was compared with the traditional TF-IDF model and word2vec+LSTM model.The validity of this method is verified.http://www.telecomsci.com/zh/article/doi/10.11959/j.issn.1000-0801.2020303/bad informationBert modeltext analysisfeature extraction |
spellingShingle | Xin CAI Internet bad information detection based on Bert model Dianxin kexue bad information Bert model text analysis feature extraction |
title | Internet bad information detection based on Bert model |
title_full | Internet bad information detection based on Bert model |
title_fullStr | Internet bad information detection based on Bert model |
title_full_unstemmed | Internet bad information detection based on Bert model |
title_short | Internet bad information detection based on Bert model |
title_sort | internet bad information detection based on bert model |
topic | bad information Bert model text analysis feature extraction |
url | http://www.telecomsci.com/zh/article/doi/10.11959/j.issn.1000-0801.2020303/ |
work_keys_str_mv | AT xincai internetbadinformationdetectionbasedonbertmodel |