Survey of research on multimodal semantic communication
With the cross-integration of artificial intelligence and communications, technologies for processing multimodal data such as text, image, audio, and video are booming, the shared dimension of modal semantics is deeply excavated, and the characteristics of multimodal semantic information such as hig...
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | zho |
| Published: |
Editorial Department of Journal on Communications
2023-05-01
|
| Series: | Tongxin xuebao |
| Subjects: | |
| Online Access: | http://www.joconline.com.cn/zh/article/doi/10.11959/j.issn.1000-436x.2023105/ |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1841539181971505152 |
|---|---|
| author | Zhijin QIN Tantan ZHAO Fan LI Xiaoming TAO |
| author_facet | Zhijin QIN Tantan ZHAO Fan LI Xiaoming TAO |
| author_sort | Zhijin QIN |
| collection | DOAJ |
| description | With the cross-integration of artificial intelligence and communications, technologies for processing multimodal data such as text, image, audio, and video are booming, the shared dimension of modal semantics is deeply excavated, and the characteristics of multimodal semantic information such as high abstraction, intelligence and simplicity are being fully utilized, which brings new ideas and means to semantic communications.First, the fundamental theories and classifications of semantic communication were introduced, and the research status of single-modal semantic communication was reviewed for text, image, audio, and video respectively.Then, the research status of multimodal semantic communication was reviewed, and multimodal data fusion technology and secure semantic communication were introduced.Finally, the challenges faced by multimodal semantic communication were summarized. |
| format | Article |
| id | doaj-art-30cc05dee5484d30b92fac791b935406 |
| institution | Kabale University |
| issn | 1000-436X |
| language | zho |
| publishDate | 2023-05-01 |
| publisher | Editorial Department of Journal on Communications |
| record_format | Article |
| series | Tongxin xuebao |
| spelling | doaj-art-30cc05dee5484d30b92fac791b9354062025-01-14T07:23:49ZzhoEditorial Department of Journal on CommunicationsTongxin xuebao1000-436X2023-05-0144284159838115Survey of research on multimodal semantic communicationZhijin QINTantan ZHAOFan LIXiaoming TAOWith the cross-integration of artificial intelligence and communications, technologies for processing multimodal data such as text, image, audio, and video are booming, the shared dimension of modal semantics is deeply excavated, and the characteristics of multimodal semantic information such as high abstraction, intelligence and simplicity are being fully utilized, which brings new ideas and means to semantic communications.First, the fundamental theories and classifications of semantic communication were introduced, and the research status of single-modal semantic communication was reviewed for text, image, audio, and video respectively.Then, the research status of multimodal semantic communication was reviewed, and multimodal data fusion technology and secure semantic communication were introduced.Finally, the challenges faced by multimodal semantic communication were summarized.http://www.joconline.com.cn/zh/article/doi/10.11959/j.issn.1000-436x.2023105/semantic communicationmultimodal data fusionmultimodal semantic communication |
| spellingShingle | Zhijin QIN Tantan ZHAO Fan LI Xiaoming TAO Survey of research on multimodal semantic communication Tongxin xuebao semantic communication multimodal data fusion multimodal semantic communication |
| title | Survey of research on multimodal semantic communication |
| title_full | Survey of research on multimodal semantic communication |
| title_fullStr | Survey of research on multimodal semantic communication |
| title_full_unstemmed | Survey of research on multimodal semantic communication |
| title_short | Survey of research on multimodal semantic communication |
| title_sort | survey of research on multimodal semantic communication |
| topic | semantic communication multimodal data fusion multimodal semantic communication |
| url | http://www.joconline.com.cn/zh/article/doi/10.11959/j.issn.1000-436x.2023105/ |
| work_keys_str_mv | AT zhijinqin surveyofresearchonmultimodalsemanticcommunication AT tantanzhao surveyofresearchonmultimodalsemanticcommunication AT fanli surveyofresearchonmultimodalsemanticcommunication AT xiaomingtao surveyofresearchonmultimodalsemanticcommunication |