Construction and application of a quantitative efficiency assessment model for green AI in intelligent customer service systems
The rise of AI and the increasing prominence of LLM are positioned as core technologies for knowledge dissemination and multi-turn dialogues. Alongside their growth, the high energy consumption associated with data processing, model training, and deployment in AI large models is necessitating effect...
Saved in:
Main Authors: | , , , , , |
---|---|
Format: | Article |
Language: | zho |
Published: |
Beijing Xintong Media Co., Ltd
2024-08-01
|
Series: | Dianxin kexue |
Subjects: | |
Online Access: | http://www.telecomsci.com/zh/article/doi/10.11959/j.issn.1000-0801.2024184/ |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
_version_ | 1841528892430483456 |
---|---|
author | MA Xiaoliang LIU Ying ZHAO Ruqiang YANG Bangxing GAO Jie DENG Congjian |
author_facet | MA Xiaoliang LIU Ying ZHAO Ruqiang YANG Bangxing GAO Jie DENG Congjian |
author_sort | MA Xiaoliang |
collection | DOAJ |
description | The rise of AI and the increasing prominence of LLM are positioned as core technologies for knowledge dissemination and multi-turn dialogues. Alongside their growth, the high energy consumption associated with data processing, model training, and deployment in AI large models is necessitating effective evaluation to facilitate quantitative comparisons before and after model optimization. An assessment method for the energy consumption of AI large models was introduced, aimed at quantitatively evaluating the service efficiency (E) of AI models. This model was incorporated with multiple dimensions such as training convergence time (T), model parameter size (P), and floating-point operations (F), and quantitative analysis was achieved through the construction of an energy consumption function C(T, P, F). Furthermore, by employing the nonlinear least squares method, model parameters were derived. This analysis method was not only applicable to the operational efficiency analysis of AI models used by telecommunications operators but can also be generalized for energy consumption assessment of AI models across various industries. |
format | Article |
id | doaj-art-cb74e9a937c84f1c82a5654fc8028ca1 |
institution | Kabale University |
issn | 1000-0801 |
language | zho |
publishDate | 2024-08-01 |
publisher | Beijing Xintong Media Co., Ltd |
record_format | Article |
series | Dianxin kexue |
spelling | doaj-art-cb74e9a937c84f1c82a5654fc8028ca12025-01-15T03:33:51ZzhoBeijing Xintong Media Co., LtdDianxin kexue1000-08012024-08-014013013769875745Construction and application of a quantitative efficiency assessment model for green AI in intelligent customer service systemsMA XiaoliangLIU YingZHAO RuqiangYANG BangxingGAO JieDENG CongjianThe rise of AI and the increasing prominence of LLM are positioned as core technologies for knowledge dissemination and multi-turn dialogues. Alongside their growth, the high energy consumption associated with data processing, model training, and deployment in AI large models is necessitating effective evaluation to facilitate quantitative comparisons before and after model optimization. An assessment method for the energy consumption of AI large models was introduced, aimed at quantitatively evaluating the service efficiency (E) of AI models. This model was incorporated with multiple dimensions such as training convergence time (T), model parameter size (P), and floating-point operations (F), and quantitative analysis was achieved through the construction of an energy consumption function C(T, P, F). Furthermore, by employing the nonlinear least squares method, model parameters were derived. This analysis method was not only applicable to the operational efficiency analysis of AI models used by telecommunications operators but can also be generalized for energy consumption assessment of AI models across various industries.http://www.telecomsci.com/zh/article/doi/10.11959/j.issn.1000-0801.2024184/green AIintelligent customer serviceenergy efficiency assessmentLLM |
spellingShingle | MA Xiaoliang LIU Ying ZHAO Ruqiang YANG Bangxing GAO Jie DENG Congjian Construction and application of a quantitative efficiency assessment model for green AI in intelligent customer service systems Dianxin kexue green AI intelligent customer service energy efficiency assessment LLM |
title | Construction and application of a quantitative efficiency assessment model for green AI in intelligent customer service systems |
title_full | Construction and application of a quantitative efficiency assessment model for green AI in intelligent customer service systems |
title_fullStr | Construction and application of a quantitative efficiency assessment model for green AI in intelligent customer service systems |
title_full_unstemmed | Construction and application of a quantitative efficiency assessment model for green AI in intelligent customer service systems |
title_short | Construction and application of a quantitative efficiency assessment model for green AI in intelligent customer service systems |
title_sort | construction and application of a quantitative efficiency assessment model for green ai in intelligent customer service systems |
topic | green AI intelligent customer service energy efficiency assessment LLM |
url | http://www.telecomsci.com/zh/article/doi/10.11959/j.issn.1000-0801.2024184/ |
work_keys_str_mv | AT maxiaoliang constructionandapplicationofaquantitativeefficiencyassessmentmodelforgreenaiinintelligentcustomerservicesystems AT liuying constructionandapplicationofaquantitativeefficiencyassessmentmodelforgreenaiinintelligentcustomerservicesystems AT zhaoruqiang constructionandapplicationofaquantitativeefficiencyassessmentmodelforgreenaiinintelligentcustomerservicesystems AT yangbangxing constructionandapplicationofaquantitativeefficiencyassessmentmodelforgreenaiinintelligentcustomerservicesystems AT gaojie constructionandapplicationofaquantitativeefficiencyassessmentmodelforgreenaiinintelligentcustomerservicesystems AT dengcongjian constructionandapplicationofaquantitativeefficiencyassessmentmodelforgreenaiinintelligentcustomerservicesystems |