Construction and application of a quantitative efficiency assessment model for green AI in intelligent customer service systems

The rise of AI and the increasing prominence of LLM are positioned as core technologies for knowledge dissemination and multi-turn dialogues. Alongside their growth, the high energy consumption associated with data processing, model training, and deployment in AI large models is necessitating effect...

Full description

Saved in:
Bibliographic Details
Main Authors: MA Xiaoliang, LIU Ying, ZHAO Ruqiang, YANG Bangxing, GAO Jie, DENG Congjian
Format: Article
Language:zho
Published: Beijing Xintong Media Co., Ltd 2024-08-01
Series:Dianxin kexue
Subjects:
Online Access:http://www.telecomsci.com/zh/article/doi/10.11959/j.issn.1000-0801.2024184/
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1841528892430483456
author MA Xiaoliang
LIU Ying
ZHAO Ruqiang
YANG Bangxing
GAO Jie
DENG Congjian
author_facet MA Xiaoliang
LIU Ying
ZHAO Ruqiang
YANG Bangxing
GAO Jie
DENG Congjian
author_sort MA Xiaoliang
collection DOAJ
description The rise of AI and the increasing prominence of LLM are positioned as core technologies for knowledge dissemination and multi-turn dialogues. Alongside their growth, the high energy consumption associated with data processing, model training, and deployment in AI large models is necessitating effective evaluation to facilitate quantitative comparisons before and after model optimization. An assessment method for the energy consumption of AI large models was introduced, aimed at quantitatively evaluating the service efficiency (E) of AI models. This model was incorporated with multiple dimensions such as training convergence time (T), model parameter size (P), and floating-point operations (F), and quantitative analysis was achieved through the construction of an energy consumption function C(T, P, F). Furthermore, by employing the nonlinear least squares method, model parameters were derived. This analysis method was not only applicable to the operational efficiency analysis of AI models used by telecommunications operators but can also be generalized for energy consumption assessment of AI models across various industries.
format Article
id doaj-art-cb74e9a937c84f1c82a5654fc8028ca1
institution Kabale University
issn 1000-0801
language zho
publishDate 2024-08-01
publisher Beijing Xintong Media Co., Ltd
record_format Article
series Dianxin kexue
spelling doaj-art-cb74e9a937c84f1c82a5654fc8028ca12025-01-15T03:33:51ZzhoBeijing Xintong Media Co., LtdDianxin kexue1000-08012024-08-014013013769875745Construction and application of a quantitative efficiency assessment model for green AI in intelligent customer service systemsMA XiaoliangLIU YingZHAO RuqiangYANG BangxingGAO JieDENG CongjianThe rise of AI and the increasing prominence of LLM are positioned as core technologies for knowledge dissemination and multi-turn dialogues. Alongside their growth, the high energy consumption associated with data processing, model training, and deployment in AI large models is necessitating effective evaluation to facilitate quantitative comparisons before and after model optimization. An assessment method for the energy consumption of AI large models was introduced, aimed at quantitatively evaluating the service efficiency (E) of AI models. This model was incorporated with multiple dimensions such as training convergence time (T), model parameter size (P), and floating-point operations (F), and quantitative analysis was achieved through the construction of an energy consumption function C(T, P, F). Furthermore, by employing the nonlinear least squares method, model parameters were derived. This analysis method was not only applicable to the operational efficiency analysis of AI models used by telecommunications operators but can also be generalized for energy consumption assessment of AI models across various industries.http://www.telecomsci.com/zh/article/doi/10.11959/j.issn.1000-0801.2024184/green AIintelligent customer serviceenergy efficiency assessmentLLM
spellingShingle MA Xiaoliang
LIU Ying
ZHAO Ruqiang
YANG Bangxing
GAO Jie
DENG Congjian
Construction and application of a quantitative efficiency assessment model for green AI in intelligent customer service systems
Dianxin kexue
green AI
intelligent customer service
energy efficiency assessment
LLM
title Construction and application of a quantitative efficiency assessment model for green AI in intelligent customer service systems
title_full Construction and application of a quantitative efficiency assessment model for green AI in intelligent customer service systems
title_fullStr Construction and application of a quantitative efficiency assessment model for green AI in intelligent customer service systems
title_full_unstemmed Construction and application of a quantitative efficiency assessment model for green AI in intelligent customer service systems
title_short Construction and application of a quantitative efficiency assessment model for green AI in intelligent customer service systems
title_sort construction and application of a quantitative efficiency assessment model for green ai in intelligent customer service systems
topic green AI
intelligent customer service
energy efficiency assessment
LLM
url http://www.telecomsci.com/zh/article/doi/10.11959/j.issn.1000-0801.2024184/
work_keys_str_mv AT maxiaoliang constructionandapplicationofaquantitativeefficiencyassessmentmodelforgreenaiinintelligentcustomerservicesystems
AT liuying constructionandapplicationofaquantitativeefficiencyassessmentmodelforgreenaiinintelligentcustomerservicesystems
AT zhaoruqiang constructionandapplicationofaquantitativeefficiencyassessmentmodelforgreenaiinintelligentcustomerservicesystems
AT yangbangxing constructionandapplicationofaquantitativeefficiencyassessmentmodelforgreenaiinintelligentcustomerservicesystems
AT gaojie constructionandapplicationofaquantitativeefficiencyassessmentmodelforgreenaiinintelligentcustomerservicesystems
AT dengcongjian constructionandapplicationofaquantitativeefficiencyassessmentmodelforgreenaiinintelligentcustomerservicesystems