{"id":1856,"date":"2022-10-01T12:59:00","date_gmt":"2022-10-01T05:59:00","guid":{"rendered":"http:\/\/52.220.214.134\/?p=1856"},"modified":"2022-10-23T17:06:02","modified_gmt":"2022-10-23T10:06:02","slug":"how-to-reduce-the-carbon-footprint-of-advanced-ai-models","status":"publish","type":"post","link":"https:\/\/satrc.apt.int\/index.php\/2022\/10\/01\/how-to-reduce-the-carbon-footprint-of-advanced-ai-models\/","title":{"rendered":"How to reduce the carbon footprint of advanced AI models"},"content":{"rendered":"\n

By ITU News<\/em> 23rd September 2022<\/p>\n\n\n\n

As artificial intelligence (AI) steadily grows, so do concerns about its environmental footprint. Today\u2019s emerging natural language processing (NLP) models, such as GPT-3 can consume as much energy as five cars, according to a 2019 study<\/a>.<\/p>\n\n\n\n

To reduce their environmental and climate impact, researchers in the United Arab Emirates are proposing a new development approach for these models that takes energy consumption into account at every stage, aiming to boost energy efficiency wherever possible.<\/p>\n\n\n\n

Last April, Abu Dhabi\u2019s Technology Innovation Institute (TII) launched NOOR<\/a>, the largest Arabic-language NLP model to date.<\/p>\n\n\n\n

NOOR \u2013 Arabic for \u201clight\u201d \u2013 is trained on 10 billion parameters including books, poetry, news, and technical information, reinforcing the model\u2019s broad applicability, according to its creators<\/a>.<\/p><\/blockquote>\n\n\n\n

NLP systems, among other subfields of AI and linguistics, allow computers to understand, interpret and manipulate human language, based on deep learning-based training. The more parameters used in development, the more capable the system becomes.<\/p>\n\n\n\n

But balancing system capabilities with the energy costs and environmental impact presents major challenges for AI and NLP developers.<\/p>\n\n\n\n

The burden of inferences<\/strong><\/h5>\n\n\n\n

An exhaustive study by TII shows NOOR\u2019s average carbon footprint and indicates the energy cost behind each of the Arabic NLP model\u2019s processes, explains Ebtesam Almazrouei, Director of the Al-Cross Center Unit at TII.<\/p>\n\n\n\n

Model inference \u2013 when the AI system uses what it learns during training to make a prediction \u2013 is the most resource-intensive, TII\u2019s research reveals<\/a>. \u201cWhen I run this AI on my devices, there is a real inference on how much the cost will be,\u201d Almazrouei noted in a recent AI for Good webinar<\/a>, \u201cthe scale of the model is linearly correlated with its energy and carbon footprint.\u201d<\/p>\n\n\n\n

External factors related to the project also have a significant impact. One example is international air travel. Since NOOR was developed together with the French technology company LightOn, which specialises in extreme-scale foundation models, the team travelled between Paris and Abu Dhabi several times.<\/p>\n\n\n\n

\u201cWe want to achieve similar state-of-the-art capabilities to the GPT-3 model,\u201d Almazrouei said about the aspirations of the team she leads, adding: \u201cNOOR will become the reference language model for Arabic.\u201d<\/p><\/blockquote>\n\n\n\n

With English and Chinese accounting for most progress in NPL models to date, she emphasises the need to \u201cempower\u201d NPL use in other languages.<\/p>\n\n\n\n

Future applications for NOOR could range from speech recognition to automated text synthesis and chatbot services.<\/p>\n\n\n\n

Consumption efficiency<\/strong><\/h5>\n\n\n\n

The data centres used in training models are also part of the quest to make advanced AI energy efficient. Their power usage effectiveness ratio, or PUE, represents their total energy use divided by the amount used by their computing equipment.<\/p>\n\n\n\n

While the world\u2019s largest data centres have a PUE of 1.57<\/a>, Google says its centres have achieved an average PUE of 1.1<\/a> by using hardware materials that emit less heat and therefore require less energy for cooling.<\/p>\n\n\n\n

Energy efficiency also varies by country and region, reflecting the efficiency of different energy grids. The carbon intensity of the local electricity mix \u201csignificantly impacts the final footprint,\u201d according to Almazrouei.<\/p>\n\n\n\n

Choosing a location with green energy sources, therefore, lower\u2019s a project\u2019s environmental impact and ecological costs.<\/p><\/blockquote>\n\n\n\n

While some countries and regions are trying to reduce emissions from their data centres, the task is complex. One European Commission study<\/a> for example notes the difficulty of making  data centres climate-neutral and highly energy-efficient by 2030, as per the European Digital Strategy<\/a>.<\/p>\n\n\n\n

Estimates say the average consumption of data centres on the continent will grow by 28 per cent by the end of the decade.<\/p>\n\n\n\n

Carbon footprint as a performance metric<\/strong><\/h5>\n\n\n\n

Eco-efficient criteria must be considered in every decision from the outset, based on the needs and characteristics of each model, with AI developers determining \u201cthe best trade-off I can make to still have a good accuracy for my client.\u201d<\/p>\n\n\n\n

Up to now, environmental footprint reporting for AI has focused largely on the computational resources used in training new models. In the TII team\u2019s view, this must extend to all phases of model development and use, with carbon footprints becoming a metric in assessing model quality and performance.<\/p>\n\n\n\n

Source: https:\/\/www.itu.int<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"

By ITU News 23rd September 2022 As artificial intelligence (AI) steadily grows, so do concerns about its environmental footprint. Today\u2019s emerging natural language processing (NLP) models, such as GPT-3 can …<\/p>\n

How to reduce the carbon footprint of advanced AI models<\/span> Read More »<\/a><\/p>\n","protected":false},"author":1,"featured_media":2925,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"site-sidebar-layout":"default","site-content-layout":"","ast-site-content-layout":"","site-content-style":"default","site-sidebar-style":"default","ast-global-header-display":"","ast-banner-title-visibility":"","ast-main-header-display":"","ast-hfb-above-header-display":"","ast-hfb-below-header-display":"","ast-hfb-mobile-header-display":"","site-post-title":"","ast-breadcrumbs-content":"","ast-featured-img":"disabled","footer-sml-layout":"","theme-transparent-header-meta":"","adv-header-id-meta":"","stick-header-meta":"","header-above-stick-meta":"","header-main-stick-meta":"","header-below-stick-meta":"","astra-migrate-meta-layouts":"default","ast-page-background-enabled":"default","ast-page-background-meta":{"desktop":{"background-color":"var(--ast-global-color-4)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-gradient":""},"tablet":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-gradient":""},"mobile":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-gradient":""}},"ast-content-background-meta":{"desktop":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-gradient":""},"tablet":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-gradient":""},"mobile":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-gradient":""}},"footnotes":""},"categories":[6],"tags":[],"class_list":["post-1856","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-technology"],"_links":{"self":[{"href":"https:\/\/satrc.apt.int\/index.php\/wp-json\/wp\/v2\/posts\/1856","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/satrc.apt.int\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/satrc.apt.int\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/satrc.apt.int\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/satrc.apt.int\/index.php\/wp-json\/wp\/v2\/comments?post=1856"}],"version-history":[{"count":1,"href":"https:\/\/satrc.apt.int\/index.php\/wp-json\/wp\/v2\/posts\/1856\/revisions"}],"predecessor-version":[{"id":1857,"href":"https:\/\/satrc.apt.int\/index.php\/wp-json\/wp\/v2\/posts\/1856\/revisions\/1857"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/satrc.apt.int\/index.php\/wp-json\/wp\/v2\/media\/2925"}],"wp:attachment":[{"href":"https:\/\/satrc.apt.int\/index.php\/wp-json\/wp\/v2\/media?parent=1856"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/satrc.apt.int\/index.php\/wp-json\/wp\/v2\/categories?post=1856"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/satrc.apt.int\/index.php\/wp-json\/wp\/v2\/tags?post=1856"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}