This paper investigates how the configuration of on-device hardware affects energy consumption for neural network inference with regular fine-tuning.
This paper is available on arxiv under CC BY-NC-ND 4.0 DEED license. Authors: Minghao Yan, University of Wisconsin-Madison; Hongyi Wang, Carnegie Mellon University; Shivaram Venkataraman, myan@cs.wisc.edu. Table of Links Abstract & Introduction Motivation Opportunities Architecture Overview Proble Formulation: Two-Phase Tuning Modeling Workload Interference Experiments Conclusion & References A. Hardware Details B. Experimental Results C. Arithmetic Intensity D.
These results underline the interesting observation that the energy consumption patterns vary for the same model operating on different devices. Furthermore, even for the same model device pairing, the optimization landscape can be significantly influenced by the batch size. This underlines the complexities of energy optimization and the need for an adaptive framework that can take these factors into account.
United Kingdom Latest News, United Kingdom Headlines
Similar News:You can also read news stories similar to this one that we have collected from other news sources.
ANYmal robot excels in parkour feats thanks to neural network trainingDog-like robot ANYmal's agility is boosted by a new framework, allowing it to tackle a basic parkour course at up to 6 feet per second.
Read more »
Using Machine Learning & Neural Networks to Maximize Solar Energy GloballyOther ways to generate solar energy that just trying to make solar cells efficient potential of luminescent solar concentration
Read more »
CPS Energy progressing towards cleaner energy goals; set to shut down older plantsSAN ANTONIO- Cleaner energy: that's the goal cps energy is working toward -- by closing down coal and older natural gas plants. CPS energy announced they will b
Read more »
Yellen: Pushing Green Energy to Lower Energy Costs ‘Over Time’ Is Key Part of Fighting InflationSource of breaking news and analysis, insightful commentary and original reporting, curated and written specifically for the new generation of independent and conservative thinkers.
Read more »
$22 Million to Improve Siting & Permitting for Large-Scale Renewable Energy & Energy StorageInvests $22 Million to Improve Siting and Permitting for Large-Scale Renewable Energy and Energy Storage in NC
Read more »
$50 Million for Tribal Clean Energy Projects: Funding Doubled, Now Available for Clean Energy Technology DeploymentFOA Update: DOE Doubles Funding to $50 Million for Tribal Clean Energy Projects, FOA Update: DOE Doubles Funding to $50 Million
Read more »