Large Language Models

Nabla: Adaptive Multi-Domain DVFS for Energy-Efficient LLM Inference on Edge SoCs
Nabla is a residual multi-domain DVFS framework for energy-efficient edge LLM inference. It uses an interference-free execution …
Yaotian Hu, Chuang Hu, Zheng Gong, Qianlong Sang, Zheng Zhang, Xiaobo Zhou, Dazhao Cheng