Towards a Green Future: Energy Efficient Conversational AI on the Edge
Date
2022-05
Authors
Williams, Kaylee
Journal Title
Journal ISSN
Volume Title
Publisher
Abstract
This project aims to show that emerging compute- and data-intensive workloads can be executed in an energy efficient way on low-power edge devices. To this end, I set up a cloud compute cluster consisting of three Raspberry Pis based on the ARM architecture. I then built a conversational AI app, a simple chatbot, to run on this cluster. My proposed framework reduces the energy cost in two ways (i) there is no need to communicate to back-end servers, saving bandwidth and (ii) all computation takes place on a low-power ARM processor, greatly reducing the carbon intensity at the cost of slightly diminished performance. Right now and in the future, complex applications can be created and run efficiently using the proposed framework.
Description
Keywords
Raspberry Pi, edge, computing, conversational AI, chatbot, energy efficient, efficiency, Honors College
Citation
Williams, K. (2022). Towards a green future: Energy efficient conversational AI on the edge (Unpublished thesis). Texas State University, San Marcos, Texas.