Awesome
AI on the Edge Device: Digitizing Your non-digital meters with an ESP32-CAM
Artificial intelligence is everywhere, from speech to image recognition. While most AI systems rely on powerful processors or cloud computing, edge computing brings AI closer to the end user by utilizing the capabilities of modern processors.
This project demonstrates edge computing using the ESP32, a low-cost, AI-capable device, to digitize your analog meters—whether water, gas, or electricity. With affordable hardware and simple instructions, you can turn any standard meter into a smart device.
Let's explore how to make AI on the Edge a reality! 🌟
All you need is an ESP32 board with a supported camera and some practical skills. 🛠️
Key Features 🚀
- 🔗 Tensorflow Lite (TFLite) integration – including an easy-to-use wrapper.
- 📸 Inline image processing (feature detection, alignment, ROI extraction).
- 💡 Small and affordable device (3 x 4.5 x 2 cm³, less than 10 EUR).
- 📷 Integrated camera and illumination.
- 🌐 Web interface for administration and control.
- 🔄 OTA interface for updating directly via the web interface.
- 🏠 Full integration with Home Assistant.
- 📊 Support for Influx DB 1 and 2.
- 📡 MQTT protocol support.
- 📥 REST API available for data access.
Workflow 🔧
The device captures a photo of your meter at set intervals. It then extracts the Regions of Interest (ROIs) from the image and runs them through artificial intelligence. As a result, you get the digitized value of your meter.
There are several options for what to do with that value:
- 📤 Send it to a MQTT broker.
- 📝 Write it to an InfluxDb.
- 🔗 Provide access via a REST API.
Impressions 📷
AI-on-the-edge-device on a Water Meter 💧
<p align="center"> <img src="https://raw.githubusercontent.com/jomjol/AI-on-the-edge-device/master/images/watermeter_all.jpg" width="200"><img src="https://raw.githubusercontent.com/jomjol/AI-on-the-edge-device/master/images/main.jpg" width="200"><img src="https://raw.githubusercontent.com/jomjol/AI-on-the-edge-device/master/images/size.png" width="200"> </p>Web Interface (Water Meter) 💻
<p align="center"> <img src="https://raw.githubusercontent.com/jomjol/AI-on-the-edge-device/master/images/watermeter.jpg" width="600"> </p>AI-on-the-edge-device on an Electrical Power Meter ⚡
<p align="center"> <img src="https://raw.githubusercontent.com/jomjol/AI-on-the-edge-device/master/images/powermeter.jpg" width="600"> </p>Setup 🛠️
There is growing documentation which provides you with a lot of information. Head there to get started, set it up, and configure it.
There are also articles in the German Heise magazine "make:" about the setup and technical background (behind a paywall): DIY - Setup 📰
A lot of people have created useful YouTube videos that might help you get started:
- 🎥 youtube.com/watch?v=HKBofb1cnNc
- 🎥 youtube.com/watch?v=yyf0ORNLCk4
- 🎥 youtube.com/watch?v=XxmTubGek6M
- 🎥 youtube.com/watch?v=mDIJEyElkAU
- 🎥 youtube.com/watch?v=SssiPkyKVVs
- 🎥 youtube.com/watch?v=MAHE_QyHZFQ
- 🎥 youtube.com/watch?v=Uap_6bwtILQ
For further background information, head to:
Download 🔽
The latest available version can be found on the Releases page.
Flashing the ESP32 💾
Initially, you will have to flash the ESP32 via a USB connection. Later updates are possible directly over the air (OTA using Wi-Fi).
There are different ways to flash your ESP32:
- The preferred way is the Web Installer and Console, a browser-based tool to flash the ESP32 and extract the log over USB:
- Flash Tool from Espressif
- ESPtool (command-line tool)
See the documentation for more information.
Flashing the SD Card 💾
The SD card can be set up automatically after the firmware is installed. See the documentation for details. For this to work, the SD card must be FAT formatted (which is the default on a new SD card).
Alternatively, the SD card can still be set up manually. See the documentation for details.
Casing 🛠️
Various 3D-printable housings can be found here:
Donate ☕
If you'd like to support the developer with a cup of coffee, you can do so via PayPal.
<p align="center"> <a href="https://www.paypal.com/donate?hosted_button_id=8TRSVYNYKDSWL"><img border="0" src="images/paypal.png" width="200px" target="_blank"></a> </p>Support 💬
If you have any technical problems, please search the discussions. In case you find a bug or have a feature request, please open an issue.
For any other issues, you can contact the developer via email:
<p align="center"> <img src="https://raw.githubusercontent.com/jomjol/AI-on-the-edge-device/master/images/mail.jpg" height="25"> </p>Changes and History 📜
See the Changelog for detailed information.
Build It Yourself 🔨
See the Build Instructions for step-by-step guidance.
Tools 🛠️
- Logfile downloader and combiner (Thanks to reserve85)
- It can be found at '/tools/logfile-tool'.
Additional Ideas 💡
There are some ideas and feature requests which are not currently being pursued—mainly due to capacity constraints on the part of the developers. These features are collected in the issues and in FeatureRequest.md.
Our Contributors ❤️
<!-- Do not manually edit this section! It should get updated using the Github action "Manually update contributors list" --> <!-- readme: contributors -start --> <table> <tbody> <tr> <td align="center"> <a href="https://github.com/jomjol"> <img src="https://avatars.githubusercontent.com/u/30766535?v=4" width="100;" alt="jomjol"/> <br /> <sub><b>jomjol</b></sub> </a> </td> <td align="center"> <a href="https://github.com/caco3"> <img src="https://avatars.githubusercontent.com/u/1783586?v=4" width="100;" alt="caco3"/> <br /> <sub><b>CaCO3</b></sub> </a> </td> <td align="center"> <a href="https://github.com/haverland"> <img src="https://avatars.githubusercontent.com/u/412645?v=4" width="100;" alt="haverland"/> <br /> <sub><b>Frank Haverland</b></sub> </a> </td> <td align="center"> <a href="https://github.com/Slider0007"> <img src="https://avatars.githubusercontent.com/u/115730895?v=4" width="100;" alt="Slider0007"/> <br /> <sub><b>Slider0007</b></sub> </a> </td> <td align="center"> <a href="https://github.com/SybexX"> <img src="https://avatars.githubusercontent.com/u/587201?v=4" width="100;" alt="SybexX"/> <br /> <sub><b>michael</b></sub> </a> </td> <td align="center"> <a href="https://github.com/nliaudat"> <img src="https://avatars.githubusercontent.com/u/6782613?v=4" width="100;" alt="nliaudat"/> <br /> <sub><b>Nicolas Liaudat</b></sub> </a> </td> </tr> <tr> <td align="center"> <a href="https://github.com/Zwer2k"> <img src="https://avatars.githubusercontent.com/u/10438794?v=4" width="100;" alt="Zwer2k"/> <br /> <sub><b>Zwer2k</b></sub> </a> </td> <td align="center"> <a href="https://github.com/phlupp"> <img src="https://avatars.githubusercontent.com/u/6304863?v=4" width="100;" alt="phlupp"/> <br /> <sub><b>phlupp</b></sub> </a> </td> <td align="center"> <a href="https://github.com/jasaw"> <img src="https://avatars.githubusercontent.com/u/721280?v=4" width="100;" alt="jasaw"/> <br /> <sub><b>jasaw</b></sub> </a> </td> <td align="center"> <a href="https://github.com/dockSquadron"> <img src="https://avatars.githubusercontent.com/u/11964767?v=4" width="100;" alt="dockSquadron"/> <br /> <sub><b>dockSquadron</b></sub> </a> </td> <td align="center"> <a href="https://github.com/rdmueller"> <img src="https://avatars.githubusercontent.com/u/1856308?v=4" width="100;" alt="rdmueller"/> <br /> <sub><b>Ralf D. Müller</b></sub> </a> </td> <td align="center"> <a href="https://github.com/cristianmitran"> <img src="https://avatars.githubusercontent.com/u/36613624?v=4" width="100;" alt="cristianmitran"/> <br /> <sub><b>cristianmitran</b></sub> </a> </td> </tr> <tr> <td align="center"> <a href="https://github.com/michaeljoos72"> <img src="https://avatars.githubusercontent.com/u/20517474?v=4" width="100;" alt="michaeljoos72"/> <br /> <sub><b>michaeljoos72</b></sub> </a> </td> <td align="center"> <a href="https://github.com/henrythasler"> <img src="https://avatars.githubusercontent.com/u/6277203?v=4" width="100;" alt="henrythasler"/> <br /> <sub><b>Henry Thasler</b></sub> </a> </td> <td align="center"> <a href="https://github.com/amantyagiprojects"> <img src="https://avatars.githubusercontent.com/u/174239452?v=4" width="100;" alt="amantyagiprojects"/> <br /> <sub><b>Naman Tyagi</b></sub> </a> </td> <td align="center"> <a href="https://github.com/pixeldoc2000"> <img src="https://avatars.githubusercontent.com/u/376715?v=4" width="100;" alt="pixeldoc2000"/> <br /> <sub><b>pixel::doc</b></sub> </a> </td> <td align="center"> <a href="https://github.com/mad2xlc"> <img src="https://avatars.githubusercontent.com/u/37449746?v=4" width="100;" alt="mad2xlc"/> <br /> <sub><b>Stefan</b></sub> </a> </td> <td align="center"> <a href="https://github.com/jochenchrist"> <img src="https://avatars.githubusercontent.com/u/2930448?v=4" width="100;" alt="jochenchrist"/> <br /> <sub><b>jochenchrist</b></sub> </a> </td> </tr> <tr> <td align="center"> <a href="https://github.com/parhedberg"> <img src="https://avatars.githubusercontent.com/u/13777521?v=4" width="100;" alt="parhedberg"/> <br /> <sub><b>parhedberg</b></sub> </a> </td> <td align="center"> <a href="https://github.com/slovdahl"> <img src="https://avatars.githubusercontent.com/u/1417619?v=4" width="100;" alt="slovdahl"/> <br /> <sub><b>Sebastian Lövdahl</b></sub> </a> </td> <td align="center"> <a href="https://github.com/RaHehl"> <img src="https://avatars.githubusercontent.com/u/7577984?v=4" width="100;" alt="RaHehl"/> <br /> <sub><b>Raphael Hehl</b></sub> </a> </td> <td align="center"> <a href="https://github.com/LordGuilly"> <img src="https://avatars.githubusercontent.com/u/13271835?v=4" width="100;" alt="LordGuilly"/> <br /> <sub><b>LordGuilly</b></sub> </a> </td> <td align="center"> <a href="https://github.com/muggenhor"> <img src="https://avatars.githubusercontent.com/u/484066?v=4" width="100;" alt="muggenhor"/> <br /> <sub><b>Giel van Schijndel</b></sub> </a> </td> <td align="center"> <a href="https://github.com/AngryApostrophe"> <img src="https://avatars.githubusercontent.com/u/89547888?v=4" width="100;" alt="AngryApostrophe"/> <br /> <sub><b>AngryApostrophe</b></sub> </a> </td> </tr> <tr> <td align="center"> <a href="https://github.com/toolsfactory"> <img src="https://avatars.githubusercontent.com/u/7744975?v=4" width="100;" alt="toolsfactory"/> <br /> <sub><b>Michael Geissler</b></sub> </a> </td> <td align="center"> <a href="https://github.com/ppisljar"> <img src="https://avatars.githubusercontent.com/u/13629809?v=4" width="100;" alt="ppisljar"/> <br /> <sub><b>Peter Pisljar</b></sub> </a> </td> <td align="center"> <a href="https://github.com/ralf1307"> <img src="https://avatars.githubusercontent.com/u/46164027?v=4" width="100;" alt="ralf1307"/> <br /> <sub><b>Ralf Rachinger</b></sub> </a> </td> <td align="center"> <a href="https://github.com/Ranjana761"> <img src="https://avatars.githubusercontent.com/u/129291313?v=4" width="100;" alt="Ranjana761"/> <br /> <sub><b>Ranjana761</b></sub> </a> </td> <td align="center"> <a href="https://github.com/SkylightXD"> <img src="https://avatars.githubusercontent.com/u/16561545?v=4" width="100;" alt="SkylightXD"/> <br /> <sub><b>SkylightXD</b></sub> </a> </td> <td align="center"> <a href="https://github.com/ottk3"> <img src="https://avatars.githubusercontent.com/u/5236802?v=4" width="100;" alt="ottk3"/> <br /> <sub><b>Sven Rojek</b></sub> </a> </td> </tr> <tr> <td align="center"> <a href="https://github.com/Turbo87"> <img src="https://avatars.githubusercontent.com/u/141300?v=4" width="100;" alt="Turbo87"/> <br /> <sub><b>Tobias Bieniek</b></sub> </a> </td> <td align="center"> <a href="https://github.com/yonz2"> <img src="https://avatars.githubusercontent.com/u/13886257?v=4" width="100;" alt="yonz2"/> <br /> <sub><b>Yonz</b></sub> </a> </td> <td align="center"> <a href="https://github.com/Yveaux"> <img src="https://avatars.githubusercontent.com/u/7716005?v=4" width="100;" alt="Yveaux"/> <br /> <sub><b>Yveaux</b></sub> </a> </td> <td align="center"> <a href="https://github.com/flooxo"> <img src="https://avatars.githubusercontent.com/u/93255373?v=4" width="100;" alt="flooxo"/> <br /> <sub><b>flox_x</b></sub> </a> </td> <td align="center"> <a href="https://github.com/kalwados"> <img src="https://avatars.githubusercontent.com/u/11840444?v=4" width="100;" alt="kalwados"/> <br /> <sub><b>kalwados</b></sub> </a> </td> <td align="center"> <a href="https://github.com/kub3let"> <img src="https://avatars.githubusercontent.com/u/95883234?v=4" width="100;" alt="kub3let"/> <br /> <sub><b>kub3let</b></sub> </a> </td> </tr> <tr> <td align="center"> <a href="https://github.com/pfeifferch"> <img src="https://avatars.githubusercontent.com/u/73090220?v=4" width="100;" alt="pfeifferch"/> <br /> <sub><b>pfeifferch</b></sub> </a> </td> <td align="center"> <a href="https://github.com/rstephan"> <img src="https://avatars.githubusercontent.com/u/8532364?v=4" width="100;" alt="rstephan"/> <br /> <sub><b>rstephan</b></sub> </a> </td> <td align="center"> <a href="https://github.com/smartboart"> <img src="https://avatars.githubusercontent.com/u/38385805?v=4" width="100;" alt="smartboart"/> <br /> <sub><b>smartboart</b></sub> </a> </td> <td align="center"> <a href="https://github.com/wetneb"> <img src="https://avatars.githubusercontent.com/u/309908?v=4" width="100;" alt="wetneb"/> <br /> <sub><b>Antonin Delpeuch</b></sub> </a> </td> <td align="center"> <a href="https://github.com/adarazs"> <img src="https://avatars.githubusercontent.com/u/6269603?v=4" width="100;" alt="adarazs"/> <br /> <sub><b>Attila Darazs</b></sub> </a> </td> <td align="center"> <a href="https://github.com/austindrenski"> <img src="https://avatars.githubusercontent.com/u/21338699?v=4" width="100;" alt="austindrenski"/> <br /> <sub><b>Austin Drenski</b></sub> </a> </td> </tr> <tr> <td align="center"> <a href="https://github.com/bilalmirza74"> <img src="https://avatars.githubusercontent.com/u/84387676?v=4" width="100;" alt="bilalmirza74"/> <br /> <sub><b>Bilal Mirza</b></sub> </a> </td> <td align="center"> <a href="https://github.com/PLCHome"> <img src="https://avatars.githubusercontent.com/u/29116097?v=4" width="100;" alt="PLCHome"/> <br /> <sub><b>PLCHome</b></sub> </a> </td> <td align="center"> <a href="https://github.com/CFenner"> <img src="https://avatars.githubusercontent.com/u/9592452?v=4" width="100;" alt="CFenner"/> <br /> <sub><b>Christopher Fenner</b></sub> </a> </td> <td align="center"> <a href="https://github.com/dkneisz"> <img src="https://avatars.githubusercontent.com/u/43378003?v=4" width="100;" alt="dkneisz"/> <br /> <sub><b>Dave</b></sub> </a> </td> <td align="center"> <a href="https://github.com/FarukhS52"> <img src="https://avatars.githubusercontent.com/u/129654632?v=4" width="100;" alt="FarukhS52"/> <br /> <sub><b>Farookh Zaheer Siddiqui</b></sub> </a> </td> <td align="center"> <a href="https://github.com/hex7c0"> <img src="https://avatars.githubusercontent.com/u/4419146?v=4" width="100;" alt="hex7c0"/> <br /> <sub><b>Francesco Carnielli</b></sub> </a> </td> </tr> <tr> <td align="center"> <a href="https://github.com/040medien"> <img src="https://avatars.githubusercontent.com/u/115072?v=4" width="100;" alt="040medien"/> <br /> <sub><b>Frederik Kemner</b></sub> </a> </td> <td align="center"> <a href="https://github.com/eltociear"> <img src="https://avatars.githubusercontent.com/u/22633385?v=4" width="100;" alt="eltociear"/> <br /> <sub><b>Ikko Eltociear Ashimine</b></sub> </a> </td> <td align="center"> <a href="https://github.com/queeek"> <img src="https://avatars.githubusercontent.com/u/9533371?v=4" width="100;" alt="queeek"/> <br /> <sub><b>Ina</b></sub> </a> </td> <td align="center"> <a href="https://github.com/joergrosenkranz"> <img src="https://avatars.githubusercontent.com/u/310438?v=4" width="100;" alt="joergrosenkranz"/> <br /> <sub><b>Joerg Rosenkranz</b></sub> </a> </td> <td align="center"> <a href="https://github.com/Innovatorcloudy"> <img src="https://avatars.githubusercontent.com/u/183274513?v=4" width="100;" alt="Innovatorcloudy"/> <br /> <sub><b>KrishCode</b></sub> </a> </td> <td align="center"> <a href="https://github.com/myxor"> <img src="https://avatars.githubusercontent.com/u/1397377?v=4" width="100;" alt="myxor"/> <br /> <sub><b>Marco H</b></sub> </a> </td> </tr> <tr> <td align="center"> <a href="https://github.com/rainman110"> <img src="https://avatars.githubusercontent.com/u/3213107?v=4" width="100;" alt="rainman110"/> <br /> <sub><b>Martin Siggel</b></sub> </a> </td> <td align="center"> <a href="https://github.com/mkelley88"> <img src="https://avatars.githubusercontent.com/u/5567324?v=4" width="100;" alt="mkelley88"/> <br /> <sub><b>Matthew T. Kelley</b></sub> </a> </td> </tr> <tbody> </table> <!-- readme: contributors -end --><div align="center"> <a href="#top"> <img src="https://img.shields.io/badge/Back%20to%20Top-000000?style=for-the-badge&logo=github&logoColor=white" alt="Back to Top"> </a> </div>