Hardware Guide

ESP32 for People Counting with TensorFlow Lite Micro

The ESP32 handles people counting effectively with TFLite Micro. 520 KB SRAM at 240 MHz provides 2.7x headroom over the 192 KB requirement for 200 KB models. Built-in Wi-Fi 802.11 b/g/n enables wireless result reporting.

Hardware Specs

Spec ESP32
Processor Dual-core Xtensa LX6 @ 240 MHz
SRAM 520 KB
Flash Up to 16 MB (external)
Key Features Hardware crypto acceleration, Ultra-low-power co-processor (ULP)
Connectivity Wi-Fi 802.11 b/g/n, Bluetooth 4.2 BR/EDR + BLE
Price Range $2 - $5 (chip), $5 - $15 (dev board)

Compatibility: Good

Memory-wise, the ESP32 offers 520 KB SRAM, which delivers 2.7x the 192 KB minimum needed for people counting. The 200 KB quantized model fits in the tensor arena with enough remaining capacity for input buffers and core application logic. More demanding features (multi-sensor fusion, large protocol stacks) may require careful allocation planning. Flash storage at 16 MB comfortably houses the TFLite Micro runtime, the 200 KB model binary, application firmware, and OTA update partitions for field upgrades. Flash usage is well within budget for this configuration. The ESP32's dual-core Xtensa LX6 allows dedicating one core to inference while the other handles Wi-Fi/BLE communication and application logic. The ULP co-processor can handle simple sensor reads during deep sleep, reducing average power consumption in duty-cycled deployments. People Counting requires camera input. The ESP32 lacks native peripheral support for some of these sensors, requiring external interface circuitry. A camera interface (DVP/DCMI) is not available — SPI-based camera modules may work but with reduced frame rates. Evaluate whether the peripheral gap justifies an alternative MCU with native support. TFLite Micro's static memory allocation model maps well to the ESP32's memory architecture — define a fixed tensor arena at compile time with no runtime heap fragmentation risk. The framework's operator coverage supports convolutional, depthwise-separable, and pooling layers needed for people counting. Model conversion uses the standard TFLite converter with int8 post-training quantization. At $2-5 per chip ($5-15 for dev boards), the ESP32 is a reasonable investment for people counting deployments. With 136 PlatformIO-listed boards, hardware availability is excellent. Key ESP32 features for this workload: Hardware crypto acceleration, Ultra-low-power co-processor (ULP).

Getting Started

  1. 1

    Set up ESP32 development environment

    Install ESP-IDF (recommended for production) or Arduino framework via PlatformIO. Create a project targeting the ESP32 and verify basic functionality (blink LED, serial output). For TFLite Micro, clone the framework repository and add it as a library dependency. Ensure the toolchain supports C++11 or later for the ML runtime.

  2. 2

    Collect camera training data

    Connect a camera module (e.g., OV2640 via DVP/SPI) to the ESP32. Write a data logging sketch that captures camera readings at the target sample rate and outputs via serial/SD card. Collect 1000+ labeled samples across all classes. Capture images at the model input resolution (96×96 or lower).

  3. 3

    Train and quantize model for TFLite Micro

    Build a quantized MobileNet-SSD or YOLO-Tiny in TensorFlow or PyTorch. Apply int8 post-training quantization — this typically reduces model size by 4x with minimal accuracy loss. Convert to .tflite and generate a C array (xxd -i model.tflite > model_data.h). Target model size: under 200 KB to fit the ESP32's 520 KB SRAM with room for application code.

  4. 4

    Deploy and validate on ESP32

    Include the TFLite Micro runtime and compiled model in your Espressif project. Allocate a tensor arena of 300-500 KB in a static buffer. Run inference on live camera data and compare predictions against your test set. Report results via MQTT or HTTP for remote validation. Measure inference latency and peak RAM usage to verify they meet application requirements.

Alternatives

Explore More

FAQ

What size people counting model fits on ESP32?
The ESP32 has 520 KB SRAM and 16 MB flash. A typical people counting model is 200 KB after int8 quantization. The tensor arena needs 300-400 KB at runtime. After model allocation, approximately 120 KB remains for application logic, sensor drivers, and Wi-Fi 802.11 b/g/n stack.
How do I update the people counting model on ESP32 in production?
Over-the-air (OTA) updates via Wi-Fi: store the model in a dedicated flash partition and update it independently of the main firmware. The ESP32's 16 MB flash supports dual-partition OTA (A/B scheme) for safe rollback. Always validate model integrity with a checksum before switching to the new version.
Can ESP32 use BLE for people counting data?
Yes. Configure a custom BLE GATT service with characteristics for people counting results (classification label, confidence score, timestamp). BLE notifications push results to a connected smartphone or gateway with minimal latency. The BLE stack uses significantly less RAM than Wi-Fi — check the SDK documentation for exact memory requirements. Espressif's BLE stack integrates with the standard development environment. Battery impact is minimal at typical inference reporting rates.

Build Vision AI Pipelines in ForestHub

Connect cameras to on-device inference — design detection workflows visually and compile to optimized firmware.

Get Started Free