Hardware Guide

ESP32-S3 for People Counting with TensorFlow Lite Micro

For people counting, the ESP32-S3 with TFLite Micro scores Excellent. Its 512 KB internal SRAM (2.7x the required 192 KB) and 240 MHz clock ensure smooth real-time inference on 200 KB models. Hardware SIMD vector instructions boost throughput.

Hardware Specs

Spec ESP32-S3
Processor Dual-core Xtensa LX7 @ 240 MHz
SRAM 512 KB
Flash Up to 16 MB (external)
Key Features Vector instructions (SIMD), USB OTG, LCD/Camera interface, Up to 8 MB PSRAM
Connectivity Wi-Fi 802.11 b/g/n, Bluetooth 5.0 LE
Price Range $3 - $8 (chip), $10 - $25 (dev board)

Compatibility: Excellent

With 512 KB of internal SRAM, the ESP32-S3 delivers 2.7x the 192 KB minimum needed for people counting. The 200 KB quantized model fits in the tensor arena with enough remaining capacity for input buffers and core application logic. More demanding features (multi-sensor fusion, large protocol stacks) may require careful allocation planning. The ESP32-S3 provides 16 MB of flash memory, which comfortably houses the TFLite Micro runtime, the 200 KB model binary, application firmware, and OTA update partitions for field upgrades. Flash usage is well within budget for this configuration. The ESP32-S3's vector instructions (SIMD) accelerate 8-bit and 16-bit MAC operations common in quantized neural networks. Its native USB-OTG and camera (DVP) interfaces simplify peripheral integration without external chips. For people counting, connect a camera module (e.g., OV2640 via DVP/SPI) via SPI to the ESP32-S3. The camera interface supports QVGA (320×240) or lower resolution for on-device inference. Downsample to the model's input size (typically 96×96 or 128×128 pixels) before feeding the neural network. TFLite Micro's static memory allocation model maps well to the ESP32-S3's memory architecture — define a fixed tensor arena at compile time with no runtime heap fragmentation risk. The framework's operator coverage supports convolutional, depthwise-separable, and pooling layers needed for people counting. Model conversion uses the standard TFLite converter with int8 post-training quantization. At $3-8 per chip ($10-25 for dev boards), the ESP32-S3 offers strong value for people counting deployments. With 57 PlatformIO-listed boards, hardware availability is excellent. Key ESP32-S3 features for this workload: Vector instructions (SIMD), USB OTG, LCD/Camera interface, Up to 8 MB PSRAM.

Getting Started

  1. 1

    Set up ESP32-S3 development environment

    Install ESP-IDF (recommended for production) or Arduino framework via PlatformIO. Create a project targeting the ESP32-S3 and verify basic functionality (blink LED, serial output). For TFLite Micro, clone the framework repository and add it as a library dependency. Ensure the toolchain supports C++11 or later for the ML runtime.

  2. 2

    Collect camera training data

    Connect a camera module (e.g., OV2640 via DVP/SPI) to the ESP32-S3. Write a data logging sketch that captures camera readings at the target sample rate and outputs via serial/SD card. Collect 1000+ labeled samples across all classes. Capture images at the model input resolution (96×96 or lower).

  3. 3

    Train and quantize model for TFLite Micro

    Build a quantized MobileNet-SSD or YOLO-Tiny in TensorFlow or PyTorch. Apply int8 post-training quantization — this typically reduces model size by 4x with minimal accuracy loss. Convert to .tflite and generate a C array (xxd -i model.tflite > model_data.h). Target model size: under 200 KB to fit the ESP32-S3's 512 KB SRAM with room for application code.

  4. 4

    Deploy and validate on ESP32-S3

    Include the TFLite Micro runtime and compiled model in your Espressif project. Allocate a tensor arena of 300-500 KB in a static buffer. Run inference on live camera data and compare predictions against your test set. Report results via MQTT or HTTP for remote validation. Measure inference latency and peak RAM usage to verify they meet application requirements.

Alternatives

Explore More

FAQ

What size people counting model fits on ESP32-S3?
The ESP32-S3 has 512 KB SRAM and 16 MB flash. A typical people counting model is 200 KB after int8 quantization. The tensor arena needs 300-400 KB at runtime. After model allocation, approximately 112 KB remains for application logic, sensor drivers, and Wi-Fi 802.11 b/g/n stack.
What size people counting model fits on ESP32-S3?
The ESP32-S3 has 512 KB SRAM and 16 MB flash. A typical people counting model is 200 KB after int8 quantization. The tensor arena needs 300-400 KB at runtime. After model allocation, approximately 112 KB remains for application logic, sensor drivers, and Wi-Fi 802.11 b/g/n stack.
What size people counting model fits on ESP32-S3?
The ESP32-S3 has 512 KB SRAM and 16 MB flash. A typical people counting model is 200 KB after int8 quantization. The tensor arena needs 300-400 KB at runtime. After model allocation, approximately 112 KB remains for application logic, sensor drivers, and Wi-Fi 802.11 b/g/n stack.

Build Vision AI Pipelines in ForestHub

Connect cameras to on-device inference — design detection workflows visually and compile to optimized firmware.

Get Started Free