An Integrated IoT Smart Home System with Face and Object Detection Using SSD for Real-Time Security and Control on ESP32

Abstract

The Internet of Things (IoT) has enabled smart homes to continuously monitor environmental conditions and security through interconnected sensors and devices. This paper proposes a home security and smart IoT monitoring and control system based on the Espressif System Platform (ESP32) lowcost microcontroller platform. The metal oxide semiconductor gas sensor (MQ-2), Digital Humidity and Temperature sensor (DHT11), passive infrared sensor (PIR) and actuators (cooling fan, servo motor, buzzer, relay switch, red, green and blue LED (RGB) and organic light emitting diode (OLED) display) provide realtime environmental monitoring and automated control responses. An ESP32-CAM module is incorporated to perform face and object recognition, enabling intelligent intrusion detection and surveillance capabilities by using Single Shot Detection (SSD) algorithm. Users can remotely monitor sensor readings and receive instant alerts via a Wi-Fi-based web interface and mobile application, while the OLED display provides local feedback. The system’s hardware and software are tightly integrated with a focus on security, ensuring that home safety (through intrusion alarms and hazard detection) is improved without compromising user accessibility. The implementation provides a comprehensive solution for monitoring and securing smart home environments, featuring reliable real-time performance and a user-friendly interface.