AI-Based Intelligent Fire Fighting Robot with Vision Navigation

AI-Based Intelligent Fire Fighting Robot with Vision Navigation ESP32 + AI Agent + IoT Cloud + n8n Automation + Telegram Voice Alerts + Google Sheets + ThingSpeak Dashboard

AI-Based Intelligent Fire Fighting Robot with Vision Navigation ESP32 + AI Agent + IoT Cloud + n8n Automation + Telegram Voice Alerts + Google Sheets + ThingSpeak Dashboard 1. Project Overview The AI-Based Intelligent Fire Fighting Robot is an autonomous robot capable of: Detecting fire using flame sensors Navigating toward fire sources Avoiding obstacles automatically Activating a water pump to extinguish fire Sending real-time alerts through Telegram Uploading sensor data to ThingSpeak Storing logs in Google Sheets Using AI Agent analytics for predictive monitoring Generating voice notifications via Telegram Providing cloud-based remote monitoring This project combines: ESP32 IoT Controller Computer Vision Navigation AI Agent Analytics n8n Workflow Automation Google Sheets Cloud Logging ThingSpeak IoT Dashboard Telegram Alert System 2. System Architecture Flame Sensor | | Ultrasonic Sensor | | ESP32 Controller | -------------------------------- | | | | | | ThingSpeak Telegram Bot Google Sheets | | | -------------------------------- | n8n Server | AI Agent | Voice Notifications 3. Major Features Fire Detection Flame Sensor detects fire Multiple detection zones Vision Navigation ESP32-CAM identifies fire location Robot rotates toward fire source Obstacle Avoidance Ultrasonic sensor detects objects Robot changes path automatically Fire Extinguishing Water pump activated automatically Cloud Monitoring Real-time dashboard AI Prediction Predicts: Battery usage Water consumption Fire occurrence patterns 4. Hardware Components List Component Quantity ESP32 Dev Board 1 ESP32-CAM Module 1 Flame Sensor 3 Ultrasonic Sensor HC-SR04 1 L298N Motor Driver 1 DC Gear Motors 2 Water Pump 5V 1 Relay Module 1 Servo Motor SG90 1 Li-ion Battery Pack 1 Robot Chassis 1 Jumper Wires As required Water Tank 1 Buzzer 1 LED Indicators 2 5. Working Principle Step 1 Robot continuously scans surroundings. Step 2 Flame sensors detect fire. Step 3 ESP32 receives fire coordinates. Step 4 Robot moves toward flame. Step 5 Obstacle avoidance activates if necessary. Step 6 Water pump turns ON. Step 7 Fire extinguished. Step 8 Alert sent to: Telegram Google Sheets ThingSpeak Step 9 AI Agent analyzes event. 6. Pin Connections Flame Sensors Flame Sensor ESP32 OUT1 GPIO34 OUT2 GPIO35 OUT3 GPIO32 Ultrasonic Sensor HC-SR04 ESP32 Trig GPIO5 Echo GPIO18 Motor Driver L298N ESP32 IN1 GPIO12 IN2 GPIO13 IN3 GPIO14 IN4 GPIO27 Relay Module Relay ESP32 IN GPIO26 Servo Motor Servo ESP32 Signal GPIO25 7. Circuit Schematic Flame Sensors | | ESP32 Board / | \ / | \ Motor WiFi Relay Driver | | | Motors Water Pump | Fire Control ESP32 ----> ThingSpeak ESP32 ----> Telegram ESP32 ----> n8n ESP32 ----> Google Sheets 8. Flowchart Start | Initialize ESP32 | Connect WiFi | Read Sensors | Fire Detected? | Yes | Move Toward Fire | Obstacle Present? | Yes --> Avoid Obstacle | No | Activate Pump | Fire Extinguished? | Yes | Send Alert | Update Cloud | Store Data | Repeat 9. ESP32 Source Code Structure Required Libraries WiFi.h HTTPClient.h ThingSpeak.h ESP32Servo.h Variables const char* ssid="WiFi_Name"; const char* password="WiFi_Password"; long channelID = 123456; const char* apiKey = "THINGSPEAK_KEY"; Flame Detection int flame1=digitalRead(34); int flame2=digitalRead(35); int flame3=digitalRead(32); if(flame1==0 || flame2==0 || flame3==0) { fireDetected(); } Pump Activation digitalWrite(RELAY,HIGH); delay(5000); digitalWrite(RELAY,LOW); Upload Data ThingSpeak.setField(1,temperature); ThingSpeak.setField(2,fireStatus); ThingSpeak.writeFields(channelID,apiKey); 10. ThingSpeak Dashboard Setup Create Account Register at: ThingSpeak Create Channel Fields: Fire Status Temperature Distance Battery Voltage Water Level Motor Status Copy Channel ID Write API Key Insert into ESP32 code. 11. Telegram Bot Setup Step 1 Open: Telegram BotFather Step 2 Create new bot. /newbot Step 3 Get: BOT TOKEN Step 4 Find Chat ID. Send Alert Example https://api.telegram.org/botTOKEN/sendMessage Message: 🔥 FIRE DETECTED Robot Activated Pump Running Location Protected 12. Google Sheets Integration Create Sheet Columns: Date Time Fire Status Distance Battery Water Level Pump Status Create Google Apps Script function doPost(e) { var sheet= SpreadsheetApp.getActiveSpreadsheet() .getSheetByName("Data"); sheet.appendRow([ new Date(), e.parameter.fire, e.parameter.distance, e.parameter.battery ]); return ContentService .createTextOutput("Success"); } Deploy as: Web App Anyone Access 13. n8n Automation Workflow Install n8n Official website: n8n Automation Platform Workflow Webhook | ESP32 Data | IF Fire Detected | Telegram Node | Google Sheets Node | AI Agent Node | Voice Alert Node 14. n8n Workflow JSON Structure { "nodes":[ { "name":"Webhook" }, { "name":"IF Fire" }, { "name":"Telegram" }, { "name":"Google Sheets" }, { "name":"AI Agent" } ] } 15. AI Agent Analytics AI Agent continuously analyzes: Fire frequency Battery consumption Water tank usage Motor runtime Sensor health Outputs: Normal Warning Critical 16. AI Power Consumption Prediction Logic Inputs Motor Runtime Pump Runtime Battery Voltage WiFi Usage Formula Daily Power: P=V×I Energy: E=P×t Example Battery = 12V Motor = 1A Pump = 2A Total Current = 3A Power = 36W 2 Hours Usage Energy = 72Wh AI predicts: Remaining Battery Recharge Time Future Consumption 17. Telegram Voice Notification Automation Event Trigger Fire detected. n8n Process Fire Event | Generate Voice | Convert Text-to-Speech | Send Telegram Audio Voice Message: Warning. Fire detected. Robot has started extinguishing operation. 18. AI Agent Prompt Example Analyze incoming fire robot data. Check: - Fire frequency - Battery status - Water tank level - Motor health Generate: - Risk level - Maintenance suggestions - Prediction report 19. Future Enhancements Computer Vision AI Smoke recognition Human detection Fire localization GPS Tracking Outdoor firefighting robots Edge AI On-device fire classification Drone Integration Fire surveillance Multi-Robot Collaboration Swarm firefighting system 20. Deployment Guide Phase 1 Hardware Assembly Phase 2 ESP32 Programming Phase 3 Sensor Calibration Phase 4 ThingSpeak Dashboard Phase 5 Google Sheets Logging Phase 6 Telegram Bot Integration Phase 7 n8n Workflow Deployment Phase 8 AI Agent Analytics Phase 9 Field Testing Phase 10 Production Deployment Final Outcome This project delivers a complete Industry 4.0 Intelligent Fire Fighting Robot platform featuring: ✅ ESP32 IoT Monitoring ✅ Vision-Based Fire Navigation ✅ Autonomous Fire Extinguishing ✅ AI Agent Analytics ✅ n8n Workflow Automation ✅ Google Sheets Database Logging ✅ Telegram Text & Voice Alerts ✅ ThingSpeak Cloud Dashboard ✅ AI Power Consumption Prediction ✅ Cloud-Based Monitoring & Reporting ✅ Predictive Maintenance Analytics ✅ Real-Time Emergency Notifications ✅ Scalable Smart Safety Infrastructure