![Introduction to ESP32 Programming [Road to RIoT 2017]](https://cdn.slidesharecdn.com/ss_thumbnails/roadtoriotsurabayagettingstartedesp32-170726155154-thumbnail.jpg?width=560&fit=bounds)
More Related Content
What's hot (20)
Similar to ESP32 IoT presentation @ dev.bg (20)
Recently uploaded (20)
ESP32 IoT presentation @ dev.bg
- 1. Mission possible: DIY smart home hub/controller Martin Harizanov Sofia, February 5th 2019
- 2. Agenda ● Agenda ● About me ● Goals ● Mission possible: DIY smart home hub/controller ● Q/A
- 3. About Martin Harizanov Supervisor, Systems Engineering Visteon
- 4. What problem does this project solve? Gateway ActuatorsSensors Cloud Phone app Control hub ● Home automation control without internet connection ● Shared controls access ● Cost reduction by having control hubs and ‘dumb’ sensors/actuators
- 5. Requirements ● Control hub that integrates with the existing home automation ● Works regardless of the internet connectivity ● Visual and acoustic feedback ● Easy to use ● Reliable ● Low cost
- 6. Analysis steps Customer Requirements System Architecture System Requirements HW architecture SW architecture Software Design Requirements Software functional requirements Mechanical Hardware Requirements Mechanical Requirements
- 7. Non-Functional requirements Architecture Hardware Software Mechanics Design/UX Localization, easy initial setup, wireless Color TFT with touch, dimming, ambient light sensing; buttons Precise touch detection/calibration Option to hang on wall, magnetic attachment, compact size Graphical HMI with touch, buttons; Antialiased fonts; Usability Ease with which the user is able to learn, operate, prepare inputs and interpret outputs through interaction with the system Multi-language Localization (TZ, units)SmartConfig AP web config WiFi config GUI Touch calibration GUI Touch calibration in flash GUI library Configurable “skins”
- 8. Non-Functional requirements Architecture Hardware Software Mechanics Design/UX Watchdog, OTA recovery, safe mode, degraded operation mode, crash recovery, task isolation/prioritization Thermal, EMI consideration Power management Durable moving parts Reliability Extent to which the system consistently performs the specified functions without failure
- 9. Non-Functional requirements Architecture Hardware Software Mechanics Design/UX TLS, RF encryption, mutual authentication, provisioning, access PIN Encryption chip Authentication on APIs, DDoS rate limiter, encrypted vFS, NVS Reflashing port not available without product disassembly Security Extent to which the system is safeguarded against deliberate and intrusive faults from internal and external sources
- 10. Non-Functional requirements Architecture Hardware Software Mechanics Design/UX Connections manager, operational state manager , fallback to backup connection. Revert to factory app HW RTC to ensure time availability regardless of network availability, RF control as alternative to WiFi Degraded (fail safe) mode Availability Degree to which users can depend on the system to be up and able to function during normal operating times
- 11. Non-Functional requirements Architecture Hardware Software Mechanics Design/UX Piezo buzzer for acoustic feedback. RGB LED for visual feedback Buttons easily pressable Large contrast icons, color selection, acoustic feedback, visual feedback from distance, lighting sensing and brightness adjustment Accessibility Extent to which the system can be used by people with the widest range of capabilities
- 12. ..and more requirements Non-functional ● Integrity ● Safety ● Environmental ● Flexibility ● Scalability ● Maintainability ● Performance ● Storage ● Regulatory ● .. and more Functional ● Time & Date ● Temperature, Humidity, ambient light ● Configuration ● Connectivity management ● Diagnostics ● Security functions ● Power management ● Input devices .. and more functional requirements ● Acoustic feedback ● Multi-language ● RF comms ● OTA ● Charts ● Thermostat ● HMI ● API
- 13. What is HMI? Sensory stimuli Visual/acoustic/ vibration etc Controls Responses (motor, acoustic) Machine State Human Information processing and decision making Human MachineInterface
- 14. System functions diagram OTA GUI security env. sensing power diagnostics clock/date communication protocols communications operating state data storage visual feedback audio display in-dev illumination Internal data localization application logic
- 15. System function allocation diagram
- 16. System function block example
- 17. SWCs design SW time & date manager Enabled, TZ, DST, TimeFormat rtc_datetime ntp_datetime api_datetime ● Signals include STATE e.g. VALID, ERR, TMO, SNA ● SWC has cycle time, this particular runs every 1000ms set_TZ set_DST set_TimeFormat timestamp hour minute second day DOW month year DST TZ timeFormat ampmFlag
- 18. Layered Architecture IO Peripherals Memories CoresWiFi basebandBT Baseband FreeRTOS Drivers Bootloader Middleware Application Communication Protocol StacksGUISW HW
- 19. Fact break 78,337 lines of code as of todayThis project has
- 20. Partitions ● Flash layout ○ NVS for factory and user apps ○ Factory + user apps ○ VFS (SPIFFS, FAT etc) App NVS Factory NVS Factory App User App 1 User App 2 VFS Bootloader
- 21. User Application Operational states Fail safe Init Normal Configuration OTA Power-save Degraded mode Factory app
- 22. Power management strategies ● Dynamic Frequency Shifting ● Modem light sleep ● Variable WiFi transmission power ● Screen dimming ● GUI refresh rate reducing ● Peripheral sleep mode, whenever possible ● Overall: interrupt driven functionality vs polling As a result: power consumption is ~60mA while maintaining WiFi connection and being fully operational
- 23. OTA strategies ● OTA over web portal ● OTA over HTTPs ● OTA over MQTTs ● Compressed image OTA ● OTA rollback ○ Image verification ○ Tracking restarts due to crash ● Queued OTA ● OTA resume
- 24. DMA SPI and double buffering to speed up GUI rendering DMA SPI VB2 VB1 VB2 VB1 DMA SPI VB1 DMA SPI VB2 VB 2 DMA SPI VB1 VB1 30ms 30ms SPI HW CPU 30ms
- 25. Integrated Development Framework choice ● ESP-IDF using FreeRTOS ● Eclipse ● Github private repository
- 26. Fact break 7 months to developThis project took
- 27. Physical architecture UController TFT ILI9341 Buttons RF comms RFM69 RGB LED WS2812b Temperature/ Humidity HTU21D Light sensor LDR FTDI programming interface RTC DS1338 Piezo Buzzer WiFiBLE 1 PWM 1 RMT SPI1 + CS + D/C + RST 1 UART 1 I2C 1 ADC 1 SPI2 + CS 2 GPIO+2 GPIO with ADC and IRQ Touch 4-wire resistive 4 GPIO HW encryption module ATSHA204 Flash Screen dimming 1 PWM ● GPIO 10 total (2 for touch + 3 for TFT CS, D/C and RST + 4 buttons +1 for RF CS) ● PWM 2 total (1 for piezo, 1 for screen dimming) ● RMT 1 total (1 for LED) ● SPI 2 SPI interfaces or 5 pins (1 for TFT CLK, MOSI only and 1 for RF CLS, MOSI, MISO) ● I2C 1 total or 2 pins ● ADC 3 total (1 for LDR and 2 for touch screen) ● UART - 1 total or 2 pins (RX/TX) ~23 GPIO pins needed
- 28. SoC choice ● ESP32 is dual core containing a Protocol CPU (known as CPU 0 or PRO_CPU) and an Application CPU (known as CPU 1 or APP_CPU). The two cores are identical in practice and share the same memory. This allows the two cores to run tasks interchangeably between them.
- 29. HW design
- 30. HW prototypes
- 31. Final version … after six PCB revisions
- 32. Mechanics - 3D PCB model for enclosure design
- 33. Mechanics - 3D printable enclosure
- 34. Mechanics - 3D printable enclosure
- 35. HMI Use cases Setup WiFi Calibrate Touch Dimming setup About Time/date settings Units setup Language select OTA Thermost at Provisioni ng Reset to Factory View charts Thermost at schedule Sound setup Clock Pairing
- 36. Menu structure Settings WiFi Manual Smartconfig Web portal Display Brightness Screensaver Wifi On/Off Calibration *Manual *Auto Localization Language Time & date Units Sound About FW update LED Charts Thermost at Clock Schedule More settings RF Pairing Reset
- 37. Menu design Main menu Item Item Item Item Item Settings Sub-menu Back Item Item Item ItemItem
- 39. Menu design WiFi settings Back Next List of networks Select network WiFi settings Back Next ********** Enter password QWERTY keyboard
- 40. Challenges ● Driver conversion to FreeRTOS ● Temperature skew ● Enclosure design ● DMA, double video buffers ● Overall R&D process, as this is my first project using ESP32
- 41. Future plans ● Larger 3.5” TFT ● LoRa support ● No buttons, thin frame ● More powerful ESP32 package with PSRAM support ● Improved firmware functions
- 42. Questions?
Editor's Notes
- #5: No internet: No HVAC system control No hot water
- #8: https://docs.google.com/spreadsheets/d/1qh0FFg8FVvWqPQiCQqMijkuaBa461PhQDRTuFa0cq0E/edit#gid=0
- #14: Edge devices Actuators Relay Sensors
- #15: Communications management Manages WiFi connectivity & related events Connection and reconnection (smart) WiFi scan functions Failover to alternative connection, then revert to primary SmartConfig & WPS Manages RF connections Manages incoming / outgoing message queues Manages UART connection Manages BLE connections Manages internal message queues Manages signal states e.g. VALID, TMO, ERR, SNA E2E protection Manages message queues rate limiters Power management Detects BOD conditions DFS - CPU clock speed management Monitors internal CPU temperature Sets WiFi transmission power levels Sets WiFi power saving modes Peripheral sleep Manages power-saving mode by monitoring interaction with system Security management Secure boot Firmware verification Certificate management Credentials management Operating state management Different system states based on predefined conditions (normal, degraded, power save, OTA, safe mode etc) Clock/Date management Provides reliable time & date information Illumination management Handles display and status LED brightness based on environmental and time factors OTA management Provides over the air updates functionality Data storage management Non-Volatile Storage (“key-value” storage with mirroring, CRC) RTC memory, survives restarts SPIFFS ESPFS SD card storage Input devices management Buttons manager (press, long press, double click and other combinations) Touch management (TS driver, touch calibration) Environmental sensing Ambient temperature Ambient humidity Ambient light Communication protocols management NTP client MQTT (s) HTTP server Websocket server Captive DNS HTTP(s) client mDNS Diagnostics Configuration API System state information Debug output redirection Debug verbosity GUI LittlevGL Display ILI9431 library Audio Buzzer driver Visual feedback WS2812b control Localization Translation strings Units Time zone
- #16: https://docs.google.com/drawings/d/1OLnj0uhegQvToHiTKmKudzg55ssnaHQAPkx850cZKoQ/edit
- #19: Peripherals ADC CAN DAC GPIO (including RTC low power I/O) I2C I2S LED Control MCPWM Pulse Counter Remote Control SDMMC Host SD SPI Host SDIO Slave Sigma-delta Modulation SPI Master SPI Slave Timer Touch Sensor UART