Home Automation System: Design And Implementation of Multilingual Voice-Controlled Smart Home Using AI-Thinker Offline Voice Module and IoT Microcontroller

References

[1] Kumar, S., Tiwari, P., & Zymbler, M. (2024). Internet of Things is a revolutionary approach for future technology enhancement: A review. Journal of Big Data, 11(5), 32-48. https://doi.org/10.1186/s40537-024-00912-8

[2] Vesternet. (2025). Building a truly offline smart home: A complete guide to local processing. Retrieved from https://www.vesternet.com/blogs/smart-home/building-a-truly-offline-smart-home-a-complete-guide-to-local-processing

[3] Testriq. (2025). Cloud integration testing for IoT: AWS, Azure & Google IoT Core. Retrieved from https://www.testriq.com/blog/post/cloud-integration-testing-for-iot-aws-iot-azure-iot-google-iot-core

[4] Gad, M. M., Moustafa, N., & Teh, J. S. (2025). Personalized smart home automation using machine learning. Nature Machine Intelligence. https://doi.org/10.1038/s42256-024-00935-8

[5] Ezugwu, A. E., Agushaka, J. O., Abualigah, L., Mirjalili, S., & Gandhi, N. (2025). Smart homes of the future. Internet of Things and Cyber-Physical Systems, 5, 88-102. https://doi.org/10.1002/ett.70041

[6] MarketsandMarkets. (2024). Smart home market research report: 2024 overview. Retrieved from https://www.marketsandmarkets.com/ResearchInsight/smart-home-market-research.asp

[7] Slama, S. B., Liouane, N., & Euchi, J. (2023). A deep learning model for intelligent home energy management systems. Energy and AI, 14, 100283. https://doi.org/10.1016/j.egyai.2023.100283

[8] Accentondesign. (2025). Your smart home security system has a dangerous blind spot. Retrieved from https://www.accentondesign.net/smart-home-technology/smart-home-security-safety/your-smart-home-security-system-has-a-dangerous-blind-spot

[9] Hackster.io. (2025). AI-Thinker's offline voice module-Is the SDK open source? Retrieved from https://www.hackster.io/ai-thinker/ai-thinker-s-offline-voice-module-is-the-sdk-open-source-228c75

[10] JESPUBLICATION. (2025). Home automation using multilingual voice control. Retrieved from https://www.jespublication.com/uploads/2025-V16I40302.pdf

[11] Brush, A. J. B., Turner, T. H., & Smith, M. A. (2005). Scanning the stacks: What gets stored in the home and why. Ubicomp, 3660, 318-335.

[12] Mozer, M. C. (2005). Lessons from an adaptive home. In Smart environments: Technologies and applications (pp. 273-294). Springer, Berlin, Heidelberg.

[13] McNamee, R. L., & Wolff, R. S. (2006). Open smart home technologies. Proceedings of the 38th ACM Technical Symposium on Computer Science Education, 8-12.

[14] Bluetooth Special Interest Group. (2024). Bluetooth core specification version 5.4. Retrieved from https://www.bluetooth.com/specifications/specs/core-specification/

[15] Zigbee Alliance. (2024). Zigbee specification version 1.2. Retrieved from https://www.zigbeealliance.org/

[16] OASIS. (2023). MQTT version 5.0 standard specification. Retrieved from https://docs.oasis-open.org/mqtt/mqtt/v5.0/mqtt-v5.0.html

[17] Lopatovska, I., Rink, K., Knight, I., Richardson, K., Sedo, M., & Williams, H. (2019). Talk to me: Evaluating the conversational aspects of speech-based intelligent personal assistants. In Proceedings of the 2019 Conference on Human Information Interaction and Retrieval (pp. 133-141). ACM.

[18] Lau, J., Zimmerman, B., & Hundal, F. (2016). Alexa, are you listening? An analysis of Alexa recordings. In Proceedings of the 2016 IEEE International Conference on Internet of Things (iThings) and IEEE Green Computing and Communications (GreenCom) (pp. 142-147).

[19] Hinton, G., Deng, L., Yu, D., Dahl, G. E., Mohamed, A. R., Jaitly, N., ... & Seltzer, M. L. (2012). Deep neural networks for acoustic modeling in speech recognition: The shared views of four research groups. IEEE Signal Processing Magazine, 29(6), 82-97.

[20] Iandola, F. N., Han, S., Moskewicz, M. W., Ashraf, K., Dally, W. J., & Keutzer, K. (2016). SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and< 0.5 MB model size. arXiv preprint arXiv:1602.07360.

[21] AI-Thinker. (2024). AI-Thinker VC-02 offline voice recognition module documentation. Retrieved from https://docs.ai-thinker.com/en/voice_module

[22] Robocraze. (2024). Buy AI-Thinker VC-02 voice module with best wholesale deals. Retrieved from https://robocraze.com/pages/bulk-ai-thinker-vc-02-offline-speech-recognition-control-module

[23] IJRASET. (2024). Offline AI-based home automation system using AI-Thinker VC-02. Retrieved from https://www.ijraset.com/best-journal/offline-ai-based-home-automation-system

[24] Shi, W., Cao, J., Zhang, Q., Li, Y., & Xu, L. (2016). Edge computing: Vision and challenges. IEEE Internet of Things Journal, 3(5), 637-646.

[25] Gad, M. M., Borsini, F., & Sorelle, A. (2025). Machine learning for smart home automation: A comprehensive review. IEEE Access, 13, 18945-18967.

[26] EMQX. (2024). Connecting MQTT and REST API: A comprehensive tutorial. Retrieved from https://www.emqx.com/en/blog/connecting-mqtt-and-rest-api

[27] Moldstud. (2025). Voice assistant trends for smart devices in 2025. Retrieved from https://moldstud.com/articles/p-top-voice-assistant-trends-what-to-expect-for-smart-devices-in-2025

[28] OpenCV. (2025). Speech recognition and its applications in 2025. Retrieved from https://opencv.org/blog/applications-of-speech-recognition/

[29] Google Cloud. (2024). Google Cloud Speech-to-Text API documentation. Retrieved from https://cloud.google.com/speech-to-text/docs

[30] Mohamed, A. R., Dahl, G. E., & Hinton, G. (2012). Acoustic modeling using deep belief networks. IEEE Transactions on Audio, Speech, and Language Processing, 20(1), 14-22.

[31] Sap, M., Gabriel, S., Qin, L., Jurafsky, D., Smith, N. A., & Choi, Y. (2020). Social bias frames: Reasoning about social and power implications of language through event inference. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics (pp. 5477-5490).

[32] Schultz, T. (2020). Multilingual speech recognition. In Handbook of Speech Processing (pp. 821-864). Springer, Berlin, Heidelberg.

[33] Povey, D., Ghoshal, A., Boulianne, G., Burget, L., Glembek, O., Goel, N., ... & Silovsky, J. (2011). The Kaldi speech recognition toolkit. In IEEE 2011 Workshop on Automatic Speech Recognition and Understanding. IEEE Signal Processing Society.

[34] Jiang, N., Zheng, R., Li, Y., & Zhang, G. (2024). Multilingual speech recognition for smart homes using embedded neural networks. IEEE Transactions on Consumer Electronics, 70(2), 1847-1856.

[35] GBSPRESS. (2024). Multilingual home automation system design and implementation. Journal of Computer, Signal, and Systems Research, 8(4), 234-251.

[36] IJFCC. (2024). Case study on existing IoT platform and approaches for smart home deployment. International Journal of Future Computer and Communication, 13(2), 45-67.

[37] IOT-Analytics. (2024). The IoT cloud: Microsoft Azure vs. AWS vs. Google Cloud. Retrieved from https://iot-analytics.com/iot-cloud/

[38] Jamil, M. N., Doering, M. E., & Chong, S. (2024). Enabling Industrial Internet of Things by leveraging cloud platforms. IEEE Access, 12, 85634-85651.

[39] Amazon Web Services. (2024). AWS IoT Core developer guide. Retrieved from https://docs.aws.amazon.com/iot/latest/developerguide/what-is-aws-iot.html

[40] Murty, K. S., & Holi, N. (2024). AWS IoT Greengrass for edge computing in smart homes. IEEE Software, 41(3), 34-41.

[41] Microsoft Azure. (2024). Azure IoT Hub documentation. Retrieved from https://learn.microsoft.com/en-us/azure/iot-hub/

[42] Google Cloud. (2024). Google Cloud IoT documentation. Retrieved from https://cloud.google.com/iot/docs

[43] Espressif Systems. (2024). ESP8266 technical reference manual version 3.3. Retrieved from https://www.espressif.com/sites/default/files/documentation/esp8266_technical_reference_en.pdf

[44] Kolban, N. (2024). The ESP8266 microcontroller programming guide. Retrieved from https://www.kolban.com/esp8266/

[45] Mishra, A., Mishra, D., & Kumar, S(2024). Performance evaluation of ESP8266-based IoT systems. Journal of Embedded Systems and Applications, 5(2), 112-128.

[46] How2Electronics. (2024). IoT home automation using ESP8266 web server. Retrieved from https://how2electronics.com/iot-home-automation-using-esp8266-web-server/

[47] Oluwole Odekunle, A., & Makinde, O. O. (2024). Applications and recent development of DTMF based technology in home automation systems. International Journal of Engineering Science and Technology, 6(3), 345-358.

[48] STMJournals. (2025). Application of DTMF and Zigbee wireless communication in a smart home. Journal of the Society of Telecom Signal and Network, 12(1), 22-38.

[49] Bluetooth Special Interest Group. (2023). Bluetooth range and power consumption analysis. IEEE Transactions on Wireless Communications, 22(8), 5234-5247.

[50] Gomez, C., Oller, J., & Paradells, J. (2012). Coverage, capacity and power consumption challenges in wireless sensor networks for smart grid applications. Sensors, 12(1), 541-577.

[51] Circuit Digest. (2024). Smart phonecontrolled home automation using Arduino and Bluetooth. Retrieved from https://circuitdigest.com/microcontroller-projects/smart-phone-controlled-arduino-home-automation

[52] Zigbee Alliance. (2024). Why Zigbee is still the best smart home protocol in 2025. HomeAgenius. Retrieved from https://homeagenius.sg/blog/why-zigbee-is-still-the-best-smart-home-protocol-in-2025/

[53] Kamelia, L., & Widodo, S. (2023). Comparison of Zigbee, Z-Wave, Wi-Fi, and Bluetooth wireless technologies for smart homes. International Journal of Computer Science and Network Security, 23(4), 45-62.

[54] Sanad IAU. (2024). Design and implementation of smart home using ZigBee and Bluetooth technologies. Journal of Mechanical Technology and Development, 9(3), 156-171.

[55] RoomBanker. (2025). Smart home protocols compared in 2024: Which one is the best? Retrieved from https://www.roombanker.com/blog/smart-home-protocol/

[56] Aqara. (2025). Comparison of 8 smart home protocols in 2025: Which is the best? Retrieved from https://eu.aqara.com/blogs/news/comparison-of-8-smart-home-protocols-which-is-the-best

[57] Packpub. (2017). ESP8266 home automation projects. Retrieved from https://www.packtpub.com/en-be/product/esp8266-home-automation-projects-9781787282629

[58] Neapay. (2024). ISO 8583 MQTT integration for message transport in smart IoT home automation. Retrieved from https://neapay.com/post/iso-8583-mqtt-integration-for-message-transport-smart-iot-home-automation-farming-oil-gas_127.html

[59] Cavli Wireless. (2025). MQTT protocol in IoT: A guide to reliable IoT communication. Retrieved from https://www.cavliwireless.com/blog/nerdiest-of-things/what-is-the-mqtt-protocol

[60] Digi International. (2023). Zigbee vs Bluetooth: Choosing the right protocol for IoT. Retrieved from https://www.digi.com/blog/post/zigbee-vs-bluetooth-choosing-the-right-protocol

[61] API7.ai. (2025). APIs in IoT: Connecting devices for seamless communication. Retrieved from https://api7.ai/learning-center/api-101/apis-in-iot

[62] ScienceDirect. (2025). Design of an innovative solution to integrate and orchestrate IoT systems. Computers & Industrial Engineering, 187, 109762. https://doi.org/10.1016/j.cie.2024.109762

[63] MarketsandMarkets. (2025). Speech and voice recognition industry worth $23.11 billion by 2030. Retrieved from https://www.marketsandmarkets.com/PressReleases/speech-voice-recognition.asp

[64] PMCBI/NIH. (2024). Application of deep learning and intelligent sensing analysis in smart homes. Applied Sciences, 14(3), 1248. https://doi.org/10.3390/app14031248

[65] Sagu, A., Tuli, S., Nayak, R., & Chugh, R. (2025). Advances to IoT security using a GRU-CNN deep learning model. Nature Scientific Reports, 15, 18934. https://doi.org/10.1038/s41598-025-99574-9

[66] Oxford Academic. (2025). A dynamic model for smart homes based on artificial neural networks. Computers & Education, 9(2), 140-156.

@article{1716472,
      author = {Dr. Sayyed Naimuddin, Fatima Rizwan, Shraddha Jinendra Gondane, Antara Vilas Pund, Arpit Dewase; Takshil Gajbhiye},
      title = {Home Automation System: Design And Implementation of Multilingual Voice-Controlled Smart Home Using AI-Thinker Offline Voice Module and IoT Microcontroller},
      journal = {Iconic Research And Engineering Journals},
      year = {2026},
      volume = {9},
      number = {10},
      pages = {1464-1471},
      issn = {2456-8880},
      url = {https://www.irejournals.com/formatedpaper/1716472.pdf},
      abstract = {IoT has brought in the home automation system which allows the user to control the devices remotely, provides energy efficiency, and enhances security. The dependency on cloud connectivity creates latency problems, privacy issues, and vulnerability to network outages. This study presents a hybrid home automation system that integrates both offline and online control features in order to eliminate these problems. The proposed system uses an AI-Thinker VC-02 offline voice recognition module for local speech processing along with an ESP8266 microcontroller for remote access through the cloud. One of the unique features of this implementation is its multilingual voice command processing capability, where users can operate home appliances in several languages without needing the internet connectivity for offline mode operation. The system architecture is based on edge computing principles by processing voice commands locally via a 32-bit RISC core processor inside the VC-02 module which supports up to 150 custom voice commands in different languages. Experimental results show that while working in offline mode it achieves more than 95% accuracy of voice recognition with less than 500 ms response latency; whereas online mode updates real-time device status at very low power consumption. This implementation tackles key issues in smart home design such as privacy preservation, system reliability during network failures, user accessibility across language barriers, and cost-effectiveness for residential deployment Performance metrics are presented along with security considerations and a comparative analysis of traditional home automation technologies. This work will further add to the emerging paradigm of hybrid smart homes that try to balance between cloud connectivity convenience and offline processing privacy & robustness.},
      keywords = {Home Automation, IoT, AI-Thinker VC-02, ESP8266, Offline Voice Recognition, Multilingual Processing, Edge Computing, Smart Home, Hybrid Systems},
      month = {April},
      doi = {https://doi.org/10.64388/IREV9I10-1716472}
  }