International Peer-Reviewed Journal•Open Access•ISSN 2456-8880
irejournals@gmail.com•+91-7433024337

Home / Current Issue / Paper 1709741

1709741 Vol 6 · Issue 12 Download Paper

Real-Time Edge AI: Deploying Efficient Deep Learning Models for On-Device Inference

Luis Madrigal Ofer Ronen Leon Chlon

Subject area: Science,Engineering and Technology  ·  Area of research: Deep Learning

Abstract

Edge AI is transforming the landscape of smart devices by enabling real-time inference on resource-constrained hardware. This paper presents a framework for deploying lightweight deep learning models that strike a balance between accuracy and latency.

References

[1] H. Howard et al., 'Efficient CNN Architectures for Mobile Devices', IEEE TNNLS, 2019.

[2] A. Krizhevsky et al., 'ImageNet Classification with Deep CNNs', NIPS, 2012.

[3] M. Sandler et al., 'MobileNetV2: Inverted Residuals and Linear Bottlenecks', CVPR, 2018.

[4] F. Chollet, 'Xception: Deep Learning with Depthwise Separable Convolutions', CVPR, 2017.

[5] Y. Cheng et al., 'Model Compression and Acceleration for Deep Neural Networks', arXiv, 2017.

[6] H. Wang et al., "MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications," arXiv preprint arXiv:1704.04861, 2017.

[7] M. Tan and Q. Le, "EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks," arXiv:1905.11946, 2019.

[8] A. Krizhevsky, I. Sutskever, and G. Hinton, "ImageNet Classification with Deep Convolutional Neural Networks," NIPS, 2012.

[9] K. He et al., "Deep Residual Learning for Image Recognition," CVPR, 2016.

[10] Y. LeCun et al., "Gradient-Based Learning Applied to Document Recognition," Proceedings of the IEEE, 1998.

[11] Mohit Jain and Adit Shah (2021). Convolutional neural networks for real-time object detection with raspberry Pi. https://wjaets.com/sites/default/files/WJAETS2021-0067.pdf. https://doi.org/10.30574/wjaets.2021.4.1.0067

[12] S. Ioffe and C. Szegedy, "Batch Normalization: Accelerating Deep Network Training," ICML, 2015.

[13] F. Chollet, "Xception: Deep Learning with Depthwise Separable Convolutions," CVPR, 2017.

[14] D. Howard et al., "Searching for MobileNetV3," ICCV, 2019.

[15] Nair and G. Hinton, "Rectified Linear Units Improve Restricted Boltzmann Machines," ICML, 2010.

[16] M. Sandler et al., "MobileNetV2: Inverted Residuals and Linear Bottlenecks," CVPR, 2018.

[17] J. Redmon et al., "You Only Look Once: Unified, Real-Time Object Detection," CVPR, 2016.

[18] J. Deng et al., "ImageNet: A Large-Scale Hierarchical Image Database," CVPR, 2009.

[19] C. Szegedy et al., "Going Deeper with Convolutions," CVPR, 2015.

[20] M. Abadi et al., "TensorFlow: A System for Large-Scale Machine Learning," OSDI, 2016.

[21] A. Paszke et al., "PyTorch: An Imperative Style, High-Performance Deep Learning Library," NeurIPS, 2019.

[22] H. Han et al., "The Edge of Intelligence: A Survey on Edge AI," IEEE Access, 2019.

[23] A. Graves et al., "Speech Recognition with Deep Recurrent Neural Networks," ICASSP, 2013.

[24] Y. Gal and Z. Ghahramani, "Dropout as a Bayesian Approximation," ICML, 2016.

[25] R. Girshick, "Fast R-CNN," ICCV, 2015.

[26] S. Ren et al., "Faster R-CNN: Towards Real-Time Object Detection," NIPS, 2015.

[27] X. Glorot and Y. Bengio, "Understanding the Difficulty of Training Deep Feedforward Networks," AISTATS, 2010.

[28] J. Ba and R. Caruana, "Do Deep Nets Really Need to be Deep?," NIPS, 2014.

[29] Mohit Jain and Adit Shah (2021). Convolutional neural networks for real-time object detection with raspberry Pi. https://wjaets.com/sites/default/files/WJAETS2021-0067.pdf. https://doi.org/10.30574/wjaets.2021.4.1.0067

[30] G. Hinton et al., "Distilling the Knowledge in a Neural Network," arXiv:1503.02531, 2015.

[31] B. Zoph and Q. Le, "Neural Architecture Search with Reinforcement Learning," ICLR, 2017.

[32] Y. Wu and K. He, "Group Normalization," ECCV, 2018.

How to cite this paper

Luis Madrigal, Ofer Ronen, Leon Chlon "Real-Time Edge AI: Deploying Efficient Deep Learning Models for On-Device Inference" Iconic Research And Engineering Journals Volume 6 Issue 12 2023 Page 1619-1622
Luis Madrigal, Ofer Ronen, Leon Chlon "Real-Time Edge AI: Deploying Efficient Deep Learning Models for On-Device Inference" Iconic Research And Engineering Journals, vol. 6, no. 12, Jun. 2023
Luis Madrigal, Ofer Ronen, Leon Chlon (2023). Real-Time Edge AI: Deploying Efficient Deep Learning Models for On-Device Inference. Iconic Research And Engineering Journals, 6(12).
Luis Madrigal, Ofer Ronen, Leon Chlon "Real-Time Edge AI: Deploying Efficient Deep Learning Models for On-Device Inference" Iconic Research And Engineering Journals, vol. 6, no. 12, Jun. 2023.
@article{1709741,
      author = {Luis Madrigal, Ofer Ronen, Leon Chlon},
      title = {Real-Time Edge AI: Deploying Efficient Deep Learning Models for On-Device Inference},
      journal = {Iconic Research And Engineering Journals},
      year = {2023},
      volume = {6},
      number = {12},
      pages = {1619-1622},
      issn = {2456-8880},
      url = {https://www.irejournals.com/formatedpaper/1709741.pdf},
      abstract = {Edge AI is transforming the landscape of smart devices by enabling real-time inference on resource-constrained hardware. This paper presents a framework for deploying lightweight deep learning models that strike a balance between accuracy and latency.},
      month = {June},
  }