MobileDets: Searching for Object Detection Architectures for Mobile Accelerators

Inverted bottleneck layers, which are built upon depth-wise convolutions, have been the predominant building blocks in state-of-the-art object detection models on mobile devices. In this work, we investigate the optimality of this design pattern over a broad range of mobile accelerators by revisiting the usefulness of regular convolutions. We discover that regular convolutions are a potent component to boost the latency-accuracy trade-off for object detection on accelerators, provided that they are placed strategically in the network via neural architecture search. By incorporating regular convolutions in the search space and directly optimizing the network architectures for object detection, we obtain a family of object detection models, MobileDets, that achieve state-of-the-art results across mobile accelerators. On the COCO object detection task, MobileDets outperform MobileNetV3+SSDLite by 1.7 mAP at comparable mobile CPU inference latencies. MobileDets also outperform MobileNetV2+SSDLite by 1.9 mAP on mobile CPUs, 3.7 mAP on Google EdgeTPU, 3.4 mAP on Qualcomm Hexagon DSP and 2.7 mAP on Nvidia Jetson GPU without increasing latency. Moreover, MobileDets are comparable with the state-of-the-art MnasFPN on mobile CPUs even without using the feature pyramid, and achieve better mAP scores on both EdgeTPUs and DSPs with up to 2× speedup. Code and models are available in the TensorFlow Object Detection API [16]: https://github.com/tensorflow/models/tree/master/research/object_detection.

• Publication year

  2020

• Venue

  Computer Vision and Pattern Recognition

• Publication date

  2020-04-30

• Fields of study

  Computer Science, Engineering

• Identifiers
  DOI 10.1109/CVPR46437.2021.00382arXiv 2004.14525
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Accelerator-aware Neural Network Design using AutoML

  2020cited by this paper
• Can Weight Sharing Outperform Random Architecture Search? An Investigation With TuNAS

  2020influential reference
• DetNAS: Backbone Search for Object Detection

  2019cited by this paper
• EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks

  2019influential reference
• Searching for MobileNetV3

  2019influential reference
• ANTNets: Mobile Convolutional Neural Networks for Resource Efficient Image Classification

  2019cited by this paper
• MnasFPN: Learning Latency-Aware Pyramid Architecture for Object Detection on Mobile Devices

  2019influential reference
• ThunderNet: Towards Real-Time Generic Object Detection on Mobile Devices

  2019cited by this paper
• Scaling Recurrent Models via Orthogonal Approximations in Tensor Trains

  2019cited by this paper
• Once for All: Train One Network and Specialize it for Efficient Deployment

  2019cited by this paper
• Resource Constrained Neural Network Architecture Search: Will a Submodularity Assumption Help?

  2019cited by this paper
• NAS-FCOS: Fast Neural Architecture Search for Object Detection

  2019cited by this paper
• ChamNet: Towards Efficient Network Design Through Platform-Aware Model Adaptation

  2018cited by this paper
• Efficient Neural Architecture Search via Parameter Sharing

  2018cited by this paper
• Regularized Evolution for Image Classifier Architecture Search

  2018cited by this paper
• MobileNetV2: Inverted Residuals and Linear Bottlenecks

  2018influential reference
• NetAdapt: Platform-Aware Neural Network Adaptation for Mobile Applications

  2018cited by this paper
• Pelee: A Real-Time Object Detection System on Mobile Devices

  2018cited by this paper
• DARTS: Differentiable Architecture Search

  2018cited by this paper
• Understanding and Simplifying One-Shot Architecture Search

  2018cited by this paper
• MnasNet: Platform-Aware Neural Architecture Search for Mobile

  2018cited by this paper
• AMC: AutoML for Model Compression and Acceleration on Mobile Devices

  2018influential reference
• ProxylessNAS: Direct Neural Architecture Search on Target Task and Hardware

  2018cited by this paper
• FBNet: Hardware-Aware Efficient ConvNet Design via Differentiable Neural Architecture Search

  2018cited by this paper
• SMASH: One-Shot Model Architecture Search through HyperNetworks

  2017cited by this paper
• ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devices

  2017cited by this paper
• Squeeze-and-Excitation Networks

  2017cited by this paper
• MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications

  2017cited by this paper
• Learning Transferable Architectures for Scalable Image Recognition

  2017cited by this paper
• Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inference

  2017cited by this paper
• SqueezeDet: Unified, Small, Low Power Fully Convolutional Neural Networks for Real-Time Object Detection for Autonomous Driving

  2016cited by this paper
• Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning

  2016cited by this paper
• Neural Architecture Search with Reinforcement Learning

  2016cited by this paper
• Speed/Accuracy Trade-Offs for Modern Convolutional Object Detectors

  2016influential reference
• R-FCN: Object Detection via Region-based Fully Convolutional Networks

  2016cited by this paper
• You Only Look Once: Unified, Real-Time Object Detection

  2015cited by this paper
• Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks

  2015cited by this paper
• Deep Residual Learning for Image Recognition

  2015cited by this paper
• Compression of Deep Convolutional Neural Networks for Fast and Low Power Mobile Applications

  2015cited by this paper
• SSD: Single Shot MultiBox Detector

  2015influential reference
• Speeding-up Convolutional Neural Networks Using Fine-tuned CP-Decomposition

  2014cited by this paper
• Microsoft COCO: Common Objects in Context

  2014influential reference
• Simple Statistical Gradient-Following Algorithms for Connectionist Reinforcement Learning

  2004cited by this paper
• Analysis of individual differences in multidimensional scaling via an n-way generalization of “Eckart-Young” decomposition

  1970cited by this paper
• Some mathematical notes on three-mode factor analysis

  1966cited by this paper

• A lightweight framework with adaptive feature enhancement for accurate pavement distress evaluation

  2026cites this paper
• Boosting lightweight object detection with enhanced feature fusion and optimized receptive field

  2026cites this paper
• REDARTS: Regressive Differentiable Neural Architecture Search for Exploring Optimal Light Field Disparity Estimation Network

  2026cites this paper
• An efficient attention-based detection network for underground miner pose recognition

  2026cites this paper
• Real-Time Parking Space Management System Based on a Low-Power Embedded Platform

  2025cites this paper
• Auto-accel: a SW/HW co-design framework with adaptive unified buffer mapping and power-of-two quantization for FPGA-based object detection accelerators

  2025cites this paper
• Mozart: A Chiplet Ecosystem-Accelerator Codesign Framework for Composable Bespoke Application Specific Integrated Circuits

  2025cites this paper
• Development of a Vehicle Classification for Multi Lane Free Flow Using the EfficientDet Model

  2025cites this paper
• Enhanced Lightweight Deep Learning-Based Object Classification for Edge Devices

  2025influential citation
• ICSD-YOLO: Intelligent detection for real-time industrial field safety

  2025cites this paper
• CLARiTy: A Vision Transformer for Multi-Label Classification and Weakly-Supervised Localization of Chest X-ray Pathologies

  2025cites this paper
• Engineering opportunistic digital twins with lingua franca

  2025cites this paper
• Automatic species identification from images for Aotearoa

  2025cites this paper
• Designing Object Detection Models for TinyML: Foundations, Comparative Analysis, Challenges, and Emerging Solutions

  2025cites this paper
• S3Det: a fast object detector for remote sensing images based on artificial to spiking neural network conversion

  2025cites this paper
• AnchorFormer: Differentiable Anchor Attention for Efficient Vision Transformer

  2025cites this paper
• A comprehensive review of object detection with traditional and deep learning methods

  2025cites this paper
• CNN based 2D object detection techniques: a review

  2025cites this paper
• A lightweight neural network search algorithm based on in-place distillation and performance prediction for hardware-aware optimization

  2025cites this paper
• SCGAN: Sampling and Clustering-Based Neural Architecture Search for GANs

  2025cites this paper
• ELASTIC: Efficient Once For All Iterative Search for Object Detection on Microcontrollers

  2025cites this paper
• YOLO-Shuffle Unified Cross Attentive Feature Fusion for Multispectral Drone Based Object Detection

  2025cites this paper
• Research on fault detection of belt conveyor drum based on improved YOLOv8 network mode

  2025cites this paper
• 16.3 An on-Device Generative AI Focused Neural Processing Unit in 4nm Flagship Mobile SoC with Fan-Out Wafer-Level Package

  2025cites this paper
• Aggregated Time Series Features in a Voxel-Based Network Architecture

  2025cites this paper
• Underwater Target Detection with High Accuracy and Speed Based on YOLOv10

  2025cites this paper
• An autonomous UAV system based on adaptive LiDAR inertial odometry for practical exploration in complex environments

  2024cites this paper
• Development of Object Detection Models Compatible with Edge TPU Accelerator for Low-Cost Single-Board Computers

  2024cites this paper
• Efficient Processing of MLPerf Mobile Workloads Using Digital Compute-In-Memory Macros

  2024cites this paper
• A Hybrid Human Tracking System using UWB Sensors and Monocular Visual Data Fusion for Human Following Robots

  2024cites this paper
• Mediator: Characterizing and Optimizing Multi-DNN Inference for Energy Efficient Edge Intelligence

  2024cites this paper
• Lightweight and efficient deep learning models for fruit detection in orchards

  2024cites this paper
• BGF-YOLOv10: Small Object Detection Algorithm from Unmanned Aerial Vehicle Perspective Based on Improved YOLOv10

  2024cites this paper
• ORNet: Orthogonal Re-Parameterized Networks for Fast Pedestrian and Vehicle Detection

  2024cites this paper
• Robust multi-stage progressive autoencoder for hyperspectral anomaly detection

  2024cites this paper
• Reg-PTQ: Regression-specialized Post-training Quantization for Fully Quantized Object Detector

  2024cites this paper
• Artificial Intelligence-Based Challenges as an Educational Tool in Aerospace Engineering: the u3S Laboratory Experience

  2024cites this paper
• Inverted Bottleneck Convolution Module for Yolov8

  2024cites this paper
• ${MC}^{3}$: Memory Contention-Based Covert Channel Communication on Shared DRAM System-on-Chips

  2024cites this paper
• Evaluating the Effectiveness of an Object Detection Pipeline to Support Surveillance of Unintended Passage

  2024cites this paper
• Panoptic Water Surface Visual Perception for USVs Using Monocular Camera Sensor

  2024cites this paper
• Real-Time Object Detection from UAV Inspection Videos by Combining YOLOv5s and DeepStream

  2024cites this paper
• TBNet: A Reliable and Efficient Neural Network for Tuberculosis Detection

  2024cites this paper
• A new lightweight network for efficient UAV object detection

  2024cites this paper
• Recent Advances for Aerial Object Detection: A Survey

  2024cites this paper
• Multi-resolution Rescored ByteTrack for Video Object Detection on Ultra-low-power Embedded Systems

  2024cites this paper
• Tensor Processing Unit Reliability Dependence on Temperature and Radiation Source

  2024cites this paper
• An Investigation on Hardware-Aware Vision Transformer Scaling

  2023cites this paper
• A Framework for Benchmarking Real-Time Embedded Object Detection

  2023cites this paper
• A lightweight and efficient one-stage detection framework

  2023cites this paper
• A Multi-Mode 8k-MAC HW-Utilization-Aware Neural Processing Unit With a Unified Multi-Precision Datapath in 4-nm Flagship Mobile SoC

  2023cites this paper
• An Ensemble Mobile-Cloud Computing Method for Affordable and Accurate Glucometer Readout

  2023influential citation
• Surface Defect Detection System for Carrot Combine Harvest Based on Multi-Stage Knowledge Distillation

  2023cites this paper
• Oriented Object Detection in Optical Remote Sensing Images: A Survey

  2023cites this paper
• Accelerating Deep Neural Networks on Mobile Multicore NPUs

  2023cites this paper
• Using Semantic Segmentation Network to Measure Vibration Displacement of Rotating Body

  2023cites this paper
• External Camera-Based Mobile Robot Pose Estimation for Collaborative Perception with Smart Edge Sensors

  2023cites this paper
• Multi-level Feature Interaction and Efficient Non-Local Information Enhanced Channel Attention for image dehazing

  2023cites this paper
• Lightweight Sea Cucumber Recognition Network Using Improved YOLOv5

  2023cites this paper
• Modular design automation of the morphologies, controllers, and vision systems for intelligent robots: a survey

  2023cites this paper
• A Wireless Gunshot Recognition System Based on Tri-Axis Accelerometer and Lightweight Deep Learning

  2023cites this paper
• A Survey on Deep Learning-Based Monocular Spacecraft Pose Estimation: Current State, Limitations and Prospects

  2023cites this paper
• A deep neural network based feature fusion panoramic segmentation method

  2023cites this paper
• Vision-based underwater target real-time detection for autonomous underwater vehicle subsea exploration

  2023influential citation
• Histopathological Image Deep Feature Representation for CBIR in Smart PACS

  2023cites this paper
• Oriented object detection in optical remote sensing images using deep learning: a survey

  2023cites this paper
• A new deep learning-based food recognition system for mobile terminal

  2023cites this paper
• ECenterDet: An Efficient Anchor-free Detector

  2023cites this paper
• SYENet: A Simple Yet Effective Network for Multiple Low-Level Vision Tasks with Real-time Performance on Mobile Device

  2023cites this paper
• Opportunistic Digital Twin: an Edge Intelligence enabler for Smart City

  2023cites this paper
• SFTN: Fast object detection for aerial images

  2023cites this paper
• Lightweight computer vision based asphalt pavement crack visualization detection

  2023cites this paper
• Design of an Automated Robotic System for Object Tracking and Targeted Lighting

  2023cites this paper
• Advances, Challenges and Opportunities in Deep Learning Approach for Object Detection: A Review

  2023cites this paper
• Fire Detection System Using Transfer Learning Mobiledets with Google Coral USB Accelerator Based on Raspberry Pi 4

  2023cites this paper
• Object Detection in Autonomous Vehicles: Status and Open Challenges

  2022cites this paper
• 3D Semantic Scene Perception using Distributed Smart Edge Sensors

  2022cites this paper
• Searching for Efficient Neural Architectures for On-Device ML on Edge TPUs

  2022influential citation
• Online Rail Fastener Detection Based on YOLO Network

  2022cites this paper
• Smartadapt: Multi-branch Object Detection Framework for Videos on Mobiles

  2022cites this paper
• Neural Architecture Search Survey: A Hardware Perspective

  2022cites this paper
• Deep Learning for Real Time Satellite Pose Estimation on Low Power Edge TPU

  2022cites this paper
• U-Boost NAS: Utilization-Boosted Differentiable Neural Architecture Search

  2022cites this paper
• A Multi-Mode 8K-MAC HW-Utilization-Aware Neural Processing Unit with a Unified Multi-Precision Datapath in 4nm Flagship Mobile SoC

  2022cites this paper
• Neural Architecture Search for Dense Prediction Tasks in Computer Vision

  2022cites this paper
• BackboneAnalysis: Structured Insights into Compute Platforms from CNN Inference Latency

  2022cites this paper
• MobileDenseNet: A new approach to object detection on mobile devices

  2022cites this paper
• Revisiting AP Loss for Dense Object Detection: Adaptive Ranking Pair Selection

  2022cites this paper
• A deep learning based dislocation detection method for cylindrical silicon growth process

  2022cites this paper
• Restructurable Activation Networks

  2022cites this paper
• Design Automation for Fast, Lightweight, and Effective Deep Learning Models: A Survey

  2022influential citation
• Hardware-aware mobile building block evaluation for computer vision

  2022cites this paper
• MIC_FuzzyNET: Fuzzy Integral Based Ensemble for Automatic Classification of Musical Instruments From Audio Signals

  2022cites this paper
• DPNet: Dual-Path Network for Real-Time Object Detection With Lightweight Attention

  2022influential citation
• Toward Edge-Efficient Dense Predictions with Synergistic Multi-Task Neural Architecture Search

  2022cites this paper
• A Study of Zero-Cost Proxies for Remote Sensing Image Segmentation

  2022cites this paper
• Automatic detection of sow posture and estrus based on convolutional neural network

  2022cites this paper
• Variant Parallelism: Lightweight Deep Convolutional Models for Distributed Inference on IoT Devices

  2022cites this paper
• ViTCoD: Vision Transformer Acceleration via Dedicated Algorithm and Accelerator Co-Design

  2022cites this paper
• A survey: object detection methods from CNN to transformer

  2022cites this paper