TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems

TensorFlow is an interface for expressing machine learning algorithms, and an implementation for executing such algorithms. A computation expressed using TensorFlow can be executed with little or no change on a wide variety of heterogeneous systems, ranging from mobile devices such as phones and tablets up to large-scale distributed systems of hundreds of machines and thousands of computational devices such as GPU cards. The system is flexible and can be used to express a wide variety of algorithms, including training and inference algorithms for deep neural network models, and it has been used for conducting research and for deploying machine learning systems into production across more than a dozen areas of computer science and other fields, including speech recognition, computer vision, robotics, information retrieval, natural language processing, geographic information extraction, and computational drug discovery. This paper describes the TensorFlow interface and an implementation of that interface that we have built at Google. The TensorFlow API and a reference implementation were released as an open-source package under the Apache 2.0 license in November, 2015 and are available at www.tensorflow.org.

• Publication year

  2016

• Venue

  arXiv.org

• Publication date

  2016-03-14

• Fields of study

  Computer Science, Engineering

• Identifiers
  arXiv 1603.04467
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Pointer Networks

  2015influential reference
• Massively Multitask Networks for Drug Discovery

  2015cited by this paper
• Massively Parallel Methods for Deep Reinforcement Learning

  2015cited by this paper
• Large-scale cluster management at Google with Borg

  2015cited by this paper
• Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift

  2015cited by this paper
• Pedestrian detection with a Large-Field-Of-View deep network

  2015cited by this paper
• Frame-by-frame language identification in short utterances using deep neural networks

  2015cited by this paper
• One weird trick for parallelizing convolutional neural networks

  2014cited by this paper
• Caffe: Convolutional Architecture for Fast Feature Embedding

  2014cited by this paper
• Project Adam: Building an Efficient and Scalable Deep Learning Training System

  2014cited by this paper
• Grammar as a Foreign Language

  2014cited by this paper
• Move Evaluation in Go Using Deep Convolutional Neural Networks

  2014cited by this paper
• Sequence to Sequence Learning with Neural Networks

  2014cited by this paper
• cuDNN: Efficient Primitives for Deep Learning

  2014cited by this paper
• An introduction to computational networks and the computational network toolkit (invited talk)

  2014cited by this paper
• Large-Scale Video Classification with Convolutional Neural Networks

  2014cited by this paper
• Going deeper with convolutions

  2014cited by this paper
• Multiple Object Recognition with Visual Attention

  2014cited by this paper
• On rectified linear units for speech processing

  2013cited by this paper
• Dandelion: a compiler and runtime for heterogeneous systems

  2013cited by this paper
• Multilingual acoustic models using distributed deep neural networks

  2013cited by this paper
• Naiad: a timely dataflow system

  2013influential reference
• Efficient Estimation of Word Representations in Vector Space

  2013cited by this paper
• Halide: a language and compiler for optimizing parallelism, locality, and recomputation in image processing pipelines

  2013cited by this paper
• Multi-digit Number Recognition from Street View Imagery using Deep Convolutional Neural Networks

  2013cited by this paper
• DeViSE: A Deep Visual-Semantic Embedding Model

  2013cited by this paper
• Large Scale Distributed Deep Networks

  2012cited by this paper
• Deep Neural Networks for Acoustic Modeling in Speech Recognition: The Shared Views of Four Research Groups

  2012cited by this paper
• Resilient Distributed Datasets: A Fault-Tolerant Abstraction for In-Memory Cluster Computing

  2012cited by this paper
• Hogwild: A Lock-Free Approach to Parallelizing Stochastic Gradient Descent

  2011cited by this paper
• Building high-level features using large scale unsupervised learning

  2011cited by this paper
• CIEL: A Universal Execution Engine for Distributed Data-Flow Computing

  2011cited by this paper
• FlumeJava: easy, efficient data-parallel pipelines

  2010cited by this paper
• Dryad: distributed data-parallel programs from sequential building blocks

  2007cited by this paper
• The mnist database of handwritten digits

  2005cited by this paper
• Torch: a modular machine learning software library

  2002cited by this paper
• Long Short-Term Memory

  1997cited by this paper
• Global code motion/global value numbering

  1995cited by this paper
• A set of level 3 basic linear algebra subprograms

  1990cited by this paper
• Annual review of computer science: vol. 3, 1988

  1988cited by this paper
• Executing a Program on the MIT Tagged-Token Dataflow Architecture

  1987cited by this paper
• Learning representations by back-propagating errors

  1986cited by this paper

• Computability of Agentic Systems

  2026cites this paper
• Deep learning models used to detect fish movement over resistivity counters

  2026cites this paper
• Holocene Evolution of Saharan Vegetation Revealed by Paleoclimate Simulations and Machine Learning

  2026cites this paper
• Sheep Face Identification Using Multi-Model Deep Learning Evaluation and Ensemble Learning.

  2026cites this paper
• LXIE-Net and HLXray: A Mamba-Based Network and Real-World Dataset for Low-Dose X-Ray Image Enhancement in Industrial Inspection

  2026cites this paper
• A Two-Stage GPU Kernel Tuner Combining Semantic Refactoring and Search-Based Optimization

  2026cites this paper
• Enhancing structure-based virtual screening of MDM2–p53 inhibitors: a benchmark of machine learning vs. traditional docking scoring functions

  2026cites this paper
• On Sequence-to-Sequence Models for Automated Log Parsing

  2026influential citation
• A Multi‐Level Acceleration Scheme for AI Model Training on ARM Architecture Processors

  2026cites this paper
• How much EEG is needed for deep learning with convolutional neural networks? Predicting the benefit from additional data

  2026influential citation
• Unified Unbiased Variance Estimation for MMD: Robust Finite-Sample Performance with Imbalanced Data and Exact Acceleration under Null and Alternative Hypotheses

  2026cites this paper
• Deep Dive into the Abuse of DL APIs To Create Malicious AI Models and How to Detect Them

  2026cites this paper
• Deep learning models for efficient geotechnical predictions: reducing training effort and data requirements with transfer learning

  2026cites this paper
• Explaining transformer-based classification of radiology reports

  2026cites this paper
• Language biomarker screening using AI: a transdiagnostic approach to the brain

  2026cites this paper
• The Comparison of Human and Machine Performance in Object Recognition

  2026influential citation
• Using Artificial Neural Networks to Relate External Sensory Features to Internal Decisional Evidence

  2026cites this paper
• Optimizing Training Time in Deep Learning Models Using Distributed Computing Techniques

  2026cites this paper
• RLGT: A reinforcement learning framework for extremal graph theory

  2026cites this paper
• Autoencoder-based framework for anomaly detection in stellar spectra: application to the MaNGA Stellar Library

  2026cites this paper
• ExoFILT: Transfer learning for robust and accelerated analysis of exocytosis single-particle tracking data

  2026influential citation
• Leveraging Squeeze Aggregation Excitation and Positional Encoding in ResNet‐50 for Rice Leaf Disease Classification

  2026cites this paper
• Evaluating hyperparameter transferability in unsupervised anomaly detection for smart home environments

  2026cites this paper
• On the Expressive Power of Floating-Point Transformers

  2026cites this paper
• OpFML: Pipeline for ML-based Operational Forecasting

  2026cites this paper
• GEMS-GER: a machine learning benchmark dataset of long-term groundwater levels in Germany with meteorological forcings and site-specific environmental features

  2026cites this paper
• Sentinel-1 SAR-based globally distributed co-seismic landslide detection by deep neural networks

  2026cites this paper
• Benchmark of plankton images classification: emphasizing features extraction over classifier complexity

  2026influential citation
• Performance Assessment of DL for Network Intrusion Detection on a Constrained IoT Device

  2026cites this paper
• Voice-driven Parkinson’s detection using bidirectional long short-term memory and attention on mobile-recorded speech

  2026cites this paper
• Deep Learning Detection on Multi-Antenna Quantize-Forward Relay Channel Based on Maximum Likelihood

  2026cites this paper
• Mitigation of the time-lag issue in LSTM-based significant wave height prediction using long-term (1984–2023) ERA5 dataset

  2026cites this paper
• From differentiable modeling to system optimization: the full journey using geometric algebra exemplarily applied to improve light sectioning systems

  2026cites this paper
• C-SIMD: CORDIC-Driven SIMD Processing Element for Resource-Efficient Multi-Precision Deep Learning Inference

  2026influential citation
• Meta-learning Hybrid Spiking networks as physics-based nonlinear solvers for physical simulations

  2026cites this paper
• Robust baseball pitch reconstruction using artificial neural networks with noisy data

  2026cites this paper
• Improving Generalization and Uncertainty Quantification of Photometric Redshift Models

  2026cites this paper
• Predicting Atmospheric Effective Sound Speed Using Synthetic Infrasound and Machine Learning

  2026cites this paper
• Deep Learning Methods for Assessing Time‐Variant Nonlinear Signatures in Clutter Echoes

  2026cites this paper
• Inferring Exoplanet Parameters from Transit Timing Variations Using LSTM Networks

  2026cites this paper
• Asthma identification through multimodal data fusion: towards reliable clinical decision support

  2026cites this paper
• Automated Identification of Stylolites in Geological Whole-Core Images using Hybrid Deep Learning Networks

  2026cites this paper
• Scalability of Predictive Models on Multi-Core CPUs and GPUs: An Empirical Analysis

  2026cites this paper
• A Fast Generative Framework for High-dimensional Posterior Sampling: Application to CMB Delensing

  2026influential citation
• Towards reliable forgery detection techniques for remote sensing images: Parametric evaluation and open challenges

  2026cites this paper
• Unified Unbiased Variance Estimation for Maximum Mean Discrepancy: Robust Finite-Sample Performance with Imbalanced Data and Exact Acceleration under Null and Alternative Hypotheses

  2026cites this paper
• Subtracting and Monitoring Tilt-to-length Noise under High Differential Wavefront Sensing Noise Using Convolutional Neural Networks and Time Delay Interferometry

  2026cites this paper
• Bridging machine learning and water electrolysis: Concepts, methods, and perspectives

  2026cites this paper
• Clinical validation of lightweight CNN architectures for reliable multi-class classification of lung cancer using histopathological imaging techniques

  2026cites this paper
• Energy reconstruction of non-fiducial electron-positron events in the DAMPE experiment using convolutional neural networks

  2025cites this paper
• RESTRAIN: Reinforcement Learning-Based Secure Framework for Trigger-Action IoT Environment

  2025cites this paper
• Tools for unbinned unfolding

  2025cites this paper
• Cross-platform metabolomics imputation using importance-weighted autoencoders

  2025cites this paper
• Bayesian-optimized ensemble deep learning models for demand forecasting in the volatile situations: A case study of grocery demand during Covid-19 outbreaks

  2025cites this paper
• Deep Learning-Enhanced 3D Imaging Unveils Semaglutide Impact on Cardiac Fibrosis

  2025cites this paper
• Real Time Data Processing and Analysis in MIS: Challenges and Solutions

  2025cites this paper
• miRNA-Based Diagnosis of Schizophrenia Using Machine Learning

  2025cites this paper
• Improving of intelligent decision support systems for planning a balanced diet

  2025cites this paper
• ASTGSleep: Attention-Based Spatial–Temporal Graph Network for Sleep Staging

  2025cites this paper
• A multi-dilated convolution network for speech emotion recognition

  2025cites this paper
• Numerical study on hyper parameter settings for neural network approximation to partial differential equations

  2025cites this paper
• Joint Optimization of Channel Bonding and Transmit Power Using Optimized Actor–Critic Deep Reinforcement Learning for Wireless Networks

  2025influential citation
• Evaluation of Ground-Based Upward-Looking Microwave Radiometer Brightness Temperature Observations and Assessment of Machine Learning-Based Methods for Retrieving Atmospheric Profiles and Their Application for Studying the Evolution of the Atmospheric Boundary Layer

  2025cites this paper
• Engineering highly active nuclease enzymes with machine learning and high-throughput screening.

  2025cites this paper
• Reanalysis and Forecasting of Total Water Storage and Hydrological States by Combining Machine Learning With CLM Model Simulations and GRACE Data Assimilation

  2025influential citation
• Deep Learning Using Path Length Prediction for Internet of Things

  2025cites this paper
• Enhanced Food Demand Forecasting Using NARX Neural Networks

  2025cites this paper
• Automatic Detect Incorrect Lifting Posture with the Pose Estimation Model

  2025influential citation
• Revisiting the In-Network Aggregation in Distributed Machine Learning

  2025cites this paper
• Sudden cardiac arrest prediction via deep learning electrocardiogram analysis

  2025cites this paper
• Enhancing Bilingual Lexicon Induction with Dynamic Translation

  2025cites this paper
• Human Guided Learning of Transparent Regression Models

  2025cites this paper
• An observational estimate of Arctic UV-absorbing aerosol direct radiative forcing on instantaneous and climatic scales

  2025cites this paper
• DRANet: Deep Learning-Based Automatic White Balancing Approach to CVCC

  2025cites this paper
• FedTune-SGM: A Stackelberg-Driven Personalized Federated Learning Strategy for Edge Networks

  2025cites this paper
• Efficient Hybrid Amplitude-Phase Quantization for Multi-Antenna Relay System

  2025cites this paper
• Machine and deep learning to predict viral fusion peptides

  2025cites this paper
• A Multi-source Precipitation Data Fusion Model for Qinghai Province Based on 3D CNN and Bidirectional ConvLSTM

  2025cites this paper
• Classifying spectra of emission-line regions with neural networks. An application to integral field spectroscopic data of M33

  2025influential citation
• Dynamic Algorithmic Configuration for Enhanced Malware Detection

  2025cites this paper
• AtheroRisk: An Integrated Computer Software System for Stroke Risk Stratification Utilizing Carotid Plaque Analysis in Ultrasound Videos

  2025cites this paper
• Recurrent Neural Network/Machine Learning Predictions of Reactive Channels in H+ + C2H4 at ELab = 30 eV: A Prototype of Ion Cancer Therapy Reactions

  2025influential citation
• Investigations on higher-order spherical harmonic input features for deep learning-based multiple speaker detection and localization

  2025cites this paper
• Exploring the role of acylated ghrelin and gut microbiome in delineating cognitive health in the elderly

  2025cites this paper
• Tuning the cosmic instrument: robust cosmology through combined probes

  2025cites this paper
• KubePipe: a container-based high-level parallelization tool for scalable machine learning pipelines

  2025cites this paper
• Stochastic variational inference improves quantification of multiple timepoint arterial spin labelling perfusion MRI

  2025cites this paper
• Frontier molecular orbital weighted model based networks for revealing organic delayed fluorescence efficiency

  2025cites this paper
• Classification of schizophrenia, bipolar disorder and major depressive disorder with comorbid traits and deep learning algorithms

  2025influential citation
• Prediction of traffic time using XGBoost model with hyperparameter optimization

  2025cites this paper
• Machine Learning Fleet Efficiency: Analyzing and Optimizing Large-Scale Google TPU Systems with ML Productivity Goodput

  2025cites this paper
• Minima Possible Weights: A Homogenous Deep Ensemble Method for Cross-Subject Motor Imagery Classification

  2025cites this paper
• Macrophage memory emerges from coordinated transcription factor and chromatin dynamics.

  2025cites this paper
• Parallelization of Recurrent Neural Network training algorithm with implicit aggregation on multi-core architectures

  2025cites this paper
• Deep Learning for Wound Tissue Segmentation: A Comprehensive Evaluation using A Novel Dataset

  2025cites this paper
• Context-Aware Lifelong Sequential Modeling for Online Click-Through Rate Prediction

  2025cites this paper
• A Smooth Transition Between Induction and Deduction: Fast Abductive Learning Based on Probabilistic Symbol Perception

  2025cites this paper
• An Improved Convolutional Neural Networks: Quantum Pseudo-Transposed Convolutional Neural Networks

  2025cites this paper
• Geochemistry and machine learning: methods and benchmarking

  2025influential citation
• Deep Learning-Based Molecular Fingerprint Prediction for Metabolite Annotation

  2025cites this paper