DRAW: A Recurrent Neural Network For Image Generation

This paper introduces the Deep Recurrent Attentive Writer (DRAW) neural network architecture for image generation. DRAW networks combine a novel spatial attention mechanism that mimics the foveation of the human eye, with a sequential variational auto-encoding framework that allows for the iterative construction of complex images. The system substantially improves on the state of the art for generative models on MNIST, and, when trained on the Street View House Numbers dataset, it generates images that cannot be distinguished from real data with the naked eye.

• Publication year

  2015

• Venue

  International Conference on Machine Learning

• Publication date

  2015-02-16

• Fields of study

  Computer Science

• Identifiers
  arXiv 1502.04623
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• A Neural Autoregressive Approach to Attention-based Recognition

  2015cited by this paper
• Recurrent Models of Visual Attention

  2014influential reference
• Multiple Object Recognition with Visual Attention

  2014influential reference
• Markov Chain Monte Carlo and Variational Inference: Bridging the Gap

  2014influential reference
• Neural Variational Inference and Learning in Belief Networks

  2014influential reference
• Adam: A Method for Stochastic Optimization

  2014cited by this paper
• Sequence to Sequence Learning with Neural Networks

  2014cited by this paper
• Attention for Fine-Grained Categorization

  2014cited by this paper
• Iterative Neural Autoregressive Distribution Estimator NADE-k

  2014cited by this paper
• Optimizing Neural Networks that Generate Iimages

  2014cited by this paper
• Neural Turing Machines

  2014cited by this paper
• Stochastic Backpropagation and Approximate Inference in Deep Generative Models

  2014cited by this paper
• Generating Sequences With Recurrent Neural Networks

  2013cited by this paper
• Deep AutoRegressive Networks

  2013influential reference
• Multi-digit Number Recognition from Street View Imagery using Deep Convolutional Neural Networks

  2013cited by this paper
• A Deep and Tractable Density Estimator

  2013cited by this paper
• Learning Generative Models with Visual Attention

  2013cited by this paper
• Auto-Encoding Variational Bayes

  2013cited by this paper
• The Neural Autoregressive Distribution Estimator

  2011cited by this paper
• Reading Digits in Natural Images with Unsupervised Feature Learning

  2011influential reference
• Learning Where to Attend with Deep Architectures for Image Tracking

  2011cited by this paper
• Learning to combine foveal glimpses with a third-order Boltzmann machine

  2010cited by this paper
• Deep Boltzmann Machines

  2009influential reference
• Learning Multiple Layers of Features from Tiny Images

  2009influential reference
• On the quantitative analysis of deep belief networks

  2008cited by this paper
• Evaluating probabilities under high-dimensional latent variable models

  2008cited by this paper
• Supporting Online Material for Reducing the Dimensionality of Data with Neural Networks

  2006cited by this paper
• Learning to Forget: Continual Prediction with LSTM

  2000cited by this paper
• Learning where to look

  1999cited by this paper
• Gradient-based learning applied to document recognition

  1998cited by this paper
• Long Short-Term Memory

  1997cited by this paper
• The Helmholtz Machine

  1995cited by this paper

• EyeLayer: Integrating Human Attention Patterns into LLM-Based Code Summarization

  2026cites this paper
• Stroke of Surprise: Progressive Semantic Illusions in Vector Sketching

  2026cites this paper
• ResTok: Learning Hierarchical Residuals in 1D Visual Tokenizers for Autoregressive Image Generation

  2026cites this paper
• An Improved Yolo Algorithm Based on Concise Decoupled Head for Real-Time Object Detection in Night Scenarios

  2026cites this paper
• Tuning the burn-in phase in training recurrent neural networks improves their performance

  2026cites this paper
• Generative Models for Medical Image Creation and Translation: A Scoping Review

  2026cites this paper
• Harnessing Synthetic Data from Generative AI for Statistical Inference

  2026cites this paper
• Pressure pulsation forecasting in pump-turbines via variational mode decomposition and optimized gated recurrent unit-attention network

  2026cites this paper
• From a Single Design to Multiple Variations: AI-Guided in-App Image Generation

  2025cites this paper
• Cascading attention enhancement network for RGB-D indoor scene segmentation

  2025cites this paper
• Indoor Scene Classification Based on Optimized Convolutional Neural Network

  2025cites this paper
• Maximum Likelihood Learning of Latent Dynamics Without Reconstruction

  2025cites this paper
• Recognizing unknowns: a survey on visual open-set recognition

  2025cites this paper
• An overview of neural architectures for self-supervised audio representation learning from masked spectrograms

  2025cites this paper
• A critique of current approaches to privacy in machine learning

  2025influential citation
• A Review of Pedestrian Trajectory Prediction Methods Based on Deep Learning Technology

  2025cites this paper
• Multi-model deep learning-based state of charge estimation for shipboard lithium batteries with feature extraction and Spatio-temporal dependency

  2025cites this paper
• Synthesising activity participations and scheduling with deep generative machine learning

  2025cites this paper
• AIGC-Based Image and Video Generation Method: A Review

  2025cites this paper
• Text-to-Image Generation for Vocabulary Learning Using the Keyword Method

  2025cites this paper
• Beyond Data Augmentations: Generalization Abilities of Few-Shot Segmentation Models

  2025cites this paper
• Exploración del Espacio Latente en la Descarga de Partículas Mediante Autoencoders Entrenados con Simulaciones de Modelos de Elementos Discretos

  2025cites this paper
• Wavelet-based Variational Autoencoders for High-Resolution Image Generation

  2025cites this paper
• Leveraging human-centred AI in interactive English education for generating learning materials

  2025cites this paper
• Long-Term Individual Causal Effect Estimation via Identifiable Latent Representation Learning

  2025cites this paper
• A comparison of latent space modeling techniques in a plain-vanilla autoencoder setting

  2025cites this paper
• Predictive Approaches for 3D‐Printing: Methods and Approaches for Polymeric Materials

  2025cites this paper
• A machine learning prediction framework for damping performance of silicone rubber based on molecular dynamics and VAE-OK data augmentation

  2025cites this paper
• Generative AI in depth: A survey of recent advances, model variants, and real-world applications

  2025cites this paper
• A Literature Review of Federated Learning Algorithms for Load Prediction

  2025cites this paper
• Mechanisms of Projective Composition of Diffusion Models

  2025cites this paper
• ViViMZheimer a slice based end to end model for Alzheimer’s disease diagnosis from 3D MRI

  2025cites this paper
• DRL-EnVar: an adaptive hybrid ensemble–variational data assimilation method based on deep reinforcement learning

  2025cites this paper
• Hierarchical Vector-Quantized Latents for Perceptual Low-Resolution Video Compression

  2025cites this paper
• Attention Mechanisms in Medical Image Analysis: Advance, Challenge, and Future Direction

  2025cites this paper
• Seismic Data Reconstruction Using Generative Adversarial Networks and Global Grouping Mechanism

  2025cites this paper
• Iterative Latent Refinement for Robust Non-Autoregressive Sign Language Production

  2025cites this paper
• Optimizing cavitation fault forecasting in pump-turbine systems through gated recurrent units

  2025cites this paper
• Quantum Generative Adversarial Networks: Development, Application, and Performance Evaluation for Superior Synthetic Data Production

  2025cites this paper
• Exploring Generative Adversarial Networks: Comparative Analysis of Facial Image Synthesis and the Extension of Creative Capacities in Artificial Intelligence

  2025cites this paper
• Leveraging ensemble deep models and llm for visual polysemy and word sense disambiguation

  2025cites this paper
• NeuroFusionNet: cross-modal modeling from brain activity to visual understanding

  2025cites this paper
• Designing ReLU Generative Networks to Enumerate Trees with a Given Tree Edit Distance

  2025cites this paper
• Ksurf-Drone: Attention Kalman Filter for Contextual Bandit Optimization in Cloud Resource Allocation

  2025cites this paper
• A comprehensive overview of Generative AI (GAI): Technologies, applications, and challenges

  2025cites this paper
• Knowledge‐Guided Machine Learning for Operational Flood Forecasting

  2025cites this paper
• Validating Image Captioning Models Using Text-to-Image Algorithms via Generative AI

  2025cites this paper
• RNN‐DAS: A New Deep Learning Approach for Detection and Real‐Time Monitoring of Volcano‐Tectonic Events Using Distributed Acoustic Sensing

  2025cites this paper
• Adaptive patch selection to improve Vision Transformers through Reinforcement Learning

  2025cites this paper
• From traditional algorithms to artificial intelligence: a review of the development of sensory substitution sonification methods

  2025cites this paper
• Unlocking Accurate Diagnoses: The Impact of Deep Learning on Radiology

  2025cites this paper
• Rapid Calibration of High-Performance Wavelength Selective Switches Based on the Few-Shot Transfer Learning

  2025cites this paper
• Exploring Latent Spaces for Generating Challenging Datasets using Variational Autoencoders

  2025cites this paper
• A refined methodology for small object detection: Multi-scale feature extraction and cross-stage feature fusion network

  2025cites this paper
• Continuous Semi-Implicit Models

  2025influential citation
• AttZoom: Attention Zoom for Better Visual Features

  2025cites this paper
• S-VFNet: a siamese object detection method based on salient features and visual features

  2025cites this paper
• Integrative Variational Autoencoders for Generative Modeling of an Image Outcome with Multiple Input Images

  2024cites this paper
• Generation of Images from Text Using AI

  2024cites this paper
• Text2Street: Controllable Text-to-image Generation for Street Views

  2024cites this paper
• DSSO-YOLO: A fast detection model for densely stacked small object

  2024cites this paper
• Recent Advances in Digital Image and Video Forensics, Anti-forensics and Counter Anti-forensics

  2024cites this paper
• Multi-scale dense spatially-adaptive residual distillation network for lightweight underwater image super-resolution

  2024cites this paper
• Self-Attention Generative Adversarial Network Interpolating and Denoising Seismic Signals Simultaneously

  2024cites this paper
• Recurrent neural network based on attention mechanism in prediction of glass forming ability by element proportion

  2024cites this paper
• A Statistical Analysis of Wasserstein Autoencoders for Intrinsically Low-dimensional Data

  2024cites this paper
• Contextual Feedback Loops: Amplifying Deep Reasoning with Iterative Top-Down Feedback

  2024cites this paper
• Any-Resolution AI-Generated Image Detection by Spectral Learning

  2024cites this paper
• Using lightweight method to detect landslide from satellite imagery

  2024cites this paper
• Performance Evaluation of UFMC System using Neural Networks for BER Prediction and Efficiency Optimization

  2024cites this paper
• MT-RAM: Multi Task-Recurrent Attention Model for partially observable image anomaly classification and localization

  2024cites this paper
• A Review of Bayesian Uncertainty Quantification in Deep Probabilistic Image Segmentation

  2024cites this paper
• Service Level Prediction in Non-Markovian Nonstationary Queues: A Simulation-Based Deep Learning Approach

  2024cites this paper
• Level of agreement between emotions generated by Artificial Intelligence and human evaluation: a methodological proposal

  2024cites this paper
• Subspace-Aided SIR Approach with Application to Indicator Diagram Estimation of BPUs

  2024cites this paper
• Application of deep learning models to generate rich, dynamic and production-like test data

  2024cites this paper
• Evolution of Detection Performance throughout the Online Lifespan of Synthetic Images

  2024cites this paper
• Affinity-Driven Transfer Learning for Load Forecasting

  2024cites this paper
• Exploring the Effectiveness of Object-Centric Representations in Visual Question Answering: Comparative Insights with Foundation Models

  2024cites this paper
• Progressive Pretext Task Learning for Human Trajectory Prediction

  2024cites this paper
• A Network Based Approach for Unbalanced Optimal Transport on Surfaces

  2024cites this paper
• Wafer defect pattern recognition based on differentiable architecture search with dual attention module

  2024cites this paper
• A Feature Fusion-Based ResNet Using the Pooling Pyramid for Age Estimation

  2024cites this paper
• Face Mask Removal with Region-attentive Face Inpainting

  2024cites this paper
• Adversarial Text to Continuous Image Generation

  2024cites this paper
• Unsupervised Representation Learning using Wasserstein Generative Adversarial Network

  2024cites this paper
• Variational autoencoder-driven adversarial SVDD for power battery anomaly detection on real industrial data

  2024cites this paper
• FTASD - A Fine Tuning Approach for Stable Diffusion Models

  2024cites this paper
• CART: Compositional Auto-Regressive Transformer for Image Generation

  2024cites this paper
• Artificial intelligence in music: recent trends and challenges

  2024cites this paper
• DisGAN: Distance-Aware Generative Adversarial Network for Diverse Image Generation

  2024cites this paper
• Procedural Content Generation in Games: A Survey with Insights on Emerging LLM Integration

  2024cites this paper
• Generating African Artistic Styles Using Textual Inversion

  2024cites this paper
• A Decade of Deep Learning: A Survey on The Magnificent Seven

  2024cites this paper
• TRIP: Trainable Region-of-Interest Prediction for Hardware-Efficient Neuromorphic Processing on Event-Based Vision

  2024cites this paper
• Multi-scale image compression and reconstruction algorithm for structural health monitoring system

  2024cites this paper
• Generative adversarial networks-based AI-generated imagery authentication using frequency domain analysis

  2024cites this paper
• Pyramid Convolutional Recurrent Network for Serial Medical Image Registration With Adaptive Motion Regularizations

  2024cites this paper
• Evaluating Machine Learning Models for Multimodal Probability-Based Energy Forecasting

  2024cites this paper
• Adaptation of an alternative neural network instead of ANN for backcalculating pavement layer moduli

  2024cites this paper