When Location Meets Social Multimedia

Coming with the popularity of multimedia sharing platforms such as Facebook and Flickr, recent years have witnessed an explosive growth of geographical tags on social multimedia content. This trend enables a wide variety of emerging applications, for example, mobile location search, landmark recognition, scene reconstruction, and touristic recommendation, which range from purely research prototype to commercial systems. In this article, we give a comprehensive survey on these applications, covering recent advances in recognition and mining of geographical-aware social multimedia. We review related work in the past decade regarding to location recognition, scene summarization, tourism suggestion, 3D building modeling, mobile visual search and city navigation. At the end, we further discuss potential challenges, future topics, as well as open issues related to geo-social multimedia computing, recognition, mining, and analytics.

• Publication year

  2015

• Venue

  ACM Transactions on Intelligent Systems and Technology

• Publication date

  2015-03-11

• Fields of study

  Geography, Computer Science

• Identifiers
  DOI 10.1145/2597181
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• The Travel Guide

  2013cited by this paper
• Geographical Retagging

  2013influential reference
• Cluster-Based Landmark and Event Detection for Tagged Photo Collections

  2011cited by this paper
• Mining flickr landmarks by modeling reconstruction sparsity

  2011cited by this paper
• Multi-view Landmark Recognition in Large-scale Image Collections

  2011cited by this paper
• W2Go: a travel guidance system by automatic landmark ranking

  2010cited by this paper
• Geotagging in multimedia and computer vision—a survey

  2010cited by this paper
• Mining Regional Representative Photos from Consumer-Generated Geotagged Photos

  2010cited by this paper
• Inferring photographic location using geotagged web images

  2010cited by this paper
• Image-based Localization in Urban Environments

  2010cited by this paper
• Location sensitive indexing for image-based advertising

  2009cited by this paper
• Robust Face Recognition via Sparse Representation

  2009cited by this paper
• Image-based street-side city modeling

  2009cited by this paper
• From structure-from-motion point clouds to fast location recognition

  2009cited by this paper
• Landmark classification in large-scale image collections

  2009cited by this paper
• Enhancing semantic and geographic annotation of web images via logistic canonical correlation regression

  2009cited by this paper
• Tour the world: Building a web-scale landmark recognition engine

  2009influential reference
• Latent Dirichlet Allocation

  2009cited by this paper
• Vocabulary hierarchy optimization for effective and transferable retrieval

  2009cited by this paper
• Mapping the world's photos

  2009cited by this paper
• Image sequence geolocation with human travel priors

  2009influential reference
• Mining city landmarks from blogs by graph modeling

  2009influential reference
• Pagerank for product image search

  2008cited by this paper
• Geo-located image analysis using latent representations

  2008cited by this paper
• IM2GPS: estimating geographic information from a single image

  2008influential reference
• Estimating landmark locations from geo-referenced photographs

  2008cited by this paper
• Understanding individual human mobility patterns

  2008cited by this paper
• Learning transportation mode from raw gps data for geographic applications on the web

  2008cited by this paper
• Structuring Visual Words in 3D for Arbitrary-View Object Localization

  2008cited by this paper
• Image super-resolution as sparse representation of raw image patches

  2008cited by this paper
• Unified Loop Closing and Recovery for Real Time Monocular SLAM

  2008cited by this paper
• Image-Based Information Guide on Mobile Devices

  2008cited by this paper
• City-Scale Location Recognition

  2007influential reference
• Joint Optimization of Cascaded Classifiers for Computer Aided Detection

  2007cited by this paper
• A contextual dissimilarity measure for accurate and efficient image search

  2007cited by this paper
• Adaptive Vocabulary Forests br Dynamic Indexing and Category Learning

  2007cited by this paper
• Toward A Discriminative Codebook: Codeword Selection across Multi-resolution

  2007cited by this paper
• Object retrieval with large vocabularies and fast spatial matching

  2007cited by this paper
• Segmentation of Multivariate Mixed Data via Lossy Data Coding and Compression

  2007cited by this paper
• Sharing, Discovering and Browsing Geotagged Pictures on the World Wide Web

  2007cited by this paper
• How flickr helps us make sense of the world: context and content in community-contributed media collections

  2007cited by this paper
• Segmentation of multivariate mixed data via lossy coding and compression

  2007cited by this paper
• Scene Summarization for Online Image Collections

  2007influential reference
• Evaluating bag-of-visual-words representations in scene classification

  2007cited by this paper
• Discovering Authoritative News Sources and Top News Stories

  2006cited by this paper
• The scaling laws of human travel

  2006cited by this paper
• Towards Urban 3D Reconstruction from Video

  2006cited by this paper
• Photo-to-Search: Using Camera Phones to Inquire of the Surrounding World

  2006cited by this paper
• For most large underdetermined systems of equations, the minimal 𝓁1‐norm near‐solution approximates the sparsest near‐solution

  2006cited by this paper
• Image Based Localization in Urban Environments

  2006cited by this paper
• Photo tourism: exploring photo collections in 3D

  2006influential reference
• Analysis of Representations for Domain Adaptation

  2006cited by this paper
• Scalable Recognition with a Vocabulary Tree

  2006influential reference
• VirtualTour: an online travel assistant based on high quality images

  2006cited by this paper
• Web-based 3D Reconstruction Service

  2006cited by this paper
• Approximate Correspondences in High Dimensions

  2006cited by this paper
• Building Detection from Mobile Imagery Using Informative SIFT Descriptors

  2005cited by this paper
• A Bayesian hierarchical model for learning natural scene categories

  2005cited by this paper
• Local features for object class recognition

  2005cited by this paper
• Creating efficient codebooks for visual recognition

  2005cited by this paper
• Extent: Inferring Image Metadata from Context and Content

  2005cited by this paper
• Multiple view geometry

  2005cited by this paper
• Detecting geographic locations from web resources

  2005cited by this paper
• Combination of content analysis and context features for digital photograph retrieval.

  2005cited by this paper
• Searching the Web with mobile images for location recognition

  2004cited by this paper
• Information Theory, Inference, and Learning Algorithms

  2004cited by this paper
• Forecast and control of epidemics in a globalized world.

  2004cited by this paper
• Distinctive Image Features from Scale-Invariant Keypoints

  2004cited by this paper
• Unsupervised Learning by Probabilistic Latent Semantic Analysis

  2004cited by this paper
• Fast wide baseline matching for visual navigation

  2004cited by this paper
• Robust wide-baseline stereo from maximally stable extremal regions

  2004cited by this paper
• Interactive design of multi-perspective images for visualizing urban landscapes

  2004cited by this paper
• IDeixis - Searching the Web with Mobile Images for Location-Based Information

  2004cited by this paper
• An Image-Based System for Urban Navigation

  2004cited by this paper
• HPAT Indexing for Fast Object/Scene Recognition Based on Local Appearance

  2003cited by this paper
• InfoXtract location normalization: a hybrid approach to geographic references in information extraction

  2003cited by this paper
• Video Google: a text retrieval approach to object matching in videos

  2003cited by this paper
• Approaches to Large-Scale Urban Modeling

  2003cited by this paper
• Latent Dirichlet Allocation

  2003cited by this paper
• Location Normalization for Information Extraction

  2002cited by this paper
• From images to 3D models

  2002cited by this paper
• Multiple View Geometry in Computer Vision

  2001cited by this paper
• Model Based Population Tracking and Automatic Detection of Distribution Changes

  2001cited by this paper
• Representing and Recognizing the Visual Appearance of Materials using Three-dimensional Textons

  2001cited by this paper
• Calibrated, Registered Images of an Extended Urban Area

  2001cited by this paper
• Multilingual Topic Detection and Tracking: Successful Research Enabled by Corpora and Evaluation

  2000cited by this paper
• A Linear Programming Approach to Novelty Detection

  2000cited by this paper
• Exploiting Geographical Location Information of Web Pages

  1999cited by this paper
• Authoritative sources in a hyperlinked environment

  1999cited by this paper
• Multiple View Geometry

  1999cited by this paper
• Bundle Adjustment - A Modern Synthesis

  1999cited by this paper
• Self-Calibration and Metric Reconstruction Inspite of Varying and Unknown Intrinsic Camera Parameters

  1999cited by this paper
• A Multi-Frame Structure-from-Motion Algorithm under Perspective Projection

  1999cited by this paper
• The Anatomy of a Large-Scale Hypertextual Web Search Engine

  1998cited by this paper
• Self-calibration and metric reconstruction in spite of varying and unknown internal camera parameters

  1998cited by this paper
• Discovery of Frequent Episodes in Event Sequences

  1997cited by this paper
• Regression Shrinkage and Selection via the Lasso

  1996cited by this paper
• Modeling and rendering architecture from photographs: a hybrid geometry- and image-based approach

  1996cited by this paper
• Near Neighbor Search in Large Metric Spaces

  1995influential reference
• An open architecture for collaborative filtering of netnews

  1994cited by this paper

• Leveraging tourist trajectory data for effective destination planning and management: A new heuristic approach

  2022cites this paper
• MISGD: Moving-Information-Based Stochastic Gradient Descent Paradigm for Personalized Fuzzy Recommender Systems

  2021cites this paper
• Dynamic Iranian Sign Language Recognition Using an Optimized Deep Neural Network: An Implementation via a Robotic-Based Architecture

  2021cites this paper
• Urban Traffic Monitoring from Mobility Data

  2021cites this paper
• A Multi-Task Sequential State Model for the Human Trajectory Data Understanding

  2021cites this paper
• New trends in influence maximization models

  2021cites this paper
• (2+1)D-SLR: an efficient network for video sign language recognition

  2021cites this paper
• Human-Computer Interaction System for Improving Digital Literacy Among Speech- and Hearing-Impaired in Developing Countries

  2021cites this paper
• Digital Garbage Bin Monitoring System (DGBMS)

  2021cites this paper
• Analysing environmental impact of large-scale events in public spaces with cross-domain multimodal data fusion

  2021cites this paper
• Managing the Fourth Industrial Revolution: A Competence Framework for Smart Factory

  2021cites this paper
• Application of Computer Big Data in Internet Learning

  2021cites this paper
• Trajectory similarity measurement: An enhanced maximal travel match method

  2021cites this paper
• Risk Data Analysis of Cross Border E-commerce Transactions Based on Data Mining

  2021cites this paper
• Convolutional LSTM based transportation mode learning from raw GPS trajectories

  2020cites this paper
• Personalized travel route recommendation algorithm based on improved genetic algorithm

  2020cites this paper
• Vision-based Hand Gesture Recognition for Indian Sign Language Using Convolution Neural Network

  2020cites this paper
• Artificial intelligence and big data in tourism: a systematic literature review

  2020cites this paper
• Efficient structure from motion for large-scale UAV images: A review and a comparison of SfM tools

  2020cites this paper
• Perceiving spatiotemporal traffic anomalies from sparse representation-modeled city dynamics

  2020cites this paper
• RETRACTED ARTICLE: Data mining technology of computer testing system for intelligent machining

  2020cites this paper
• AIS Ship Trajectory Clustering Based on Convolutional Auto-encoder

  2020cites this paper
• Segmentation Optimization in Trajectory-Based Ship Classification

  2020cites this paper
• Deep learning-assisted comparative analysis of animal trajectories with DeepHL

  2020cites this paper
• Discovery of Chasing Patterns in Trajectory Data

  2020cites this paper
• A multi-valued and sequential-labeled decision tree method for recommending sequential patterns in cold-start situations

  2020cites this paper
• Gradient flow-based deep residual networks for enhancing visibility of scenery images degraded by foggy weather conditions

  2020cites this paper
• Salsa dance learning evaluation and motion analysis in gamified virtual reality environment

  2020cites this paper
• Biomedical REAl-Time Health Evaluation (BREATHE): toward an mHealth informatics platform

  2020cites this paper
• Data Mining Approach to Poincaré Maps in Multi-Body Trajectory Design.

  2020cites this paper
• Detecting Pattern Changes in Individual Travel Behavior from Vehicle GPS/GNSS Data

  2020cites this paper
• Visualization of Folk-Dances in Virtual Reality Environments

  2020cites this paper
• Semantic Trajectories Data Models

  2020cites this paper
• Automated digital cause-and-effect diagrams to assist causal analysis in problem-solving: a data-driven approach

  2020cites this paper
• Detection and analysis: driver state with electrocardiogram (ECG)

  2020cites this paper
• Discovery of Important Location from Massive Trajectory Data Based on Mediation Matrix

  2019cites this paper
• Exploration of artistic creation of Chinese ink style painting based on deep learning framework and convolutional neural network model

  2019cites this paper
• Codebook-Free Compact Descriptor for Scalable Visual Search

  2019cites this paper
• Using Multi-objective Optimization to Solve the Long Tail Problem in Recommender System

  2019cites this paper
• Mining Habitual User Choices from Google Maps History Logs

  2019cites this paper
• Semantic enrichment of spatio-temporal trajectories for worker safety on construction sites

  2019cites this paper
• Research on big data mining based on improved parallel collaborative filtering algorithm

  2019cites this paper
• Movie genome: alleviating new item cold start in movie recommendation

  2019cites this paper
• Algorithms Research of the Illegal Gas Station Discovery Based on Vehicle Trajectory Data

  2019cites this paper
• Applications of Deep Learning in Healthcare and Biomedicine

  2019cites this paper
• Hybrid route recommendation with taxi and shared bicycles

  2019cites this paper
• Regularized super-resolution restoration algorithm for single medical image based on fuzzy similarity fusion

  2019cites this paper
• MCSM-Wri: A Small-Scale Motion Recognition Method Using WiFi Based on Multi-Scale Convolutional Neural Network

  2019cites this paper
• Shop floor data-driven spatial–temporal verification for manual assembly planning

  2019cites this paper
• A Heterogeneous Domain Adversarial Neural Network for Trans-Domain Behavioral Targeting

  2019cites this paper
• A Pseudo-likelihood Approach for Geo-localization of Events from Crowd-sourced Sensor-Metadata

  2019cites this paper
• SMART: A Service-Oriented Statistical Analysis Framework on Spatio-Temporal Big Data (Short Paper)

  2019cites this paper
• An expert recommendation algorithm based on Pearson correlation coefficient and FP-growth

  2019cites this paper
• A Next Location Predicting Approach Based on a Recurrent Neural Network and Self-attention

  2019cites this paper
• An overview on trajectory outlier detection

  2019cites this paper
• Crowdsourcing Urban Issues in Smart Cities: A Usability Assessment of the Crowd4City System

  2019cites this paper
• Task Allocation in Eco-friendly Mobile Crowdsensing: Problems and Algorithms

  2019cites this paper
• Privacy preserving semantic trajectory data publishing for mobile location-based services

  2019cites this paper
• Non-negative matrix factorization for implicit aspect identification

  2019cites this paper
• NextRoute: a lossless model for accurate mobility prediction

  2019cites this paper
• Robust 3D point cloud registration based on bidirectional Maximum Correntropy Criterion

  2018cites this paper
• Cluster-based trajectory segmentation with local noise

  2018cites this paper
• Convolutional Neural Network-Based Action Recognition on Depth Maps

  2018cites this paper
• Efficient and scalable execution of smart city parallel applications

  2018cites this paper
• Measuring the Spatio-Temporal Similarity Between Users

  2018cites this paper
• Opportunities and Risks of Delegating Sensing Tasks to the Crowd

  2018cites this paper
• HESAVE: An Approach for Online Heuristic GPS Trajectory Sampling

  2018cites this paper
• From Web to Physical and Back: WP User Profiling with Deep Learning

  2018cites this paper
• A Survey on Vision-Based Hand Gesture Recognition

  2018cites this paper
• Task Assignment for Semi-opportunistic Mobile Crowdsensing

  2018cites this paper
• Medical Alert System Using Social Data

  2018cites this paper
• Anomaly Detection via Trajectory Representation

  2018cites this paper
• Storing and Handling Complex Content for Large-scale Data

  2018cites this paper
• Movement-based co-creation of adaptive architecture

  2018cites this paper
• Geocoding and Reverse Geocoding

  2018cites this paper
• Factored Item Similarity and Bayesian Personalized Ranking for Recommendation with Implicit Feedback

  2018cites this paper
• Digitization and Visualization of Movements of Slovak Folk Dances

  2018cites this paper
• Big Data for Sustainable Urban Transport

  2018cites this paper
• Trajectory segment selection with limited budget in mobile crowd sensing

  2017cites this paper
• Three little-known and yet still significant contributions of Lloyd Shapley

  2017cites this paper
• Applying mobile phone data to travel behaviour research: A literature review

  2017cites this paper
• A convolutional neural network based feature learning and fault diagnosis method for the condition monitoring of gearbox

  2017cites this paper
• Online classification of frequent behaviours based on multidimensional trajectories

  2017cites this paper
• Research on Ship Classification Based on Trajectory Features

  2017cites this paper
• Mobile cloud computing with voltage scaling and data compression

  2017cites this paper
• Nighttime image Dehazing with modified models of color transfer and guided image filter

  2017cites this paper
• Benchmarking Harp-DAAL: High Performance Hadoop on KNL Clusters

  2017cites this paper
• A Thorough Review of Big Data Sources and Sets Used in Transportation Research

  2017cites this paper
• Unsupervised event exploration from social text streams

  2017cites this paper
• Fine-Grained Urban Event Detection and Characterization Based on Tensor Cofactorization

  2017cites this paper
• ! "

  2017cites this paper
• Teetool -- a probabilistic trajectory analysis tool

  2017cites this paper
• Inferring Follower Preferences in the 2016 U.S. Presidential Primaries with Sparse Learning

  2017cites this paper
• DTRP: A Flexible Deep Framework for Travel Route Planning

  2017cites this paper
• A Large-Scale Visual Check-In System for TV Content-Aware Web with Client-Side Video Analysis Offloading

  2017cites this paper
• Using 3D face priors for depth recovery

  2017cites this paper
• Recommending a personalized sequence of pick-up points

  2017cites this paper
• The seaport service rate prediction system: Using drayage truck trajectory data to predict seaport service rates

  2017cites this paper
• A new recommendation algorithm combined with spectral clustering and transfer learning

  2017cites this paper
• On Combining Social Media and Spatial Technology for POI Cognition and Image Localization

  2017cites this paper