Clustering and sharing incentives in BitTorrent systems

Peer-to-peer protocols play an increasingly instrumental role in Internet content distribution. It is therefore important to gain a complete understanding of how these protocols behave in practice and how their operating parameters affect overall system performance. This paper presents the first detailed experimental investigation of the peer selection strategy in the popular BitTorrent protocol. By observing more than 40 nodes in instrumented private torrents, we validate three protocol properties that, though believed to hold, have not been previously demonstrated experimentally: the clustering of similar-bandwidth peers, the effectiveness of BitTorrent's sharing incentives, and the peers' high uplink utilization. In addition, we observe that BitTorrent's modified choking algorithmin seed state provides uniform service to all peers, and that an underprovisioned initial seed leads to absence of peer clustering and less effective sharing incentives. Based on our results, we provide guidelines for seed provisioning by content providers, and discuss a tracker protocol extension that addresses an identified limitation of the protocol.

• Publication year

  2006

• Venue

  Measurement and Modeling of Computer Systems

• Publication date

  2006-11-21

• Fields of study

  Computer Science

• Identifiers
  DOI 10.1145/1254882.1254919arXiv cs/0703107
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Coupon replication systems

  2008cited by this paper
• Exploring the robustness of BitTorrent peer‐to‐peer content distribution systems

  2008cited by this paper
• Free-riding in BitTorrent Networks with the Large View Exploit

  2007cited by this paper
• Do incentives build robustness in bit torrent

  2007cited by this paper
• The Delicate Tradeoffs in BitTorrent-like File Sharing Protocol Design

  2006cited by this paper
• Analyzing and Improving a BitTorrent Networks Performance Mechanisms

  2006influential reference
• Free Riding in BitTorrent is Cheap

  2006cited by this paper
• Rarest first and choke algorithms are enough

  2006cited by this paper
• Modeling, Analysis and Improvement for BitTorrent-Like File Sharing Networks

  2006cited by this paper
• The Bittorrent P2P File-Sharing System: Measurements and Analysis

  2005influential reference
• Influences on cooperation in BitTorrent communities

  2005cited by this paper
• Incentives in BitTorrent induce free riding

  2005cited by this paper
• Measurements, analysis, and modeling of BitTorrent-like systems

  2005influential reference
• Performance Analysis of Peer-to-Peer Networks for File Distribution

  2004cited by this paper
• Is P2P dying or just hiding? [P2P traffic measurement]

  2004cited by this paper
• Self-scaling networks for content distribution

  2004cited by this paper
• Faithfulness in internet algorithms

  2004cited by this paper
• Dissecting BitTorrent: Five Months in a Torrent's Lifetime

  2004cited by this paper
• Is P2P dying or just hiding?

  2004cited by this paper
• Service capacity of peer to peer networks

  2004cited by this paper
• Modeling and performance analysis of BitTorrent-like peer-to-peer networks

  2004cited by this paper
• Incentives Build Robustness in Bit-Torrent

  2003cited by this paper

• Dynamic Deep Genomics Sequence Encoder for Managed File Transfer

  2022cites this paper
• Heterogeneous download times in bandwidth-homogeneous BitTorrent swarms

  2021cites this paper
• Analysis of minimum distribution time of tit-for-tat-based P2P file distribution: Linear programming based approach

  2021cites this paper
• Open Problems in Cooperative AI

  2020cites this paper
• Hyperwell: Local-First, Collaborative Notebooks for Digital Annotation

  2020cites this paper
• A New Stable Peer-to-Peer Protocol With Non-Persistent Peers: The Group Suppression Protocol

  2020cites this paper
• From me to you: peer-to-peer collaboration with linked data

  2020cites this paper
• Scalable Streaming Multimedia Delivery using Peer-to-Peer Communication

  2019cites this paper
• A Credit-Based Approach for Overcoming Free-Riding Behaviour in Peer-to-Peer Networks

  2019cites this paper
• On Market-Driven Hybrid-P2P Video Streaming

  2017influential citation
• A new stable peer-to-peer protocol with non-persistent peers

  2017cites this paper
• Policy implications of scaling low-power wide-area networks over white spaces

  2017cites this paper
• A Methodology and Tool for Investigation of Artifacts Left by the BitTorrent Client

  2016cites this paper
• Towards scalable on-demand collective data access in IaaS clouds: An adaptive collaborative content exchange proposal

  2016cites this paper
• Distribution multi-contenus sur Internet

  2016cites this paper
• Fluid Models of Population and Download Progress in P2P Networks

  2016cites this paper
• Distributed Caching Using the HTCondor CacheD

  2015cites this paper
• Free Riding in Peer-to-Peer Networks: Review and Analysis

  2015influential citation
• Implementation of modified Probabilistic Caching Schema on Bittorrent protocol for video on demand content

  2015cites this paper
• An Automated Framework for the Management of P2P Traffic in ISP Infrastructures

  2015influential citation
• Energy efficiency of P2P and distributed clouds networks

  2015influential citation
• Coalitions Improve Performance in Data Swarming Systems

  2015cites this paper
• Profiling professional and regular users on popular Internet services based on implementation of large scale Internet measurement tools. (Profilage d'usagers professionnels et non-professionnels de services Internet basés sur l'implémentation d'outils de mesure Internet à grande échelle)

  2015cites this paper
• ISP-friendly peer-assisted on-demand streaming of long duration content in BBC iPlayer

  2015cites this paper
• Enabling Distributed Scientific Computing on the Campus

  2015cites this paper
• Toward a collaborative management of a P2P distribution protocol: Local vision vs. global vision

  2015cites this paper
• Neighbor selection for proportional fairness in P2P networks

  2015cites this paper
• Sustaining Ad-driven P2P streaming ecosystems: A market-based approach

  2015cites this paper
• Coercion builds cooperation in dynamic and heterogeneous P2P live streaming networks

  2015cites this paper
• Lyapunov stability and performance of user-assisted Video-on-Demand services

  2015cites this paper
• Towards effective control of P2P traffic aggregates in network infrastructures

  2015cites this paper
• Queueing analysis of peer-to-peer swarms: Stationary distributions and their scaling limits

  2015influential citation
• User contribution in peer-to-peer communities

  2015cites this paper
• Integrating Piece and Peer Selection in Content Distribution Networks

  2014cites this paper
• Robust Swarm Management for Multiple Torrent Environments

  2014cites this paper
• Delay-based congestion control: Flow vs. BitTorrent swarm perspectives

  2014cites this paper
• Understanding Collaboration in Volunteer Computing Systems

  2014cites this paper
• On the performance and fairness of BitTorrent-like data swarming systems with NAT devices

  2014influential citation
• Nine Ways to Bias Open‐Source Artificial General Intelligence Toward Friendliness

  2014cites this paper
• Analysis of Optimal Scheduling in Tit-for-Tat-Based P2P File Distribution

  2014cites this paper
• Estimating and Controlling the Traffic Impact of a Collaborative P2P System

  2014cites this paper
• An analysis of user behavior in a private BitTorrent community

  2014cites this paper
• BitTorrent Locality and Transit TrafficReduction: When, Why, and at What Cost?

  2014cites this paper
• EnhancedBit: Unleashing the potential of the unchoking policy in the BitTorrent protocol

  2014cites this paper
• Towards a Peer-to-Peer Bandwidth Marketplace

  2014cites this paper
• Monotonicity and global stability in download dynamics of content-sharing networks

  2014cites this paper
• Scalability Issues in P2P Systems

  2014cites this paper
• Studies on User-Behavior Driven Content Distribution Environments

  2014cites this paper
• Modeling Flash Crowd Performance in Peer-to-Peer File Distribution

  2014cites this paper
• Facultat d ’ Informática de Barcelona On Incentive Mechanisms for Resource Sharing in Community Clouds Ümit Çavuş Büyükşahin

  2013cites this paper
• Spatial and temporal locality of content in BitTorrent: A measurement study

  2013cites this paper
• Dynamics of heterogeneous peer-to-peer networks

  2013cites this paper
• A Framework for Highly Reconfigurable P2P Trackers

  2013cites this paper
• On System Time Analysis for BitTorrent with Sharing Ratio Enforcement

  2013cites this paper
• Performance Modeling of BitTorrent Peer-to-Peer File Sharing Networks

  2013cites this paper
• Measuring large-scale distributed systems: case of BitTorrent Mainline DHT

  2013cites this paper
• Experimenting with BitTorrent on a Cluster: A Good or a Bad Idea?

  2013cites this paper
• iRep: indirect reciprocity reputation based efficient content delivery in BT-like systems

  2013cites this paper
• Experimental analyses of data distribution on data center networks

  2013influential citation
• A multi-faced measurement study on a large private BitTorrent community

  2013cites this paper
• Peer To Peer Content Sharing On Wi-Fi Network For Smart Phones

  2013cites this paper
• From Peers to the Cloud: Utilizing Distributed Resources for Content Delivery and User Collaboration

  2013cites this paper
• PEER TO PEER NODE GROUPINGS BASED ON CONTENT USING GAME THEORETIC STRATEGY IN INTER-NETWORKS

  2013cites this paper
• SMART: A Subspace based Malicious Peers Detection algorithm for P2P Systems

  2013cites this paper
• A Measurement-Driven Comparison of Server Bandwidth Controllers for Client-assisted Content Delivery

  2013cites this paper
• Effort-based incentives for resource sharing in collaborative volunteer applications

  2013cites this paper
• Unveiling the Incentives for Content Publishing in Popular BitTorrent Portals

  2013cites this paper
• A Game Theoretic Approach to the Formation of Clustered Overlay Networks

  2013cites this paper
• A credit-based approach to scalable video transmission over a peer-to-peer social network

  2013cites this paper
• On the Impact of Incentives in eMule {Analysis and Measurements of a Popular File-Sharing Application}

  2013cites this paper
• Analysis of mobile BitTorrent client behavior

  2013cites this paper
• Modeling BitTorrent-like systems with many classes of users

  2013cites this paper
• A Measurement Study on the Topologies of BitTorrent Networks

  2013cites this paper
• A bottom-up model for heterogeneous BitTorrent systems

  2013cites this paper
• A measurement‐based study on user management in private BitTorrent communities

  2013cites this paper
• Exploiting scheduling and free‐riding for offline downloading in BitTorrent networks

  2013cites this paper
• Accelerating Peer-to-Peer File Sharing with Social Relations

  2013cites this paper
• On Incentive Mechanisms for Resource Sharing in Community Clouds

  2013cites this paper
• On Zipf Models for Probabilistic Piece Selection in P2P Stored Media Streaming

  2013cites this paper
• Modeling and Control of Rare Segments in BitTorrent with Epidemic Dynamics

  2013cites this paper
• Connectivity Properties of Real BitTorrent Swarms

  2013cites this paper
• Understanding the topologies of BitTorrent networks: A measurement view

  2012cites this paper
• Exploring the Sustainability of Credit-incentivized Peer-to-Peer Content Distribution

  2012cites this paper
• Peer To Peer Content Sharing On Smart Phones Technology

  2012cites this paper
• A Game Theoretic Approach to the Formation of Clustered Overlay Networks ( Supplemental Material ) ✦

  2012cites this paper
• Exploring Peer-to-Peer Locality in Multiple Torrent Environment

  2012cites this paper
• A methodology to gauge the extent of Bufferbloat in the Internet: LEDBAT vs TCP

  2012cites this paper
• Changing the Unchoking Policy for an Enhanced Bittorrent

  2012cites this paper
• Nine Ways to Bias Open-Source AGI Toward Friendliness

  2012cites this paper
• An Optimized Video-on-Demand System: Theory, Design and Implementation

  2012cites this paper
• Incentivizing Cooperation in P2P File Sharing - Indirect Interaction as an Incentive to Seed

  2012cites this paper
• EBITSIM: SIMULADOR DE BITTORRENT UTILIZANDO O ARCABOUÇO OMNET++

  2012cites this paper
• TESIS DOCTORAL E XPERIMENTAL ANALYSIS OF THE SOCIO-ECONOMIC PHENOMENA IN THE BITTORRENT ECOSYSTEM

  2012influential citation
• Defending against malicious behaviors in bittorrent systems

  2012cites this paper
• Network Efficiency in Peer-to-peer Data Distribution

  2012influential citation
• Peer-to-Peer Support for Large Scale Interactive Applications

  2012cites this paper
• Peer-to-peer video streaming

  2012cites this paper
• Trading seeder bandwidth for efficient content distribution in swarming system

  2012cites this paper
• Pros & cons of model-based bandwidth control for client-assisted content delivery

  2012cites this paper
• Title Exploring the sustainability of credit-incentivized peer-to-peercontent distribution

  2012cites this paper