Seminar: Designing a Warehouse-sized Video Streaming Sever - A Hybrid Cloud Approach

Thursday, January 28, 2010 - 11:00am - 12:00pm EST

  • Location:Dibner Building, LC 400
    Five MetroTech Center, Brooklyn, New York

Speaker: Dr. Hui Zhang

Faculty Host: Professor Kang Xi

Abstract

This talk consists of two parts:

  • In the first part, we report the workload characterization on Yahoo! Video, the 2nd largest U.S. video sharing site, for the understanding of its nature and the impact on online video data center design. We discovered interesting statistical properties on both static and temporal dimensions of the workload; they include file duration and popularity distributions, arrival rate dynamics and predictability, and workload stationarity and burstiness.
  • In the second part, we present the design of Resilient Workload Manager (ROM) - for hosting scaling Internet applications in data centers to achieve both resource efficiency and Quality of Service (QoS) guarantee. Its basic idea lies in explicitly segregating base workload and trespassing workload, the two naturally different components in application workload, and managing them separately in two resource zones with specialized optimization techniques. This allows enterprise customers to make the best use of public cloud services along with their privately-owned (legacy) data centers. As a comprehensive workload management framework, ROM covers workload, data, resource, and Quality of Service of the target applications. In this talk, we focus on the intelligent workload factoring technology whose core is a fast frequent data item detection algorithm.

About the Speaker

Hui Zhang received his Ph.D. from the Computer Science Department at the University of Southern California in 2005. From 2005 to now he is a Research Staff Member of NEC Laboratories of America at Princeton. His research interests include new management solutions for large-scale data centers, and high performance algorithms for high-speed networks.