Visual Media Hub: An Open Multimedia Hub for Building Cloud Services and Mobile Apps

Seminar / Lecture
For NYU Community

Speaker: Jin Li, Microsoft Research (CCS)

Visual Media Hub (short as VM Hub below) aims to build an open multimedia hub to allow the entire multimedia/vision community in both academia and industry to easily build cloud services and mobile multimedia applications. The VM Hub is built on top of a to-be open sourced distributed functional programming platform OneNet. The VM Hub Client Suite and Hub App Library are also to be open sourced. With the Hub, a multimedia researcher or developer can quickly turn his/her single-machine implementation of a multimedia application, e.g., an image/video recognizer, into a service hosted in the cloud with multiple service endpoints. This provides the capability to scale by increasing the number of worker machines, balance the load among endpoints, and automatically deal with failure. VM Hub is capable of concurrently supporting multiple service providers, each of which may support services with different schemas and domains. VM Hub can also support multiple versions of multimedia services on the same schema and domain. This multi-version hosting feature allows the developer to seamlessly test and deploy a new implementation of the service without any risk in disrupting the existing service (the old version). VM Hub service endpoints may be simultaneously deployed in a public cloud and / or in a private cluster. We also provide tools for obtaining detailed operating telemetry of the multimedia service endpoints, with capability for developers to arbitrarily customize their telemetry. The open sourced VM Hub App Library implementation is based on the Portable Class Library [15] and can support mobile Apps across Windows Phone, Android and iOS platforms. The VM Hub suite of libraries will greatly reduce the development and deployment effort for multimedia researchers and developers to bring their work to a Cloud service and encourages them to build mobile applications that easily showcase the multimedia service to a worldwide audience.



Dr. Jin Li is a Partner Research Manager of the Cloud Computing and Storage (CCS) group in Microsoft Research. He engaged research in an end-to-end approach, and believes that the ultimate milestone of cool system research is a product of significant impact. His group has architected (and in many cases written the code for) the erasure code solution used in Windows Azure Storage, Storage Spaces in Windows 8.1 and Windows Server 2012 R2, and in Lync, Xbox and RemoteFX. His work on Local Reconstruction Code (LRC) in Windows
Azure Storage has led to hundreds of millions of dollars of savings for Microsoft, a Best Paper Award at USENIX ATC 2012 and a 2013 Microsoft Technical Community Network Storage Technical Achievement Award. He has architected and implemented the Primary Data Deduplication feature in Windows Server 2012 and End-to-End Deduplication for Storage Virtualization in Windows Server 2012 R2, which is among top 3 features for Windows File Server introduced at Windows Server 2012, received rave reviews from press, with evidence that some customers upgrading to Windows Server 2012 for the primary data deduplication feature only. He has architected and implemented the RemoteFX for WAN feature in Windows 8, Windows 10 and Windows Server 2012, which provides fast and fluid user experience in a remote session running over any WAN and wireless networks. He is ICME steering committee chair and a TPC Co-Chair of ACM Multimedia 2016. He is an IEEE Fellow.