A Dual Framework and Algorithms for Targeted Online Data Delivery

TitleA Dual Framework and Algorithms for Targeted Online Data Delivery
Publication TypeJournal Articles
Year of Publication2011
AuthorsRoitman H, Gal A, Raschid L
JournalIEEE Transactions on Knowledge and Data Engineering
Pagination5 - 21
Date Published2011///
ISBN Number1041-4347
Keywordsclient/server multitier systems, distributed databases, online data delivery., online information services

A variety of emerging online data delivery applications challenge existing techniques for data delivery to human users, applications, or middleware that are accessing data from multiple autonomous servers. In this paper, we develop a framework for formalizing and comparing pull-based solutions and present dual optimization approaches. The first approach, most commonly used nowadays, maximizes user utility under the strict setting of meeting a priori constraints on the usage of system resources. We present an alternative and more flexible approach that maximizes user utility by satisfying all users. It does this while minimizing the usage of system resources. We discuss the benefits of this latter approach and develop an adaptive monitoring solution Satisfy User Profiles (SUPs). Through formal analysis, we identify sufficient optimality conditions for SUP. Using real (RSS feeds) and synthetic traces, we empirically analyze the behavior of SUP under varying conditions. Our experiments show that we can achieve a high degree of satisfaction of user utility when the estimations of SUP closely estimate the real event stream, and has the potential to save a significant amount of system resources. We further show that SUP can exploit feedback to improve user utility with only a moderate increase in resource utilization.