Five most cited papers published in KDD 2004

• Minqing Hu, Bing Liu. Mining and summarizing customer reviews (2015 Test of Time Paper)
• Sugato Basu, Mikhail Bilenko, Raymond J. Mooney. A probabilistic framework for semi-supervised clustering
• Theodoros Evgeniou, Massimiliano Pontil. Regularized multi--task learning
• Mark Steyvers, Padhraic Smyth, Michal Rosen-Zvi, Thomas Griffiths. Probabilistic author-topic models for information discovery
• Inderjit S. Dhillon, Yuqiang Guan, Brian Kulis. Kernel k-means: spectral clustering and normalized cuts

Five most cited papers published in KDD 2005

• Jure Leskovec, Jon Kleinberg, Christos Faloutsos. Graphs over time: densification laws, shrinking diameters and possible explanations
• Filip Radlinski, Thorsten Joachims. Query chains: learning to rank from implicit feedback
• Qiaozhu Mei, ChengXiang Zhai. Discovering evolutionary theme patterns from text: an exploration of temporal text mining
• Daniel Gruhl, R. Guha, Ravi Kumar, Jasmine Novak, Andrew Tomkins. The predictive power of online chatter
• Geetha Jagannathan, Rebecca N. Wright. Privacy-preserving distributed k-means clustering over arbitrarily partitioned data
• Xifeng Yan, Hong Cheng, Jiawei Han, Dong Xin. Summarizing itemset patterns: a profile-based approach

Five most cited papers published in KDD 2006

• Thorsten Joachims. Training linear SVMs in linear time
• Lars Backstrom, Dan Huttenlocher, Jon Kleinberg, Xiangyang Lan. Group formation in large social networks: membership, growth, and evolution
• Ravi Kumar, Jasmine Novak, Andrew Tomkins. Structure and evolution of online social networks
• Ingo Mierswa, Michael Wurst, Ralf Klinkenberg, Martin Scholz, Timm Euler. YALE: rapid prototyping for complex data mining tasks
• Xuerui Wang, Andrew McCallum. Topics over time: a non-Markov continuous-time model of topical trends