The Basics

• Retrieving Answers from Frequently Asked Questions Pages on the Web, V. Jijkoun and M. de Rijke. CIKM-2005. (pdf) and references there.
• Maximum Entropy Markov Models for Information Extraction and Segmentation, A. McCallum?, D. Freitag and F. Pereira, (ps).
• FAQ Mining via List Detection, Y. S. Lai et al. (pdf)
• Question Answering from Frequently-Asked Question Files: Experiences with the FAQ Finder System, R. Burke et al. (pdf).
• The use of question types to match questions in FAQFinder. S. Lytinen and N. Tomuro., (pdf)

Vector Space Model

Papers

Links

• The Classic Vector Space Model, http://www.miislita.com/term-vector/term-vector-3.html, 2006

Language Model

Papers

• Latent Dirichlet Allocation, David M. Blei, Andrew Y. Ng and Michael I. Jordan (2003) (pdf)
• Latent Semantic Indexing, Thomas Hofmann (SIGIR 1999) (pdf)

Links

Misc.

• PageRank without hyperlinks: Structural re-ranking using links induced by language models. O. Kurland, L. Lee (pdf)

Lucene

• A very simple example of indexing with Lucene (using it as a library), http://www.budget-ha.com/lucene/simple-example

Libraries

• The Lemur Toolkit for Language Modeling and Information Retrieval (The Site van Lemur)
• P Ogilvie, J Callan - Fuhr et al, 2004, Using Language Models for Flat Text Queries in XML Retrieval (Over LM & Lemur)
• Ponte, J. M. and Croft, W. B. 1998. A language modeling approach to information retrieval. In Proceedings of the 21st Annual international ACM SIGIR Conference on Research and Development in information Retrieval (Melbourne, Australia, August 24 - 28, 1998). (Over LM)
• Lucene: a text search engine library