This contains text datasets in the <a href ="http://www.cs.waikato.ac.nz/~ml/weka/arff.html">Weka Sparse Arff</a> format. The
original text documents have been tokenized and pre-processed to remove stop-words and filter words with very high/low frequencies,
using the <a href = "http://www.cs.utexas.edu/users/jfan/dm/">MC</a> code of James Fan. A perl script has been used after that to
convert the CCS files to sparse Arff format, and to replace html tokens by generic tokenIDs. <br>
	
<p> 
<a href = "tfidf">tfidf</a>: Words frequencies in the datasets have been tfidf normalized.
<br>
<a href = "frequency">frequency</a>: Original word frequencies are 
provided. 
</p> 

Here are some non-sparse arff files that are not in the WEKA data release:
<p>
<a href = "protein.arff">protein</a>: Protein dataset used by Xing et 
al.
</p>

<br>
<a href="http://www.cs.utexas.edu/users/ml/risc">Back to RISC</a>