(Note: the experiments here are only about language modeling) About the Penn Treebank corpus: - This corpus is free for research purposes - ptb.train.txt: train set - ptb.valid.txt: development set (should be used just for tuning hyper-parameters, but not for training) - ptb.test.txt: test set for reporting perplexity