Built on the OpenAI GPT-2 model, the Hugging Face team has fine-tuned the small version of the model on a tiny dataset (60MB of text) of Arxiv papers. The targeted subject is Natural Language Processing, resulting in a very Linguistics/Deep Learning oriented generation.

All articles were downloaded from Cornell University’s arxiv.org website using arXiv Bulk Data Access.