AI Research

There are times when word vectors are initialized to lists of random numbers before a model is trained for a specific task, but it is also quite common to initialize the word vectors of a model with those obtained by running methods like word2vec, GloVe, or FastText.

The last few decades have witnessed a fundamental change in the challenge of taking in new information.

The rise of Machine Learning, Deep Learning, and Artificial Intelligence has already had a massive impact on the field of computer science.

Automatically generating captions for images has emerged as a prominent interdisciplinary research problem in both academia and industry.

LSTMs have become a basic building block for many deep NLP models.

Humans learn natural languages, such as English, starting from basic grammar to complex semantics in a single brain.

In deep learning, there are two very different ways to process input (like an image or a document).

We introduce the Dynamic Coattention Network, a state of the art neural network designed to automatically answer questions about documents.

Imagine you were a young child and wanted to ask about something. How would you describe a new object?

The WikiText language modeling dataset is a collection of over 100 million tokens extracted from the set of verified Good and Featured articles on Wikipedia.