Which algorithm Doc2Vec uses?

Question

Like Word2vec is not a single algorithm but combination of two, namely, CBOW and Skip-Gram model; is Doc2Vec also a combination of any such algorithms? Or is it an algorithm in itself?

score 4 · Accepted Answer · answered Jul 10 '17 at 11:38

Word2Vec is not a combination of two models, rather both are variants of word2vec. Similarly doc2vec has Distributed Memory(DM) model and Distributed Bag of words (DBOW) model. Based on the context words and the target word, these variants arised.

Note: the name of the model maybe confusing

Distriubted Bag of words is similar to Skip-gram model
Distributed Memory is similar to Continuous bag of words model

score 1 · Answer 2 · answered Jul 10 '17 at 08:29

1

Documentation says:

Deep learning via the distributed memory and distributed bag of words models from [1], using either hierarchical softmax or negative sampling [2], [3].

answered Jul 10 '17 at 08:29

Damian Melniczuk

649
4
19

score 1 · Answer 3 · edited Mar 19 '18 at 13:56

1

Distributed Memory model preserves the word order in a document whereas Distributed Bag of words just uses the bag of words approach, which doesn't preserve any word order.

This has been explained in details in this research paper.

edited Mar 19 '18 at 13:56

Stephen Rauch

1,831
11
23
34

answered Mar 19 '18 at 12:40

Deepak Mishra

11
1
3

Which algorithm Doc2Vec uses?

3 Answers3