Is there "Attention Is All You Need" implementation in Keras?

Question

Has anyone seen this model's implementation using Keras?

score 2 · Answer 1 · answered Oct 11 '21 at 14:57

2

Update for anyone googling this in 2021: Keras has implemented a MultiHead attention layer. If key, query, and value are the same, this is self-attention.

answered Oct 11 '21 at 14:57

Tanner Phillips

121
2

score 2 · Accepted Answer · edited Apr 22 '19 at 15:20

2

Here is an implementation from PyPI.

edited Apr 22 '19 at 15:20

Stephen Rauch

1,831
11
23
34

answered Jan 28 '19 at 09:20

eugen

146
4

score 0 · Answer 3 · edited Apr 22 '19 at 15:18

0

One example from Kaggle is available.

edited Apr 22 '19 at 15:18

Stephen Rauch

1,831
11
23
34

answered Jan 28 '19 at 11:06

silverstone

126
5

Is there "Attention Is All You Need" implementation in Keras?

3 Answers3