easy5 pts · first answer countstransformersembeddings

What the embedding layer does

What does the first layer of a transformer language model, the token embedding layer, actually do with a token id?

A.Runs a small neural network over the characters of the tokenB.Looks up a row of a learned matrix and returns that vectorC.Converts the id to binary and uses the bits as featuresD.Computes attention between the token and its neighbours

Discussion 0

Join free to post in the discussion.

What the embedding layer does

Discussion 0

Related questions