electra (efficiently learning an encoder that classifies token replacements accurately)

Electra is a learning algorithm that efficiently trains an encoder to accurately classify token replacements.

Requires login.