BART201910Mike Lewis8Facebook AIBARTBidirectional and Auto-Regressive Transformers.
barttransformersreadme
TransformerGPTBERTOpenAI Transformer ChatGPTTransformer .
T5BART
BERTencoder-onlyT5BARTencoder-decoderGPTdecoder-onlyUNILMPrefixLMGPTattention mask.
BART []CPTBERTGPT.
2021 .
.
90
TransformerTransformerTransformerTransformerGPT.
