huggingface_nlp_course

huggingface上的nlp课程的notebook

TRANSFORMER MODELS

model	examlpes	task
encoder	ALBERT, BERT, DistilBERT, ELECTRA, RoBERTa	Sentence classification, named entity recognition, extractive question answering
decoder	CTRL, GPT, GPT-2, Transformer XL	Text generation
encoder-decoder	BART, T5, Marian, mBART	Summarization, translation, generative question answering

tokenizer	examlpes	tokenization method
Byte-level BPE	as used in GPT-2	Subword tokenization
WordPiece	as used in BERT	Subword tokenization
SentencePiece or Unigram	as used in several multilingual models	Subword tokenization

Name		Name	Last commit message	Last commit date
Latest commit History 15 Commits
course/en/chapter2		course/en/chapter2
Bias_and_limitations.ipynb		Bias_and_limitations.ipynb
Processing_the_data_(PyTorch).ipynb		Processing_the_data_(PyTorch).ipynb
README.md		README.md
Transformers,_what_can_they_do?.ipynb		Transformers,_what_can_they_do?.ipynb