Very nice paper! I see that pre-training took 3000 A100 GPU hours. How long does fine-tuning take?
Very nice paper! I see that pre-training took 3000 A100 GPU hours. How long does fine-tuning take?