Pre-training
The initial phase where a model learns general representations from massive unlabeled data before being adapted to any specific task.
Deep Learning
The initial phase where a model learns general representations from massive unlabeled data before being adapted to any specific task.