Look at a general representation learning method called Big Transfer that was found that is particularly good in specialized small label downstream tasks.
: Review of paper: Big Transfer (BiT): General Visual Representation Learning Paper details: The attached is a Work In Progress and a good starting point. In this project you will look at a general representation learning method called Big Transfer that was found that is particularly good in specialized small label downstream tasks. (from […]