Generate vocab_tags for my own datasets.

[kai-wen-yang]

Hi, I want to use lens on Birds classification task. But the released vocab_tags obtained from laion does not contain all the bird classnames of my dataset, thus the final accuracy is poor.
I want to ask how to build my own vocab_tags for my datasets.

[williamberrios]

Hi @kai-wen-yang , you might need first to extend the vocabulary with these new classes and then generate the CLIP weights associated with the new vocabulary. We will release code for all these steps too!

[Keep-lucky]

Hi @kai-wen-yang , you might need first to extend the vocabulary with these new classes and then generate the CLIP weights associated with the new vocabulary. We will release code for all these steps too!
Excuse me, when will these steps be released?

[filipegl]

👀