Pinned Tweet
Thanks for sharing! It was a great experience working on this project together with you and @ThomasBrox at @CVisionFreiburg. #ICLR2024 #VLMs #AI #ComputerVision #NLP
Excited to share that our paper, "Open-Ended VQA Benchmarking of Vision-Language Models by Exploiting Classification Datasets and Their Semantic Hierarchy," has been selected as a Spotlight at #ICLR2024! #AI #VLMs
Paper: arxiv.org/pdf/2402.07270.pdf
Code: github.com/lmb-freiburg/ovqa
1/n
Excited to release our models and preprint: "Using Knowledge Graphs to harvest datasets for efficient CLIP model training"
We propose a dataset collection method using knowledge graphs and web image search, and create EntityNet-33M: a dataset of 33M images paired with 46M texts.
3
2
24
This work would not have been possible without all my amazing co-authors and supervisors: Sebastian Walter, @JelenaBratulic, Johannes Dienert, @hannahbast and Thomas Brox!
1
20
Using this dataset, we train a generic CLIP model in 2 days on 1 server.
With a 10M subset of living organisms, we train domain expert CLIP models excelling at fine-grained animal, plant, and fungi classification.
Models are out now on huggingface! The dataset is coming soon.
1
21
Happy to present our poster: Open-ended VQA benchmarking, together with @MariaAleBravo ! #ICLR2024 @CVisionFreiburg @ThomasBrox
Simon Ging retweeted
Thanks to all collaborators at @CVisionFreiburg: @mittalsud, @ging_ai and @ThomasBrox, great job! 2/6




