johko (Johannes Kolbe)

upvoted a paper 12 days ago

HaloQuest: A Visual Hallucination Dataset for Advancing Multimodal Reasoning

Paper • 2407.15680 • Published Jul 22 • 1

upvoted an article about 1 month ago

Article

The 5 Most Under-Rated Tools on Hugging Face

Aug 22

• 81

upvoted a paper about 1 month ago

Building and better understanding vision-language models: insights and future directions

Paper • 2408.12637 • Published Aug 22 • 110

upvoted a paper 3 months ago

LLaVA-NeXT-Interleave: Tackling Multi-image, Video, and 3D in Large Multimodal Models

Paper • 2407.07895 • Published Jul 10 • 40

upvoted an article 6 months ago

Article

Design choices for Vision Language Models in 2024

By

•

Apr 16

• 23

upvoted a collection 6 months ago

🎭 Avatars

Collection

The latest AI-powered technologies usher in a new era of realistic avatars! 🚀 • 67 items • Updated 2 days ago • 73

upvoted a paper 6 months ago

FeatUp: A Model-Agnostic Framework for Features at Any Resolution

Paper • 2403.10516 • Published Mar 15 • 16

upvoted a collection 7 months ago

Matryoshka Embedding Models

Collection

https://huggingface.co/blog/matryoshka • 14 items • Updated Jun 4 • 13

upvoted 2 papers 7 months ago

How Easy is It to Fool Your Multimodal LLMs? An Empirical Analysis on Deceptive Prompts

Paper • 2402.13220 • Published Feb 20 • 12

Aria Everyday Activities Dataset

Paper • 2402.13349 • Published Feb 20 • 29

upvoted a paper 8 months ago

PokéLLMon: A Human-Parity Agent for Pokémon Battles with Large Language Models

Paper • 2402.01118 • Published Feb 2 • 29

upvoted a collection 8 months ago

AIM

Collection

AIM: Autoregressive Image Models • 5 items • Updated Jun 19 • 48

upvoted a paper 9 months ago

Instruct-Imagen: Image Generation with Multi-modal Instruction

Paper • 2401.01952 • Published Jan 3 • 30

upvoted 5 papers 10 months ago

upvoted 3 papers 11 months ago

GLaMM: Pixel Grounding Large Multimodal Model

Paper • 2311.03356 • Published Nov 6, 2023 • 33

Grounding Visual Illusions in Language: Do Vision-Language Models Perceive Illusions Like Humans?

Paper • 2311.00047 • Published Oct 31, 2023 • 8

Distil-Whisper: Robust Knowledge Distillation via Large-Scale Pseudo Labelling

Paper • 2311.00430 • Published Nov 1, 2023 • 56

upvoted 3 papers about 1 year ago

VidChapters-7M: Video Chapters at Scale

Paper • 2309.13952 • Published Sep 25, 2023 • 9

Kosmos-2.5: A Multimodal Literate Model

Paper • 2309.11419 • Published Sep 20, 2023 • 50

An Empirical Study of Scaling Instruct-Tuned Large Multimodal Models

Paper • 2309.09958 • Published Sep 18, 2023 • 18

upvoted a paper over 1 year ago

Recognize Anything: A Strong Image Tagging Model

Paper • 2306.03514 • Published Jun 6, 2023 • 10

Johannes Kolbe

AI & ML interests

Organizations

johko's activity

HaloQuest: A Visual Hallucination Dataset for Advancing Multimodal Reasoning

The 5 Most Under-Rated Tools on Hugging Face

Building and better understanding vision-language models: insights and future directions

LLaVA-NeXT-Interleave: Tackling Multi-image, Video, and 3D in Large Multimodal Models

Design choices for Vision Language Models in 2024

🎭 Avatars

FeatUp: A Model-Agnostic Framework for Features at Any Resolution

Matryoshka Embedding Models

How Easy is It to Fool Your Multimodal LLMs? An Empirical Analysis on Deceptive Prompts

Aria Everyday Activities Dataset

PokéLLMon: A Human-Parity Agent for Pokémon Battles with Large Language Models

AIM

Instruct-Imagen: Image Generation with Multi-modal Instruction

PhotoMaker: Customizing Realistic Human Photos via Stacked ID Embedding

Describing Differences in Image Sets with Natural Language

FaceStudio: Put Your Face Everywhere in Seconds

Concept Sliders: LoRA Adaptors for Precise Control in Diffusion Models

GAIA: a benchmark for General AI Assistants

GLaMM: Pixel Grounding Large Multimodal Model

Grounding Visual Illusions in Language: Do Vision-Language Models Perceive Illusions Like Humans?

Distil-Whisper: Robust Knowledge Distillation via Large-Scale Pseudo Labelling

VidChapters-7M: Video Chapters at Scale

Kosmos-2.5: A Multimodal Literate Model

An Empirical Study of Scaling Instruct-Tuned Large Multimodal Models

Recognize Anything: A Strong Image Tagging Model