Revisit Large-Scale Image-Caption Data in Pre-training Multimodal Foundation Models
Paper
•
2410.02740
•
Published
•
46
Habibullah Akbar
ChavyvAkvar
AI & ML interests
AGI
Organizations
ChavyvAkvar's activity
upvoted
3
papers
2 days ago
upvoted
5
papers
8 days ago
Molmo and PixMo: Open Weights and Open Data for State-of-the-Art Multimodal Models
Paper
•
2409.17146
•
Published
•
92
Instruction Following without Instruction Tuning
Paper
•
2409.14254
•
Published
•
25
Discovering the Gems in Early Layers: Accelerating Long-Context LLMs with 1000x Input Token Reduction
Paper
•
2409.17422
•
Published
•
22
EMOVA: Empowering Language Models to See, Hear and Speak with Vivid Emotions
Paper
•
2409.18042
•
Published
•
34
MaskLLM: Learnable Semi-Structured Sparsity for Large Language Models
Paper
•
2409.17481
•
Published
•
43
upvoted
3
papers
11 days ago
upvoted
6
papers
12 days ago
A Case Study of Web App Coding with OpenAI Reasoning Models
Paper
•
2409.13773
•
Published
•
4
Zero-shot Cross-lingual Voice Transfer for TTS
Paper
•
2409.13910
•
Published
•
7
Reflecting Reality: Enabling Diffusion Models to Produce Faithful Mirror Reflections
Paper
•
2409.14677
•
Published
•
14
Beyond Fine-tuning: Unleashing the Potential of Continuous Pretraining for Clinical LLMs
Paper
•
2409.14988
•
Published
•
21
Phantom of Latent for Large Language and Vision Models
Paper
•
2409.14713
•
Published
•
27
PixWizard: Versatile Image-to-Image Visual Assistant with Open-Language Instructions
Paper
•
2409.15278
•
Published
•
22
upvoted
4
papers
16 days ago
Language Models Learn to Mislead Humans via RLHF
Paper
•
2409.12822
•
Published
•
9
Scaling Smart: Accelerating Large Language Model Pre-training with Small Model Initialization
Paper
•
2409.12903
•
Published
•
20
InfiMM-WebMath-40B: Advancing Multimodal Pre-Training for Enhanced Mathematical Reasoning
Paper
•
2409.12568
•
Published
•
46
Training Language Models to Self-Correct via Reinforcement Learning
Paper
•
2409.12917
•
Published
•
128
upvoted
5
papers
17 days ago
GRIN: GRadient-INformed MoE
Paper
•
2409.12136
•
Published
•
14
Ovis: Structural Embedding Alignment for Multimodal Large Language Model
Paper
•
2405.20797
•
Published
•
24
LLMs + Persona-Plug = Personalized LLMs
Paper
•
2409.11901
•
Published
•
30
Qwen2.5-Coder Technical Report
Paper
•
2409.12186
•
Published
•
121
Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolution
Paper
•
2409.12191
•
Published
•
69
upvoted
4
papers
18 days ago
upvoted
3
papers
19 days ago
RetrievalAttention: Accelerating Long-Context LLM Inference via Vector Retrieval
Paper
•
2409.10516
•
Published
•
33
Schrodinger's Memory: Large Language Models
Paper
•
2409.10482
•
Published
•
1
Mamba-YOLO-World: Marrying YOLO-World with Mamba for Open-Vocabulary Detection
Paper
•
2409.08513
•
Published
•
10
upvoted
2
papers
22 days ago
upvoted
4
papers
24 days ago
Can Large Language Models Unlock Novel Scientific Research Ideas?
Paper
•
2409.06185
•
Published
•
10
Self-Harmonized Chain of Thought
Paper
•
2409.04057
•
Published
•
16
LLMs Will Always Hallucinate, and We Need to Live With This
Paper
•
2409.05746
•
Published
•
2
Agent Workflow Memory
Paper
•
2409.07429
•
Published
•
27
upvoted
3
papers
25 days ago
upvoted
2
papers
26 days ago
upvoted
16
papers
about 1 month ago
Loopy: Taming Audio-Driven Portrait Avatar with Long-Term Motion Dependency
Paper
•
2409.02634
•
Published
•
85
Attention Heads of Large Language Models: A Survey
Paper
•
2409.03752
•
Published
•
86
LongLLaVA: Scaling Multi-modal LLMs to 1000 Images Efficiently via Hybrid Architecture
Paper
•
2409.02889
•
Published
•
54
Arctic-SnowCoder: Demystifying High-Quality Data in Code Pretraining
Paper
•
2409.02326
•
Published
•
16
MMMU-Pro: A More Robust Multi-discipline Multimodal Understanding Benchmark
Paper
•
2409.02813
•
Published
•
27
Mini-Omni: Language Models Can Hear, Talk While Thinking in Streaming
Paper
•
2408.16725
•
Published
•
51
Mixture-of-Depths: Dynamically allocating compute in transformer-based language models
Paper
•
2404.02258
•
Published
•
104
LongRecipe: Recipe for Efficient Long Context Generalization in Large Languge Models
Paper
•
2409.00509
•
Published
•
38
FLUX that Plays Music
Paper
•
2409.00587
•
Published
•
31
PMoE: Progressive Mixture of Experts with Asymmetric Transformer for Continual Learning
Paper
•
2407.21571
•
Published
•
1
OLMoE: Open Mixture-of-Experts Language Models
Paper
•
2409.02060
•
Published
•
77
Dolphin: Long Context as a New Modality for Energy-Efficient On-Device Language Models
Paper
•
2408.15518
•
Published
•
41
Law of Vision Representation in MLLMs
Paper
•
2408.16357
•
Published
•
92
CogVLM2: Visual Language Models for Image and Video Understanding
Paper
•
2408.16500
•
Published
•
56
Eagle: Exploring The Design Space for Multimodal LLMs with Mixture of Encoders
Paper
•
2408.15998
•
Published
•
83
SoftDedup: an Efficient Data Reweighting Method for Speeding Up Language Model Pre-training
Paper
•
2407.06654
•
Published
•
1