Jialiang Cheng

Julius-L's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes

upvoted 2 papers about 8 hours ago

A Survey of Small Language Models

Paper • 2410.20011 • Published 7 days ago • 34

COAT: Compressing Optimizer states and Activation for Memory-Efficient FP8 Training

Paper • 2410.19313 • Published 7 days ago • 17

upvoted 4 papers 8 days ago

The Llama 3 Herd of Models

Paper • 2407.21783 • Published Jul 31 • 105

SemiEvol: Semi-supervised Fine-tuning for LLM Adaptation

Paper • 2410.14745 • Published 15 days ago • 45

Why Does the Effective Context Length of LLMs Fall Short?

Paper • 2410.18745 • Published 8 days ago • 15

MiniPLM: Knowledge Distillation for Pre-Training Language Models

Paper • 2410.17215 • Published 10 days ago • 12

upvoted a paper 10 days ago

Baichuan Alignment Technical Report

Paper • 2410.14940 • Published 14 days ago • 46

upvoted 4 papers 22 days ago

Model Merging in LLMs, MLLMs, and Beyond: Methods, Theories, Applications and Opportunities

Paper • 2408.07666 • Published Aug 14 • 2

Memory-Efficient LLM Training with Online Subspace Descent

Paper • 2408.12857 • Published Aug 23 • 11

Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolution

Paper • 2409.12191 • Published Sep 18 • 73

Scaling Smart: Accelerating Large Language Model Pre-training with Small Model Initialization

Paper • 2409.12903 • Published Sep 19 • 21

upvoted 3 papers 23 days ago

Differential Transformer

Paper • 2410.05258 • Published 25 days ago • 165

What Matters for Model Merging at Scale?

Paper • 2410.03617 • Published 28 days ago • 8

SageAttention: Accurate 8-Bit Attention for Plug-and-play Inference Acceleration

Paper • 2410.02367 • Published 29 days ago • 45

upvoted 3 papers 24 days ago

MM1.5: Methods, Analysis & Insights from Multimodal LLM Fine-tuning

Paper • 2409.20566 • Published Sep 30 • 51

MaskLLM: Learnable Semi-Structured Sparsity for Large Language Models

Paper • 2409.17481 • Published Sep 26 • 46

VPTQ: Extreme Low-bit Vector Post-Training Quantization for Large Language Models

Paper • 2409.17066 • Published Sep 25 • 27