Sparse Backpropagation for MoE Training
Paper
•
2310.00811
•
Published
•
2
Backpropagation
-
-
The Forward-Forward Algorithm: Some Preliminary Investigations
Paper • 2212.13345 • Published • 2 -
Fine-Tuning Language Models with Just Forward Passes
Paper • 2305.17333 • Published • 2 -
Towards Green AI in Fine-tuning Large Language Models via Adaptive Backpropagation
Paper • 2309.13192 • Published • 1 -
Multiplication-Free Transformer Training via Piecewise Affine Operations
Paper • 2305.17190 • Published • 2 -
Learning with Local Gradients at the Edge
Paper • 2208.08503 • Published • 1 -
HyperTuning: Toward Adapting Large Language Models without Back-propagation
Paper • 2211.12485 • Published • 1 -
Towards Fine-tuning Pre-trained Language Models with Integer Forward and Backward Propagation
Paper • 2209.09815 • Published • 1 -
Memory-Efficient Backpropagation through Large Linear Layers
Paper • 2201.13195 • Published • 1 -
Few-Bit Backward: Quantized Gradients of Activation Functions for Memory Footprint Reduction
Paper • 2202.00441 • Published • 1