vicgalle (Victor Gallego)

upvoted a collection 7 days ago

Llama 3.2 Re-upload

Collection

10 items • Updated 7 days ago • 10

upvoted a paper 13 days ago

Training Language Models to Self-Correct via Reinforcement Learning

Paper • 2409.12917 • Published 13 days ago • 127

upvoted a paper 19 days ago

Hermes 3 Technical Report

Paper • 2408.11857 • Published Aug 15 • 35

upvoted an article about 1 month ago

Article

Tensor Parallelism

By

•

Aug 20

• 9

upvoted a collection about 2 months ago

Hermes 3

Collection

The Hermes 3 Series of Models • 8 items • Updated Aug 23 • 81

upvoted a paper about 2 months ago

WalledEval: A Comprehensive Safety Evaluation Toolkit for Large Language Models

Paper • 2408.03837 • Published Aug 7 • 17

upvoted a collection 2 months ago

Llama 3.1

Collection

This collection hosts the transformers and original repos of the Llama 3.1, Llama Guard 3 and Prompt Guard models • 11 items • Updated 7 days ago • 585

upvoted 3 articles 3 months ago

Article

Announcing Finance Commons and the Bad Data Toolbox: Pioneering Open Data and Advanced Document Processing

By

•

Jul 19

• 17

Article

SmolLM - blazingly fast and remarkably powerful

Jul 16

• 244

Article

The Rise of Agentic Data Generation

By

•

Jul 15

• 74

upvoted 3 papers 3 months ago

upvoted a collection 3 months ago

Probably DPO datasets

Collection

A collection of datasets that probably support DPO • 146 items • Updated Jun 26 • 12

upvoted 4 papers 3 months ago

TinyStyler: Efficient Few-Shot Text Style Transfer with Authorship Embeddings

Paper • 2406.15586 • Published Jun 21 • 2

Model Merging and Safety Alignment: One Bad Model Spoils the Bunch

Paper • 2406.14563 • Published Jun 20 • 30

nabla^2DFT: A Universal Quantum Chemistry Dataset of Drug-Like Molecules and a Benchmark for Neural Network Potentials

Paper • 2406.14347 • Published Jun 20 • 99

τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains

Paper • 2406.12045 • Published Jun 17 • 5

upvoted a paper 4 months ago

Merging Improves Self-Critique Against Jailbreak Attacks

Paper • 2406.07188 • Published Jun 11 • 3

upvoted a collection 4 months ago

Multimodal Models 🔀

Collection

A collection of multimodal models developed by the Komorebi AI team • 2 items • Updated Jun 18 • 2

upvoted a paper 4 months ago

Aligning to Thousands of Preferences via System Message Generalization

Paper • 2405.17977 • Published May 28 • 6

upvoted 2 articles 4 months ago

Article

Uncensor any LLM with abliteration

By

•

Jun 13

• 334

Article

Expanding Model Context and Creating Chat Models with a Single Click

By

•

Apr 28

• 37

upvoted an article 5 months ago

Article

Can we create pedagogically valuable multi-turn synthetic datasets from Cosmopedia?

By

•

May 7

• 7

upvoted a paper 5 months ago

Replacing Judges with Juries: Evaluating LLM Generations with a Panel of Diverse Models

Paper • 2404.18796 • Published Apr 29 • 68

upvoted an article 5 months ago

Article

🦙⚗️ Using Llama3 and distilabel to build fine-tuning datasets

By

•

Jun 4

• 69

upvoted a collection 6 months ago

Configurable Safety Tuning ⚙️

Collection

CST allows for configurable inference-time control of LLM safety levels, so users can dictate model behavior based on the system prompt • 10 items • Updated Jul 24 • 2

upvoted 2 papers 6 months ago

Configurable Safety Tuning of Language Models with Synthetic Preference Data

Paper • 2404.00495 • Published Mar 30 • 2

Evolutionary Optimization of Model Merging Recipes

Paper • 2403.13187 • Published Mar 19 • 49

upvoted a paper 7 months ago

Large Language Models are Null-Shot Learners

Paper • 2401.08273 • Published Jan 16 • 1

upvoted a collection 7 months ago

Quantized Models (GGUF, IQ, Imatrix)

Collection

Various quantizations of models in the GGUF format. Models with a "checkmark" are personal favorites. An "orange arrow" means it's being uploaded. • 86 items • Updated 4 days ago • 45

upvoted a paper 7 months ago

GRATH: Gradual Self-Truthifying for Large Language Models

Paper • 2401.12292 • Published Jan 22 • 2

upvoted 4 papers 8 months ago

A Survey on Data Selection for LLM Instruction Tuning

Paper • 2402.05123 • Published Feb 4 • 3

Refined Direct Preference Optimization with Synthetic Data for Behavioral Alignment of LLMs

Paper • 2402.08005 • Published Feb 12 • 1

Suppressing Pink Elephants with Direct Principle Feedback

Paper • 2402.07896 • Published Feb 12 • 9

Vision Superalignment: Weak-to-Strong Generalization for Vision Foundation Models

Paper • 2402.03749 • Published Feb 6 • 12

upvoted a collection 8 months ago

🛰️🌍 Geospatial Datasets

Collection

A curated collections of diverse geospatial and satellite imagery datasets. • 54 items • Updated Mar 6 • 14

upvoted 4 collections 9 months ago

Exotic Frankenmerges 🥨

Collection

Merges of models of different architectures and sizes that end up working surprisingly well • 1 item • Updated Jun 13 • 1

Usable Models

Collection

5 items • Updated Dec 10, 2023 • 2

Upscaled Models ⏫

Collection

A collection of my frankenmerges, upscaling several models. All of them have the corresponding GGUF variants. • 4 items • Updated Jun 13 • 2

Model Merging

Collection

Model Merging is a very popular technique nowadays in LLM. Here is a chronological list of papers on the space that will help you get started with it! • 30 items • Updated Jun 12 • 212

upvoted a paper 10 months ago

Distilled Self-Critique of LLMs with Synthetic Data: a Bayesian Perspective

Paper • 2312.01957 • Published Dec 4, 2023 • 1

upvoted a collection 11 months ago

Optimised Translation Models 🌍

Collection

A collection of optimised and quantised multilingual translation models • 6 items • Updated Nov 7, 2023 • 3

upvoted 4 papers about 1 year ago

Fast Adaptation with Bradley-Terry Preference Models in Text-To-Image Classification and Generation

Paper • 2308.07929 • Published Jul 15, 2023 • 1

Personalizing Text-to-Image Generation via Aesthetic Gradients

Paper • 2209.12330 • Published Sep 25, 2022 • 1

ZYN: Zero-Shot Reward Models with Yes-No Questions

Paper • 2308.06385 • Published Aug 11, 2023 • 1

LoraHub: Efficient Cross-Task Generalization via Dynamic LoRA Composition

Paper • 2307.13269 • Published Jul 25, 2023 • 31

Victor Gallego

AI & ML interests

Organizations

vicgalle's activity

Tensor Parallelism

Announcing Finance Commons and the Bad Data Toolbox: Pioneering Open Data and Advanced Document Processing

SmolLM - blazingly fast and remarkably powerful

The Rise of Agentic Data Generation

Uncensor any LLM with abliteration

Expanding Model Context and Creating Chat Models with a Single Click

Can we create pedagogically valuable multi-turn synthetic datasets from Cosmopedia?

🦙⚗️ Using Llama3 and distilabel to build fine-tuning datasets