Zheng Zian(Andy)'s picture

Zheng Zian(Andy)

OrionZheng

·

https://zheng-zian-andy.com

AI & ML interests

LLM, Mixture-of-Experts, Data-Centric AI

Recent Activity

liked a dataset about 1 month ago

MixEval/MixEval-X

authored a paper about 1 month ago

OpenMoE: An Early Effort on Open Mixture-of-Experts Language Models

authored a paper about 1 month ago

MixEval-X: Any-to-Any Evaluations from Real-World Data Mixtures

View all activity

Organizations

None yet

OrionZheng's activity

New activity in OrionZheng/openmoe-8b 4 months ago

model_type "llama"

#1 opened 4 months ago by

New activity in reflectio/gemma-2b-wildchat-offload 4 months ago

Update config.json

#1 opened 4 months ago by

New activity in reflectio/AdaVocab-Gemma-2b-1024 5 months ago

Update ada_vocab_factory.py

#1 opened 5 months ago by

New activity in hpcai-tech/openmoe-base 9 months ago

convert t5x into pytorch model

#1 opened 11 months ago by

New activity in shareAI/ShareGPT-Chinese-English-90k about 1 year ago

Fixed some data in bad format

#6 opened about 1 year ago by

New activity in allenai/peS2o over 1 year ago

Is there any overlap between peS2o dataset and the arxiv subset from Redpajama?

#2 opened over 1 year ago by

New activity in liwu/MNBVC over 1 year ago

Add snippet to locate errors in the data files

#3 opened over 1 year ago by

New activity in bigcode/starcoderdata over 1 year ago

How to obtain the original git-commits dataset?

#5 opened over 1 year ago by

New activity in bigcode/the-stack-dedup over 1 year ago

Confusion and Discrepancy Regarding Deduplication Versions and Dataset Sizes

#26 opened over 1 year ago by

New activity in wordcab/llama-natural-instructions-13b over 1 year ago

Cannot run the inference on the playground

#1 opened over 1 year ago by

New activity in mutiyama/alt over 1 year ago

Error while loading "alt-parallel" config: TypeError: Couldn't cast array

#3 opened over 1 year ago by

albertvillanova

🚩 Report

#2 opened over 1 year ago by