DataFlex: A Unified Framework for Data-Centric Dynamic Training of Large Language Models

Hao Liang, Zhengyang Zhao, Meiyi Qiang, Mingrui Chen, Lu Ma, Rongyi Yu, Hengyi Feng, Shixuan Sun, Zimo Meng, Xiaochen Ma, Xuanlin Yang, Qifeng Cai, Ruichuan An, Bohan Zeng, Zhen Hao Wong, Chengyu Shen, Runming He, Zhaoyang Han, Yaowei Zheng, Fangcheng Fu, Conghui He, Bin Cui, Zhiyu Li, Weinan E, Wentao Zhang
March, 2026
PDF arXiv

Abstract

DataFlex is a unified framework for data-centric dynamic LLM training. Built on LLaMA-Factory, it integrates sample selection, domain-mixture adjustment, and sample reweighting behind extensible trainer abstractions with support for large-scale distributed training.

Type
Preprint
Publication
arXiv preprint arXiv:2603.26164
Xiaochen Ma
Xiaochen Ma
Ph.D. Student in Computer Science and Engineering

I work on data infrastructure and high-performance distributed systems for large-scale LLM data preparation, with a focus on Ray and Apache Spark.