Towards Next-Generation LLM Training: From the Data-Centric Perspective

Abstract

This perspective outlines two complementary directions for next-generation LLM training: agent-based systems for automatic, reusable data preparation and unified data-model interaction systems that dynamically select, mix, and reweight training data.

Publication
arXiv preprint arXiv:2603.14712
Xiaochen Ma
Xiaochen Ma
Ph.D. Student in Computer Science and Engineering

I work on data infrastructure and high-performance distributed systems for large-scale LLM data preparation, with a focus on Ray and Apache Spark.