搜索文章:
期刊:
主题:

合成数据驱动的模型泛化能力提升研究——面向高质量训练数据稀缺场景

Research on Enhancing Model Generalization Ability Driven by Synthetic Data: Focusing on Scenarios with Scarcity of High-Quality Training Data


作者:沈子安*
 云南理工职业学院 云南 昆明
*通信作者:沈子安;单位:云南理工职业学院 云南 昆明
AI应用研究, 2023, 1(1), 0-0;
课题资助:自筹经费,无利益冲突需要说明
引用本文
摘 要:
高质量训练数据的匮乏长期以来制约了机器学习模型的性能与泛化能力,尤其在实际应用场景中常面临数据稀缺的问题。为解决这一挑战,本研究提出了一种基于合成数据驱动的模型泛化能力提升方法,通过生成与真实分布接近的合成数据以扩展数据空间、丰富特征表现力,从而增强模型对未知数据的适应能力。研究中采用了先进的数据生成技术,如基于生成对抗网络(GAN)和变分自编码器(VAE)的方法,同时结合数据增强策略优化数据分布和多样性,以确保模型能更有效地学习潜在数据模式与规律。实验结果显示,在多个高数据稀缺场景中,与传统训练方法相比,使用合成数据驱动的模型取得了显著的性能提升,且泛化能力在测试和应用数据集中均表现优异。此外,研究还探讨了合成数据的质量评估方法及生成数据对模型结构的影响。该研究为解决高质量训练数据不足的问题提供了新的思路,并对促进机器学习模型广泛应用具有重要意义。
关键词:模型泛化能力;数据稀缺;生成对抗网络(GAN);变分自编码器(VAE)
 
Abstract:
The scarcity of high-quality training data has long constrained the performance and generalization ability of machine learning models, particularly in real-world application scenarios where data is often limited. To address this challenge, this study proposes a synthetic data-driven approach to improve model generalization ability. By generating synthetic data that closely approximates the real distribution, the data space is expanded, and feature expressiveness is enriched, thereby enhancing the model's adaptability to unknown data. Advanced data generation techniques, such as methods based on Generative Adversarial Networks (GANs) and Variational Autoencoders (VAEs), are employed in the research. Additionally, data augmentation strategies are combined to optimize the data distribution and diversity, ensuring that the model can more effectively learn the underlying data patterns and regularities. Experimental results demonstrate that, in multiple scenarios with severe data scarcity, models driven by synthetic data achieve significant performance improvements compared to traditional training methods, and exhibit excellent generalization ability in both test and application datasets. Furthermore, the study explores methods for evaluating the quality of synthetic data and the impact of generated data on model architecture. This research offers new insights into solving the problem of insufficient high-quality training data and is of great significance for promoting the widespread application of machine learning models.
Keywords: Model Generalization Ability; Data Scarcity; Generative Adversarial Network (GAN); Variational Autoencoder (VAE)
 
--
正文内容 / Content:
可下载并阅读全文PDF,请按照本文版权许可使用。
Download the full text PDF for viewing and using it according to the license of this paper.

参考文献 / References: 
  1. 李昕,王江江,战国栋.基于生成对抗网络的字体生成数据集差异性研究[J].大连民族大学学报,2022,24(03):259-263.
      
  2. 王新峰,黄伟.变分自编码器对甲基化缺失数据的填补[J].计算机工程与应用,2022,58(12):149-154.
  3. 曹爽.SCGAN:合成单类别表格数据的生成对抗网络[J].计算机时代,2021,(04):25-27.
  4. 仁曾卓玛,朱丽平.藏语方言语音合成数据集[J].中国科学数据:中英文网络版,2022,7(02):20-29.
  5. 徐东伟,彭航,商学天,等.基于图自编码-生成对抗网络的路网数据修复[J].交通运输系统工程与信息,2021,21(06):33-41.
  6. 郭秋燕,胡磊,代劲.基于云模型的变分自编码器数据压缩方法[J].电子技术应用,2023,49(10):96-99.
  7. 林焱辉李春波.基于变分自编码器的多维退化数据生成方法[J].北京航空航天大学学报,2023,49(10):2617-2627.
  8. 张贤坤,赵亚婷,丁文强,等.基于生成对抗网络的变分自编码器解耦合[J].天津科技大学学报,2023,38(04):62-68.
  9. 陈文婷,陈学勤,王伟津,等.面向稀疏数据场景的生成对抗网络推荐算法[J].福州大学学报:自然科学版,2023,51(04):467-474.
  10. 张建光,郭双乐,曹吉朋,等.变分自编码器低质量数据生成原因剖析[J].衡水学院学报,2023,25(04):20-24.
由此登陆,开启投稿之旅: