Synthetic Data Engineer (AI Data/Training)
Oregon, USA·Posted 1mo ago
web3llmspark
<p>We are seeking a talented and innovative Synthetic Data Engineer. In this role, you will design and implement domain-specific synthetic data generation pipelines, ensuring high-quality data management for training loops. Your expertise will drive the success of data processing and model training within the organization.</p> <p> </p> <p><strong>Responsibilities:</strong></p> <ul> <li>Design domain-specific synthetic data generation (SDG) pipelines via self-instruct and constitutional prompting.</li> <li>Implement automated quality scoring and de-duplication systems.</li> <li>Manage data pipelines that feed directly into SFT and DPO training loops.</li> </ul> <p><strong>Qualifications:</strong></p> <ul> <li>Proven experience building large-scale data pipelines (Airflow, Spark, Ray).</li> <li>Deep knowledge of prompt engineering for data generation.</li> <li>Familiarity with dataset distillation and bias mitigation.</li> </ul>