Join us as we work together to inspire creativity and enrich life around the globe.
Responsibilities
About the team Seed Global Data is a team focused on producing international data for LLMs. For the training of large models, data is the lifeline of model quality — and the Global Data team is working closely with technical, product, and operations teams to ensure effective data production strategies and execution management. As a key member of Seed Global Data team, you will manage and deliver high‑quality LLM training projects with precision and efficiency, ensuring operational processes support scalable and reliable data production. You will also mentor and upskill team members, elevating performance and output. - The LLM Training Operations Analyst orchestrates end‑to‑end LLM training workflows, integrating evaluation practices at every stage and translating ambiguous requirements into executable tasks through robust QA and cross‑functional collaboration. Key Responsibilities and Duties: - Project & Workflow Management: Design, run, and optimize multiple LLM training workflows; own timelines and quality protocols through effective collaboration with researchers, product managers, and internal/external training teams. Offer flexible availability to accommodate discussion meetings with global teams. - Prompt Engineering & Automation: Craft and refine prompt engineering frameworks and scripts for training, evaluation, and workflow automation to improve model outcomes and operational efficiency. - Data Analysis & Reporting: Analyze operational data and build dynamic dashboards; compile quantitative and qualitative reports to inform high-value, strategic insights congruent with organizational goals. - Operational Improvement & Standardization: Run quality and productivity experiments; develop living guidelines that establish and iteratively refine standard operating procedures. - Task Specs: Document clear task specifications, including inputs, outputs, constraints, and context. - Team Mentorship and Collaboration: Develop team capabilities through coaching; promote knowledge sharing and best‑practice adoption for high‑quality delivery.
Qualifications
Minimum Qualifications: - 3+ years of experience in project/operations management or data operations for ML/LLM programs, with exposure to evaluation design and QA methodologies. - Hands-on data analysis using AI tools and low/no-code platforms (e.g., Airtable, Lark Base) and spreadsheets for dashboard building and rapid iterations. - Experience with LLM Ops running training/evaluation projects and applying prompt engineering for model and workflow optimization. - Ability to define task specifications, acceptance criteria, and quality metrics, complemented by strong process documentation skills. - Seasoned communication skills and cross-functional alignment capabilities in a fast-paced, project-based environment. Preferred Qualifications - Demonstrated portfolio of role-aligned projects with exceptional outcomes with links or case studies. - Proficiency with Python (Pandas, NumPy, SciPy) for analysis scripting and SQL for data extraction. - Hands-on experience with experimental design (A/B testing, sampling, hypothesis testing). - Ability to design rubrics, scoring systems, and error taxonomies. - Experience running human evaluation programs (guidelines, rater training, adjudication, QA) and managing vendor operations. - Background in Data Science, Machine Learning, Human-Computer Interaction, or Statistics. Note: This role requires a test prior to interviews.
Job Information
【For Pay Transparency】Compensation Description (Annually)
The base salary range for this position in the selected city is $83600 - $143556 annually.
Compensation may vary outside of this range depending on a number of factors, including a candidate’s qualifications, skills, competencies and experience, and location. Base pay is one part of the Total Package that is provided to compensate and recognize employees for their work, and this role may be eligible for additional discretionary bonuses/incentives, and restricted stock units.
Benefits may vary depending on the nature of employment and the country work location. Employees have day one access to medical, dental, and vision insurance, a 401(k) savings plan with company match, paid parental leave, short-term and long-term disability coverage, life insurance, wellbeing benefits, among others. Employees also receive 10 paid holidays per year, 10 paid sick days per year and 17 days of Paid Personal Time (prorated upon hire with increasing accruals by tenure).
The Company reserves the right to modify or change these benefits programs at any time, with or without notice.
For Los Angeles County (unincorporated) Candidates:
Qualified applicants with arrest or conviction records will be considered for employment in accordance with all federal, state, and local laws including the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act. Our company believes that criminal history may have a direct, adverse and negative relationship on the following job duties, potentially resulting in the withdrawal of the conditional offer of employment:
1. Interacting and occasionally having unsupervised contact with internal/external clients and/or colleagues;
2. Appropriately handling and managing confidential information including proprietary and trade secret information and access to information technology systems; and
3. Exercising sound judgment.
About Doubao (Seed)
Founded in 2023, the ByteDance Doubao (Seed) Team, is dedicated to pioneering advanced AI foundation models. Our goal is to lead in cutting-edge research and drive technological and societal advancements.
With a strong commitment to AI, our research areas span deep learning, reinforcement learning, Language, Vision, Audio, AI Infra and AI Safety. Our team has labs and research positions across China, Singapore, and the US.
Why Join ByteDance
Inspiring creativity is at the core of ByteDance's mission. Our innovative products are built to help people authentically express themselves, discover and connect – and our global, diverse teams make that possible. Together, we create value for our communities, inspire creativity and enrich life - a mission we work towards every day.
As ByteDancers, we strive to do great things with great people. We lead with curiosity, humility, and a desire to make impact in a rapidly growing tech company. By constantly iterating and fostering an "Always Day 1" mindset, we achieve meaningful breakthroughs for ourselves, our Company, and our users. When we create and grow together, the possibilities are limitless. Join us.
Diversity & Inclusion
ByteDance is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At ByteDance, our mission is to inspire creativity and enrich life. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.
Reasonable Accommodation
ByteDance is committed to providing reasonable accommodations in our recruitment processes for candidates with disabilities, pregnancy, sincerely held religious beliefs or other reasons protected by applicable laws. If you need assistance or a reasonable accommodation, please reach out to us at https://tinyurl.com/RA-request
