Responsibilities

About the team Seed Global Data is a team focused on producing international data for LLMs. For the training of large models, data is the lifeline of model quality — and the Global Data team is working closely with technical, product, and operations teams to ensure effective data production strategies and execution management. As a key member of our LLM Global Data Team, the LLM Training Operations Analyst will play a pivotal role in managing the intricate processes involved in training Large Language Models (LLMs) with diverse datasets. This role focuses on overseeing and improving operational workflows, ensuring that projects are delivered with high quality and efficiency, while leveraging advanced data analysis and prompt engineering capabilities to drive strategic decision making. Key Responsibilities and Duties: - Project and Workflow Management: Design, manage, and optimize workflows for LLM training projects, including training design, QA processes, and performance tracking. Lead multiple projects while ensuring timelines, quality standards, and objectives are met, tracking progress and implementing corrective actions as needed. Collaborate with product managers, engineers, and cross-functional teams to ensure alignment on quality metrics, coordinate global team meetings, and manage external vendor relationships. - Prompt Engineering and Model Optimization: Apply prompt engineering expertise to optimize model training and evaluation projects. Design and implement prompts that enhance model performance for both technical training tasks and administrative workflow automation. Continuously refine prompting strategies to improve project outcomes and operational efficiency. - Data Analysis and Strategic Thinking: Lead comprehensive data manipulation and analysis initiatives to support operational decision-making, managing no-code data platforms like Airtable and Lark Base for data organization. Create dynamic dashboards in sheets and other spreadsheet tools, and manage no-code data tables to conduct rapid analysis that answers critical operational questions. Connect all analytical work directly to overarching organizational goals and strategic initiatives, ensuring data-driven decision-making across projects. - Operational Improvement: Conduct quality and productivity improvement experiments to enhance operational processes. Lead and support general annotation operation improvement initiatives across various data domains. Develop and maintain guidelines and casebooks to support consistent, high-quality data production. - Team Leadership and Collaboration: Provide mentorship and guidance to team members, helping to develop their skills and ensuring the delivery of high-quality outputs. Foster a collaborative environment where team members can share knowledge and best practices to improve overall performance.

Qualifications

Minimum Qualifications: - 3+ years of experience in project or operations management roles - Demonstrated experience with data manipulation and analysis, including proficiency with no-code data platforms (Airtable, Lark Base, or similar) - Proven ability to create dashboards and conduct rapid analysis to support operational and strategic decision making - Experience in LLM training and eval project management and prompt engineering for model optimization - Ability to balance independent judgment with collaborative teamwork in a fast-paced, project-based environment - Enthusiasm for learning, engaging with diverse case studies, and working with global teams - Comfort with technology and tools that enhance project and team performance Preferred Qualifications - SQL proficiency for complex data extraction and analysis - Advanced prompt engineering experience with demonstrated ability to optimize models for both technical and administrative applications - Strong track record of connecting analytical work to overarching organizational goals and strategic initiatives - Proven ability to lead and mentor entry-level team members

Job Information