Responsibilities
Team Introduction We are the AI Vertical Scenarios Team under the Corporate Information Systems department. Our core mission is to serve ByteDance's global internal office scenarios as the standard-setter for AI-native applications and the driver of globally consistent experiences — we both build flagship AI application scenarios in-house and, using a full-scope evaluation suite as our measurement foundation, drive functional and experiential parity between CN and non-CN regions across core scenarios. Every feature you ship here is backed by the real, everyday usage and feedback of ByteDance employees worldwide. Here, you'll be deeply involved in the entire journey of an enterprise AI product — from idea to launch! Responsibilities 1. Lead evaluation product planning and system design: for core scenarios such as AI Agents and Coding Agents, design the evaluation framework, workflow, and product mechanisms, turning frontier capabilities into reusable and continuously evolving evaluation systems; 2. Uncover the real needs of enterprise users: distill users' core pain points through interviews, data analysis, and behavioral insights, and drive them into the product; 3. Drive evaluation engineering and cross-functional collaboration: work closely with algorithm, engineering, and data teams to build evaluation platforms, automated pipelines, and result dashboards so evaluation can directly support model optimization and product decisions.
Qualifications
Minimum Qualifications - Bachelor's degree or above; backgrounds in Computer Science, Artificial Intelligence, Information Management, Statistics, or related fields； - Solid structured thinking and sustained interest at the intersection of evaluation, data, and AI products are important; - Clear logical thinking, self-driven, and user-value oriented; able to think from the user's perspective to solve problems, with strong communication and cross-team collaboration skills; - Genuine interest in AI products, model evaluation, and benchmark systems, with a habit of following the latest developments in the LLM / Agent space; - Familiar with AI / Agent tools such as Claude Code, Cursor, Codex. Preferred Qualifications - Experience using, analyzing, or building around third-party benchmarks such as SWE-Bench is a plus; - Understanding of evaluation automation, data processing, or experiment pipelines is preferred; hands-on experience building agents, evaluation platforms, or AI applications is a plus.
Job Information
About Us
Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Lemon8, CapCut and Pico as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create content.
Why Join ByteDance
Inspiring creativity is at the core of ByteDance's mission. Our innovative products are built to help people authentically express themselves, discover and connect – and our global, diverse teams make that possible. Together, we create value for our communities, inspire creativity and enrich life - a mission we work towards every day.
As ByteDancers, we strive to do great things with great people. We lead with curiosity, humility, and a desire to make impact in a rapidly growing tech company. By constantly iterating and fostering an "Always Day 1" mindset, we achieve meaningful breakthroughs for ourselves, our Company, and our users. When we create and grow together, the possibilities are limitless. Join us.
Diversity & Inclusion
ByteDance is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At ByteDance, our mission is to inspire creativity and enrich life. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.
