Senior Platform Architect - Enterprise AI Agent
ByteDance
A complete application in a minute — tailored resume and cover letter, ready to send.
Job summary
ByteDance in San Jose seeks an architect-level contributor to lead design and adoption of enterprise AI agent capabilities, AI harness platforms, and RAG-based knowledge bases across the organization.
You will partner with product, engineering, data, security, and business teams to identify high-value AI use cases, shape platform roadmaps, and drive enterprise-wide adoption with governance and security considerations.
Qualifications
- BS degree in Computer Science, similar technical field of study or equivalent practical experience.
- Experience working with two or more of the following: web application development, Unix/Linux environments, distributed and parallel systems, networking systems, developing large software systems.
- 5+ years software development experience preferably with Golang or Python.
- Experience driving enterprise AI adoption across multiple business units or internal product teams.
- Prior experience combining architect-level technical ownership with product management responsibilities.
- Strong understanding of AI system tradeoffs, including cost, latency, accuracy, reliability, safety, and user experience.
Responsibilities
- Lead design, development, and adoption of enterprise AI agent capabilities and AI harness platforms.
- Define architecture principles, patterns, and governance for enterprise AI agent and RAG-based development.
- Partner with product, engineering, data, security and business teams to identify high-value AI use cases and guide them to production.
- Provide technical leadership on AI reliability, scalability, observability, cost optimization, privacy, security, and responsible AI practices.
- Apply product management thinking to define platform vision, user journeys, and adoption metrics.
- Influence stakeholders to align AI platform capabilities with enterprise strategy.
- Mentor engineers and platform teams through architecture reviews and deep-dives.
Skills
Education
Tools
Job description
The DCS platform team's goal is to build all the necessary and advanced tooling to support full-lifecycle operation and management of domestic and overseas data centers, covering data center infrastructure operation and maintenance, server delivery, server operation, asset and resource management, platform tooling, as well as cloud services and server system services.
We are looking for an architect-level contributor to lead the design, development, and adoption of enterprise AI agent capabilities, AI harness platforms, RAG-based knowledge base systems, and emerging AI technologies across the organization.
This role requires deep technical architecture expertise, strong hands-on understanding of AI platforms, and product management capabilities to identify business needs, shape platform capabilities, and drive enterprise-wide adoption.
- Possess an in-depth understanding of the history and industry trends in Server Operations and Data Center operations platform development from production point of view. Be familiar with Volcano (Volcengine) and edge server / Data Center requirements and their differences globally. Acquire knowledge of both domestic and non-domestic GPU hardware architectures, firmware baselines, and performance stress testing. Master high-power-density and high-compute-density rack-level solutions, including cold-plate liquid cooling integrated with air cooling, PowerShelf, SideCar, and RDMA copper / optical interconnects such as NVLINK or HCCS. Leverage the AI Factory approach to address challenges at the AI infrastructure layer.
- Define the technical architecture and roadmap for enterprise AI agent platforms, including AI harness, agent orchestration, tool integration, workflow automation, memory, evaluation, observability, and governance capabilities.
- Partner with product, engineering, data, security, and business teams to identify high-value AI use cases and guide them from concept to production.
- Establish architecture principles, design patterns, best practices, and governance standards for enterprise AI agent and RAG-based application development.
- Provide technical leadership on AI reliability, scalability, observability, cost optimization, privacy, security, compliance, and responsible AI practices.
- Apply product management thinking to define platform vision, user journeys, feature priorities, adoption metrics, rollout plans, and feedback loops.
- Influence stakeholders across business and technology teams to align AI platform capabilities with enterprise strategy.
- Mentor engineers and platform teams through architecture reviews, technical deep dives, prototypes, and implementation guidance.
- BS degree in Computer Science, similar technical field of study or equivalent practical experience.
- Experience working with two or more of the following: web application development, Unix/Linux environments, distributed and parallel systems, networking systems, developing large software systems.
- 5+ years software development experience preferably with Golang or Python.
- Experience driving enterprise AI adoption across multiple business units or internal product teams.
- Prior experience combining architect-level technical ownership with product management responsibilities.
- Strong understanding of AI system tradeoffs, including cost, latency, accuracy, reliability, safety, and user experience.
- Experience building or architecting enterprise AI agent platforms, AI harness platforms, RAG-based knowledge bases, model gateways, evaluation platforms, or internal AI developer platforms.
- Deep familiarity with modern LLM ecosystems, including agent frameworks, vector databases, embedding models, reranking models, model routing, evaluation tooling, and AI governance.
- Experience with enterprise knowledge management systems, document intelligence, semantic search, taxonomy design, or knowledge quality evaluation.
- Experience with security, compliance, data privacy, access control, auditability, and responsible AI practices in enterprise AI systems.
- Publications, patents, open-source contributions, or recognized technical leadership in AI, platform architecture, or enterprise software are a plus.
Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Lemon8, CapCut and Pico as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create content.
Inspiring creativity is at the core of ByteDance's mission. Our innovative products are built to help people authentically express themselves, discover and connect – and our global, diverse teams make that possible. Together, we create value for our communities, inspire creativity and enrich life - a mission we work towards every day.
As ByteDancers, we strive to do great things with great people. We lead with curiosity, humility, and a desire to make impact in a rapidly growing tech company. By constantly iterating and fostering an "Always Day 1" mindset, we achieve meaningful breakthroughs for ourselves, our Company, and our users. When we create and grow together, the possibilities are limitless. Join us.
ByteDance is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At ByteDance, our mission is to inspire creativity and enrich life. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.
ByteDance is committed to providing reasonable accommodations in our recruitment processes for candidates with disabilities, pregnancy, sincerely held religious beliefs or other reasons protected by applicable laws. If you need assistance or a reasonable accommodation, please reach out to us at https://tinyurl.com/RA-request
【For Pay Transparency】Compensation Description (Annually)
The base salary range for this position in the selected city is $218400 - $480000 annually.
Compensation may vary outside of this range depending on a number of factors, including a
'/%3e%3cpath%20d='M101.744%2012.4726L102.894%2016.1947L99.0021%2013.2201L101.744%2012.4726ZM105.3%208.40937H100.488L99.0026%203.59473L97.5116%208.41047L92.7%208.40385L96.5965%2011.3834L95.1055%2016.1942L99.0021%2013.2196L101.408%2011.3834L105.3%208.40992V8.40937Z'%20fill='white'/%3e%3cdefs%3e%3clinearGradient%20id='paint0_linear_5593_1381'%20x1='90'%20y1='9.44471'%20x2='99'%20y2='9.44471'%20gradientUnits='userSpaceOnUse'%3e%3cstop%20stop-color='%2300AD70'/%3e%3cstop%20offset='0.998594'%20stop-color='%2300B67A'/%3e%3cstop%20offset='1'%20stop-color='%23DCDCE6'/%3e%3c/linearGradient%3e%3c/defs%3e%3c/svg%3e){kind=small}
