Technical Lead — Data Platform Engineer for AI Delivery

XYZ Venture Capital

Mountain View (CA)

Hybrid

USD 180,000 - 220,000

Full time

14 days+
Application generator

Don’t send a generic resume — generate a resume and cover letter tailored to this exact role.

Get past ATS filters

Benefits offered by this job

Competitive salary
Comprehensive healthcare benefits
FSA
Flexible work schedule
EAP
Parental Leave
Team events
Internet reimbursement

Job summary

Harness in Mountain View is seeking a talented Data Platform Engineer to lead data pipelines and infrastructure. You will design, implement, and optimize scalable systems while aligning with data analytics needs across teams.

The role emphasizes data quality, reliability, and governance, with opportunities to mentor juniors and influence data strategy within a hybrid work setup.

Qualifications

  • Bachelor's degree in CS/Engineering or related field required.
  • 9+ years of data engineering experience with warehousing, ETL/ELT, and modeling.
  • Strong programming in Python/Java/Scala and SQL.

Responsibilities

  • Design, build, and maintain scalable data pipelines and infrastructure.
  • Collaborate with data scientists and analysts to meet business needs.
  • Implement data quality checks and ensure data integrity.
  • Optimize pipelines for performance and efficiency.
  • Document architecture, processes, and workflows.
  • Provide guidance to junior engineers.

Skills

Python
Java
Scala
Big Data
SQL
Cloud
SQL/NoSQL
Tableau/BI
Communication
Problem solving

Education

Bachelor's degree in CS/Engineering
Master's degree preferred

Tools

Docker
Kubernetes
CI/CD tooling

Job description

Harness is the AI Software Delivery Platform company, led by technologist and entrepreneur Jyoti Bansal (founder of AppDynamics, acquired by Cisco for $3.7B). Harness has raised approximately $570M in funding and is valued at $5.5B, backed by leading investors including Goldman Sachs, Menlo Ventures, IVP, Unusual Ventures, Citi Ventures, and more. As AI accelerates code creation, the real bottleneck has shifted to everything after the code – testing, deployments, application security, reliability, compliance, and cost optimization. Harness brings AI and automation to this “outer loop,” helping teams ship software faster while maintaining security and governance throughout the entire software delivery lifecycle.

Powered by Harness AI and the Software Delivery Knowledge Graph, the Harness Platform applies deep context and intelligent automation across the software delivery lifecycle with governance and policy-driven controls embedded throughout the platform.

Over the past year, Harness powered over 185M deployments, 82M builds, 18T flag evaluations, 8M security scans, 9.1B optimized tests, 3T protected API calls, and helped manage $2.8B in cloud spend — enabling customers like United Airlines, Morningstar, and Choice Hotels to accelerate releases by up to 75%, reduce cloud costs by up to 60%, and achieve 10x DevOps efficiency.

With a global team across 26 offices and 27 countries, Harness is shaping the future of AI software delivery — and we’re looking for exceptional talent to help us move even faster.

Position Summary
We are seeking a talented and experienced Data Platform Engineer to join our team as the Technical Lead. The ideal candidate will be responsible for designing, developing, and maintaining our data pipelines and infrastructure. They will work closely with cross-functional teams to understand data requirements, implement solutions, and ensure data quality and reliability. The data engineer will also be involved in optimizing data processes and supporting data analytics initiatives.
About the role
  • Design, build, and maintain scalable data pipelines and infrastructure to support data ingestion, processing, and storage.
  • Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and develop solutions to meet business needs.
  • Implement data quality checks and ensure data integrity and reliability throughout the data lifecycle.
  • Optimize and tune data pipelines for performance and efficiency.
  • Troubleshoot and debug data-related issues, and provide timely resolution.
  • Stay updated with the latest technologies and best practices in data engineering and apply them to improve existing systems.
  • Document data architecture, processes, and workflows.
  • Provide support and guidance to junior members of the team.
About you
  • Bachelor's degree in Computer Science, Engineering, or related field. Master's degree preferred.
  • 9+ yrs of proven experience as a data engineer or similar role, with a strong background in data warehousing, ETL/ELT processes, and data modeling.
  • Proficiency in programming languages such as Python, Java, or Scala.
  • Experience with big data technologies such as BigQuery, Spark, Kafka, DBT, SQLMesh etc.
  • Hands-on experience with cloud platforms such as AWS, Azure, or Google Cloud.
  • Strong SQL skills and experience working with relational and NoSQL databases.
  • Familiarity with data visualization tools such as Tableau, Power BI, or Looker.
  • Excellent problem-solving and analytical skills.
  • Strong communication and collaboration skills, with the ability to work effectively in a team environment.

Preferred Experience

  • Experience with containerization and orchestration tools such as Docker and Kubernetes.
  • Knowledge of machine learning techniques and frameworks.
  • Experience with DevOps practices and tools for CI/CD.
Work Location

Mountain View, CA - Hybrid (3 days / week onsite)

What you will have at Harness
  • Competitive salary
  • Comprehensive healthcare benefits
  • Flexible Spending Account (FSA)
  • Flexible work schedule
  • Employee Assistance Program (EAP)
  • Flexible Time Off and Parental Leave
  • Monthly, quarterly, and annual social and team building events
  • Monthly internet reimbursement
Pay transparency
$180,000—$220,000 USD
Harness in the news:

All qualified applicants will receive consideration for employment without regard to race, color, religion, sex or national origin.

At Harness, we care about your privacy and are committed to protecting your personal data. For additional information on this topic, you can visit our privacy Portal: https://harness-privacy.relyance.ai/

Note on Fraudulent Recruiting/Offers

We have become aware that there may be fraudulent recruiting attempts being made by people posing as representatives of Harness. These scams may involve fake job postings, unsolicited emails, or messages claiming to be from our recruiters or hiring managers.

Please note, we do not ask for sensitive or financial information via chat, text, or social media, and any email communications will come from the domain @harness.io. Additionally, Harness will never ask for any payment, fee to be paid, or purchases to be made by a job applicant. All applicants are encouraged to apply directly to our open jobs via our website. Interviews are generally conducted via Zoom video conference unless the candidate requests other accommodations.

If you believe that you have been the target of an interview/offer scam by someone posing as a representative of Harness, please do not provide any personal or financial information and contact us immediately at security@harness.io. You can also find additional information about this type of scam and report any fraudulent employment offers via the Federal Trade Commission’s website (https://consumer.ftc.gov/articles/job-scams), or you can contact your local law enforcement agency.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Java Engineer, AI-Driven SDLC Platform (Remote)
Senior Java Engineer, AI-Driven SDLC Platform (Remote)

XYZ Venture Capital • United States

On-site
USD 150,000 - 255,000
Competitive salary
Healthcare benefits
FSA
+6
Staff Software Engineer - Data Platform
Staff Software Engineer - Data Platform

XYZ Venture Capital • Mountain View (CA)

On-site
USD 180,000 - 220,000
Competitive salary
Comprehensive healthcare benefits
FSA
+5
Staff Software Engineer - Data Platform
Staff Software Engineer - Data Platform

Harness • Mountain View (CA)

On-site
USD 180,000 - 220,000
Competitive salary
Comprehensive healthcare benefits
Flexible Spending Account (FSA)
+5
Remote Sales Engineer - AI Software Delivery Expert
Remote Sales Engineer - AI Software Delivery Expert

XYZ Venture Capital • San Francisco (CA)

On-site
USD 220,000 - 290,000
Competitive salary
Comprehensive healthcare benefits
Flexible Time Off
+1
Staff Software Engineer, SCS Platform & Security
Staff Software Engineer, SCS Platform & Security

Armory • Mountain View (CA)

On-site
USD 150,000 - 226,000
Comprehensive healthcare benefits
Flexible Spending Account
Employee Assistance Program
+6
Senior Sales Engineer, AI Software Delivery Platform
Senior Sales Engineer, AI Software Delivery Platform

Armory • New York (NY)

On-site
USD 120,000 - 180,000
Senior IT Systems Administrator: Automation, Security & Scale
Senior IT Systems Administrator: Automation, Security & Scale

XYZ Venture Capital • Mountain View (CA)

Hybrid
USD 80,000 - 110,000
Healthcare benefits
FSA
Flexible schedule
+4
Senior AI Solutions Engineer - Software Delivery
Senior AI Solutions Engineer - Software Delivery

XYZ Venture Capital • Tampa (FL)

On-site
USD 210,000 - 290,000
Competitive salary
Healthcare benefits
FSA
+5
Senior Technical Content Strategist: AI Software Delivery
Senior Technical Content Strategist: AI Software Delivery

Armory • San Francisco (CA)

Hybrid
USD 150,000 - 165,000
Competitive salary
Comprehensive healthcare benefits
Flexible Spending Account (FSA)
+5
Sales Engineer: AI-Driven Software Delivery
Sales Engineer: AI-Driven Software Delivery

Armory • Boston (MA)

On-site
USD 250,000 - 275,000
Competitive salary
Comprehensive healthcare benefits
Flexible Spending Account (FSA)
+5