Staff Data Engineer: Large-Scale Data Pipelines & Spark

Intuit, Inc.; Mountain View (CA); Hybrid; USD 203,000 - 274,000; Full time

Job summary

Intuit, Inc. is seeking a Staff Software Engineer in Data for the QuickBooks Capital and Lending Platform in Mountain View. You will design and implement data engineering pipelines using Python, PySpark, Spark, SQL and DataBricks on AWS, with on-call production support. 7+ years in data engineering is preferred.

The role emphasizes hands-on development, cross-functional collaboration, and adherence to SDLC and Agile practices in a fast-paced environment.

Qualifications

• 7+ years of experience building data engineering pipelines.
• Proven experience with Python, PySpark and Spark.
• Experience with SDLC and large-scale enterprise data systems.

Responsibilities

• Size and design medium to large work items with timelines.
• Develop software using data engineering tech.
• Spend 90% time hands-on designing, coding, testing and on-call support.
• Debug and patch defects across test, pre-prod and production.
• Collaborate with product, engineering, and business teams.
• Follow Agile Scrum or XP methodologies.
• Data modeling, warehousing and ETL pipelines.
• Production support via quarterly on-call rotations.

Skills

Python

PySpark

Spark

SQL

DataBricks

AWS

Elasticsearch

Kafka

Big Data

Education

BS/MS in computer science

Job description

Intuit, Inc. is seeking a Staff Software Engineer in Data for the QuickBooks Capital and Lending Platform in Mountain View. You will design and implement data engineering pipelines using Python, PySpark, Spark, SQL and DataBricks on AWS, with on-call production support. 7+ years in data engineering is preferred.

The role emphasizes hands-on development, cross-functional collaboration, and adherence to SDLC and Agile practices in a fast-paced environment.