Senior Data Engineer — Big Data Pipelines & Spark Expert

Intuit; Mountain View (CA); On-site; USD 202,500 - 274,000; Full time

Job summary

Intuit in Mountain View is seeking a Staff Software Engineer in Data to join the QuickBooks Capital and Lending Platform. You will design and build enterprise-scale data pipelines using Python, PySpark, Spark, SQL, DataBricks, AWS, and Kafka, working primarily hands-on.

Ideal candidates have 7+ years in data engineering, experience with large codebases, SDLC, and cross-functional collaboration. This role emphasizes on-call production support and delivering scalable data solutions for capital

Qualifications

• 7+ years’ experience building data engineering pipelines.
• Experience with Python, PySpark, Spark, SQL, DataBricks, AWS, Elasticsearch, Kafka.
• Experience with Big Data technologies.
• Proven ability to understand large codebases.
• SDLC experience and production support expertise.

Responsibilities

• Understand requirements, design technical solutions, code and test.
• Size work and manage timelines for medium to large tasks.
• Design/develop software using data engineering tech.
• Spend ~90% hands-on designing, coding, testing, and supporting production systems.

Skills

Data engineering

Python

PySpark

Spark

SQL

DataBricks

AWS

Elasticsearch

Kafka

Codebase understanding

Education

BS/MS in computer science or equivalent

Tools

Python tooling

Spark tooling

Data pipelines tooling

Cloud services

Job description

Intuit in Mountain View is seeking a Staff Software Engineer in Data to join the QuickBooks Capital and Lending Platform. You will design and build enterprise-scale data pipelines using Python, PySpark, Spark, SQL, DataBricks, AWS, and Kafka, working primarily hands-on.

Ideal candidates have 7+ years in data engineering, experience with large codebases, SDLC, and cross-functional collaboration. This role emphasizes on-call production support and delivering scalable data solutions for capital