Senior Data Engineer: Big Data Pipelines & ETL

6Sense; San Francisco (CA); On-site; USD 179,400 - 263,120; Full time

Benefits offered by this job

Health insurance

Paid parental leave

Generous paid time-off

Quarterly self-care days off

Stock options

Job summary

6Sense is looking for a Data Engineer in San Francisco to design and build robust big data systems and data transformations. Candidates should have a BS/MS in Computer Science or a related field, along with strong experience in Big Data technologies like Hadoop and Spark. The position emphasizes the importance of communication skills and a collaborative mindset, ensuring both technical and non-technical stakeholders understand engineering concepts. Comprehensive benefits include health insurance, a 401K matching program, and generous PTO.

Qualifications

• Experience in Big Data technologies including Hadoop and Spark is required.
• Hands-on experience with data ingestion, data integration, and ETL processes.
• Strong skills in schema design and SQL queries are essential.

Responsibilities

• Design and build data transformations efficiently for various purposes.
• Implement reliable, scalable big data systems that support core products.
• Establish engineering design standards for technical and non-technical stakeholders.

Skills

Big Data technologies (Hadoop, M/R, Hive, Spark, Flink, Metastore, Presto, Kafka)

Data analysis

ETL (Extraction, Transformation & Loading)

SQL queries

Django framework (nice to have)

AWS exposure (nice to have)

Education

BS/MS in Computer Science or related field

Tools

AI coding assistants (e.g., Claude Code, Windsurf)

Job description

6Sense is looking for a Data Engineer in San Francisco to design and build robust big data systems and data transformations. Candidates should have a BS/MS in Computer Science or a related field, along with strong experience in Big Data technologies like Hadoop and Spark. The position emphasizes the importance of communication skills and a collaborative mindset, ensuring both technical and non-technical stakeholders understand engineering concepts. Comprehensive benefits include health insurance, a 401K matching program, and generous PTO.