Senior Data Engineer: Scalable ETL & Lakehouse Pipelines

Ethereum Technologies; San Jose (CA); On-site; USD 130,000 - 200,000; Full time

Job summary

Ethereum Technologies is seeking a data engineer to design, develop, and maintain scalable data pipelines and ETL workflows. You will work with Python, SQL, PySpark, and cloud tools like Azure Data Factory, Databricks, and Snowflake to integrate data across systems and deliver analytics-ready datasets.

The role emphasizes collaboration with data analysts, data scientists, and business teams, while participating in Agile ceremonies and CI/CD practices to ensure reliable data delivery.

Qualifications

• Bachelor's degree required in CS/IT or related field.
• Experience building data pipelines and ETL/ELT processes.
• Proficient in Python, SQL, and PySpark.
• Experience with cloud platforms and data warehousing.
• Strong data modeling and data integration understanding.
• Excellent analytical, problem-solving, debugging, and communication skills.

Responsibilities

• Designed, developed, and maintained scalable data pipelines to extract, transform, and load data from multiple sources.
• Developed ETL/ELT workflows using Python, SQL, PySpark, and Azure Data Factory.
• Built and optimized data processing solutions using Apache Spark and Databricks.
• Integrated data from multiple enterprise systems using REST APIs and database connectors.
• Monitored data pipelines, identified failures, and resolved performance and data processing issues.
• Implemented incremental data loading, partitioning, and optimization techniques to improve pipeline performance.
• Worked with Snowflake for data loading, transformation, query optimization, and warehouse management.
• Used Git and Azure DevOps for source control, CI/CD, and deployment management.
• Collaborated with data analysts, data scientists, and business teams to understand data requirements.
• Participated in Agile/Scrum ceremonies, technical discussions, code reviews, and production support.

Skills

Analytical thinking

Problem-solving

Communication skills

Collaboration

Education

Bachelor's degree in Computer Science, Information Technology, or related field

Tools

Python

SQL

PySpark

Azure Data Factory

Databricks

Snowflake

Git

Azure DevOps

Job description

Ethereum Technologies is seeking a data engineer to design, develop, and maintain scalable data pipelines and ETL workflows. You will work with Python, SQL, PySpark, and cloud tools like Azure Data Factory, Databricks, and Snowflake to integrate data across systems and deliver analytics-ready datasets.

The role emphasizes collaboration with data analysts, data scientists, and business teams, while participating in Agile ceremonies and CI/CD practices to ensure reliable data delivery.