Senior Data Engineer: Scalable Pipelines & Data Warehouses

Ethereum Technologies; Jersey City (NJ); Sur place; USD 120 000 - 160 000; Plein temps

Résumé du poste

Ethereum Technologies is seeking an experienced Data Engineer to build scalable data pipelines, warehouses, and integration solutions, transforming raw data into analytics-ready datasets for BI, reporting, and data science initiatives.

The role requires strong Python and SQL, PySpark, cloud platforms (AWS/Azure/GCP), and experience with Snowflake, Redshift, Databricks, Spark, Kafka; you will design ETL/ELT processes, optimize queries, ensure data quality, and collaborate with analysts and

Qualifications

• Bachelor's degree in a technical field or equivalent experience.
• 5+ years of experience in data engineering, data integration, or ETL development.
• Strong proficiency in Python, SQL, and data transformation techniques.
• Hands-on experience with cloud data platforms and distributed processing.
• Understanding of relational databases, data warehousing, and data lake architecture.
• Experience with performance tuning, debugging, and production support.

Responsabilités

• Design, develop, and maintain robust ETL/ELT pipelines for structured and semi-structured data.
• Ingest data from APIs, databases, files, and streaming sources.
• Build scalable data transformation workflows using Python, SQL, and Spark.
• Develop and optimize data warehouse tables, data models, and analytical datasets.
• Implement batch and real-time data processing solutions.
• Improve query performance, pipeline reliability, and data processing efficiency.
• Implement data quality checks, validation rules, reconciliation, and error-handling mechanisms.
• Monitor production pipelines and troubleshoot data failures.
• Apply data security, access controls, and governance standards.
• Collaborate with data analysts, data scientists, architects, and business stakeholders.
• Automate deployments and support CI/CD practices.
• Maintain technical documentation and participate in Agile development activities.

Connaissances

Python

SQL

PySpark

Informatica

Azure Data Factory

AWS Glue

Snowflake

Databricks

Amazon Redshift

Google BigQuery

Apache Spark

Hadoop

Kafka

PostgreSQL

SQL Server

Oracle

MySQL

AWS

Azure

GCP

Star schema

Snowflake schema

Dimensional modeling

Data warehouse design

Git

CI/CD

Docker

Automated testing

Formation

Bachelor's degree in Computer Science, Information Technology, Engineering, or related field

Description du poste

Ethereum Technologies is seeking an experienced Data Engineer to build scalable data pipelines, warehouses, and integration solutions, transforming raw data into analytics-ready datasets for BI, reporting, and data science initiatives.

The role requires strong Python and SQL, PySpark, cloud platforms (AWS/Azure/GCP), and experience with Snowflake, Redshift, Databricks, Spark, Kafka; you will design ETL/ELT processes, optimize queries, ensure data quality, and collaborate with analysts and