A complete application in a minute
Tailored resume and cover letter, ready to send.
Ethereum Technologies seeks a senior data engineer to design and optimize data pipelines on Azure, leveraging Data Factory and Databricks. You will implement modular data engineering code in Python or Scala, optimize SQL for large-scale datasets, and collaborate with stakeholders on testing and delivery.
Ideal candidate has 8–10 years in data engineering, 3+ years Azure experience, and hands-on work with ADLS Gen2, Parquet and Delta Lake.
US Citizen, Green Card, H-1B, OPT-EAD, CPT, Other
Work Authorization: US Citizen, Green Card, OPT-EAD, CPT, H-1B, H4-EAD, Other
Job Description:
Develop Azure Data Factory pipelines, data flows, triggers, integration runtimes, and parameterized workflows.
Build and optimize Azure Databricks notebooks, jobs, workflows, and Delta Lake solutions.
Develop modular data engineering code using Python or Scala with unit testing practices.
Write and tune advanced SQL queries using CTEs, window functions, and large datasets.
Manage data storage and optimization using ADLS Gen2, Parquet, partitioning, Z-Ordering, OPTIMIZE, and VACUUM.
Support Git-based CI/CD and promotion across Azure Data Factory and Databricks environments.
Collaborate with stakeholders and participate in testing and delivery activities.
Required Skills & Experience
8-10 years of data engineering experience
At least 3 years of Azure experience
Advanced SQL
Python or Scala
Experience with large datasets and data pipeline optimization
We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.