Azure Data Architect: Cloud Pipelines & ETL Lead

Ethereum Technologies LLC; Jefferson City (MO); On-site; USD 90,000 - 130,000; Full time

Job summary

Ethereum Technologies LLC is seeking a data engineering professional to design, build, and maintain cloud-based data pipelines for analytics and BI. You will modernize legacy ingestion and ETL/ELT processes using Azure and AWS tools, while ensuring data security and regulatory compliance.

You will collaborate with data scientists, analysts, and business stakeholders to deliver scalable data architectures and high-quality solutions across on-prem and cloud environments.

Qualifications

• 4+ years designing and implementing data warehouse and analytics solutions (on-prem and cloud).
• 3+ years in data warehousing concepts with hands-on experience using ADF, Data Factory, SSIS.
• 2+ years Python/Scala/Java for distributed processing and analytics with Spark.

Responsibilities

• Provide technical leadership in modernizing legacy data ingestion, ETL/ELT, and databases to cloud technologies (AWS/Azure).
• Implement data access, classification, and security patterns that comply with regulatory standards (PII, locational data, contractual obligations).
• Collaborate with stakeholders, business analysts, and SMEs to translate business requirements into scalable solutions.
• Integrate data from multiple sources into cloud-based architectures, collaborating with cross-functional teams.
• Work closely with data scientists, analysts, and stakeholders to meet data requirements with high-quality solutions.
• Design and map ETL/ELT pipelines for new or modified data streams, ensuring integration into on-prem or cloud-based data storage.
• Automate, validate and maintain ETL/ELT processes using technologies such as Databricks, ADF, SSIS, Spark, Python, and Scala.
• Conduct unit, system, and integration testing for ETL/ELT solutions, ensuring defects are resolved.
• Create detailed documentation for data processes, architectures, and workflows.
• Monitor and optimize the performance of data pipelines and databases.

Skills

Data warehousing

Python/Scala/Java

CI/CD practices

Azure data services

Tools

ADF/Data Factory

SSIS

Databricks

Spark

Python

Scala

Java

Azure DevOps

Git

Jenkins

Job description

Ethereum Technologies LLC is seeking a data engineering professional to design, build, and maintain cloud-based data pipelines for analytics and BI. You will modernize legacy ingestion and ETL/ELT processes using Azure and AWS tools, while ensuring data security and regulatory compliance.

You will collaborate with data scientists, analysts, and business stakeholders to deliver scalable data architectures and high-quality solutions across on-prem and cloud environments.