Cloud Data Engineer - Big Data Pipelines & Analytics

Ethereum Technologies; Maryland; On-site; USD 77,000 - 110,000; Full time

Job summary

Ethereum Technologies is seeking a Data Engineer in Maryland to design, build, and maintain scalable data pipelines and cloud-based data solutions. You will work with AWS services, Airflow, and other tools to process large, diverse datasets for policy-relevant research and performance analytics.

You will collaborate with data scientists and policy analysts to deliver reproducible research, dashboards, and decision-support products while ensuring data quality and governance compliance.

Qualifications

• Advanced SQL skills and experience with relational databases.
• Experience designing and optimizing big data pipelines and architectures.
• Proven ability to develop dashboards, reports, and analytics products for stakeholders.

Responsibilities

• Design, build, and maintain scalable data pipeline architectures.
• Develop cloud-based data solutions using AWS services such as S3, EC2, Glue, EMR, RDS, Redshift, Athena, Lambda, and DynamoDB.
• Build and maintain data orchestration workflows using Apache Airflow, AWS Step Functions, or similar tools.
• Extract, transform, integrate, and process large datasets from multiple sources using SQL and big data technologies.
• Develop analytical data environments supporting statistical analysis, predictive modeling, machine learning, and evidence-based research.
• Collaborate with data scientists, research analysts, and policy analysts to support reproducible research and statistical modeling.
• Build analytics tools, dashboards, reports, analytical models, and decision-support products.
• Support analysis of education and workforce outcomes, operational efficiency, and key business performance metrics.
• Develop and maintain pipeline monitoring, alerting, logging, data quality checks, and validation frameworks.
• Identify and resolve data quality issues through root-cause analysis.
• Automate manual processes and optimize data delivery, infrastructure scalability, and system performance.
• Support data conversions associated with system modernization and replacement initiatives.
• Work with executive, data, design, and support teams to address technical issues and infrastructure requirements.
• Ensure compliance with Commonwealth policies, data governance standards, privacy requirements, security controls, and interagency data-sharing agreements.
• Develop and optimize data tools that support analytics and data science teams.
• Advanced SQL skills and strong experience working with relational databases and various database technologies.
• Experience designing and optimizing big data pipelines, architectures, and datasets.
• Experience developing dashboards, reports, analytical models, and decision-support products for executive and non-technical stakeholders.
• Experience working with student-level higher education data and linking it with external sources, such as employment and wage data, to measure outcomes.
• Strong experience performing root-cause analysis on internal and external data.
• Strong analytical skills and experience working with structured and unstructured datasets.
• Experience with data transformation, data structures, metadata, dependencies, and workload management.
• Proven ability to process, manipulate, and extract insights from large, disconnected datasets.
• Working knowledge of message queuing, stream processing, and scalable big data storage technologies.
• Strong project management, organizational, and communication skills.
• Experience collaborating with cross-functional teams in a dynamic environment.

Skills

Advanced SQL

Relational databases

Data modeling

Cloud data engineering

Tools

AWS S3

AWS EC2

AWS Glue

EMR

Redshift

Airflow

Step Functions

Lambda

DynamoDB

Job description

Ethereum Technologies is seeking a Data Engineer in Maryland to design, build, and maintain scalable data pipelines and cloud-based data solutions. You will work with AWS services, Airflow, and other tools to process large, diverse datasets for policy-relevant research and performance analytics.

You will collaborate with data scientists and policy analysts to deliver reproducible research, dashboards, and decision-support products while ensuring data quality and governance compliance.