Data Engineer

Ethereum Technologies; Maryland; Sur place; USD 77 000 - 110 000; Plein temps

Résumé du poste

Ethereum Technologies is seeking a Data Engineer in Maryland to design, build, and maintain scalable data pipelines and cloud-based data solutions. You will work with AWS services, Airflow, and other tools to process large, diverse datasets for policy-relevant research and performance analytics.

You will collaborate with data scientists and policy analysts to deliver reproducible research, dashboards, and decision-support products while ensuring data quality and governance compliance.

Qualifications

• Advanced SQL skills and experience with relational databases.
• Experience designing and optimizing big data pipelines and architectures.
• Proven ability to develop dashboards, reports, and analytics products for stakeholders.

Responsabilités

• Design, build, and maintain scalable data pipeline architectures.
• Develop cloud-based data solutions using AWS services such as S3, EC2, Glue, EMR, RDS, Redshift, Athena, Lambda, and DynamoDB.
• Build and maintain data orchestration workflows using Apache Airflow, AWS Step Functions, or similar tools.
• Extract, transform, integrate, and process large datasets from multiple sources using SQL and big data technologies.
• Develop analytical data environments supporting statistical analysis, predictive modeling, machine learning, and evidence-based research.
• Collaborate with data scientists, research analysts, and policy analysts to support reproducible research and statistical modeling.
• Build analytics tools, dashboards, reports, analytical models, and decision-support products.
• Support analysis of education and workforce outcomes, operational efficiency, and key business performance metrics.
• Develop and maintain pipeline monitoring, alerting, logging, data quality checks, and validation frameworks.
• Identify and resolve data quality issues through root-cause analysis.
• Automate manual processes and optimize data delivery, infrastructure scalability, and system performance.
• Support data conversions associated with system modernization and replacement initiatives.
• Work with executive, data, design, and support teams to address technical issues and infrastructure requirements.
• Ensure compliance with Commonwealth policies, data governance standards, privacy requirements, security controls, and interagency data-sharing agreements.
• Develop and optimize data tools that support analytics and data science teams.
• Advanced SQL skills and strong experience working with relational databases and various database technologies.
• Experience designing and optimizing big data pipelines, architectures, and datasets.
• Experience developing dashboards, reports, analytical models, and decision-support products for executive and non-technical stakeholders.
• Experience working with student-level higher education data and linking it with external sources, such as employment and wage data, to measure outcomes.
• Strong experience performing root-cause analysis on internal and external data.
• Strong analytical skills and experience working with structured and unstructured datasets.
• Experience with data transformation, data structures, metadata, dependencies, and workload management.
• Proven ability to process, manipulate, and extract insights from large, disconnected datasets.
• Working knowledge of message queuing, stream processing, and scalable big data storage technologies.
• Strong project management, organizational, and communication skills.
• Experience collaborating with cross-functional teams in a dynamic environment.

Connaissances

Advanced SQL

Relational databases

Data modeling

Cloud data engineering

Outils

AWS S3

AWS EC2

AWS Glue

EMR

Redshift

Airflow

Step Functions

Lambda

DynamoDB

Description du poste

US Citizen, Green Card, H-1B, OPT-EAD, CPT, Other

Job Title: Data Engineer
Location: Maryland
Duration: 12 Months + Extension
Bill Rate: $68/hour
Job Type: W-2, 1099, C2C
Client: To Be Discussed Later
Work Authorization: US-Citizen, H-1B, OPT-EAD, GC-EAD

Job Description:

The ideal candidate will combine strong technical expertise in data engineering, cloud-based data solutions, and analytics with the ability to understand policy-relevant research questions, evaluate data sources, and develop analytical products.

Key Responsibilities

• Design, build, and maintain scalable data pipeline architectures.
• Develop cloud-based data solutions using AWS services such as S3, EC2, Glue, EMR, RDS, Redshift, Athena, Lambda, and DynamoDB.
• Build and maintain data orchestration workflows using Apache Airflow, AWS Step Functions, or similar tools.
• Extract, transform, integrate, and process large datasets from multiple sources using SQL and big data technologies.
• Develop analytical data environments supporting statistical analysis, predictive modeling, machine learning, and evidence-based research.
• Collaborate with data scientists, research analysts, and policy analysts to support reproducible research and statistical modeling.
• Build analytics tools, dashboards, reports, analytical models, and decision-support products.
• Support analysis of education and workforce outcomes, operational efficiency, and key business performance metrics.
• Develop and maintain pipeline monitoring, alerting, logging, data quality checks, and validation frameworks.
• Identify and resolve data quality issues through root-cause analysis.
• Automate manual processes and optimize data delivery, infrastructure scalability, and system performance.
• Support data conversions associated with system modernization and replacement initiatives.
• Work with executive, data, design, and support teams to address technical issues and infrastructure requirements.
• Ensure compliance with Commonwealth policies, data governance standards, privacy requirements, security controls, and interagency data-sharing agreements.
• Develop and optimize data tools that support analytics and data science teams.
• Advanced SQL skills and strong experience working with relational databases and various database technologies.
• Experience designing and optimizing big data pipelines, architectures, and datasets.
• Experience developing dashboards, reports, analytical models, and decision-support products for executive and non-technical stakeholders.
• Experience working with student-level higher education data and linking it with external sources, such as employment and wage data, to measure outcomes.
• Strong experience performing root-cause analysis on internal and external data.
• Strong analytical skills and experience working with structured and unstructured datasets.
• Experience with data transformation, data structures, metadata, dependencies, and workload management.
• Proven ability to process, manipulate, and extract insights from large, disconnected datasets.
• Working knowledge of message queuing, stream processing, and scalable big data storage technologies.
• Strong project management, organizational, and communication skills.
• Experience collaborating with cross-functional teams in a dynamic environment.

We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.