Data Engineer: Cloud Pipelines & Analytics

MACHINE LEARNING TECHNOLOGIES LLC; Annapolis (MD); In loco; USD 77.000 - 110.000; Tempo pieno

Descrizione del lavoro

MACHINE LEARNING TECHNOLOGIES LLC is seeking a Data Engineer in Maryland to build and maintain scalable data pipelines, integrate multiple data sources, and enable analytics for education and workforce outcomes.

You will design cloud-based data solutions, develop data quality controls, and collaborate with data scientists and policy analysts to support reproducible research and data-driven decision making.

Competenze

• Advanced SQL skills and experience with relational databases and multiple database technologies.
• Experience designing and optimizing big data pipelines and architectures.
• Experience developing dashboards, reports, and analytical models for executive and non-technical stakeholders.
• Experience working with student-level higher education data and linking to external sources to measure outcomes.

Mansioni

• Design, build, and maintain scalable data pipeline architectures.
• Develop cloud-based data solutions using AWS services like S3, EC2, Glue, EMR, RDS, Redshift, Athena, Lambda, and DynamoDB.
• Build and maintain data orchestration workflows with Airflow and AWS Step Functions.
• Extract, transform, integrate, and process large datasets using SQL and big data technologies.
• Develop analytical environments supporting statistical analysis, predictive modeling, ML, and evidence-based research.
• Collaborate with data scientists, policy analysts, and support teams to ensure reproducible research and modeling.
• Build analytics tools, dashboards, reports, models, and decision-support products.
• Support analysis of education and workforce outcomes, efficiency, and key KPIs.
• Develop and maintain data pipeline monitoring, logging, data quality checks, and validation frameworks.
• Identify and resolve data quality issues via root-cause analysis.
• Automate manual processes and optimize data delivery and scalability.
• Support data conversions during system modernization and replacements.
• Work with executives and cross-functional teams to address tech and infra requirements.
• Ensure compliance with data governance, privacy, and interagency sharing agreements.

Conoscenze

SQL

Big data

Cloud data engineering

Data pipelines

Airflow

Data governance

Analytics

Strumenti

AWS S3

AWS EC2

AWS Glue

AWS EMR

AWS RDS

AWS Redshift

AWS Athena

AWS Lambda

DynamoDB

Descrizione del lavoro

MACHINE LEARNING TECHNOLOGIES LLC is seeking a Data Engineer in Maryland to build and maintain scalable data pipelines, integrate multiple data sources, and enable analytics for education and workforce outcomes.

You will design cloud-based data solutions, develop data quality controls, and collaborate with data scientists and policy analysts to support reproducible research and data-driven decision making.