Data Engineer

MACHINE LEARNING TECHNOLOGIES LLC; Annapolis (MD); In loco; USD 77.000 - 110.000; Tempo pieno

Descrizione del lavoro

MACHINE LEARNING TECHNOLOGIES LLC is seeking a Data Engineer in Maryland to build and maintain scalable data pipelines, integrate multiple data sources, and enable analytics for education and workforce outcomes.

You will design cloud-based data solutions, develop data quality controls, and collaborate with data scientists and policy analysts to support reproducible research and data-driven decision making.

Competenze

• Advanced SQL skills and experience with relational databases and multiple database technologies.
• Experience designing and optimizing big data pipelines and architectures.
• Experience developing dashboards, reports, and analytical models for executive and non-technical stakeholders.
• Experience working with student-level higher education data and linking to external sources to measure outcomes.

Mansioni

• Design, build, and maintain scalable data pipeline architectures.
• Develop cloud-based data solutions using AWS services like S3, EC2, Glue, EMR, RDS, Redshift, Athena, Lambda, and DynamoDB.
• Build and maintain data orchestration workflows with Airflow and AWS Step Functions.
• Extract, transform, integrate, and process large datasets using SQL and big data technologies.
• Develop analytical environments supporting statistical analysis, predictive modeling, ML, and evidence-based research.
• Collaborate with data scientists, policy analysts, and support teams to ensure reproducible research and modeling.
• Build analytics tools, dashboards, reports, models, and decision-support products.
• Support analysis of education and workforce outcomes, efficiency, and key KPIs.
• Develop and maintain data pipeline monitoring, logging, data quality checks, and validation frameworks.
• Identify and resolve data quality issues via root-cause analysis.
• Automate manual processes and optimize data delivery and scalability.
• Support data conversions during system modernization and replacements.
• Work with executives and cross-functional teams to address tech and infra requirements.
• Ensure compliance with data governance, privacy, and interagency sharing agreements.

Conoscenze

SQL

Big data

Cloud data engineering

Data pipelines

Airflow

Data governance

Analytics

Strumenti

AWS S3

AWS EC2

AWS Glue

AWS EMR

AWS RDS

AWS Redshift

AWS Athena

AWS Lambda

DynamoDB

Descrizione del lavoro

Job Overview

• Job ID: J53995
• Job Title: Data Engineer
• Location: Maryland, MD
• Duration: 12 Months + Extension
• Domain Exposure: Insurance
• Client: To Be Discussed Later
• Employment Type: W-2, 1099, C2C
• Work Authorization: US Citizen, Green Card, H-1B, OPT-EAD, CPT, Other

Bill Rate: $68/hour

Job Description

The ideal candidate will combine strong technical expertise in data engineering, cloud-based data solutions, and analytics with the ability to understand policy-relevant research questions, evaluate data sources, and develop analytical products.

The candidate will be responsible for building and maintaining scalable data pipelines, integrating data from multiple sources, improving data quality, and establishing controls for the responsible use of large, complex, and confidential datasets.

Key Responsibilities

• Design, build, and maintain scalable data pipeline architectures.
• Develop cloud-based data solutions using AWS services such as S3, EC2, Glue, EMR, RDS, Redshift, Athena, Lambda, and DynamoDB.
• Build and maintain data orchestration workflows using Apache Airflow, AWS Step Functions, or similar tools.
• Extract, transform, integrate, and process large datasets from multiple sources using SQL and big data technologies.
• Develop analytical data environments supporting statistical analysis, predictive modeling, machine learning, and evidence-based research.
• Collaborate with data scientists, research analysts, and policy analysts to support reproducible research and statistical modeling.
• Build analytics tools, dashboards, reports, analytical models, and decision-support products.
• Support analysis of education and workforce outcomes, operational efficiency, and key business performance metrics.
• Develop and maintain pipeline monitoring, alerting, logging, data quality checks, and validation frameworks.
• Identify and resolve data quality issues through root-cause analysis.
• Automate manual processes and optimize data delivery, infrastructure scalability, and system performance.
• Support data conversions associated with system modernization and replacement initiatives.
• Work with executive, data, design, and support teams to address technical issues and infrastructure requirements.
• Ensure compliance with Commonwealth policies, data governance standards, privacy requirements, security controls, and interagency data-sharing agreements.
• Develop and optimize data tools that support analytics and data science teams.
• Advanced SQL skills and strong experience working with relational databases and various database technologies.
• Experience designing and optimizing big data pipelines, architectures, and datasets.
• Experience developing dashboards, reports, analytical models, and decision-support products for executive and non-technical stakeholders.
• Experience working with student-level higher education data and linking it with external sources, such as employment and wage data, to measure outcomes.
• Strong experience performing root-cause analysis on internal and external data.
• Strong analytical skills and experience working with structured and unstructured datasets.
• Experience with data transformation, data structures, metadata, dependencies, and workload management.
• Proven ability to process, manipulate, and extract insights from large, disconnected datasets.
• Working knowledge of message queuing, stream processing, and scalable big data storage technologies.
• Strong project management, organizational, and communication skills.
• Experience collaborating with cross-functional teams in a dynamic environment.

Equal Opportunity Employer

We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.