Senior Cloud Data Engineer — SQL, Python & ETL

AEM Corporation; Washington (District of Columbia); On-site; USD 110,000 - 140,000; Full time

Job summary

AEM Corporation is seeking a Data Engineer to support education data systems, data management, and data use initiatives. You will partner with state and local education agencies to integrate data into secure, scalable platforms for reporting and analytics.

You will design, build, and maintain reliable data pipelines, data models, and cloud-ready data solutions, collaborating with project managers, analysts, and clients to drive data-driven decisions.

Qualifications

• Five years of experience designing, building, and supporting SQL-based ETL/ELT and data integration solutions.
• Advanced SQL skills, including complex transformations and performance tuning.
• Experience with Python for data engineering, automation, data transformation, or data quality workflows.
• Strong experience with data modeling for analytics and reporting, including schema design and dimensional modeling.
• Hands-on experience with cloud data platforms and services; Azure preferred, with AWS or GCP experience also valued.

Responsibilities

• Design, develop, test, and maintain scalable ETL/ELT pipelines and data integration solutions using SQL, Python, and cloud-native services.
• Develop and optimize SQL queries, stored procedures, transformations and data pipelines.
• Design and maintain analytics-ready data models for reporting, dashboards, and downstream applications, including dimensional and semantic modeling patterns.
• Integrate data from databases, flat files, APIs, and third-party systems into governed, reusable datasets.
• Monitor, troubleshoot, and tune data pipelines and database workloads for reliability, performance, and cost efficiency.
• Establish and maintain data quality controls, including profiling, validation, testing, reconciliation, monitoring, and alerting.
• Operationalize pipelines using CI/CD practices, code review, and environment promotion processes.
• Implement and support orchestration, scheduling, and observability for batch and near-real-time data workflows.
• Support cloud adoption and modernization efforts, including migration of legacy or on-premises data workflows to cloud environments.
• Model and serve data for analytics and BI use cases, including support for Power BI data sets, row-level security, and refresh orchestration.
• Document data lineage, architecture, and data contracts, contributing to metadata/catalog solutions (e.g., Microsoft Purview).
• Collaborate within a Scrum team, participating in sprint ceremonies and refining user stories with stakeholders.
• Work with business users to gather and translate functional and technical requirements.
• Provide technical assistance and support to education stakeholders (remote and/or on-site).
• Continuously improve processes through automation, standardization, and best practices.

Skills

SQL ETL/ELT

Advanced SQL

Python

Data modeling

Cloud platforms (Azure)

CI/CD (Azure DevOps)

Git

Data governance

Agile/Scrum

AI-assisted development

Tools

dbt

Power BI

Azure data services

Airflow

Databricks

Snowflake

Microsoft Purview

REST APIs

Job description

AEM Corporation is seeking a Data Engineer to support education data systems, data management, and data use initiatives. You will partner with state and local education agencies to integrate data into secure, scalable platforms for reporting and analytics.

You will design, build, and maintain reliable data pipelines, data models, and cloud-ready data solutions, collaborating with project managers, analysts, and clients to drive data-driven decisions.