Data Engineer: Modern Data Platform (Contract, Atlanta)

Padmore Global Connections LLC; Atlanta (GA); On-site; USD 83,000 - 152,000; Part time

Job summary

Padmore Global Connections LLC in Atlanta, GA, seeks a Data Engineer to join the DECAL modernization effort, designing scalable ETL/ELT pipelines with Microsoft Fabric and Azure Databricks, and delivering analytics-ready datasets for Power BI.

You will support migrating from legacy SQL/SSRS, implement governance with Purview/Unity Catalog, and collaborate with analysts and stakeholders. On-site Tue–Thu; strong communication and 5+ years’ experience required.

Qualifications

• Bachelor's degree in Computer Science, Information Systems, or related field.
• 5+ years of experience in data engineering roles, preferably in government or regulated environments.
• Proficiency in SQL, Python, Spark.
• Hands-on experience with Microsoft Fabric (Dataflows, Pipelines, Notebooks, OneLake).
• Experience with Power BI data modeling and dashboard development.
• Familiarity with data governance tools (Microsoft Purview, Unity Catalog).
• Solid understanding of ETL/ELT pipelines, data warehousing concepts, and schema design.
• Strong communication and collaboration skills.

Responsibilities

• Design, build, and maintain scalable ETL/ELT data pipelines using Microsoft Fabric and Azure Databricks.
• Implement medallion architecture (Bronze, Silver, Gold) to support data lifecycle and data quality.
• Support the sunsetting of legacy SQL-based infrastructure and SSRS, ensuring data continuity and stakeholder readiness.
• Create and manage notebooks (e.g., Fabric Notebooks, Databricks) for data transformation using Python, SQL, and Spark.
• Build and deliver curated datasets and analytics models to support Power BI dashboards and reports.
• Develop dimensional and real-time data models for analytics use cases.
• Collaborate with data analysts, stewards, and business stakeholders to deliver fit-for-purpose data assets.
• Apply data governance policies including row-level security, data masking, and classification in line with Microsoft Purview or Unity Catalog.
• Ensure monitoring, logging, and CI/CD automation using Azure DevOps for data workflows.
• Provide support during data migration and cutover events, ensuring minimal disruption.

Skills

SQL

Python

Spark

Azure Databricks

Microsoft Fabric

Power BI

Data modeling

ETL/ELT

Data governance

SQL Server

Education

Bachelor's degree in Computer Science

Tools

Purview

Unity Catalog

Azure DevOps

SSRS

Fabric Notebooks

OneLake

Job description

Padmore Global Connections LLC in Atlanta, GA, seeks a Data Engineer to join the DECAL modernization effort, designing scalable ETL/ELT pipelines with Microsoft Fabric and Azure Databricks, and delivering analytics-ready datasets for Power BI.

You will support migrating from legacy SQL/SSRS, implement governance with Purview/Unity Catalog, and collaborate with analysts and stakeholders. On-site Tue–Thu; strong communication and 5+ years’ experience required.