Sr. Data Engineer

Padmore Global Connections LLC; Atlanta (GA); On-site; USD 85,000 - 120,000; Full time

Job summary

Padmore Global Connections LLC is seeking a Data Engineer to help modernize our data estate. You will design and maintain ETL/ELT pipelines using Microsoft Fabric and Azure Databricks, migrate SSIS packages, and implement Bronze-Silver-Gold data lifecycles to ensure trusted data for analytics.

Based in Georgia, the role is contract, on-site Tuesday to Thursday, with mandatory in-person All Hands meetings. Ideal candidates have 2–3 years of data engineering experience and strong SQL, Python, and

Qualifications

• Bachelor's degree in computer science, Information Systems, or related field.
• 2-3 years of experience in data engineering or related roles.
• Proficiency in SQL, Python, Spark.
• Familiarity with LangGraph and RAG DB concepts.
• Hands-on experience with Microsoft Fabric and Power BI.
• Understanding of ETL/ELT pipelines and data warehousing concepts.

Responsibilities

• Assist in designing, building, and maintaining ETL/ELT data pipelines using Microsoft Fabric and Azure Databricks.
• Support migration and maintenance of SSIS packages from legacy systems.
• Implement medallion architecture (Bronze, Silver, Gold) for data lifecycle and quality.
• Create and manage notebooks (Fabric Notebooks, Databricks) for data transformation using Python, SQL, and Spark.
• Build curated datasets to support Power BI dashboards.
• Collaborate with data analysts and business stakeholders to deliver fit-for-purpose data assets.
• Apply data governance policies in line with Microsoft Purview or Unity Catalog.
• Support monitoring, logging, and CI/CD automation using Azure DevOps.

Skills

SQL

Python

Spark

Education

Bachelor's degree in computer science, Information Systems, or related field

Tools

Microsoft Fabric

Power BI

SSIS

LangGraph

RAG DB

Job description

Agency Interview Type: Either Web Cam or In Person

Engagement Type: Contract

NOTE: Applications with resumes in PDF Format will be automatically rejected. Only Word format resumes will be considered.

Short Description:

Under broad supervision, combines strong technical skills with knowledge of database administration. Works on one or more projects of high complexity. Provides technical support to development team members.

Complete Description:

We are seeking a motivated Data Engineer to join our team and support the modernization of our data estate. This role focuses on assisting with data pipeline development, migration of legacy systems, and maintaining scalable, secure, and efficient data solutions using modern technologies, particularly Microsoft Fabric and Azure-based platforms.

Must be physically located in Georgia

On-site: Tuesday to Thursday (per managers discretion)

Mandatory in-person meetings: All Hands, Enterprise Applications, DECAL All Staff

Position Type: Contract

Experience Required: 2-3 years

Key Responsibilities

Assist in designing, building, and maintaining ETL/ELT data pipelines using Microsoft Fabric and Azure Databricks.

Support migration and maintenance of SSIS packages from legacy systems.

Implement medallion architecture (Bronze, Silver, Gold) for data lifecycle and quality.

Create and manage notebooks (Fabric Notebooks, Databricks) for data transformation using Python, SQL, and Spark.

Build curated datasets to support Power BI dashboards.

Collaborate with data analysts and business stakeholders to deliver fit-for-purpose data assets.

Apply data governance policies in line with Microsoft Purview or Unity Catalog.

Support monitoring, logging, and CI/CD automation using Azure DevOps.

Technical Stack

Microsoft Fabric (Dataflows, Pipelines, Notebooks, OneLake)

SQL Server / SQL Managed Instances

Power BI

SSIS (migration and maintenance)

LangGraph and RAG DB (for advanced data workflows)

Qualifications

Bachelor's degree in computer science, Information Systems, or related field.

23 years of experience in data engineering or related roles.

Proficiency in SQL, Python, Spark.

Familiarity with LangGraph and RAG DB concepts.

Hands-on experience with Microsoft Fabric and Power BI.

Understanding of ETL/ELT pipelines and data warehousing concepts.

Preferred

Knowledge of CI/CD automation with Azure DevOps.

Familiarity with data governance tools (Microsoft Purview, Unity Catalog).

Experience with SSIS package migration and maintenance.