Senior Data Engineer - Azure & Databricks Lead (Onsite)

System One; Atlanta (GA); On-site; USD 140,000 - 155,000; Full time

Job summary

System One is seeking a Senior Data Engineer to design and implement enterprise-grade data pipelines in Atlanta, GA or Washington, DC. You will drive data architecture and scalable ETL/ELT processes to support analytics and data science initiatives, working with a team of data scientists and engineers.

You will leverage Python, SQL, Databricks, and Azure Data Factory to transform diverse data sources, ensure data quality and security, and enable leadership with actionable insights.

Qualifications

• 8+ years of experience in data engineering, software engineering, or database architecture.
• 6+ years of experience in Python and SQL with scalable ETL/ELT pipelines.
• 2+ years of experience with cloud data ecosystems like Azure Data Factory.
• 1+ years of experience with modern data processing frameworks like Databricks.
• Experience with integrating and transforming data from diverse formats and systems (APIs, flat files, relational sources).
• Knowledge of relational and NoSQL databases, data modeling, and schema design.
• Knowledge of data governance, security, and compliance principles for enterprise data environments.
• Ability to support on-site work in Atlanta, GA or Washington, DC.
• Must be a U.S. Citizen or Lawful Permanent Resident (Green Card Holder).

Responsibilities

• Design, implement, and maintain enterprise-grade ETL/ELT pipelines using Python and SQL
• Build, optimize, and manage data models, warehouses, and lakehouse environments (e.g., Databricks)
• Develop processes for ingesting, cleaning, validating, and transforming large-scale datasets from APIs, relational sources, and unstructured systems
• Implement data quality, metadata management, and governance controls to ensure consistency and trust in analytics workflows
• Collaborate with cloud engineering teams to deploy and manage data solutions on Azure
• Monitor, troubleshoot, and improve pipeline performance using logging, alerting, and CI/CD practices
• Document data architecture, pipeline logic, and operational procedures to enable team collaboration and maintainability

Skills

Python

SQL

ETL/ELT pipelines

Data modeling

Data governance

CI/CD

Cloud data workflows

Data architectures

Education

Bachelor’s degree in computer science, Engineering, Information Systems, or a related field

Tools

Databricks

Azure Data Factory

Job description

System One is seeking a Senior Data Engineer to design and implement enterprise-grade data pipelines in Atlanta, GA or Washington, DC. You will drive data architecture and scalable ETL/ELT processes to support analytics and data science initiatives, working with a team of data scientists and engineers.

You will leverage Python, SQL, Databricks, and Azure Data Factory to transform diverse data sources, ensure data quality and security, and enable leadership with actionable insights.