Senior Data Engineer — Enterprise Pipelines on Azure

System One; Atlanta (GA); Ibrido; USD 140.000 - 171.000; Tempo pieno

Descrizione del lavoro

System One is hiring a Senior Data Engineer in Atlanta, GA or Washington, DC with hybrid work options. The role requires US citizenship or a Green Card and the ability to obtain Public Trust, with a salary around $155K.

You will design and optimize enterprise data pipelines, data models, and lakehouse environments, collaborating with data scientists, engineers, and operations to enable scalable analytics and secure data infrastructure.

Competenze

• 8+ years in data engineering or related field.
• 6+ years Python and SQL with scalable ETL/ELT experience.
• 2+ years with Azure Data Factory.
• 1+ year with Databricks.
• Experience integrating data from APIs, files, and relational sources.
• Knowledge of relational and NoSQL databases and data modeling.
• Understanding data governance, security, and compliance.

Mansioni

• Design, implement, and maintain enterprise-grade ETL/ELT pipelines using Python and SQL.
• Build and manage data models, warehouses, and lakehouse environments (Databricks).
• Ingest, clean, validate, and transform large-scale datasets from diverse sources.
• Apply data governance and metadata controls to ensure trust in analytics.
• Collaborate with cloud engineering to deploy data solutions on Azure.
• Monitor and optimize pipeline performance with CI/CD practices.
• Document architecture, pipelines, and operational procedures.

Conoscenze

Python

SQL

ETL/ELT pipelines

Databricks

Azure Data Factory

Data modeling

Data governance

Relational databases

NoSQL databases

Cloud platforms (Azure)

Formazione

Bachelor's degree in CS/Engineering/Information Systems

Strumenti

Databricks

Azure

SQL tooling

Descrizione del lavoro

System One is hiring a Senior Data Engineer in Atlanta, GA or Washington, DC with hybrid work options. The role requires US citizenship or a Green Card and the ability to obtain Public Trust, with a salary around $155K.

You will design and optimize enterprise data pipelines, data models, and lakehouse environments, collaborating with data scientists, engineers, and operations to enable scalable analytics and secure data infrastructure.