Senior Data Engineer — Enterprise Pipelines & Azure

Metas Solutions; Atlanta (GA); On-site; USD 120,000 - 170,000; Full time

Job summary

Metas Solutions is seeking a Senior Data Engineer in the Atlanta area to design and manage enterprise data pipelines and data architectures. You will work with data scientists and infrastructure teams to deliver scalable, secure data platforms that drive strategic decisions.

The role emphasizes building robust data models, governance, and reliable ETL processes across cloud environments on Azure, with Databricks and modern data tools to support current and future analytics initiatives.

Qualifications

• 8+ years of experience in data engineering, software engineering, or database architecture.
• 6+ years of Python and SQL with experience building scalable ETL/ELT pipelines.
• 2+ years of experience with cloud data ecosystems like Azure Data Factory.
• 1+ years of experience with modern data processing frameworks like Databricks.
• Experience with integrating and transforming data from diverse formats and systems (APIs, flat files, relational sources).
• Knowledge of relational and NoSQL databases, data modeling, and schema design.
• Knowledge of data governance, security, and compliance principles for enterprise data environments.
• Bachelor's degree in computer science, Engineering, Information Systems, or a related, quantitative field.
• Must be a U.S. Citizen or Lawful Permanent Resident (Green Card Holder).

Responsibilities

• Design, implement, and maintain enterprise‑grade ETL/ELT pipelines using Python and SQL.
• Build, optimize, and manage data models, warehouses, and lakehouse environments (e.g., Databricks)
• Develop processes for ingesting, cleaning, validating, and transforming large‑scale datasets from APIs, relational sources, and unstructured systems.
• Implement data quality, metadata management, and governance controls to ensure consistency and trust in analytics workflows.
• Collaborate with cloud engineering teams to deploy and manage data solutions on Azure.
• Monitor, troubleshoot, and improve pipeline performance using logging, alerting, and CI/CD practices.
• Document data architecture, pipeline logic, and operational procedures to enable team collaboration and maintainability.

Skills

ETL/ELT pipelines

Data modeling

Data governance

Security & compliance

Team collaboration

Education

Bachelor's degree in CS/Engineering/IS or related field

Tools

Python

SQL

Databricks

Azure Data Factory

Job description

Metas Solutions is seeking a Senior Data Engineer in the Atlanta area to design and manage enterprise data pipelines and data architectures. You will work with data scientists and infrastructure teams to deliver scalable, secure data platforms that drive strategic decisions.

The role emphasizes building robust data models, governance, and reliable ETL processes across cloud environments on Azure, with Databricks and modern data tools to support current and future analytics initiatives.