Azure Data Architect: Data Lakehouse & Databricks Lead

Artifintech; Atlanta (GA); In loco; USD 140.000 - 200.000; Tempo pieno

Descrizione del lavoro

Artifintech in the United States is seeking an experienced Senior Data Engineer to partner with business units, design scalable data solutions, and manage large-scale Spark-based pipelines in a cloud environment. The role emphasizes automation, governance, and translating business needs into technical specifications.

Responsibilities include developing and maintaining data models, optimizing ETL/ELT processes, and ensuring alignment with IT strategy.

Competenze

• 10+ years of experience in data engineering, including design, development, testing, and operations.
• Advanced proficiency with Parquet, Iceberg, PySpark, Lambda, Databricks, and Azure data services.
• Proficiency in Python, Java, or Scala for data processing.
• Extensive Databricks experience with large-scale data pipelines, Spark optimization, and governance controls.
• CI/CD practices using Git/Bitbucket, Jenkins, and automated deployments.

Mansioni

• Acts as expert for business units supported; analyzes operations to identify automation opportunities.
• Translates requirements into functional specifications; manages requirements, approvals, and traceability.
• Assists with business process redesign; ensures compliance with standards and best practices.
• Guides buy vs. build decisions; coordinates with IT and business units.
• Develops processes and templates to support process maturity goals.
• Builds and maintains reports using SQL-driven tools and governance data sources.
• Performs systems analysis focusing on business processes and data flows.
• Maintains risk awareness and adheres to policies and controls.

Conoscenze

Data engineering

PySpark

Databricks

Python

Java

Scala

Azure data services

SQL

CI/CD

Data governance

Formazione

Bachelor's degree in Computer Science or related field

Strumenti

Databricks

Oracle SQL

SQL Server

ER Data Modeling

Descrizione del lavoro

Artifintech in the United States is seeking an experienced Senior Data Engineer to partner with business units, design scalable data solutions, and manage large-scale Spark-based pipelines in a cloud environment. The role emphasizes automation, governance, and translating business needs into technical specifications.

Responsibilities include developing and maintaining data models, optimizing ETL/ELT processes, and ensuring alignment with IT strategy.