Senior Databricks Engineer: Azure Data & AI Pipelines

Quantiphi; United States; On-site; USD 100,000 - 130,000; Full time

Benefits offered by this job

Exposure to Fortune 500 clients

Latest technologies in AI and cloud

Leading a talented team

Job summary

A leading AI-first digital transformation company in the United States is seeking a Mid-Senior Level Data Engineer. You will be responsible for designing, developing, and maintaining scalable data pipelines using PySpark and SQL, primarily in Azure Databricks environments. The ideal candidate will have expertise in data modeling and CI/CD practices, ensuring high performance and reliability in data solutions. Join a dynamic team and work with Fortune 500 companies to drive innovation in AI and cloud technologies.

Qualifications

• Expert-level knowledge of Azure and Databricks architecture.
• Experience with CI/CD for data pipelines and automated testing.
• Strong expertise in PySpark, SQL, and data modeling for high-volume datasets.

Responsibilities

• Design, develop, and maintain scalable data pipelines using PySpark and SQL.
• Implement data models optimized for analytics and performance.
• Collaborate with cross-functional teams to deliver high-quality data solutions.

Skills

PySpark

SQL

Azure Databricks

Data Modeling

CI/CD

Distributed Computing

Tools

Azure

GCP

AWS

Databricks

Job description

A leading AI-first digital transformation company in the United States is seeking a Mid-Senior Level Data Engineer. You will be responsible for designing, developing, and maintaining scalable data pipelines using PySpark and SQL, primarily in Azure Databricks environments. The ideal candidate will have expertise in data modeling and CI/CD practices, ensuring high performance and reliability in data solutions. Join a dynamic team and work with Fortune 500 companies to drive innovation in AI and cloud technologies.