Databricks Engineer: Cloud Data Architect & AI Pipelines

Infoverity; Dublin (OH); On-site; USD 100,000 - 130,000; Full time

Job summary

A leading consulting firm is seeking an experienced Databricks Engineer to design and implement scalable data solutions leveraging cloud technologies. You will collaborate with cross-functional teams to optimize modern data platforms, ensuring efficient data movement and working on innovative AI/ML projects. The ideal candidate has strong experience with Databricks and cloud platforms like Azure or AWS, and excellent problem-solving skills.

Qualifications

• 2 to 3 years of experience in data engineering, architecture, and integration.
• Strong expertise in Databricks, Snowflake, or Microsoft Fabric.
• Proficiency in SQL, Python, and distributed data processing.

Responsibilities

• Design and implement scalable, cloud-based data pipelines.
• Develop and optimize ETL/ELT workflows in Databricks.
• Collaborate with data science teams for ML operations.

Skills

Databricks

SQL

Python

Spark

Data integration

Cloud platforms

ETL/ELT development

Data governance

AI/ML workflows

Problem-solving

Tools

Snowflake

Microsoft Fabric

Apache Airflow

Terraform

dbt

Delta Lake

Job description

A leading consulting firm is seeking an experienced Databricks Engineer to design and implement scalable data solutions leveraging cloud technologies. You will collaborate with cross-functional teams to optimize modern data platforms, ensuring efficient data movement and working on innovative AI/ML projects. The ideal candidate has strong experience with Databricks and cloud platforms like Azure or AWS, and excellent problem-solving skills.