AI Data Engineer — Databricks Pipelines & SQL Expert

Abundant Code

Little Rock Township (IL)

On-site

USD 83,000 - 118,000

Full time

5 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

QUANTUM TECHNOLOGIES LLC seeks an AI Engineer to design, build, and support advanced AI-enabled data solutions on the Databricks platform. You will craft scalable data pipelines, optimize SQL workloads, and collaborate with data engineers and business stakeholders to deliver production-ready AI solutions.

The role requires deep Databricks engineering capability, strong SQL, Python, and PySpark skills, and a track record delivering reliable data pipelines in enterprise environments.

Qualifications

  • Extensive hands-on AI engineering experience in Databricks environments.
  • Strong SQL including CTEs, window functions and joins.
  • Hands-on PySpark, Python, and Delta Lake knowledge.

Responsibilities

  • Design, develop, and productionize AI and machine learning solutions using the Databricks platform.
  • Build and maintain robust Databricks data engineering workflows using declarative pipeline techniques, including Lakeflow and Delta Live Tables.
  • Develop scalable data pipelines to support AI, analytics, and downstream reporting use cases.
  • Perform advanced SQL analysis across complex datasets, including query development, debugging, reconciliation, and root-cause analysis.
  • Investigate poorly performing SQL queries and implement improvements to execution patterns, logic, joins, and filters.
  • Optimize SQL workloads for performance, reliability, and maintainability within Databricks.
  • Analyze data quality issues and trace defects through source data, pipelines, and SQL logic.
  • Collaborate with cross-functional engineering teams and business SMEs to translate requirements into technical solutions.
  • Apply modern software engineering practices, including modular design, version control, testing, code review, and deployment discipline.
  • Support production incidents and troubleshoot issues across AI solutions, Databricks pipelines, and SQL workloads.

Job description

QUANTUM TECHNOLOGIES LLC seeks an AI Engineer to design, build, and support advanced AI-enabled data solutions on the Databricks platform. You will craft scalable data pipelines, optimize SQL workloads, and collaborate with data engineers and business stakeholders to deliver production-ready AI solutions.

The role requires deep Databricks engineering capability, strong SQL, Python, and PySpark skills, and a track record delivering reliable data pipelines in enterprise environments.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineer — Databricks & ADF Pipelines
Data Engineer — Databricks & ADF Pipelines

Quantum Technologies. LLC • Atlanta (GA)

On-site
USD 90,000 - 150,000
Senior Data Engineer: AI-Driven Data Pipelines
Senior Data Engineer: AI-Driven Data Pipelines

Quantum Technologies LLC • Dallas (TX)

On-site
USD 130,000 - 190,000
Databricks Engineer: Genie AI & Data Pipelines
Databricks Engineer: Genie AI & Data Pipelines

Quantum Technologies. LLC • Weehawken (NJ)

On-site
USD 84,000 - 120,000
Data Engineer: Databricks, Snowflake & Cloud Pipelines
Data Engineer: Databricks, Snowflake & Cloud Pipelines

Quantum Technologies. LLC • Dallas (TX)

On-site
USD 90,000 - 150,000
Senior Databricks Data Engineer: Scale Big Data Pipelines
Senior Databricks Data Engineer: Scale Big Data Pipelines

Quantum Technologies. LLC • Dallas (TX)

On-site
USD 150,000 - 190,000
Azure Data Engineer — Pipelines, Databricks & Power BI
Azure Data Engineer — Pipelines, Databricks & Power BI

Quantum Technologies. LLC • Columbia Township (MO)

On-site
USD 90,000 - 130,000
Azure Data Analytics Architect — Lead Databricks & Pipelines
Azure Data Analytics Architect — Lead Databricks & Pipelines

Quantum Technologies. LLC • Houston (TX)

Hybrid
USD 120,000 - 180,000
Databricks Engineer - Lakehouse Data Pipelines & Spark
Databricks Engineer - Lakehouse Data Pipelines & Spark

Quantum Technologies LLC • Austin (TX)

On-site
USD 120,000 - 190,000
Azure Data Engineer – ETL, Databricks & Data Lake Architect
Azure Data Engineer – ETL, Databricks & Data Lake Architect

Quantum Technologies. LLC • Atlanta (GA)

On-site
USD 120,000 - 150,000
AI Engineer QUANTUM TECHNOLOGIES LLC
AI Engineer QUANTUM TECHNOLOGIES LLC

Abundant Code • Little Rock Township (IL)

On-site
USD 83,000 - 118,000