Databricks Engineer with Genie AI

Machine Learning Technologies, LLC; Weehawken (NJ); On-site; USD 87,000 - 117,000; Full time

Job summary

Machine Learning Technologies, LLC in New Jersey is seeking an experienced Databricks Data Engineer to build scalable data pipelines and enable Genie AI-powered analytics on the Databricks platform. The role requires hands-on data engineering expertise and strong knowledge of Delta Lake and Lakehouse architectures.

You will implement Bronze-Silver-Gold medallion design, manage Unity Catalog, and optimize Spark jobs, Databricks SQL workloads, and data workflows while collaborating with data and

Qualifications

• Hands-on Databricks/Azure Databricks experience required.
• Experience building data pipelines with PySpark, Python and SQL.
• Familiarity with Delta Lake, Lakehouse architectures, and data governance.

Responsibilities

• Build and optimize data pipelines using Databricks, PySpark, Python and SQL.
• Develop ETL/ELT solutions with Delta Lake and Lakehouse architecture.
• Implement Bronze, Silver and Gold Medallion architecture.
• Work with Unity Catalog for data governance and access management.
• Configure and support Genie AI/Genie Agents for NL data querying and analytics.
• Optimize Spark jobs and Databricks SQL workloads.
• Collaborate with data, analytics and business teams to deliver scalable data solutions.

Skills

Databricks

Azure Databricks

PySpark

Python

SQL

Apache Spark

Delta Lake

Genie AI

Data Engineering

Lakehouse Architecture

Medallion Architecture

Unity Catalog

Tools

Databricks

Azure Databricks

Python

SQL

PySpark

Delta Lake

Spark

Job description

US Citizen, Green Card, H-1B, OPT-EAD, CPT, Other

Job Title: Databricks Engineer with Genie AI

Duration: 8 Months

Bill Rate: $74/hour (C2C)

Job Type: W-2, 1099, C2C

Client: To Be Discussed Later

Work Authorization: US Citizen, Green Card, OPT-EAD, CPT, H-1B, H4-EAD, Other

Job Summary:

We are looking for an experienced Databricks Data Engineer with strong hands-on expertise in data engineering and exposure to Genie AI / Genie Agents. The candidate will build scalable data pipelines and enable AI-powered conversational analytics on the Databricks platform.

Key Responsibilities

• Build and optimize data pipelines using Databricks, PySpark, Python and SQL.
• Develop ETL/ELT solutions using Delta Lake and Lakehouse architecture.
• Implement Bronze, Silver and Gold Medallion architecture.
• Work with Unity Catalog for data governance and access management.
• Configure and support Genie AI / Genie Agents for natural-language data querying and conversational analytics.
• Optimize Spark jobs, Databricks SQL workloads and data pipelines.
• Collaborate with data, analytics and business teams to deliver scalable data solutions.

Required Skills

• Strong hands-on experience with Databricks / Azure Databricks
• PySpark, Python and SQL
• Apache Spark and Delta Lake
• ETL/ELT and Data Engineering
• Databricks SQL
• Unity Catalog
• Lakehouse / Medallion Architecture

We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.