Databricks Engineer with Genie AI

Artifintech; Weehawken (NJ); On-site; USD 84,000 - 120,000; Full time

Job summary

Artifintech seeks an experienced Databricks Engineer with Genie AI to build scalable data pipelines on the Databricks platform and enable AI-powered conversational analytics.

The role focuses on constructing robust ETL/ELT processes, leveraging Delta Lake, and implementing medallion architecture while ensuring governance via Unity Catalog. Collaboration with analytics and business teams will drive scalable data solutions.

Qualifications

• Experience with Databricks or Azure Databricks in data engineering.
• Hands-on with PySpark, Python and SQL.
• Familiarity with Delta Lake and Lakehouse architecture.
• Experience implementing Bronze, Silver and Gold medallion architectures.

Responsibilities

• Build and optimize data pipelines using Databricks, PySpark, Python and SQL.
• Develop ETL/ELT solutions using Delta Lake and Lakehouse architecture.
• Implement Bronze, Silver and Gold Medallion architecture.
• Work with Unity Catalog for data governance and access management.
• Configure and support Genie AI / Genie Agents for natural-language data querying and conversational analytics.
• Optimize Spark jobs, Databricks SQL workloads and data pipelines.
• Collaborate with data, analytics and business teams to deliver scalable data solutions.

Skills

Data engineering

SQL & Python

Spark / PySpark

Genie AI exposure

Tools

Databricks

Azure Databricks

PySpark

Python

SQL

Delta Lake

Unity Catalog

Lakehouse Architecture

Genie AI / Genie Agents

Job description

US Citizen, Green Card, H-1B, OPT-EAD, CPT, Other

Job Title: Databricks Engineer with Genie AI

Duration: 8 Months

Bill Rate: $74/hour (C2C)

Job Type: W-2, 1099, C2C

Client: To Be Discussed Later

Work Authorization: US Citizen, Green Card, OPT-EAD, CPT, H-1B, H4-EAD, Other

Job Summary:

We are looking for an experienced Databricks Data Engineer with strong hands-on expertise in data engineering and exposure to Genie AI / Genie Agents. The candidate will build scalable data pipelines and enable AI-powered conversational analytics on the Databricks platform.

Key Responsibilities

• Build and optimize data pipelines using Databricks, PySpark, Python and SQL.
• Develop ETL/ELT solutions using Delta Lake and Lakehouse architecture.
• Implement Bronze, Silver and Gold Medallion architecture.
• Work with Unity Catalog for data governance and access management.
• Configure and support Genie AI / Genie Agents for natural-language data querying and conversational analytics.
• Optimize Spark jobs, Databricks SQL workloads and data pipelines.
• Collaborate with data, analytics and business teams to deliver scalable data solutions.

Required Skills

• Strong hands-on experience with Databricks / Azure Databricks
• PySpark, Python and SQL
• Apache Spark and Delta Lake
• ETL/ELT and Data Engineering
• Databricks SQL
• Unity Catalog
• Lakehouse / Medallion Architecture

We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.