Databricks Engineer with Genie AI

Quantum Technologies. LLC; Weehawken (NJ); Presencial; USD 84.000 - 120.000; Tempo integral

Resumo da vaga

Quantum Technologies. LLC seeks a Databricks Engineer with Genie AI to design and implement scalable data pipelines on the Databricks platform.

The role involves enabling AI-powered conversational analytics through Genie Agents and working across data, analytics, and business teams. The candidate will build Bronze/Silver/Gold data architectures, utilize Unity Catalog for governance, and optimize Spark jobs and SQL workloads to deliver robust data solutions.

Qualificações

• Experience with Databricks/Azure Databricks to build scalable data pipelines.
• Strong skills in PySpark, Python and SQL for data engineering tasks.
• Hands-on knowledge of Apache Spark and Delta Lake architectures.
• Experience with ETL/ELT and Lakehouse/Medallion architecture patterns.
• Familiarity with Databricks SQL for data querying and analytics.
• Knowledge of Unity Catalog for data governance and access control.

Responsabilidades

• Build and optimize data pipelines using Databricks, PySpark, Python and SQL.
• Develop ETL/ELT solutions using Delta Lake and Lakehouse architecture.
• Implement Bronze, Silver and Gold Medallion data architectures.
• Work with Unity Catalog for data governance and access management.
• Configure and support Genie AI/Genie Agents for natural-language data querying.
• Optimize Spark jobs, Databricks SQL workloads and data pipelines.
• Collaborate with data, analytics and business teams to deliver scalable data solutions.

Conhecimentos

Databricks expertise

PySpark

Python

SQL

Apache Spark

Delta Lake

Unity Catalog

Descrição da vaga

US Citizen, Green Card, H-1B, OPT-EAD, CPT, Other

Job Title: Databricks Engineer with Genie AI

Duration: 8 Months

Bill Rate: $74/hour (C2C)

Job Type: W-2, 1099, C2C

Client: To Be Discussed Later

Work Authorization: US Citizen, Green Card, OPT-EAD, CPT, H-1B, H4-EAD, Other

Job Summary:

We are looking for an experienced Databricks Data Engineer with strong hands-on expertise in data engineering and exposure to Genie AI / Genie Agents. The candidate will build scalable data pipelines and enable AI-powered conversational analytics on the Databricks platform.

Key Responsibilities

• Build and optimize data pipelines using Databricks, PySpark, Python and SQL.
• Develop ETL/ELT solutions using Delta Lake and Lakehouse architecture.
• Implement Bronze, Silver and Gold Medallion architecture.
• Work with Unity Catalog for data governance and access management.
• Configure and support Genie AI / Genie Agents for natural-language data querying and conversational analytics.
• Optimize Spark jobs, Databricks SQL workloads and data pipelines.
• Collaborate with data, analytics and business teams to deliver scalable data solutions.

Required Skills

• Strong hands-on experience with Databricks / Azure Databricks
• PySpark, Python and SQL
• Apache Spark and Delta Lake
• ETL/ELT and Data Engineering
• Databricks SQL
• Unity Catalog
• Lakehouse / Medallion Architecture

We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.