Databricks Engineer with Genie AI

Valiant Technologies LLC; Weehawken (NJ); On-site; USD 87,000 - 117,000; Full time

Job summary

Valiant Technologies LLC in New Jersey is seeking a Databricks Data Engineer to build scalable data pipelines on the Databricks platform and enable Genie AI-powered conversational analytics. You will implement Bronze-Silver-Gold medallion architecture, use Unity Catalog for governance, and leverage Delta Lake within a Lakehouse framework.

The role demands strong PySpark, Python and SQL skills, Spark optimization, and collaboration with analytics and business teams.

Qualifications

• Strong hands-on experience with Databricks / Azure Databricks.
• Hands-on PySpark, Python and SQL development.
• Experience with Apache Spark and Delta Lake.
• Familiarity with ETL/ELT and data engineering best practices.
• Experience with Databricks SQL and Unity Catalog.
• Knowledge of Lakehouse/Medallion architecture concepts.
• Exposure to Genie AI / Genie Agents is a plus.

Responsibilities

• Build and optimize data pipelines using Databricks, PySpark, Python and SQL.
• Develop ETL/ELT solutions using Delta Lake and Lakehouse architecture.
• Implement Bronze, Silver and Gold Medallion architecture.
• Work with Unity Catalog for data governance and access management.
• Configure and support Genie AI / Genie Agents for natural-language data querying and conversational analytics.
• Optimize Spark jobs, Databricks SQL workloads and data pipelines.
• Collaborate with data, analytics and business teams to deliver scalable data solutions.

Skills

Databricks / Azure Databricks

PySpark

Python

SQL

Apache Spark

Delta Lake

ETL/ELT

Databricks SQL

Unity Catalog

Lakehouse Architecture

Genie AI

Genie Agents

Job description

US Citizen, Green Card, H-1B, OPT-EAD, CPT, Other

Job Title: Databricks Engineer with Genie AI

Duration: 8 Months

Bill Rate: $74/hour (C2C)

Job Type: W-2, 1099, C2C

Client: To Be Discussed Later

Work Authorization: US Citizen, Green Card, OPT-EAD, CPT, H-1B, H4-EAD, Other

Job Summary:

We are looking for an experienced Databricks Data Engineer with strong hands-on expertise in data engineering and exposure to Genie AI / Genie Agents. The candidate will build scalable data pipelines and enable AI-powered conversational analytics on the Databricks platform.

Key Responsibilities

• Build and optimize data pipelines using Databricks, PySpark, Python and SQL.
• Develop ETL/ELT solutions using Delta Lake and Lakehouse architecture.
• Implement Bronze, Silver and Gold Medallion architecture.
• Work with Unity Catalog for data governance and access management.
• Configure and support Genie AI / Genie Agents for natural-language data querying and conversational analytics.
• Optimize Spark jobs, Databricks SQL workloads and data pipelines.
• Collaborate with data, analytics and business teams to deliver scalable data solutions.

Required Skills

• Strong hands-on experience with Databricks / Azure Databricks
• PySpark, Python and SQL
• Apache Spark and Delta Lake
• ETL/ELT and Data Engineering
• Databricks SQL
• Unity Catalog
• Lakehouse / Medallion Architecture

We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.