Senior AI & Data Engineer – Databricks, Remote

Eliassen Group

Nashville (TN)

À distance

USD 110 000 - 124 000

Plein temps

14 jours+

Obtenez une réponse de cet employeur

Votre CV et votre lettre de motivation, adaptés exactement à ce que l’employeur recherche.

Passez les filtres ATS

Avantages offerts par ce poste

Medical benefits
Dental benefits
Vision benefits
401(k) with match
Life insurance

Résumé du poste

Eliassen Group seeks a Staff AI & Data Engineer specializing in Databricks to design and implement enterprise-grade data and AI solutions. You will build scalable pipelines, orchestrate Bronze/Silver/Gold architectures, and enable cross-domain analytics in a remote, contract setting.

The role emphasizes GenAI-enabled data products, semantic layers, and governance. Excellent Python/SQL skills and AWS data services are essential. This position includes a strong benefits package for W2 consultants.

Qualifications

  • Advanced hands-on experience with Databricks, Apache Spark, Delta Lake, and SQL.
  • Hands-on experience with AWS data analytics services (EMR, Bedrock).
  • Strong Python and SQL development skills.
  • Experience building scalable batch and streaming data pipelines.
  • Deep understanding of Bronze/Silver/Gold medallion architectures.
  • Experience with Unity Catalog and governed enterprise data environments.
  • Experience with CI/CD, automated testing, and production deployment.
  • Experience building AI and GenAI solutions against enterprise data.
  • Knowledge of semantic layers and natural-language-to-data architectures.

Responsabilités

  • Design and build production-grade data pipelines on Databricks.
  • Ingest data from enterprise applications, databases, APIs, SaaS platforms, files, and other source systems.
  • Build and maintain Bronze, Silver, and Gold medallion architectures.
  • Implement incremental processing and change data capture patterns where appropriate.
  • Standardize types, codes, units, keys, and business definitions across source systems.
  • Implement deduplication, historical tracking, schema evolution, and data lineage.
  • Optimize pipelines for reliability, performance, scalability, and cost.
  • Build a configuration-driven source onboarding framework and Lakeflow pipeline templates.
  • Automate source registration, deployment, monitoring, lineage, and operational controls.
  • Implement data quality expectations, anomaly detection, monitoring, and quarantine processes.
  • Implement job and pipeline monitoring, alerting, audit logging, and operational dashboards.
  • Support automated deployment and promotion using Databricks Asset Bundles and CI/CD.
  • Develop conformed dimensions and shared-key strategies across domains.
  • Build integrated Gold-layer products and reusable data contracts.
  • Build AI-ready Gold data products with ownership, lineage, definitions, and quality information.
  • Develop semantic context, business glossary, ontology, and certified KPIs in Unity Catalog.
  • Build governed Unity Catalog functions and agent-ready tools and endpoints.
  • Implement tracing, evaluation, testing, monitoring, and governance for AI and agent workflows.
  • Support development of AI agents that use trusted enterprise data.

Connaissances

Databricks
Apache Spark
Python
SQL
ETL pipelines
AWS
Data governance
GenAI
CI/CD
Orchestration

Outils

Databricks Lakeflow
CI/CD tooling

Description du poste

Eliassen Group seeks a Staff AI & Data Engineer specializing in Databricks to design and implement enterprise-grade data and AI solutions. You will build scalable pipelines, orchestrate Bronze/Silver/Gold architectures, and enable cross-domain analytics in a remote, contract setting.

The role emphasizes GenAI-enabled data products, semantic layers, and governance. Excellent Python/SQL skills and AWS data services are essential. This position includes a strong benefits package for W2 consultants.

Obtenez votre examen gratuit et confidentiel de votre CV.

ou faites glisser et déposez votre fichier ici.

Similar jobs

Postes similaires à comparer

Senior AI & Data Engineer — Databricks, Remote
Senior AI & Data Engineer — Databricks, Remote

Eliassen Group • Montgomery (AL)

À distance
USD 110 000 - 124 000
Senior AI & Data Engineer, Databricks, Remote
Senior AI & Data Engineer, Databricks, Remote

Eliassen Group • Richmond (VA)

À distance
USD 110 000 - 124 000
Medical insurance
Dental insurance
Vision insurance
+2
Senior AI & Data Engineer — Databricks & GenAI (Remote)
Senior AI & Data Engineer — Databricks & GenAI (Remote)

Eliassen Group • Pierre (SD)

À distance
USD 110 000 - 124 000
Medical benefits
401k with company matching
Life insurance
Senior AI & Data Engineer - Databricks, Remote
Senior AI & Data Engineer - Databricks, Remote

Eliassen Group • San Juan (PR)

À distance
USD 110 000 - 124 000
Medical insurance
Dental insurance
Vision insurance
+2
Senior AI & Data Engineer, Databricks (Remote)
Senior AI & Data Engineer, Databricks (Remote)

Eliassen Group • Bismarck (ND)

À distance
USD 110 000 - 124 000
Medical benefits
Dental benefits
Vision benefits
+2
Remote Staff AI & Data Engineer (Databricks)
Remote Staff AI & Data Engineer (Databricks)

Eliassen Group • Boston (MA)

À distance
USD 110 000 - 124 000
Medical
Dental
Vision
+2
Senior AI & Data Engineer (Databricks) — Remote
Senior AI & Data Engineer (Databricks) — Remote

Eliassen Group • Providence (RI)

À distance
USD 110 000 - 124 000
Medical Insurance
Dental Insurance
Vision Insurance
+2
Staff AI & Data Engineer on Databricks — Remote
Staff AI & Data Engineer on Databricks — Remote

Eliassen Group • Jackson (MS)

À distance
USD 110 000 - 124 000
Medical, Dental, Vision benefits
401k with company match
Life insurance
Staff AI & Data Engineer - Databricks (Remote, W2)
Staff AI & Data Engineer - Databricks (Remote, W2)

Eliassen Group • Harrisburg

À distance
USD 110 000 - 124 000
Medical, dental, and vision benefits
401k with company matching
Life insurance
Staff AI & Data Engineer, Databricks — Remote
Staff AI & Data Engineer, Databricks — Remote

Eliassen Group • États-Unis

À distance
USD 110 000 - 124 000