Lead Data Engineer: AI-Driven Data Platforms

Srijan Technologies

United States

Remote

USD 150.000 - 200.000

Vollzeit

14 Tage+

Erhalte eine Antwort von diesem Arbeitgeber

Dein Lebenslauf und dein Anschreiben, genau auf das zugeschnitten, was gesucht wird.

Schaffe es an den ATS-Filtern vorbei

Zusammenfassung

Srijan Technologies seeks a Lead Data Engineer to architect and deliver scalable data solutions across Databricks, Snowflake, AWS, and Azure. You will lead hands-on development of ETL/ELT pipelines for high-volume data and guide a team in data architecture and governance.

Role emphasizes CDC, real-time processing, REST API design, and DevOps/ML readiness while staying ahead of GenAI and observability trends.

Qualifikationen

  • 5+ years of experience in Data Engineering.
  • Expertise in designing, building, and managing large-scale Data Lakes and Data Warehouses.
  • Hands-on experience with CDC, complex batch processing, and real-time data processing.
  • Proven multi-cloud platform expertise (Databricks, Snowflake, AWS, Azure).
  • Proficient in SQL and Python for data processing and analytics.
  • Strong experience building and consuming REST APIs (FastAPI/Flask).
  • Solid DevOps/CI/CD experience (GitLab preferred) and container orchestration with Docker & Kubernetes.
  • MLOps concepts: data prep, model lifecycle, registries, monitoring.
  • Strong leadership and mentoring abilities; excellent collaboration and communication.

Aufgaben

  • Lead scalable ETL/ELT pipelines, data models, and integration frameworks for billions of records.
  • Design and optimize data processing across Databricks, Snowflake, AWS, and Azure.
  • Build robust pipelines with Airflow and Airbyte for data movement.
  • Architect CDC, batch, and real-time streaming solutions.
  • Develop internal REST APIs for downstream applications and users.
  • Leverage AI coding assistants to accelerate pipeline development.
  • Own CI/CD pipelines and DevOps practices with Docker/Kubernetes.
  • Collaborate with data scientists to ensure ML readiness and governance.
  • Establish data governance, quality, and security best practices.

Kenntnisse

Databricks
Snowflake
AWS
Azure
Airflow
Airbyte
CDC
ETL/ELT
Python
REST APIs
CI/CD
Docker
Kubernetes
MLOps
Data Modeling
Data Governance
Leadership
Communication

Tools

Airflow
Airbyte
Delta Lake
GitLab
Docker
Kubernetes

Jobbeschreibung

Srijan Technologies seeks a Lead Data Engineer to architect and deliver scalable data solutions across Databricks, Snowflake, AWS, and Azure. You will lead hands-on development of ETL/ELT pipelines for high-volume data and guide a team in data architecture and governance.

Role emphasizes CDC, real-time processing, REST API design, and DevOps/ML readiness while staying ahead of GenAI and observability trends.

Hol dir deinen kostenlosen, vertraulichen Lebenslauf-Check.

oder ziehe deine Datei hierhin.

Similar jobs

Ähnliche Jobs, die dir auch gefallen könnten

Lead Data Engineer: Scalable Data & AI Platform
Lead Data Engineer: Scalable Data & AI Platform

Lennar Corporation • Florida

Vor Ort
USD 122.000 - 152.000
Health insurance
401(k) with match
Paid parental leave
+2
Lead Data Engineer & Databricks Architect for AI-Ready Data
Lead Data Engineer & Databricks Architect for AI-Ready Data

Celebal Technologies • Dallas (TX)

Vor Ort
USD 180.000 - 240.000
Senior Data Engineer — Databricks, PySpark & Data Lakehouse
Senior Data Engineer — Databricks, PySpark & Data Lakehouse

Resolve Tech Solutions • Irving (TX)

Vor Ort
USD 110.000 - 160.000
Lead Data Engineer — Databricks & AI-Driven Platform
Lead Data Engineer — Databricks & AI-Driven Platform

JPMorganChase • Plano (TX)

Vor Ort
USD 150.000 - 210.000
Lead Data Architect & Engineer - Databricks Lakehouse
Lead Data Architect & Engineer - Databricks Lakehouse

CloudBigD • Atlanta (GA)

Vor Ort
USD 89.000 - 126.000
Lead Data Engineer: AI-Driven Pipelines on Snowflake
Lead Data Engineer: AI-Driven Pipelines on Snowflake

JP Morgan Chase • Plano (TX)

Vor Ort
USD 130.000 - 170.000
Lead Data Engineer
Lead Data Engineer

BCforward • Columbus (OH)

Vor Ort
USD 140.000 - 190.000
Lead Data Engineer, AI-Driven Platform & Databricks Expert
Lead Data Engineer, AI-Driven Platform & Databricks Expert

JP Morgan Chase • Plano (TX)

Vor Ort
USD 140.000 - 240.000
Lead Data & AI Solutions Architect
Lead Data & AI Solutions Architect

WinsAbove • San Francisco (CA)

Vor Ort
USD 180.000 - 248.000
Remote Lead Data Platform Architect (Databricks & AI)
Remote Lead Data Platform Architect (Databricks & AI)

Lovelytics • Arlington (VA), Chicago (IL)

Hybrid
USD 155.000 - 215.000