Senior Specialist - Data Engineering

Vivantify Technology Solutions India Pvt. Ltd.

United States

Teletrabalho

USD 42 000 - 90 000

Tempo integral

14 dias+

Recebe uma resposta deste empregador

O teu currículo e carta de apresentação, adaptados exatamente ao que estão a contratar.

Ultrapassa os filtros ATS

Vantagens oferecidas por esta oferta de emprego

Competitive salary
Growth opportunities
Collaborative environment

Resumo da oferta

eBSI Export Academy in Pune seeks an experienced Data Engineer with 8+ years of expertise in Big Data, Databricks, Spark, PySpark, Scala, and SQL. The role centers on delivering scalable data solutions using Databricks, Delta Lake, Lakehouse architecture, AWS, and Power BI in an Agile environment.

You will design and develop data pipelines, work with Delta Lake, perform data modeling, and collaborate with stakeholders to drive data-driven insights across BI and reporting platforms.

Qualificações

  • 8+ years of Data Engineering experience with Databricks, Spark, PySpark and SQL.
  • Experience building data pipelines and modeling with Delta Lake in Lakehouse architectures.
  • Strong AWS exposure including EMR, S3, Glue, Redshift or similar services.

Responsabilidades

  • Design scalable data engineering solutions using Databricks and Spark.
  • Build and maintain data pipelines with Delta Lake and Lakehouse architecture.
  • Develop complex SQL queries and data models across relational databases.

Conhecimentos

Databricks
Apache Spark
PySpark
Scala
Python
SQL
Power BI
Delta Lake
Lakehouse architecture
AWS
S3/EMR
Git & CI/CD
Unity Catalog

Descrição da oferta de emprego

Location: Pune

Experience: 7–11 Years

About the Role

We are seeking an experienced Data Engineer with 8+ years of expertise in Big Data Engineering, Databricks, Apache Spark, PySpark, Scala, and SQL . The role focuses on building and delivering scalable data solutions using Databricks, Delta Lake, Lakehouse architecture, AWS, and Power BI in a fast-paced Agile environment.

Job Description

The role involves designing, developing, and supporting modern data engineering solutions using Databricks and Apache Spark , with strong emphasis on PySpark, Scala, Python, SQL, and data modeling. The candidate will work with Delta Lake and Lakehouse architecture to build scalable distributed data processing solutions.

Key Responsibilities
  • Design and develop scalable data engineering solutions using Databricks, Apache Spark, PySpark, Scala, and Python .
  • Build and maintain data pipelines using Delta Lake and Lakehouse architecture .
  • Develop complex SQL queries and implement effective data models across relational databases.
  • Work with AWS Big Data services and manage EMR clusters and associated services.
  • Develop data visualization and reporting solutions using Power BI .
  • Implement data orchestration, streaming, CI/CD, and source control practices.
  • Work with data cataloguing solutions such as Unity Catalog .
  • Collaborate with stakeholders in Agile environments and take ownership of data engineering deliverables.
Required Skills
  • Databricks
  • Apache Spark, PySpark, and Scala
  • Python
  • SQL and Data Modelling
  • Power BI
  • Delta Lake and Lakehouse architecture
  • AWS cloud platform
  • AWS services: S3, Glue, EMR, DMS, Athena, RDS, Redshift, Kinesis
  • EMR cluster management
  • Data orchestration tools
  • Kafka / streaming frameworksRDBMS: PostgreSQL, Oracle, SQL Server
  • Complex SQL queries, particularly in PostgreSQL
  • Git and CI/CD pipelines
  • Azure DevOps / GitHub
  • Unity Catalog
  • Distributed computing principles
  • Agile, Continuous Integration, Test-Driven Development, and Infrastructure as Code practices
Preferred / Good to Have
  • Data warehousing concepts
  • Experience supporting Machine Learning pipelines in Databricks
  • MLflow experiment tracking and model registry
  • Databricks Mosaic AI, Vector Search, and embeddings pipelines
  • Generative AI concepts including LLMs, embeddings, and RAG
  • Terraform or CloudFormation
  • Debezium or other CDC tools
  • Jenkins-based workflow orchestration
Mandatory Skills
  • Databricks
Candidate Profile

The ideal candidate will have 8+ years of Data Engineering experience , including strong hands‑on expertise in Databricks, Spark, Python, SQL, AWS, and modern data architecture. The candidate should possess strong analytical and problem‑solving abilities, communicate effectively with stakeholders, and demonstrate ownership while working in a fast‑paced Agile environment.

Benefits Package
  • Competitive salary and benefits package
  • Opportunities for professional growth and development
  • A collaborative and inclusive work environment
  • The opportunity to work on exciting and challenging projects with leading clients
Obtém a tua avaliação gratuita e confidencial do currículo.

ou arrasta e larga o ficheiro aqui.

Similar jobs

Ofertas semelhantes que vale a pena comparar

Senior Data Engineer - Databricks
Senior Data Engineer - Databricks

UNAVAILABLE • McLean (VA)

Presencial
USD 120 000 - 160 000
Senior Data Engineer - Databricks, Spark & Airflow
Senior Data Engineer - Databricks, Spark & Airflow

Compunnel Inc. • Norfolk (VA)

Híbrido
USD 110 000 - 150 000
Lead Databricks Data Engineer
Lead Databricks Data Engineer

Fa Ewjt Saasfaprod1 • New York (NY)

Presencial
USD 140 000 - 170 000
Senior Data Engineer
Senior Data Engineer

Bitful • EUA

Teletrabalho
USD 120 000 - 180 000
Senior Consultant (Databricks)
Senior Consultant (Databricks)

Unison Group • San Francisco (CA)

Presencial
USD 180 000 - 250 000
Senior Solutions Consultant
Senior Solutions Consultant

Unison Group • San Francisco (CA)

Presencial
USD 140 000 - 190 000
Databricks Data Engineer
Databricks Data Engineer

EXL Talent Acquisition Team • New York (NY)

Presencial
USD 170 000 - 230 000
Senior Data Engineer
Senior Data Engineer

Bitful Inc. • Wadsworth (OH)

Presencial
USD 110 000 - 160 000
Senior Data Engineer - Databricks
Senior Data Engineer - Databricks

DATAECONOMY Inc • New Jersey

Presencial
USD 140 000 - 180 000
Databricks Developer
Databricks Developer

Vservice It Solutions • EUA

Teletrabalho
USD 140 000 - 190 000