ADG Senior Analyst (Data Engineer-Databricks & Pyspark)

Essex Lake Group

Gurugram District

Presencial

INR 1.200.000 - 2.200.000

Jornada completa

Hace 13 días

Consigue una respuesta de este empleador

Tu currículum y tu carta de presentación, adaptados exactamente a lo que buscan contratar.

Supera los filtros ATS

Descripción de la vacante

Essex Lake Group in Gurgaon, India, is seeking a data engineering professional to design, build, and maintain scalable data pipelines for banking analytics. You will partner with analytics, business and technology teams to deliver reliable, governed data assets and reusable data models.

The role focuses on ETL/ELT pipelines, Databricks, PySpark, Python and SQL, with data-security and governance considerations. Work from office, Mon–Fri, 2:00 PM–11:00 PM IST, in a dynamic, data-driven environment.

Formación

  • Hands-on experience with Databricks and PySpark.
  • Proficiency in Python and SQL.
  • Experience building ETL/ELT pipelines and working with Data Lake.
  • Understanding of distributed processing, workflow orchestration and performance tuning.
  • Working knowledge of the banking domain, including banking data and metrics.
  • Understanding of data-quality requirements, including validation, completeness, accuracy and consistency.

Responsabilidades

  • Design, build and maintain scalable data pipelines and curated datasets for analytics in the banking domain.
  • Partner with analytics, business and technology teams to deliver reliable data assets.
  • Develop data ingestion and transformation pipelines using Databricks, PySpark, Python and SQL.
  • Integrate data from multiple sources and prepare datasets for reporting and ML use cases.
  • Build reusable transformation components and analytical data models.
  • Implement data-quality checks, reconciliation, exception handling and pipeline monitoring.
  • Optimize Spark workloads for performance, reliability and cost.
  • Apply data security, access controls, lineage and documentation standards.
  • Support automated deployment, production troubleshooting and ongoing pipeline maintenance.
  • Translate banking business requirements into sustainable data solutions.

Conocimientos

Databricks
PySpark
Python
SQL
ETL/ELT pipelines
Data Lake
Distributed processing
Performance tuning
Banking domain knowledge
Data quality

Herramientas

Azure
Power BI

Descripción del empleo

With global headquarters in New York, U.S.A. and operations in India, Canada, China and the United Kingdom, Essex Lake Group LLC (“Essex”) delivers transformative profit enhancing solutions, anchored on insights from Big Data, Advanced Analytics and its extensive executive and industry experience. Essex’customized battle-tested solutions deliver a measurable positive impact within 6 to 18 months. Essex solutions have created substantial profit increases for clients in the areas of revenue growth, cost reduction, consumer and enterprise risk management regulatory compliance. Every Essex solution is customized for the client and the specific problem or opportunity. Essex has proven success and specific experience in the Financial Services, Retail Banking, Telecommunications, Insurance, Healthcare and Media & Entertainment industries, as well as others. Essex delivers visibility in complex businesses to help clients make sound business decisions and its experienced industry experts work with clients through full implementation of its solutions to ensure the organization receives all the benefits from its solutions and methodologies. Further information on the company can be found on its website: www.essexlg.com

About the Role

Experience- 3-5 Years

Location: Gurgaon, India

Work Mode: Work from Office (Monday- Friday)

Time: 2:00 PM – 11:00 PM IST

Role Summary

Design, build and maintain scalable data pipelines and curated datasets to support analytics, new capabilities and technology experimentation in the banking domain. Partner with analytics, business and technology teams to deliver reliable, reusable and governed data assets.

Responsibilities
  • Develop data ingestion and transformation pipelines using Databricks, PySpark, Python and SQL.
  • Integrate data from multiple sources and prepare datasets for reporting, analytics and machine-learning use cases.
  • Build reusable transformation components and analytical data models.
  • Implement data-quality checks, reconciliation, exception handling and pipeline monitoring.
  • Optimize Spark workloads for performance, reliability and cost.
  • Apply data security, access controls, lineage and documentation standards.
  • Support automated deployment, production troubleshooting and ongoing pipeline maintenance.
  • Translate banking business requirements into sustainable data solutions.
Required Skills

Required Skills & Experience

  • Strong hands-on experience with Databricks and PySpark
  • Proficiency in Python and SQL
  • Experience building ETL/ELT pipelines and working with Data Lake
  • Understanding of distributed processing, workflow orchestration and performance tuning
  • Working knowledge of the banking domain, including banking data and metrics
  • Understanding of data-quality requirements, including validation, completeness, accuracy and consistency
Preferred Skills
  • Experience with Azure-based data platforms
  • Familiarity with enterprise data governance and sensitive-data handling
  • Experience preparing data for Power BI and machine-learning applications
Consigue la evaluación confidencial y gratuita de tu currículum.

o arrastra y suelta tu archivo aquí

Similar jobs

Puestos de trabajo similares que vale la pena comparar

ADG Senior Analyst (Data Engineer-Databricks & Pyspark)
ADG Senior Analyst (Data Engineer-Databricks & Pyspark)

Essex Lake Group • India

Presencial
INR 1.200.000 - 2.400.000
ADG Analyst/Senior Analyst (Data Engineer-Databricks & Pyspark)
ADG Analyst/Senior Analyst (Data Engineer-Databricks & Pyspark)

Essex Lake Group • Gurugram District

Presencial
INR 1.200.000 - 2.000.000
Data Engineer
Data Engineer

MantriAI • Gurugram District

Presencial
INR 1.500.000 - 2.500.000
Senior Data Engineer
Senior Data Engineer

Intelaltus Llp • Gurugram District

Híbrido
INR 3.500.000 - 6.000.000
Senior Databricks Developer
Senior Databricks Developer

EXL • Gurugram District

Presencial
INR 1.800.000 - 2.800.000
Senior Data Engineer
Senior Data Engineer

Wissen • Bengaluru

Híbrido
INR 2.800.000 - 4.800.000
Senior Software Engineer_Data
Senior Software Engineer_Data

Giant Eagle GCC • Bengaluru

Presencial
INR 1.200.000 - 1.900.000
Data Engineer ID89384
Data Engineer ID89384

AgileEngine, LLC. • Ernakulam

Híbrido
INR 1.500.000 - 2.100.000
Remote work
Local presence in India
Competitive INR compensation
+1
Data Engineer ID89384
Data Engineer ID89384

AgileEngine, LLC. • Thiruvananthapuram

A distancia
INR 1.400.000 - 2.800.000
Remote work
Local presence in India
Competitive INR compensation
+1
Senior Data Engineer
Senior Data Engineer

Fa Ewjt Saasfaprod1 • Gurugram District

Presencial
INR 4.000.000 - 7.000.000