Data Engineer-Customer Analytics AIML

BMW Techworks India

Bengaluru

Sur place

INR 700 000 - 1 300 000

Plein temps

14 jours+

Obtenez une réponse de cet employeur

Votre CV et votre lettre de motivation, adaptés exactement à ce que l’employeur recherche.

Passez les filtres ATS

Qualifications

  • Analyze, organize data and build data systems with multiple data sources.
  • Collaborate with stakeholders and cross-functional teams for data analysis.
  • Ingest and cleanse raw data from SaaS, cloud and on-prem sources.
  • Develop data pipelines with incremental loads and data snapshots.
  • Monitor, optimize performance and cost of data pipelines.
  • Ensure data quality and reliability in the data lake.

Responsabilités

  • Analyze, organize data and build data systems with multiple data sources.
  • Work with stakeholders and cross-functional teams for data analysis.
  • Implement data pipelines to ingest and cleanse data from SaaS, cloud and on-prem sources.
  • Develop, test and deploy data processing jobs with incremental loads and snapshots.
  • Optimize data pipelines for performance and cost while ensuring data lake quality.
  • Monitor services for cost, performance and reliability; fix defects.

Connaissances

Spark/PySpark
Python
SQL

Formation

B Tech
M Tech

Outils

AWS
Glue
Athena
Step Functions
S3
Github Actions
Terraform

Description du poste

B Tech M Tech

Job Description

What awaits you/ Job Profile

  • Analyze, Organize data and Build data systems with multiple data sources
  • Working closely with Stakeholders and Cross functional teams for the Data analysis.

What should you bring along

  • Build data systems and pipelines
  • Standardize the data assets which maximize data reusability
  • Evaluate business needs and objectives
  • Implementing data pipeline to ingest and cleanse raw data from various source systems including SaaS, Cloud based and On-prep databases
  • Conduct complex data analysis and report on results
  • Combine raw information from different sources
  • Explore ways to enhance data quality and reliability
  • Implementing functional requirements including incremental loads, data snapshots and identity resolution
  • Optimizing data pipelines to improve performance and cost, while ensuring a high quality of data within the data lake:
  • Monitoring services and jobs for cost and performance, ensuring continual operations of data pipelines, and fixing of defects.
  • Constantly looking for opportunities to optimize data pipelines to improve performance.

Must have technical skill

  • Must have coding skills in Spark/Pyspark, Python and SQL
  • Must have Knowledge of AWS tools, Glue, Athena ,step functions and S3

Good to have technical skills

  • Good knowledge of CI/CD (Github / Github Actions, Terraform)
Obtenez votre examen gratuit et confidentiel de votre CV.

ou faites glisser et déposez votre fichier ici.

Similar jobs

Postes similaires à comparer

Data Engineer-Customer Analytics AIML
Data Engineer-Customer Analytics AIML

BMW TechWorks India Private Limited • Pune District

Sur place
INR 1 200 000 - 2 400 000
Data Engineer (4)
Data Engineer (4)

Compoundexpress Private Limited • Gurugram District

Sur place
INR 800 000 - 1 800 000
Data Engineer
Data Engineer

Mployee.me • Bengaluru

Sur place
INR 1 800 000 - 2 800 000
AWS Data Engineer
AWS Data Engineer

Qtsolv • Hyderabad

Sur place
INR 1 200 000 - 1 800 000
Data Engineer
Data Engineer

Recro • Bengaluru

Sur place
INR 1 200 000 - 2 400 000
Data Engineer
Data Engineer

MINDTEL • Pune District

Hybride
INR 1 200 000 - 2 100 000
Data Engineer
Data Engineer

Recro • Bengaluru

Sur place
INR 1 000 000 - 1 500 000
Data Engineer - Assistant Manager
Data Engineer - Assistant Manager

Kavi India • Chennai

Sur place
INR 1 200 000 - 2 000 000
Data Engineer
Data Engineer

novio • Mumbai

Sur place
INR 800 000 - 1 500 000
Data Engineer - ETL
Data Engineer - ETL

Forward Eye Technologies • Pune District

Sur place
INR 1 500 000 - 2 100 000