Data Engineer-Customer Analytics AIML

BMW TechWorks India Private Limited

Pune District

On-site

INR 1,200,000 - 2,400,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

BMW TechWorks India Private Limited seeks a data engineer to analyze, organize data and build scalable data systems from multiple sources. You will work closely with stakeholders and cross-functional teams for data analysis.

The role emphasizes building and optimizing data pipelines, ingesting and cleansing data from SaaS, cloud and on-premise sources, ensuring data quality and implementing features like incremental loads and identity resolution.

Qualifications

  • Must have coding skills in Spark/PySpark, Python and SQL.
  • Knowledge of AWS tools, Glue, Athena, step functions and S3.

Responsibilities

  • Analyze and organize data; build data systems from multiple sources.
  • Collaborate with stakeholders and cross-functional teams for data analysis.
  • Implement data pipelines to ingest and cleanse raw data from various source systems including SaaS, Cloud based and On-prem databases.
  • Monitor services and jobs for cost and performance; fix defects to ensure continual operation.
  • Optimize data pipelines to improve performance and reduce costs while maintaining data quality in the data lake.
  • Implement incremental loads, data snapshots and identity resolution.

Skills

Spark / PySpark
Python
SQL

Tools

Glue
Athena
Step Functions
S3

Job description

Job Description
What awaits you/ Job Profile
  • Analyze, Organize data and Build data systems with multiple data sources
  • Working closely with Stakeholders and Cross functional teams for the Data analysis.
What should you bring along
  • Build data systems and pipelines
  • Standardize the data assets which maximize data reusability
  • Evaluate business needs and objectives
  • Implementing data pipeline to ingest and cleanse raw data from various source systems including SaaS, Cloud based and On-prep databases
  • Conduct complex data analysis and report on results
  • Combine raw information from different sources
  • Explore ways to enhance data quality and reliability
  • Implementing functional requirements including incremental loads, data snapshots and identity resolution
  • Optimizing data pipelines to improve performance and cost, while ensuring a high quality of data within the data lake:
  • Monitoring services and jobs for cost and performance, ensuring continual operations of data pipelines, and fixing of defects.
  • Constantly looking for opportunities to optimize data pipelines to improve performance.
Must have technical skill
  • Must have coding skills in Spark/Pyspark, Python and SQL
  • Must have Knowledge of AWS tools, Glue, Athena ,step functions and S3
Good to have technical skills
  • Good knowledge of CI/CD (Github / Github Actions, Terraform)
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineer-Customer Analytics AIML
Data Engineer-Customer Analytics AIML

BMW Techworks India • Bengaluru

On-site
INR 700,000 - 1,300,000
Data Engineer
Data Engineer

Mployee.me • Bengaluru

On-site
INR 1,800,000 - 2,800,000
Data Engineer
Data Engineer

Recro • Bengaluru

On-site
INR 1,000,000 - 1,500,000
Data Engineer
Data Engineer

Recro • Bengaluru

On-site
INR 1,200,000 - 2,400,000
Data Engineer - Assistant Manager
Data Engineer - Assistant Manager

Kavi India • Chennai

On-site
INR 1,200,000 - 2,000,000
Data Engineer
Data Engineer

Naviq • India

On-site
INR 800,000 - 1,600,000
Data Engineer (4)
Data Engineer (4)

Compoundexpress Private Limited • Gurugram District

On-site
INR 800,000 - 1,800,000
Data Engineer
Data Engineer

Appsierra Group • Maharashtra

On-site
INR 1,200,000 - 2,100,000
Data Engineer (Platform Focus)
Data Engineer (Platform Focus)

Comviva • Gurugram District

On-site
INR 900,000 - 1,500,000
Data Engineer
Data Engineer

e-stonetech • Mumbai

On-site
INR 2,500,000 - 5,000,000