Data Engineer I, DSP Analytics

Mployee.me

Hyderabad

Presencial

INR 1 000 000 - 1 800 000

Tempo integral

Há 6 dias
Torna-te num dos primeiros candidatos

Uma candidatura completa num minuto

Currículo e carta de apresentação personalizados, prontos a enviar.

Ultrapassa os filtros ATS

Resumo da oferta

Amazon DSP Analytics is seeking a Data Engineer to design and build robust data pipelines for real-time and batch processing. You will work on data infrastructure powering GenAI applications, collaborating with data scientists and analysts to turn ML research into scalable products.

You’ll focus on data quality, privacy, and performance. You will contribute to building scalable pipelines, data warehousing, and analytics platforms, while staying current with industry trends and emerging

Qualificações

  • 2+ years of data engineering experience.
  • Experience with SQL.
  • Experience with data modeling, warehousing and building ETL pipelines.
  • Experience with one or more query language (e.g., SQL, PL/SQL, DDL, MDX, HiveQL, SparkSQL, Scala).
  • Experience with one or more scripting language (e.g., Python, KornShell).
  • Knowledge of database, data warehouse, or data lake solutions.

Responsabilidades

  • Design, build, and maintain robust data pipelines to acquire, process, and store data from various sources such as databases, APIs, and external data providers.
  • Develop and optimize ETL (Extract, Transform, Load) processes to clean, enrich, and structure raw data into a usable format for analysis and reporting.
  • Implement and manage data warehousing solutions to ensure efficient data storage, retrieval, and query performance.
  • Establish data quality standards, perform data validation, and proactively identify and address data quality issues.
  • Optimize data pipelines and storage solutions to handle large volumes of data while maintaining high performance and reliability.
  • Ensure data privacy and security by implementing access controls, encryption, and compliance with data protection regulations.
  • Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and provide the necessary data infrastructure to support their needs.
  • Maintain comprehensive documentation for data pipelines, data models, and processes to facilitate knowledge sharing and troubleshooting.
  • Implement monitoring solutions to proactively detect and address data pipeline failures or performance bottlenecks.
  • Keep abreast of industry trends and emerging technologies in data engineering to recommend and implement improvements to our data infrastructure.

Conhecimentos

SQL
Data pipelines
ETL
Data modeling
Data warehousing
Python
Spark
HiveQL
Scala
AWS

Ferramentas

Hadoop
Hive
Spark
EMR
Redshift
S3
Kinesis
Lambda
IAM

Descrição da oferta de emprego

Do you enjoy diving deep into data, developing real-time and batch pipelines that generate actionable insights?

The DSP Analytics team has an exciting opportunity for a Data Engineer to make impactful contributions to Amazon's Delivery Service Partner (DSP) program tackling modern data challenges by combining traditional engineering practices with transformative analytics and Generative AI.

You’ll help design and build the next generation of data infrastructure powering GenAI applications, and develop agents that automate the end-to-end data operations lifecycle. We are a team of Data Engineers working closely with Data Scientists, Economists, and Analysts turning machine learning and AI research into scalable products that delight customers worldwide.

You’re passionate about technology, strongly biased toward going deep to find insights, and driven to build scalable analytical platforms. You’re relentless about quality and reliability, and comfortable communicating across different levels of leadership. If that sounds like you, we’d love to talk.

Key job responsibilities
  • Design, build, and maintain robust data pipelines to acquire, process, and store data from various sources such as databases, APIs, and external data providers.
  • Develop and optimize ETL (Extract, Transform, Load) processes to clean, enrich, and structure raw data into a usable format for analysis and reporting.
  • Implement and manage data warehousing solutions to ensure efficient data storage, retrieval, and query performance.
  • Establish data quality standards, perform data validation, and proactively identify and address data quality issues.
  • Optimize data pipelines and storage solutions to handle large volumes of data while maintaining high performance and reliability.
  • Ensure data privacy and security by implementing access controls, encryption, and compliance with data protection regulations.
  • Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and provide the necessary data infrastructure to support their needs.
  • Maintain comprehensive documentation for data pipelines, data models, and processes to facilitate knowledge sharing and troubleshooting.
  • Implement monitoring solutions to proactively detect and address data pipeline failures or performance bottlenecks.
  • Keep abreast of industry trends and emerging technologies in data engineering to recommend and implement improvements to our data infrastructure.
About The Team

We are the Amazon DSP Analytics team, supporting all business pillars across the DSP organization horizontally, with the vision to enable data-, insights-, and science-driven decision-making. We are an exceptionally talented and fun-loving team. Here, you’ll have the opportunity to dive deep into complex business and data problems, drive large-scale technical solutions, and raise the bar for operational excellence. We love sharing ideas and learning from each other, and we believe in using those ideas to disrupt the status quo.

Basic Qualifications
  • 2+ years of data engineering experience
  • Experience with SQL
  • Experience with data modeling, warehousing and building ETL pipelines
  • Experience with one or more query language (e.g., SQL, PL/SQL, DDL, MDX, HiveQL, SparkSQL, Scala)
  • Experience with one or more scripting language (e.g., Python, KornShell)
  • Knowledge of database, data warehouse, or data lake solutions
Preferred Qualifications
  • Experience with big data technologies such as: Hadoop, Hive, Spark, EMR
  • Knowledge of basics of designing and implementing a data schema like normalization, relational model vs dimensional model
  • Experience with AWS technologies like Redshift, S3, AWS Glue, EMR, Kinesis, FireHose, Lambda, and IAM roles and permissions
  • Demonstrated experience leveraging generative AI tools to enhance workflow efficiency and productivity, with the ability to craft effective prompts and critically evaluate AI-generated outputs in a professional setting
  • Experience identifying opportunities to integrate AI solutions into products and services to drive business value

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.

Company - ADCI HYD 13 SEZ

Job ID: A10601582

Obtém a tua avaliação gratuita e confidencial do currículo.

ou arrasta e larga o ficheiro aqui.

Similar jobs

Ofertas semelhantes que vale a pena comparar

Data Engineer I, DSP Analytics
Data Engineer I, DSP Analytics

Amazon.com Inc. • Hyderabad

Presencial
INR 1 200 000 - 1 800 000
Data Engineer, SPT
Data Engineer, SPT

Amazon Inc. • Bengaluru

Presencial
INR 1 200 000 - 4 000 000
Data Engineer, SPT
Data Engineer, SPT

Mployee.me • Bengaluru

Presencial
INR 1 800 000 - 2 400 000
Data Engineer II
Data Engineer II

Mployee.me • Hyderabad

Presencial
INR 1 200 000 - 2 400 000
Data Engineer, MIDAS, Digital Acceleration
Data Engineer, MIDAS, Digital Acceleration

Amazon.com Inc. • Hyderabad

Presencial
INR 900 000 - 1 300 000
Data Engineer - AI/ML Products, AOP (Analytics Operations and Programs)
Data Engineer - AI/ML Products, AOP (Analytics Operations and Programs)

Amazon Inc. • Hyderabad

Presencial
INR 1 500 000 - 2 700 000
Data Engineer, Alexa Smart Home
Data Engineer, Alexa Smart Home

Amazon Inc. • Bengaluru

Presencial
INR 1 500 000 - 2 100 000
Data Engineer, SPT
Data Engineer, SPT

Amazon.com Inc. • Hyderabad

Presencial
INR 1 800 000 - 2 800 000
Data Engineer
Data Engineer

Amazon.com Inc. • Hyderabad

Presencial
INR 2 500 000 - 4 200 000
Data Engineer II
Data Engineer II

Amazon.com • Hyderabad

Presencial
INR 1 500 000 - 3 000 000