AWS Data Engineer

Infarsight

India

Presencial

INR 4 500 000 - 7 000 000

Tempo integral

14 dias+

Uma candidatura completa num minuto

Currículo e carta de apresentação personalizados, prontos a enviar.

Ultrapassa os filtros ATS

Resumo da oferta

Infarsight is seeking a seasoned AWS Data Engineer to design and build cloud-native data pipelines, enabling real-time insights and scalable data solutions across our platforms. You will collaborate with data scientists and engineers to integrate data from internal systems and external sources, implementing streaming and batch processing while applying DevOps practices to improve DataOps across teams.

The role emphasizes data integrity, security, and performance, with responsibilities spanning

Qualificações

  • Bachelor's degree in CS/Engineering or related field.
  • 10+ years of application development experience.
  • 4+ years of big data and cloud platforms experience.
  • 6+ years UNIX/Linux and 8+ years Agile practices.

Responsabilidades

  • Develop, test, deploy, orchestrate, monitor, document, and troubleshoot cloud-based data pipelines.
  • Collaborate with data scientists, architects, ETL developers, and stakeholders to integrate data.
  • Lead research on batch and streaming data technologies and their business impact.
  • Advocate for emerging data engineering technologies across teams.
  • Define and improve data engineering processes and procedures.
  • Ensure data integrity, accuracy, and security across data assets.
  • Maintain high data quality standards for Data Services, Analytics, and Master Data.
  • Own the design, development, testing, and delivery of technical solutions.
  • Build automated, scalable, test-driven data pipelines.
  • Apply Git, CI/CD, and release management to AWS pipelines.
  • Partner with DevOps to improve DataOps tools and frameworks.

Conhecimentos

Python
SQL
Scala or Java
Unix/Linux
Agile engineering practices
SQL performance tuning
PySpark
Shell scripting

Formação académica

Bachelor's Degree in Computer Science, Engineering, or related field

Ferramentas

MapReduce
Hadoop
Hive
EMR
Kafka
Spark
Gurobi
MySQL
MongoDB
Cassandra
Redshift
Unix/Linux
Shell scripting
Airflow
KubeFlow
AWS Step Functions
Luigi
PySpark

Descrição da oferta de emprego

At Infarsight, we simplify complex operations across Finance, HR, Operations, and Supply Chain through intelligent platforms like Task Sight, Trip Sight, and Fleet Sight. Our engineering teams build scalable software, and our data solutions unlock real-time insights that help businesses move faster and smarter.

Role Overview

We are seeking a seasoned AWS Data Engineer to design and build cloud-native data pipelines, drive innovation in data engineering practices, and collaborate across teams to deliver secure, scalable, and high-quality data solutions. This role is critical to enabling real-time insights and supporting our mission to streamline enterprise operations.

Key Responsibilities
  • Develop, test, deploy, orchestrate, monitor, document, and troubleshoot cloud-based data pipelines and automation workflows in alignment with best practices and security standards.
  • Collaborate with data scientists, architects, ETL developers, and business stakeholders to capture, format, and integrate data from internal systems, external sources, and data warehouses.
  • Lead research and experimentation with batch and streaming data technologies to evaluate their business impact and suitability for current use cases.
  • Advocate for and enable the adoption of emerging data engineering technologies across teams.
  • Contribute to the definition and continuous improvement of data engineering processes and procedures.
  • Ensure data integrity, accuracy, and security across all corporate data assets.
  • Maintain high data quality standards for Data Services, Analytics, and Master Data Management.
  • Own the design, development, testing, and delivery of technical solutions.
  • Build automated, scalable, and test-driven data pipelines.
  • Apply software development practices including Git-based version control, CI/CD, and release management to enhance AWS CI/CD pipelines.
  • Partner with DevOps engineers and architects to improve DataOps tools and frameworks.
Basic Qualifications
  • Bachelor's Degree in Computer Science, Engineering, or related field.
  • 10+ years of experience in application development (excluding internships).
  • 4+ years of experience in big data technologies.
  • 4+ years of experience with cloud platforms (AWS, Azure, or GCP).
  • Proficiency in Python, SQL, Scala, or Java (4+ years).
  • Experience with distributed computing tools such as MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL (4+ years).
  • Hands-on experience with real-time data and streaming applications (4+ years).
  • NoSQL database experience (MongoDB, Cassandra) - 4+ years.
  • Data warehousing expertise (Redshift) - 4+ years.
  • UNIX/Linux proficiency including shell scripting - 6+ years.
  • Agile engineering practices - 8+ years.
  • SQL performance tuning and optimization - 8+ years.
  • PySpark experience - 4+ years.
  • Process orchestration tools (Airflow, KubeFlow, AWS Step Functions, Luigi) - 3+ years.
Preferred Qualifications
  • 3+ years of experience with Machine Learning workflows.
  • Experience building Data-as-a-Service platforms.
  • Experience designing and deploying APIs.
Obtém a tua avaliação gratuita e confidencial do currículo.

ou arrasta e larga o ficheiro aqui.

Similar jobs

Ofertas semelhantes que vale a pena comparar

AWS Devops Engineer
AWS Devops Engineer

Infarsight • Índia

Teletrabalho
INR 2 500 000 - 5 200 000
AWS Data Engineer
AWS Data Engineer

Durapid Technologies Pvt Ltd • Hyderabad

Presencial
INR 900 000 - 1 350 000
Aws Data Engineer
Aws Data Engineer

Astrosoft Technologies • Hyderabad

Presencial
INR 1 800 000 - 3 000 000
Senior Data Engineer
Senior Data Engineer

AagatiServe Pvt Ltd • Delhi

Presencial
INR 1 800 000 - 2 400 000
Sr. Data Engineer
Sr. Data Engineer

Minfy Technologies • Gurugram District

Presencial
INR 1 800 000 - 2 400 000
AWS Data Engineer
AWS Data Engineer

ExlService Holdings, Inc. • Bengaluru

Presencial
INR 1 200 000 - 2 200 000
AWS Data Engineer
AWS Data Engineer

Code1 • Chennai

Presencial
INR 1 500 000 - 2 300 000
AWS Data Engineer
AWS Data Engineer

Qtsolv • Hyderabad

Presencial
INR 1 200 000 - 1 800 000
Aws Data Engineer
Aws Data Engineer

Fugetron Corporation • Mumbai

Híbrido
INR 1 500 000 - 2 400 000
Lead AWS Data Engineer
Lead AWS Data Engineer

Weekday • Bengaluru

Presencial
INR 1 000 000 - 1 500 000