Software Engineer - Data Engineering

Caterpillar Inc.; Bengaluru; Presencial; INR 1.200.000 - 2.000.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Competitive salary

Health insurance

Professional development

Descripción de la vacante

Caterpillar in Bengaluru is seeking an experienced Data Engineer to design scalable data pipelines on AWS, build Snowflake warehousing, and develop reliable data processing using Python and SQL.

You will collaborate with data scientists and analysts, ensure data quality and security, and contribute to CI/CD deployments using GitHub Actions and AzDO in an Agile environment. The role requires 5–8 years in data engineering, deep AWS experience, and knowledge of graph and vector databases.

Formación

• 5–8 years of experience in data engineering.
• Strong hands-on AWS cloud services experience.
• Deep Snowflake architecture knowledge and best practices.
• Advanced proficiency in Python and SQL for data pipelines.
• Experience with graph and vector databases and modelling concepts.
• CI/CD pipelines (GitHub Actions) and cloud-native deployments.
• Experience with AzDO boards in Agile environments.
• Excellent analytical and problem-solving skills.
• Strong communication and collaboration abilities.

Responsabilidades

• Design, develop, and maintain scalable data pipelines on AWS (S3, Glue, Lambda, Redshift, EMR).
• Build and optimize Snowflake data warehousing solutions with data modeling and performance tuning.
• Write efficient Python and SQL for data transformation and processing.
• Collaborate with data scientists, analysts, and stakeholders to understand data needs.
• Monitor, troubleshoot, and improve pipeline performance and reliability.
• Ensure data quality, integrity, and security across all stages of the pipeline.

Conocimientos

Strong communication

Team collaboration

Educación

Bachelor’s or Master’s degree in Computer Science, Engineering, or related field

Herramientas

AWS

Snowflake

Python

SQL

Graph databases

Milvus or similar

Neo4J or similar

GitHub Actions

Azure DevOps

AWS Step Functions

Descripción del empleo

Career Area: Technology, Digital and Data Job Description: Your Work Shapes the World at Caterpillar Inc. When you join Caterpillar, you're joining a global team who cares not just about the work we do – but also about each other. We are the makers, problem solvers, and future world builders who are creating stronger, more sustainable communities. We don't just talk about progress and innovation here – we make it happen, with our customers, where we work and live. Together, we are building a better world, so we can all enjoy living in it.

Job Summary We are looking for a highly motivated and experienced Data Engineer to join our data engineering team. The ideal candidate will have a strong background in building scalable data pipelines using the AWS cloud stack and extensive hands-on experience with Snowflake. Proficiency in Python and SQL, along with graph and vector database technologies, is essential. This role requires strong problem-solving abilities and a proactive mindset to deliver efficient, scalable, and reliable data solutions.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines on AWS using services such as S3, Glue, Lambda, Redshift, and EMR.
• Build and optimize data warehousing solutions using Snowflake, including performance tuning and data modeling.
• Write efficient and reusable code in Python and SQL for data transformation and processing.
• Collaborate with cross-functional teams, including data scientists, analysts, and business stakeholders, to understand data requirements.
• Monitor, troubleshoot, and improve pipeline performance and reliability.
• Ensure data quality, integrity, and security across all stages of the pipeline.
• Participate in code reviews, architecture discussions, and continuous improvement initiatives.

Required Qualifications

• 5-8 years of experience in data engineering or related roles.
• Strong hands-on experience with AWS cloud services, including data and AI workloads.
• Deep understanding of Snowflake architecture, performance tuning, and best practices.
• Advanced proficiency in Python and SQL for data pipelines, transformations, and services.
• Strong understanding of graph and vector data modelling concepts and their practical applications.
• Experience developing and operating CI/CD pipelines (GitHub Actions) and cloud native deployments.
• Experience working with Azure DevOps (AzDO) boards for backlog management in Agile environments.
• Excellent analytical and problem-solving skills.
• Strong communication and collaboration abilities.
• Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.

Nice to Have skills

• Knowledge of the NVIDIA ecosystem and its applications in data and AI.
• Hands on experience with Vector (Milvus or similar) and Graph (Neo4J or similar) databases

Preferred Qualifications

• Experience with orchestration tools such as AWS Step Functions.
• Familiarity with data governance and compliance practices.
• Exposure to real-time data processing frameworks (e.g., Kafka, Spark Streaming).

Posting Dates: October 28, 2026 - November 3, 2026

Caterpillar is an Equal Opportunity Employer. Qualified applicants of any age are encouraged to apply

There’s more to work at Caterpillar than just the work itself. We hire smart, friendly people and it shows in our culture. We hold ourselves to high standards and make sure our values of integrity, excellence, teamwork, commitment and sustainability come to life in the way we work. We make sure our employees feel continuously challenged while also supported. We provide professional growth opportunities, including leadership programs. We celebrate the diversity of our team, while also working together as one Caterpillar. Our culture, like everything at our company, is made possible by each employee’s contribution. Person by person, we create the environment we work in, and we are proud of the Caterpillar we’ve built.