Data Specialist (Senior Data Engineer)

Caterpillar; Bengaluru; In loco; INR 1.200.000 - 2.100.000; Tempo pieno

Descrizione del lavoro

Caterpillar is seeking a Senior Data Engineer to join the Financial Systems Tech Support - CAT IT Division in Bengaluru. The role focuses on designing, developing, and maintaining scalable data pipelines, ensuring data quality and governance, and collaborating with cross-functional teams to meet data-driven objectives.

The ideal candidate has 5-8 years of data engineering experience, strong SQL and ETL tool skills, and is comfortable working in a 5-day in-office schedule.

Competenze

• Bachelor’s degree in computer science, IT, data science or a related field.
• 5-8 years of experience in data engineering, data analysis, or software development.
• Strong experience with SQL (Oracle, Teradata, Snowflake) and data integration concepts.
• Hands-on experience with ETL tools like Datastage, Informatica, SnapLogic.
• Knowledge of ETL architecture, data storage, and data governance best practices.
• Familiarity with CI/CD pipelines and Unix commands.
• Experience with AWS Glue and Qlik replication is a plus.
• This position requires working in the Bengaluru office on a 5-day schedule.

Mansioni

• Design, develop, and maintain scalable data pipelines to ingest, process, and store large data volumes.
• Implement ETL workflows to ensure data quality and integrity.
• Collaborate with architects, product owners, and analysts to deliver data solutions.
• Integrate data from multiple sources (databases, APIs, external providers) into a unified platform.
• Monitor and optimize pipeline performance and resolve bottlenecks.
• Document data engineering processes and collaborate with cross-functional teams.

Conoscenze

Advanced SQL

Data pipeline development

Data integration

Data quality checks

CI/CD practices

Formazione

Bachelor’s degree in Computer Science/IT/Data Science or related field

Strumenti

Datastage

Informatica

SnapLogic

AWS Glue

Qlik Replication

Github Actions

Unix commands

Descrizione del lavoro

Career Area:

Technology, Digital and Data

Job Description:

Your Work Shapes the World at Caterpillar Inc.

When you join Caterpillar, you're joining a global team who cares not just about the work we do – but also about each other. We are the makers, problem solvers, and future world builders who are creating stronger, more sustainable communities. We don't just talk about progress and innovation here – we make it happen, with our customers, where we work and live. Together, we are building a better world, so we can all enjoy living in it.

Your Impact Shapes the World at Caterpillar Inc

When you join Caterpillar, you're joining a global team who cares not just about the work we do – but also about each other. We are the makers, problem solvers and future world builders who are creating stronger, more sustainable communities. We don't just talk about progress and innovation here – we make it happen, with our customers, where we work and live. Together, we are building a better world, so we can all enjoy living in it.

Job Summary

We are seeking a skilled Data Specialist (Senior Data Engineer) join our Financial Systems Tech Support -CAT IT Division

We are seeking a highly motivated and detail-oriented Junior Data Engineer to join our dynamic team. The ideal candidate will have a good foundation in data engineering principles, a keen analytical mindset, and the ability to work collaboratively in a fast-paced environment. As a Junior Data Engineer, you will play a critical role in designing, developing, and maintaining data pipelines and infrastructure to support our organization's data needs.

The preference for this role is to be based out of Bangalore – Caterpillar PSN

What you will do

Data Pipeline Development

• Design, develop, and maintain scalable and reliable data pipelines to ingest, process, and store large volumes of data from various sources.
• Implement data workflows using ETL (Extract, Transform, Load) processes to ensure data quality and integrity.

Data Integration and Management

• Collaborate with data architects, product owners, business analysts, and other stakeholders to understand data requirements and deliver data solutions that meet their needs.
• Integrate data from multiple sources, including databases, APIs, and external data providers, into a unified data platform.
• Manage and optimize data storage solutions, ensuring efficient data retrieval and processing.

Data Quality and Governance

• Implement data quality checks and validation processes to ensure the accuracy and consistency of data.
• Adhere to data governance policies and best practices to maintain data security and compliance.

Performance Optimization

• Monitor and optimize data pipeline performance to ensure timely and efficient data processing.
• Identify and resolve performance bottlenecks and system issues to maintain data pipeline reliability.

Documentation and Collaboration

• Document data engineering processes, workflows, and solutions for future reference and knowledge sharing.
• Collaborate with cross-functional teams to support data-driven decision-making and project initiatives.

What you will have

Education and Experience

• Bachelor’s degree in computer science, Information Technology, Data Science, or a related field.
• 5-8 years of experience in data engineering, data analysis, or software development.

Technical Skills

• Strong experience on advanced SQL any Database. (Oracle, Teradata, snowflake).
• Experience in data integration area and hands on experience in any of the ETL tools like Datastage , Informatica , Snaplogic etc.
• Able to transform technical requirements into data collection query.
• Should be capable of working with business and other IT teams and convert the requirements into queries.
• Good understanding of ETL architecture and design.
• Good knowledge in Databases, SQL, or PL/SQL
• Good experience with CI/CD tools such as Github Actions (AzDO pipelines)
• Good to have knowledge on Unix commands
• Good to have an experience on AWS Glue
• Good to have knowledge on Qlik replication tool
• This position requires candidate to work a 5-day -a -week schedule in the office.
• Shift Timing: 01:00-10:00PM IST

Soft Skills

• Good analytical and problem-solving skills with attention to detail.
• Excellent communication and interpersonal skills to collaborate effectively with cross-functional teams.
• Ability to manage multiple tasks and prioritize workload in a fast-paced environment.
• Eagerness to learn new technologies and stay updated with industry trends.

Skills desired:

Value Realization:

Knowledge of value realization methods; ability to plan, execute, monitor and manage business activities and resources to determine and achieve the actual value from a business initiative as estimated in an associated business case.

Level Basic Understanding:

• Describes the importance of Value Realization milestones for long-term projects.
• Assists in measuring and attaining post-project implementation value.
• Identifies process changes or business value integration in change initiative plans and activities.
• Contributes to project team communication regarding the linkage of a change initiative to its associated business goals and case.