Lead Digital Arhcitect

Caterpillar Inc; Chennai District, Bengaluru; On-site; INR 4,000,000 - 7,000,000; Full time

Job summary

Caterpillar Inc. in Chennai, India seeks a highly skilled Data Architect to build a next-gen data platform, focusing on Big Data, Data Warehousing, and real-time data movement. You will shape the enterprise data blueprint and drive AI-enabled analytics across functions.

Responsibilities include leading end-to-end architecture design, establishing governance, and guiding engineers to deliver secure, scalable data solutions aligned with business goals.

Qualifications

• Bachelor's degree in Computer Science or IT is required.
• 12+ years of software development or 3+ years architecture experience.
• 5+ years designing data models and data warehousing.
• Expert in data security for data at rest and in transit and defining access control.
• Experience with data integration across systems and APIs.
• Strong background in building scalable data platforms and pipelines.

Responsibilities

• Lead Architecture design of end-to-end enterprise integrations for multiple functions.
• Design and implement end-to-end near real-time data movement solutions.
• Define the overall data architecture strategy aligned with business goals.
• Establish data governance policies, standards, and security guardrails.
• Translate business requirements into technical data solutions.
• Collaborate with data engineers and stakeholders to ensure data quality and interoperability.
• Oversee testing and validation of data platforms and components.

Skills

Big Data

Data Warehousing

Python

SQL

No-SQL databases

Cloud platforms

Data governance

End-to-end data pipelines

Education

Bachelor's degree in Computer Science or Information Technology

Tools

Snowflake

Kafka/Kinesis

AWS

Azure

DynamoDB

Aurora

RDS PostgreSQL

Job description

Seeking a highly skilled and visionary Data Architect to work with highly skilled engineers to build a robust next gen data platform. The ideal candidate will possess deep technical and functional expertise in Big Data, Data Warehousing, and end-to-end real-time data movement. You will architect and build Caterpillar's state-of-the-art digital platform, while driving innovation in AI and advanced analytics.

• Competent to perform all programming and provide oversight for architecture assessment and design for development assignments without close supervision; normally assigned the more complex aspects of systems work.

• Lead Architecture design of end-to-end enterprise integrations that serves multiple business functions.

• Design and implement end-to-end near real-time data movement solutions that provide core capabilities for the enterprise.

• Define the overall data architecture strategy aligned with business goals.

• Establish data governance policies, standards, and compliance Drives application development focused around delivering business valuable features

• Maintains high standards of software quality within the team by establishing good practices and security guardrails per Enterprise standards.

• Knowledge of target architecture; ability to develop the IT blueprint and roadmap while aligning the architecture and processes with business strategies and objectives

• Develop and maintain current, planned, and future state architecture blueprints. Lead in the identification and analysis of enterprise business drivers and requirements that drive the future state architecture.

• Work with business analysts, data engineers, and stakeholders. Translate business requirements into technical data solutions

• Communicate with end users and stake holders to help direct development, debugging, and testing of application software for accuracy, integrity, interoperability, and completeness.

• Performs integrated testing and customer acceptance testing of components that requires careful planning and execution to ensure timely, quality results.

Typical customers include Caterpillar customers, dealers, other external companies who purchase services offered by Caterpillar as well as internal business unit and/or service centre groups. The position is challenged to quickly and correctly identify problems that may not be obvious. The incumbent solves problems by determining the best architecture, within departmental guidelines, from many existing solutions.

Basic qualifications:

• Four-year bachelor's degree from an accredited college or university in a Computer Science or Information Technology, or related field

• 12+ years or more of software development experience or at least 3 years of architecture experience with strong demonstrable experience.

• 5+ years or more of experience in designing conceptual, logical, and physical data models & data models support scalability, performance, and integration needs.

• 5+ years of Data Warehousing experience & optimizing database performance, indexing, and storage strategies

• Expert in implementing security measures for data at rest and in transit and defining access control, encryption, and compliance frameworks

• Strong in designing data integration solutions across systems ensuring smooth data flow between applications, APIs, and data warehouses

• Top candidates will also have proven experience in many of the following,

• Designing, developing, deploying and maintaining software at scale, with good understanding of concurrency.

• Working experience in Python as an Object-Oriented programming language

• In-Depth understanding of how Data pipelines work in Big Data & expert in designing architectures for cloud-based data platforms (AWS, Azure) for large-scale processing.

• Expertise and experience in building Large Data Lakes and Data Warehouse (Snowflake Preferred).

• Expertise in building end-to-end near real-time data pipelines for OLTP & OLAP.

• Strong architecture exposure for building robust Data Platforms

• Expertise in SQL and NO-SQL databases, Message brokers and other AWS services such as Kafka/Kinesis, AWS SQS, AWS SNS, Lambda, API Gateway, DynamoDB, Aurora, AWS RDS PostgreSQL.

• Test driven development and behaviour driven development.

• Ability to work under pressure and within time constraints.

• Passion for technology and an eagerness to contribute to a team-oriented environment.

• Demonstrated leadership on medium to large-scale projects impacting strategic priorities.

• Strong understanding of AI concepts and latest developments (Gen AI, MCP, ATA, etc.).