Senior Data Quality Analyst

Caterpillar Financial Services Corporation; Bengaluru; On-site; INR 2,600,000 - 4,000,000; Full time

Job summary

Caterpillar Financial Services Corporation is seeking a Senior Data Quality Analyst for GFS Strategy in Bangalore. The role leads data quality initiatives, designs DQ rules, and implements pipelines to ensure trusted data for finance analytics and reporting.

The candidate will work closely with stakeholders and governance teams. The position focuses on data quality, governance, and end-to-end pipeline delivery, requiring in-depth SQL/Python skills and 8+ years of relevant experience.

Qualifications

• 8+ years’ experience in data management or data quality governance.
• Strong SQL and Python skills.
• Experience with Snowflake and AWS data stack (AWS Glue, Glue Data Catalog, Lambda, Athena).
• Proven experience authoring and operationalizing DQ rules and remediation processes.
• Strong stakeholder engagement, requirements-gathering and documentation skills.
• Bachelor’s degree or equivalent practical experience.
• This position requires candidate to work a 5-day-a-week schedule in the office.

Responsibilities

• Lead data quality initiatives for Finance platforms by designing and operationalizing DQ rules, pipelines and remediation processes.
• Partner with stakeholders to ensure trusted, governed data for analytics and financial reporting.
• Design, build and operate end-to-end data quality pipelines and validations for finance datasets.
• Author, implement and monitor data quality rules and expectations.
• Capture metadata, lineage and access controls; collaborate with governance and security teams.
• Produce technical documentation and DQ dashboards; mentor junior analysts.

Skills

SQL

Python

Snowflake

AWS Glue

Airflow

Data governance

Data quality

Data management

Education

Bachelor's degree

Tools

Snowflake

AWS Glue

Lambda

Athena

Glue Data Catalog

Airflow

Job description

Career Area:

Technology, Digital and Data

Job Description:

Your Work Shapes the World at Caterpillar Inc.

When you join Caterpillar, you're joining a global team who cares not just about the work we do – but also about each other. We are the makers, problem solvers, and future world builders who are creating stronger, more sustainable communities. We don't just talk about progress and innovation here – we make it happen, with our customers, where we work and live. Together, we are building a better world, so we can all enjoy living in it.

About Caterpillar

Caterpillar Inc. is the world’s leading manufacturer of construction and mining equipment, off-highway diesel and natural gas engines, industrial gas turbines and diesel-electric locomotives. For nearly 100 years, we’ve been helping customers build a better, more sustainable world and are committed to and contributing to a reduced-carbon future. Our innovative products and services, backed by our global dealer network, provide exceptional value that helps customers succeed.

Your Impact Shapes the World at Caterpillar Inc

When you join Caterpillar, you're joining a global team who cares not just about the work we do – but also about each other. We are the makers, problem solvers and future world builders who are creating stronger, more sustainable communities. We don't just talk about progress and innovation here – we make it happen, with our customers, where we work and live. Together, we are building a better world, so we can all enjoy living in it.

Job Summary

We are seeking a skilled Senior Data Quality Analyst - GFS Strategy -Global Finance Services Division.

The incumbent would Lead data quality initiatives for Finance platforms by designing and operationalizing DQ rules, pipelines and remediation processes. Partner with stakeholders to ensure trusted, governed data for analytics and financial reporting.

The preference for this role is to be based out of Bangalore-Shared Services

What you will do

• Lead business and IT discussions for DQ solution development, enhancements and support
• Accountable and responsible for overall data accuracy and completeness for priority data elements
• Champion data governance framework and support data cataloging and glossary efforts
• Good with documentation and creating process maps – for example - technical design documents, Requirement Docs, BRDs, Project Plan, Status Decks, etc.
• Good requirement-gathering skills and experience as a technical business analyst.
• Design, build and operate end-to-end data quality pipelines and validations to support reconciliation and data quality for finance datasets.
• Author, implement and monitor data quality rules and expectations
• Build and maintain data pipelines using Snowflake/Snowpark and/or AWS Glue (Crawlers, Jobs, Workflows, Glue Data Quality).
• Integrate Glue workflows with Apache Airflow for orchestration; develop Lambda functions for processing and orchestration tasks.
• Design and develop API integrations connecting AWS/Snowflake/Web UI etc. to support data quality solution
• Drive DQ remediation with data owners and stewards: automate fixes where safe, escalation and manage manual remediation
• Capture metadata, lineage and access controls; collaborate with governance and security teams.
• Produce technical documentation, requirement specs and DQ dashboards; mentor junior analysts.

What you will have

• 8 + years’ experience in data management, data quality/governance or related roles.
• Strong hands-on experience with SQL and Python.
• Experience with Snowflake and/or AWS data stack (AWS Glue, Glue Data Catalog, Lambda, Athena).
• Proven experience authoring and operationalizing DQ rules and remediation processes.
• Strong stakeholder engagement, requirements-gathering and documentation skills.
• Bachelor’s degree or equivalent practical experience.
• This position requires candidate to work a 5-day -a -week schedule in the office.

Preferred Qualifications:

• Experience integrating Glue workflows with Apache Airflow.
• Experience with Alation or other data catalog tools.
• Certifications: AWS (Data Analytics or Solutions Architect), DAMA/DMBOK, or DQ certification.
• Experience with building dashboards or WebUI to support DQ dashboards
• Proficient in AI tools like Co-Pilot, Github Copilot, VS code, Snowflake Cortex etc.

Core Skills & Competencies:

• Data profiling, cleansing, enrichment and DQ frameworks
• Pipeline orchestration and automation
• Troubleshooting, logging and observability best practices (CloudWatch, monitoring tools)
• Version control (Git) and collaboration tools (Azure Devops)
• Strong analytical, communication and stakeholder management skills

Skills desired:

• Business Analysis: Knowledge of business analysis and the set of tasks, techniques and tools required to identify business needs; ability to recommend solutions that deliver value to stakeholders.
  Level Working Knowledge:
  Analyzes the value of a business and its functions through the value estimation of assets.
  Applies the prerequisites to a project before starting the business analysis process.
  Collaborates with stakeholders, development teams, testing teams, etc., to deliver business solutions.
  Documents the business case to justify the requirements of time and resources of a project.
  Utilizes diverse analysis tools and methodologies to group different business activities based on shared characteristics or similarities.
• Decision Making and Critical Thinking: Knowledge of the decision-making process and associated tools and techniques; ability to accurately analyze situations and reach productive decisions based on informed judgment.
  Level Extensive Experience:
  Differentiates assumptions, perspectives, and historical frameworks.
  Evaluates past decisions for insights to improve decision-making process.
  Assesses and validates decision options and points and predicts their potential impact.
  Advises others in analyzing and synthesizing relevant data and assessing alternatives.
  Uses effective decision-making approaches such as consultative, command, or consensus.
  Ensures that assumptions and received wisdom are objectively analyzed in decisions.
• Effective Communications: Understanding of effective communication concepts, tools and techniques; ability to effectively transmit, receive, and accurately interpret ideas, information, and needs through the application of appropriate communication behaviors.
  Level Extensive Experience:
  Reviews others' writing or presentations and provides feedback and coaching.
  Adapts documents and presentations for the intended audience.
  Demonstrates both empathy and assertiveness when communicating a need or defending a position.
  Communicates well downward, upward, and outward.
  Employs appropriate methods of persuasion when soliciting agreement.
  Maintains focus on the topic at hand.
• Software Change Request Management: Knowledge of software change request management; ability to manage software product change requests from customers, prospective customers, vendors, and internal staff.
  Level Extensive Experience:
  Describes methods for estimating costs for request fulfillment.
  Defines responses for non-standard or unsupported change requests.
  Contributes to the design and development of request process flow and templates.
  Clarifies description, components affected, need, cost estimate, risk, resources, status.
  Manages all aspects of the change request process.
  Researches new tools and techniques for monitoring product efficacy.
• Software Engineering: Knowledge of software engineering; ability to deliver new or enhanced fee-based software products.
  Level Working Knowledge:
  Identifies considerations for product integration with multiple platforms and systems.
  Works with development or delivery of a software package or component.
  Describes phases, activities, deliverables and processes for a specific methodology.
  Works with structured documents for developing features, functions, plans and schedules.
  Describes software design practices, technologies, and considerations.
• Software Problem Management: Knowledge of strategies, practices and tools for resolving software problems; ability to manage software problems in installed software products.
  Level Working Knowledge:
  Documents resolution progress and provides feedback to customers.
  Describes issues and consideration for resolving problems involving other products or vendors.
  Works with tracking and resolving common types of problems for a product or product group.
  Describes actions, tools, and procedures for problem reporting, solving, and resolution.
  Cites examples of unusual problems; follows proper notifications and escalation procedures.
• Software Product Business Knowledge: Knowledge of and experience with the business aspects and operation of a software product; ability to manage install base, current uses, future plans, and product vision.
  Level Extensive Experience:
  Participates in enhancing the sales process and expanding sales opportunities.
  Collects, documents, and maintains product functional requirements; makes recommendations.
  Supports and participates in major installations and customizations.
  Maintains and disseminates information on customer use and experiences.
  Has knowledge of all advanced business features and functions of the product.
  Relates experiences with unusual or non-traditional uses; assessments opportunities and challenges.
• User Acceptance Testing (UAT: Knowledge of UAT activities, tasks, tools and techniques; ability to design, implement and evaluate acceptance tests for end-users.
  Level Extensive Experience:
  Compares and contrasts features and benefits of major acceptance testing frameworks.
  Critiques user acceptance plans for appropriateness and completeness.
  Develops approaches for acceptance testing following legal or contractual agreements.
  Monitors end-users in defining