Senior Data Quality Analyst
Caterpillar Inc.
Stand out for this role — generate a tailored resume and cover letter in about a minute.
Benefits offered by this job
Job summary
Caterpillar Inc. in Bengaluru (Bangalore) seeks a Senior Data Quality Analyst for the Global Finance Services Division. You will lead data quality initiatives, design rules and pipelines, and collaborate with finance stakeholders to ensure trusted data for analytics and reporting.
The role emphasizes governance, data cataloging, and end-to-end DQ pipelines using Snowflake, AWS Glue, and Airflow, with onsite work five days a week in the Bangalore Shared Services setup.
Qualifications
- 8+ years in data management, data quality/governance or related roles.
- Strong SQL and Python capabilities with hands-on experience.
- Experience with Snowflake and/or AWS data stack (Glue, Lambda, Airflow).
- Proven ability to author data quality rules and remediation processes.
- Excellent stakeholder engagement and documentation skills.
- Bachelor’s degree or equivalent practical experience.
Responsibilities
- Lead data quality initiatives for Finance platforms by designing DQ rules, pipelines and remediation processes.
- Partner with stakeholders to ensure trusted, governed data for analytics and reporting.
- Lead DQ solution discussions and oversee end-to-end data quality pipelines.
- Build data pipelines using Snowflake/Snowpark and AWS Glue; orchestrate with Airflow.
- Develop API integrations and automate data quality remediation with data owners.
- Create and maintain metadata, lineage and data quality dashboards; mentor juniors.
Skills
Education
Tools
Job description
Your Work Shapes the World at Caterpillar Inc.
When you join Caterpillar, you're joining a global team who cares not just about the work we do - but also about each other. We are the makers, problem solvers, and future world builders who are creating stronger, more sustainable communities. We don't just talk about progress and innovation here - we make it happen, with our customers, where we work and live. Together, we are building a better world, so we can all enjoy living in it.
Technology, Digital and Data
We are seeking a skilled Senior Data Quality Analyst - GFS Strategy -Global Finance Services Division.
The incumbent would Lead data quality initiatives for Finance platforms by designing and operationalizing DQ rules, pipelines and remediation processes. Partner with stakeholders to ensure trusted, governed data for analytics and financial reporting.
The preference for this role is to be based out of Bangalore-Shared Services.
- Lead business and IT discussions for DQ solution development, enhancements and support
- Accountable and responsible for overall data accuracy and completeness for priority data elements
- Champion data governance framework and support data cataloging and glossary efforts
- Good with documentation and creating process maps – for example - technical design documents, Requirement Docs, BRDs, Project Plan, Status Decks, etc.
- Good requirement-gathering skills and experience as a technical business analyst.
- Design, build and operate end-to-end data quality pipelines and validations to support reconciliation and data quality for finance datasets.
- Author, implement and monitor data quality rules and expectations
- Build and maintain data pipelines using Snowflake/Snowpark and/or AWS Glue (Crawlers, Jobs, Workflows, Glue Data Quality).
- Integrate Glue workflows with Apache Airflow for orchestration; develop Lambda functions for processing and orchestration tasks.
- Design and develop API integrations connecting AWS/Snowflake/Web UI etc. to support data quality solution
- Drive DQ remediation with data owners and stewards: automate fixes where safe, elevate and manage manual remediation
- Capture metadata, lineage and access controls; collaborate with governance and security teams.
- Produce technical documentation, requirement specs and DQ dashboards; mentor junior analysts.
- 8 + years' experience in data management, data quality/governance or related roles.
- Strong hands-on experience with SQL and Python.
- Experience with Snowflake and/or AWS data stack (AWS Glue, Glue Data Catalog, Lambda, Athena).
- Proven experience authoring and operationalizing DQ rules and remediation processes.
- Strong stakeholder engagement, requirements-gathering and documentation skills.
- Bachelor's degree or equivalent practical experience.
- This position requires candidate to work a 5-day -a -week schedule in the office.
- Experience integrating Glue workflows with Apache Airflow.
- Experience with Alation or other data catalog tools.
- Certifications: AWS (Data Analytics or Solutions Architect), DAMA/DMBOK, or DQ certification.
- Experience with building dashboards or WebUI to support DQ dashboards
- Proficient in AI tools like Co-Pilot, Github Copilot, VS code, Snowflake Cortex etc.
- Data profiling, cleansing, enrichment and DQ frameworks
- Pipeline orchestration and automation
- Troubleshooting, logging and observability best practices (CloudWatch, monitoring tools)
- Version control (Git) and collaboration tools (Azure Devops)
- Strong analytical, communication and stakeholder management skills
Business Analysis: Knowledge of business analysis and the set of tasks, techniques and tools required to identify business needs; ability to recommend solutions that deliver value to stakeholders.
- Analyzes the value of a business and its functions through the value estimation of assets.
- Applies the prerequisites to a project before starting the business analysis process.
- Collaborates with stakeholders, development teams, testing teams, etc., to deliver business solutions.
- Documents the business case to justify the requirements of time and resources of a project.
- Utilizes diverse analysis tools and methodologies to group different business activities based on shared characteristics or similarities.
Knowledge of the decision-making process and associated tools and techniques; ability to accurately analyze situations and reach productive decisions based on informed judgment.
- Differentiates assumptions, perspectives, and historical frameworks.
- Evaluates past decisions for insights to improve decision-making process.
- Assesses and validates decision options and points and predicts their potential impact.
- Advises others in analyzing and synthesizing relevant data and assessing alternatives.
- Uses effective decision-making approaches such as consultative, command, or consensus.
- Ensures that assumptions and received wisdom are objectively analyzed in decisions.
Understanding of effective communication concepts, tools and techniques; ability to effectively transmit, receive, and accurately interpret ideas, information, and needs through the application of appropriate communication behaviors.
- Reviews others' writing or presentations and provides feedback and coaching.
- Adapts documents and presentations for the intended audience.
- Demonstrates both empathy and assertiveness when communicating a need or defending a position.
- Communicates well downward, upward, and outward.
- Employs appropriate methods of persuasion when soliciting agreement.
- Maintains focus on the topic at hand.
Knowledge of software change request management; ability to manage software product change requests from customers, prospective customers, vendors, and internal staff.
- Describes methods for estimating costs for request fulfillment.
- Defines responses for non-standard or unsupported change requests.
- Contributes to the design and development of request process flow and templates.
- Clarifies description, components affected, need, cost estimate, risk, resources, status.
- Manages all aspects of the change request process.
- Researches new tools and techniques for monitoring product efficacy.
Knowledge of software engineering; ability to deliver new or enhanced fee-based software products.
- Identifies considerations for product integration with multiple platforms and systems.
- Works with development or delivery of a software package or component.
- Describes phases, activities, deliverables and processes for a specific methodology.
- Works with structured documents for developing features, functions, plans and schedules.
- Describes software design practices, technologies, and considerations.
Knowledge of strategies, practices and tools for resolving software problems; ability to manage software problems in installed software products.
- Documents resolution progress and provides feedback to customers.
- Describes issues and consideration for resolving problems involving other products or vendors.
- Works with tracking and resolving common types of problems for a product or product group.
- Describes actions, tools, and procedures for problem reporting, solving, and resolution.
- Cites examples of unusual problems; follows proper notifications and escalation procedures.
Knowledge of and experience with the business aspects and operation of a software product; ability to manage install base, current uses, future plans, and product vision.
- Participates in enhancing the sales process and expanding sales opportunities.
- Collects, documents, and maintains product functional requirements; makes recommendations.
- Supports and participates in major installations and customizations.
- Maintains and disseminates information on customer use and experiences.
- Has knowledge of all advanced business features and functions of the product.
- Relates experiences with unusual or non-traditional uses; assesses opportunities and challenges.
Knowledge of UAT activities, tasks, tools and techniques; ability to design, implement and evaluate acceptance tests for end-users.
- Compares and contrasts features and benefits of major acceptance testing frameworks.
- Critiques user acceptance plans for appropriateness and completeness.
- Develops approaches for acceptance testing following legal or contractual agreements.
- Monitors end-users in defining the testing environment and acceptance criteria; explains the importance of being actively involved in test designs and other testing phases.
- Applies user acceptance testing in typical software development scenarios.
- Consults on test strategies, components, processes, plans and approaches during the user acceptance testing process.
- Work Life Harmony
- Earned and medical leave.
- Relocation assistance
- Personal and professional development through Caterpillar's employee resource groups across the globe
- Career developments opportunities with global prospects
- Medical coverage -Medical, life and personal accident coverage
- Employee mental wellness assistance program
- Employee investment plan
- Pay for performance -Annual incentive Bonus plan.
Caterpillar is not currently hiring individuals for this position who now or in the future require sponsorship for employment visa status; however, as a global company, Caterpillar offers many job opportunities outside of the U.S. which can be found through our employment website at www.caterpillar.com/careers
This position requires working onsite five days a week.
Visa Sponsorship is not available for this position.
Caterpillar is an Equal Opportunity Employer. Qualified applicants of any age are encouraged to apply
'/%3e%3cpath%20d='M101.744%2012.4726L102.894%2016.1947L99.0021%2013.2201L101.744%2012.4726ZM105.3%208.40937H100.488L99.0026%203.59473L97.5116%208.41047L92.7%208.40385L96.5965%2011.3834L95.1055%2016.1942L99.0021%2013.2196L101.408%2011.3834L105.3%208.40992V8.40937Z'%20fill='white'/%3e%3cdefs%3e%3clinearGradient%20id='paint0_linear_5593_1381'%20x1='90'%20y1='9.44471'%20x2='99'%20y2='9.44471'%20gradientUnits='userSpaceOnUse'%3e%3cstop%20stop-color='%2300AD70'/%3e%3cstop%20offset='0.998594'%20stop-color='%2300B67A'/%3e%3cstop%20offset='1'%20stop-color='%23DCDCE6'/%3e%3c/linearGradient%3e%3c/defs%3e%3c/svg%3e){kind=small}
