Senior Data Engineer

Equifax, Inc.; Bengaluru; On-site; INR 2,600,000 - 4,000,000; Full time

Job summary

Equifax, Inc. in Bengaluru is seeking a Senior Data Engineer to join our Entity Resolution/Keying & Linking team. The role blends software engineering with data science, building data prototypes and pipelines, using Python and SQL to ingest and refine diverse data streams.

You will work across data governance, cloud infrastructure (GCP), and collaboration with regional and global teams to standardize workflows and extract actionable insights from complex datasets.

Qualifications

• BS in STEM (Math/Stats/CS) required.
• 3–5 years in a data engineering or quantitative technical role.
• Strong Python and SQL skills.
• Hands-on experience with Google Cloud Platform or similar cloud.
• Experience transforming un/structured data into optimized models.
• DevOps basics with Git and CI/CD workflows.

Responsibilities

• Build and manage data pipelines to ingest, aggregate, and process data from diverse sources.
• Integrate, cleanse, and structure large datasets for analytics and client solutions.
• Develop tracking processes to support data quality and entity resolution models.
• Leverage GCP technologies and pursue cloud optimization opportunities.
• Apply data governance, security, and maintenance best practices in pipelines.
• Collaborate with regional and global teams to standardize workflows.

Skills

Python

SQL

Git

CI/CD

Data pipelines

Education

BS in STEM major (Math/Stats/CS)

Tools

Google Cloud Platform (GCP)

BigQuery

Dataflow

PySpark

Scala

Job description

Synopsis of the role

Equifax is seeking a Senior Data Engineer to join our world-class Entity Resolution/Keying & Linking team within India Data & Analytics. The ideal candidate is an analytical engineer who bridges the gap between software development and data science—possessing the programming skills to scrape, merge, and manage diverse data streams, alongside the statistical mindset to extract meaningful insights. You will combine technical execution with creative problem-solving to build reliable data prototypes and uncover patterns within complex data. If you have a solid foundation in mathematics or statistics and a passion for data mining and machine learning, we want to hear from you.

What you’ll do

• Pipeline Engineering: Build and manage reliable data pipelines to aggregate, ingest, and process data from diverse source systems.
• Data Integration & Quality: Integrate, cleanse, and structure large datasets for analytical consumption and client solutions, implementing automated checks to troubleshoot data anomalies.
• Model Support: Apply an understanding of data characteristics to develop tracking processes that support data quality and entity resolution models.
• Cloud & Infrastructure: Leverage and implement Google Cloud Platform (GCP) technologies, keeping up with cloud advancements to propose optimization improvements.
• Data Governance: Implement data management, security, and maintenance best practices directly into pipeline workflows.
• Global Teamwork: Collaborate actively with regional and global Equifax teams to share insights, standardize workflows, and adopt best practices.

What experience you need

• Education: BS in a STEM major or equivalent discipline (Mathematics, Statistics, or Computer Science preferred).
• Experience: 3 to 5 years of hands-on experience in a data engineering or highly quantitative technical role.
• Core Tech Stack: Strong proficiency in Python and SQL, with practical experience writing utility scripts.
• Cloud Infrastructure: Competent understanding of cloud computing concepts, with practical experience working in Google Cloud Platform (GCP) or a similar cloud environment.
• Data Modeling: Experience transforming unstructured/structured data into optimized data models, troubleshooting pipeline bottlenecks, and ensuring data readiness.
• DevOps Basics: Solid experience with version control (Git) and exposure to CI/CD integration workflows.

What could set you apart

• Big Data & Cloud Tooling: Hands-on experience with Google BigQuery, BigTable, Dataflow, or big data processing frameworks like PySpark/Scala.
• Data Formats: Familiarity with managing modern schemas and file formats such as JSON, AVRO, and PARQUET.
• Domain & Concept Knowledge: Exposure to credit/financial data products or prior project/academic experience with Entity Resolution and identity matching concepts.
• Certification: Any active cloud certifications (e.g., GCP Associate Cloud Engineer).

#India