Senior Data Engineer

Equifax India; Bengaluru; On-site; INR 1,500,000 - 2,300,000; Full time

Job summary

Equifax India is seeking a Senior Data Engineer to join our India Data & Analytics team. You will bridge software development and data science, building data prototypes and scalable pipelines while applying statistics to derive insights from complex data.

You will work on Entity Resolution/Keying & Linking, leveraging Python, SQL, and GCP to ingest, cleanse, and model data, with strong emphasis on data governance and collaboration with global teams.

Qualifications

• 3–5 years hands-on data engineering or quantitative technical experience.
• Strong proficiency in Python and SQL with experience writing utility scripts.
• Experience transforming unstructured/structured data into optimized data models and debugging pipelines.
• Cloud experience in Google Cloud Platform or a similar environment.
• DevOps basics: Git and CI/CD exposure.

Responsibilities

• Build and manage reliable data pipelines to ingest, aggregate, and process data from diverse source systems.
• Integrate and structure large datasets for analytics and client solutions with automated data quality checks.
• Develop tracking processes to support data quality and entity resolution models.
• Leverage Google Cloud Platform technologies and propose optimization improvements.
• Implement data governance, security, and maintenance in pipeline workflows.
• Collaborate with regional/global teams to standardize workflows and share insights.

Skills

Python

SQL

Scripting

Data pipelines

Education

BS in STEM (Math/Stats/CS)

Tools

BigQuery

BigTable

Dataflow

PySpark/Scala

Job description

Synopsis of the role

Equifax is seeking a Senior Data Engineer to join our world-class Entity Resolution/Keying & Linking team within India Data & Analytics. The ideal candidate is an analytical engineer who bridges the gap between software development and data science-possessing the programming skills to scrape, merge, and manage diverse data streams, alongside the statistical mindset to extract meaningful insights. You will combine technical execution with creative problem-solving to build reliable data prototypes and uncover patterns within complex data. If you have a solid foundation in mathematics or statistics and a passion for data mining and machine learning, we want to hear from you.

Synopsis of the role

Equifax is seeking a Senior Data Engineer to join our world-class Entity Resolution/Keying & Linking team within India Data & Analytics. The ideal candidate is an analytical engineer who bridges the gap between software development and data science-possessing the programming skills to scrape, merge, and manage diverse data streams, alongside the statistical mindset to extract meaningful insights. You will combine technical execution with creative problem-solving to build reliable data prototypes and uncover patterns within complex data. If you have a solid foundation in mathematics or statistics and a passion for data mining and machine learning, we want to hear from you.

What You'll Do

• Pipeline Engineering: Build and manage reliable data pipelines to aggregate, ingest, and process data from diverse source systems.
• Data Integration & Quality: Integrate, cleanse, and structure large datasets for analytical consumption and client solutions, implementing automated checks to troubleshoot data anomalies.
• Model Support: Apply an understanding of data characteristics to develop tracking processes that support data quality and entity resolution models.
• Cloud & Infrastructure: Leverage and implement Google Cloud Platform (GCP) technologies, keeping up with cloud advancements to propose optimization improvements.
• Data Governance: Implement data management, security, and maintenance best practices directly into pipeline workflows.
• Global Teamwork: Collaborate actively with regional and global Equifax teams to share insights, standardize workflows, and adopt best practices.

What Experience You Need

• Education: BS in a STEM major or equivalent discipline (Mathematics, Statistics, or Computer Science preferred).
• Experience: 3 to 5 years of hands-on experience in a data engineering or highly quantitative technical role.
• Core Tech Stack: Strong proficiency in Python and SQL, with practical experience writing utility scripts.
• Cloud Infrastructure: Competent understanding of cloud computing concepts, with practical experience working in Google Cloud Platform (GCP) or a similar cloud environment.
• Data Modeling: Experience transforming unstructured/structured data into optimized data models, troubleshooting pipeline bottlenecks, and ensuring data readiness.
• DevOps Basics: Solid experience with version control (Git) and exposure to CI/CD integration workflows.

What Could Set You Apart

• Big Data & Cloud Tooling: Hands-on experience with Google BigQuery, BigTable, Dataflow, or big data processing frameworks like PySpark/Scala.
• Data Formats: Familiarity with managing modern schemas and file formats such as JSON, AVRO, and PARQUET.
• Domain & Concept Knowledge: Exposure to credit/financial data products or prior project/academic experience with Entity Resolution and identity matching concepts.
• Certification: Any active cloud certifications (e.g., GCP Associate Cloud Engineer).

#India