Senior GCP Data Engineer (R-19655)

Dun & Bradstreet

Hyderabad

Remote

INR 1,800,000 - 2,600,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Dun & Bradstreet in Hyderabad seeks a Senior Data Engineer to design, build, and optimize large-scale data pipelines and ID graph systems. You will ingest, normalize, and unify datasets from web, apps, and third-party sources, writing robust Python and SQL code.

The role demands deep analytical skills, independence, and comfort working in a remote, fast-paced environment. You will collaborate with data, platform, DevOps, and product teams to deliver scalable, production-grade data solutions.

Qualifications

  • 5–8+ years of hands‑on experience in data engineering or large-scale data processing.
  • Proven experience building and maintaining production‑grade data pipelines and distributed systems.
  • Experience contributing to the architecture and delivery of large-scale data platforms or mission‑critical data systems.
  • Strong expertise in: SQL and relational databases (Postgres, BigQuery, Redshift, etc.), Python for data processing and analysis.

Responsibilities

  • Design, build, and optimize scalable data pipelines and ETL/ELT workflows for large, complex datasets.
  • Design and implement foundational data architecture supporting identity resolution and ID graph systems.
  • Develop and enhance systems supporting identity resolution and ID graph construction (data ingestion, normalization, matching, and deduplication).
  • Process and unify multi-source datasets (cookies, device IDs, behavioral data, third‑party and proprietary data).
  • Write efficient, testable, and maintainable code using Python and SQL for large-scale data processing.

Skills

Analytical thinking
Detail-oriented
Independent worker
Collaborative

Tools

Python
SQL
BigQuery
Redshift
PostgreSQL
Dataflow
Cloud Pub/Sub
Docker
Kubernetes
GitHub Actions

Job description

Shape the Future with Dun & Bradstreet

At Dun & Bradstreet, we believe data has the power to create a better tomorrow. As a global leader in business decisioning data and analytics, we help companies worldwide grow, manage risk, and innovate. Since 1841, businesses have trusted us to turn uncertainty into opportunity. We’re a diverse, global team that values creativity, collaboration, and bold ideas. Are you ready to make an impact and help shape what’s next? Join us!

We are seeking an experienced Senior Data Engineer to help build the next generation of our identity graph and data platform. This role is focused on designing, developing, and optimizing large-scale data pipelines and systems that ingest, process, and unify complex datasets from diverse sources (web, mobile, AdTech, government, and proprietary data).

This is a highly hands‑on, technical role for someone who can quickly understand existing systems, operate independently, and deliver high‑quality solutions at scale. The ideal candidate is deeply analytical, detail‑oriented, and experienced with building performant data pipelines and systems handling billions of records.

Key Responsibilities:
  • Design, build, and optimize scalable data pipelines and ETL/ELT workflows for large, complex datasets.
  • Design and implement foundational data architecture supporting identity resolution and ID graph systems.
  • Develop and enhance systems supporting identity resolution and ID graph construction (data ingestion, normalization, matching, and deduplication).
  • Process and unify multi-source datasets (cookies, device IDs, behavioral data, third‑party and proprietary data).
  • Write efficient, testable, and maintainable code using Python and SQL for large-scale data processing.
  • Optimize data models, queries, and storage strategies for performance, scalability, and cost efficiency.
  • Build and maintain data validation, monitoring, and alerting systems to ensure data quality and reliability.
  • Troubleshoot, debug, and improve existing data pipelines and infrastructure.
  • Take ownership of complex data problems end‑to‑end, from initial design through production deployment.
  • Contribute to key technical decisions related to data architecture, scalability, and system design.
  • Collaborate with data, platform, DevOps, and product teams to deliver scalable, production‑ready solutions.
  • Translate business and product requirements into practical, performant data solutions.
  • Document data pipelines, systems, and workflows clearly.
  • Continuously improve system performance, data quality, and pipeline resilience.
  • Contribute to building new capabilities that improve how customers understand and leverage data insights.
Key Requirements:
  • 5–8+ years of hands‑on experience in data engineering or large-scale data processing.
  • Proven experience building and maintaining production‑grade data pipelines and distributed systems.
  • Experience contributing to the architecture and delivery of large-scale data platforms or mission‑critical data systems.
  • Strong expertise in:
    • SQL and relational databases (Postgres, BigQuery, Redshift, etc.)
    • Python for data processing and analysis
  • Experience with Google Cloud Platform (BigQuery, Dataflow, Pub/Sub, Cloud Storage, Cloud Functions) and/or AWS (S3, Redshift, EMR, RDS).
  • Experience working with large‑scale datasets (hundreds of millions to billions of records).
  • Strong understanding of data modeling, partitioning, indexing, and query optimization.
  • Experience with distributed data processing and parallelization techniques.
  • Experience moving large volumes of data across systems and architectures.
  • Familiarity with CI/CD, containerization, and orchestration tools (Docker, Kubernetes, GitHub Actions, etc.).
  • Strong debugging and troubleshooting skills in complex data environments.
  • Experience with version control (Git) and Agile tools (Jira, Confluence, etc.).
  • Highly analytical with strong attention to detail and a data‑driven mindset.
  • Ability to hit the ground running, quickly understand systems, and deliver independently.
  • Comfortable working in a remote, fast‑paced, and collaborative environment.
  • Strong ability to contribute to system design and deliver implementations independently.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior GCP Data Engineer
Senior GCP Data Engineer

Mployee.me • Hyderabad

On-site
INR 1,200,000 - 2,200,000
Data Engineer I (R-18658)
Data Engineer I (R-18658)

Dun & Bradstreet • Hyderabad

On-site
INR 800,000 - 1,200,000
Data Engineer I (R-20055)
Data Engineer I (R-20055)

Dun & Bradstreet • Hyderabad

On-site
INR 900,000 - 1,300,000
Senior Software Engineer (R-20132)
Senior Software Engineer (R-20132)

Dnb • Andhra Pradesh

On-site
INR 1,500,000 - 2,500,000
Senior Data Engineer
Senior Data Engineer

EY • Hyderabad

On-site
INR 1,200,000 - 2,200,000
Senior Devops Engineer (R-20131)
Senior Devops Engineer (R-20131)

Dnb • Andhra Pradesh

On-site
INR 2,600,000 - 4,000,000
Software Engineer II (R-20067) New
Software Engineer II (R-20067) New

NetVerks Inc. • Hyderabad

On-site
INR 1,200,000 - 1,800,000
Senior Data Engineer
Senior Data Engineer

Dunboxed • Hyderabad

On-site
INR 3,500,000 - 5,200,000
Principal Data Scientist (R-18861)
Principal Data Scientist (R-18861)

Dun & Bradstreet • Chennai District

On-site
INR 1,500,000 - 2,500,000
Senior Data Engineer (Data & Analytics)
Senior Data Engineer (Data & Analytics)

Summit Consulting Services • Ernakulam

On-site
INR 1,000,000 - 1,800,000
Collaborative culture
Opportunity to influence architecture
Modern cloud-native tech stack