Data Engineer II

Condé Nast; Chennai District; On-site; INR 1,500,000 - 3,000,000; Full time

Job summary

Condé Nast is seeking a CDP Engineer in Chennai, TN, to design and maintain large-scale data ingestion pipelines and identity resolution workflows that power personalized experiences across markets. You will work with Digdag or equivalent tools and collaborate with data engineers, data scientists, and product managers to drive data-driven marketing activation.

Ideal candidates have 4–6 years in building scalable data pipelines, strong SQL and Python skills, and experience with cloud data

Qualifications

• Degree in CS/IT or equivalent experience

Responsibilities

• Design, build, and maintain batch data ingestion pipelines from multiple sources
• Develop and maintain Digdag workflows to orchestrate data pipelines
• Write SQL and Python to transform data for segmentation, reporting, and activation
• Contribute to identity resolution pipelines and cross-device stitching
• Build activation workflows to export data to marketing platforms
• Collaborate with data engineers, scientists, and product managers
• Monitor, debug, and optimize workflows and handle data quality issues
• Contribute to shared CDP tooling and documentation
• Leverage AI-assisted tools to accelerate development while upholding standards

Skills

SQL

Python

CI/CD

Git

REST APIs

Data pipelines

Cross-functional collaboration

Troubleshooting

Education

Bachelor's degree in CS/IT or related

Tools

Digdag

Airflow

Treasure Data

Databricks

BigQuery

Snowflake

REST APIs

Job description

Condé Nast is a global media company producing the highest quality content with a footprint of more than 1 billion consumers in 32 territories through print, digital, video and social platforms. The company’s portfolio includes many of the world’s most respected and influential media properties including Vogue, Vanity Fair, Glamour, GQ, The New Yorker, Condé Nast Traveler/Traveller, Allure, AD, Bon Appétit and Wired, among others.

Job Description

Location: Chennai, TN

About the Role

The Customer Data Platform (CDP) Engineering team sits at the intersection of data engineering and audience intelligence, playing a critical role in how Condé Nast understands and engages its global consumer base. The team is responsible for building and operating the pipelines, identity resolution systems, and audience activation workflows that power personalised experiences and marketing across more than a dozen international markets. Our work spans the full data journey - from raw data ingestion and user unification to audience segmentation and real-time activation across marketing channels.

Responsibilities

• Design, build, and maintain batch data ingestion pipelines that pull consumer data from sources including behavioral events, subscriptions, e-commerce, email platforms, and third-party APIs
• Develop and maintain Digdag workflows within Treasure Data to orchestrate multi-step data pipelines across ingestion, transformation, and activation stages
• Write SQL and Python to transform raw data into clean, unified datasets used for audience segmentation, reporting, and downstream activation
• Contribute to identity resolution (user unification) pipelines that stitch together consumer identities across devices, brands, and markets at scale
• Build and maintain audience activation workflows that export segmented user data to marketing platforms such as Iterable, Sailthru, Klaviyo, Airship, LinkedIn, and others
• Participate in the full software development lifecycle using trunk-based development and GitHub Actions CI/CD pipelines that deploy to Treasure Data production
• Collaborate with data engineers, data scientists, and product managers to implement shared technical solutions that work across global markets
• Monitor, debug, and optimize existing workflows; respond to pipeline failures and data quality issues
• Contribute to shared CDP tooling, standards, and documentation to improve team productivity and onboarding
• Leverage AI-assisted development tools (such as Codex, Claude, Gemini, etc) to accelerate pipeline development, code review, and documentation, while maintaining standards for code quality and data accuracy

Minimum Qualifications

• Applicants should have a degree (B.E., B.Tech, or higher) in Computer Science, Information Technology, or a related discipline, or equivalent professional experience
• 4 - 6 years of software development experience building and maintaining scalable data pipelines
• Strong SQL skills and experience querying and transforming large-scale structured datasets
• Proficiency in Python for data engineering tasks (scripting, API integrations, pipeline logic)
• Experience with workflow orchestration tools - Digdag experience preferred; experience with Airflow, Prefect, or similar platforms considered
• Experience with cloud-based Customer Data Platforms; Treasure Data experience strongly preferred
• Experience with cloud data platforms such as Databricks, BigQuery, Snowflake, or similar
• Experience integrating with REST APIs and third-party platforms (e.g. marketing ESPs, activation platforms)
• Familiarity with identity resolution, user unification, or entity matching concepts is a plus
• Comfortable with CI/CD pipelines and trunk-based development workflows
• Experience with Git version control and related software development tooling
• Proven attention to detail and ability to own and debug complex, multi-step workflows independently
• Ability to work cross-functionally across engineering, data science, and product teams in a global organization

Condé Nast is an equal opportunity employer. We evaluate qualified applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, veteran status, age, familial status and other legally protected characteristics.