Data Engineer II

American Express; Gurugram District; On-site; INR 2,500,000 - 4,000,000; Full time

Benefits offered by this job

Competitive base salaries

Bonus incentives

Medical/dental/vision benefits

Flexible hybrid/onsite options

Job summary

American Express is seeking an Engineer II with strong hands-on data engineering experience in cloud and big data environments. You will design scalable data pipelines on GCP, ensure data quality, and leverage AI-assisted tools to accelerate development and automation.

You will collaborate with product owners and cross-functional teams to deliver data capabilities for marketing analytics, targeting and personalization.

Qualifications

• 5+ years of software/data engineering experience with large-scale cloud solutions.
• Strong SQL, Python, GCP BigQuery and Apache Airflow experience.
• Experience with Spark, Hadoop/Hive or equivalent distributed processing.
• Hands-on Generative AI tools for development, testing and automation.

Responsibilities

• Design, develop and maintain scalable data pipelines on GCP.
• Ensure data quality via profiling, reconciliation and validation.
• Leverage Generative AI tools to accelerate coding, testing and automation.
• Optimize performance, automation and platform reliability.
• Collaborate with product owners and engineers to deliver data capabilities.
• Adhere to CI/CD, code reviews, testing and governance practices.
• Identify opportunities to reduce technical debt and improve productivity.

Skills

Data Engineering

Big Data technologies

GCP

Python

SQL

AI-assisted development

CI/CD

Data governance

Education

Bachelor's or master's in CS/Engineering or related

Tools

BigQuery

Apache Airflow

Spark

Hadoop/Hive

Git/GitHub

GitHub Copilot

Job description

Job Description

As part of the Enterprise Marketing Technology team, you will design, develop and optimize scalable, reliable and high-quality data solutions that power customer targeting, eligibility, personalization, campaign execution and marketing analytics across American Express.

As part of the Enterprise Marketing Technology team, you will design, develop and optimize scalable, reliable and high-quality data solutions that power customer targeting, eligibility, personalization, campaign execution and marketing analytics across American Express.

The ideal candidate will bring strong analytical and problem-solving skills, hands-on cloud data engineering expertise, and practical experience leveraging Generative AI tools to improve engineering productivity, automation and solution quality.

You will work in an agile, collaborative environment that values engineering excellence, innovation, continuous learning and responsible AI adoption.

Responsibilities

We are looking for a skilled and motivated Engineer II with strong hands-on experience in Data Engineering, Big Data technologies, GCP, Python, SQL and AI-assisted software development.

• Data Engineering & Development: Design, develop and maintain scalable data pipelines using GCP BigQuery, Python, SQL, Spark and Apache Airflow for large-scale data ingestion, transformation and processing.
• Data Analysis & Quality: Perform data discovery, profiling, complex SQL analysis, source-to-target reconciliation, data validation and root cause analysis to ensure trusted, high-quality data.
• AI-Assisted Engineering: Leverage approved Generative AI tools, GitHub Copilot and LLM-based solutions to accelerate code development, testing, troubleshooting, documentation and engineering automation.
• Performance & Reliability: Optimize data-processing performance, automate monitoring, troubleshoot production issues and implement preventive measures to improve platform stability.
• Data Product Enablement: Build reusable customer, product, campaign and engagement data capabilities supporting enterprise Marketing, targeting, personalization and analytics.
• Engineering Excellence: Follow software engineering best practices, including CI/CD, GitHub, code reviews, automated testing, data governance and production-readiness controls.
• Cross-Functional Collaboration: Partner with Product Owners, Business stakeholders, architects and upstream/downstream engineering teams to understand requirements, resolve dependencies and deliver business capabilities.
• Continuous Improvement: Proactively identify opportunities for automation, technical debt reduction, AI adoption and engineering productivity improvements.

Qualifications

Minimum Qualifications

• Bachelor's or master's degree in computer science, Engineering or a related technical discipline, or equivalent work experience.
• 5+ years of hands-on experience in software development or data engineering, preferably with large-scale Big Data and cloud-based solutions.
• Strong hands-on expertise in SQL, Python, GCP Big Query and Apache Airflow, including developing and optimizing complex data pipelines.
• Experience with Spark, Scala, Hadoop/Hive or equivalent distributed data-processing technologies.
• Strong data analysis and problem-solving skills, including data profiling, complex SQL, source-to-target validation, data reconciliation, and root cause analysis.
• Experience in ETL/ELT, data modeling, data transformation, workflow orchestration and performance optimization.
• Practical hands-on experience with Generative AI tools such as GitHub Copilot, ChatGPT Enterprise or equivalent AI coding assistants for development, debugging, testing or automation.
• Working knowledge of LLMs, prompt engineering and responsible AI practices, particularly secure handling of enterprise and sensitive data.
• Experience with Git/GitHub, CI/CD pipelines, automated testing and software development best practices.
• Understanding of data-quality controls, data governance, privacy and production support.
• Strong communication skills, ability to collaborate across teams and independently resolve complex technical problems.

Preferred Qualifications

• Experience with GCP Bigtable, Pub/Sub, Dataflow, Kafka or real-time data-processing frameworks.
• Exposure to Adobe Experience Platform, Adobe Journey Optimizer or Customer Journey Analytics.
• Experience building or contributing to AI-enabled data engineering solutions, such as automated RCA, data-quality monitoring, intelligent data discovery, lineage or test-data generation.
• Familiarity with LLM APIs, Retrieval-Augmented Generation (RAG), agentic AI frameworks or AI workflow automation.
• Experience developing enterprise data products supporting Marketing, Banking, Lending or customer engagement.
• GCP Professional Data Engineer or equivalent cloud certification.

About Us

At American Express, our culture is built on a 175-year history of innovation, shared values and Leadership Behaviors, and an unwavering commitment to back our customers, communities, and colleagues. From delivering differentiated products to providing world-class customer service, we operate with a strong risk mindset, ensuring we continue to uphold our brand promise of trust, security, and service.

As part of Team Amex, you'll experience our powerful backing with comprehensive support for your holistic well-being and many opportunities to learn new skills, develop as a leader, and grow your career. Here, your voice and ideas matter, your work makes an impact, and together, you'll help us define the future of American Express.

About The Team

We back you with benefits that support your holistic well-being so you can be and deliver your best. This means caring for you and your loved ones' physical, financial, and mental health, as well as providing the flexibility you need to thrive personally and professionally:

• Competitive base salaries
• Bonus incentives
• Support for financial-well-being and retirement
• Comprehensive medical, dental, vision, life insurance, and disability benefits (depending on location)
• Flexible working model with hybrid, onsite or virtual arrangements depending on role and business need
• Generous paid parental leave policies (depending on your location)
• Free access to global on-site wellness centers staffed with nurses and doctors (depending on location)
• Free and confidential counseling support through our Healthy Minds program
• Career development and training opportunities

American Express is an equal opportunity employer and makes employment decisions without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran status, disability status, age, or any other status protected by law.

Offer of employment with American Express is conditioned upon the successful completion of a background verification check, subject to applicable laws and regulations.