Data Engineer II

American Express; Gurgaon; Hybrid; INR 1,800,000 - 2,800,000; Full time

Benefits offered by this job

Bonus incentives

Flexible working model (hybrid/ onsite

Medical, dental, vision, lifeinsurance

Career development and training

Job summary

American Express is seeking a Data Engineer II in Gurgaon to optimize data pipelines, maintain data models, and ensure alignment with enterprise standards. The role emphasizes collaboration with product teams and hands-on work with GCP services, SQL, and Python across distributed systems.

The position requires 4+ years in data engineering, with experience in Big Data tools and NoSQL databases, and a strong focus on performance, scalability, and security.

Qualifications

• Bachelor’s degree in Computer Science, Computer Engineering, or equivalent.
• Knowledge of Big Data/NoSQL design and development with diverse data stores.
• Experience with distributed systems and relational & non-relational databases.

Responsibilities

• Evaluates data requirements and documents them for integration into architectures.
• Builds and enhances data pipelines and database designs for performance and security.
• Hands-on with GCP BigQuery, DataProc, and related services.
• Strong SQL and data evaluation tool knowledge.
• Collaborates in design reviews, testing, and production support.
• Communicates with business and product teams to enable changes.
• Implements basic partitioning and indexing for Big Data management.

Skills

Analytical thinking

Team collaboration

Effective communication

Education

Bachelor's degree in Computer Science/Engineering

Tools

BigQuery

DataProc

Hive

BigTable

Cloud Spanner

HBase

GCP tools

SQL

Python

Java

Job description

Job Description:

Data Engineer II facilitates seamless data integration and model maintenance, enhances data pipelines and database designs, supports production environments, ensures compliance with enterprise standards, and fosters collaboration while implementing basic partitioning and indexing solutions for Big Data management.

Responsibilities

• Evaluates data requirements and stories, documents them for seamless integration into existing architectures, and maintains data models to support business needs
• Builds and enhances data pipelines and database designs to meet performance, scalability, and security requirements
• Should have good hands on with GCP technologies like : BigQuery, DataProc and other services of GCP.
• Have good working knowledge of SQL and data evaluation tools.
• Collaborates in design reviews and testing, and provides production environment support with guidance from peers and leaders
• Completes work reviews and fosters a collaborative learning environment with guidance from peers and leaders
• Communicates and collaborates with business and product teams to facilitate changes and implementation
• Completes Big Data/Spark and Other distributed frameworks requirements by implementing basic partitioning and indexing solutions
• Collaborates and co-creates effectively with teams in product and the business to align technology initiatives with business objectives

Qualifications

Education Qualifications:

• Bachelor’s degree in Computer Science, Computer Engineering, and/or comparable experience; advanced degree preferred
• Knowledge of Big Data / NoSQL design and development with variety of data stores.
• Knowledge of database management system products and ecosystem – e.g., storage formats, access algorithms, data management processes, administration, data maintenance, replication, high availability, encryption, etc.
• Knowledge of distributed (multi-tiered) systems, algorithms, and relational & non-relational database

Work Experience:

• Data engineering and 4+ years of experience in development.
• Have good experience in performance tuning of large data processing in both batch and real-time.
• Experience in SQL and Python (or any other programming language like Java)
• Experience in design and development across one or more database management systems (e.g., HBase, Hive, GCP tools, NoSQL, BigTable, BigQuery, Cloud Spanner) as appropriate.
• Experience in NoSQL databases (e.g., Hbase, BigTable)
• Experience in performance tuning in the Big Data space
• Experience in distributed (multi-tiered) systems, algorithms, and application development
• Experience in database development and support of online transaction processing and/or online analytical processing systems
• Experience in software delivery methodology (Agile, Scrum, Agile XP, Test-Driven Development etc.)
• GCP Certificate will be good add-on.

At American Express, our culture is built on a 175-year history of innovation,shared valuesand Leadership Behaviors, and an unwavering commitment to back our customers, communities, and colleagues. From delivering differentiated products to providing world-class customer service, we operate with a strong risk mindset, ensuring we continue to uphold our brand promise of trust, security, and service.

As part of Team Amex, you’ll experience our powerful backing with comprehensive support for your holistic well-being and many opportunities to learn new skills, develop as a leader, and grow your career. Here, your voice and ideas matter, your work makes an impact, and together, you will help us define the future of American Express.

We back you with benefits that support your holistic well-being so you can be and deliver your best. This means caring for you and your loved ones physical, financial, and mental health, as well as providing the flexibility you need to thrive personally and professionally:

• Competitive base salaries
• Bonus incentives
• Support for financial-well-being and retirement
• Comprehensive medical, dental, vision, life insurance, and disability benefits (depending on location)
• Flexible working model with hybrid, onsite or virtual arrangements depending on role and business need
• Generous paid parental leave policies (depending on your location)
• Free access to global on-site wellness centers staffed with nurses and doctors (depending on location)
• Free and confidential counseling support through our Healthy Minds program
• Career development and training opportunities

American Express is an equal opportunity employer and makes employment decisions without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran status, disability status, age, or any other status protected by law.

Offer of employment with American Express is conditioned upon the successful completion of a background verification check, subject to applicable laws and regulations.