Data Engineering - AWS DMS

HCLTech; Seattle (WA); On-site; USD 78,000 - 148,000; Full time

Benefits offered by this job

Medical insurance

Dental & Vision

Life insurance

401(k) retirement plan

Paid time off

Job summary

HCLTech is seeking a Data Engineering professional with strong AWS DMS & CDC experience to drive data ingestion, real-time streaming, and scalable pipelines. The role requires Python/PySpark, AWS Glue, Kafka, and NoSQL knowledge, with on-prem and cloud integration.

This full-time position in Seattle involves collaborating with data teams, designing robust data architectures, and delivering near-real-time data access while leveraging modern cloud technologies for reliability and scalability.

Qualifications

• AWS DMS and CDC expertise required.
• Proficient in Python/PySpark for data processing.
• Experience designing scalable data pipelines across on-prem and AWS.
• Familiar with NoSQL databases (MongoDB, DynamoDB, Cassandra).
• Strong SQL and DB design skills.

Responsibilities

• Ingest data from multiple sources using Python and ETL tools.
• Design event-driven architecture using AWS EventBridge, Kafka, or SNS/SQS for real-time data streaming.
• Build and maintain scalable data pipelines across on-prem and AWS cloud.
• Develop Python scripts using pandas, NumPy for large datasets.
• Work with NoSQL DBs (MongoDB, Cassandra, DynamoDB) for storage and retrieval.
• Deploy applications in a cloud-native architecture with modern cloud tech.
• Monitor data workflows, troubleshoot, and optimize performance.
• Collaborate with data team on data ingestion, pipelines, and analytics needs.
• Document target data architecture, pipelines, and processing patterns.
• Identify opportunities for optimization and consolidation.

Skills

AWS DMS

AWS Glue

Kafka

SNS/SQS

Python/PySpark

Data lake

CloudWatch

CloudTrail

DB design SQL

NoSQL (MongoDB/DynamoDB)

Tools

AWS IAM

EKS

Job description

We require only US Citizen or GC Holders only. -Full-time role only -

HCL Tech is looking for a highly talented and self- motivated Data Engineering AWS DMS

Full time role) to join it in advancing the technological world through innovation and creativity. We require only US Citizen or GC Holders only.

Key Responsibilities

Primary Skills: AWS DMS (Amazon Web Services Database Migration Service & implementing CDC), AWS Glue, Kafka, or SNS/SQS, Python / PySpark, Data lake, Cloudwatch, Cloudtrail, SNS/SQS, DB design and SQL

Secondary Skills: AWS IAM, EKS

Key Responsibilities - 7- 15 year’s experience.

Develop Services to enable data ingestion from and synchronization with system which exposes required data access mechanisms ensuring near-real-time updates

• Ingest data from multiple sources using the python and any other ETL tools
• Design and implement an event-driven architecture using AWS EventBridge, Kafka, or SNS/SQS for real-time data streaming. 7- 15 year’s experience.
• Design, implement, and maintain scalable data pipelines that integrate both on-prem and AWS cloud environments.
• Develop efficient Python scripts and applications using libraries like pandas, NumPy, etc., to handle and process large datasets.
• Work with various NoSQL databases (e.g., MongoDB, Cassandra, DynamoDB) to support high-performance data storage and retrieval.
• Develop and deploy applications in a cloud-native architecture, leveraging modern cloud technologies for scalability and resilience.
• Continuously monitor data workflows and systems, troubleshoot issues, and optimize performance for reliability and scalability
• Collaborate with the business application owner on the existing data architecture, including data ingestion, data pipelines, business logic, data consumption patterns, and analytics requirements
• Design and document the target data architecture, pipelines, processing and analytics architecture
• Identify opportunities for optimization and consolidation

Transition existing pipeline to MSSQL server

Collaboration with data team on decomposition of business logic and data transformation patterns

Pay Range Minimum: 78000

Pay Range Maximum: 148000

HCLTech is an equal opportunity employer, committed to providing equal employment opportunities to all applicants and employees regardless of race, religion, sex, color, age, national origin, pregnancy, sexual orientation, physical disability or genetic information, military or veteran status, or any other protected classification, in accordance with federal, state, and/or local law. Should any applicant have concerns about discrimination in the hiring process, they should provide a detailed report of those concerns to [e-mail] for investigation.

A candidate’s pay within the range will depend on their skills, experience, education, and other factors permitted by law. This role may also be eligible for performance-based bonuses subject to company policies. In addition, this role is eligible for the following benefits subject to company policies: medical, dental, vision, pharmacy, life, accidental death & dismemberment, and disability insurance; employee assistance program; 401(k) retirement plan; 10 days of paid time off per year (some positions are eligible for need-based leave with no designated number of leave days per year); and 10 paid holidays per year

How You’ll Grow

At HCLTech, we offer continuous opportunities for you to find your spark and grow with us. We want you to be happy and satisfied with your role and to really learn what type of work sparks your brilliance the best. Throughout your time with us, we offer transparent communication with senior-level employees, learning and career development programs at every level, and opportunities to experiment in different roles or even pivot industries. We believe that you should be in control of your career with unlimited opportunities to find the role that fits you best.