Enable job alerts via email!

DATA Engineer-AWS Glue , SQL, Python

HCLTech

United States

Remote

USD 88,000 - 134,000

Full time

19 days ago

Generate a tailored resume in minutes

Land an interview and earn more. Learn more

Start fresh or import an existing resume

Job summary

HCLTech is seeking a skilled Data Engineer with expertise in AWS Glue to join their team for an innovative technology-driven role. The successful candidate will develop services and maintain data pipelines while collaborating on data architecture. This is a remote position offering a competitive salary range based on skills and experience, along with comprehensive benefits.

Benefits

Medical insurance
Dental insurance
Vision insurance
401(k) retirement plan
Paid time off
Paid holidays

Qualifications

  • Experience with data ingestion and synchronization.
  • Knowledge of ETL tools including Python and libraries like pandas.
  • Familiarity with NoSQL databases like MongoDB and DynamoDB.

Responsibilities

  • Develop services for data ingestion and real-time updates.
  • Design and maintain scalable data pipelines integrating AWS.
  • Collaborate on the architecture and optimization of data insights.

Skills

AWS Glue
Python
Data lake
SQL

Tools

Kafka
AWS EventBridge
AWS IAM
EKS

Job description

This range is provided by HCLTech. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.

Base pay range

$88,000.00/yr - $134,000.00/yr

HCLTech is looking for a highly talented and self- motivated Data Engineer with AWS Glue to join it in advancing the technological world through innovation and creativity.

Job ID: 1571347BR

Location: Remote

Primary Skills (must have): AWS Glue, Kafka, or SNS/SQS, Python / PySpark, Data lake, Cloudwatch, Cloudtrail, SNS/SQS, DB design and SQL

Secondary Skills (knowledge is a must): AWS EventBridge, AWS IAM, EKS

Location: US - Remote

Citizenship: US Citizen or GC holder as US Citizenship required based on client requirement or Secret Clearance required

Job Description:

• Develop Services to enable data ingestion from and synchronization with system which exposes required data access mechanisms ensuring near-real-time updates

• Ingest data from multiple sources using the python and any other ETL tools

Design and implement an event-driven architecture using AWS EventBridge, Kafka, or SNS/SQS for real-time data streaming

• Design, implement, and maintain scalable data pipelines that integrate both on-prem and AWS cloud environments.

• Develop efficient Python scripts and applications using libraries like pandas, NumPy, etc., to handle and process large datasets.

• Work with various NoSQL databases (e.g., MongoDB, Cassandra, DynamoDB) to support high-performance data storage and retrieval.

• Develop and deploy applications in a cloud-native architecture, leveraging modern cloud technologies for scalability and resilience.

• Continuously monitor data workflows and systems, troubleshoot issues, and optimize performance for reliability and scalability

Transition existing pipeline to MSSQL server

• Collaborate with the business application owner on the existing data architecture, including data ingestion, data pipelines, business logic, data consumption patterns, and analytics requirements

• Design and document the target data architecture, pipelines, processing and analytics architecture

• Identify opportunities for optimization and consolidation

• Collaboration with data team on decomposition of business logic and data transformation patterns

Pay Range Minimum: $ 88,000 per year

HCLTech is an equal opportunity employer, committed to providing equal employment opportunities to all applicants and employees regardless of race, religion, sex, color, age, national origin, pregnancy, sexual orientation, physical disability or genetic information, military or veteran status, or any other protected classification, in accordance with federal, state, and/or local law. Should any applicant have concerns about discrimination in the hiring process, they should provide a detailed report of those concerns to secure@hcltech.com for investigation.

A candidate’s pay within the range will depend on their skills, experience, education, and other factors permitted by law. This role may also be eligible for performance-based bonuses subject to company policies. In addition, this role is eligible for the following benefits subject to company policies: medical, dental, vision, pharmacy, life, accidental death & dismemberment, and disability insurance; employee assistance program; 401(k) retirement plan; 10 days of paid time off per year (some positions are eligible for need-based leave with no designated number of leave days per year); and 10 paid holidays per year

How You’ll Grow

At HCLTech, we offer continuous opportunities for you to find your spark and grow with us. We want you to be happy and satisfied with your role and to really learn what type of work sparks your brilliance the best. Throughout your time with us, we offer transparent communication with senior-level employees, learning and career development programs at every level, and opportunities to experiment in different roles or even pivot industries. We believe that you should be in control of your career with unlimited opportunities to find the role that fits you best., Data lake, Cloudwatch, Cloudtrail, SNS/SQS, DB design and SQL

Secondary Skills (knowledge is a must): AWS EventBridge, AWS IAM, EKS

CU HR L4: ERS CU-Digital Engg-DevOpsCapG-DATA ENGG

Location: US - Remote

Citizenship: US Citizen or GC holder as US Citizenship required based on client requirement or Secret Clearance required

Job Description:

• Develop Services to enable data ingestion from and synchronization with system which exposes required data access mechanisms ensuring near-real-time updates

• Ingest data from multiple sources using the python and any other ETL tools

• Design and implement an event-driven architecture using AWS EventBridge, Kafka, or SNS/SQS for real-time data streaming

• Design, implement, and maintain scalable data pipelines that integrate both on-prem and AWS cloud environments.

• Develop efficient Python scripts and applications using libraries like pandas, NumPy, etc., to handle and process large datasets.

• Work with various NoSQL databases (e.g., MongoDB, Cassandra, DynamoDB) to support high-performance data storage and retrieval.

• Develop and deploy applications in a cloud-native architecture, leveraging modern cloud technologies for scalability and resilience.

• Continuously monitor data workflows and systems, troubleshoot issues, and optimize performance for reliability and scalability

Transition existing pipeline to MSSQL server

• Collaborate with the business application owner on the existing data architecture, including data ingestion, data pipelines, business logic, data consumption patterns, and analytics requirements

• Design and document the target data architecture, pipelines, processing and analytics architecture

• Identify opportunities for optimization and consolidation

• Collaboration with data team on decomposition of business logic and data transformation patterns

Pay Range Minimum: $ 88,000 per year

HCLTech is an equal opportunity employer, committed to providing equal employment opportunities to all applicants and employees regardless of race, religion, sex, color, age, national origin, pregnancy, sexual orientation, physical disability or genetic information, military or veteran status, or any other protected classification, in accordance with federal, state, and/or local law. Should any applicant have concerns about discrimination in the hiring process, they should provide a detailed report of those concerns to secure@hcltech.com for investigation.

A candidate’s pay within the range will depend on their skills, experience, education, and other factors permitted by law. This role may also be eligible for performance-based bonuses subject to company policies. In addition, this role is eligible for the following benefits subject to company policies: medical, dental, vision, pharmacy, life, accidental death & dismemberment, and disability insurance; employee assistance program; 401(k) retirement plan; 10 days of paid time off per year (some positions are eligible for need-based leave with no designated number of leave days per year); and 10 paid holidays per year

How You’ll Grow

At HCLTech, we offer continuous opportunities for you to find your spark and grow with us. We want you to be happy and satisfied with your role and to really learn what type of work sparks your brilliance the best. Throughout your time with us, we offer transparent communication with senior-level employees, learning and career development programs at every level, and opportunities to experiment in different roles or even pivot industries. We believe that you should be in control of your career with unlimited opportunities to find the role that fits you best.

Seniority level
  • Seniority level
    Mid-Senior level
Employment type
  • Employment type
    Full-time
Job function
  • Job function
    Information Technology and Engineering
  • Industries
    Aviation and Aerospace Component Manufacturing, Engineering Services, and IT Services and IT Consulting

Referrals increase your chances of interviewing at HCLTech by 2x

Inferred from the description for this job

401(k)

Vision insurance

Medical insurance

Get notified when a new job is posted.

Sign in to set job alerts for “Data Engineer” roles.

United States $170,000.00-$720,000.00 1 week ago

United States $170,000.00-$720,000.00 1 week ago

United States $170,000.00-$720,000.00 3 days ago

San Francisco, CA $126,100.00-$186,800.00 5 days ago

Irving, TX $80,000.00-$100,000.00 1 week ago

McLean, VA $80,000.00-$100,000.00 1 week ago

United States $93,000.00-$116,000.00 9 hours ago

United States $120,000.00-$130,000.00 6 days ago

Orange County, CA $75,000.00-$85,000.00 22 hours ago

New York, NY $120,000.00-$132,000.00 4 days ago

New York, NY $139,500.00-$271,566.94 1 week ago

United States $184,500.00-$217,100.00 1 week ago

Manhattan, NY $110,000.00-$160,000.00 1 week ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

Get your free, confidential resume review.
or drag and drop a PDF, DOC, DOCX, ODT, or PAGES file up to 5MB.