Senior Technical Lead

HCLTech

Washington (District of Columbia)

On-site

USD 120,000 - 160,000

Full time

22 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

HCL Technologies Limited is seeking a Senior Technical Lead to drive data ingestion, ETL, and real-time streaming architectures in a cloud-first environment. You will partner with business stakeholders to define data architectures and implement scalable pipelines across on-prem and AWS.

The role emphasizes Python/PySpark development, use of AWS Glue, Kafka, and SNS/SQS, and hands-on design of data access and analytics patterns to support timely insights.

Qualifications

  • Experience building data ingestion & ETL pipelines.
  • Strong knowledge of streaming data architectures and real-time data processing.
  • Familiarity with cloud services (AWS) and NoSQL/SQL databases.

Responsibilities

  • Develop services to enable data ingestion and synchronization with systems.
  • Ingest data from multiple sources using Python and ETL tools.
  • Design and implement event-driven architecture using AWS EventBridge, Kafka, or SNS/SQS for real-time streaming.
  • Build scalable data pipelines across on-prem and AWS cloud environments.
  • Develop Python scripts to process large datasets with pandas/NumPy.
  • Work with NoSQL databases (MongoDB, Cassandra, DynamoDB) for high-performance storage.
  • Deploy cloud-native applications with scalable, resilient architectures.
  • Monitor data workflows and optimize performance for reliability and scalability.
  • Collaborate with business owners on data architecture, ingestion, pipelines, and analytics requirements.

Skills

Python / PySpark
AWS Glue
Kafka
SNS/SQS
Data lake
Cloudwatch
Cloudtrail
DB design
SQL

Tools

SQL

Job description

Career Opportunities: Senior Technical Lead (191516)

Requisition ID191516-Posted11/10/2026

  • Develop Services to enabledataingestion from and synchronization with system which exposes requireddataaccess mechanisms ensuring near-real-time updates
  • Ingestdatafrom multiple sources using the python and any other ETL tools
  • Design and implement an event-driven architecture using AWS EventBridge, Kafka, or SNS/SQS for real-timedatastreaming
  • Design, implement, and maintain scalabledatapipelines that integrate both on-prem and AWS cloud environments.
  • Develop efficient Python scripts and applications using libraries like pandas, NumPy, etc., to handle and process largedatasets.
  • Work with various NoSQLdatabases (e.g., MongoDB, Cassandra, DynamoDB) to support high-performancedatastorage and retrieval.
  • Develop and deploy applications in a cloud-native architecture, leveraging modern cloud technologies for scalability and resilience.
  • Continuously monitordataworkflows and systems, troubleshoot issues, and optimize performance for reliability and scalability
  • Transition existing pipeline to MSSQL server
  • Collaborate with the business application owner on the existingdataarchitecture, includingdataingestion,datapipelines, business logic,dataconsumption patterns, and analytics requirements
  • Design and document the targetdataarchitecture, pipelines, processing and analytics architecture
  • Identify opportunities for optimization and consolidation
  • Collaboration withdatateam on decomposition of business logic anddatatransformation patterns
Key Responsibilities

Job Description:

  • Develop Services to enabledataingestion from and synchronization with system which exposes requireddataaccess mechanisms ensuring near-real-time updates
  • Ingestdatafrom multiple sources using the python and any other ETL tools
  • Design and implement an event-driven architecture using AWS EventBridge, Kafka, or SNS/SQS for real-timedatastreaming
  • Design, implement, and maintain scalabledatapipelines that integrate both on-prem and AWS cloud environments.
  • Develop efficient Python scripts and applications using libraries like pandas, NumPy, etc., to handle and process largedatasets.
  • Work with various NoSQLdatabases (e.g., MongoDB, Cassandra, DynamoDB) to support high-performancedatastorage and retrieval.
  • Develop and deploy applications in a cloud-native architecture, leveraging modern cloud technologies for scalability and resilience.
  • Continuously monitordataworkflows and systems, troubleshoot issues, and optimize performance for reliability and scalability
  • Transition existing pipeline to MSSQL server
  • Collaborate with the business application owner on the existingdataarchitecture, includingdataingestion,datapipelines, business logic,dataconsumption patterns, and analytics requirements
  • Design and document the targetdataarchitecture, pipelines, processing and analytics architecture
  • Identify opportunities for optimization and consolidation
  • Collaboration withdatateam on decomposition of business logic anddatatransformation patterns
Skill Requirements

Primary Skills: AWS Glue, Kafka, or SNS/SQS, Python / PySpark, Data lake, Cloudwatch, Cloudtrail, SNS/SQS, DB design and SQL

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AWS DATA Architect
AWS DATA Architect

Incedo Inc. • New Jersey

Hybrid
USD 120,000 - 150,000
AWS Data Engineer - Real-Time Data Pipelines & Architecture
AWS Data Engineer - Real-Time Data Pipelines & Architecture

TechDigital Group • Ohio

Hybrid
USD 90,000 - 120,000
AWS Data Engineer
AWS Data Engineer

TechDigital Group • Blue Ash (OH)

On-site
USD 90,000 - 120,000
AWS Data Engineer - Real-Time Data Pipelines
AWS Data Engineer - Real-Time Data Pipelines

TechDigital Group • Fort Worth (TX)

On-site
USD 90,000 - 120,000
AWS Data Engineer
AWS Data Engineer

TechDigital Group • Edison (NJ)

On-site
USD 90,000 - 120,000
AWS Big Data Lead Software Engineer
AWS Big Data Lead Software Engineer

Testing Site - JPMC • Columbus (OH)

On-site
USD 90,000 - 130,000
Senior Data Engineer
Senior Data Engineer

Compunnel Inc. • Charlotte (NC)

On-site
USD 120,000 - 150,000
AWS Data Lead
AWS Data Lead

Global Business Ser. 4u Inc. • Columbia (SC)

Hybrid
USD 140,000 - 190,000
Data Platform Technical Lead / Senior Data Engineer
Data Platform Technical Lead / Senior Data Engineer

Feuji • United States

On-site
USD 140,000 - 190,000
Senior Data Engineer
Senior Data Engineer

SRM Technologies LLC • United States

Remote
USD 150,000 - 190,000