Career Opportunities: Senior Technical Lead (191516)
Requisition ID191516-Posted11/10/2026
- Develop Services to enabledataingestion from and synchronization with system which exposes requireddataaccess mechanisms ensuring near-real-time updates
- Ingestdatafrom multiple sources using the python and any other ETL tools
- Design and implement an event-driven architecture using AWS EventBridge, Kafka, or SNS/SQS for real-timedatastreaming
- Design, implement, and maintain scalabledatapipelines that integrate both on-prem and AWS cloud environments.
- Develop efficient Python scripts and applications using libraries like pandas, NumPy, etc., to handle and process largedatasets.
- Work with various NoSQLdatabases (e.g., MongoDB, Cassandra, DynamoDB) to support high-performancedatastorage and retrieval.
- Develop and deploy applications in a cloud-native architecture, leveraging modern cloud technologies for scalability and resilience.
- Continuously monitordataworkflows and systems, troubleshoot issues, and optimize performance for reliability and scalability
- Transition existing pipeline to MSSQL server
- Collaborate with the business application owner on the existingdataarchitecture, includingdataingestion,datapipelines, business logic,dataconsumption patterns, and analytics requirements
- Design and document the targetdataarchitecture, pipelines, processing and analytics architecture
- Identify opportunities for optimization and consolidation
- Collaboration withdatateam on decomposition of business logic anddatatransformation patterns
Key Responsibilities
Job Description:
- Develop Services to enabledataingestion from and synchronization with system which exposes requireddataaccess mechanisms ensuring near-real-time updates
- Ingestdatafrom multiple sources using the python and any other ETL tools
- Design and implement an event-driven architecture using AWS EventBridge, Kafka, or SNS/SQS for real-timedatastreaming
- Design, implement, and maintain scalabledatapipelines that integrate both on-prem and AWS cloud environments.
- Develop efficient Python scripts and applications using libraries like pandas, NumPy, etc., to handle and process largedatasets.
- Work with various NoSQLdatabases (e.g., MongoDB, Cassandra, DynamoDB) to support high-performancedatastorage and retrieval.
- Develop and deploy applications in a cloud-native architecture, leveraging modern cloud technologies for scalability and resilience.
- Continuously monitordataworkflows and systems, troubleshoot issues, and optimize performance for reliability and scalability
- Transition existing pipeline to MSSQL server
- Collaborate with the business application owner on the existingdataarchitecture, includingdataingestion,datapipelines, business logic,dataconsumption patterns, and analytics requirements
- Design and document the targetdataarchitecture, pipelines, processing and analytics architecture
- Identify opportunities for optimization and consolidation
- Collaboration withdatateam on decomposition of business logic anddatatransformation patterns
Skill Requirements
Primary Skills: AWS Glue, Kafka, or SNS/SQS, Python / PySpark, Data lake, Cloudwatch, Cloudtrail, SNS/SQS, DB design and SQL