Data Engineer

Agentic Global Talent; Lahore; On-site; PKR 1,800,000 - 3,200,000; Full time

Job summary

Agentic Global Talent is seeking a hands-on Data Engineer to join its Data & AI team in Lahore to migrate legacy ingestion pipelines to AWS and build a modern Databricks Lakehouse platform.

You will design scalable ETL/ELT workflows, develop Python/C# data processing, and collaborate with product, analytics, and data science teams to deliver reliable data solutions in a multi-tenant SaaS environment.

Qualifications

• Bachelor’s degree in Computer Science, IT, or a related field.
• 3+ years in Data Engineering.
• Strong AWS data engineering and SQL Server experience.

Responsibilities

• Design and build scalable ingestion pipelines using AWS S3, Lambda, Glue, Step Functions, and API Gateway.
• Develop Python and/or C#/.NET data-processing and integration solutions.
• Build APIs and file-based ingestion mechanisms for client data.
• Develop data mapping and transformation workflows into SQL Server.
• Help design and implement a Databricks Lakehouse platform.
• Optimize ETL/ELT pipelines for performance, reliability, and scalability.
• Support and modernize existing C#/.NET ingestion processes.
• Troubleshoot production data-pipeline issues.
• Implement data governance, security, and compliance practices for a multi-tenant SaaS environment.
• Collaborate with Software Engineering, Architecture, Product, Analytics, and Data Science teams.

Skills

AWS data engineering

Python

C#/.NET

SQL Server

ETL/ELT

API ingestion

Databricks

Spark

Lakehouse

Education

Bachelor's degree in Computer Science / IT

Job description

About This Role.

We are looking for a hands-on Data Engineer to join a growing Data & AI team and help modernize and scale a next-generation data platform. This role will focus on migrating legacy C#/.NET-based ingestion processes to a cloud-native AWS architecture and building a modern analytical platform using Databricks/Lakehouse technologies.

The ideal candidate has strong experience building scalable data pipelines, APIs, ETL/ELT workflows, and distributed data systems.

Key Responsibilities

• Design and build scalable ingestion pipelines using AWS S3, Lambda, Glue, Step Functions, and API Gateway.
• Develop Python and/or C#/.NET data-processing and integration solutions.
• Build APIs and file-based ingestion mechanisms for client data.
• Develop data mapping and transformation workflows into SQL Server.
• Help design and implement a Databricks Lakehouse platform.
• Optimize ETL/ELT pipelines for performance, reliability, and scalability.
• Support and modernize existing C#/.NET ingestion processes.
• Troubleshoot production data-pipeline issues.
• Implement data governance, security, and compliance practices for a multi-tenant SaaS environment.
• Collaborate with Software Engineering, Architecture, Product, Analytics, and Data Science teams.

Required Skills

• Strong AWS data engineering.
• Python and/or C#/.NET.
• SQL Server.
• ETL/ELT; API and file-based ingestion.
• Familiarity with Databricks, Spark, and Lakehouse architecture.

Nice to Have

• Azure DevOps/CI/CD, Amazon Bedrock/AgentCore, data governance and security, real-time processing, ML/AI pipelines, and multi-tenant SaaS experience.

Qualification

• Bachelor’s degree in Computer Science, IT, or a related field.

Experience

• 3+ years in Data Engineering.