Aws Data Engineer (Telecom Domain)

BULLIT MANAGEMENT SERVICES LIMITED; Ipswich; On-site; GBP 50,000 - 70,000; Full time

Job summary

A leading telecommunications company is looking for an experienced AWS Data Engineer to support large-scale data processing and analytics initiatives. Key responsibilities include designing and developing ETL/ELT pipelines using AWS services such as Glue and Redshift, implementing data ingestion from telecom systems, and optimizing workflows for high-scale datasets. The ideal candidate will have strong skills in Python and SQL, with 3-10 years of data engineering experience. This is a full-time position located in Ipswich, England.

Qualifications

• 3–10 years of experience in data engineering.
• Hands-on experience with telecom data pipelines.
• Strong problem-solving, optimization, and debugging skills.

Responsibilities

• Design and maintain ETL/ELT pipelines using AWS services.
• Build and manage Amazon Redshift clusters for analytics.
• Develop Apache Iceberg tables for data management.
• Optimize ETL workflows for telecom datasets.
• Implement data lifecycle and governance policies.

Skills

Python

SQL

ETL/ELT pipelines

Telecom data handling

Data engineering

Optimization skills

Debugging skills

Tools

AWS Glue

Amazon Redshift

S3

Apache Iceberg

Athena

Terraform

Git

Job description

1 day ago Be among the first 25 applicants

Direct message the job poster from BULLIT MANAGEMENT SERVICES LIMITED

We are seeking an experiencedAWS Data Engineerwith strong expertise inETL pipelines, Redshift, Iceberg, Athena, and S3to support large-scale data processing and analytics initiatives in thetelecom domain. The candidate will work closely with data architects, business analysts, and cross‑functional teams to build scalable and efficient data solutions supporting network analytics, customer insights, billing systems, and telecom OSS/BSS workflows.

Key Responsibilities

• Design, develop, and maintainETL/ELT pipelinesusing AWS‑native services (Glue, Lambda, EMR, Step Functions).
• Implement data ingestion from telecom systems likeOSS/BSS, CDRs, mediation systems, CRM, billing, network logs.
• Optimize ETL workflows for large‑scale telecom datasets (high volume, high velocity).

Data Warehousing (Redshift)

• Build and manage scalableAmazon Redshiftclusters for reporting and analytics.
• Create and optimizeschemas, tables, distribution keys, sort keys, and workload management.
• Implement Redshift Spectrum to query data in S3 using external tables.

Data Lake & Iceberg

• Implement and maintainApache Icebergtables on AWS for schema evolution and ACID operations.
• Build Iceberg‑based ingestion and transformation pipelines using Glue, EMR, or Spark.
• Ensure high performance for petabyte‑scale telecom datasets (CDRs, tower logs, subscriber activity).

Querying & Analytics (Athena)

• Develop and optimizeAthenaqueries for operational and analytical reporting.
• Integrate Athena with S3/Iceberg for low‑cost, serverless analytics.
• Manage Glue Data Catalog integrations and table schema management.

Storage (S3) & Data Lake Architecture

• Implement data lifecycle policies, versioning, and partitioning strategies.
• Ensure data governance, metadata quality, and security (IAM, Lake Formation).

Telecom Domain Expertise

• Understand telecom‑specific datasets such as:
  • Network KPIs (4G/5G tower logs)
  • Billing & revenue assurance
• Build models and pipelines to supportnetwork analytics, customer 360, churn prediction, fraud detection, etc.

Performance Optimization & Monitoring

• Tune Spark/Glue jobs for performance and cost.
• Monitor Redshift/Athena/S3 efficiency and implement best practices.
• Perform data quality checks and validation across pipelines.

DevOps & CI/CD (Preferred)

• UseGit, CodePipeline, Terraform/CloudFormationfor infrastructure and deployments.
• Automate pipeline deployment and monitoring.

Required Skills

• 3–10 yearsexperience in data engineering.
• Strong hands‑on experience with:
  • Python/SQL
  • Telecom data pipelines and handling large‑scale structured/semi‑structured data.
  • Strong problem‑solving, optimization, and debugging skills.

Good to Have Skills

• Knowledge ofAWS Lake Formation,Kafka/Kinesis,Airflow, orDelta/Apache Hudi.
• Experience with ML workflows in telecom (churn, network prediction).

Seniority level

• Mid‑Senior level

Employment type

• Full‑time

Job function

• Information Technology