Senior Python Data Engineer - Enterprise Pipelines (Hybrid)

N Consulting Limited; Greater London; Hybrid; GBP 70,000 - 90,000; Full time

Job summary

N Consulting Limited is looking for a Senior Data Engineer (Python Enterprise Developer) to lead the design and optimization of scalable data pipelines. The role requires 8+ years of Python scripting experience, proficiency with SQL databases like PostgreSQL, and familiarity with cloud platforms such as AWS and Azure. Ideal candidates will have strong skills in Python libraries including NumPy and Pandas, along with experience in DevOps practices using CI/CD pipelines. This position offers a hybrid work environment based in Greater London.

Qualifications

• 8+ years of experience in Python scripting and development.
• Proficient with Python packages such as NumPy, pandas, and more.
• Experience with building native Python ETL pipelines.

Responsibilities

• Lead the design and development of scalable data pipelines.
• Provide technical leadership in Python development.
• Architect and optimize SQL queries and database solutions.

Skills

Python

Postgres SQL

Azure Databricks

AWS (S3)

Git

Azure DevOps CICD

Apache Airflow

Job description

N Consulting Limited is looking for a Senior Data Engineer (Python Enterprise Developer) to lead the design and optimization of scalable data pipelines. The role requires 8+ years of Python scripting experience, proficiency with SQL databases like PostgreSQL, and familiarity with cloud platforms such as AWS and Azure. Ideal candidates will have strong skills in Python libraries including NumPy and Pandas, along with experience in DevOps practices using CI/CD pipelines. This position offers a hybrid work environment based in Greater London.