Data Engineer (Python Enterprise Developer)

N Consulting Limited; Greater London; Hybrid; GBP 70,000 - 90,000; Full time

Job summary

N Consulting Limited is looking for a Data Engineer (Python Enterprise Developer) to work in a hybrid model with 4 days a week in London, Canary Wharf. The ideal candidate will have 8+ years of experience in Python scripting, and proficiency in tools such as Postgres SQL and Azure Databricks.

Responsibilities include coordinating teams across locations, delivering projects with Agile methods, and leading a motivated team. This is a long-term contract position with opportunities in the energy trading domain.

Qualifications

• 8+ years of experience in python scripting.
• Experience in building native python ETL pipelines.
• Proficient in SQL programming and Postgres SQL.

Responsibilities

• Coordinate with teams across multiple locations.
• Deliver projects using Agile and Scrum methodology.
• Lead a team and keep them motivated.

Skills

Python

Postgres SQL

Azure Databricks

AWS (S3)

Git

Azure DevOps CI/CD

Apache Airflow

Job description

# Data Engineer (Python Enterprise Developer) at N Consulting LtdWork mode: Hybrid (with 4 days a week at London, Canary Wharf) Contract duration: Long term Location: London --------------------------------------- JOB DETAILS Role Title: Data Engineer (Python Enterprise Developer) Must have skills: -Python, Postgres SQL, Azure Databricks, AWS(S3), Git, Azure DevOps CICD, Apache Airflow -Preferred Domain: Energy trading Minimum number of relevant years of experience: 8+ Detailed Job Description: JD: • 8+ years of experience in python scripting. • Exposed to python packages such as NumPy, pandas, polars beautiful soup, Selenium, Requests etc. • Experience in building native python ETL pipelines for scraping/processing. • Good to have experience in processing big data. • Proficient in SQL programming, Postgres SQL. Spark knowledge is a good to have • Knowledge on DevOps CI/CD like Azure Pipelines, Jenkins, Git. • Experience working with AWS services(S3, lambda,etc) and Azure Databricks. • Have experience in delivering project with Agile and Scrum methodology. • Able to co-ordinate with Teams across multiple locations and time zones • Strong interpersonal and communication skills with an ability to lead a team and keep them motivated. • Python, Postgres SQL, Azure Databricks, AWS(S3), Git, Azure DevOps CICD, Apache Airflow