Senior Data Engineer

Apexon; Newcastle upon Tyne; On-site; GBP 60,000 - 90,000; Full time

Job summary

Apexon is seeking a Data Engineer with hands-on experience in Databricks and Azure cloud technologies to join our Newcastle/Sunderland team. You will design, build, and optimize data pipelines, integrate diverse data sources, and support scalable data architectures in a modern cloud environment.

The role involves collaborating with data analysts and BI teams to create Power BI semantic models and reports, leveraging notebooks for ETL processes, and ensuring secure, highly available data

Qualifications

• Proven experience as a Data Engineer with expertise in Azure cloud services.
• Experience with Azure Data Lake and Azure Databricks.
• Proficiency in designing and managing ETL processes using Notebooks.
• Experience with Power BI for semantic model creation and report development.
• Familiarity with integrating various data sources within Azure environments.
• Basic understanding of Azure networking concepts and their relevance to data engineering.
• Excellent problem-solving and communication skills.

Responsibilities

• Design, develop, and maintain ETL pipelines using Azure services, with a focus on Databricks and Azure Datafactory.
• Develop and optimize ETL processes leveraging Notebooks to ensure efficient data movement and transformation.
• Collaborate with data analysts and BI teams to develop and maintain Power BI semantic models and reports.
• Integrate various data sources into Azure environments for seamless data access and analysis.
• Contribute to the design and implementation of Azure solutions to support data flows and connectivity.
• Ensure data pipelines are highly available, scalable, and secure by leveraging Azure best practices.
• Collaborate with cross-functional teams to ensure smooth delivery of data engineering projects.

Skills

Azure cloud

ETL design

Power BI modeling

Data integration

Problem solving

Communication

DevOps awareness

Tools

Azure Data Lake

Azure Databricks

Terraform

Notebooks

Job description

Apexon is a digital-first technology services firm specializing in accelerating business transformation and delivering human-centric digital experiences. We have been meeting customers wherever they are in the digital lifecycle and helping them outperform their competition through speed and innovation.

Apexon brings together distinct core competencies – in AI, analytics, app development, cloud, commerce, CX, data, DevOps, IoT, mobile, quality engineering and UX, and our deep expertise in BFSI, healthcare, and life sciences – to help businesses capitalize on the unlimited opportunities digital offers. Our reputation is built on a comprehensive suite of engineering services, a dedication to solving clients’ toughest technology problems, and a commitment to continuous improvement.

Backed by Goldman Sachs Asset Management and Everstone Capital, Apexon now has a global presence of 15 offices (and 10 delivery centers) across four continents.

Job Title: Data Engineer with Azure Experience

About the Role

We are seeking a talented and motivated Data Engineer with hands-on experience in Databricks & Azure cloud technologies to join our team in Newcastle/Sunderland. The ideal candidate will play a key role in designing, building, and optimizing data pipelines, integrating various data sources, and supporting the development of scalable data architectures. This is a great opportunity for an individual who is passionate about data engineering and keen to work with modern cloud solutions.

Key Responsibilities

• Design, develop, and maintain ETL pipelines using Azure services, with a focus on Databricks & Azure Datafactory
• Develop and optimize ETL processes leveraging Notebooks to ensure efficient data movement and transformation.
• Collaborate with data analysts and business intelligence teams to develop and maintain Power BI semantic models and reports.
• Integrate various data sources into Azure environments for seamless data access and analysis.
• Contribute to the design and implementation of Azure solutions to support data flows and connectivity.
• Ensure data pipelines are highly available, scalable, and secure by leveraging Azure best practices.
• Collaborate with cross-functional teams to ensure smooth delivery of data engineering projects.

Key Skills & Qualifications

• Proven experience as a Data Engineer or in a similar role, with expertise in Azure cloud services.
• Experience with Azure services like Azure Data Lake and Azure Databricks.
• Proficiency in designing and managing ETL processes using Notebooks.
• Experience with Power BI for semantic model creation and report development.
• Familiarity with integrating various data sources within Azure environments.
• Basic understanding of Azure networking concepts and their relevance to data engineering.
• Excellent problem-solving and communication skills.

Preferred Qualifications

• Familiarity with Infrastructure-as-Code (IaC) practices.
• Knowledge of Terraform is beneficial but not required.
• Strong knowledge of data governance and security best practices in the cloud.
• Previous experience in a DevOps environment with CI/CD pipelines.

Our Commitment to Diversity & Inclusion:

Did you know that Apexon has been Certified by Great Place To Work, the global authority on workplace culture, in each of the three regions in which it operates: USA (for the fourth time in 2023), India (seven consecutive certifications as of 2023), and the UK.

Apexon is committed to being an equal opportunity employer and promoting diversity in the workplace. We take affirmative action to ensure equal employment opportunity for all qualified individuals. Apexon strictly prohibits discrimination and harassment of any kind and provides equal employment opportunities to employees and applicants without regard to gender, race, color, ethnicity or national origin, age, disability, religion, sexual orientation, gender identity or expression, veteran status, or any other applicable characteristics protected by law.