Data Engineer (SC Clearance)

amber labs; United Kingdom; Remote; GBP 40,000 - 60,000; Full time

Job summary

Join a forward-thinking technology consultancy that champions innovation and collaboration. This exciting opportunity involves developing scalable data pipelines, utilizing cutting-edge technologies like AWS and Python, and working closely with cross-functional teams to drive data solutions. As part of a dynamic startup, you will thrive in a flexible work environment that encourages personal growth and experimentation. With a strong focus on diversity and inclusion, the company fosters a culture where every voice is valued. If you're ready to make a significant impact in the tech landscape, this role is perfect for you.

Benefits

Private medical insurance

Company pension plan

25 days annual leave

Access to Perkbox

Generous employee referral program

Flexible work environment

Choice of device (PC or Mac)

Qualifications

• Expertise in data pipeline development and ETL processes using SSIS.
• Proficient in AWS services and Python for data management.

Responsibilities

• Design and maintain scalable data pipelines for data ingestion and transformation.
• Collaborate with teams to ensure data architecture meets business needs.

Skills

AWS S3

AWS Lambda

AWS EMR

Terraform

Databricks

Python/Pyspark

Data Lake architecture

Gitlab

Java (Spring Boot)

Tools

SSIS

Jupyter

Azure

Job description

Location: Remote

Work Pattern: Full-Time

Security Clearance: SC Clearance

The Company:

At Amber Labs, we are a cutting-edge UK and European technology consultancy that prioritises empowering autonomy, promoting experimentation, and facilitating rapid learning to provide exceptional value to our clients. Our company culture is centred around collaboration, where all colleagues, regardless of their role, work together to minimise risk and shorten delivery times. Our team consists of highly-skilled cross-functional consultants, analysts, and support staff.

Responsibilities:

1. Data Pipeline Development:
   • Design, develop, and maintain scalable and efficient data pipelines for ingesting, transforming, and loading data from various sources.
   • Utilize SSIS to create and manage ETL (Extract, Transform, Load) processes for seamless data integration.
2. Data Modeling and Architecture:
   • Collaborate with data architects and analysts to understand data requirements and implement efficient data models.
   • Ensure data architecture and models support business needs and are scalable for future growth.
3. SSIS Expertise:
   • Demonstrate expertise in SQL Server Integration Services (SSIS) for building and managing ETL processes.
   • Optimize and troubleshoot SSIS packages for performance and reliability.
4. Data Quality and Governance:
   • Implement data quality checks and validations within ETL processes to ensure accurate and reliable data.
   • Adhere to data governance and compliance standards, ensuring data integrity and security.
5. Collaboration:
   • Work closely with cross-functional teams, including data scientists, analysts, and business stakeholders, to understand data requirements and deliver solutions.

Requirements:

• AWS: S3, Lambda, EMR, SMS, SQS, and additional services related to data infrastructure
• Terraform
• Databricks
• Data Lake, Warehouse, Lakehouse architecture and design
• Python/Pyspark
• Data platforms and notebooks: Jupyter, Databricks, Azure
• Gitlab: repository and CI/CD
• Java (Spring Boot) experience is a plus

Benefits:

• Join a rapidly expanding startup where personal growth is a part of our DNA.
• Benefit from a flexible work environment focused on deliverable outcomes.
• Receive private medical insurance through Aviva.
• Enjoy the benefits of a company pension plan through Nest.
• 25 days of annual leave plus UK bank holidays.
• Access Perkbox, a global employee rewards platform offering discounts, perks, and wellness resources.
• Participate in a generous employee referral program.
• A highly collaborative and collegial environment with opportunities for career advancement.
• Be encouraged to take bold steps and embrace a mindset of experimentation.
• Choose your preferred device, PC or Mac.

Diversity & Inclusion:

Here at Amber Labs, we are dedicated to fostering an inclusive and equitable workplace for all. Our commitment to diversity, equality, and inclusion includes:

• Valuing the unique experiences, perspectives, and backgrounds of all employees and creating an environment where everyone feels welcomed, respected, and valued.
• Prohibiting all forms of harassment, bullying, discrimination, and victimisation and promoting a culture of dignity and respect for all.
• Educating all new hires on our Diversity and Inclusion policies and ensuring they are aware of their rights and responsibilities to create a safe and inclusive workplace.
• By taking these steps, we are dedicated to building a workplace that reflects and celebrates the diversity of our employees and communities.

What Happens Next?

Our Talent Acquisition team will be in touch to advise you on the next steps. We have a two-stage interview process for most of our consultants. In certain cases, we may include a third and final stage, which is a conversation with the company Partners. This will only be considered if deemed necessary.