Senior Data Engineer

Acxiom UK; England; On-site; GBP 60,000 - 80,000; Full time

Job summary

A leading data solutions company in the UK is seeking a Senior Data Engineer to design and maintain data architectures and pipelines. Responsibilities include developing data solutions using Snowflake, optimizing data structures, and ensuring data quality. The ideal candidate should have over 5 years experience, strong skills in Python and SQL, and a proven track record in data engineering. This role offers the opportunity to work with advanced data technologies in an agile environment.

Qualifications

• 5+ years of intensive experience as a Data Engineer or similar role.
• Demonstrable track record of leading large-scale projects.
• Strong understanding of RESTful APIs.

Responsibilities

• Develop, test, and maintain data architectures in Snowflake.
• Uphold data quality standards and rectify inconsistencies.
• Optimize pipelines and ensure peak performance.

Skills

Python

SQL

Data architecture

Data quality

Snowflake

Airflow

JSON

XML

AWS

Agile environment

Education

Bachelor’s degree in Computer Science, Information Systems or related discipline

Master's degree or higher

Tools

Snowflake

Git

CI/CD pipelines

Pandas

Job description

As we architect the next wave of data solutions in the AdTech and MarTech sectors, we're on the lookout for a Senior Data Engineer—a maestro in data architecture and pipeline design. If you're a seasoned expert, eager to lead, innovate, and craft state-of-the-art data solutions, we're keen to embark on this journey with you.

Job Responsibilities

• Develop, test, and maintain data architectures in Snowflake using Python, SQL, and modern data orchestration frameworks to deliver on business requirements.
• Uphold data quality standards, implementing tools and frameworks to detect and rectify data inconsistencies and inaccuracies.
• Optimize pipelines and data structures to ensure peak performance.
• Identify resolve bottlenecks by refactoring code and / or modifying flows.
• Drive initiatives for new data collection while refining existing data sources.
• Ensuring the highest standards of data integrity, accuracy, and reliability.
• Troubleshoot existing ETL pipelines and work with partners to resolve them in a timely manner.
• Develop and update technical documentation.
• Manage conflicting priorities and multiple projects concurrently.

Desired Skills & Qualifications

• Bachelor’s degree in Computer Science, Information Systems, or a related discipline. A Master's degree or higher is a distinct advantage.
• 5+ years of intensive experience as a Data Engineer or in a similar role, with a demonstrable track record of leading large-scale projects.
• Familiarity with Airflow, Dagster or similar data orchestration frameworks
• Strong understanding of RESTful APIs as well as experience working with both synchronous and asynchronous endpoints
• Experience with Snowflake or Redshift with a strong understanding of SQL.
• Proficient in Python and Pandas
• Experience working with JSON and XML
• Strong understanding of cloud computing concepts and services (AWS preferably)
• Experience with Git or equivalent version control systems and CI / CD pipelines.
• Familiarity with dbt a plus
• Highly analytical with strong problem-solving skills : ability to apply solutions forward, not just completing the task at hand.
• Ability to investigate, analyze and solve problems as well as clearly communicate results.
• Strong attention to detail, well organized, and can prioritize tasks under pressure.
• Must be a team player but also can work independently.
• Experience working in an agile product development environment.
• Is positive and motivating in a team environment.

Acxiom is a customer intelligence company that provides data-driven solutions to enable the world’s best marketers to better understand their customers to create better experiences and business growth. A leader in customer data management , identity , and the ethical use of data for more than 50 years, Acxiom now helps thousands of clients and partners around the globe work together to create millions of better customer experiences, every day. Acxiom is a registered trademark of Acxiom LLC. For more information, visit Acxiom.com .