About the Role
Our client, a growing data analytics firm in East London, is looking for a seasoned Senior Data Engineer to build and maintain efficient and scalable data pipelines. This role is crucial for ensuring the reliable flow of data that powers our client's analytics and business intelligence initiatives. You will be responsible for designing, developing, and optimizing data warehousing solutions, ETL processes, and data infrastructure. The ideal candidate has a strong command of database technologies, programming languages, and cloud data services. This is a hybrid role, offering the flexibility to work remotely while also collaborating in our East London office. Your expertise will be key to transforming raw data into valuable insights for our organization.
Key Responsibilities
- Design, build, and maintain robust, scalable, and efficient data pipelines and ETL processes.
- Develop and manage data warehouse solutions and data models.
- Optimize data infrastructure for performance, reliability, and cost-effectiveness.
- Implement data quality checks and ensure data accuracy and consistency.
- Collaborate with data scientists, analysts, and business stakeholders to understand data needs and requirements.
- Develop and maintain data ingestion processes from various sources.
- Utilize cloud data services (e.g., AWS RDS, Redshift, S3; Azure SQL Database, Data Lake; GCP BigQuery, Cloud Storage) to build and manage data solutions.
- Write clean, well-documented, and maintainable code using programming languages like Python or Scala.
- Troubleshoot and resolve data-related issues and performance bottlenecks.
- Stay current with emerging data engineering technologies and best practices.
- Ensure data security and compliance with relevant regulations.
Requirements
- Bachelor's degree in Computer Science, Engineering, or a related quantitative field, or equivalent practical experience.
- Minimum of 5 years of professional experience in data engineering or a similar role.
- Strong experience in designing and building data pipelines using ETL tools and technologies.
- Proficiency in SQL and experience with relational databases (e.g., PostgreSQL, MySQL) and data warehousing concepts.
- Experience with cloud platforms and their data services (AWS, Azure, or GCP).
- Proficiency in programming languages such as Python or Scala.
- Familiarity with big data technologies (e.g., Spark, Hadoop) is a plus.
- Knowledge of data modeling techniques and database design.
- Experience with version control systems like Git.
- Excellent problem-solving, analytical, and communication skills.
- Ability to work independently and collaboratively in a team environment.
Benefits
- Competitive salary and performance incentives.
- Comprehensive health, dental, and vision insurance.
- Generous pension fund contribution.
- Opportunities for professional development and continuous learning.
- A dynamic work environment with exposure to cutting-edge data technologies.
- Hybrid work model offering flexibility.
Modern office facilities in East London .Paid time off for vacation and personal needs.Team-building activities and social events.Career growth opportunities within a leading data analytics company.