About the Role
Our client, a prominent data analytics consultancy, is seeking a Senior Data Engineer with extensive experience in big data technologies to join their fully remote team. This role is essential for designing, building, and maintaining scalable data pipelines and infrastructure that support complex analytical and machine learning initiatives. You will work with large, diverse datasets, ensuring data quality, reliability, and accessibility for data scientists and analysts. The ideal candidate possesses deep technical expertise in distributed systems, data warehousing, and ETL processes, and thrives in a collaborative, remote environment. This is a fantastic opportunity to work on challenging big data projects and influence data strategy from anywhere.
Key Responsibilities
- Design, build, and optimize robust and scalable big data pipelines and ETL processes.
- Develop and manage data warehousing solutions and data lakes using technologies like Hadoop, Spark, and cloud-based data platforms.
- Implement data governance and data quality best practices.
- Collaborate with data scientists and analysts to understand their data needs and provide efficient data solutions.
- Develop and maintain data models for various analytical purposes.
- Ensure the performance, reliability, and security of data infrastructure.
- Automate data processes and implement monitoring and alerting systems.
- Stay current with emerging big data technologies and trends.
- Troubleshoot and resolve data-related issues across the entire data lifecycle.
- Contribute to architectural decisions regarding data platform design and implementation.
Requirements
- Bachelor's or Master's degree in Computer Science, Engineering, Statistics, or a related quantitative field.
- Minimum of 5 years of experience in data engineering, with a strong focus on big data technologies.
- Proficiency in programming languages such as Python, Scala, or Java.
- Hands-on experience with distributed computing frameworks like Apache Spark and Hadoop (HDFS, MapReduce).
- Experience with cloud data platforms (e.g., AWS EMR, Azure Databricks, Google Cloud Dataflow).
- Strong knowledge of SQL and experience with various database technologies (relational and NoSQL).
- Familiarity with data warehousing concepts and ETL/ELT tools.
- Experience with workflow management tools (e.g., Apache Airflow).
- Understanding of data modeling techniques and principles.
- Excellent problem-solving skills and ability to work with complex, large-scale datasets.
- Strong communication skills and ability to collaborate effectively in a remote team environment.
Benefits
- This is a fully remote position offering excellent flexibility.
- Our client provides a highly competitive salary, regular performance reviews, and potential for bonuses.
- Comprehensive health, dental, and vision insurance coverage are included.
- A generous retirement savings plan with company contributions is available.
- We support continuous learning through online courses, certifications, and virtual conferences.
- Employees receive ample paid time off.
- The company culture fosters collaboration, innovation, and values employee well-being, even in a distributed setting.
- Opportunities for professional development are abundant, and the company invests in tools and resources to ensure remote employees succeed.