A data consulting firm is seeking a skilled data engineer to work remotely on a contract basis. The successful candidate will design and maintain data pipelines, collaborate with cross-functional teams, and implement data quality checks. Required qualifications include a Bachelor's degree in Computer Science and proficiency in SQL, with up to 5 years of experience in relevant roles.
Qualifications
0-5 years of experience in data engineering or a similar role.
Experience with relational databases (e.g., MySQL, PostgreSQL).
Familiarity with ETL tools and frameworks.
Responsibilities
Design and maintain scalable data pipelines.
Collaborate with teams to understand data needs.
Implement data quality checks and validate data.
Skills
Proficiency in SQL
Strong programming skills in Python
Excellent problem-solving skills
Strong communication skills
Education
Bachelor's degree in Computer Science
Tools
Apache Airflow
Snowflake
Job description
We are seeking a skilled data engineer to join our team. The successful candidate will work remotely on a contract basis.
Job Location and Type
Location: Remote, Type: Contract
Job Responsibilities:
Design, develop, and maintain scalable data pipelines and ETL processes to collect, process, and store large volumes of data from various sources
Collaborate with cross-functional teams to understand data requirements and translate them into technical solutions
Optimize and tune database queries and processes for performance and efficiency
Implement data quality checks and validation procedures to ensure the integrity and accuracy of data
Build and maintain data warehouses and data marts to support reporting and analytics needs
Work closely with data scientists and analysts to provide access to structured and unstructured data for analysis and modeling
Continuously evaluate and adopt new technologies and tools to enhance data processing capabilities and improve efficiency
Document technical designs, processes, and procedures for data engineering projects
Troubleshoot and resolve issues related to data pipelines, databases, and data infrastructure
Stay up-to-date with industry trends and best practices in data engineering and related technologies
Job Requirements:
Bachelor's degree in Computer Science, Engineering, or a related field
0-5 years of experience in data engineering or a similar role
Proficiency in SQL and experience working with relational databases (e.g., MySQL, PostgreSQL)
Strong programming skills in at least one scripting language (e.g., Python, Java, Scala)
Experience with data warehousing concepts and technologies (e.g., Snowflake, Redshift, BigQuery)
Familiarity with ETL tools and frameworks (e.g., Apache Airflow, Talend, Informatica)
Knowledge of cloud computing platforms and services (e.g., AWS, Azure, Google Cloud Platform)
Understanding of data modeling principles and techniques
Excellent problem-solving and analytical skills
Strong communication and collaboration skills, with the ability to work effectively in a team environment