A leading consulting firm seeks a Data Engineer to design and maintain data processes. The role involves collaboration with stakeholders, developing data models, and implementing machine learning solutions. Ideal candidates will have a Bachelor's degree and strong SQL skills, in addition to proficiency in Python and ETL tools.
Qualifications
Proven experience as a Data Engineer or similar role.
Strong proficiency in SQL and relational databases.
Hands-on experience with ETL tools and data integration.
Responsibilities
Design and maintain data pipelines and ETL processes.
Collaborate to understand data requirements.
Implement machine learning models and algorithms.
Skills
SQL
Python
Data Modeling
ETL
Machine Learning
Data Governance
Data Security
Collaboration
Education
Bachelor’s degree in computer science, Data Science, or related field
Tools
ETL tools
Power BI
Azure
Hadoop
Spark
Job description
Job Description:
Responsibilities:
Design, develop, and maintain robust data pipelines and ETL processes to support data integration and analytics.
Collaborate with analysts and business stakeholders to understand data requirements and deliver effective solutions.
Develop and optimize data models for analytics and reporting.
Implement machine learning models and algorithms to solve complex business problems.
Create and maintain dashboards and reports to provide actionable insights to business users.
Ensure data quality, integrity, and security across all data platforms.
Monitor and troubleshoot data pipeline issues to ensure timely and accurate data delivery.
Implement best practices for data management, including data governance and documentation.
Qualifications:
Bachelor’s degree in computer science, Data Science, Information Technology, or a related field.
Proven experience as a Data Engineer or in a similar role.
Strong proficiency in SQL and experience with relational databases (e.g., SQL Server, MySQL, PostgreSQL).
Hands-on experience with ETL tools and data integration frameworks.
Proficiency in programming languages such as Python.
Experience with machine learning frameworks and libraries like scikit-learn, TensorFlow, PyTorch.
Strong problem-solving skills and attention to detail.
Excellent communication and collaboration skills.
Preferred Skills:
Experience with big data technologies (e.g., Hadoop, Spark).
Proficiency in data visualization tools using Power BI.
Familiarity with cloud platforms specifically Azure.
Understanding of data warehousing concepts and tools.
Understanding of data governance and data security best practices.