Data Engineer

ECLARO; Philippines; On-site; PHP 600,000 - 900,000; Full time

Job summary

ECLARO is seeking a Data Engineer to support the Strategic Analytics data engineering needs across a growing portfolio of analytics projects. You will develop complex data structures and pipelines leveraging SQL, Python, and cloud-based tools to enable faster data analysis.

Join a team that collaborates with predictive modelers to improve profitability and growth, using Databricks, Snowflake, Spark, Python, and Azure Data Factory to build robust data solutions.

Qualifications

• 3+ years of Data Engineer experience or equivalent using SQL and/or Python.
• Advanced SQL knowledge with relational databases.
• Experience with cloud technologies and Python is a plus.
• Excellent communication and collaboration in fast-paced environments.

Responsibilities

• Assemble large, complex data sets with modelers to solve business problems and increase profitability.
• Manipulate and transform data using SQL and Python.
• Automate manual processes and optimize data pipelines.
• Discover and explore new data sources with curiosity.
• Create and maintain scalable data pipeline architecture.
• Document data pipelines and technical solutions clearly.
• Ensure data quality and completeness.

Skills

Advanced SQL knowledge

Relational databases

3+ years data engineering

Attention to detail

Critical thinking

Communication skills

Fast-paced collaboration

Data quality awareness

Education

BS in Computer Science / IT / Data Analytics

Tools

Azure Data Factory

Snowflake

Databricks

Python

Spark

SQL tooling

Job description

Role: Data Engineer

• Work closely with predictive modelers to assemble large, complex data sets that help solve business problems and increase profitability
• Perform data manipulation and transformation using SQL and Python
• Identify, design, and implement internal process improvements: automating manual processes and optimizing data pipelines
• Discover and explore new sources of data with curiosity and creativity
• Create and maintain optimal data pipeline architecture
• Author detailed and comprehensible documentation of data pipelines and technical solutions
• Ensure data quality and completeness

Role: Data Engineer

Job Description

Strategic Analytics is a growing team at Client’s team. The team develops innovative predictive models and analytical tools to improve profitability and growth. This position will help support the data engineering needs across a growing portfolio of high-profile analytics projects by developing complex data structures and pipelines leveraging a diverse set of tools and languages. This includes the following cloud based technologies: Databricks, Snowflake, Spark, Python and Azure Data Factory. As a key member of the Strategic Analytics team, you will advance our data engineering capabilities helping the team analyze data faster.

Tasks/ Responsibilities

• Work closely with predictive modelers to assemble large, complex data sets that help solve business problems and increase profitability
• Perform data manipulation and transformation using SQL and Python
• Identify, design, and implement internal process improvements: automating manual processes and optimizing data pipelines
• Discover and explore new sources of data with curiosity and creativity
• Create and maintain optimal data pipeline architecture
• Author detailed and comprehensible documentation of data pipelines and technical solutions
• Ensure data quality and completeness

Required Skills / Experience

• Advanced working SQL knowledge and experience working with relational databases, query authoring
• A successful history of manipulating, processing and extracting value from large, disconnected datasets
• Ideally, 3+ years of experience in a Data Engineer role or equivalent using SQL and/or Python
• Good organizational skills and attention to detail
• Excellent critical thinking skills to flag complex data challenges
• Experience with cloud technologies and Python is a plus
• Comfortable working in fast paced, highly collaborative environment
• Ability to effectively communicate to different target audiences

Technical Skills: Technical Skills Proficiency Level Required (R) / Optional (O)

• SQL 4 R
• Relational SQL databases 3 R
• Data integrations services (SSIS, Azure Data Factory, etc.) 2 R
• Microsoft Excel 3 R
• Python, Scala, C++, Java or similar 2 O
• Snowflake or other cloud-based data warehouse 3 O
• NoSQL databases / unstructured data 2 O
• Azure cloud services 1 O

Education

• BS in Computer Science, Information Technology degree, Data Analytics or equivalent