Senior Data Engineer

Dplit; Islamabad; On-site; PKR 1,200,000 - 1,800,000; Full time

Job summary

Dplit is looking for an experienced Data Engineer to join their team in Islamabad. The role involves designing, building, and maintaining analytics solutions while collaborating with Software Engineers.

The ideal candidate will have a BS/MS degree and substantial experience with AWS services as well as expertise in data engineering and ETL technologies. This position offers an exciting opportunity to work with big data frameworks and enhance data reliability.

Qualifications

• 5+ years of experience with data engineering and ETL technologies.
• 2+ years of hands-on experience with AWS.
• Experience with big data technologies like Hadoop, Spark, or Hive.

Responsibilities

• Build data systems, pipelines, and analytics solutions.
• Evaluate business needs and interpret trends and patterns.
• Implement complex data aggregates and business logic using SQL.

Skills

Data systems and pipelines

AWS services

SQL

Python

Data quality enhancement

Education

BS/MS degree in Computer Science, IT, Mathematics, or Statistics

Tools

AWS

Hadoop

Spark

Hive

Pandas

Job description

As a Data Engineer you will work closely with our Software Engineers’ team to design, build, secure, and maintain analytics solutions.

Requirements

• Build data systems and pipelines
• Evaluate business needs and objectives
• Interpret trends and patterns
• Prepare data for prescriptive and predictive modeling
• Build algorithms and prototypes
• Combine raw information from different sources
• Explore ways to enhance data quality and reliability
• Extract value insights from semi-structured, structured data and non-structured data
• Implement complex data aggregates and business logic using SQL

Qualifications

• BS/MS degree in Computer Science, IT, Mathematics, Statistics or similar.
• At least 5 years of experience with data engineering and ETL technologies
• At least 2 years of hands-on experience working with AWS
• Experience and expertise working with AWS services to design, build, secure, and maintain analytics solutions
• Experience with AWS IoT Core/Analytics would be preferred
• Experience with big data technologies like Hadoop, Spark, Hive or similar frameworks.
• Advanced SQL skills.
• Experience in AWS Lambda, AWS Glue, AWS Athena and as AWS Redshift
• Experience in Python, Pandas or a similar modeling language.