Senior Data Engineer

Akrivia HCM; Hyderabad; On-site; INR 7,005,253 - 12,259,193; Full time

Job summary

An established industry player is seeking a Data Engineer to enhance their cloud-based data warehousing solutions. In this dynamic role, you will leverage your 8-12 years of experience to design, build, and maintain scalable data warehouses on AWS and Azure. You will develop high-performance ETL processes and collaborate with analytics teams to optimize products and foster innovation. This is a fantastic opportunity to contribute to advanced analytics and data science efforts while ensuring data security and integrity. If you're passionate about data and looking to make a significant impact, this role is perfect for you.

Qualifications

• 8-12 years of experience in data warehousing and cloud environments.
• Strong skills in big data pipelines and unstructured datasets.

Responsibilities

• Design and implement scalable data warehouse solutions.
• Develop data pipeline architectures for ingestion and transformation.
• Collaborate with stakeholders to support data infrastructure needs.

Skills

Data Warehousing

AWS

Azure

ETL Processes

Python

SQL

Big Data Pipelines

Project Management

Education

BA/BS in Computer Science

Tools

AWS EC2

AWS EMR

AWS RDS

AWS Redshift

Azure Data Warehouse

Azkaban

Luigi

Airflow

Job description

Get AI-powered advice on this job and more exclusive features.

Direct message the job poster from Akrivia HCM.

We are looking for a Data Engineer with a strong foundation in cloud-based data warehousing solutions to support our advanced analytics and data science efforts. The ideal candidate will have 8-12 years of extensive experience in designing, building, and maintaining scalable and reliable data warehouses, as well as expertise in data retrieval and orchestration in cloud environments such as AWS and Azure.

Core Responsibilities:

• Design and implement scalable data warehouse solutions on AWS and Azure.
• Develop and maintain data pipeline architectures for ingestion, transformation, and distribution.
• Build high-performance ETL processes using AWS or Azure big data technologies.
• Collaborate with stakeholders to support data infrastructure needs and resolve technical issues.
• Ensure data security across regions and data centers.
• Assemble large, complex data sets to meet business requirements.
• Identify and implement process improvements, automation, and infrastructure re-designs for scalability.
• Work with analytics teams to enhance data models for BI tools and decision-making.
• Create data tools for analytics and data science teams to optimize products and foster innovation.

Qualifications:

• BA/BS in Computer Science, Engineering, or related field, or equivalent experience.
• 8-12 years of relevant experience.
• Strong skills with unstructured datasets and big data pipelines.
• Experience with AWS services: EC2, EMR, RDS, Redshift.
• Experience with Azure services: Data Warehouse, Data Lake, HDInsight.
• Experience with stream processing systems: Kinesis, Kafka, Storm, Spark-Streaming.
• Proficiency in scripting languages: Python, Java, C++, Scala.
• Knowledge of message queuing, stream processing, and scalable data stores.
• Strong project management and organizational skills.
• Experience with data pipeline tools: Azkaban, Luigi, Airflow.
• Familiarity with data retrieval, orchestration, and warehousing best practices.
• Certifications in AWS or Azure.
• Strong SQL skills and experience with relational databases.

Seniority level

• Mid-Senior level

Employment type

• Full-time

Job function

• Information Technology and Engineering

Industries

• IT Services and Consulting, Software Development, Technology, Internet

Referrals can increase your chances of interviewing at Akrivia HCM by 2x.