Data Engineer III — Cloud Big Data (Chennai/Hyderabad)

PDI Technologies; Indiana; On-site; USD 110,000 - 150,000; Full time

Job summary

PDI is seeking a Data Engineer III in Indiana to join our agile data services team. You will develop and maintain our cloud-based big data and analytics infrastructure used by Fortune 500 clients, contributing from design to deployment and support.

You will work with Redshift, EMR, and Spark, perform data modeling and ETL, mentor teammates, and ensure data governance and security across the data lake and analytics platforms.

Qualifications

• Architect and design data-oriented tasks.
• Establish and maintain relationships with business stakeholders.
• Build reliable and scalable data systems with governance.
• Expertise in data and dimensional modeling with business acumen.
• Assist teams to meet delivery goals with data design and infrastructure.
• Perform data modeling and ETL pipelines for OLTP/OLAP needs.
• Monitor data/system KPIs like storage and performance.
• Hands-on administration of Redshift, EMR, Spark.
• Prepare documentation per departmental standards.
• Identify and back-track data problems as needed.
• Mentor other team members and promote data quality.
• Plan, develop, and maintain high-performance data solutions.

Responsibilities

• Utilize architectural and design skills for data-oriented tasks.
• Establish and maintain strong relationships with business stakeholders.
• Build reliable and scalable data systems with governance for analytics.
• Expertise in data and dimensional modeling with business acumen.
• Assist teams to meet delivery goals with data design and infrastructure.
• Perform data modeling, big data architecture, and ETL pipelines.
• Track data/system KPIs like storage, performance and usage.
• Hands-on administration of Redshift, EMR, Spark.
• Prepare required documentation per departmental standards.
• Identify and analyze data problems as needed.
• Provide recommendations for system improvements.
• Mentor other team members.
• Work with business users to understand requirements.
• Develop and maintain high-performance data systems.

Skills

Data modeling

Data governance

Big data pipelines

ETL development

Cloud data platforms

Stakeholder collaboration

Mentoring teammates

Tools

Redshift

EMR

Spark

Job description

PDI is seeking a Data Engineer III in Indiana to join our agile data services team. You will develop and maintain our cloud-based big data and analytics infrastructure used by Fortune 500 clients, contributing from design to deployment and support.

You will work with Redshift, EMR, and Spark, perform data modeling and ETL, mentor teammates, and ensure data governance and security across the data lake and analytics platforms.