Data Engineer III On-site — Full-time Chennai / Hyderabad

PDI Technologies; Indiana; On-site; USD 110,000 - 150,000; Full time

Job summary

PDI is seeking a Data Engineer III in Indiana to join our agile data services team. You will develop and maintain our cloud-based big data and analytics infrastructure used by Fortune 500 clients, contributing from design to deployment and support.

You will work with Redshift, EMR, and Spark, perform data modeling and ETL, mentor teammates, and ensure data governance and security across the data lake and analytics platforms.

Qualifications

• Architect and design data-oriented tasks.
• Establish and maintain relationships with business stakeholders.
• Build reliable and scalable data systems with governance.
• Expertise in data and dimensional modeling with business acumen.
• Assist teams to meet delivery goals with data design and infrastructure.
• Perform data modeling and ETL pipelines for OLTP/OLAP needs.
• Monitor data/system KPIs like storage and performance.
• Hands-on administration of Redshift, EMR, Spark.
• Prepare documentation per departmental standards.
• Identify and back-track data problems as needed.
• Mentor other team members and promote data quality.
• Plan, develop, and maintain high-performance data solutions.

Responsibilities

• Utilize architectural and design skills for data-oriented tasks.
• Establish and maintain strong relationships with business stakeholders.
• Build reliable and scalable data systems with governance for analytics.
• Expertise in data and dimensional modeling with business acumen.
• Assist teams to meet delivery goals with data design and infrastructure.
• Perform data modeling, big data architecture, and ETL pipelines.
• Track data/system KPIs like storage, performance and usage.
• Hands-on administration of Redshift, EMR, Spark.
• Prepare required documentation per departmental standards.
• Identify and analyze data problems as needed.
• Provide recommendations for system improvements.
• Mentor other team members.
• Work with business users to understand requirements.
• Develop and maintain high-performance data systems.

Skills

Data modeling

Data governance

Big data pipelines

ETL development

Cloud data platforms

Stakeholder collaboration

Mentoring teammates

Tools

Redshift

EMR

Spark

Job description

For nearly 40 years, PDI has helped convenience retailers and petroleum wholesalers adapt to changes in the industry by leveraging the latest technologies. Simplifying the complexity in your world is our main focus. That's why we're delivering an integrated portfolio of global, cloud-based solutions and services to meet our customers needs today and well into the future. From the back office to fuel logistics, and the latest wave of consumer demands and digital commerce, PDI solutions and services are designed to give you a competitive edge. Our deep domain knowledge is backed by our industry-specific software offerings and a people-first approach. Serving the entire supply chain means that we’ve had to solve a wide range of industry challenges and deliver measurable value. To address the increasingly dynamic convenience retail and petroleum wholesale industry, PDI leads the way with converged digital, cloud-optimized, secure, and scalable solutions including ERP, Loyalty, Fuel Pricing, Point-of-Sale and Logistics to create a broader industry ecosystem. The result is unparalleled insights, simplified operations, and higher profitability for your employees and business. We’re dedicated to helping our more than 1,500 customers in over 50 countries, providing solutions and services to over 200,000 sites.

The Opportunity

If you love to develop great quality software and are eager to learn new technologies and develop new skills, then we have a great opportunity for you: join our PDI family and work closely with other talented PDI engineers to deliver solutions that delight our customers every day!

As a Data Engineer III, you will be part of an agile data services team responsible for developing and maintaining our industry-leading cloud-based big data and data analytics infrastructure serving major global fortune 500 companies. The candidate will help with design, development, unit testing, performance testing, deployment, troubleshooting, defect resolution, and support of our

Job Responsibilities

• Utilize architectural and design skills for a variety of data-oriented tasks.
• Establish and maintain strong relationships with business stakeholders.
• Build highly reliable & scalable data systems with good data governance that provide complete, secure, accurate and timely data for analytics.
• Expertise in data & dimensional modeling with good business acumen in supporting new product features and services - including financial reporting.
• Assist development and analytics organization to meet its delivery goals with regards to data design, flow and infrastructure.
• Perform Data Modeling, Big data architecture design, support and implementation of OLTP, real time OLAP/data warehouse systems and ETL pipelines.
• Track/Build & monitor data/system KPI’s like storage, performance & usage
• Hands on administration of big data databases/compute engines (Redshift, EMR, Spark or similar) and optimization/tuning techniques
• Prepare required documentation as outlined by departmental standards.
• Identify, analyze and back track data problems as needed.
• Provide recommendations for application and system improvements.
• Mentor other team members
• Work with business users to understand business requirements, issues and business and/or client processes.
• Develop, test, and maintain high-performance of our data systems to meet the requirements of the business and/clients while adhering to departmental standards.
• Perform quality assurance testing for all work performed.
• Meet with agile teams as required to define and document application requirements.
• Follow project development, deployment process & maintain industry standards and best coding practices.
• Maintain security and organization of the company’s data.
• Provide off-hour support as assigned.
• Gather business requirements/features, estimate the tasks, design & develop scalable solutions.
• Work with manager to ascertain the company’s data requirements.
• Plan