Senior Data Engineer

Data Axle; Pune District; On-site; USD 18,630 - 36,225; Full time

Job summary

Data Axle Inc. in Pune, India is seeking a Senior Data Engineer to design, implement, and support an analytical data infrastructure providing ad-hoc access to large datasets and computing power.

You will interface with multiple technology teams to extract, transform, and load data from diverse sources using SQL and AWS big data technologies, and you will build real-time pipelines on Glue, Redshift/Spectrum, Kinesis, EMR and Athena.

Qualifications

• 7+ years of experience in software development, data engineering, BI, data science, or related field with large datasets.
• Bachelor’s degree in Computer Science, Engineering, Mathematics, or related technical discipline.
• Strength in data modeling, ETL development, and data warehousing.
• Experience with Spark and AWS big data technologies (Redshift, S3, EMR, Spark).
• Experience using BI reporting tools (Tableau, Power BI, Cognos).
• Experience building/operating highly available distributed data extraction and processing systems.

Responsibilities

• Design, implement and support an analytical data infrastructure with ad-hoc access to large datasets and computing power.
• Interface with technology teams to extract, transform, and load data from diverse sources using SQL and AWS big data technologies.
• Create and support real-time data pipelines on AWS (Glue, Redshift/Spectrum, Kinesis, EMR, Athena).
• Pursue continual research of big data and visualization tech to add capabilities and efficiency.
• Collaborate to implement analytics algorithms for statistical analysis, prediction, clustering and ML.
• Help improve reporting/analysis processes, automating self-service for customers.

Skills

Data modeling

ETL development

Data warehousing

SQL

Distributed systems

Agile methodologies

Education

Bachelor’s degree in Computer Science or related field

Tools

Spark

Tableau

Power BI

Cognos

Redshift

S3

EMR

Job description

Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging proprietary business & consumer databases. Data Axle is headquartered in Dallas, TX, USA.

We are looking for a Senior Data Engineer who will design, implement and support an analytical data infrastructure providing ad-hoc access to large datasets and computing power.

• Design, implement and support an analytical data infrastructure providing ad-hoc access to large datasets and computing power.
• Interface with other technology teams to extract, transform, and load data from a wide variety of data sources using SQL and AWS big data technologies.
• Creation and support of real-time data pipelines built on AWS technologies including Glue, Redshift/Spectrum, Kinesis, EMR and Athena.
• Continual research of the latest big data and visualization technologies to provide new capabilities and increase efficiency.
• Working closely with team members to drive real-time model implementations for monitoring and alerting of risk systems.
• Collaborate with other tech teams to implement advanced analytics algorithms that exploit our rich datasets for statistical analysis, prediction, clustering and machine learning.
• Help continually improve ongoing reporting and analysis processes, automating or simplifying self-service support for customers.

Qualifications

• 7+ years of industry experience in software development, data engineering, business intelligence, data science, or related field with a track record of manipulating, processing, and extracting value from large datasets.
• Bachelor’s degree in Computer Science, Engineering, Mathematics, or a related technical discipline.
• Demonstrated strength in data modeling, ETL development, and data warehousing.
• Experience using big data processing technology using Spark.
• Knowledge of data management fundamentals and data storage principles.
• Experience using business intelligence reporting tools (Tableau, Business Objects, Cognos, Power BI etc.).
• Experience working with AWS big data technologies (Redshift, S3, EMR, Spark).
• Experience building/operating highly available, distributed systems of data extraction, ingestion, and processing of large data sets.
• Experience working with distributed systems as it pertains to data storage and computing.
• Knowledge of software engineering best practices across the development lifecycle, including agile methodologies, coding standards, code reviews, source management, build processes, testing, and operations.

Posting Location

Pune, India

Position Type

Full Time

undefined

Employer Privacy Policy

DISCLAIMER:

Data Axle India follows a merit-based employee recruitment practice with extensive screening steps. Data Axle India does not charge/accept any amount or security deposit from job seekers during the recruitment process. Job seekers are requested to be aware of unsolicited or fraudulent communication regarding a job offer or an interview call against payment of money, please stay alert. All Data Axle India jobs are published on the Careers page of its Website and/or on its LinkedIn profile. Interested job seekers may access the same and apply directly.

If you believe you have been a victim of recruitment fraud, you are requested to approach law enforcement agencies immediately.

EEO is the Law

ADP Privacy Statement

Artificial Intelligence

Google Privacy Policy

Google Terms of Service