Senior Data Engineer

UsefulBI Corporation; Bengaluru; On-site; INR 2,000,000 - 4,000,000; Full time

Job summary

UsefulBI Corporation in Bengaluru, India is seeking highly skilled data engineers to design analytical infrastructure capable of turning large datasets into actionable business insights. The role focuses on building data pipelines and analytics tools to enable strategic decision-making.

The ideal candidate will have deep knowledge of statistics, Python, PySpark, Databricks, and cloud platforms (AWS/Azure), with experience in handling very large datasets and delivering business impact.

Qualifications

• 5+ years of Data Engineering experience.
• Proficiency in Python.
• Strong knowledge of PySpark, Databricks, and cloud platforms (AWS/Azure).

Responsibilities

• Create and maintain optimal data pipeline architecture.
• Assemble large, complex data sets that meet functional / non-functional business requirements.
• Identify, design, and implement internal process improvements: automating manual processes, etc.
• Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS ‘big data’ technologies.
• Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics.
• Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.

Skills

Python

Pyspark

Databricks

AWS/Azure

SQL databases

R

SAS

Statistics

Machine learning

Data engineering

Tools

Databricks

Job description

About UsefulBI

UsefulBI is a leading AI-driven data solutions provider specializing in data engineering, cloud transformations, and AI-powered analytics for Fortune 500 companies. We help businesses turn complex data into actionable insights through our innovative products and services.

Overview

UsefulBI is looking for highly skilled candidates, with expertise in generating power business insights from very large datasets, in this space where the primary aim would be to enable needle moving business impacts through cutting edge statistical analysis. We are looking for passionate data engineers who can envision the design and development of analytical infrastructure which can support strategic and tactical decision-making. The candidate should be well-versed in statistics, R and SAS languages, machine learning techniques, mathematics, and SQL databases.

Experience Required

• 5+ years' Experience in Data Engineering.
• Must have good knowledge and experience in Python.
• Must have good Knowledge of Pyspark.
• Must have good Knowledge of Databricks.
• Must have good experience in AWS/Azure.
• Typically requires relevant analysis work and domain-area work experience.
• Expert in the management, manipulation, and analysis of very large datasets.

Key Responsibilities

• Create and maintain optimal data pipeline architecture.
• Assemble large, complex data sets that meet functional / non-functional business requirements.
• Identify, design, and implement internal process improvements: automating manual processes, etc.
• Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS ‘big data’ technologies.
• Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics.
• Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.