Lead Data Engineer

Albert Invent; Maharashtra; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

Albert Invent, a leading Software as a Service company in Maharashtra, is seeking Software Developers with expertise in data engineering. The role involves designing and maintaining ETL pipelines, collaborating with data scientists and engineers, and utilizing cloud platforms. Candidates should have a Bachelor's or Master's degree in Computer Science and at least 5 years of relevant experience. Proficiency in ETL tools, SQL, and programming languages like Python or Java is essential. This is a dynamic opportunity for technology leaders looking to innovate in the healthcare sector.

Qualifications

• 5+ years of hands-on experience as a Data Engineer or in a related data-driven role.
• Strong proficiency in Python, Scala, or Java for data manipulation and pipeline development.
• Experience in data warehousing concepts and building data models (e.g., Snowflake, Redshift).

Responsibilities

• Design, develop, and maintain robust and scalable ETL/ELT pipelines.
• Optimize and manage databases for efficient data storage and retrieval.
• Collaborate with cross-functional teams to provide data solutions.

Skills

Data Engineering

ETL Tools (Apache Airflow, Talend, Informatica)

SQL Databases

NoSQL Databases

Python

Cloud Platforms (AWS, Google Cloud, Azure)

Big Data Frameworks (Hadoop, Spark, Flink)

Education

Bachelor’s or Master’s degree in Computer Science, Information Technology, or related field

Tools

SQL

NoSQL (MySQL, PostgreSQL, MongoDB, Cassandra)

Git

Job description

Brief Description

Job summary: We are a leading Software as a Service (SaaS) company that specializes in the transformation of data in the US healthcare industry through cutting‑edge Artificial Intelligence (AI) solutions. We are looking for Software Developers, who should continually strive to advance engineering excellence and technology innovation. The mission is to power the next generation of digital products and services through innovation, collaboration, and transparency. You will be a technology leader and doer who enjoys working in a dynamic, fast‑paced environment.

Responsibilities

• Design, develop, and maintain robust and scalable ETL/ELT pipelines to ingest and transform large datasets from various sources.
• Optimize and manage databases (SQL/NoSQL) to ensure efficient data storage, retrieval, and manipulation for both structured and unstructured data.
• Collaborate with data scientists, analysts, and engineers to integrate data from disparate sources and ensure smooth data flow between systems.
• Implement and maintain data validation and monitoring processes to ensure data accuracy, consistency, and availability.
• Automate repetitive data engineering tasks and optimize data workflows for performance and scalability.
• Work closely with cross‑functional teams to understand their data needs and provide solutions that help scale operations.
• Ensure proper documentation of data engineering processes, workflows, and infrastructure for easy maintenance and scalability.

Desired Profile

• Bachelor’s or Master’s degree in Computer Science, Information Technology, or a related field.
• 5+ years of hands‑on experience as a Data Engineer or in a related data‑driven role.
• Strong experience with ETL tools like Apache Airflow, Talend, or Informatica.
• Expertise in SQL and NoSQL databases (e.g., MySQL, PostgreSQL, MongoDB, Cassandra).
• Strong proficiency in Python, Scala, or Java for data manipulation and pipeline development.
• Experience with cloud‑based platforms (AWS, Google Cloud, Azure) and their data services (e.g., S3, Redshift, BigQuery).
• Familiarity with big data processing frameworks such as Hadoop, Spark, or Flink.
• Experience in data warehousing concepts and building data models (e.g., Snowflake, Redshift).
• Understanding of data governance, data security best practices, and data privacy regulations (e.g., GDPR, HIPAA).
• Familiarity with version control systems like Git.