hiring For Data engineer_ Immediate Joiner_ Bangalore

Acesoft Labs; Bengaluru; Hybrid; INR 1,400,000 - 2,000,000; Full time

Job summary

Acesoft Labs is seeking a Data Engineer to design, build, and maintain scalable data pipelines in Bengaluru. You will develop ETL processes to load data into the data warehouse, ensuring quality and consistency across sources.

You will collaborate with stakeholders, data scientists and analysts to translate requirements into robust technical solutions, while optimizing performance and upholding governance and security practices.

Qualifications

• 4+ years of experience as a Data Engineer.
• Bachelors in technology with Agile/Scrum exposure.
• Proficient in Python or Java and building data pipelines.
• Experience with cloud data warehousing tech (Snowflake/Redshift).
• Knowledge of SQL, Hive, and data governance practices.

Responsibilities

• Design, build and maintain scalable data pipelines for structured and unstructured data.
• Develop ETL processes to load data into data warehouse with quality checks.
• Collaborate with stakeholders, report developers and data scientists to translate data needs into solutions.
• Optimize performance and efficiency of data infrastructure and processes.
• Implement data governance, security and privacy best practices; troubleshoot issues promptly.

Skills

Python

Java

Data pipelines

SQL

Hive

Education

Bachelor's degree in technology

Tools

Snowflake

Redshift

Cloudera

Apache Hadoop

Spark

AWS

Azure

GCP

Docker

Kubernetes

GitLab

Bitbucket

Airflow

Jenkins

Tableau

Power BI

Great Expectations

DataHub

Kafka

Job description

Job Description

Primary Responsibilities:

Design, build and maintain scalable and reliable data pipelines to process large volumes of structures, semi-structured and unstructured data from diverse sources.

Develop ETL processes to ingest, transform and load data into data warehouse, ensuring data quality, integrity and consistency.

• Collaborate with business stakeholders, report developers and data scientists to understand data requirements and translate then into technical solutions for various business purposes.
• Optimize performance and efficiency of data infrastructure and processes, including data storage, processing and querying.
• Implement data governance policies and best practice to ensure compliance, security and privacy of sensitive data.
• Troubleshoot data issues, identify root cause and implement solutions in timely manner.
• Excellent communication and collaboration skills, with the ability to work effectively in a cross-functional team environment.

Basic Qualifications

We are looking for candidate with 4+ years of experience in a Data Engineer role and has attained bachelors degree in technology and has experienced with Agile/Scrum development process and methodologies.

• Experience as a Data Engineer with strong track record of designing and implementing data solutions.
• Experience in programming language as Python or Java, with experience in building data pipelines and workflows.
• Experience with cloud data warehousing technologies, such as Snowflake and Redshift.
• Experience with distributed computing frameworks such as Cloudera, Apache Hadoop and Spark.
• Experience with Cloud platforms such as AWS, Azure or Google Cloud Platform.
• Experience with AWS cloud services, such as S3, EC2, EMR, Glue, CloudWatch, Athena, Lambda.
• Experience with containerization and orchestration technologies, such as Docker and Kubernetes.
• Experience with building CI/CD pipeline using tools, has GitLab and Bitbucket.
• Experience with data pipeline orchestration tools, such as Airflow and Jenkins.
• Knowledge of database concepts, data modelling, schemas and query languages, SQL and Hive.
• Knowledge of data visualization and reporting tools, such as MicroStrategy, Tableau and Power BI.
• Knowledge of data quality and monitoring techniques and tools, such as Great Expectations or similar.
• Knowledge of data governance processes, lineage, cataloging, dictionaries using tools, such about using DataHub or similar.
• Knowledge of streaming data processing and real-time analytics technologies, such as Kafka.
• Retail experience is a plus. Role & responsibilities