Associate Data Engineer - R01571250

Brillio; Bengaluru; On-site; INR 500,000 - 1,000,000; Full time

Job summary

Brillio is seeking an Associate Data Engineer to join our Bengaluru team. The role focuses on ingesting manufacturing and life sciences data into enterprise data lakes and analytics platforms using AWS services and Databricks.

You will configure ingestion frameworks, mappings, and metadata, validate data quality, and troubleshoot production pipelines. Collaboration with teams for data integration from SharePoint, OneDrive, SFTP, LIMS, and MES/EMES will be important, with documentation and

Qualifications

• Entry-level role with 0–2 years of AWS data engineering experience.
• Experience in manufacturing or life sciences data environments preferred.
• Hands-on data ingestion into data lake and analytics platforms using AWS.
• Configure ingestion frameworks, mappings and metadata definitions.
• Perform data validation, quality checks and troubleshoot pipelines.
• Integrate data from SharePoint, OneDrive, SFTP, LIMS and manufacturing systems.
• Assist in developing automation for document processing and data extraction with AWS tools.
• Create technical documentation and SOPs.

Responsibilities

• Manage manufacturing data ingestion into enterprise data lakes and analytics platforms using AWS services.
• Configure and maintain data ingestion frameworks, mappings, and metadata definitions.
• Perform data validation and quality checks, troubleshoot issues in production pipelines.
• Integrate data from sources such as SharePoint, OneDrive, SFTP, LIMS, and manufacturing systems.
• Assist in developing automation solutions for document processing and data extraction with AWS tools.
• Support analytics platforms by enabling efficient data access and pipeline performance.

Skills

Python

SQL

Data engineering

ETL pipeline development

Data quality and validation

Data integration in cloud environments

Education

Bachelor's degree in Computer Science, Information Technology, Data Engineering, or a related field

Tools

Databricks

AWS S3

AWS Lambda

SharePoint

OneDrive

SFTP

Job description

Associate Data Engineer

Primary Skills

• Athena, SNS, SQS, CloudWatch, Kinesis, Redshift

Specialization

• AWS Data EngineerIng Advanced: Associate Data Engineer

Job requirements

• Experience Range: Entry-level role with at least 0 to 2 years of hands-on experience in AWS data engineering, ideally including exposure to manufacturing or life sciences data environments. Key Responsibilities: 1. Manage manufacturing data ingestion into enterprise data lake and analytics platforms using AWS services. 2. Configure and maintain data ingestion frameworks, mappings, and metadata definitions. 3. Perform data validation, quality checks, and troubleshoot issues in production data pipelines. 4. Integrate data from sources such as SharePoint, OneDrive, SFTP, LIMS, and manufacturing systems. 5. Assist in developing automation solutions for document processing and data extraction with AWS tools. 6. Support analytics platforms by enabling efficient data access and pipeline performance. 7. Create and maintain technical documentation, SOPs, and knowledge-transfer materials. Required Skills: 1. Python 2. SQL 3. Databricks 4. AWS S3 5. AWS Lambda 6. Data engineering and ETL pipeline development 7. Data quality and validation 8. Data integration in cloud environments Preferred Skills: 1. AWS Textract or OCR technologies 2. Experience with Life Sciences or Pharmaceutical domain data 3. Familiarity with LIMS and Manufacturing Execution Systems (MES/EMES) 4. Experience in enterprise data lake environments Desired Qualifications: 1. Bachelor's degree in Computer Science, Information Technology, Data Engineering, or a related field 2. Completion of relevant AWS or Databricks training courses (certification preferred but not required) Additional Information: Project tenure is 1 year with potential extension.