Data Engineering Architect

Intellidash; United States; Remote; USD 90,000 - 120,000; Full time

Job summary

A leading company in data solutions is seeking a skilled Data Engineer to design and develop data warehouses and pipelines. The ideal candidate will have extensive experience managing large data volumes and optimizing databases. This role offers a work-from-home option and requires occasional travel to the office in Coimbatore.

Benefits

Work from home option

Performance-based bonus

Qualifications

• 5+ years managing data pipelines with large volumes of data.
• 3+ years developing POCs with various technologies.

Responsibilities

• Design and develop Data Warehouse, Data Lake, and ETL processes.
• Ensure data accuracy and integrity through automated quality checks.

Skills

Communication

Problem-solving

Tools

MySQL

SQL Server

AWS

Job description

Role & Responsibilities

Design and development of Data Warehouse, Data Lake, data pipelines, and ETL processes.

Database Management: Manage data and optimize databases.

Ensure data accuracy, integrity, and consistency through automated data quality checks and validation processes.

Database integration with other tools.

Implement industry best practices to ensure data availability and processing efficiency.

Mandatory Skills & Experience

• Experience in setting up and managing data pipelines involving large volumes of data (5+ years)
• Experience in developing POCs with different technologies (3+ years)
• Experience with MySQL or SQL Server (3+ years)
• Experience with AWS products (3+ years)
• Excellent communication skills (English/Tamil)
• Problem-solving and project management skills

Preferred Skills (Good to Have)

• Experience with data processing tools like AWS Glue, AWS Kinesis, Hadoop, Apache Airflow, Informatica, Snowflake, Databricks, Google Cloud Dataflow, etc.
• Experience with BI tools like Tableau, PowerBI, etc.
• Experience working with ERP products like Infor Syteline, Acumatica, SAP, Oracle ERP, NetSuite, Epicor, etc.
• Experience in building IT solutions for the Manufacturing domain
• Experience in Full Stack Development
• Experience in Android app development
• Experience setting up CI/CD pipelines

Additional Information

Benefits:

• Work from home option available
• Performance-based bonus

Location: Coimbatore/Remote. Candidates currently in South who can travel twice a month to the office are preferred.