Data Engineer

Innorev Technologies Inc; Dallas (TX); On-site; USD 90,000 - 120,000; Full time

Job summary

Innorev Technologies Inc is seeking a Data Engineer with strong experience in Azure Databricks and Python/PySpark to design and optimize data pipelines. You will develop scalable ETL/ELT workflows and support secure data transfers using FTP/SFTP, while leveraging AWS services for processing and storage.

Ideal candidates will have hands-on expertise with data transformation, cleansing, validation, and quality checks, and collaborate closely with data architects, engineers, and stakeholders to

Qualifications

• Must-have Azure Databricks, Python/PySpark, AWS, FTP/SFTP, SQL and ETL skills.
• Experience in building and maintaining data pipelines and integration workflows.
• Strong understanding of data quality, transformation and validation practices.

Responsibilities

• Develop and maintain scalable ETL/ELT data pipelines using Databricks.
• Build and support FTP/SFTP integrations for data ingestion and transfers.
• Work with AWS cloud services for data processing, storage, and integration.

Skills

Azure Databricks

Python/PySpark

AWS

FTP/SFTP

SQL

ETL

Job description

• Seeking a Data Engineer with strong experience in Azure Databricks and Python/PySpark.
• Develop and maintain scalable ETL/ELT data pipelines using Databricks.
• Build and support FTP/SFTP integrations for data ingestion and transfers.
• Work with AWS cloud services for data processing, storage, and integration.
• Perform data transformation, validation, cleansing, and quality checks.
• Troubleshoot pipeline failures, integration issues, and production defects.
• Collaborate with data architects, engineers, and business stakeholders.
• Must Have: Azure Databricks, Python/PySpark, AWS, FTP/SFTP, SQL, and ETL.