Data Integration Engineer

iitjobs; United States; Remote; USD 80,000 - 120,000; Full time

Job summary

A leading data management company is seeking a qualified Data Engineer to design and implement effective data pipelines, develop ETL processes, and ensure data quality. The ideal candidate will have a Bachelor's in Computer Science and be skilled in integrating data across various platforms, utilizing tools like Databricks and containerization technologies.

Qualifications

• Experience with ETL processes and data integration tools.
• Knowledge of containerization using Docker and Kubernetes.
• Familiarity with SQL and NoSQL databases.

Responsibilities

• Design and implement data pipelines.
• Develop ETL processes.
• Ensure data quality and performance.

Skills

Data Integration Tools

Containerization

Cloud Platforms

Database Management

Education

Bachelor of Computer Science

Job description

Technical/Functional Skills:-
Data Integration Tools/Technologies: Experience with tools for workflow, batch and ETL process using various tools/ tech (Databricks, Kafka, Stream sets, prefect)

Containerization and Orchestration:- Skills in using Docker and Kubernetes for deploying and managing data applications.
Cloud Platforms:- Knowledge of cloud services such as, Google Cloud, and Microsoft Azure for data storage and processing, Integration services.
Database Management:- Experience with both SQL and NoSQL databases, including MySQL, PostgreSQL, MongoDB, and Cassandra
Experience Required:- Well versed with diverse set of technical skills to effectively manage and integrate data across various systems.

Roles & Responsibilities:-
• Design and Implement Data Pipelines:
• Develop ETL Processes:
• Ensure Data Quality:
• Collaborate with Data Teams:
• Optimize Performance:
• Implement Security Measures:

Generic Managerial Skills:- Team Lead Skills
Qualification:- BACHELOR OF COMPUTER SCIENCE