Lead Data Engineer - ETL & Distributed Systems

Uplers; United States; Remote; USD 42,000 - 3,500,000; Full time

Job summary

A leading company is seeking a passionate Data Engineer to design, build, and optimize scalable ETL pipelines. The role involves utilizing distributed data processing tools and managing cloud-based data infrastructure to support data-driven decision-making. If you're ready for a new challenge in a great work environment, apply today!

Qualifications

• 3-5 years of experience in data engineering.
• Proficiency in Python and SQL.
• Experience with data warehousing and cloud platforms.

Responsibilities

• Designing and building ETL pipelines using Apache Airflow.
• Managing cloud data infrastructure (AWS, GCP, Azure).
• Collaborating with data scientists and analysts.

Skills

Apache Airflow

Spark

AWS

Kafka

SQL

Job description

Data Engineer

Experience: 3 - 5 Years Exp

Salary: Upto INR 35 Lacs per annum

Preferred Notice Period: Within 30 Days

Shift: 10:30AM to 7:30PM IST

Opportunity Type: Remote

Placement Type: Permanent

(*Note: This is a requirement for one of Uplers' Clients)

Must have skills required: Apache Airflow, Spark, AWS, Kafka, SQL

Good to have skills: Apache Hudi, Flink, Iceberg, Azure, GCP

About the Role: Nomupay, a client of Uplers, is seeking a passionate Data Engineer eager to learn, grow, and deliver exceptional results. The role involves designing, building, and optimizing scalable ETL pipelines, utilizing distributed data processing tools, managing cloud-based data infrastructure, and supporting data-driven decision-making in collaboration with cross-functional teams.

Responsibilities include:

1. Designing and building ETL pipelines using Apache Airflow or similar frameworks.
2. Utilizing Spark (PySpark), Kafka, Flink, or similar tools for distributed processing and real-time streaming.
3. Managing and optimizing cloud data infrastructure (AWS, GCP, Azure).
4. Designing data models ensuring data integrity and performance.
5. Enhancing query performance through indexing, partitioning, and tuning.
6. Managing cloud storage solutions and ensuring data governance and security.
7. Collaborating with data scientists, analysts, and engineers, maintaining documentation.
8. Proficiency in Python, SQL, and additional languages like Java or Scala.
9. Experience with data warehousing, data lakes, and version control tools like Git.

NomuPay is a newly established company providing unified payment solutions, funded by Finch Capital, with acquisitions in Turkey. The company aims to facilitate growth in high-potential markets across Asia, Turkey, and the Middle East.

Application Process:

1. Click on Apply and register or log in on our portal.
2. Upload your updated resume and complete the screening form.
3. Increase your chances of being shortlisted and interview with the client.

About Our Client: At Nomupay, we simplify global payments to help businesses expand seamlessly.

About Uplers: We aim to make hiring and job searching reliable, simple, and fast, helping talents find relevant opportunities and advance their careers.

(Note: Many more opportunities are available on our portal.)

If you're ready for a new challenge and a great work environment, apply today. We look forward to hearing from you!