Data Engineer 2

Talentboon Consulting; United States; Remote; USD 100,000 - 130,000; Full time

Job summary

A leading consulting firm seeks a highly skilled Data Engineer II with 6+ years of experience, specifically in data engineering and software development. You will be responsible for designing scalable ETL pipelines and developing solutions in the AWS Data Ecosystem, leveraging technologies like Snowflake and Databricks.

Qualifications

• 6+ years of experience with at least 4 years in data engineering.
• Proficiency in building scalable data solutions.
• Experience with Big Data technologies and cloud platforms.

Responsibilities

• Design, build, and optimize scalable ETL pipelines.
• Write and optimize complex SQL queries for large datasets.
• Develop data solutions using the AWS Data Ecosystem.

Skills

ETL

Big Data technologies

SQL

Python

Java

Scala

Linux command-line tools

Data lineage

Data quality

Data observability

Tools

Snowflake

Databricks

AWS Data Ecosystem

PostgreSQL

Job description

Job Title: Data Engineer II

Experience: 6+ Years

Location: Remote (India)

Job Type: Full-time

Job Description:

We are looking for a highly skilled Data Engineer II with 6+ years of experience, including at least 4 years in data engineering or software development. The ideal candidate will be well-versed in building scalable data solutions using modern data ecosystems and cloud platforms.

Key Responsibilities:

• Design, build, and optimize scalable ETL pipelines.
  
• Work extensively with Big Data technologies like Snowflake and Databricks.
  
• Write and optimize complex SQL queries for large datasets.
  
• Define and manage SLAs, performance benchmarks, and monitoring systems.
  
• Develop data solutions using the AWS Data Ecosystem, including S3, Lambda, and more.
  
• Handle both relational (e.g., PostgreSQL) and NoSQL databases.
  
• Work with programming languages like Python, Java, and/or Scala.
  
• Use Linux command-line tools for system and data operations.
  
• Implement best practices in data lineage, data quality, data observability, and data discoverability.
  

Preferred (Nice-to-Have):

• Experience with data mesh architecture or building distributed data products.
  
• Prior exposure to data governance frameworks.