Sr Data Engineer

TechTriad; New York (NY); On-site; USD 110,000 - 140,000; Full time

Job summary

A leading technology firm in New York City is seeking an experienced Data Engineer to build modern data pipelines and platforms. The ideal candidate has over 5 years of experience, skilled in Python, SQL, and AWS services. Responsibilities include optimizing cloud-native analytics and applying best practices in version control and Infrastructure as Code. Excellent communication skills are essential for success in this role.

Qualifications

• 5+ years of experience in data engineering/science.
• Hands-on experience with Python and statistic libraries like pandas.
• Excellent writing and presentation skills.

Responsibilities

• Build modern data pipelines and platforms using AWS services.
• Work on cloud-native analytics to optimize data workflows.
• Leverage open-source tools and ML frameworks for data delivery.

Skills

Python

SQL

AWS services

Data structures

Algorithms

Database management

Visualization tools

Terraform

Education

Bachelor’s degree in a scientific or quantitative discipline

Tools

Tableau

AWS QuickSight

git

Jupyter notebooks

Sublime

VS Code

Job description

Location: New York City, NY, 10001- 3 days onsite

Duration: Full-Time

Overview

The ideal candidate has hands-on experience building modern data pipelines and platforms using Python, SQL, and AWS services such as Glue, Lambda, S3, EMR, Kinesis, and SageMaker. You will work on cloud-native analytics, leveraging open-source tools and machine learning frameworks to optimize data workflows and enhance the delivery of innovative payment and financial solutions. This role requires a strong foundation in data structures, algorithms, and database management, along with proficiency in data visualization tools like Tableau or AWS QuickSight. You’ll also apply best practices in version control, CI/CD, and Infrastructure as Code using Terraform to manage secure and scalable cloud environments.

Responsibilities

• Build modern data pipelines and platforms using Python, SQL, and AWS services (Glue, Lambda, S3, EMR, Kinesis, SageMaker).
• Work on cloud-native analytics to optimize data workflows and support financial solutions.
• Leverage open-source tools and ML frameworks to enhance data delivery and analytics capabilities.
• Apply best practices in version control, continuous integration/continuous deployment, and IaC with Terraform to manage secure cloud environments.

Required Qualifications

• Bachelor’s degree or the equivalent in a scientific or quantitative discipline, such as Mathematics, Engineering, Computer Science, Economics, or Physical Sciences
• 5+ years of experience or equivalent in the data engineering/science field as a programmer, analyst, engineer or scientist
• Hands-on development experience using programming languages, ideally Python, with statistical and data visualization libraries, such as pandas and matplotlib
• Experience with data structures, algorithms and database query languages, such as SQL
• Familiarity using git code repositories and interactive editors, such as Jupyter notebooks, Sublime or VS Code
• Familiarity with cloud services for data management and analysis, such as AWS Glue
• Experience managing a variety of large-scale data sets on Linux, Windows or MacOS
• Excellent writing and presentation skills