Data Engineer / Developer

Amtex Systems Inc; New York (NY); Hybrid; USD 120,000 - 240,000; Full time

Job summary

Amtex Systems Inc is seeking a GM – Service Delivery with a strong focus on data engineering and technology consulting. The ideal candidate will have over 8 years of experience in data acquisition and transformation, and will manage large datasets. This hybrid role in NYC offers a competitive salary and the opportunity to work on impactful data projects within a collaborative team environment.

Qualifications

• 8+ years of experience in data engineering roles.
• Proficiency in SQL and programming languages including Python, Java, or .Net.
• Experience with data pipeline architectures and Big Data technologies.

Responsibilities

• Acquiring and optimizing data from internal and external sources.
• Implementing reliable data ingestion methods.
• Building and maintaining data pipeline architectures.

Skills

Data acquisition

Data transformation

ETL

SQL

Python

Java

.Net

C++

Big Data technologies

Linux and shell scripting

Job description

Get AI-powered advice on this job and more exclusive features.

Direct message the job poster from Amtex Systems Inc

GM - Service Delivery | Client Relations | Technology Consulting | Portfolio Management | Strategy Advisor | Recruitment | Market Research

Location: NYC, NY(Hybrid)

Duration: 12-24+ Months

Key Responsibilities

Primary duties are working in a team of data engineers and data architects to acquire data from internal and external sources, ingest into our repositories, and optimize it for data consumptions by end-users.

• Implementing methods to improve data reliability and quality.
• Combining raw information from different sources to create consistent formats.
• Developing and testing architectures for data extraction and transformation.
• Building and maintaining optimal data pipeline architectures.
• Assembling large and complex data sets, as well as Big Data technologies.
• Ensuring that data is readily available to data scientists, analysts, and other users.

Key Skills:

• 8+ years of experience in developing data acquisition, data ingestion, data transformation, file handling, encryption, sFTP protocol, ETL, ELT workloads on-prem and in the cloud.
• 8+ years of experience in writing SQL queries, database warehousing: normalization, query optimization, store procedures, views, etc.
• 8+ years of experience in Python, Java or .Net or C++ to build scripts, data movement applications and integration APIs.

Desired Qualifications:

• Experience in using:
• Snowflake.
• APIs, containerization, and Kubernetes.
• DevOps: Gitlab CI/ CD pipelines (both YAML and UI based), Gitlab runners, Terraform for CICD.
• Snaplogic.
• Perl/XML.
• DBT, Data Build Tool.
• REST APIs, GraphQL, RPC, gRPC, and Webhooks protocols.
• Linux and shell scripting.
• Designing and implementing event-driven architectures, messaging middleware, and microservices.
• Containerization technologies, such as Docker and Kubernetes, and their deployments options on Azure: Azure Container App, Azure App Service, Azure Container Instances, and Azure Kubernetes Service.
• Best practices for code quality, testing, and performance optimization.
• NoSQL databases.
• AI / ML concepts and implementations.

Seniority level

• Seniority level

  Mid-Senior level

Employment type

• Employment type

  Contract

Job function

• Job function

  Information Technology

• Industries

  IT Services and IT Consulting

Referrals increase your chances of interviewing at Amtex Systems Inc by 2x

Sign in to set job alerts for “Data Engineer” roles.

Brooklyn, NY $120,000.00-$170,000.00 3 weeks ago

New York City Metropolitan Area $150,000.00-$200,000.00 6 days ago

New York, NY $80,000.00-$160,000.00 1 week ago

New York, NY $170,000.00-$240,000.00 4 months ago

New York, NY $130,000.00-$200,000.00 1 month ago

New York, NY $124,000.00-$178,000.00 2 weeks ago

New York, NY $139,500.00-$271,566.94 1 week ago

New York, NY $170,000.00-$250,000.00 2 weeks ago

New York, NY $175,000.00-$230,000.00 2 weeks ago

New York, NY $120,000.00-$132,000.00 1 week ago

New York, NY $90,000.00-$130,000.00 4 months ago

New York, NY $114,000.00-$171,000.00 3 hours ago

Data Engineer III, Go-to-Market Operations

New York, NY $132,600.00-$160,000.00 2 weeks ago

New York, NY $69,661.00-$125,000.00 3 days ago

Software Engineer, Search Infrastructure

New York, NY $220,000.00-$260,000.00 3 days ago

New York, NY $80,000.00-$100,000.00 1 week ago

New York, NY $141,000.00-$202,000.00 1 week ago

New York, NY $220,000.00-$260,000.00 1 week ago

New York, NY $120,000.00-$170,000.00 2 months ago

New York, NY $125,000.00-$160,000.00 2 weeks ago

New York City Metropolitan Area 2 weeks ago

New York, NY $120,000.00-$121,000.00 5 days ago

New York, NY $180,000.00-$230,000.00 1 week ago

New York, NY $139,500.00-$271,566.94 1 week ago

New York, NY $140,000.00-$150,000.00 2 weeks ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.