Data Engineer

Gotham Technology Group; New York (NY); On-site; USD 60,000 - 90,000; Full time

Job summary

Gotham Technology Group is seeking a Junior Data Engineer to help build the foundation behind analytics and AI. You’ll work alongside data scientists and analysts, supporting production workflows from the lab to users. The role focuses on data pipelines, data quality, and scalable data platforms in a collaborative team.

The position emphasizes hands-on experience with Python and SQL, cloud tooling, and modern data architectures, with growth toward MLOps and AI platform responsibilities.

Qualifications

• Degree in Computer Science, Engineering, Information Systems, or similar field.
• 1 to 3 years in data engineering, DataOps, or MLOps.
• Strong Python and SQL foundations with ETL/ELT experience.
• Experience on Snowflake, Databricks, or equivalent platforms.
• Working knowledge of AWS or other cloud providers.
• Exposure to Kubernetes or container orchestration.
• Understanding of data warehouses, lakes, and modern architecture.
• Proficiency with Git and clean development practices.

Responsibilities

• Write and improve ETL/ELT jobs moving data into warehouses and data lakes.
• Shape data models and tune performance on Snowflake/Databricks or similar.
• Automate data ingestion, cleaning, and downstream flow.
• Add checks and monitoring to ensure data trust and early issue detection.
• Run workloads on AWS and containerized services on Kubernetes.
• Troubleshoot production issues and support reliability.
• Help data scientists deploy models and monitor performance and data drift.
• Utilize MLOps tools to organize model lifecycles.
• Participate in code reviews, testing, documentation, and CI/CD.

Skills

Python

SQL

ETL/ELT pipelines

Snowflake/Databricks

AWS

Kubernetes

Data warehouse architecture

Git

Education

Bachelor's or related degree

Tools

Airflow

Dagster

Prefect

Terraform

CloudFormation

Docker

Job description

Junior Data Engineer, Data Platform and MLOps

A growing data team is hiring an early-career Data Engineer to help build the foundation behind its analytics and AI work. If you have a couple of years of pipeline experience under your belt and want to get closer to how machine learning actually runs in production, this is a strong next step. You’ll sit alongside data scientists, analysts, and business partners, and your work will directly shape how models and AI tools get from the lab into everyday use.

A Typical Week Might Include

• Writing and improving ETL/ELT jobs that move both structured and semi-structured data into the warehouse and lake.
• Shaping data models and tuning performance on Snowflake, Databricks, or a similar platform.
• Automating how data comes in, gets cleaned up, and flows downstream.
• Adding checks and monitoring so the team can trust the data and catch problems early.
• Running and supporting workloads on AWS (Azure or GCP is fine too), including containerized services on Kubernetes.
• Jumping in to troubleshoot when something breaks in production.
• Helping data scientists package and deploy models, then keeping an eye on model performance, data drift, and service health afterward.
• Using MLOps tools like MLflow, SageMaker, or Kubeflow to keep the model lifecycle organized.
• Taking part in code reviews, testing, documentation, and CI/CD, and suggesting ways to make the platform more stable and secure.

Must Haves

• A degree in Computer Science, Engineering, Information Systems, or something close.
• Roughly 1 to 3 years working in data engineering, DataOps, MLOps, or a related area.
• Solid Python.
• Solid SQL, with experience making queries and databases run faster.
• Real experience building and supporting ETL/ELT pipelines.
• Time spent on Snowflake, Databricks, or a comparable data platform.
• Working experience in AWS or another major cloud.
• Exposure to Kubernetes or a similar container orchestration tool.
• A good grasp of how warehouses, lakes, and modern data architectures fit together.
• Day-to-day comfort with Git and clean development practices.

Nice to Haves

• You’ve helped deploy or support AI/ML applications in production.
• You’ve worked with LLMs or generative AI, such as inference endpoints or plugging AI services into applications.
• You’ve used ML lifecycle tools like MLflow, Kubeflow, SageMaker, or Databricks ML.
• You’ve built workflows in Airflow, Dagster, or Prefect.
• You know your way around Docker.
• You’ve touched CI/CD pipelines or Infrastructure as Code with Terraform or CloudFormation.
• You’ve used monitoring tools such as Prometheus, Grafana, CloudWatch, or Datadog.
• Bonus points for Kafka or other streaming experience.

The Right Fit

You’ve got the data engineering basics down and you’re genuinely excited to grow into MLOps, AI platform work, and keeping AI applications running smoothly in production.