Senior Data Platform Engineer - Cloud & GenAI (Hybrid)

Interactive Brokers; Greenwich (CT); Hybrid; USD 140,000 - 210,000; Full time

Benefits offered by this job

Competitive salary

Bonus

Stock grants

401(k) match

Health benefits

Wellness program

Parental leave

Life insurance

Disability coverage

Education reimbursement

Lunch allowance

Care support

Job summary

Interactive Brokers in Greenwich, CT is seeking a Senior Data Platform Engineer to design, build, and operate a scalable data lake and cloud infrastructure for enterprise data ingestion, governance, and analytics.

You will implement governance via Lake Formation, automate with Terraform, and contribute to GenAI knowledge bases and AI-enabled workflows, while collaborating with data scientists and developers in a hybrid environment.

Qualifications

• 5+ years hands-on data engineering or data platform experience.
• Expertise with AWS services S3, Glue, Athena, EMR.
• Experience with AWS Lake Formation and data governance.
• IaC experience using Terraform.
• Proficient in Python, PySpark on EMR, and SQL.
• Experience with CI/CD and containerization.

Responsibilities

• Design, build, and operate a scalable data lake and infrastructure.
• Implement data governance with fine-grained access control.
• Automate infrastructure provisioning with Terraform.
• Contribute to GenAI knowledge base platform and Python services.
• Build real-time streaming pipelines using Kafka.
• Develop ETL/ELT pipelines for diverse data.
• Monitor and optimize platform performance and cost.
• Collaborate with teams and document standards.

Skills

Python

SQL

Data platform engineering

CI/CD practices

Communication

Tools

AWS S3

AWS Glue

AWS Athena

AWS EMR

Terraform

Kafka

Docker

Git

Airflow

Kubernetes

Job description

Interactive Brokers in Greenwich, CT is seeking a Senior Data Platform Engineer to design, build, and operate a scalable data lake and cloud infrastructure for enterprise data ingestion, governance, and analytics.

You will implement governance via Lake Formation, automate with Terraform, and contribute to GenAI knowledge bases and AI-enabled workflows, while collaborating with data scientists and developers in a hybrid environment.