Lead Developer

Intercontinental Exchange Holdings, Inc.; Atlanta (GA); On-site; USD 100,000 - 150,000; Full time

Job summary

Intercontinental Exchange, Inc. seeks a Lead Developer to enhance a dynamic data platform for mortgage data. This full-time role demands expertise in big data technologies, effective leadership, and collaboration with stakeholders to align strategies. Ideal candidates should possess advanced programming skills, innovative problem-solving capabilities, and a commitment to mentoring team members.

Qualifications

• Proven experience in big data architectures.
• Advanced programming and scripting skills.
• Experience with cloud-based data solutions.

Responsibilities

• Designing and developing a robust big data platform.
• Promoting innovation and ensuring operational excellence.

Skills

Python

SQL

Apache Spark

Hadoop

Kafka

AWS

Azure

Google Cloud Platform

Data Privacy

Agile Methodology

Docker

Kubernetes

Job description

Overview

Job Purpose

Intercontinental Exchange, Inc. (ICE) presents an opportunity for a full-time Lead Developer to our dynamic team dedicated to building and enhancing a robust data platform for processing and managing both structured and unstructured mortgage data using AI. In this role, the candidate will play a pivotal part in designing, developing, and maintaining scalable data solutions that drive business insights and operational efficiency. The ideal candidate will have a proven track record in architecting and implementing sophisticated data systems, utilizing the latest advancements in big data management, modern database technologies, and a variety of programming and scripting languages.

This position demands advanced technical proficiency, innovative problem-solving capabilities, leadership qualities, and the ability to mentor and guide team members effectively. Exceptional professionalism, proactive collaboration, and outstanding communication skills are essential. The candidate will actively engage and influence diverse stakeholders across the organization to align technical solutions with strategic business objectives. Strong written and verbal communication skills are imperative, given the candidate's responsibility to articulate complex technical concepts clearly and persuasively to both technical and non-technical audiences.

Responsibilities

The candidate will serve as a Lead Developer within our technical team, responsible for:

• Designing, developing, and overseeing a robust big data platform.
• Promoting innovation, ensuring operational excellence, and enhancing scalability across enterprise environments.

Knowledge and Experience

• Deep understanding of designing and implementing scalable, high-performance big data architectures that support both structured and unstructured data processing.
• Proven experience in building, deploying, and optimizing data platforms for large-scale data ingestion, storage, processing, and analytics.
• Advanced programming and scripting skills in Python, Shell scripting, and SQL.
• Expertise in Apache Spark, Hadoop, and Kafka for large-scale data processing and real-time data streaming.
• Proficiency with data catalog tools like AWS Glue, Apache Atlas, or Unity catalog for metadata management and data discovery.
• Hands-on experience with AWS, Azure, or Google Cloud Platform for deploying and managing cloud-based data solutions.
• Experience with Jupyter Notebooks, Pandas, and data visualization tools for data exploration and analysis.
• Knowledge of Docker, Kubernetes, and CI/CD pipelines for scalable deployment and automation.
• Strong knowledge of both relational (e.g., PostgreSQL, MySQL) and NoSQL (e.g., MongoDB, Cassandra) databases.
• Understanding of data privacy, compliance standards, and best practices for securing sensitive data.
• Experience working in Agile teams comprised of 5-8 cross-skilled engineers.
• Solid understanding of version control tools (ideally Git).
• Experience beyond using open-source tools as-is, and writing custom code on top of, or in addition to, existing open-source frameworks.
• Knowledge of continuous integration and continuous deployment (CI/CD) pipelines.
• Experience in an applied R&D environment, working in an agile and innovation-lab culture.
• Exceptional problem-solving skills and strategic thinking capabilities.
• Proven leadership abilities, including mentoring and guiding technical teams.
• Excellent written and verbal communication skills.
• Ability to effectively collaborate with and influence diverse stakeholders and teams to align technology solutions with business objectives.

Preferred Skills

• Familiarity with traditional AI techniques alongside modern Generative AI technologies.

#LI-MA1

----------

Intercontinental Exchange, Inc. is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to legally protected characteristics.