Senior Data Service Developer

TECHNOLOGY & INNOVATION; New York (NY); On-site; USD 140,000 - 190,000; Full time

Job summary

Office of Technology and Innovation (OTI) in Brooklyn, NY seeks a Senior Data Service Developer to lead data pipeline design, API development, and ETL engineering for city data projects.

You will collaborate across teams, build scalable data solutions, and contribute to security accreditation efforts. The role requires strong Java/SQL/Python skills and cloud experience in AWS/Azure.

Qualifications

• Degree in CS/engineering or related field with 4+ years experience in data / software development.
• Associate degree plus 6 years experience in related area.
• Bachelor's degree plus 8 years experience in related area.
• Equivalent education/experience to one of the above.

Responsibilities

• Create and maintain optimal data pipeline architecture for consolidated data repositories.
• Build analytics tools using the data pipeline to provide actionable insights into engagement and performance.
• Develop new APIs or reuse existing ones for data access and downstream data stores.
• Design, develop, and test repository changes.
• Build ETL infrastructure for diverse data sources using SQL, cloud, and big data tech.
• Develop ETLs to move data securely between systems.
• Contribute to new technology projects and provide operations & maintenance support.
• Troubleshoot errors and system issues.
• Create, update, and maintain system documentation.
• Work with City Cyber Command to pass security accreditation.
• Perform special projects and initiatives.

Skills

Java

SQL

Python

ETL

API development

Spring Boot

RabbitMQ

Web security

Frontend basics

React

Angular

Vue.js

Node.js

Python/Django

ETL tools

Cloud (AWS/Azure)

Docker

Kubernetes

JSON/XML

MDM

Git

Education

Bachelor's degree in CS/engineering/HCI/etc.

Associate degree + 6 years experience

Bachelor's + 8 years experience

Equivalent education/experience

Tools

Informatica PowerCenter

IICS

SSIS

Snowflake

Redshift

Docker

Kubernetes

AWS

Azure

GCP

Git

Job description

The Office of Technology and Innovation (OTI) leverages technology to drive opportunity, improve public safety, and help government run better across New York City. From delivering affordable broadband to protecting against cybersecurity threats and building digital government services, OTI is at the forefront of how the city delivers for New Yorkers in the 21st century. Watch our welcome video to see our work in action, follow us on social media NYCOfficeofTech, and visit www.oti.nyc.gov to learn more.

At OTI, we offer great benefits, and the chance to work on projects that have a meaningful impact on millions of people. You'll have the opportunity to work with cutting-edge technology and collaborate with other passionate professionals who share your drive and commitment to making a difference through technology.

The Office of Data Strategy (ODS) works with City agencies and their data to help serve New Yorkers more equitably and effectively. Historically, this work has mainly taken the form of analyzing agency data to improve City agency operations and working to make Open Data more accessible to all New Yorkers. ODS has also assumed a greater role in determining the direction of the infrastructure that powers non-public data sharing between City agencies, and an expansion of our role in automating data feeds, providing more robust quality assurance, and improving the user experience of the City’s data sharing platforms.

We are seeking a versatile and driven Senior Data Service Developer to join our innovative Integration Services - Data Analytics team. This role ensures the efficient and successful implementation and support of complex data engineering solutions for City agencies. The Senior Data Service Developer should demonstrate a solid understanding of industry-standard implementation methodologies using data engineering technologies, tools, and processes; and will be responsible for developing, supporting and expanding our extensive data products and will collaborate closely with cross-functional teams to translate business requirements into technical implementations that drive our agency’s growth and success.

The Senior Data Service Developer will report to the Director of Integration Services, and work closely with cross-functional teams and ODS office on projects.

Primary responsibilities will include:

• Create and maintain optimal data pipeline architecture that is coherent and scalable, based on best practices of integrating data into a consolidated repository.
• Build analytics tools that utilize the data pipeline to provide actionable insights into customer engagement and experience, operational efficiency, and other key business performance metrics.
• Develop new or build against existing APIs for data access or landing data as output for further downstream consumption in the appropriate target data store.
• Perform the technical design, development, and component testing of repository changes.
• Build the infrastructure required for optimal extraction, transformation, and loading (ETL) of data from a wide variety of data sources using SQL, cloud, and “big data” technologies.
• Develop ETLs to move data securely from source to target systems.
• Contribute to new technology projects as assigned and provide operations & maintenance support for existing applications.
• Troubleshoot errors, defects, and other system issues.
• Create, update, and maintain system documentation.
• Work with City’s Cyber Command unit to pass application security accreditation.
• Perform special projects and initiatives assigned.

HOURS/SHIFT

Day - Due to the necessary technical duties of this position in a 24/7 operation, candidate may be required to work various shifts such as weekends and/or nights/evenings.

WORK LOCATION

Brooklyn, NY

OTI participates in E-Verify

Minimum Qualifications

1. A baccalaureate degree from an accredited college in computer science, engineering, human computer interaction, interactive media, digital and graphics design, data visualization, communication or a related field, and four years of satisfactory full-time experience related to the area(s) required by the particular position and a specialization in a relevant technology, process, methodology and/or domain; or
2. An associate degree from an accredited college in computer science, engineering, human computer interaction, interactive media, digital and graphics design, data visualization, communication or a related field, and six years of satisfactory full-time experience related to the area(s) required by the particular position and a specialization in a relevant technology, process, methodology and/or domain; or
3. A baccalaureate degree from an accredited college, and eight years of satisfactory full-time experience related to the area(s) required by the particular position and a specialization in a relevant technology, process, methodology and/or domain; or
4. Education and/or experience which is equivalent to "1", "2", or "3" above.

Preferred Skills

The ideal candidate will have a passion for both front-end and back-end development, with a keen eye for detail and a commitment to delivering high-quality solutions. An interest and/or understanding of New York City policy and operations or strong policy or operational analysis capabilities is preferred but not required.

The successful candidate should possess the following:

• Bachelor’s degree in computer science, engineering, or a related field.
• 8+ years of experience in Java application development.
• 8+ years of experience in writing SQL and Python
• 8+ years of experience in copying, transferring, manipulating, and automating data operations that were manual processes.
• Experience in developing applications using Java Spring Boot and RabbitMQ
• Solid understanding of web development fundamentals such as HTTP, RESTful APIs, and web security principles.
• Experience with front-end frameworks/libraries (e.g., React, Angular, Vue.js) and proficiency in HTML5, CSS3, JavaScript.
• Proficiency in server-side languages and frameworks (e.g., Node.js, Python/Django).
• Experience with tools and components of data architecture such as Informatica Power Center, IICS, SSIS, or similar ETL tools.
• Experience working with Amazon Web Services or Microsoft Azure cloud computing platform and services.
• Experience with WSDL creation.
• In‐depth knowledge of SQL and other database solutions.
• Experience with data pipelines and warehousing (Snowflake, Redshift etc.).
• Familiarity with cloud platforms (e.g., AWS, Azure, GCP) and containerization technologies (e.g., Docker, Kubernetes).
• Knowledge of modeling database schemas for large datasets. Knowledge of JSON, XML, XSD, WSDL, JDBC, MQ, SOAP concepts
• Experience with tools and components of MDM (Master Data Management).
• Experience developing cloud‑ready applications.
• Proven experience as a Data and Software Developer or in a similar role, with a strong proficiency in both front‑end and back‑end technologies.
• Experience with databases (e.g., SQL, NoSQL) and version control systems (e.g., Git).
• Experience with an agile, iterative development process and version control tools such as Git, GitHub, Subversion.
• Excellent communication skills and the ability to collaborate effectively in a team environment.
• Strong problem‑solving skills and the ability to write clean, maintainable code.
• Knowledge of agile methodologies and DevOps practices.

Public Service Loan Forgiveness

As a prospective employee of the City of New York, you may be eligible for federal loan forgiveness programs and state repayment assistance programs. For more information, please visit the U.S. Department of Education’s website at https://studentaid.gov/pslf/.

Residency Requirement

New York City Residency is not required for this position

Additional Information

The City of New York is an inclusive equal opportunity employer committed to recruiting and retaining a diverse workforce and providing a work environment that is free from discrimination and harassment based upon any legally protected status or protected characteristic, including but not limited to an individual's sex, race, color, ethnicity, national origin, age, religion, disability, sexual orientation, veteran status, gender identity, or pregnancy.