Data Engineer, Senior

Blackbaud; Hyderabad; On-site; INR 2,000,000 - 3,500,000; Full time

Job summary

Blackbaud seeks a Senior Data Engineer in Hyderabad to design, build and operate high-volume data pipelines powering data intelligence and analytics products. You will implement scalable data ingestion, transformation and orchestration, and mentor junior engineers in a fast-paced IECO team.

You will collaborate with product managers, software engineers and data scientists, apply TDD/CI/CD, and ensure data security and governance while exploring AI-assisted tooling to improve delivery and quality.

Qualifications

• 5+ years of data engineering experience.
• Experience with Spark, Databricks, Delta lakes, Hive.
• Proficiency in Python, Scala or Java (prefer Python).
• Hands-on cloud/PaaS experience in Azure preferred.
• Knowledge of data governance and security practices.

Responsibilities

• Design, develop and operate high performance, large volume data structures for data-powered products and data science.
• Implement efficient, distributed and scalable pipelines and integrate data from multiple sources to create data products.
• Implement design patterns for data ingestion, movement, transformation, and aggregation.
• Collaborate with product managers, software engineers, and data scientists to achieve key results.
• Build production-grade code, test and deploy data pipelines.
• Undertake complex tasks large in scope and critical in nature.
• Design and develop breakthrough data products and architectures to expand business.
• Participate in code reviews and mentor junior engineers.
• Work in a fast-paced agile environment and support sprint commitments.
• Leverage AI-assisted tools to accelerate delivery and improve quality.

Skills

Data engineering

Big data processing

Python

Scala/Java

CI/CD

Testing practices

Tools

Spark

Databricks

Delta lakes

Hive

Azure DevOps

Job description

Data Engineering at Blackbaud is responsible for ingestion, transformation and processing of data that powers Blackbaud Data Intelligence and Advanced analytics products. The data managed by the team supports data science, data enrichment, research and data analysis as well as making data operationally able to be consumed by Blackbaud's products and services. As a Senior Data Engineer, you will take responsibility for technical design, implement complex features and provide mentorship in the Data Engineering discipline of Infrastructure Engineering & Cloud Operations (IECO). You build data intensive solutions that are highly available, scalable, reliable, secure, and cost-effective. You contribute to our common code repositories; help establish and enforce coding standards for data engineering teams.

What will You be doing:

• Design, develop and operate high performance, large volume data structures for data-powered products and data science.
• Implement efficient, distributed and scalable pipelines and integrate data from multiple sources to create data products
• Implement design patterns that support data ingestion, data movement, transformation, aggregation, and much more.
• Collaborate with Product managers, Software engineers, and Data Scientists, and work towards achieving key results.
• Build high quality production level code, test and deploy data pipelines
• Undertake complex tasks that are large and diverse in scope and/or critical in nature
• Design and develop breakthrough products, services or technological advancements that expand our business
• Participate in code reviews, brainstorm design approaches with peers and mentor junior engineers
• Work in fast paced agile environment, participate in scrum ceremonies and help ensure that the team meets sprint commitments.
• Leverage AI-assisted tools to accelerate delivery and improve quality and actively experiment with emerging capabilities as they evolve.

What you'll bring:

• Have 5+ years of data engineering experience
• Experience with big data technologies such as Spark, Databricks, Delta lakes, Hive, etc.
• 4+ years of experience in core languages such as Python, Scala or Java (Preferably Python)
• Hands-on experience leveraging PaaS offerings in a public cloud environment (Azure preferred)
• Experience with Big Data design patterns and distributed computing tools/frameworks
• Proven expertise building big data pipelines (batch processing, real-time streaming)
• Working knowledge of TDD, CI/CD concepts and tools (Preferably Azure DevOps)
• Advanced understanding of unit testing/integration testing/QA/Validation
• Knowledge of data security and authentication protocols
• Experience in areas of data governance, privacy and regulation and professional experience with architectural approaches to data security
• Have experience integrating multiple data sources into a common set of data assets

Stay up to date on everything Blackbaud, follow us on Linkedin, X, Instagram, Facebook and YouTube Blackbaud powers social impact through purpose-driven technology and responsible AI. Guided by our Intelligence for Good® vision, we're building a culture where innovation, trust, and human expertise come together to help organizations make a greater difference in the world.

Blackbaud is proud to be an equal opportunity employer and is committed to maintaining an inclusive work environment. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, physical or mental disability, age, or veteran status or any other basis protected by federal, state, or local law.

Blackbaud (NASDAQ: BLKB) is the world's leading cloud software company powering social good. Serving the entire social good community - nonprofits, foundations, corporations, education institutions, healthcare institutions and individual change agents - Blackbaud connects and empowers organizations to increase their impact through software, services, expertise, and data intelligence. The Blackbaud portfolio is tailored to the unique needs of vertical markets, with solutions for fundraising and CRM, marketing, advocacy, peer-to-peer fundraising, corporate social responsibility, school management, ticketing, grantmaking, financial management, payment processing, and analytics. Serving the industry for more than three decades, Blackbaud is headquartered in Charleston, South Carolina and has operations in the United States, Australia, Canada, and the United Kingdom.