Senior Solutions Consultant - Open Data Platform

Acceldata

Kitchener

On-site

CAD 120,000 - 170,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Acceldata seeks a Senior Solutions Consultant to own Open Data Platform (ODP) deployments, guiding customer infrastructure, security and governance teams.

This hands-on role blends architect, engineer and advisor duties: design the target-state cluster, execute the build, and translate trade-offs into terms stakeholders can act on. You’ll work with Ambari, Kerberos, Ranger, LDAP and data-management concepts to deliver a secure, scalable platform in complex data environments.

Qualifications

  • Deep architectural knowledge of the Apache Hadoop ecosystem (HDFS, YARN, Hive, ZooKeeper).
  • Strong Linux system administration on RHEL and/or Ubuntu, with a real command of network configuration and tuning.
  • Practical experience with enterprise security: Kerberos (KDC), SSL/TLS, LDAP/AD and Apache Ranger.
  • Comfort operating within Java and Python runtimes for configuration and troubleshooting.
  • Excellent communication skills to explain trade-offs to engineers and stakeholders.

Responsibilities

  • Own cluster architecture and end-to-end deployment using Ambari, defining topology and node placement.
  • Prepare and harden infrastructure including OS prerequisites, firewall rules, SELinux and tuning.
  • Deliver secure and air-gapped deployments inside firewalled data centres with trusted proxies.
  • Integrate backend databases (Oracle, PostgreSQL, MySQL/MariaDB) including schemas and JDBC drivers.
  • Extend ecosystem with Ambari Management Packs (Spark, Kafka, NiFi, etc.).
  • Implement enterprise security end-to-end: Kerberos integration, Ranger policies, SSL/TLS management, LDAP/AD integration.

Skills

Hadoop knowledge
Ambari
Linux admin
Security
Java/Python/Scala

Tools

Ambari
Oracle
PostgreSQL
MySQL/MariaDB

Job description

About the Role: We are looking for a Senior Solutions Consultant with deep Hadoop knowledge and strong enterprise presence.

You’ll be the principal technical owner of ODP (open data platform) deployments - responsible not just for standing up the platform, but for guiding a customer’s infrastructure, security and database teams to the right architectural decisions, and for making those decisions stick in environments where security and change control are non-negotiable.

This is a hands-on role with a consultative position. You’ll be equal parts architect, engineer and trusted advisor: designing the target-state cluster, executing the build, and translating hard technical trade-offs into terms a customer’s stakeholders can act on. You are the person the customer relies on to get a secure, scalable platform right the first time.

What we look for:
  • Own cluster architecture and deployment. Lead end-to-end deployment of Acceldata ODP managed via Apache Ambari. Define cluster topology - master, slave and client node placement - sized to the customer’s workload and infrastructure.
  • Prepare and harden infrastructure. Advise on and execute OS-level prerequisites on RHEL or Ubuntu: password-less SSH, DNS/NTP, firewall (iptables) rules, SELinux and PackageKit handling, and system tuning such as umask and open file descriptors.
  • Deliver secure and air-gapped deployments. Design and implement installations inside firewalled and air-gapped data centres using local mirror repositories or trusted HTTP proxy servers, working within the customer’s change-control and compliance constraints.
  • Integrate backend databases. Provision and configure operational databases (Oracle, PostgreSQL, or MySQL/MariaDB), including schemas, users and JDBC drivers for core services - Ambari, Hive, Spark, Ranger and Schema Registry.
  • Extend the ecosystem via mpacks. Install, configure and troubleshoot components through Ambari Management Packs - Spark, Kafka, Flink, NiFi, Ozone, Airflow, Trino, ClickHouse, JupyterHub and MLflow.
  • Implement enterprise security. Stand up cluster security end-to-end: Kerberos integration, Apache Ranger authorization policies, SSL/TLS certificate management, LDAP/AD integration, and secure credential handling (e.g. obfuscating LDAP bind passwords via the Ambari Credential Store / JCEKS).
  • Advise and enable the customer. Run working sessions with the customer’s infrastructure, security and DBA teams; document target-state architecture and handover runbooks; and coordinate with Acceldata engineering and account teams to unblock issues and drive long-term adoption.
  • 8+ years of experience in customer-facing product implementation , designing and deploying performant end-to-end data architectures, and solving complex migrations and deployments.
  • Comfortable writing code in either Java, Python or Scala.
  • Consult on design and architecture; implement strategic customer projects that lead to customers’ successful understanding, evaluation, and adoption of Acceldata Data Observability Cloud.
  • Good understanding of Data management concepts like Data Quality, Data Catalog and Data Governance.
Must-Have Qualifications
  • Deep architectural knowledge of the Apache Hadoop ecosystem (HDFS, YARN, MapReduce, Hive, ZooKeeper).
  • Strong Linux system administration on RHEL and/or Ubuntu , with a real command of network configuration, firewall rules and system tuning.
  • Practical experience with enterprise security: Kerberos (KDC), SSL/TLS, LDAP/AD and Apache Ranger.
  • Comfort operating within the platform’s runtime stack (Java and Python) for configuration and troubleshooting.
  • Excellent communication skills - able to explain hard technical trade-offs clearly to both engineers and senior stakeholders - and the autonomy to drive complex work with little supervision.
Strongly Preferred (Great Foundation)
  • Extensive experience managing Cloudera (CDH/CDP) or Hortonworks (HDP) distributions - this maps to an excellent foundation for the role.
  • Familiarity with several of the mpack components above (Spark, Kafka, NiFi, Trino, Ozone, MLflow, etc.) rather than all.
  • Experience delivering into regulated, secured or air-gapped environments.
  • Strong desire to tackle hard technical problems in Kubernetes; proven ability to do so with little or no direct daily supervision.
  • Ability to quickly learn new technologies and willingness to support working in different time zones, and may be required to travel up to 50% of the time to meet with customers.
  • Prior customer-facing / professional-services or consulting experience in enterprise environments.

You’ll work on genuinely hard problems for some of the most demanding data organisations in the world, with the autonomy to own an engagement end-to-end and the visibility that comes with being the customer’s principal technical partner. If you enjoy the moment a complex, secured cluster comes up clean, and the customer’s team trusts what you’ve built - this is that job.

Acceldata has been named to Forbes’ America’s Best Startup Employers for two consecutive years, recognised on CRN’s Big Data 100 for data observability and DataOps, and named a Leader in Everest Group’s Data Observability PEAK Matrix.

Above all, Acceldata has a people-first culture; you get full ownership of real, high-impact problems from day one.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Software Engineer - Open Data Platform (ODP)
Senior Software Engineer - Open Data Platform (ODP)

The Consensus • Kitchener

On-site
CAD 139,000 - 194,000
PTO with unlimited negative balance
RRSP plan
Employer-paid health, dental, vision
Principal Engineer - Open Source Data Platform (ODP)
Principal Engineer - Open Source Data Platform (ODP)

The Consensus • Kitchener

On-site
CAD 291,000 - 333,000
PTO with unlimited negative balance
RRSP plan
Employer-paid health, dental, vision
+3
Product Specialist (Cloud Support SME)
Product Specialist (Cloud Support SME)

Acceldata Inc • Kitchener

On-site
CAD 130,000 - 190,000
Unlimited PTO
RRSP plan
Health, dental, and vision coverage
+3
Staff Engineer - Open Source Data Platform (ODP)
Staff Engineer - Open Source Data Platform (ODP)

The Consensus • Kitchener

Hybrid
CAD 250,000 - 291,000
Manager, Global Practice and Delivery (Solutions & Services)
Manager, Global Practice and Delivery (Solutions & Services)

Acceldata • Kitchener

Hybrid
CAD 150,000 - 190,000
Manager, Global Practice and Delivery (Solutions & Services)
Manager, Global Practice and Delivery (Solutions & Services)

Acceldata • Toronto

On-site
CAD 180,000 - 240,000
Staff Software Engineer
Staff Software Engineer

Acceldata • Kitchener

On-site
CAD 140,000 - 200,000
Product Specialist (Cloud Support SME)
Product Specialist (Cloud Support SME)

Acceldata • Cambridge

On-site
CAD 90,000 - 130,000
Field Engineering Co-Op
Field Engineering Co-Op

Acceldata • Kitchener

On-site
CAD 27,552 - 41,328
Apple Mac Equipment
Catered lunch once a week
Gym with onsite showers
+3
Data Architecture\\Consultant Lead
Data Architecture\\Consultant Lead

Accenture PLC • Toronto

Hybrid
CAD 109,000 - 220,000
Hybrid work model