(1710) Data Engineer - BSTD

The main purpose of this position is to build, maintain and optimise business intelligence (BI) data pipelines that feed from various data systems across the South African Reserve Bank (SARB) and enable the support of Data as a Service (DaaS) to the SARB.

Detailed description

The successful candidate will be responsible for the following key performance areas:

• Implement data service standards and frameworks across the SARB to ensure optimised solutions and adherence to best practice, that is, data operations, development and operations as well as machine learning and operations.
• Take responsibility for BI data pipelines and flows for domain specific analytic implementations across the SARB.
• Ensure understanding of client’s data requirements in order to drive continuous development of data services and address evolving business needs.
• Design and build data pipelines that are robust, modular, scalable, deployable, reproducible and versioned for analytics and reporting purposes.
• Continually monitor and optimise domain specific data pipelines to ensure data availability and optimal long-term performance of data pipelines.
• Perform root cause analysis and implement permanent fixes.
• Maintain SLA adherence for data availability and incident resolution.
• Support releases, deployments and environment stability
• Ensure compliance with SARB Data governance frameworks, Security standards as well as Audit and regulatory requirements.
• Implement new data engineering features.
• Implement data sharing technology services for the SARB, in alignment with the BI and Business Solutions and Technology Department (BSTD) Strategy.
• Implement ingestion from structured, semi-structured and external data sources.
• Diagnose, manage and enhance the performance of BI data marts and warehouses across the SARB by applying data engineering techniques such as distributed computing and data optimisation.
• Resolve data issues across BI data marts, data warehouses and data lakes.
• Implement initiatives to ensure compliance and adherence to security and application standards with respect to all BI data services.
• Identify and manage the mitigation of risks relating to domain-specific BI data services.
• Proactively engage and problem-solve with cross functional stakeholders ‒ from technical data teams to managers ‒ to address their data needs in order to build impactful analytics solutions.
• Provide reporting and recommendations on data service performance, improvements and data availability for domain-specific solutions to management.
• Keep abreast of industry best practices and technologies and lead implementation thereof to optimise effective and efficient data pipelines and services.
• Impart knowledge of the technical environment to other data engineers, systems development, database administrator, infrastructure and enterprise architecture and enterprise information management teams.