Data Architect – Big Data Platform (Azure & Databricks) (iOCO0120)

The Data Architect will be responsible for designing, governing, and evolving enterprise-scale data platforms leveraging Microsoft Azure and Databricks technologies. The role focuses on establishing scalable, secure, and high-performing data architectures to support analytics, reporting, machine learning, AI, and business intelligence initiatives.

The successful candidate will define data strategy, architecture standards, data models, integration patterns, and governance frameworks while collaborating with business stakeholders, data engineers, developers, and analytics teams.

What you'll do:

• Data Architecture & Strategy
  • Develop and maintain enterprise data architecture roadmaps.
  • Design modern data platforms utilizing Azure cloud services and Databricks.
  • Define standards and best practices for data ingestion, storage, transformation, and consumption.
  • Create architecture blueprints supporting data warehouse, data lake, and lakehouse environments.
  • Ensure alignment between business objectives and data solutions.
• Azure Data Platform Design
• Design end-to-end cloud data ecosystems using:
• • Azure Data Lake Storage Gen2
    • Azure Databricks
    • Azure Data Factory
    • Azure Synapse Analytics
    • Azure SQL Database
    • Azure Event Hub
    • Azure Service Bus
    • Azure Functions
    • Microsoft Fabric (advantageous)
• Databricks Architecture
  • Design and implement scalable Lakehouse architectures.
  • Define Delta Lake standards and data management practices.
  • Architect data pipelines using:
• • PySpark
    • Spark SQL
    • Delta Live Tables
    • Databricks Workflows
    • Optimize Databricks performance, scalability, and cost efficiency.
• Data Modelling
  • Develop conceptual, logical, and physical data models.
  • Design:
• • Star schemas
    • Snowflake schemas
    • Dimensional models
    • Data Vault models
    • Ensure data consistency across enterprise systems.
• Data Governance & Security
  • Define data governance frameworks and policies.
  • Implement:
• • Data quality standards
    • Metadata management
    • Master Data Management (MDM)
    • Data lineage processes
    • Ensure compliance with:
• • POPIA
    • GDPR
    • Internal security standards
    • Design role-based access control and data security solutions.
• Stakeholder Engagement
• • Work closely with:
    • Business stakeholders
    • Enterprise Architects
    • Data Engineers
    • Data Scientists
    • BI Developers
• Translate business requirements into scalable technical solutions.
• Present architectural recommendations to leadership and technical teams.

Your Expertise:

• Essential
  • 8+ years in Data Architecture, Data Engineering, or Data Platform roles.
  • 5+ years working with Azure cloud technologies.
  • 3+ years architecting Databricks-based solutions.
  • Proven experience designing enterprise-scale data platforms.
  • Experience delivering Data Lake, Data Warehouse, or Lakehouse solutions.
• Preferred
  • Financial Services experience.
  • Telecommunications experience.
  • Retail or eCommerce data platform experience.
  • Experience with real-time streaming data platforms.

Qualifications:

• Minimum
  • Bachelor's Degree in:
  • Computer Science
  • Information Systems
  • Engineering
  • Related discipline
• Preferred
  • Honours Degree or Master's Degree in a technology-related field.

Technical Environment:

• Azure
  • Azure Data Lake Storage Gen2
  • Azure Data Factory
  • Azure Databricks
  • Azure Synapse Analytics
  • Azure SQL
  • Azure Key Vault
  • Azure Active Directory
  • Azure Functions
• Databricks
  • Delta Lake
  • Unity Catalog
  • Spark
  • Spark SQL
  • Delta Live Tables
  • Databricks Workflows
• Programming
  • Python
  • PySpark
  • SQL
  • Scala (advantageous)
• DevOps
  • Azure DevOps
  • Git
  • CI/CD Pipelines
  • Infrastructure as Code

Required Skills:

• Technical Skills
  • Enterprise Data Architecture
  • Cloud Data Architecture
  • Big Data Technologies
  • Lakehouse Architecture
  • Data Modelling
  • Data Governance
  • Metadata Management
  • Data Integration
  • API Integration
  • Streaming Data Architecture
  • Performance Optimization
• Soft Skills
  • Strategic thinking
  • Stakeholder management
  • Communication skills
  • Problem-solving ability
  • Leadership and mentoring
  • Business acumen

Other information applicable to the opportunity:

• Contract position
• Location: Johannesburg

Why work for us?

Want to work for an organization that solves complex real-world problems with innovative software solutions? At iOCO, we believe anything is possible with modern technology, software, and development expertise. We are continuously pushing the boundaries of innovative solutions across multiple industries using an array of technologies.?

You will be part of a consultancy, working with some of the most knowledgeable minds in the industry on interesting solutions across different business domains.?

Our culture of continuous learning will ensure that you will have all the opportunities, tools, and support to hone and grow your craft.?

By joining IOCO you will have an open invitation to developer inspiring forums. A place where you will be able to connect and learn from and with your peers by sharing ideas, experiences, practices, and solutions.?