Senior Data Engineer

4 weeks ago

Johannesburg, Gauteng, Saudi Arabia Hollard Insurance Full time

Job Advert Summary

This person will design, development and maintain appropriate processes to extract the appropriate data from mainly off-platform data sources at the appropriate frequency and using the appropriate technologies and rules to enable access to data for reporting and data analysis.

This person will also assist with the development of short, medium and long-term data management strategies, paying due consideration to the HLS data strategy. Key considerations in this regard are the implementation of the off-Platform Operational Data Store, Setup of Cloud technologies and the HLS Data Warehouse/Lake.

Key Responsibilities:

Project/Work Planning:

  • Collaborate with business users, data stewards, report developers and data analysts to integrate and expose required data.
  • Ensure high quality development work through the application of standards, guidelines, quality assurance reviews and testing, paying due consideration to Hollard Group standards.
  • Assist with the development of project estimates, plans, and acceptance testing guidelines for approved projects.
  • Ensure that only quality solutions are deployed to production.

ETL Development:

  • Design/develop/test/maintain ETL processes, programs and scripts that reflect best practices for data management, error handling, operations logging and alerting, scheduling and job control, etc.
  • Maintain the overall ETL architecture by which systems are interconnected and data is passed among systems.
  • Conduct root cause analysis and resolve production problems and data integrity issues and eliminate such through the application of process/system enhancements.
  • Raise critical technical issues to vendors or key stakeholders E.g. DBA's in a timely manner where they would impact on delivery and quality of services and follow up on the technical resolution of such issues.
  • Validate the data integrity and develop and maintain data validation routines.

Data Modelling:

  • Understand and translate business requirements into data models.
  • Work with the Application Development team to implement data strategies and build data flows.
  • Create or update conceptual, logical and physical data models using OLTP best practices and according to Hollard's standards.
  • Recommend opportunities for reuse of data models where appropriate.
  • Perform reverse engineering of physical data models from databases and SQL scripts.

Operation Data Store and Data Warehouse Development:

  • Design, develop and administrate databases and data structures/models with due consideration to: the potential data queries and system feeds that will be generated from the tables; addition of timestamp and user ID columns as appropriate to identify the user and the time of the row addition or change; the use of standard abbreviations in table and column names; assignment of data types, nullability, and defaults for columns as appropriate.
  • In collaboration with the DBA team implement database optimisation strategies such as indexing and partitioning.
  • Creation of database objects such as tables, tables paces, synonyms, views, triggers, stored procedures, defaults, domains, and indices; maintenance and recoverability; logging and recoverability of database updates since the last backup; periodic table reorganization; structure update with change control.
  • In collaboration with the DBA's and outsource vendors, monitor and maintain database security, create security profiles and user access, grant and revoke rights and monitor usage.
  • Create and update database documentation and procedures as appropriate.

Cloud Migration:

  • Analyse environments to gauge cloud readiness and provide guidance on structures and processes not in a state that is ready to migrate to cloud solutions economically and efficiently.
  • Develop and design a proposed cloud landscape following best practices and standards.
  • Assist in the development of team skills.
  • Assist in the overall cloud migration process.

Stakeholder Management:

  • Liaise and engage with KAM, the off-platform partner's BI team and DBA.
  • Manager stakeholder expectation and ensure that deadlines are met under promise and over deliver

Required Knowledge and Experience

  • Minimum 5 years' experience in the implementation, development and/or maintenance of Business Information systems in at least 3 different business environments, including financial services; of which;
  • Minimum 5 years' experience in ETL integration with transactional systems;
  • Minimum 2 years' experience in Cloud technologies development and integration;
  • Minimum 2 years' experience specifically in relational database design, modelling, implementation and maintenance;
  • Experience demonstrating in-depth understanding of Data Architecture, Database Management Technologies, Data Warehousing and Business Intelligence concepts and technologies.
  • Advanced knowledge of ETL methodologies and technologies and demonstrated proficiency in Data Definition Language DDL, Data Manipulation Language DML, and ETL design and development using SQL Server tools SQL Management Studio, T-SQL.
  • In-depth knowledge and experience in SSIS.
  • In-depth knowledge and experience in AZURE
  • Skilled in the design and development of relational databases and data structures
  • Knowledgeable on the range of options and best practices for common ETL design techniques such as change data capture, key generation and optimization.
  • Skilled in the management of ETL and data quality, data profiling, metadata management and master data management, including error handling, logging & alerting, scheduling and job control.
  • Advanced knowledge in working with large, complex data warehouses/data marts.
  • General understanding of and proficiency in project management principles and best practices.
  • Excellent SQL coding skills.
  • Data Modelling skills
  • Customer orientation.
  • Attention to accuracy.

Personal Qualities:

  • Leadership Skills
  • Excellent analytical skills
  • Lateral thinker/innovator
  • Effective written and oral communication skills
  • Teamwork and co-operation

Educational Requirements

  • Matric/Grade 12
  • National diploma or Bachelor's degree in Information Technology, Informatics, Computer Science , Engineering or Business Analysis
  • BI Certification e.g. Microsoft MCITP, Kimball Certification, etc. would serve as an advantage

  • Junior Data Engineer

    2 months ago

    Johannesburg, Gauteng, Saudi Arabia Hollard Insurance Full time

    Job Advert SummaryThe Junior Data Engineer will report to the Hollard Life Solutions Business Unit area and provide Data Engineering support across all the Business Units within Hollard.Key Responsibilities:To ensure effective movement, collection, integration, storage, and provisioning of data to meet business objectives through a sound understanding of...

  • Junior Data Engineer

    4 weeks ago

    Johannesburg, Gauteng, Saudi Arabia Hollard Insurance Full time

    Job Advert SummaryThe Junior Data Engineer will report to the Hollard Life Solutions Business Unit area and provide Data Engineering support across all the Business Units within Hollard.Key Responsibilities:To ensure effective movement, collection, integration, storage, and provisioning of data to meet business objectives through a sound understanding of...

  • Data Engineer

    1 week ago

    Johannesburg, Gauteng, Saudi Arabia Fidelity Services Group Full time

    Overview:We are seeking a highly skilled and motivated data engineer to join our team. The ideal candidate will have a passion for working with data, a strong technical background, and experience with various data management and processing tools.Responsibilities: Design and develop data pipelines and ETL processes to extract, transform, and load data from...

  • Data Engineer

    3 weeks ago

    Johannesburg, Gauteng, Saudi Arabia Fidelity Services Group Full time

    Overview:We are seeking a highly skilled and motivated data engineer to join our team. The ideal candidate will have a passion for working with data, a strong technical background, and experience with various data management and processing tools.Responsibilities: Design and develop data pipelines and ETL processes to extract, transform, and load data from...

  • Senior Data Analyst

    2 months ago

    Johannesburg, Gauteng, Saudi Arabia Experian Full time

    Job DescriptionAn experienced Senior Data Analyst who will be responsible for processing, analysing, and interpreting large amounts of data to identify best practices, insights and patterns that will add value and improve our data platform and data offering.To support and manage client delivery and engagement and help us maintain our position as a market...

  • Senior Data Analyst

    4 weeks ago

    Johannesburg, Gauteng, Saudi Arabia Experian Full time

    Job DescriptionAn experienced Senior Data Analyst who will be responsible for processing, analysing, and interpreting large amounts of data to identify best practices, insights and patterns that will add value and improve our data platform and data offering.To support and manage client delivery and engagement and help us maintain our position as a market...

  • Senior Security Engineer

    1 month ago

    Johannesburg, Gauteng, Saudi Arabia Nintex Full time

    About the role: The Senior Security Engineer will implement the organization's security policies, procedures, and standards. This role requires an in-depth understanding of current and emerging threats and technology to drive innovation and improvement in all technical areas of security, including network, data, application, cloud, IAM, mobile, and endpoint....

  • Senior Security Engineer

    1 week ago

    Johannesburg, Gauteng, Saudi Arabia Nintex Full time

    About the role: The Senior Security Engineer will implement the organization's security policies, procedures, and standards. This role requires an in-depth understanding of current and emerging threats and technology to drive innovation and improvement in all technical areas of security, including network, data, application, cloud, IAM, mobile, and endpoint....

  • Senior Security Engineer

    4 weeks ago

    Johannesburg, Gauteng, Saudi Arabia Nintex Full time

    About the role: The Senior Security Engineer will implement the organization's security policies, procedures, and standards. This role requires an in-depth understanding of current and emerging threats and technology to drive innovation and improvement in all technical areas of security, including network, data, application, cloud, IAM, mobile, and endpoint....

  • Manager, Data

    2 days ago

    Johannesburg, Gauteng, Saudi Arabia Stryker Full time

    Job OverviewAs the Manager, Data & Analytics EEMEA, you will be responsible for the creation and management of data analytics tools and supporting the analytic needs of the EEMEA Division, providing world class analytical insights and capabilities. This includes ensuring appropriate data access and availability, analysis and visualization that meets and...

  • Data Scientist

    2 months ago

    Johannesburg, Gauteng, Saudi Arabia Mimecast Full time

    About the JobThe Data Science team is the advanced analytical engine of the Business Intelligence team – we work to solve high-value business problems by using cutting-edge tools and techniques to develop actionable AI/ML driven processes at scale. In this role you will focus on building new and improving existing machine learning models and working with...

  • Data Scientist

    2 months ago

    Johannesburg, Gauteng, Saudi Arabia Standard Bank Group Full time

    Job DescriptionW are looking for a talented and proactive Data Scientist to join our dynamic team in the fight against financial crime. As a Data Scientist in the Group Fusion Centre, you will play a crucial role in developing and implementing advanced analytics solutions to detect, prevent, and mitigate various forms of financial crime.Utilize advanced...

  • Data Scientist

    4 weeks ago

    Johannesburg, Gauteng, Saudi Arabia Standard Bank Group Full time

    Job DescriptionW are looking for a talented and proactive Data Scientist to join our dynamic team in the fight against financial crime. As a Data Scientist in the Group Fusion Centre, you will play a crucial role in developing and implementing advanced analytics solutions to detect, prevent, and mitigate various forms of financial crime.Utilize advanced...

  • Senior Executive

    1 week ago

    Johannesburg, Gauteng, Saudi Arabia NielsenIQ Full time

    Job DescriptionA Senior Insights Executive, Customer Success is an individual that will manage a selection of manufacturer client relationships across South Africa clients.The role will require the individual to deliver on the commercial agreements in place with our manufacturer clients. The individual will be required to manage the day-to-day relationship...

  • Senior Executive

    3 weeks ago

    Johannesburg, Gauteng, Saudi Arabia NielsenIQ Full time

    Job DescriptionA Senior Insights Executive, Customer Success is an individual that will manage a selection of manufacturer client relationships across South Africa clients.The role will require the individual to deliver on the commercial agreements in place with our manufacturer clients. The individual will be required to manage the day-to-day relationship...

  • Senior Specialist

    1 month ago

    Johannesburg, Gauteng, Saudi Arabia Vodafone Global Enterprise Full time

    Your responsibilities will include:Pricing Governance:Price Strategy: Developing and implementing effective pricing strategies to maximize revenue and market share.Market Analysis: Analyzing market trends, competitor pricing, and customer behavior to make informed pricing decisions.Profitability Analysis: Assessing the impact of pricing changes on overall...

  • Senior Specialist

    1 week ago

    Johannesburg, Gauteng, Saudi Arabia Vodafone Global Enterprise Full time

    Your responsibilities will include:Pricing Governance:Price Strategy: Developing and implementing effective pricing strategies to maximize revenue and market share.Market Analysis: Analyzing market trends, competitor pricing, and customer behavior to make informed pricing decisions.Profitability Analysis: Assessing the impact of pricing changes on overall...

  • Senior Specialist

    4 weeks ago

    Johannesburg, Gauteng, Saudi Arabia Vodafone Global Enterprise Full time

    Your responsibilities will include:Pricing Governance:Price Strategy: Developing and implementing effective pricing strategies to maximize revenue and market share.Market Analysis: Analyzing market trends, competitor pricing, and customer behavior to make informed pricing decisions.Profitability Analysis: Assessing the impact of pricing changes on overall...

  • Senior Adviser, Science Technology and Innovation

    2 months ago

    Johannesburg, Gauteng, Saudi Arabia AUDA - NEPAD Full time

    Required Skills and CompetenciesExperience working with quantitative and qualitative methodologies, operations research, public sector management information systems, reporting, data quality assessments, data analysis and presentation.Experience processing and analysing data using one or more statistical software packages.Demonstrated strong management,...

  • Senior Solar Draughtsman

    2 months ago

    Johannesburg, Gauteng, Saudi Arabia The Talent Expert Full time

    Is this you?Are you an experienced Draughtsman with a passion for renewable energy design? Our client is seeking a skilled Senior Solar Draughtsman who thrives in dynamic environments, has a strong attention to detail, and brings best practices to the table. If you have formal Draughtsman qualifications, practical experience in utility solar, BESS, and...