Senior Data Engineer

5 days ago

الرياض, Saudi Arabia Oivan Group Oy Full time

**What We Need**:
We are seeking an experienced Senior Data Engineer / Data Expert with a strong background in data streaming, Apache Kafka, and Airflow to join our dynamic data engineering team. This role will involve managing and enhancing a large-scale infrastructure designed for extensive social media data scraping, integration into a data lake house, and coordination across multiple data-centric teams. This position requires expertise in handling complex data pipelines, identifying and resolving security vulnerabilities, and ensuring the optimal storage and retrieval of data within our systems.

**What You'll Do**:

- Design, develop, and maintain scalable data pipelines to support AI model development.
- Design, build, and maintain efficient, scalable, and reliable data pipelines using Apache Kafka, streaming services, and Airflow.
- Coordinate with the data acquisition team to ensure seamless data flow while addressing and resolving any security vulnerabilities identified in the Airflow and Kubernetes (K8) setup
- Implement data solutions to handle large volumes of structured and unstructured data, including videos, audio, images, and text.
- Collaborate with AI researchers, machine learning engineers, and software engineers to ensure data is available and ready for model training.
- Ensure data quality, integrity, and security throughout the data lifecycle.
- Optimize data processing workflows for performance and scalability.
- Lead initiatives to validate and manage multilingual data, specifically for Arabic and English datasets, with a focus on YouTube data.
- Coordinate model training and data validation efforts, to enhance multilingual processing capabilities.
- Oversee the completion of Phase 01 data scraping project, which includes managing data collection from social media platforms under API constraints.
- Coordinate with the team to finalize infrastructure setup for scraping 2 million hours of video from YouTube and 10 million photos from other sources.

**What You Have**:

- Bachelor's or master's degree in computer science, Data Engineering, or a related field.
- 8+ years of experience in data engineering with a focus on building data pipelines.
- Proficiency in data processing technologies such as Apache Spark, Airflow, Kafka, Hadoop, and cloud platforms (AWS, GCP, Azure).
- Strong programming skills in Python, Java, Go, or Scala.
- Experience with SQL and NoSQL databases.
- Demonstrated ability to work on large-scale data projects and deliver results.
- Excellent problem-solving skills and attention to detail.
- Strong communication and teamwork skills.

**What We Offer**:

- An international workforce to learn from and grow with - we have a diverse, multicultural workforce with Nordic values
- A fair compensation package and a considerable annual leave of 25 days per annum. We support our staff to be with family at the most important time. Partners with a newborn baby can have additional holidays.
- Medical insurance depending on agreement
- Opportunities for growth and enrichment through Grow with Oivan, our internal learning and development departments
- Line devices Mac or PC within a fixed company budget
- Team building activities, movie nights, events

**Who We Are**:

- PDPL Statement_

  • Senior Data Engineer

    2 weeks ago

    الرياض, Saudi Arabia Mozn Full time

    Mozn is a rapidly growing technology firm revolutionizing the field of Artificial Intelligence and Data Science headquartered in Riyadh, Saudi Arabia and it’s working to realize Vision 2030 with a proven track record of excellence in supporting and growing the tech ecosystem in Saudi Arabia and the GCC region. Mozn is the trusted AI technology partner for...

  • Senior Data Engineer

    5 days ago

    الرياض, Saudi Arabia UXBERT Labs Full time

    **About Us**: At UXBERT Labs, we believe in the power of data pipelines to drive innovation. Our engineers create data architectures that process, store, and unlock insights across our platforms. **Role Overview**: We’re hiring a **Senior Data Engineer** to design and implement robust data pipelines. If you thrive on structuring large datasets and...

  • Data Center Facility Engineer, Data Center Engineering Operations

    5 days ago

    الرياض, Saudi Arabia Data Services Saudi Arabia Limited One Person Company Full time

    Bachelor's degree in engineering (Electrical/Mechanical), project management, construction management or similar technical focus Knowledge of mechanical systems (Mechanical, HVAC systems, Controls) Knowledge of key electrical competencies and theory - Experience in data center engineering - Familiar with Building Management System (BMS) and Electrical Power...

  • Senior Data Engineer

    1 week ago

    الرياض, Saudi Arabia Gathern Full time

    **Job Purpose**: To design, build, and maintain scalable data infrastructure, enabling seamless data processing and analysis for the organization. **Accountabilities**: - Design and Build Data Pipelines: Develop and maintain scalable ETL pipelines that ingest, clean, and structure data from various sources. - Design, implement, and maintain cloud-based...

  • Data Engineer

    5 days ago

    الرياض, Saudi Arabia Master-Works Full time

    **Data Collection and Integration**: Data engineers collect data from various sources, including databases, APIs, external data providers, and streaming sources. They must design and implement efficient data pipelines to ensure a smooth flow of information into the data warehouse or storage system. **2. Data Storage and Management**: Once the data is...

  • Data Engineer

    2 weeks ago

    الرياض, Saudi Arabia Master-Works Full time

    **Experience Required**: - 3+ years of experience in data engineering or a related field. - Expertise in MLOps (Machine Learning Operations). - Preferred experience or certification in DataIKU. **Key Skills**: - Strong knowledge of data engineering principles and best practices. - Proficiency in MLOps frameworks and tools for the development, deployment,...

  • Data Engineer

    2 weeks ago

    الرياض, Saudi Arabia Master-Works Full time

    Develop and maintain robust data architectures that support business needs and provide reliable data accessibility. - Collaborate with cross-functional teams to define data requirements and deliver scalable data solutions. - Implement ETL processes for data extraction, transformation, and loading, ensuring high data quality and integrity. - Optimize data...

  • Ai Support Engineer

    5 days ago

    الرياض, Saudi Arabia EndemandIT & Data Solutions LLC Full time

    Position Title: AI Platform Engineer Location: Onsite role - Riyadh Desired Qualifications: Bachelor’s degree in Computer Science, Information Technology, or a related field. Experience: Overall, 7 plus year exp 3+ years of experience in ML/AI support or related roles.Strong hands-on experience with Kubernetes in production environments. Number of...

  • Senior Manager

    5 days ago

    الرياض, Saudi Arabia Tamara Full time

    Senior Manager - BI & Data Science **About us** Tamara is the leading fintech platform in Saudi Arabia and the wider GCC region with a mission to help people make their dreams come true by building the most customer-centric financial super-app on earth. The company serves millions of users in KSA, UAE and Kuwait, and partners with leading global and...

  • Data Warehouse Engineer

    2 weeks ago

    الرياض, Saudi Arabia Master-Works Full time

    Master-Works is looking for a skilled Data Warehouse Engineer to join our dynamic team. In this role, you will be responsible for building, maintaining, and optimizing our data warehouse solutions to support data-driven decision-making across the organization. You will work closely with data analysts, data scientists, and business stakeholders to understand...