Senior Data Engineer

4 days ago

الرياض, Saudi Arabia Oivan Group Oy Full time

**What We Need**:
We are seeking an experienced Senior Data Engineer / Data Expert with a strong background in data streaming, Apache Kafka, and Airflow to join our dynamic data engineering team. This role will involve managing and enhancing a large-scale infrastructure designed for extensive social media data scraping, integration into a data lake house, and coordination across multiple data-centric teams. This position requires expertise in handling complex data pipelines, identifying and resolving security vulnerabilities, and ensuring the optimal storage and retrieval of data within our systems.

**What You'll Do**:

- Design, develop, and maintain scalable data pipelines to support AI model development.
- Design, build, and maintain efficient, scalable, and reliable data pipelines using Apache Kafka, streaming services, and Airflow.
- Coordinate with the data acquisition team to ensure seamless data flow while addressing and resolving any security vulnerabilities identified in the Airflow and Kubernetes (K8) setup
- Implement data solutions to handle large volumes of structured and unstructured data, including videos, audio, images, and text.
- Collaborate with AI researchers, machine learning engineers, and software engineers to ensure data is available and ready for model training.
- Ensure data quality, integrity, and security throughout the data lifecycle.
- Optimize data processing workflows for performance and scalability.
- Lead initiatives to validate and manage multilingual data, specifically for Arabic and English datasets, with a focus on YouTube data.
- Coordinate model training and data validation efforts, to enhance multilingual processing capabilities.
- Oversee the completion of Phase 01 data scraping project, which includes managing data collection from social media platforms under API constraints.
- Coordinate with the team to finalize infrastructure setup for scraping 2 million hours of video from YouTube and 10 million photos from other sources.

**What You Have**:

- Bachelor's or master's degree in computer science, Data Engineering, or a related field.
- 8+ years of experience in data engineering with a focus on building data pipelines.
- Proficiency in data processing technologies such as Apache Spark, Airflow, Kafka, Hadoop, and cloud platforms (AWS, GCP, Azure).
- Strong programming skills in Python, Java, Go, or Scala.
- Experience with SQL and NoSQL databases.
- Demonstrated ability to work on large-scale data projects and deliver results.
- Excellent problem-solving skills and attention to detail.
- Strong communication and teamwork skills.

**What We Offer**:

- An international workforce to learn from and grow with - we have a diverse, multicultural workforce with Nordic values
- A fair compensation package and a considerable annual leave of 25 days per annum. We support our staff to be with family at the most important time. Partners with a newborn baby can have additional holidays.
- Medical insurance depending on agreement
- Opportunities for growth and enrichment through Grow with Oivan, our internal learning and development departments
- Line devices Mac or PC within a fixed company budget
- Team building activities, movie nights, events

**Who We Are**:

- PDPL Statement_

  • Senior Data Engineer

    2 weeks ago

    الرياض, Saudi Arabia Mozn Full time

    Mozn is a rapidly growing technology firm revolutionizing the field of Artificial Intelligence and Data Science headquartered in Riyadh, Saudi Arabia and it’s working to realize Vision 2030 with a proven track record of excellence in supporting and growing the tech ecosystem in Saudi Arabia and the GCC region. Mozn is the trusted AI technology partner for...

  • Senior Data Engineer

    4 days ago

    الرياض, Saudi Arabia UXBERT Labs Full time

    **About Us**: At UXBERT Labs, we believe in the power of data pipelines to drive innovation. Our engineers create data architectures that process, store, and unlock insights across our platforms. **Role Overview**: We’re hiring a **Senior Data Engineer** to design and implement robust data pipelines. If you thrive on structuring large datasets and...

  • Data Center Facility Engineer, Data Center Engineering Operations

    4 days ago

    الرياض, Saudi Arabia Data Services Saudi Arabia Limited One Person Company Full time

    Bachelor's degree in engineering (Electrical/Mechanical), project management, construction management or similar technical focus Knowledge of mechanical systems (Mechanical, HVAC systems, Controls) Knowledge of key electrical competencies and theory - Experience in data center engineering - Familiar with Building Management System (BMS) and Electrical Power...

  • Cybersecurity Resident Engineer L2

    2 weeks ago

    الرياض, Saudi Arabia NTT DATA Full time

    **Make an impact with NTT DATA** Join a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion - it’s a place where you can grow, belong and thrive. **Your day at NTT DATA** As a...

  • Senior Data Engineer

    1 week ago

    الرياض, Saudi Arabia Gathern Full time

    **Job Purpose**: To design, build, and maintain scalable data infrastructure, enabling seamless data processing and analysis for the organization. **Accountabilities**: - Design and Build Data Pipelines: Develop and maintain scalable ETL pipelines that ingest, clean, and structure data from various sources. - Design, implement, and maintain cloud-based...

  • Senior Client Project

    2 weeks ago

    الرياض, Saudi Arabia NTT DATA Full time

    **Make an impact with NTT DATA** Join a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion - it’s a place where you can grow, belong and thrive. **Your day at NTT DATA** This...

  • Senior / Staff Cloud Support Engineer - Data

    2 weeks ago

    الرياض, Saudi Arabia Talent Pal Full time

    Build the future of the AI Data Cloud. Join the Snowflake team. Snowflake’s values are key to our approach and success in delivering world-class Support. Putting customers first, acting with integrity, owning initiative and accountability, and getting it done are Snowflake core values and are reflected in everything we do. Snowflake’s Support team is...

  • Data Engineer

    4 days ago

    الرياض, Saudi Arabia Master-Works Full time

    **Data Collection and Integration**: Data engineers collect data from various sources, including databases, APIs, external data providers, and streaming sources. They must design and implement efficient data pipelines to ensure a smooth flow of information into the data warehouse or storage system. **2. Data Storage and Management**: Once the data is...

  • Data Engineer

    2 weeks ago

    الرياض, Saudi Arabia Master-Works Full time

    **Experience Required**: - 3+ years of experience in data engineering or a related field. - Expertise in MLOps (Machine Learning Operations). - Preferred experience or certification in DataIKU. **Key Skills**: - Strong knowledge of data engineering principles and best practices. - Proficiency in MLOps frameworks and tools for the development, deployment,...

  • Data Engineer

    2 weeks ago

    الرياض, Saudi Arabia Master-Works Full time

    Develop and maintain robust data architectures that support business needs and provide reliable data accessibility. - Collaborate with cross-functional teams to define data requirements and deliver scalable data solutions. - Implement ETL processes for data extraction, transformation, and loading, ensuring high data quality and integrity. - Optimize data...