Senior Data Engineer – Kafka Expert

4 days ago


Makkah, Makkah Province, Saudi Arabia Agoda Full time
About Agoda

Agoda is an online travel booking platform for accommodations, flights, and more. We build and deploy cutting-edge technology that connects travelers with a global network of 4.7M hotels and holiday properties worldwide, plus flights, activities, and more. Based in Asia and part of Booking Holdings, our 7,100+ employees representing 95+ nationalities in 27 markets foster a work environment rich in diversity, creativity, and collaboration. We innovate through a culture of experimentation and ownership, enhancing the ability for our customers to experience the world.

Our Purpose – Bridging the World Through Travel

We believe travel allows people to enjoy, learn and experience more of the amazing world we live in. It brings individuals and cultures closer together, fostering empathy, understanding and happiness.

We are a skillful, driven and diverse team from across the globe, united by a passion to make an impact. Harnessing our innovative technologies and strong partnerships, we aim to make travel easy and rewarding for everyone.

Get to Know Our Team

The Data department oversees all of Agoda's data-related requirements. Our ultimate goal is to enable and increase the use of data in the company through creative approaches and the implementation of powerful resources such as operational and analytical databases, queue systems, BI tools, and data science technology. We hire the brightest minds from around the world to take on this challenge and equip them with the knowledge and tools that contribute to their personal growth and success while supporting our company's culture of diversity and experimentation. The role the Data team plays at Agoda is critical as business users, product managers, engineers, and many others rely on us to empower their decision making. We are equally dedicated to our customers by improving their search experience with faster results and protecting them from any fraudulent activities. Data is interesting only when you have enough of it, and we have plenty. This is what drives up the challenge as part of the Data department, but also the reward.

The Opportunity

As senior data pipeline engineer, you will work on distributed systems spanning multiple data centers, thousands of servers and hundreds of billions of messages a day. Ensuring data quality, data integrity and data accuracy is a core part of our identity. Design for new scalable system which data is increasing day by day, including auditing and monitoring systems. You will have a chance to manage projects with small team of 1-2 members which improving your ownership and leadership. You will be eager to solve problems that come from managing and making sense of large amounts of data. Some of the things you'll get to work on include schema registry, real-time data-ingestion, cross data center replication, enrichment, storage and analytics of the data flow.

We are a small passionate team and we are looking for exceptional individuals to be a part of designing, building, deploying (and probably debugging) our Data Pipeline.

In This Role, You'll Get to
  1. You will build, administer and scale data pipelines that process hundreds of billions of messages a day spanning over multiple data centers
  2. You will develop and expand upon existing frameworks that is used by Teams throughout Agoda to produce messages to the data pipeline
  3. You will build and manage data ingestion into multiple systems (Hadoop, ElasticSearch, other Distributed Systems)
  4. You will build tools that monitor high data accuracy SLAs for the data pipeline
  5. You will explore available new technologies that improve upon our quality of data, processes and data flow
  6. You will develop quality software through design review, code reviews and test driven development
What You'll Need To Succeed
  1. Bachelor's degree in Computer Science / Information Systems / Computer Engineering or related field
  2. 4 plus years of industry experience, preferred at a tech company
  3. Good knowledge of data architecture principles
  4. Have operational experience debugging production issues
  5. An experienced coder, who can stand your ground with experience building systems with purpose that are flexible, well-tested, maintainable and scale
  6. You're detail oriented considering every outcome of a particular decision
  7. You can communicate in technical English with fluidity, both verbal and written
  8. Know more than one programming language (Golang, Java, Scala, Python, C#, etc.)
  9. Good understanding of how Kafka works
  10. Kafka Administrator Experience
  11. Experience with data ingestion from Kafka into Hadoop, ElasticSearch, other Distributed Systems
  12. Strong systems administration skills in Linux
  13. Worked on or contributed to Open Source Project
Equal Opportunity Employer

At Agoda, we pride ourselves on being a company represented by people of all different backgrounds and orientations. We prioritize attracting diverse talent and cultivating an inclusive environment that encourages collaboration and innovation. Employment at Agoda is based solely on a person's merit and qualifications. We are committed to providing equal employment opportunity regardless of sex, age, race, color, national origin, religion, marital status, pregnancy, sexual orientation, gender identity, disability, citizenship, veteran or military status, and other legally protected characteristics.

We will keep your application on file so that we can consider you for future vacancies and you can always ask to have your details removed from the file. For more details please read our privacy policy.
#J-18808-Ljbffr

  • Makkah, Makkah Province, Saudi Arabia Agoda Full time

    About AgodaAgoda is an online travel booking platform for accommodations, flights, and more. We build and deploy cutting-edge technology that connects travelers with a global network of 4.7M hotels and holiday properties worldwide, plus flights, activities, and more. Based in Asia and part of Booking Holdings, our 7,100+ employees representing 95+...


  • Makkah, Makkah Province, Saudi Arabia Agoda Full time

    Our Purpose - Bridging the World Through TravelWe believe travel has the power to bring people closer together, fostering empathy, understanding, and happiness. Our goal is to make travel accessible and rewarding for everyone.We are a skilled, driven, and diverse team from across the globe, united by a passion to make an impact. We harness innovative...

  • Senior Data Engineer

    20 hours ago


    Makkah, Makkah Province, Saudi Arabia Salla E-Commerce Platform Full time

    We are seeking a skilled Senior Data Engineer with deep expertise in ClickHouse and streaming data, and a passion for building scalable real-time analytics solutions. In this role, you will design, develop, and optimize our data pipelines and analytics infrastructure, empowering our teams to harness real-time insights that enhance customer experience and...


  • Makkah, Makkah Province, Saudi Arabia Agoda Full time

    About UsAgoda is a leading online travel booking platform that connects travelers with a global network of accommodations, flights, and more. We build cutting-edge technology to make travel easy and rewarding for everyone. Our company culture is rich in diversity, creativity, and collaboration. We innovate through experimentation and ownership, empowering...

  • Data Engineering Lead

    3 hours ago


    Makkah, Makkah Province, Saudi Arabia Salla E-Commerce Platform Full time

    About the Role:We are seeking a highly skilled Senior Data Engineer to join our team at Salla E-Commerce Platform. As a key member of our data engineering team, you will design, develop, and optimize our data pipelines and analytics infrastructure, empowering our teams to harness real-time insights that enhance customer experience and drive business...


  • Makkah, Makkah Province, Saudi Arabia Salla E-Commerce Platform Full time

    About the Job:Salla E-Commerce Platform is looking for a seasoned Senior Data Engineer to join our team. As a key contributor, you will be responsible for building and maintaining our data infrastructure, ensuring high-quality, reliable, and performant data.Key Responsibilities:Build and maintain highly scalable data pipelines for real-time and batch...

  • Kafka Specialist

    4 days ago


    Makkah, Makkah Province, Saudi Arabia Agoda Full time

    Job OverviewWe're seeking an experienced data engineer to join our team and contribute to the development of our real-time data ingestion systems. As a data engineer, you'll work closely with our data architecture team to design, build, and deploy scalable data pipelines that process hundreds of billions of messages daily. Your primary focus will be on...


  • Makkah, Makkah Province, Saudi Arabia Salla E-Commerce Platform Full time

    Job Overview:Salla E-Commerce Platform is seeking a talented Senior Data Engineer to lead the design and implementation of our data pipelines and analytics infrastructure. As a key member of our team, you will work closely with cross-functional teams to build and optimize data systems, ensuring high-quality, reliable, and performant...


  • Makkah, Makkah Province, Saudi Arabia Salla E-Commerce Platform Full time

    About the Role:We are seeking a highly skilled Senior Data Engineer to join our team at Salla E-Commerce Platform. In this role, you will be responsible for designing, developing, and optimizing our data pipelines and analytics infrastructure.Key Responsibilities:Design and implement highly scalable data pipelines for real-time and batch processingBuild and...

  • Big Data Engineer

    2 days ago


    Makkah, Makkah Province, Saudi Arabia Agoda Full time

    About the RoleAs a skilled big data engineer, you will play a critical role in designing, building, and deploying scalable data systems that support Agoda's growing business needs.We are seeking an expert-level Apache Spark developer to join our Data Core Apps team. You will be responsible for improving the scalability, stability, accuracy, speed, and...

  • Senior Data Analyst

    3 hours ago


    Makkah, Makkah Province, Saudi Arabia Dataiku Full time

    Senior Data AnalystWe're looking for a highly skilled Senior Data Analyst to join our team at Dataiku. As a Senior Data Analyst, you will be responsible for analyzing complex data sets to inform business decisions. You will work closely with data engineers, scientists, and other stakeholders to ensure seamless integration of data analysis, AI models, and...


  • Makkah, Makkah Province, Saudi Arabia Agoda Full time

    About AgodaAgoda is an online travel booking platform for accommodations, flights, and more. We build and deploy cutting-edge technology that connects travelers with a global network of 4.7M hotels and holiday properties worldwide, plus flights, activities, and more. Based in Asia and part of Booking Holdings, our 7,100+ employees representing 95+...


  • Makkah, Makkah Province, Saudi Arabia SupportFinity™ Full time

    Company OverviewDataiku is a leading provider of AI and data science solutions, empowering businesses to make data-driven decisions. Our platform enables data experts and domain specialists to collaborate and build AI into their daily operations.


  • Makkah, Makkah Province, Saudi Arabia Agoda Full time

    In This Role, You'll Get toDesign and build scalable systems that process hundreds of billions of messages daily.Work on real-time data ingestion, cross-data center replication, enrichment, storage, and analytics.Manage projects with a small team, improving your ownership and leadership skills.Ensure data quality, integrity, and accuracy.Explore available...


  • Makkah, Makkah Province, Saudi Arabia Agoda Full time

    Company OverviewAt Agoda, we pride ourselves on being a company represented by people of all different backgrounds and orientations. We prioritize attracting diverse talent and cultivating an inclusive environment that encourages collaboration and innovation. Employment at Agoda is based solely on a person's merit and qualifications. We are committed to...


  • Makkah, Makkah Province, Saudi Arabia Agoda Full time

    About UsAgoda is an online travel booking platform for accommodations, flights, and more. We build and deploy cutting-edge technology that connects travelers with a global network of hotels and holiday properties worldwide, plus flights, activities, and more.We believe travel allows people to enjoy, learn and experience more of the amazing world we live in....


  • Makkah, Makkah Province, Saudi Arabia Agoda Full time

    About AgodaAgoda is an online travel booking platform for accommodations, flights, and more. We build and deploy cutting-edge technology that connects travelers with a global network of 4.7M hotels and holiday properties worldwide, plus flights, activities, and more. Based in Asia and part of Booking Holdings, our 7,100+ employees representing 95+...

  • AI Data Engineer Lead

    3 hours ago


    Makkah, Makkah Province, Saudi Arabia Dataiku Full time

    Job DescriptionWe're looking for a highly skilled Data Engineer Lead to join our team at Dataiku. As a Data Engineer Lead, you will be responsible for designing, building, and maintaining large-scale data infrastructure to support AI model development and deployment. You will work closely with data scientists, engineers, and other stakeholders to ensure...

  • Cloud Data Engineer

    7 days ago


    Makkah, Makkah Province, Saudi Arabia Cloudera Full time

    RequirementsTo succeed in this role, you'll need a passion for using technology to make a difference in people's lives and organizations. A minimum of 5 years of experience in a customer-facing role, ideally in a pre-sales context, is also essential.Key skills and qualifications include:Experience with Big Data, Data Warehousing, or Relational...

  • Data Scientist

    3 weeks ago


    Makkah, Makkah Province, Saudi Arabia Dataiku Full time

    At Dataiku, we're not just adapting to the AI revolution, we're leading it. Since our beginning in Paris in 2013, we've been pioneering the future of AI with a platform that makes data actionable and accessible. With over 1,000 teammates across 25 countries and backed by a renowned set of investors, we're the architects of Everyday AI, enabling data experts...