Big Data Administrator

3 days ago

الرياض, Saudi Arabia Insights Advisory Full time

**Job Summary**:
**Key Responsibilities**:
**Informatica Administration**:
1. Install, configure, and maintain Informatica PowerCenter and Informatica Cloud Data Integration environments, ensuring optimal performance and availability.

2. Manage and monitor Informatica repository, domain, and services, ensuring smooth operations across development, testing, and production environments.

3. Configure and administer Informatica workflows, sessions, and sessions logs for ETL processing, ensuring data pipelines run effectively.

4. Handle user access management, security, and role assignments within the Informatica environment.

6. Implement performance tuning of Informatica workflows and jobs to optimize resource utilization and processing times.

**Cloudera Administration**:
1. Install, configure, and maintain the Cloudera Distribution of Hadoop (CDH), including components like HDFS, Hive, Impala, Spark, YARN, and HBase.

2. Manage the Cloudera Manager and perform regular system checks to monitor the health and performance of the Hadoop ecosystem.

3. Implement and enforce data security policies across Cloudera platform services, including configuring authentication (Kerberos), encryption, and user access management.

4. Oversee the Cloudera Cluster management, including node configurations, service management, and ensuring efficient resource allocation.

5. Perform troubleshooting and performance optimization of HDFS, Hive, Spark, and other Cloudera components to minimize job failures and reduce processing times.

6. Coordinate with other teams for provisioning additional resources (e.g., compute, storage) in the Cloudera ecosystem as required by growing data demands.

**System Monitoring and Troubleshooting**:
1. Continuously monitor and manage both Informatica and Cloudera environments to ensure high availability, mínimal downtime, and maximum performance.

2. Set up and configure alerting and logging mechanisms for both platforms to proactively address performance bottlenecks, job failures, and resource utilization.

3. Troubleshoot and resolve issues related to system performance, data processing errors, and infrastructure failures across the Informatica and Cloudera environments.

4. Investigate and resolve data discrepancies, failed jobs, and system performance issues by working with Data Engineers and Business Intelligence teams.

**Performance Tuning and Optimization**:
1. Optimize Informatica workflows, mappings, and transformations to enhance execution times and reduce resource consumption.

2. Tune Hadoop components such as HDFS, YARN, Hive, and Spark to ensure efficient data processing and minimize latency.

3. Perform routine system checks and implement corrective actions to maintain optimal performance across both the Informatica and Cloudera platforms.

**Data Backup and Recovery**:
1. Manage and configure data backups and disaster recovery processes for Informatica and Cloudera environments.

2. Ensure data is recoverable in the event of failure or system downtime, and manage recovery procedures based on business continuity plans.

**Required Qualifications**:
1. Education: Major in Computer Science or related filed.

2. Years of experience: 4+

3. Informatica Administration: Strong experience in installing, configuring, and managing Informatica platforms, such as PowerCenter, IDQ, EDC, MDM, Axon, etc.

4. Cloudera Administration: Proficient experience with administering Cloudera Distribution of Hadoop (CDH), including components like HDFS, Hive, Impala, YARN, and Spark.

5. Expertise in managing Informatica repositories, services, workflows, and performance tuning.

6. Ensure end-to-end data pipeline visibility by maintaining logs, error reporting, and alerting mechanisms for ETL jobs, using platforms like Cloudera Manager or custom logging solutions.

7. Troubleshoot bottlenecks and optimize resource consumption in Cloudera, Informatica, and Alteryx to reduce costs and improve efficiency.

8. Implement monitoring and alerting systems to track system health, job performance, and data processing metrics.

  • Big Data Administration Engineer

    1 month ago

    الرياض, Saudi Arabia Reactive Talents Full time

    Are you a skilled **Big Data Administration Engineer** with a passion for managing and optimizing big data environments? Join our team and play a critical role in ensuring the stability, security, and performance of our big data platforms across production and development environments. As a Big Data Administration Engineer, you will manage clusters,...

  • Big Data Administrator

    3 hours ago

    الرياض, Saudi Arabia Insights Advisory Full time

    **Job Title**: Big Data Administrator **Job Summary**: **Key Responsibilities**: Informatica Administration: Install, configure, and maintain Informatica PowerCenter and Informatica Cloud Data Integration environments, ensuring optimal performance and availability. Manage and monitor Informatica repository, domain, and services, ensuring smooth operations...

  • Big Data Consultant

    1 month ago

    الرياض, Saudi Arabia Reactive Talents Full time

    Are you a seasoned expert in Big Data with a proven track record in designing and implementing data strategies that drive business success? Do you excel in building scalable architectures and extracting actionable insights from large datasets? If so, we are looking for a **Big Data Consultant** to join our team and help businesses transform their data into...

  • Big Data Engineer

    1 month ago

    الرياض, Saudi Arabia Reactive Talents Full time

    Are you an experienced **Big Data Engineer** looking for an opportunity to design and implement cutting-edge data pipelines and optimize data platforms? We are seeking a talented professional to join our team and play a key role in building scalable and efficient big data solutions. As a Big Data Engineer, you will design and develop robust data pipelines,...

  • Big Data Expert

    4 months ago

    الرياض, Saudi Arabia Talent Pal Full time

    Design and implement scalable big data architectures to handle large volumes of data. - Develop and optimize data processing pipelines using technologies such as Hadoop, Spark, and Kafka. - Collaborate with data scientists and analysts to provide data insights and support advanced analytics. - Manage and maintain big data platforms, ensuring high...

  • Senior Big Data Engineer

    2 months ago

    الرياض, Saudi Arabia Giza Systems EG Full time

    Design and implement large-scale data processing systems and pipelines. - Develop, test, and deploy robust big data solutions using technologies like Hadoop, Spark, and Kafka. - Optimize data storage and retrieval strategies for performance and efficiency. - Collaborate with data scientists, analysts, and stakeholders to understand data requirements. -...

  • Senior Big Data Engineer

    2 months ago

    الرياض, Saudi Arabia Giza Systems Full time

    The Role Job Description - Design and implement large-scale data processing systems and pipelines. - Develop, test, and deploy robust big data solutions using technologies like Hadoop, Spark, and Kafka. - Optimize data storage and retrieval strategies for performance and efficiency. - Collaborate with data scientists, analysts, and stakeholders to understand...

  • Big Data Engineer

    3 days ago

    الرياض, Saudi Arabia Insights Advisory Full time

    **Job Summary**: We are looking for a Data Engineer with in-depth experience in working with Cloudera, Informatica, and Alteryx to design, implement, and manage robust data engineering solutions. In this technical role, you will work with large-scale data processing systems, build high-performance ETL pipelines, and ensure the smooth integration of data from...

  • Big Data Quality

    1 month ago

    الرياض, Saudi Arabia Reactive Talents Full time

    Are you passionate about ensuring high-quality data and building robust data models that empower organizations to make better decisions? We are seeking a **Big Data Quality & Modeling Engineer** to join our team and play a critical role in maintaining data quality and creating scalable data models. As a Big Data Quality & Modeling Engineer, you will be...

  • Senior Big Data Engineer

    2 months ago

    الرياض, Saudi Arabia Talent Pal Full time

    The Role Job Description - Design and implement large-scale data processing systems and pipelines. - Develop, test, and deploy robust big data solutions using technologies like Hadoop, Spark, and Kafka. - Optimize data storage and retrieval strategies for performance and efficiency. - Collaborate with data scientists, analysts, and stakeholders to understand...

  • Senior Big Data Engineer

    2 months ago

    الرياض, Saudi Arabia Talent Pal Full time

    Design and implement large-scale data processing systems and pipelines. - Develop, test, and deploy robust big data solutions using technologies like Hadoop, Spark, and Kafka. - Optimize data storage and retrieval strategies for performance and efficiency. - Collaborate with data scientists, analysts, and stakeholders to understand data requirements. -...

  • Technology Business Head

    4 months ago

    الرياض, Saudi Arabia Black Pearl Full time

    **Job Information**: Industry - TechnologyCity - RiyadhCountry - Saudi ArabiaZip/Postal Code - 11564Number of Positions - 1re you a dynamic leader with a strong background in Big Data and AI, ready to spearhead operations in the Kingdom of Saudi Arabia (KSA)? We are seeking an experienced Business Head to lead the expansion of a leading Big Data and AI...

  • Data Structure Specialist

    4 months ago

    الرياض, Saudi Arabia MENA Consultant Full time

    **Project Duration**: 24 months. **Language Requirements**:Fluency in English (written and spoken). The Data Structure Specialist is responsible for designing, optimizing, and managing the data architecture of the organization. The role focuses on advanced data analysis, business intelligence, and ensuring the efficient and effective use of big data...

  • Data Architect

    3 months ago

    الرياض, Saudi Arabia Giza Systems EG Full time

    **Job Description**: - Proven experience as architect and engineering lead in Data & Analytics stream. - In-depth understanding of data structure principles and data platforms. - Problem-solving attitude, solution mindset with implementation expertise. - Working experience on Modern data platforms which involves big data technologies, data management...

  • Senior Data Engineer

    2 months ago

    الرياض, Saudi Arabia Master-Works Full time

    Design and implement highly available Business Intelligence solutions, Big Data and Integration systems Using technologies like: SSIS (Microsoft Integration Services), SSRS (Microsoft Reporting Services) - Debug, monitor, and troubleshoot BI solutions. - Create and deploying reports. - Write relational and multidimensional database queries. - Modify...

  • Data Engineering Expert

    4 months ago

    الرياض, Saudi Arabia Talent Pal Full time

    Design, develop, and optimize data pipelines and workflows for ETL processes. - Collaborate with data scientists and analysts to ensure data availability and quality. - Implement and maintain scalable data architectures and infrastructure. - Ensure data security, compliance, and governance practices are followed. - Troubleshoot and resolve data-related...

  • Senior Data Architect

    1 week ago

    الرياض, Saudi Arabia Giza Systems EG Full time

    Lead the design and implementation of robust, scalable, and secure data architectures. - Develop and maintain enterprise-wide data models, ensuring alignment with business objectives. - Define and enforce data architecture standards, best practices, and governance policies. - Collaborate with stakeholders to understand data requirements and translate them...

  • Senior Data Architect

    5 days ago

    الرياض, Saudi Arabia Giza Systems Full time

    The Role - Lead the design and implementation of robust, scalable, and secure data architectures. - Develop and maintain enterprise-wide data models, ensuring alignment with business objectives. - Define and enforce data architecture standards, best practices, and governance policies. - Collaborate with stakeholders to understand data requirements and...

  • Data Engineer

    1 day ago

    الرياض, Saudi Arabia Master-Works Full time

    Develop and maintain robust data architectures that support business needs and provide reliable data accessibility. - Collaborate with cross-functional teams to define data requirements and deliver scalable data solutions. - Implement ETL processes for data extraction, transformation, and loading, ensuring high data quality and integrity. - Optimize data...

  • Backup Administrator

    4 months ago

    الرياض, Saudi Arabia DS DeepSource GmbH Full time

    Assist in the installation, configuration, and maintenance of Data Domain systems at client sites. - Provide technical support and troubleshooting for Data Domain systems, including identifying and resolving issues. - Collaborate with the engineering team to develop and implement solutions for Data Domain system upgrades, performance optimizations, and...