الملخص
تعلن Midis Group عن شاغر مهندس بيانات متخصص في Cloudera في دبي. تشمل المهام بناء خطوط معالجة البيانات الضخمة وصيانتها، وتطوير سير عمل ETL/ELT وتحسينه، ودعم بيئات الإنتاج. يتطلب الدور خبرة عملية في Cloudera CDP وتقنيات Hadoop وSpark وHive وHDFS، إلى جانب معالجة متطلبات الأداء والموثوقية وأمن البيانات وحوكمتها. يشترط الحصول على بكالوريوس في علوم الحاسب أو مجال ذي صلة.
نص الإعلان
كما نُشر على midisgroup.com. نقلناه من موقع صاحب العمل ونعرضه بنصّه الأصلي.
Job Scope
We are seeking an experienced Cloudera Data Engineer with strong hands-on expertise in Cloudera CDP, Hadoop, Spark, Hive, and HDFS. The ideal candidate will be responsible for building and maintaining big data pipelines, optimizing data workflows, and supporting production environments to ensure reliability and performance.
Main Duties and Responsibilities
Design, build, and maintain big data pipelines using Cloudera CDP components.
Develop and optimize ETL/ELT workflows using Spark, Hive, and Hadoop ecosystems.
Manage and maintain HDFS storage, ensuring high availability and performance.
Perform production support activities, including issue resolution, monitoring, and performance tuning.
Work with data scientists, analysts, and other engineering teams to support data-driven initiatives.
Ensure data governance, security, and compliance across big data environments.
Troubleshoot cluster-level issues related to resource utilization, scheduling, and configuration.
Participate in solution design, architecture discussions, and technical documentation.
Position Requirements
Strong hands-on experience with Cloudera CDP.
Proficiency in Hadoop ecosystem: HDFS, YARN, MapReduce, Hive, Impala.
Strong experience working with Apache Spark (PySpark or Scala preferred).
Solid understanding of distributed systems and big data architecture.
Experience with production support and troubleshooting in big data environments.
Strong SQL skills and experience optimizing large-scale queries.
Familiarity with Linux, shell scripting, and automation tools.
Experience with version control (Git) and CI/CD workflows is a plus.
Education
Bachelor's degree in Computer Science or any other related field
Experience
Experience with cloud platforms (AWS, Azure, GCP) for big data workloads.
Exposure to Kafka, NiFi, Oozie, or similar data orchestration tools.
Knowledge of Docker, Kubernetes, or containerized environments.
Understanding of security, encryption, and data governance concepts.
- #LI-GA2