Summary
OneBullEx is hiring a Senior Batch Data Engineer in Dubai to own its enterprise batch data warehouse on Alibaba Cloud. The role involves building and optimising T-1 pipelines, modelling warehouse layers, and supporting analytics, dashboards, and AI/ML services. The engineer will implement data quality checks, monitoring, alerting, and automated testing, and manage scheduling, backfills, and pipeline reliability. Applicants should have 5+ years of experience with Alibaba Cloud data services, strong SQL and Python skills, and fluency in English and Chinese.
The posting
As published on onebullex.com. Pulled from the employer's site and shown as they wrote it.
OneBullEx is looking for a highly accountable, self-driven Senior Batch Data Engineer to take end-to-end ownership of our enterprise batch data warehouse on Alibaba Cloud. In this role, you will design, maintain, and optimise batch pipelines (T-1) supporting executive dashboards, business analytics, and AI/ML services — leveraging modern AI-assisted engineering techniques to rapidly build data layers (ODS, DWD, DWS, ADS) and enforcing strict data quality, automated validation, and proactive monitoring across the platform.
Key Responsibilities
Pipeline Architecture & Data Warehouse Modelling
- Design, build, and maintain scalable ETL/ELT batch pipelines using Alibaba Cloud DataWorks and MaxCompute.
- Rapidly design and build enterprise data warehouse layers (ODS, DWD, DWS, ADS) using modular SQL/Python scripts and AI generation tools.
- Develop and optimise data ingestion, transformation, and batch processing workflows across Lakehouse and Data Warehouse architectures (MaxCompute, Hologres, DataWorks, DTS).
- Ensure data reliability, high query performance, schema stability, and cost-effective cloud resource usage.
AI-Accelerated Engineering & Testing
- Integrate modern AI tools and techniques (e.g. Claude, GitHub Copilot, prompt engineering) into daily workflow to accelerate code generation, SQL refactoring, and data validation.
- Apply new AI testing methodologies to rapidly write unit tests, simulate data scenarios, and audit data accuracy prior to production release.
Data Quality, Monitoring & Alerting
- Implement strict data quality rules, automated reconciliation scripts, and validation checks directly inside DataWorks jobs.
- Build proactive alerting and monitoring workflows (integrated with Lark) to detect data drift, schema breaks, or pipeline failures before business impact occurs.
- Support downstream analytics, BI reporting, and AI/LLM services with clean, trusted datasets.
End-to-End Ownership & Collaboration
- Take full ownership of daily T-1 batch pipeline stability, job scheduling, historical backfills, and legacy issue cleanup.
- Act as a bilingual technical bridge, collaborating fluently in both English and Chinese with cross-functional technical leads, product managers, and developers.
Required Qualifications
- 5+ years of hands-on expertise with Alibaba Cloud data services: DataWorks, MaxCompute, DTS, Hologres, FC Functions, Data Agents, and MaxCompute Lakehouse architectures.
- Advanced proficiency in SQL and Python for data engineering, performance tuning, and database optimisation.
- Proven experience modelling multi-layer enterprise data structures (ODS, DWD, DWS, ADS) and managing batch Lakehouse architectures.
- Fluent in both English and Chinese, spoken and written, for seamless technical collaboration with regional teams.
- Strong sense of ownership, high velocity, proactive communication, and a "deliver fast, iterate continuously" attitude.
Preferred
- Active experience leveraging AI coding assistants (Copilot, LLMs) to speed up ETL development, code reviews, and query optimisation.
- Experience building alerting and monitoring integrations with Lark or a similar collaboration platform.
- Track record applying AI-driven testing methodologies ahead of production release.