Data Engineer

Job descriptionWe are working with a top tier global consulting firm to support the delivery of a large scale transformation for a Telecom client based out of Malaysia.This is a 5 year programme focused on AI revenue transformation and acceleration. They have already spent a year building out the key assets and have mobilised a 20-30 person cross functional team (data, tech, consulting) based in KL.They now require practitioners with proven hands on experience across a number of expertise areas to join them to help scale and drive value out of what has been built in phase 1.You'll be working as a member of the consulting team delivering for the end client and will need to be based on-site in KL. This will be an initial 6 month engagement with the option to extend into a multi-year contract.Open to those already based in Malaysia.Scope of work:Design, develop, and maintain data pipelines using AirflowBuild modular and incremental data flows that allow efficient refresh cycles and minimize redundant runsCollaborate with cross-functional teams to integrate AI/ML models into production data environmentsDevelop ETL/ELT workflows to ingest and transform data from multiple telecom and operational systemsEnsure data quality, version control, and governance through consistent documentation and reusable componentsParticipate in troubleshooting and optimization of data processes to ensure reliability, scalability, and performanceContribute to domain logic validation in partnership with business and analytics teamsSkills / Experience needed:3–7 years of hands-on experience in data engineering or related roles.Strong proficiency in Python, SQL, and modern data frameworks (e.g., Airflow, Spark)Working knowledge of Azure data ecosystem (Data Factory, AzureML, Synapse, Blob Storage, Azure SQL, etc.)Familiarity with AWS services (S3, ECS, RDS, EC2)Experience designing incremental / modular data pipelines and integrating APIs or external data sourcesStrong understanding of data governance, versioning, and access management practicesExcellent problem-solving skills, structured thinking, and strong communication abilities