DATA engineer（spark Scala 外企 加班少 福利齐全）

该职位来源于猎聘 NCS: Advance our communities, bring people together to make the extraordinary happen 恩士迅:智应万变 慧通未来 我们是来自新加坡的知名国际IT人才和解决方案服务商，我们拥有强大的业务网络、覆盖亚大地区的20余个城市，全年同时进行交付的项目超过 4,000个。 最近，恩士迅于2022年在中新广州知识城设立了新的大湾区创新科技交付中心(GBnDC)。 作为中国新加坡重点共建起步项目，我们正蓬勃发展，我们需要更多志同道合的伙伴一起加入，共同建设NCS 加入我们， 您将获得: 1.更多高端国际项目和团队的职业发展机会，包括IT技能和行业背景; 2.开放多元的工作氛围和优秀舒适的工作环境; 3.更有竞争力的薪资待遇和福利体系; And more... 工作时间：朝九晚六，上下班可弹性，人性化，不加班 面试流程：须用电脑，线上视频面试， 项目长期稳定，核心项目，技术提升快 外企项目，英语口语要求流利 可弹性上下班、带薪年假、五险一金、节日礼物、团队聚餐、领导好、发展空间大、公司规模大等优点。 DATA engineer 岗位要求： 1、3年及以上相关工作经验，本科及以上学历，英文流利，可以全英面试；2、熟悉spark、Scala或者Pyspark； 办公环境高大上，茶水间配备咖啡机、茶包、自动贩卖机等等，休息区 配备健身器材 园区可免费停车，附近租房环境优美，小区租房价格实惠~~~ 薪资和福利： 1.社保公积金齐全 2.年度体检 3.带薪年假10天起，带薪病假14天起 4.每月住宿交通补贴 ü Programming: Data (Python, Spark, PySpark, Hive, Scala)：Qualified ü Experience managing over 200K data records daily or equivalent ü ResponsibilitiesDeliver solutions for online data extraction, data integration and data management.Develop and maintain high-performance, scalable utilities to support technology research and data transformation.Optimize data processing protocols and systems for better efficiency and maintainability.Contribute to the establishment and maintenance of distributed computing platform and big data servicesWriting of documents that clearly explain how algorithms should be implemented,verified and validated. ü RequirementsExperience in a field encompassing Distributed computing, Data Analytics, DataTransformationDataEngineer with hands-on experience in Hadoop, SQL, Hive/Impala, Spark (Scala/Python/ Java), Parquet/Avro/HBase and HDFS.Analyse and address issues relating to capacity constraints and performance related items on SQL and Spark ETL processing.Strong in Linux/Unix Commands and Scripting (Shell Scripting and Python/Scala).Experiences in automation of batches with Shell scripts + REST APIs (triggeringand result parsing).Experience in using AWS products like S3 Storage.Strong problem-solving skills with the can-do attitude to be able to come up with solutions for various problems on a wide technical area.Knowledge of professional software engineering practices & best practices for the full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations