Unison Group

Senior Data Engineer (AWS Migration)

Posted: just now

Job Description

Key Responsibilities:Migration & Technical Implementation:Lead migration of on-premises and SharePoint-based data infrastructure to AWS Data Analytics Platform (DAP)Collaborate with AWS teams to develop comprehensive migration strategies and implementation plansRe-architect existing Python scripts and UiPath automation workflows for AWS SageMaker or Glue scripts Design and implement robust data pipelines and ETL processes within AWS environmentMigrate Tableau dashboards to AWS QuickSight whilst maintaining full functionalityEstablish data connections from multiple sources (HRPS, Gateway, SharePoint, Microsoft Lists, FormSG, MS Access)Ensure seamless transition with zero disruption to existing data operationsDocumentation & Knowledge Transfer:Create comprehensive documentation for all new AWS processes and workflowsDevelop training materials and conduct knowledge transfer sessions for end usersSupport HR officers in accessing and utilising dashboards in the new AWS environmentConduct thorough testing and validation of migrated systemsRequired Skills:AWS ServicesExtensive experience with AWS services (SageMaker, QuickSight, Athena, Lambda, data pipelines)Experience using AWS services in Python and Command Line InterfaceProficiency in serverless architecture design and Lambda function developmentInfrastructure as Code (IaaC)Experience in Infrastructure-as-Code (eg. CloudFormation, YAML, JSON infrastructure scripts)Lambda function provisioning and management through IaaC templatesIntegration of serverless components with traditional infrastructure resourcesProgramming And Automation SkillsProficiency in Python programming and UiPath automationExperience developing and deploying Lambda functions for data processing and automationUnderstanding of event-driven architecture and serverless computing patterns Data Visualisation and AnalyticsStrong background in Tableau and QuickSight dashboard developmentExperience with ETL processes and data pipeline designKnowledge of serverless data processing workflows using LambdaDevOps and CollaborationExperience working with DevOps stack (eg. Ship-hats, GitLab, Nexus Repo etc)Understanding of CI/CD pipelines for both application code and infrastructure deploymentExperience with infrastructure change management including security groups and network ACLsTechnical writing and documentation skillsTraining delivery and user support capabilities

Job Application Tips

  • Tailor your resume to highlight relevant experience for this position
  • Write a compelling cover letter that addresses the specific requirements
  • Research the company culture and values before applying
  • Prepare examples of your work that demonstrate your skills
  • Follow up on your application after a reasonable time period

You May Also Be Interested In