Data Engineer

Job Title: Data Engineer Location: Sydney, Australia Experience: 5 – 9 Years Employment Type: Full-Time / PermanentRole OverviewWe are seeking a highly skilled and motivated Data Engineer to join our dynamic team in Sydney. The ideal candidate will possess strong expertise in AWS cloud services, Big Data technologies, and Python programming, with prior experience in BFSI environments. You will be responsible for designing, developing, and maintaining data pipelines, ensuring seamless data flow across systems, and supporting analytical initiatives within the organization.Key ResponsibilitiesDesign, develop, and implement robust data pipelines and ETL solutions.Work extensively with AWS services such as EC2, EMR, S3, Redshift, IAM, Glue, RDS/Aurora, Athena, and VPC.Develop efficient and scalable data processing frameworks using Hadoop, Spark, Scala, and Hive.Collaborate with cross-functional teams to gather and analyze data requirements.Support data governance, data quality, and performance optimization initiatives.Work on Omnia platform projects within the BFSI domain.Ensure data security, reliability, and compliance with organizational standards.Troubleshoot and resolve complex data engineering and integration issues.Required Skills & QualificationsStrong programming proficiency in Python.Proven hands-on experience in AWS cloud services (EC2, EMR, S3, Redshift, IAM, Glue, RDS/Aurora, Athena, VPC).Expertise in Big Data technologies (Hadoop, Spark, Scala, Hive).Exposure to Omnia platform in BFSI environments.Solid understanding of cloud networking concepts (VPC, subnets, security groups).Excellent analytical, problem-solving, and communication skills.Bachelor’s Degree in Computer Science, Engineering, or a related field.Preferred AttributesStrong sense of ownership and accountability.Ability to work effectively in a collaborative and fast-paced environment.Willingness to explore and adopt emerging cloud and data technologies.