Engineer - Data Engineering

JOB SPECIFIC DUTIES & RESPONSIBILITIESDesigning and developing data solutions for one of the world’s largest corporations involved in the marketing and distribution of food productsImplementing distributed and highly available data processing applications that scale for enterprise demandsAdhering to Continuous Integration and Continuous Delivery of solutionsEnsuring high code quality by following software engineering best practicesWorking collaboratively in a cross-functional team in an Agile delivery environmentAdhering to DevOps principles and being involved in projects throughout their full software lifecycle: from development, QA, and deployment, to post-production supportREQUIRED COMPETENCIES AND SKILLSA Bachelor’s Degree in Computer Science or equivalent, and 1-2 years of experience in developing enterprise grade data processing applicationsA strong programming background in data ops (Python, Shell, SQL)Experience in processing large volumes of dataHands-on experience working with relational/NoSQL databases and distributed storage engines (HDFS, S3, Redshift)Hands-on experience in ETL design and development using ETL tools (Preferably Informatica and cloud tools such as AWS Data Pipelines, Glue, Lambda, EMR, Spark, Hive and data engineering tools and services on Google Cloud Platform)Experience in working with streaming data (using tools such as Kenisis, Kafka, Storm, Spark) will be an added advantageExperience in API development and user interfaces and related tools (NodeJS, AngularJS, HTML) will be an added advantageExperience working in a Scrum Agile delivery environment and DevOps practicesExperience in code management and CICD tools such as Github, Gitlab and JenkinsExperience in an agile environment and aligning Pod members on technical visions and path to implementationA strong desire to continue to grow your skillsetStrong communication skills that are influential and convincing