Big Data Engineer with Spark
Posted: 2 days ago
Job Description
IntroductionWe are currently hiring a Data Engineer with Spark to join our IT Digital Marketing Solutions team to develop dynamic software solutions.Your Role And ResponsibilitiesYour responsibilities will include: Writing effective and scalable data processing code using Spark with Scala / Java Designing and implementing robust solutions Debugging applications to ensure low-latency and high-availability (Docker / Kubernetes) Interfacing with developed API and building Rest API Implementing and refactoring ETL processes (Airflow) Implementing security and data protection (HVault) Accommodating various data storage solutions (COS API, Cassandra)Preferred EducationBachelor's DegreeRequired Technical And Professional Expertise Proficiency in data processing with Apache Spark (Scala / Java) Work experience with Docker / Kubernetes Experience in implementing and refactoring ETL processes (Arflow / Python) Experience in implementing security and data protection (HVault) Previous work experience with: SQL, COS API, CassandraPreferred Technical And Professional ExperienceNice to have: Kafka, GitLab, Jenkins
Job Application Tips
- Tailor your resume to highlight relevant experience for this position
- Write a compelling cover letter that addresses the specific requirements
- Research the company culture and values before applying
- Prepare examples of your work that demonstrate your skills
- Follow up on your application after a reasonable time period