Senior Data Engineer, OTA

About UsRivian and Volkswagen Group Technologies is a joint venture between two industry leaders with a clear vision for automotive’s next chapter. From operating systems to zonal controllers to cloud and connectivity solutions, we’re addressing the challenges of electric vehicles through technology that will set the standards for software-defined vehicles around the world.The road to the future is uncharted. By combining our expertise across connectivity, AI, security and more, we’ll map a new way forward. Working together, we’ll create a future that’s more connected, more intelligent, more sustainable for everyone.Role SummaryWe are seeking a highly skilled and experienced Senior Data Engineer, Engineering Operations, OTA to architect, build, and maintain robust, scalable streaming and analytics pipelines for our Vehicle and OTA application data. This position is designed for a candidate who is able to lead highly technical projects.ResponsibilitiesStreaming Pipeline Development: Design, build, and maintain highly efficient and reliable Kinesis streaming pipelines for Vehicle Updater and Over-the-air updates (OTA) application data.Analytics Pipeline Optimization: Develop, maintain, and optimize analytics pipelines.Infrastructure as Code (IaC): Build and maintain infrastructure as code (IaC) using Terraform data pipeline and event based activity.Permissions and Security: Design and implement robust permissions schemes and structures that align with RVT (Relevant Vehicle Technology) standards, ensuring data security and compliance.Data Integration: Implement and manage data integration processes which includes working with tools like Fivetran.Data Modeling Standards: Define and implement data modeling standards for vehicle and OTA application data to ensure consistency and efficiency.Performance Optimization: Proactively identify and resolve performance bottlenecks in data pipelines and infrastructure.Technical Guidance and Project Leadership: Provide technical guidance on best practices. Ability to lead projects.Collaboration: Work closely with data scientists, analysts, and product teams to understand data requirements and deliver effective solutions.QualificationsStrong proficiency in Python.Extensive experience with Pyspark (ideal) or Scala for large-scale data processing.Hands-on experience developing and maintaining streaming services, particularly with Kinesis.Deep understanding of AWS services related to data and infrastructure.Expertise in Terraform for infrastructure as code (IaC).Strong SQL skills and experience with relational databases.Experience with Databricks.Familiarity with DBT.Familiarity with Fivetran for data integration.Experience with CI/CD pipelines.Understanding of data governance principles.Ability to work autonomously and drive projects to completion.Nice To HaveExperience with JavaExperience with GoExperience working with firmware updatesCompany StatementsEqual OpportunityRivian and Volkswagen Group Technologies is committed to creating a diverse environment and is proud to be an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, national origin, ancestry, sex, sexual orientation, gender, gender expression, gender identity, genetic information or characteristics, physical or mental disability, marital/domestic partner status, age, military/veteran status, medical condition, or any other characteristic protected by law. We are also committed to ensuring compliance with all applicable fair employment practice laws regarding citizenship and immigration status.Rivian and Volkswagen Group Technologies is committed to ensuring that our hiring process is accessible for persons with disabilities. If you have a disability or limitation, such as those covered by the Americans with Disabilities Act, that requires accommodations to assist you in the search and application process, please email us at candidateaccommodations@rivian.com.Candidate Data PrivacyRivian and VW Group Technologies (“Rivian and Volkswagen Group Technologies”) may collect, use and disclose your personal information or personal data (within the meaning of the applicable data protection laws) when you apply for employment and/or participate in our recruitment processes (“Candidate Personal Data”). This data includes contact, demographic, communications, educational, professional, employment, social media/website, network/device, recruiting system usage/interaction, security and preference information. Rivian and Volkswagen Group Technologies may use your Candidate Personal Data for the purposes of (i) tracking interactions with our recruiting system; (ii) carrying out, analyzing and improving our application and recruitment process, including assessing you and your application and conducting employment, background and reference checks; (iii) establishing an employment relationship or entering into an employment contract with you; (iv) complying with our legal, regulatory and corporate governance obligations; (v) recordkeeping; (vi) ensuring network and information security and preventing fraud; and (vii) as otherwise required or permitted by applicable law.Rivian and Volkswagen Group Technologies may share your Candidate Personal Data with (i) internal personnel who have a need to know such information in order to perform their duties, including individuals on our People Team, Finance, Legal, and the team(s) with the position(s) for which you are applying; (ii) Rivian and Volkswagen Group Technologies affiliates; and (iii) Rivian and Volkswagen Group Technologies’ service providers, including providers of background checks, staffing services, and cloud services.Rivian and Volkswagen Group Technologies may transfer or store internationally your Candidate Personal Data, including to or in the United States, Canada, and the European Union and in the cloud, and this data may be subject to the laws and accessible to the courts, law enforcement and national security authorities of such jurisdictions.Please see our Candidate Data Privacy Notice (English) and Candidate Data Privacy Notice (Serbian) for more information.Please note that we are currently not accepting applications from third party application services.