Software Engineer, Batch Compute

Who we areAbout StripeStripe is a financial infrastructure platform for businesses. Millions of companies—from the world’s largest enterprises to the most ambitious startups—use Stripe to accept payments, grow their revenue, and accelerate new business opportunities. Our mission is to increase the GDP of the internet, and we have a staggering amount of work ahead. That means you have an unprecedented opportunity to put the global economy within everyone’s reach while doing the most important work of your career.About The TeamThe Batch Compute team at Stripe manages the infrastructure, tooling and systems behind running batch processing systems at Stripe, which are currently powered by Hadoop and Spark. Batch processing systems power several core asynchronous workflows at Stripe and operate at significant scale.What you’ll doWe're looking for a Software Engineer with experience designing, building and maintaining high-scale, distributed systems. You will work with a team that is in charge of the core infrastructure used by the product teams to build and operate batch processing jobs. You will have an opportunity to play a hands-on role in significantly rearchitecting our current infrastructure to be much more efficient and resilient. This re-architecture will introduce disaggregation of Hadoop storage and compute with open source solutions.ResponsibilitiesScope and lead technical projects within the Batch Compute domainBuild and maintain the infrastructure which powers the core of Stripe.Directly contribute to core systems and write code.Work closely with the open source community to identify opportunities for adopting new open source features as well contribute back to the OSS.Ensure operational excellence and enable a highly available, reliable and secure Batch Compute platformWho you areWe’re looking for someone who meets the minimum requirements to be considered for the role. If you meet these requirements, you are encouraged to apply. The preferred qualifications are a bonus, not a requirement.Minimum Requirements8+ years of professional experience writing high quality production level code or software programs.Have experience with distributed data systems such as Spark, Hadoop, Flink, Trino, Kafka ,etcExperience developing, maintaining and debugging distributed systems built with open source tools.Experience building infrastructure as a product centered around user needs.Experience optimizing the end to end performance of distributed systems.Experience with scaling distributed systems in a rapidly moving environment.Preferred QualificationsExperience as a user of batch processing systems (Hadoop, Spark) Track record of open source contributions to data processing or big data systems (Hadoop, Spark, Celeborn, Flink, etc)In-office expectationsOffice-assigned Stripes in most of our locations are currently expected to spend at least 50% of the time in a given month in their local office or with users. This expectation may vary depending on role, team and location. For example, Stripes in our Bucharest, Romania site have an 80% in-office expectation, and those in Stripe Delivery Center roles in Mexico City, Mexico and Bengaluru, India work 100% from the office. Also, some teams have greater in-office attendance requirements, to appropriately support our users and workflows, which the hiring manager will discuss. This approach helps strike a balance between bringing people together for in-person collaboration and learning from each other, while supporting flexibility when possible.Pay and benefitsStripe does not yet include pay ranges in job postings in every country. Stripe strongly values pay transparency and is working toward pay transparency globally.