Data Engineer

𝗗𝗮𝘁𝗮 𝗘𝗻𝗴𝗶𝗻𝗲𝗲𝗿 (𝗪𝗲𝗯 𝗦𝗰𝗿𝗮𝗽𝗶𝗻𝗴 & 𝗔𝗜 𝗔𝘂𝘁𝗼𝗺𝗮𝘁𝗶𝗼𝗻) 𝗟𝗼𝗰𝗮𝘁𝗶𝗼𝗻: 𝗢𝗻𝘀𝗶𝘁𝗲/𝗡𝗦𝗧𝗣𝗕𝘂𝗶𝗹𝗱 𝘁𝗵𝗲 𝗽𝗶𝗽𝗲𝗹𝗶𝗻𝗲 𝘁𝗵𝗮𝘁 𝗽𝗼𝘄𝗲𝗿𝘀 𝗔𝗜 𝗱𝗿𝗶𝘃𝗲𝗻 𝗵𝗲𝗮𝗹𝘁𝗵𝗰𝗮𝗿𝗲. We are building a real time data intelligence engine that transforms the web into a structured, queryable database to power a groundbreaking Treatment Navigator. We need an engineer to architect the core data acquisition and automation systems that make this possible.𝗬𝗼𝘂𝗿 𝗠𝗶𝘀𝘀𝗶𝗼𝗻: *Architect and scale robust web scraping systems to collect data from thousands of dynamic sources using Scrapy, Playwright and Selenium.*Build and optimize high performance ETL pipelines that deliver clean, structured data for our AI models.*Develop resilient data workflows that intelligently adapt to source changes and ensure data quality at scale.*Apply AI agent frameworks to automate complex data extraction and enrichment tasks.*Integrate and manage data flow into and out of our Elasticsearch platform.𝗪𝗲’𝗿𝗲 𝗟𝗼𝗼𝗸𝗶𝗻𝗴 𝗙𝗼𝗿: *Proven experience building large scale web scraping systems with Scrapy and Playwright/Selenium.*Strong proficiency in Python and expert knowledge of data engineering best practices*Hands on experience with Elasticsearch.*Practical experience with AI agent frameworks (e.g., LangChain, CrewAI) and a clear understanding of how to apply them to automate and intelligentize data workflows.𝗪𝗵𝘆 𝗝𝗼𝗶𝗻 𝗨𝘀 At Victreat, we value your skills and contributions with an attractive compensation package. We invest in your professional growth through a variety of learning opportunities. Our collaborative team culture sparks creativity and helps you thrive in our dynamic environment. Here, you will pioneer groundbreaking advancements in healthcare technology and make a meaningful impact on the industry.𝗣𝗹𝗲𝗮𝘀𝗲 𝘀𝗲𝗻𝗱 𝘆𝗼𝘂𝗿 𝗿𝗲𝘀𝘂𝗺𝗲𝘀 𝗮𝘁: jobs@victreat.com.#HiringNow #Victreat #DataEngineers #AIAutomation #WebScraping #AIAgents #HealthcareAI #NSTP