Data Engineer – GCP, Big Data

Data Engineer – GCP, Big Data Skills Required:• Digital: Big Data and Hadoop Ecosystem – MapR• Digital: Google Data EngineeringJob Description:• Coordinate data conversations with stakeholders, data sources• Explore and analyze complex datasets to identify patterns and anomalies (SQL, Python)• Develop and deploy machine learning models• Work with business to understand logic• Lead data analytics process with the product team to gather insights and identify solutions• Collect, organize, analyze, and present insights• Organize project steps and document questions, findings, processes (Confluence, JIRA)• Proficiency in Python, R, BQ, SQL as well as experience with data manipulation, analysis• Data Engineer / Data Scientist expertise in cloud technologies like Google Cloud Platform (GCP), including tools like BigQuery• Data Engineer / Data Scientist combination of technical expertise, hands-on experience with data science tools and methodologies, familiarity with cloud technologies, and the ability to drive impactful insights from dataData Scientist:• Able to work with Data Engineer and recommend suggestions to pipeline changes for staging strategy for technical critical areas (pipeline performance, data model, scheduler arrangement for data availability)• End-to-end hands-on experience with setting up Data Pipeline using Airflow instanceData Engineer Qualifications:• Bachelors or Masters degree in Economics, Statistics, Data Science, Applied Mathematics, or a related field (PhD is a plus)• 3 years of experience in data modeling, preferably in a pricing or retail environment• Strong experience with regression models, time series forecasting, and causal inference• Proficiency in Python, R, or similar programming languages for data analysis• Knowledge of SQL and experience working with large datasets• Excellent communication skills with the ability to present complex concepts clearly• 4 years of experience as a data analyst• Must be able to work effectively both on teams as well as be self-motivated, task oriented, and organized• Strong customer focus and obsession with quality• Ability to work in a fast-paced and agile development environment• Ability to gather and document detailed requirements / user stories from stakeholders for a data request• Able to identify source systems and data steward• Able to write and run SQL queries from Data Lake, BigQuery, and Vendor Master as required• Validate query results to ensure it meets criteria / requirements• Stakeholder management• Experienced in JIRA, scrum ceremonies, and Agile Methodology• Familiarity with anomaly detection and a variety of ML models and algorithms• Excellent problem-solving skills and attention to detail• Curiosity and a passion for exploring and understanding complex datasets