Our team is using modern concepts, tools and technologies for data ingestion, acquisition and data consumption and work with Agile framework. We are structured into small, highly productive squads and working very close with the Data Lab team composed of Actuaries and Data Scientists.
You dream of exciting challenges at one of Canadas top 100 places to work? Join our team as Senior Data Engineer and contribute to the planning and execution of data pipelines for various machine learning projects.
You will:
• Design, implement, and maintain large-scale batch and real-time scalable data pipelines with complex data transformations;
• Perform data wrangling to transform and map data from raw data forms into formats more appropriate and valuable for analytics;
• Write and optimize complex queries on large data sets;
• Assemble large, complex data sets that meet functional / non-functional business requirements;
• Work with stakeholders to assist with data-related technical issues and support their data infrastructure needs;
• Experience working with business teams to translate functional requirements into technical requirements;
• Conduct business and functional requirements gathering and provide projects estimates;
• Experience supporting and working with cross-functional teams in a dynamic environment;
• Develops workflows and tools that automate data loading processes and help ensure data quality and integrity.
Your Skills
You are:
• Motivated and autonomous, you love learning and applying new technologies to solve complex problems;
• Eager to understand how the business works and how your work impacts the business;
• Comfortable working in complex environments and multidisciplinary teams;
• Fast learner, versatile and a good team player;
• Excellent communicator with good analytical skills.
You have:
• A bachelors degree in computer science, Software Engineering or equivalent;
• Hands-on experience with leading commercial Cloud platforms, including AWS and Azure;
• Excellent SQL, Python and PySpark skills;
• Strong experience with Apache Spark(Databricks or similar), Kafka and NiFi;
• Hands on experience with Hadoop distributions (Cloudera, Hortonworks) and Hive;
• Strong experience with relational SQL and NoSQL databases like PostgreSQL, Oracle, Cassandra, Mongo DB;
• Hands on experience with Snowflake or Redshift, or similar cloud storage technologies;
• Experience with ElasticSearch and Kibana is a big plus;
• Experience with Alation and/or other data catalog tools (Azure, Informatica) is a big plus;
• Experience with Kubernetes, Docker is a big plus;
• Experience with Agile development methodologies;
• Strong presentation, facilitation, verbal and written communication skills, including interpersonal skills.
Here are a few reasons why others have joined our team:
• An award-winning, inspiring workplace that supports its people and recognizes great work
• Stimulating, challenging projects and development opportunities to help you grow your skills and career
• Flexibility in how and where you work
• A comprehensive financial rewards program that recognizes your success
• An extensive, flexible benefits package
• An industry leading Employee Share Purchase Plan where we match 50% of net shares purchased
• A casual dress for your day culture that encourages you to be yourself
• A $350 annual wellness account that promotes an active lifestyle