To apply for this job you must first either login or register

Senior Data Engineer

Toronto, Ontario  - Permanent



Job Description

We believe that understanding data is a fundamental skill and when leveraged well, it can be used to elevate even the best designed products. This is why we’re thrilled to be adding two Data Engineers to our engineering team. We are looking for people to work alongside our engineers and project managers to improve and maintain the integrity of our data systems which are responsible for transforming the millions of raw logs we capture each day into actionable insights used by everybody in the company. These actionable insights are foundational to improving the user experience in our products in a meaningful way. This role is intended for a highly experienced and technically proficient candidate.

You will work on:
• Acquiring a complete understanding of how data moves and is transformed across our systems from raw event logs to critical reports consumed by internal teams
• Creating and maintaining optimal data pipelines within our architecture
• Building jobs and tools on top of the data pipeline to provide actionable insights into key metrics
• Debugging discrepancy issues that come up in the ETL (e.g. misaligned metrics with 3rd parties, duplicates, failures in the ETL, performance bottlenecks)
• Building tools to automate data verification and ensure integrity of our reported metrics
• Integrating data from multiple sources across internal and external partners
• Working alongside Architects and Project Managers to strive for greater functionality in our data systems


Must Have Skills:

• Strong SQL skills
• Experience with tools used for large scale data processing: Spark, Hadoop, Kafka
• Experience with AWS cloud services: EC2, EMR, RDS, Redshift, Kinesis, Api Gateway. Lambda
• Experience with object-oriented, functional and scripting languages: Scala, Python, Java
• Experience with relational SQL and NoSQL databases, including Redshift, Postgres, Redis and MySQL
• Knowledge of message queuing, stream processing, and highly scalable ‘big data’ technologies


Nice to Have Skills:

• Knowledge of Machine Learning and experience implementing ML applications
• Worked with real time and streaming analytics
• Experience building tech that operates at scale
• Contributed to an Open Source Project


Details:
Starting: ASAP
Travel: 0%
Dress Code: Casual
To apply for this job you must first either login or register