To apply for this job you must first either login or register

Principal Data Engineer/Architect

Toronto, Ontario  - Permanent



Job Description

Our client believes that understanding data is a fundamental skill and when leveraged well, it can be used to elevate even the best designed products. This is why they are happy to be adding a Principal Data Engineer/Architect to their Platform team. They're looking for someone to work alongside our their Chief Architect, Data Engineers and PM's to improve and maintain the integrity of their data systems which are responsible for transforming the millions of raw logs they capture each day into actionable insights used by everybody in the company. These actionable insights are foundational to improving the user experience in their games in a meaningful way. This role is intended for a highly experienced and technically proficient candidate.


Must Have Skills:

-Strong SQL skills
-Experience with tools used for large scale data processing: Spark, Hadoop, Kafka
-Experience with AWS cloud services: EC2, EMR, RDS, Redshift, Kinesis, Api Gateway. Lambda
-Experience with object-oriented, functional and scripting languages: Scala, Python, Java
-Experience with relational SQL and NoSQL databases, including Redshift, Postgres, Redis and MySQL
-Knowledge of message queuing, stream processing, and highly scalable ‘big data’ technologies

You will be working on meaningful things like:
-Acquiring a complete understanding of how data moves and is transformed across our systems from raw event logs to critical reports consumed by internal teams
-Creating and maintaining optimal data pipelines within our architecture
-Building jobs and tools on top of the data pipeline to provide actionable insights into key metrics
-Debugging discrepancy issues that come up in the ETL (e.g. misaligned metrics with 3rd parties, duplicates, failures in the ETL, performance bottlenecks)
-Building tools to automate data verification and ensure integrity of our reported metrics
-Integrating data from multiple sources across internal and external partners
-Working alongside Architects and Project Managers to strive for greater functionality in our data systems


Details:
Starting: ASAP
Travel: 0%
Dress Code: Casual
To apply for this job you must first either login or register