Database Engineer

  • Location

    Toronto, Canada

  • Sector:

    Architecture

  • Job type:

    Temporary

  • Contact:

    Dhara Majmundar

  • Job ref:

    13429

  • Published:

    21 days ago

  • Duration:

    8.0

  • Expiry date:

    2019-09-30

  • Startdate:

    2019-10-07

  • Job Title:  Database Engineer
  • Type:         Contract (2 month)
  • Location:   Downtown Toronto, ON

Job Description:

Our client is currently looking for a Data Engineer to join a new Data Operations team they are building that will help transform and govern their data. The incumbent will rewrite the process to ensure they use the data in the most flexible, effective manner possible to help the business achieve its goals. Not only will the incumbent build out the tools, they will be designing, implementing, and maintaining different data architectures. The role also includes managing the flow of data from methods of input and its life cycle.

Responsibilities:

  • Create scalable data pipelines (ETL/ELT)
  • Write and optimize complex queries on large data sets
  • Transform data and map them to more valuable and understandable sets for consumption
  • Create tooling to help with day to day tasks
  • Troubleshoot issues related to data accuracy and create the source of truth
  • Help remove the friction from other members of the organization like Big data and analyst and allow them to focus on their primary objective
  • Introduce new technologies to the environment through research and POCs
  • Reduce toil by automation

Requirements:

  • Advanced experience with Python, SQL, including MapR/Hadoop, Spark, and Hive
  • Experience building ETL and big data pipelines with workflow management tools Airflow or Luigi
  • Experience with stream-processing systems: Storm, Flume, RabbitMQ, Kafka, etc.
  • Outstanding organizational skills, self-motivated, creative problem solving and high attention to detail
  • Ability to prioritize competing requests and multiple tasks in a fast-paced, deadline driven environment
  • Experience managing a project backlog and working cross-functionally with multiple stakeholders
  • Ability to work effectively on a self-organizing team with minimal supervision
  • Initiative in communicating with co-workers, asking questions and learning
  • Excellent oral and written communication skills
  • Proactive and creative problem solver with the ability to multitask and manage tight deadlines
  • Superior troubleshooting skills
  • Must be energetic and enthusiastic

Nice to Haves:

  • Experience in continuous integration/deployment tools
  • Exposure to working in Agile software development environment
  • ETLs with airflow.
  • Python
  • shell scripting (bash / powershell)
  • SQL ( tsql / ANSI )
  • RDBMS ( mssql / mysql )
  • key value stores ( couchase / redis )
  • kubernetes/chef/

Soft Skills

The ideal candidate is a person who is a generalist who can jump on any problem, and aspects of operations where no level of work is beneath them.

  • Problem solver
  • Dabbler of all thing’s technologies
  • Believer of automation
  • Reducer of toil
  • Loves to apply all their learning to advance themselves, the team and ultimately the company
  • Who enjoys sharing knowledge, guiding as well as growing your own knowledge base and experiences
  • Highly adaptive to changes, a two-way player, fun and supportive