Developer – Big Data (Hadoop Ecosystem)

Developer – Big Data (Hadoop Ecosystem)

ProViso Consulting

Story Behind the Need:

• Business Group: Emerging Technology & Platform Engineering is seeking a Senior Data Engineer/Developer for a Regulatory Project that is starting from scratch and involves setting data ingestion framework and pipelines. It is currently in the initial planning phase, the design phase is anticipated to begin in January while the project itself is to go up to 2022.

Candidate Value Proposition:

• The successful candidate will have the possibility to work on other various projects afterwards.

Typical Day in the Role:

• Create framework that can be adopted for multiple projects
• Setting up framework
• Following and setting best practices and standards
• Setting up reusable patterns
• Delegating tasks to other team members
• Ensuring data pipelines are delivered

Must Have Skills/Requirements:

• Big Data (Hadoop Ecosystem) – 3+ years of hands on experience
• Relational database – 3+ years of hands on experience
• Java Programming – 5+ years of hands on experience
• Setting up data pipelines using Java or any open source tool (Nifi preferred) – 3+ years of
• Kafka – 2+ years of hands on experience
• Customizing DevOps Pipelines (setting up their own Dev platform, and configuring Git & Jenkins pipelines) 2+ years
• Prior Technical Lead experience

Nice to have Skills:

• Enterprise scheduler (AutoSys, etc.) – orchestrating pipelines
• FI/Banking experience
• Agile experience

Soft Skills:

• Hands on but leading the development (guide other team members, delegate)
• Strong communication skills – verbal & written (technical documentation)

Job Details



7 Months



Latest Blogs

© 2020 ProViso Consulting - Toronto Recruitment and Staffing Agency

Send this to a friend