Senior Data Platform Engineer

Job title:

Senior Data Platform Engineer

Company

Royal Bank of Canada

Job description

Job SummaryJob DescriptionWhat is the opportunity?This is an opportunity within the Data & Analytics team at RBC Global Asset Management. We are seeking a hands-on, highly skilled, and motivated individual to join our dynamic team as a Senior Data Platform Engineer. As a key member of our data engineering team, you will play a crucial role in the development and implementation of GAM’s Data Platform. Your primary focus will be on designing, implementing, and maintaining robust data infrastructure to support our organization’s data needs and advance our capabilities pertaining to data engineering, BI, Machine Learning and AI.What you will do:Work closely with Data Engineering and Analytics team to drive business decisions using data.Build scalable data platform infrastructure using cloud native technologies to enable Data Engineering, Data Science and Reporting.Take ownership of end-to-end deliverables and ensure high quality data solutions adhering to data platform architecture guidelines and engineering best practices.Enable the deployment of batch and event-driven data pipelines using latest technologies such as Spark, NiFi, Kafka, and Airflow.Configure and manage scalable and managed SQL based self-serve compute platform using Starburst Trino.Implement data management tools to streamline data processing, testing, preparing, deploying, and monitoring.Improve the speed and quality of the data development process by applying DevOps principles to data workflow.Ensure data security standards are applied across the data pipelines.Troubleshoot and resolve data integration and data processing issues.Perform proof-of-concepts to implement hybrid cloud data strategy involving on-prem systems like S3, OpenShift, Trino, Spark with Cloud based solutions like Databricks, Azure, Snowflake, etc.Apply design-thinking and agile mindset in working with other engineers and business stakeholders to continuously experiment, iterate and deliver on new initiatives.Stay informed about emerging technologies and trends in data engineering domain.Lead, mentor, and inspire a team of engineers to achieve high performance levels.What you need:3-5 years of hands-on experience in big data processing using Spark, Python, NiFi, Kafka, and Airflow for on-premises and Cloud data platforms (Snowflakes, Databricks, Azure, AWS, GCP)2-3 years of experience with solution design, data ingestion, scheduling & monitoring of ETL/ELT jobs.2-3 years of system administration including Docker and Kubernetes platforms.Strong knowledge of UNIX-like operating systems and shell scripting skills.Expertise with DevOps tools, automation, and using Data Ops to develop data flows and the continuous use of data.Proficiency in writing and optimizing SQL queries and at least one programming languages like Java, Scala and/or Python.Nice-to-haveExperience with OpenShift, AirFlow, S3, Trino, Ranger and Hive.Knowledge of networking, information security and vulnerability management.Knowledge of creating dashboards using Prometheus and Grafana.Knowledge about data science tools and libraries.What’s in it for you?We thrive on the challenge of being our best, thinking progressively, continuing to grow, and working together to deliver trusted advice to help our clients thrive, and our communities prosper. We care about each other, reaching our potential, making a difference in our communities, and achieving mutual success.A comprehensive Total Rewards Program, including bonuses, flexible benefits, and competitive compensation.Leaders who support your development through coaching and managing opportunitiesOpportunities to take on progressively greater accountabilitiesWork in a dynamic, collaborative, progressive, and high-performing teamJob Skills Big Data Management, Cloud Computing, Database Development, Data Mining, Data Warehousing (DW), ETL Processing, Group Problem Solving, Quality Management, Requirements AnalysisAdditional Job DetailsAddress: RBC CENTRE, 155 WELLINGTON ST W:TORONTOCity: TORONTOCountry: CanadaWork hours/week: 37.5Employment Type: Full timePlatform: WEALTH MANAGEMENTJob Type: RegularPay Type: SalariedPosted Date: 2024-11-27Application Deadline: 2024-12-12Note: Applications will be accepted until 11:59 PM on the day prior to the application deadline date aboveInclusion and Equal Opportunity EmploymentAt RBC, we embrace diversity and inclusion for innovation and growth. We are committed to building inclusive teams and an equitable workplace for our employees to bring their true selves to work. We are taking actions to tackle issues of inequity and systemic bias to support our diverse talent, clients and communities.We also strive to provide an accessible candidate experience for our prospective employees with different abilities. Please let us know if you need any accommodations during the recruitment process.Join our Talent CommunityStay in-the-know about great career opportunities at RBC. Sign up and get customized info on our latest jobs, career tips and Recruitment events that matter to you.Expand your limits and create a new future together at RBC. Find out how we use our passion and drive to enhance the well-being of our clients and communities at .

Expected salary

Location

Toronto, ON

Job date

Fri, 29 Nov 2024 04:56:13 GMT

To help us track our recruitment effort, please indicate in your email/cover letter where (jobsnearcanada.com) you saw this job posting.