Log In
Sign Up
Requisition ID: 37305
Company
Located on the traditional, ancestral and unceded lands of the xʷməθkʷəy̓əm (Musqueam), Sḵwx̱wú7mesh (Squamish), and səlilwətaɬ (Tsleil-Waututh) Peoples, Vancouver has a commitment to becoming a City of Reconciliation. Vancouver consistently ranks as one of the world’s most liveable cities and is working towards being the greenest city in the world. Named among Canada’s Top 100 Employers, BC’s Top Employers, and Canada’s Greenest Employers, the City of Vancouver seeks colleagues who can help shape and embody our core commitments to sustainability, decolonization, equity and outstanding quality of life for all residents.
Consider joining our committed team of staff and being part of an innovative, inclusive and rewarding workplace.
Main Purpose & Function
The primary purpose of Computer Programmer III – Data Engineer is to perform data engineering work in support of capital or long term technology project implementations and requires strong knowledge and skills relating to data ingestion, data storage, processing, modeling, data lake and data warehouse design and implementation, building data pipelines, data integration, data testing, and data orchestration. The incumbent will perform complex programming and analysis work and /or configure, adapt and alter data structures, stores and pipelines for multiple applications built in many development languages to meet complex requirements. The Computer Programmer III – Data Engineer will also work as a project leader in a supervisory capacity with other data specialists and engineers, incorporating best technology solutions and showing leadership in the development of new data integration and ETL/ELT programming and development standards. The Computer Programmer III – Data Engineer works closely with Computer Programmer/ Analyst staff and other members of the Team to achieve the overall objectives of the City, Technology Services (TS), and the public. The Programmer shares knowledge and experience of computer techniques to provide solutions to technical and procedural problems. The incumbent exercises considerable independence of judgement in all technical aspects of work.
Specific Duties & Responsibilities
- Acts as an expert technical resource for data ingestion and pipelines (ETL/ELT development), data modeling, data lake and data warehouse design and implementation and preparing data for analysis efforts with data from multiple platforms, applications and technologies
- Analyzes highly complex business requirements and suggests solutions that will meet the functional and non-functional requirements including cost, security, and existing investments
- Generates technical specifications to design or redesign data warehouse, data lake and other enterprise components and applications associated with data delivery
- Leverages industry best practices to design, test, implement and support solutions
- Assures quality, security and compliance requirements are met for supported areas
- Develops ETL/ELT in the context of a project, while ensuring alignment to current and developing architecture
- Prepares Technical Design and Specification documents
- Creates implementation instructions and supports deployments
- Conducts design and peer reviews including individual and team unit testing
- Oversees technical issues and the work of other developers
- Works with TS teams to review problems, define and test solutions
- Participates in the development of architectural framework and design
- Evaluates and introduces new tools and techniques to the development team
- Proactively identifies areas for improvement, seek solutions and make recommendations
- Consults with managerial, engineering, business, and technical personnel to clarify program intent, requirements, identify problems, and suggest changes
- Performs or directs revision, repair, or expansion of existing IT systems to increase operating efficiency or adapt to new requirements
- Assists in the training and development of other members of the team and in the orientation of systems analysis
- Other duties/responsibilities as assigned
Qualifications
Education and Experience
- Completion of Grade 12 with courses in related subjects.
- Preference is given to candidates that have a bachelor degree or higher in Computer Science or a related discipline, or equivalent.
- Minimum 5 years proven experience in data engineering including ETL/ELT development for a range of environments, platforms and tools
Knowledge, Skills and Abilities
- Extensive experience developing solutions with ETL/ELT tools such as SSIS, FME, Azure Data Factory and Azure Synapse Pipelines
- Considerable experience developing data warehousing and data lake solutions
- Considerable experience developing in the SQL environment and cloud based proprietary vendor technologies such as Snowflake, Azure SQL data warehouse, Azure Synapse and others
- Considerable experience working with Microsoft SQL Server
- Considerable experience using DataOps methodologies, patterns and practices
- Strong background with the data development lifecycle, and common models (Kimball, etc.) with familiarity in best data management practices including dimensional modelling and semantic modeling.
- Working knowledge of computer programming including knowledge of one or more programming languages (e.g. C#, python), the software development life cycle, and development methodologies
- Excellent leadership skills and ability to develop and mentor others
- Ability to develop, document, review and revise work and strategic plans
- Strong analytical and problem solving skills
- Keeps up to date with developments in programming techniques, languages, software, architectural patterns, etc.
- Ability to manage projects, multiple priorities and respond to requests in a timely manner
- Ability to establish and maintain effective working relationships, and communicate well with both internally and externally with technical and non-technical staff
- Ability to handle business critical and sensitive information
- Demonstrated ability to work under pressure, manage multiple priorities and respond to requests in a timely manner
Where operationally appropriate and subject to change, the City of Vancouver has a Flexible Work Program. This program allows staff to work remotely 1 – 4 days a week from locations that are a daily commutable distance from their work at a City worksite. At this time this position is eligible to be part of the Flexible Work Program.
The City of Vancouver has a COVID-19 Mandatory Vaccination Policy. All external applicants applying to the City of Vancouver are required to be fully vaccinated as a condition of hire and subject to this policy as a condition of ongoing employment. Candidates may only be exempted from this requirement if they request and are approved for an accommodation based on a reason related to a Human Rights Code ground (such as disability). Such a request must be made during, not after, the recruitment process.
Business Unit/Department: IT, Digital Strategy & 311 (1070)
Affiliation: CUPE 15 Non Pks
Employment Type: Regular Full Time
Position Start Date: January, 2023
Salary Information: Pay Grade GR-031: $51.78 to $61.23 per hour
Application Close: November 20, 2022
At the City of Vancouver, we are committed to recruiting a diverse workforce that represents the community we so proudly serve. Indigenous applicants, people of colour, all genders, 2SLGBTQ+ and persons with disabilities are encouraged to apply. Accommodations will be provided upon request during the selection process. Learn more about our commitment to diversity and inclusion.
Before you click Apply now
Once you start your application you can save your work and leave the applications page, however please remember to submit your profile to the specific job requisition before the posting closing date.
In addition to uploading your cover letter and resume, part of the application process may include answering application questions related to the preferred requirements of the role which may take approx.. 5-10mins. Cover letters should express interest and highlight additional information relevant to the position and resumes should include a tailored summary of skills and experience related to the position.
