DataOps/Cloud Data Engineer (RQ08567)

Contract
Toronto
Posted 2 weeks ago
Applications have closed

Ministry of Transportation

Description

Deliverables section:

Scope of
Services and Deliverables – The Services and Deliverables to be provided by
the Vendor will include the following:

·
Participate in
the review of project, work request and maintenance release artefacts – Use
Case, System Requirement Specification, etc.

·
Deliver
detailed system design documents and any other supporting documentation
conforming to Ministry standards.

·
Design, develop
and optimize data/database CI/CD pipelines.

·
Design logical
and physical data models using Sybase Power Designer.

·
Prepare
database change in DACPAC and develop Azure CI/CD release pipeline to promote
DACPAC.

·
Promote
database changes through Development, Integration Testing, QA, UAT,
Production environments.

·
Provision data in
cloud environment according to requirements.

·
Design, develop
data loading, data conversion, data migration program.

·
Design, develop
and implement data conversation of VLD (Very large Data) of Online analytical
processing (OLAP) and online transaction processing (OLTP) environments to
Cloud Software-as-a-service (SaaS), Platform-as-a-service (PaaS) and
Infrastructure-as-a-service (IaaS) environments.

·
Design, develop
and implement fact/dimension model, data mapping, data warehouse, data lake
and data lakehouse.

·
Plan,
configure, maintain, administrate, tune performance of Oracle, Microsoft
Azure SQL database and Synapse database.

·
Support cloud-based
heterogeneous data replication solution.

·
Develop complex
Oracle PL/SQL program, SQL server stored procedure to fulfill project, work
request, maintenance requirements.

·
Optimize
performance of PL/SQL program, SQL server stored procedure.

·
Monitor and
analyze incident, provide timely resolution.

·
Perform
reference data administration as required.

·
Build and test
database backup/recovery scripts.

·
Build and test database
automation scripts.

·
Perform database
administration, including patching/upgrade, monitoring, performance tuning,
partitioning, capacity planning, OEM upgrade/enhancement, achieving, etc

·
Document and
resolve any database problems/issues.

·
Provide
effective knowledge transfer to Ministry staff at all stages of this
assignment.

Skills

Experience Requirements: Evaluation Table

Cloud DataOPS                                                                                                                40%

·        Expert experience with Microsoft Azure technologies, including Azure pipeline, DACPAC, storage account, disk, file share, Azure key vault, Azure portal, virtual machine, Azure DevOps, Data Lake, Data Lakehouse, Azure monitoring tools.

·        Experience with Cloud data platforms, data management and data exchange tools and technologies.

·        Experience with Data pipeline and workflow development, orchestration, deployment, and automation.

·        Experience in DataOPS principle, best practice, and implementation and Agile project development and deployment.

·        Experience in Continuous Integration/Continuous Development/Deployment (CI/CD) and Data provisioning Automation.

·        Experience with digital product, data analysis, data exchange, data provisioning, and data security.

·        Experience with structured, semi-structured, unstructured data collection, ingestion, provisioning and exchange technological development.

·        Experience with DataOPS performance monitoring and tuning.

Database Management                                                                                                40%

·        Expert data/database administration experience, e.g., Microsoft Azure SQL database and Synapse database, Oracle, IMS, DB2, etc.

·        Extensive experience with SQL Server Stored Procedure, Oracle PL/SQL, PL/1 development and performance tuning.

Data Replication Pipelines                                                                                          20%

·        Experience with Azure SQL, Oracle, IMS/DB2 data replication.

Supplier Comments: Req Closing Date/Time 2025-03-18, 12:30 p.m.

Max number of candidate submission – 3(Three)

Candidate is required to come in office – 3 days a week

Must haves:

Expert experience with Microsoft Azure technologies, including Azure pipeline, DACPAC, storage account, disk, file share, Azure key vault, Azure portal, virtual machine, Azure DevOps, Data Lake, Data Lakehouse, Azure monitoring tools.

HR

Login