RQ11828 – Software Developer – Intermediate

Role Overview:

The Government of Ontario is embarking on a large Data &
AI transformation initiative. Core to the transformation is the enablement of
the Ontario Data Platform (ODP), which is being developed as the enterprise
technology ecosystem for everything Data & AI. ODP is a modern ecosystem of
data solution consisting of data ingestion technologies, storage, processing
and visualization as well as solutions related to data governance, quality,
marketplace, etc. ODP will initially serve all internal government clusters,
ministries and program areas, but also external agencies in the future. We are
looking for a data scientist to support various initiatives related to the
platform as well as the execution of use cases to support the needs of various
businesses within the government.

Key Responsibilities:

Run and Monitor Inferences:

• Execute batch inference jobs on Databricks and other
  environments.
  
• Troubleshoot inference issues, log results, and escalate
  model anomalies.
  

Pipeline & Evaluation Support:

• Assist with running DSPy pipelines and loading custom
  models/configs.
  
• Support evaluation runs using internal metrics
  
• Track and summarize performance metrics for inference
  experiments.
  

Data Handling & Experimentation:

• Help prepare and clean legal text datasets for inference and
  evaluation.
  
• Annotate outputs to support error analysis and benchmarking.
  
• Maintain reproducible scripts/notebooks for inference runs.
  

Requirements

Experience and Skill Set Requirements:

Must Haves:

• Background in Computer Science, Data Science, or AI/ML
  (student or recent grad is good).
  
• Familiarity with Python and libraries like pandas,
  scikit-learn, or PyTorch.
  
• Exposure to LLM frameworks (DSPy, LangChain, Hugging Face,
  or equivalent).
  
• Comfortable working with Databricks / MLflow or other cloud
  ML environments.
  
• Detail-oriented with strong organizational skills for
  tracking experiments.
  

Skill Set Requirements:

Qualifications:

• Background in Computer Science, Data Science, or AI/ML (student or recent grad is good).
  
• Familiarity with Python and libraries like pandas,
  scikit-learn, or PyTorch.
  
• Exposure to LLM frameworks (DSPy, LangChain, Hugging
  Face, or equivalent).
  
• Comfortable working with Databricks / MLflow or other
  cloud ML environments.
  
• Detail-oriented with strong organizational skills for
  tracking experiments.
  

• Technical Skills
  
• LLM frameworks
  
• Databricks/MLflow