Our Methodology
How we ensure accurate, evidence-based assessments of campaign promises
Ottawa Accountability uses a rigorous triangulation methodology to ensure accurate and fair assessments of campaign promises. By cross-referencing multiple independent sources, we provide a comprehensive and reliable picture of how Ottawa's mayor and councillors are delivering on their commitments.
Three Points of Triangulation
Each promise assessment is validated through three independent sources, ensuring objectivity and accuracy in our evaluations.
1. Web-Based Research & Evidence
Our research team conducts comprehensive web-based research to gather evidence for each promise assessment. This includes:
- Reviewing official council minutes and public records
- Analyzing news reports and media coverage
- Examining government documents and policy announcements
- Tracking budget allocations and spending reports
- Monitoring official social media and public statements
Based on this research, promises are scored as Completed, In Progress, Stalled, or Not Started. Each assessment includes links to source materials so you can verify our findings.
2. Consultations with Mayor & City Councillors
We actively seek direct feedback from Ottawa's mayor and city councillors on their promise progress. This consultation process includes:
- Regular outreach to elected officials for status updates
- Opportunities for officials to provide context and additional information
- Verification of progress claims through official channels
- Documentation of official responses and clarifications
This direct engagement ensures that our assessments reflect the full picture of what officials are working on, including behind-the-scenes progress that may not be immediately visible through public records alone.
3. Citizen Panel Consultations by Riding
For each city ward, we convene citizen panels to provide ground-level perspective on promise fulfillment. These panels:
- Represent diverse perspectives from within each riding
- Assess visible progress and community impact
- Provide firsthand observations of local changes
- Offer context on how promises affect residents directly
Citizen panels help ensure that our assessments reflect not just official actions, but the real-world impact on Ottawa residents. This community perspective is essential for understanding whether promises are truly being fulfilled in meaningful ways.
How Triangulation Works
When all three sources align, we have high confidence in our assessment. When sources disagree, we:
- Investigate discrepancies through additional research
- Seek clarification from all parties involved
- Document conflicting information transparently
- Present a balanced assessment that acknowledges different perspectives
Promise Status Definitions
Completed
The promise has been fully implemented and verified through multiple sources. Evidence shows the commitment has been met.
In Progress
Active work is underway to fulfill the promise. Progress is documented and measurable steps have been taken.
Stalled
Progress has slowed significantly or stopped. Initial work may have begun, but there is no current evidence of active advancement.
Not Started
No evidence of work beginning on this promise. No action has been taken or documented.
Pass/Fail Assessment Criteria
Our Pass/Fail assessment is based on impact evaluation, not just progress. A promise receives a Pass grade only if it achieves meaningful impact relative to the original commitment. Progress alone does not guarantee a passing grade.
Example: Tree Planting Promise
Original Promise: "Plant one million trees over 4 years"
Current Status (after 3 years): 3,000 trees planted
Assessment: FAIL
Even though progress has been made (3,000 trees planted), this represents only 0.3% of the promised one million trees. At the current rate, the promise would take over 1,000 years to fulfill. This significant shortfall relative to the commitment results in a failing grade, as the promise has not achieved meaningful impact.
Key Principles:
- Impact over activity: We assess whether the promise has achieved meaningful impact, not just whether work has begun
- Proportional evaluation: Progress is measured against the scale and timeline of the original commitment
- Realistic trajectory: If current progress indicates the promise cannot be fulfilled within a reasonable timeframe, it receives a failing grade
- Context matters: We consider external factors, but officials are still held accountable for their commitments
This impact-based approach ensures that promises are evaluated on their actual contribution to improving Ottawa, not just on whether some work has been done. It encourages officials to make realistic commitments and follow through with meaningful action.
Our Commitment to Transparency
Every assessment on Ottawa Accountability includes:
- Source links to all evidence used in the assessment
- Date of last update and assessment review
- Clear explanation of how the status was determined
- Opportunity for officials and citizens to provide feedback
Questions About Our Methodology?
We're committed to transparency. If you have questions or would like to contribute to our assessment process, please reach out.