Levee Development Programme
Rugby School ยท Peer Feedback
Session 1
Waiting for facilitator to open scoring
Use your Rugby School email address
๐ How Peer Feedback Works
- Wait for the session to open โ The facilitator will unlock scoring when it's time
- Score each peer โ Assign one score to each group member using forced ranking (10, 9, 8, 7, then 5s)
- Write feedback for everyone โ Complete "I choose to follow you because..." for each peer
- Submit before time runs out โ Complete all scores and feedback, then click Submit
Your scores and feedback are anonymous and confidential โ they contribute to the Levee selection process.
© Resilient Leaders Elements Ltd. All rights reserved.
For the best experience and offline support, add Levee to your home screen.
Please Log In First
Go to the Home tab and enter your email address
Session Locked
Waiting for the facilitator to open scoring
No Scoring This Session
This is an introductory session โ peer feedback scoring will begin in the next activity evening.
No Group Assigned
The facilitator hasn't created groups for this session yet
Score Your Peers
Tap a score, then tap a peer to assign it
Available Scores
Your Peers
โ๏ธ Written Feedback (Required)
Complete the sentence: "I choose to follow you because..."
Admin Access
Enter your 6-digit PIN
๐ Load demo data for your presentation
๐ Facilitator Quick Guide
Before the session:
- Import students via the Import tab (Name, Email, Role, House format)
- Shuffle groups to create group assignments for this session
- Share the room code with students (displayed at top of screen)
Running each activity:
- Set timer (10-15 mins recommended)
- Click "Start & Unlock" to open scoring
- Monitor completion in the Groups tab
- Click "Stop & Lock" when complete or time runs out
Between sessions:
- Select next session (Session 2, 3, or 4)
- Shuffle groups again to create new combinations
- Leadership rotation happens automatically (3 HoH rotate into Heads group)
Session Control
๐ Time Slot
0 students๐ Attendance
0 presentLoading...
Students appear here when they log in via email. Tap any student to manually toggle absent. Use Mark Not-Logged-In Absent to auto-flag non-attendees.
๐บ Live Dashboard
Display real-time progress on projector
โฑ๏ธ Timer
๐ Group Management
Loading preview...
Leadership groups are created automatically with the correct rotation rules.
Clarity of Direction Groups
0 groupsNo groups created yet. Click "Shuffle" above to create groups.
All Students
| Name | Role | House | Pool | Actions |
|---|
๐ Leaderboard
Normalized scores adjust for group size so students in larger groups aren't penalised.
| Rank | Name | AoR | House | Score | Reviews |
|---|
๐ Area of Responsibility Leaderboard
Average scores aggregated by AoR for this session.
| Rank | Area of Responsibility | Students | Avg Score | Reviews |
|---|
๐ House Leaderboard
Average scores aggregated by House for this session.
| Rank | House | Students | Avg Score | Reviews |
|---|
๐ Normalized Scoring Methodology
1. The Challenge
In the Levee peer feedback system, students score their group peers using a forced ranking distribution. Each student must allocate specific scores to their peers:
| Rank | Score | Meaning |
|---|---|---|
| 1st | 10 | Exceptional leader |
| 2nd | 9 | Strong leader |
| 3rd | 8 | Good leader |
| 4th | 7 | Developing leader |
| 5th+ | 5 | Needs development |
The Problem: Different group sizes have different available score pools, creating an unfair comparison:
| Group Size | Peers to Score | Available Scores | Expected Average (ฮผ) | Std Dev (ฯ) |
|---|---|---|---|---|
| 5 | 4 | 10, 9, 8, 7 | 8.500 | 1.118 |
| 6 | 5 | 10, 9, 8, 7, 5 | 7.800 | 1.720 |
| 7 (baseline) | 6 | 10, 9, 8, 7, 5, 5 | 7.333 | 1.886 |
| 8 | 7 | 10, 9, 8, 7, 5, 5, 5 | 7.000 | 1.927 |
| 9 | 8 | 10, 9, 8, 7, 5, 5, 5, 5 | 6.750 | 1.920 |
| 10 | 9 | 10, 9, 8, 7, 5, 5, 5, 5, 5 | 6.556 | 1.892 |
โ ๏ธ Without normalization: A student performing "average" in a group of 5 would receive ~8.5, while an equally average performer in a group of 10 would receive ~6.2 โ a difference of 2.3 points through no fault of their own.
2. The Solution: Z-Score Normalization
We use standardized (Z-score) normalization to place all students on a fair, comparable scale regardless of their group size.
Step 1: Calculate Z-Score
Z = (Raw Score - ฮผgroup) / ฯgroup
Step 2: Convert to Normalized Score
Normalized = ฮผbaseline + (Z ร ฯbaseline)
Where:
- ฮผgroup = Expected average for the student's group size (from table above)
- ฯgroup = Standard deviation of available scores for that group size
- ฮผbaseline = 7.333 (expected average for group of 7, our reference point)
- ฯbaseline = 1.886 (standard deviation for group of 7)
3. Worked Examples
Example A: Student in Group of 5
Raw average received: 8.0
Group parameters: ฮผ = 8.500, ฯ = 1.118
Z-score: (8.0 - 8.500) / 1.118 = -0.447 (slightly below group average)
Normalized: 7.333 + (-0.447 ร 1.886) = 6.49
Example B: Student in Group of 10
Raw average received: 7.0
Group parameters: ฮผ = 6.556, ฯ = 1.892
Z-score: (7.0 - 6.556) / 1.892 = +0.235 (above group average)
Normalized: 7.333 + (0.235 ร 1.886) = 7.78
โ Result: Student B, despite having a lower raw score (7.0 vs 8.0), correctly ranks higher because they performed better relative to what was possible in their group.
4. Mathematical Properties
- Mean-preserving: A student scoring exactly at their group's expected average will receive the baseline score (7.33)
- Variance-adjusted: Accounts for different score spreads in different group sizes
- Rank-preserving within groups: Students' relative positions within their group are maintained
- Linear transformation: Preserves the relative distances between scores
5. Limitations & Considerations
- Assumes honest scoring: The model assumes all scorers use the full range appropriately
- Group composition effects: A strong student in a group of strong students may score lower than in a weaker group
- Small sample sizes: With few reviews, individual scores have high variance
- Cross-session comparison: Different group compositions each session mean normalized scores are most meaningful when aggregated
6. Reference Table
| Group Size | ฮผ (Mean) | ฯ (Std Dev) | Raw 10 โ Norm | Raw 5 โ Norm |
|---|
Levee Development Programme โข Rugby School โข Methodology v1.0
๐ Live Completion Monitor
๐ Reports & Export
๐ Session Summary Report
Comprehensive end-of-session report with activities, scoring & feedback
Session 1 Summary
๐ฅ Participation
๐ Top Performers (Normalized Scores)
๐ Score Distribution
๐ฅ Group-by-Group Summary
๐ฌ Feedback Highlights
๐ Programme Summary
๐ฅ Export Data
๐ All Scores (CSV)
Complete scoring data with feedback
๐ค Student Summary (CSV)
Average scores per student across all sessions
๐ฅ Group Report (CSV)
Group compositions and completion rates
๐ฌ All Feedback (CSV)
Anonymous feedback received per student
๐ค Individual Student Report
Student Name
RoleSession Scores
Feedback Received
๐ Facilitator Observations
๐ Session Comparison
| Metric | Clarity of Direction | Awareness | Leadership Presence | Resilient Decision Making |
|---|
๐ Consolidated Student Reports
Generate comprehensive reports covering all 4 Activity Evenings for the selection process.
๐ Area of Responsibility Summary
Compare performance across all 10 Areas of Responsibility, session by session.
๐ค Import Students
Upload CSV File
CSV with columns: Name, Email, Role, House (optional 4th column)
Import Format
One student per line: Name, Email, Role, House (House optional)
Valid Roles (10 Areas of Responsibility):
โ ๏ธ Danger Zone
๐ค User Management
Roles: Super Admin (full control) ยท Facilitator (run sessions) ยท Observer (view only)
| Name | Role | Assigned Groups | PIN | Status | Actions |
|---|
๐ Activity Log
| Time | User | Role | Action | Details |
|---|
โ๏ธ Settings
Programme Settings
๐ Session Configuration
Name each activity evening and enable/disable peer scoring.
๐ AoR Slot Pools
Assign each AoR to a pool. Pools alternate between Early and Late slots each evening.
๐ค Grouping Partnerships
Optionally pair small AoRs together for shuffling. Partnered AoRs form groups as one larger unit while students keep their individual AoR labels.
โ ๏ธ Danger Zone
These actions cannot be undone.