Use this workflow when you receive reports missing or incorrect learning metrics in TimeBack Platform / TimeBack UI (XP, time, accuracy, mastery).
-
Confirm you are troubleshooting the TimeBack Platform / TimeBack UI.
- Check the Tracking stack in the Education Tracker for the relevant campus.
- If this campus is using the TimeBack Tracking Stack, consider whether the issue is about the standalone Timeback app.
- Check the Data Collection by team sheet.
- Anything affected by the browser (e.g., Learning App metrics are tracked via extensions) should be escalated per Timeback app.
-
Metrics are “missing” because we’re looking at the wrong timezone.
- The TimeBack UI shows different data depending on your browser timezone.
- See the timezone troubleshooting notes in TimeBack Platform - Overview.
- Re-check the same work day after normalizing/emulating the student’s timezone.
-
Expected delay: the work might have happened, but hasn’t updated yet.
- Review the “Adapters / delays” framing in the Data Collection by team sheet for known non-real-time behavior.
- If this looks like expected delay, send a PR with a “check again later” plan and tell the requester to reach back if there's still an issue after waiting.
- Reference: How does XP work in the TimeBack platform?
-
Missing test-related XP
- Review results in AlphaTest and compare with the expected XP from the Data Collection by team sheet.
- If the student is missing XP (partial or total), follow the Routing Table to find the team managing issues in AlphaTest and escalate.
-
The tooltip/breakdown already explains the discrepancy (expected behavior).
- Use the tooltip details to identify exactly which lesson/app entry did (or didn’t) contribute.
- If the expectation is incorrect, explain what the breakdown shows and stop here.
- If the expectation is correct and matches what's in the UI, consider if it could have been a delay, which self-resolved between the time of the report and the moment you checked.
- Reference: XP breakdown tooltip notes.
-
Caliper validation: query the Caliper events endpoint.
- Use the Postman guidance referenced in Querying Caliper Events.
- Be careful with pagination and confirm you are not excluding results.
- Summarize what you found (which subjects/lessons have events; which do not).
- If Caliper events are present, but missing/incorrect in TimeBack UI, escalate to the UI owners per ALPHA Routing Table.
-
Check the learning app and confirm the student submitted trackable work.
- Verify completion directly in the learning app.
- Most apps will have app-specific articles detailing how to review progress (e.g., How to review student progress in Mentava).
- If there’s no app-specific KB coverage, try searching recent past ticket (i.e., we might have recently-received information pending an article).
- If there's no coverage or recent tickets, try your best effort considering the expectations set by the Data Collection by team sheet and XP Guide.
- Use recordings as supporting evidence (date/time, app, lesson name, visible completion/submission).
- While checking recordings, consider if the app’s own behavior is broken, then follow Reporting Content or Technical Issues for Learning Apps.
- Important: Never involve any third-party app's support team before reviewing the current guidelines on the above article.
- If you cannot prove the work occurred because we lack app-specific knowledge/rules for the app, but you're unsure if this was an issue, escalate to Academics per ALPHA Routing Table.
- Verify completion directly in the learning app.
-
The work is confirmed in the app, this is not a delay, but it still missing from Caliper:
- Escalate to the team that owns the adapter/integration for that app.
- Mapping of team to app is on the Data Collection by team sheet.
- Reference: ALPHA Routing Table.
- Ownership context: How does XP work in the TimeBack platform?
-
Last resort (rare): manual XP credit/backfill.
- Only consider this after confirmation from the team maintaining the data (per the Data Collection by team sheet), directly stating that the XP cannot be granted through usual means.
- Important: Manual XP credit must never be used as a replacement for proper investigation/escalation.
- Reference: How to manually add or backfill XP in TimeBack.
Manuel da Silva
Comments