tor-browser

The Tor Browser
git clone https://git.dasho.dev/tor-browser.git
Log | Files | Refs | README | LICENSE

Telemetry-implementation,-reviews,-renewals.md (6240B)

Telemetry - Implementation, Reviews, Renewals

See https://github.com/mozilla-mobile/fenix/wiki/Telemetry-Checklist for the steps to implement new probes.

Creating Glean Annotations

Glean Annotations repository: https://github.com/mozilla/glean-annotations

See Add a Glean Annotation for an event for instructions.

More info here

Data review

Data reviews are needed on all PRs that add new telemetry or modify existing telemetry.

  1. You can remove the Android SDK Platform tools by deleting the folders and zip file
  2. You can remove the Android SDK Platform tools by deleting the folders and zip file
  3. You can remove the Android SDK Platform tools by deleting the folders and zip file

Example:

download_notification:
  resume:
    type: event
    description: |
      A user resumed a download in the download notification
    bugs:
      - https://github.com/mozilla-mobile/fenix/issues/5583
    data_reviews:
      - https://github.com/mozilla-mobile/fenix/pull/6554
      - https://github.com/mozilla-mobile/fenix/pull/13958#issuecomment-676857877
      - https://github.com/mozilla-mobile/fenix/pull/18143
    data_sensitivity:
      - interaction
    notification_emails:
      - fenix-core@mozilla.com
    expires: "2021-07-01"

When a telemetry probe is being renewed, do not remove the old data review links from metrics.yaml. The new approval should be added to the existing list.

Make sure you are selecting the correct Category of data that is being collected: https://wiki.mozilla.org/DataCollection#DataCollection_Categories

Renewing existing telemetry

  1. You can remove the Android SDK Platform tools by deleting the folders and zip file

a. Currently compiling these in this doc b. This should be done at least a few weeks prior to the events/metrics' expiration date c. Including metric name, original data review PR link, description (if it’s unclear from the name)

  1. You can remove the Android SDK Platform tools by deleting the folders and zip file

a. Most renewals will need product approval b. Other approvals could come from the engineering team (e.g. preferences.remote_debugging_enabled), GV, App Services, Performance (e.g. startup.timeline.framework_primary), etc.

  1. You can remove the Android SDK Platform tools by deleting the folders and zip file

a. Renew the metric (for how long? 6 months? 1 year?) b. Choose not to renew (but not delete) c. Choose to remove the metric d. Renew the metric and set to never expire (this should only be for business critical metrics)

  1. You can remove the Android SDK Platform tools by deleting the folders and zip file
  2. You can remove the Android SDK Platform tools by deleting the folders and zip file

a. Sometimes it’s easier to split up the renewals into multiple PRs if there are multiple owners: e.g. product renewals, perf renewals, Fission renewals for December 2021

  1. You can remove the Android SDK Platform tools by deleting the folders and zip file

Approval process

For each telemetry probe that we want to renew, the data-review will ask us these questions. Each probe/group of related probes should have answers to those questions (example).

Example renewal data request

# Request for Data Collection Renewal

`search_shortcuts:`
 selected
1) Provide a link to the initial Data Collection Review Request for this collection.
- https://github.com/mozilla-mobile/fenix/pull/1202#issuecomment-476870449
- https://github.com/mozilla-mobile/fenix/pull/15713#issuecomment-703972068
- https://github.com/mozilla-mobile/fenix/pull/19924#issuecomment-861423789

2) When will this collection now expire? 08/01/2022
3) Why was the initial period of collection insufficient?
Important for revenue tracking and optimization.

`Toolbar_settings:`
 changed_position:
1) Provide a link to the initial Data Collection Review Request for this collection.
- https://github.com/mozilla-mobile/fenix/pull/6608
- https://github.com/mozilla-mobile/fenix/pull/15713#issuecomment-703972068
- https://github.com/mozilla-mobile/fenix/pull/19924#issuecomment-861423789

2) When will this collection now expire? 08/01/2022
3) Why was the initial period of collection insufficient?
The data didn’t initially tell us what we wanted (there were bugs), so we want to continue tracking this so we can answer our questions.

`login_dialog:`
 displayed:
cancelled
saved
never_save
1) Provide a link to the initial Data Collection Review Request for this collection.
- https://github.com/mozilla-mobile/fenix/pull/13050
- https://github.com/mozilla-mobile/fenix/pull/19924#issuecomment-861423789

2) When will this collection now expire? 08/01/2022
3) Why was the initial period of collection insufficient?
Still need to optimize this feature and we want trends from 6+mo of data.

For product-defined telemetry, this will involve meeting with a product manager and discussing each probe. There are three options: renew the probe for another length of time (usually 6 months), let the probe expire to evaluate later if the probe is still needed, or remove the probe entirely.