raptor.rst (989653B)
1 ###### 2 Raptor 3 ###### 4 5 Raptor is a performance-testing framework for running browser pageload and browser benchmark tests. Raptor is cross-browser compatible and is currently running in production on Firefox Desktop, Firefox Android GeckoView, Fenix, Reference Browser, Chromium, Chrome, Chrome for Android, Safari, and Safari Technology Preview. 6 7 - Contact: Dave Hunt [:davehunt] 8 - Source code: https://searchfox.org/mozilla-central/source/testing/raptor 9 - Good first bugs: https://codetribute.mozilla.org/projects/automation?project%3DRaptor 10 11 Raptor currently supports three test types: 1) page-load performance tests, 2) standard benchmark-performance tests, and 3) "scenario"-based tests, such as power, CPU, and memory-usage measurements on Android and Desktop. 12 13 Locally, Raptor can be invoked with the following command: 14 15 :: 16 17 ./mach raptor 18 19 20 .. toctree:: 21 :titlesonly: 22 23 browsertime 24 debugging 25 contributing 26 raptor-metrics 27 28 .. contents:: 29 :depth: 2 30 :local: 31 32 Raptor tests 33 ************ 34 35 The following documents all testing we have for Raptor. 36 37 Benchmarks 38 ---------- 39 Standard benchmarks are third-party tests (i.e. Speedometer) that we have integrated into Raptor to run per-commit in our production CI. To update any of these benchmarks, see `Updating Benchmark Tests <browsertime.html#updating-benchmark-tests>`_. 40 41 42 .. dropdown:: ares6 43 :class-container: anchor-id-ares6-b 44 45 * Command to Run Locally 46 47 .. code-block:: 48 49 ./mach raptor -t ares6 50 51 **Owner**: :jandem and SpiderMonkey Team 52 53 * **alert threshold**: 2.0 54 * **apps**: firefox, chrome, safari 55 * **expected**: pass 56 * **expose browser profiler**: true 57 * **gecko profile interval**: 1 58 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/ares6.toml#16>`__ 59 * **lower is better**: true 60 * **page cycles**: 4 61 * **page timeout**: 270000 62 * **subtest lower is better**: true 63 * **subtest unit**: ms 64 * **test url**: `<http://\<host\>:\<port\>/ARES-6/index.html?raptor>`__ 65 * **type**: benchmark 66 * **unit**: ms 67 * **Test Task**: 68 69 .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** 70 :widths: 30 15 15 15 15 71 :header-rows: 1 72 73 * - **Test Name** 74 - mozilla-central 75 - autoland 76 - mozilla-release 77 - mozilla-beta 78 * - **browsertime-benchmark-firefox-ares6** 79 - ❌ 80 - ❌ 81 - ❌ 82 - ❌ 83 84 85 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 86 :widths: 30 15 15 15 15 87 :header-rows: 1 88 89 * - **Test Name** 90 - mozilla-central 91 - autoland 92 - mozilla-release 93 - mozilla-beta 94 * - **browsertime-benchmark-firefox-ares6** 95 - ❌ 96 - ❌ 97 - ❌ 98 - ❌ 99 100 101 .. list-table:: **test-linux1804-64-qr/opt** 102 :widths: 30 15 15 15 15 103 :header-rows: 1 104 105 * - **Test Name** 106 - mozilla-central 107 - autoland 108 - mozilla-release 109 - mozilla-beta 110 * - **browsertime-benchmark-firefox-ares6** 111 - ❌ 112 - ❌ 113 - ❌ 114 - ❌ 115 116 117 .. list-table:: **test-linux1804-64-shippable-qr/opt** 118 :widths: 30 15 15 15 15 119 :header-rows: 1 120 121 * - **Test Name** 122 - mozilla-central 123 - autoland 124 - mozilla-release 125 - mozilla-beta 126 * - **browsertime-benchmark-chrome-ares6** 127 - ❌ 128 - ❌ 129 - ❌ 130 - ❌ 131 * - **browsertime-benchmark-firefox-ares6** 132 - ✅ 133 - ✅ 134 - ❌ 135 - ❌ 136 137 138 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 139 :widths: 30 15 15 15 15 140 :header-rows: 1 141 142 * - **Test Name** 143 - mozilla-central 144 - autoland 145 - mozilla-release 146 - mozilla-beta 147 * - **browsertime-benchmark-firefox-ares6** 148 - ❌ 149 - ❌ 150 - ❌ 151 - ❌ 152 153 154 .. list-table:: **test-macosx1470-64-shippable/opt** 155 :widths: 30 15 15 15 15 156 :header-rows: 1 157 158 * - **Test Name** 159 - mozilla-central 160 - autoland 161 - mozilla-release 162 - mozilla-beta 163 * - **browsertime-benchmark-chrome-ares6** 164 - ❌ 165 - ❌ 166 - ❌ 167 - ❌ 168 * - **browsertime-benchmark-firefox-ares6** 169 - ✅ 170 - ✅ 171 - ❌ 172 - ❌ 173 * - **browsertime-benchmark-safari-ares6** 174 - ❌ 175 - ❌ 176 - ❌ 177 - ❌ 178 179 180 .. list-table:: **test-macosx1470-64/opt** 181 :widths: 30 15 15 15 15 182 :header-rows: 1 183 184 * - **Test Name** 185 - mozilla-central 186 - autoland 187 - mozilla-release 188 - mozilla-beta 189 * - **browsertime-benchmark-firefox-ares6** 190 - ❌ 191 - ❌ 192 - ❌ 193 - ❌ 194 195 196 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 197 :widths: 30 15 15 15 15 198 :header-rows: 1 199 200 * - **Test Name** 201 - mozilla-central 202 - autoland 203 - mozilla-release 204 - mozilla-beta 205 * - **browsertime-benchmark-firefox-ares6** 206 - ❌ 207 - ❌ 208 - ❌ 209 - ❌ 210 211 212 .. list-table:: **test-windows11-64-24h2-shippable/opt** 213 :widths: 30 15 15 15 15 214 :header-rows: 1 215 216 * - **Test Name** 217 - mozilla-central 218 - autoland 219 - mozilla-release 220 - mozilla-beta 221 * - **browsertime-benchmark-chrome-ares6** 222 - ❌ 223 - ❌ 224 - ❌ 225 - ❌ 226 * - **browsertime-benchmark-firefox-ares6** 227 - ✅ 228 - ✅ 229 - ❌ 230 - ❌ 231 232 233 .. list-table:: **test-windows11-64-24h2/opt** 234 :widths: 30 15 15 15 15 235 :header-rows: 1 236 237 * - **Test Name** 238 - mozilla-central 239 - autoland 240 - mozilla-release 241 - mozilla-beta 242 * - **browsertime-benchmark-firefox-ares6** 243 - ❌ 244 - ❌ 245 - ❌ 246 - ❌ 247 248 249 250 .. dropdown:: assorted-dom 251 :class-container: anchor-id-assorted-dom-b 252 253 * Command to Run Locally 254 255 .. code-block:: 256 257 ./mach raptor -t assorted-dom 258 259 **Owner**: PerfTest Team 260 261 * **alert threshold**: 2.0 262 * **apps**: firefox, chrome, safari 263 * **expected**: pass 264 * **expose browser profiler**: true 265 * **gecko profile interval**: 1 266 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/assorted-dom.toml#16>`__ 267 * **lower is better**: true 268 * **page cycles**: 1 269 * **page timeout**: 60000 270 * **repository**: https://github.com/mozilla/perf-automation 271 * **repository path**: benchmarks/assorted-dom 272 * **repository revision**: 61332db584026b73e37066d717a162825408c36b 273 * **screen capture**: true 274 * **sparse checkout**: true 275 * **test url**: `<http://\<host\>:\<port\>/assorted/driver.html?raptor>`__ 276 * **type**: benchmark 277 * **unit**: ms 278 * **Test Task**: 279 280 .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** 281 :widths: 30 15 15 15 15 282 :header-rows: 1 283 284 * - **Test Name** 285 - mozilla-central 286 - autoland 287 - mozilla-release 288 - mozilla-beta 289 * - **browsertime-benchmark-firefox-assorted-dom** 290 - ❌ 291 - ❌ 292 - ❌ 293 - ❌ 294 295 296 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 297 :widths: 30 15 15 15 15 298 :header-rows: 1 299 300 * - **Test Name** 301 - mozilla-central 302 - autoland 303 - mozilla-release 304 - mozilla-beta 305 * - **browsertime-benchmark-firefox-assorted-dom** 306 - ❌ 307 - ❌ 308 - ❌ 309 - ❌ 310 311 312 .. list-table:: **test-linux1804-64-qr/opt** 313 :widths: 30 15 15 15 15 314 :header-rows: 1 315 316 * - **Test Name** 317 - mozilla-central 318 - autoland 319 - mozilla-release 320 - mozilla-beta 321 * - **browsertime-benchmark-firefox-assorted-dom** 322 - ❌ 323 - ❌ 324 - ❌ 325 - ❌ 326 327 328 .. list-table:: **test-linux1804-64-shippable-qr/opt** 329 :widths: 30 15 15 15 15 330 :header-rows: 1 331 332 * - **Test Name** 333 - mozilla-central 334 - autoland 335 - mozilla-release 336 - mozilla-beta 337 * - **browsertime-benchmark-chrome-assorted-dom** 338 - ❌ 339 - ❌ 340 - ❌ 341 - ❌ 342 * - **browsertime-benchmark-firefox-assorted-dom** 343 - ✅ 344 - ✅ 345 - ❌ 346 - ❌ 347 348 349 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 350 :widths: 30 15 15 15 15 351 :header-rows: 1 352 353 * - **Test Name** 354 - mozilla-central 355 - autoland 356 - mozilla-release 357 - mozilla-beta 358 * - **browsertime-benchmark-firefox-assorted-dom** 359 - ❌ 360 - ❌ 361 - ❌ 362 - ❌ 363 364 365 .. list-table:: **test-macosx1470-64-shippable/opt** 366 :widths: 30 15 15 15 15 367 :header-rows: 1 368 369 * - **Test Name** 370 - mozilla-central 371 - autoland 372 - mozilla-release 373 - mozilla-beta 374 * - **browsertime-benchmark-chrome-assorted-dom** 375 - ❌ 376 - ❌ 377 - ❌ 378 - ❌ 379 * - **browsertime-benchmark-firefox-assorted-dom** 380 - ✅ 381 - ✅ 382 - ❌ 383 - ❌ 384 * - **browsertime-benchmark-safari-assorted-dom** 385 - ❌ 386 - ❌ 387 - ❌ 388 - ❌ 389 390 391 .. list-table:: **test-macosx1470-64/opt** 392 :widths: 30 15 15 15 15 393 :header-rows: 1 394 395 * - **Test Name** 396 - mozilla-central 397 - autoland 398 - mozilla-release 399 - mozilla-beta 400 * - **browsertime-benchmark-firefox-assorted-dom** 401 - ❌ 402 - ❌ 403 - ❌ 404 - ❌ 405 406 407 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 408 :widths: 30 15 15 15 15 409 :header-rows: 1 410 411 * - **Test Name** 412 - mozilla-central 413 - autoland 414 - mozilla-release 415 - mozilla-beta 416 * - **browsertime-benchmark-firefox-assorted-dom** 417 - ❌ 418 - ❌ 419 - ❌ 420 - ❌ 421 422 423 .. list-table:: **test-windows11-64-24h2-shippable/opt** 424 :widths: 30 15 15 15 15 425 :header-rows: 1 426 427 * - **Test Name** 428 - mozilla-central 429 - autoland 430 - mozilla-release 431 - mozilla-beta 432 * - **browsertime-benchmark-chrome-assorted-dom** 433 - ❌ 434 - ❌ 435 - ❌ 436 - ❌ 437 * - **browsertime-benchmark-firefox-assorted-dom** 438 - ✅ 439 - ✅ 440 - ❌ 441 - ❌ 442 443 444 .. list-table:: **test-windows11-64-24h2/opt** 445 :widths: 30 15 15 15 15 446 :header-rows: 1 447 448 * - **Test Name** 449 - mozilla-central 450 - autoland 451 - mozilla-release 452 - mozilla-beta 453 * - **browsertime-benchmark-firefox-assorted-dom** 454 - ❌ 455 - ❌ 456 - ❌ 457 - ❌ 458 459 460 461 .. dropdown:: jetstream2 462 :class-container: anchor-id-jetstream2-b 463 464 * Command to Run Locally 465 466 .. code-block:: 467 468 ./mach raptor -t jetstream2 469 470 **Owner**: :jandem and SpiderMonkey Team 471 472 * **alert threshold**: 2.0 473 * **apps**: fenix, geckoview, chrome-m, cstm-car-m 474 * **expected**: pass 475 * **expose browser profiler**: true 476 * **gecko profile interval**: 1 477 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/jetstream2-mobile.toml#17>`__ 478 * **lower is better**: false 479 * **page cycles**: 4 480 * **page timeout**: 2000000 481 * **repository**: https://github.com/mozilla/perf-automation 482 * **repository path**: benchmarks/JetStream2 483 * **repository revision**: 61332db584026b73e37066d717a162825408c36b 484 * **sparse checkout**: true 485 * **subtest lower is better**: false 486 * **subtest unit**: score 487 * **test url**: `<http://\<host\>:\<port\>/index.html?raptor>`__ 488 * **type**: benchmark 489 * **unit**: score 490 * **Test Task**: 491 492 .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** 493 :widths: 30 15 15 15 15 494 :header-rows: 1 495 496 * - **Test Name** 497 - mozilla-central 498 - autoland 499 - mozilla-release 500 - mozilla-beta 501 * - **browsertime-benchmark-jetstream2-chrome-m-jetstream2-nofis** 502 - ❌ 503 - ❌ 504 - ❌ 505 - ❌ 506 * - **browsertime-benchmark-jetstream2-cstm-car-m-jetstream2-nofis** 507 - ❌ 508 - ❌ 509 - ❌ 510 - ❌ 511 * - **browsertime-benchmark-jetstream2-fenix-jetstream2** 512 - ✅ 513 - ❌ 514 - ❌ 515 - ❌ 516 * - **browsertime-benchmark-jetstream2-fenix-jetstream2-nofis** 517 - ✅ 518 - ❌ 519 - ❌ 520 - ❌ 521 * - **browsertime-benchmark-jetstream2-geckoview-jetstream2** 522 - ❌ 523 - ❌ 524 - ❌ 525 - ❌ 526 * - **browsertime-benchmark-jetstream2-geckoview-jetstream2-nofis** 527 - ❌ 528 - ❌ 529 - ❌ 530 - ❌ 531 532 533 .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** 534 :widths: 30 15 15 15 15 535 :header-rows: 1 536 537 * - **Test Name** 538 - mozilla-central 539 - autoland 540 - mozilla-release 541 - mozilla-beta 542 * - **browsertime-benchmark-jetstream2-fenix-jetstream2** 543 - ❌ 544 - ❌ 545 - ❌ 546 - ❌ 547 * - **browsertime-benchmark-jetstream2-fenix-jetstream2-nofis** 548 - ❌ 549 - ❌ 550 - ❌ 551 - ❌ 552 * - **browsertime-benchmark-jetstream2-geckoview-jetstream2** 553 - ❌ 554 - ❌ 555 - ❌ 556 - ❌ 557 * - **browsertime-benchmark-jetstream2-geckoview-jetstream2-nofis** 558 - ❌ 559 - ❌ 560 - ❌ 561 - ❌ 562 563 564 .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** 565 :widths: 30 15 15 15 15 566 :header-rows: 1 567 568 * - **Test Name** 569 - mozilla-central 570 - autoland 571 - mozilla-release 572 - mozilla-beta 573 * - **browsertime-benchmark-firefox-jetstream2** 574 - ❌ 575 - ❌ 576 - ❌ 577 - ❌ 578 579 580 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 581 :widths: 30 15 15 15 15 582 :header-rows: 1 583 584 * - **Test Name** 585 - mozilla-central 586 - autoland 587 - mozilla-release 588 - mozilla-beta 589 * - **browsertime-benchmark-firefox-jetstream2** 590 - ❌ 591 - ❌ 592 - ❌ 593 - ❌ 594 595 596 .. list-table:: **test-linux1804-64-qr/opt** 597 :widths: 30 15 15 15 15 598 :header-rows: 1 599 600 * - **Test Name** 601 - mozilla-central 602 - autoland 603 - mozilla-release 604 - mozilla-beta 605 * - **browsertime-benchmark-firefox-jetstream2** 606 - ❌ 607 - ❌ 608 - ❌ 609 - ❌ 610 611 612 .. list-table:: **test-linux1804-64-shippable-qr/opt** 613 :widths: 30 15 15 15 15 614 :header-rows: 1 615 616 * - **Test Name** 617 - mozilla-central 618 - autoland 619 - mozilla-release 620 - mozilla-beta 621 * - **browsertime-benchmark-chrome-jetstream2** 622 - ❌ 623 - ❌ 624 - ❌ 625 - ❌ 626 * - **browsertime-benchmark-firefox-jetstream2** 627 - ✅ 628 - ✅ 629 - ❌ 630 - ❌ 631 632 633 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 634 :widths: 30 15 15 15 15 635 :header-rows: 1 636 637 * - **Test Name** 638 - mozilla-central 639 - autoland 640 - mozilla-release 641 - mozilla-beta 642 * - **browsertime-benchmark-firefox-jetstream2** 643 - ❌ 644 - ❌ 645 - ❌ 646 - ❌ 647 648 649 .. list-table:: **test-macosx1470-64-shippable/opt** 650 :widths: 30 15 15 15 15 651 :header-rows: 1 652 653 * - **Test Name** 654 - mozilla-central 655 - autoland 656 - mozilla-release 657 - mozilla-beta 658 * - **browsertime-benchmark-chrome-jetstream2** 659 - ❌ 660 - ❌ 661 - ❌ 662 - ❌ 663 * - **browsertime-benchmark-firefox-jetstream2** 664 - ✅ 665 - ✅ 666 - ❌ 667 - ❌ 668 669 670 .. list-table:: **test-macosx1470-64/opt** 671 :widths: 30 15 15 15 15 672 :header-rows: 1 673 674 * - **Test Name** 675 - mozilla-central 676 - autoland 677 - mozilla-release 678 - mozilla-beta 679 * - **browsertime-benchmark-firefox-jetstream2** 680 - ❌ 681 - ❌ 682 - ❌ 683 - ❌ 684 685 686 .. list-table:: **test-macosx1500-aarch64-shippable/opt** 687 :widths: 30 15 15 15 15 688 :header-rows: 1 689 690 * - **Test Name** 691 - mozilla-central 692 - autoland 693 - mozilla-release 694 - mozilla-beta 695 * - **browsertime-benchmark-chrome-jetstream2** 696 - ❌ 697 - ❌ 698 - ❌ 699 - ❌ 700 * - **browsertime-benchmark-custom-car-jetstream2** 701 - ❌ 702 - ❌ 703 - ❌ 704 - ❌ 705 * - **browsertime-benchmark-firefox-jetstream2** 706 - ✅ 707 - ❌ 708 - ❌ 709 - ❌ 710 711 712 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 713 :widths: 30 15 15 15 15 714 :header-rows: 1 715 716 * - **Test Name** 717 - mozilla-central 718 - autoland 719 - mozilla-release 720 - mozilla-beta 721 * - **browsertime-benchmark-firefox-jetstream2** 722 - ❌ 723 - ❌ 724 - ❌ 725 - ❌ 726 727 728 .. list-table:: **test-windows11-64-24h2-shippable/opt** 729 :widths: 30 15 15 15 15 730 :header-rows: 1 731 732 * - **Test Name** 733 - mozilla-central 734 - autoland 735 - mozilla-release 736 - mozilla-beta 737 * - **browsertime-benchmark-chrome-jetstream2** 738 - ❌ 739 - ❌ 740 - ❌ 741 - ❌ 742 * - **browsertime-benchmark-firefox-jetstream2** 743 - ✅ 744 - ✅ 745 - ❌ 746 - ❌ 747 748 749 .. list-table:: **test-windows11-64-24h2/opt** 750 :widths: 30 15 15 15 15 751 :header-rows: 1 752 753 * - **Test Name** 754 - mozilla-central 755 - autoland 756 - mozilla-release 757 - mozilla-beta 758 * - **browsertime-benchmark-firefox-jetstream2** 759 - ❌ 760 - ❌ 761 - ❌ 762 - ❌ 763 764 765 **Owner**: :jandem and SpiderMonkey Team 766 767 * **alert threshold**: 2.0 768 * **apps**: firefox, chrome, safari, custom-car 769 * **expected**: pass 770 * **expose browser profiler**: true 771 * **gecko profile interval**: 1 772 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/jetstream2.toml#17>`__ 773 * **lower is better**: false 774 * **page cycles**: 4 775 * **page timeout**: 2000000 776 * **repository**: https://github.com/mozilla/perf-automation 777 * **repository path**: benchmarks/JetStream2 778 * **repository revision**: 6acd3f58f12dbd71cf4743666cad305862681630 779 * **sparse checkout**: true 780 * **subtest lower is better**: false 781 * **subtest unit**: score 782 * **test url**: `<http://\<host\>:\<port\>/index.html?raptor>`__ 783 * **type**: benchmark 784 * **unit**: score 785 * **Test Task**: 786 787 .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** 788 :widths: 30 15 15 15 15 789 :header-rows: 1 790 791 * - **Test Name** 792 - mozilla-central 793 - autoland 794 - mozilla-release 795 - mozilla-beta 796 * - **browsertime-benchmark-jetstream2-chrome-m-jetstream2-nofis** 797 - ❌ 798 - ❌ 799 - ❌ 800 - ❌ 801 * - **browsertime-benchmark-jetstream2-cstm-car-m-jetstream2-nofis** 802 - ❌ 803 - ❌ 804 - ❌ 805 - ❌ 806 * - **browsertime-benchmark-jetstream2-fenix-jetstream2** 807 - ✅ 808 - ❌ 809 - ❌ 810 - ❌ 811 * - **browsertime-benchmark-jetstream2-fenix-jetstream2-nofis** 812 - ✅ 813 - ❌ 814 - ❌ 815 - ❌ 816 * - **browsertime-benchmark-jetstream2-geckoview-jetstream2** 817 - ❌ 818 - ❌ 819 - ❌ 820 - ❌ 821 * - **browsertime-benchmark-jetstream2-geckoview-jetstream2-nofis** 822 - ❌ 823 - ❌ 824 - ❌ 825 - ❌ 826 827 828 .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** 829 :widths: 30 15 15 15 15 830 :header-rows: 1 831 832 * - **Test Name** 833 - mozilla-central 834 - autoland 835 - mozilla-release 836 - mozilla-beta 837 * - **browsertime-benchmark-jetstream2-fenix-jetstream2** 838 - ❌ 839 - ❌ 840 - ❌ 841 - ❌ 842 * - **browsertime-benchmark-jetstream2-fenix-jetstream2-nofis** 843 - ❌ 844 - ❌ 845 - ❌ 846 - ❌ 847 * - **browsertime-benchmark-jetstream2-geckoview-jetstream2** 848 - ❌ 849 - ❌ 850 - ❌ 851 - ❌ 852 * - **browsertime-benchmark-jetstream2-geckoview-jetstream2-nofis** 853 - ❌ 854 - ❌ 855 - ❌ 856 - ❌ 857 858 859 .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** 860 :widths: 30 15 15 15 15 861 :header-rows: 1 862 863 * - **Test Name** 864 - mozilla-central 865 - autoland 866 - mozilla-release 867 - mozilla-beta 868 * - **browsertime-benchmark-firefox-jetstream2** 869 - ❌ 870 - ❌ 871 - ❌ 872 - ❌ 873 874 875 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 876 :widths: 30 15 15 15 15 877 :header-rows: 1 878 879 * - **Test Name** 880 - mozilla-central 881 - autoland 882 - mozilla-release 883 - mozilla-beta 884 * - **browsertime-benchmark-firefox-jetstream2** 885 - ❌ 886 - ❌ 887 - ❌ 888 - ❌ 889 890 891 .. list-table:: **test-linux1804-64-qr/opt** 892 :widths: 30 15 15 15 15 893 :header-rows: 1 894 895 * - **Test Name** 896 - mozilla-central 897 - autoland 898 - mozilla-release 899 - mozilla-beta 900 * - **browsertime-benchmark-firefox-jetstream2** 901 - ❌ 902 - ❌ 903 - ❌ 904 - ❌ 905 906 907 .. list-table:: **test-linux1804-64-shippable-qr/opt** 908 :widths: 30 15 15 15 15 909 :header-rows: 1 910 911 * - **Test Name** 912 - mozilla-central 913 - autoland 914 - mozilla-release 915 - mozilla-beta 916 * - **browsertime-benchmark-chrome-jetstream2** 917 - ❌ 918 - ❌ 919 - ❌ 920 - ❌ 921 * - **browsertime-benchmark-firefox-jetstream2** 922 - ✅ 923 - ✅ 924 - ❌ 925 - ❌ 926 927 928 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 929 :widths: 30 15 15 15 15 930 :header-rows: 1 931 932 * - **Test Name** 933 - mozilla-central 934 - autoland 935 - mozilla-release 936 - mozilla-beta 937 * - **browsertime-benchmark-firefox-jetstream2** 938 - ❌ 939 - ❌ 940 - ❌ 941 - ❌ 942 943 944 .. list-table:: **test-macosx1470-64-shippable/opt** 945 :widths: 30 15 15 15 15 946 :header-rows: 1 947 948 * - **Test Name** 949 - mozilla-central 950 - autoland 951 - mozilla-release 952 - mozilla-beta 953 * - **browsertime-benchmark-chrome-jetstream2** 954 - ❌ 955 - ❌ 956 - ❌ 957 - ❌ 958 * - **browsertime-benchmark-firefox-jetstream2** 959 - ✅ 960 - ✅ 961 - ❌ 962 - ❌ 963 964 965 .. list-table:: **test-macosx1470-64/opt** 966 :widths: 30 15 15 15 15 967 :header-rows: 1 968 969 * - **Test Name** 970 - mozilla-central 971 - autoland 972 - mozilla-release 973 - mozilla-beta 974 * - **browsertime-benchmark-firefox-jetstream2** 975 - ❌ 976 - ❌ 977 - ❌ 978 - ❌ 979 980 981 .. list-table:: **test-macosx1500-aarch64-shippable/opt** 982 :widths: 30 15 15 15 15 983 :header-rows: 1 984 985 * - **Test Name** 986 - mozilla-central 987 - autoland 988 - mozilla-release 989 - mozilla-beta 990 * - **browsertime-benchmark-chrome-jetstream2** 991 - ❌ 992 - ❌ 993 - ❌ 994 - ❌ 995 * - **browsertime-benchmark-custom-car-jetstream2** 996 - ❌ 997 - ❌ 998 - ❌ 999 - ❌ 1000 * - **browsertime-benchmark-firefox-jetstream2** 1001 - ✅ 1002 - ❌ 1003 - ❌ 1004 - ❌ 1005 1006 1007 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 1008 :widths: 30 15 15 15 15 1009 :header-rows: 1 1010 1011 * - **Test Name** 1012 - mozilla-central 1013 - autoland 1014 - mozilla-release 1015 - mozilla-beta 1016 * - **browsertime-benchmark-firefox-jetstream2** 1017 - ❌ 1018 - ❌ 1019 - ❌ 1020 - ❌ 1021 1022 1023 .. list-table:: **test-windows11-64-24h2-shippable/opt** 1024 :widths: 30 15 15 15 15 1025 :header-rows: 1 1026 1027 * - **Test Name** 1028 - mozilla-central 1029 - autoland 1030 - mozilla-release 1031 - mozilla-beta 1032 * - **browsertime-benchmark-chrome-jetstream2** 1033 - ❌ 1034 - ❌ 1035 - ❌ 1036 - ❌ 1037 * - **browsertime-benchmark-firefox-jetstream2** 1038 - ✅ 1039 - ✅ 1040 - ❌ 1041 - ❌ 1042 1043 1044 .. list-table:: **test-windows11-64-24h2/opt** 1045 :widths: 30 15 15 15 15 1046 :header-rows: 1 1047 1048 * - **Test Name** 1049 - mozilla-central 1050 - autoland 1051 - mozilla-release 1052 - mozilla-beta 1053 * - **browsertime-benchmark-firefox-jetstream2** 1054 - ❌ 1055 - ❌ 1056 - ❌ 1057 - ❌ 1058 1059 1060 1061 .. dropdown:: jetstream3 1062 :class-container: anchor-id-jetstream3-b 1063 1064 * Command to Run Locally 1065 1066 .. code-block:: 1067 1068 ./mach raptor -t jetstream3 1069 1070 **Owner**: :jandem and spidermonkey team 1071 1072 * **alert threshold**: 2.0 1073 * **apps**: firefox, chrome, safari, safari-tp, custom-car 1074 * **expected**: pass 1075 * **expose browser profiler**: true 1076 * **expose chrome trace**: true 1077 * **gecko profile interval**: 1 1078 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/jetstream3-desktop.toml#17>`__ 1079 * **lower is better**: false 1080 * **page cycles**: 1 1081 * **page timeout**: 2000000 1082 * **repository**: https://github.com/webkit/jetstream 1083 * **repository revision**: a3f5c45465f5271bed385321a0587bd4202682d6 1084 * **subtest alert threshold**: 5.0 1085 * **subtest lower is better**: true 1086 * **subtest unit**: ms 1087 * **suite name**: JetStream3.0 1088 * **support class**: jetstream3.py 1089 * **test script**: jetstream3.js 1090 * **test url**: `<http://\<host\>:\<port\>/>`__ 1091 * **type**: benchmark 1092 * **unit**: score 1093 * **Test Task**: 1094 1095 .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** 1096 :widths: 30 15 15 15 15 1097 :header-rows: 1 1098 1099 * - **Test Name** 1100 - mozilla-central 1101 - autoland 1102 - mozilla-release 1103 - mozilla-beta 1104 * - **browsertime-benchmark-jetstream3-chrome-m-jetstream3-nofis** 1105 - ❌ 1106 - ❌ 1107 - ❌ 1108 - ❌ 1109 * - **browsertime-benchmark-jetstream3-cstm-car-m-jetstream3-nofis** 1110 - ❌ 1111 - ❌ 1112 - ❌ 1113 - ❌ 1114 * - **browsertime-benchmark-jetstream3-fenix-jetstream3** 1115 - ✅ 1116 - ✅ 1117 - ❌ 1118 - ❌ 1119 * - **browsertime-benchmark-jetstream3-fenix-jetstream3-nofis** 1120 - ✅ 1121 - ✅ 1122 - ❌ 1123 - ❌ 1124 1125 1126 .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** 1127 :widths: 30 15 15 15 15 1128 :header-rows: 1 1129 1130 * - **Test Name** 1131 - mozilla-central 1132 - autoland 1133 - mozilla-release 1134 - mozilla-beta 1135 * - **browsertime-benchmark-jetstream3-fenix-jetstream3** 1136 - ❌ 1137 - ❌ 1138 - ❌ 1139 - ❌ 1140 * - **browsertime-benchmark-jetstream3-fenix-jetstream3-nofis** 1141 - ❌ 1142 - ❌ 1143 - ❌ 1144 - ❌ 1145 1146 1147 .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** 1148 :widths: 30 15 15 15 15 1149 :header-rows: 1 1150 1151 * - **Test Name** 1152 - mozilla-central 1153 - autoland 1154 - mozilla-release 1155 - mozilla-beta 1156 * - **browsertime-benchmark-firefox-jetstream3** 1157 - ❌ 1158 - ❌ 1159 - ❌ 1160 - ❌ 1161 1162 1163 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 1164 :widths: 30 15 15 15 15 1165 :header-rows: 1 1166 1167 * - **Test Name** 1168 - mozilla-central 1169 - autoland 1170 - mozilla-release 1171 - mozilla-beta 1172 * - **browsertime-benchmark-firefox-jetstream3** 1173 - ❌ 1174 - ❌ 1175 - ❌ 1176 - ❌ 1177 1178 1179 .. list-table:: **test-linux1804-64-qr/opt** 1180 :widths: 30 15 15 15 15 1181 :header-rows: 1 1182 1183 * - **Test Name** 1184 - mozilla-central 1185 - autoland 1186 - mozilla-release 1187 - mozilla-beta 1188 * - **browsertime-benchmark-firefox-jetstream3** 1189 - ❌ 1190 - ❌ 1191 - ❌ 1192 - ❌ 1193 1194 1195 .. list-table:: **test-linux1804-64-shippable-qr/opt** 1196 :widths: 30 15 15 15 15 1197 :header-rows: 1 1198 1199 * - **Test Name** 1200 - mozilla-central 1201 - autoland 1202 - mozilla-release 1203 - mozilla-beta 1204 * - **browsertime-benchmark-chrome-jetstream3** 1205 - ❌ 1206 - ❌ 1207 - ❌ 1208 - ❌ 1209 * - **browsertime-benchmark-custom-car-jetstream3** 1210 - ❌ 1211 - ❌ 1212 - ❌ 1213 - ❌ 1214 * - **browsertime-benchmark-firefox-jetstream3** 1215 - ✅ 1216 - ✅ 1217 - ❌ 1218 - ❌ 1219 1220 1221 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 1222 :widths: 30 15 15 15 15 1223 :header-rows: 1 1224 1225 * - **Test Name** 1226 - mozilla-central 1227 - autoland 1228 - mozilla-release 1229 - mozilla-beta 1230 * - **browsertime-benchmark-firefox-jetstream3** 1231 - ❌ 1232 - ❌ 1233 - ❌ 1234 - ❌ 1235 1236 1237 .. list-table:: **test-macosx1470-64-shippable/opt** 1238 :widths: 30 15 15 15 15 1239 :header-rows: 1 1240 1241 * - **Test Name** 1242 - mozilla-central 1243 - autoland 1244 - mozilla-release 1245 - mozilla-beta 1246 * - **browsertime-benchmark-chrome-jetstream3** 1247 - ❌ 1248 - ❌ 1249 - ❌ 1250 - ❌ 1251 * - **browsertime-benchmark-custom-car-jetstream3** 1252 - ❌ 1253 - ❌ 1254 - ❌ 1255 - ❌ 1256 * - **browsertime-benchmark-firefox-jetstream3** 1257 - ✅ 1258 - ✅ 1259 - ❌ 1260 - ❌ 1261 * - **browsertime-benchmark-safari-jetstream3** 1262 - ❌ 1263 - ❌ 1264 - ❌ 1265 - ❌ 1266 1267 1268 .. list-table:: **test-macosx1470-64/opt** 1269 :widths: 30 15 15 15 15 1270 :header-rows: 1 1271 1272 * - **Test Name** 1273 - mozilla-central 1274 - autoland 1275 - mozilla-release 1276 - mozilla-beta 1277 * - **browsertime-benchmark-firefox-jetstream3** 1278 - ❌ 1279 - ❌ 1280 - ❌ 1281 - ❌ 1282 1283 1284 .. list-table:: **test-macosx1500-aarch64-shippable/opt** 1285 :widths: 30 15 15 15 15 1286 :header-rows: 1 1287 1288 * - **Test Name** 1289 - mozilla-central 1290 - autoland 1291 - mozilla-release 1292 - mozilla-beta 1293 * - **browsertime-benchmark-chrome-jetstream3** 1294 - ❌ 1295 - ❌ 1296 - ❌ 1297 - ❌ 1298 * - **browsertime-benchmark-custom-car-jetstream3** 1299 - ❌ 1300 - ❌ 1301 - ❌ 1302 - ❌ 1303 * - **browsertime-benchmark-firefox-jetstream3** 1304 - ✅ 1305 - ✅ 1306 - ❌ 1307 - ❌ 1308 * - **browsertime-benchmark-safari-jetstream3** 1309 - ❌ 1310 - ❌ 1311 - ❌ 1312 - ❌ 1313 * - **browsertime-benchmark-safari-tp-jetstream3** 1314 - ❌ 1315 - ❌ 1316 - ❌ 1317 - ❌ 1318 1319 1320 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 1321 :widths: 30 15 15 15 15 1322 :header-rows: 1 1323 1324 * - **Test Name** 1325 - mozilla-central 1326 - autoland 1327 - mozilla-release 1328 - mozilla-beta 1329 * - **browsertime-benchmark-firefox-jetstream3** 1330 - ❌ 1331 - ❌ 1332 - ❌ 1333 - ❌ 1334 1335 1336 .. list-table:: **test-windows11-64-24h2-shippable/opt** 1337 :widths: 30 15 15 15 15 1338 :header-rows: 1 1339 1340 * - **Test Name** 1341 - mozilla-central 1342 - autoland 1343 - mozilla-release 1344 - mozilla-beta 1345 * - **browsertime-benchmark-chrome-jetstream3** 1346 - ❌ 1347 - ❌ 1348 - ❌ 1349 - ❌ 1350 * - **browsertime-benchmark-custom-car-jetstream3** 1351 - ❌ 1352 - ❌ 1353 - ❌ 1354 - ❌ 1355 * - **browsertime-benchmark-firefox-jetstream3** 1356 - ✅ 1357 - ✅ 1358 - ❌ 1359 - ❌ 1360 1361 1362 .. list-table:: **test-windows11-64-24h2/opt** 1363 :widths: 30 15 15 15 15 1364 :header-rows: 1 1365 1366 * - **Test Name** 1367 - mozilla-central 1368 - autoland 1369 - mozilla-release 1370 - mozilla-beta 1371 * - **browsertime-benchmark-firefox-jetstream3** 1372 - ❌ 1373 - ❌ 1374 - ❌ 1375 - ❌ 1376 1377 1378 **Owner**: :jandem and spidermonkey team 1379 1380 * **alert threshold**: 2.0 1381 * **apps**: chrome-m, cstm-car-m, fenix 1382 * **expected**: pass 1383 * **expose browser profiler**: true 1384 * **gecko profile interval**: 1 1385 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/jetstream3-mobile.toml#22>`__ 1386 * **lower is better**: false 1387 * **page cycles**: 1 1388 * **page timeout**: 2000000 1389 * **preferences**: dom.max_script_run_time=0 1390 * **repository**: https://github.com/webkit/jetstream 1391 * **repository revision**: a3f5c45465f5271bed385321a0587bd4202682d6 1392 * **subtest alert threshold**: 5.0 1393 * **subtest lower is better**: true 1394 * **subtest unit**: ms 1395 * **suite name**: JetStream3.0 1396 * **support class**: jetstream3.py 1397 * **test script**: jetstream3.js 1398 * **test url**: `<http://\<host\>:\<port\>/>`__ 1399 * **type**: benchmark 1400 * **unit**: score 1401 * **Test Task**: 1402 1403 .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** 1404 :widths: 30 15 15 15 15 1405 :header-rows: 1 1406 1407 * - **Test Name** 1408 - mozilla-central 1409 - autoland 1410 - mozilla-release 1411 - mozilla-beta 1412 * - **browsertime-benchmark-jetstream3-chrome-m-jetstream3-nofis** 1413 - ❌ 1414 - ❌ 1415 - ❌ 1416 - ❌ 1417 * - **browsertime-benchmark-jetstream3-cstm-car-m-jetstream3-nofis** 1418 - ❌ 1419 - ❌ 1420 - ❌ 1421 - ❌ 1422 * - **browsertime-benchmark-jetstream3-fenix-jetstream3** 1423 - ✅ 1424 - ✅ 1425 - ❌ 1426 - ❌ 1427 * - **browsertime-benchmark-jetstream3-fenix-jetstream3-nofis** 1428 - ✅ 1429 - ✅ 1430 - ❌ 1431 - ❌ 1432 1433 1434 .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** 1435 :widths: 30 15 15 15 15 1436 :header-rows: 1 1437 1438 * - **Test Name** 1439 - mozilla-central 1440 - autoland 1441 - mozilla-release 1442 - mozilla-beta 1443 * - **browsertime-benchmark-jetstream3-fenix-jetstream3** 1444 - ❌ 1445 - ❌ 1446 - ❌ 1447 - ❌ 1448 * - **browsertime-benchmark-jetstream3-fenix-jetstream3-nofis** 1449 - ❌ 1450 - ❌ 1451 - ❌ 1452 - ❌ 1453 1454 1455 .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** 1456 :widths: 30 15 15 15 15 1457 :header-rows: 1 1458 1459 * - **Test Name** 1460 - mozilla-central 1461 - autoland 1462 - mozilla-release 1463 - mozilla-beta 1464 * - **browsertime-benchmark-firefox-jetstream3** 1465 - ❌ 1466 - ❌ 1467 - ❌ 1468 - ❌ 1469 1470 1471 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 1472 :widths: 30 15 15 15 15 1473 :header-rows: 1 1474 1475 * - **Test Name** 1476 - mozilla-central 1477 - autoland 1478 - mozilla-release 1479 - mozilla-beta 1480 * - **browsertime-benchmark-firefox-jetstream3** 1481 - ❌ 1482 - ❌ 1483 - ❌ 1484 - ❌ 1485 1486 1487 .. list-table:: **test-linux1804-64-qr/opt** 1488 :widths: 30 15 15 15 15 1489 :header-rows: 1 1490 1491 * - **Test Name** 1492 - mozilla-central 1493 - autoland 1494 - mozilla-release 1495 - mozilla-beta 1496 * - **browsertime-benchmark-firefox-jetstream3** 1497 - ❌ 1498 - ❌ 1499 - ❌ 1500 - ❌ 1501 1502 1503 .. list-table:: **test-linux1804-64-shippable-qr/opt** 1504 :widths: 30 15 15 15 15 1505 :header-rows: 1 1506 1507 * - **Test Name** 1508 - mozilla-central 1509 - autoland 1510 - mozilla-release 1511 - mozilla-beta 1512 * - **browsertime-benchmark-chrome-jetstream3** 1513 - ❌ 1514 - ❌ 1515 - ❌ 1516 - ❌ 1517 * - **browsertime-benchmark-custom-car-jetstream3** 1518 - ❌ 1519 - ❌ 1520 - ❌ 1521 - ❌ 1522 * - **browsertime-benchmark-firefox-jetstream3** 1523 - ✅ 1524 - ✅ 1525 - ❌ 1526 - ❌ 1527 1528 1529 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 1530 :widths: 30 15 15 15 15 1531 :header-rows: 1 1532 1533 * - **Test Name** 1534 - mozilla-central 1535 - autoland 1536 - mozilla-release 1537 - mozilla-beta 1538 * - **browsertime-benchmark-firefox-jetstream3** 1539 - ❌ 1540 - ❌ 1541 - ❌ 1542 - ❌ 1543 1544 1545 .. list-table:: **test-macosx1470-64-shippable/opt** 1546 :widths: 30 15 15 15 15 1547 :header-rows: 1 1548 1549 * - **Test Name** 1550 - mozilla-central 1551 - autoland 1552 - mozilla-release 1553 - mozilla-beta 1554 * - **browsertime-benchmark-chrome-jetstream3** 1555 - ❌ 1556 - ❌ 1557 - ❌ 1558 - ❌ 1559 * - **browsertime-benchmark-custom-car-jetstream3** 1560 - ❌ 1561 - ❌ 1562 - ❌ 1563 - ❌ 1564 * - **browsertime-benchmark-firefox-jetstream3** 1565 - ✅ 1566 - ✅ 1567 - ❌ 1568 - ❌ 1569 * - **browsertime-benchmark-safari-jetstream3** 1570 - ❌ 1571 - ❌ 1572 - ❌ 1573 - ❌ 1574 1575 1576 .. list-table:: **test-macosx1470-64/opt** 1577 :widths: 30 15 15 15 15 1578 :header-rows: 1 1579 1580 * - **Test Name** 1581 - mozilla-central 1582 - autoland 1583 - mozilla-release 1584 - mozilla-beta 1585 * - **browsertime-benchmark-firefox-jetstream3** 1586 - ❌ 1587 - ❌ 1588 - ❌ 1589 - ❌ 1590 1591 1592 .. list-table:: **test-macosx1500-aarch64-shippable/opt** 1593 :widths: 30 15 15 15 15 1594 :header-rows: 1 1595 1596 * - **Test Name** 1597 - mozilla-central 1598 - autoland 1599 - mozilla-release 1600 - mozilla-beta 1601 * - **browsertime-benchmark-chrome-jetstream3** 1602 - ❌ 1603 - ❌ 1604 - ❌ 1605 - ❌ 1606 * - **browsertime-benchmark-custom-car-jetstream3** 1607 - ❌ 1608 - ❌ 1609 - ❌ 1610 - ❌ 1611 * - **browsertime-benchmark-firefox-jetstream3** 1612 - ✅ 1613 - ✅ 1614 - ❌ 1615 - ❌ 1616 * - **browsertime-benchmark-safari-jetstream3** 1617 - ❌ 1618 - ❌ 1619 - ❌ 1620 - ❌ 1621 * - **browsertime-benchmark-safari-tp-jetstream3** 1622 - ❌ 1623 - ❌ 1624 - ❌ 1625 - ❌ 1626 1627 1628 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 1629 :widths: 30 15 15 15 15 1630 :header-rows: 1 1631 1632 * - **Test Name** 1633 - mozilla-central 1634 - autoland 1635 - mozilla-release 1636 - mozilla-beta 1637 * - **browsertime-benchmark-firefox-jetstream3** 1638 - ❌ 1639 - ❌ 1640 - ❌ 1641 - ❌ 1642 1643 1644 .. list-table:: **test-windows11-64-24h2-shippable/opt** 1645 :widths: 30 15 15 15 15 1646 :header-rows: 1 1647 1648 * - **Test Name** 1649 - mozilla-central 1650 - autoland 1651 - mozilla-release 1652 - mozilla-beta 1653 * - **browsertime-benchmark-chrome-jetstream3** 1654 - ❌ 1655 - ❌ 1656 - ❌ 1657 - ❌ 1658 * - **browsertime-benchmark-custom-car-jetstream3** 1659 - ❌ 1660 - ❌ 1661 - ❌ 1662 - ❌ 1663 * - **browsertime-benchmark-firefox-jetstream3** 1664 - ✅ 1665 - ✅ 1666 - ❌ 1667 - ❌ 1668 1669 1670 .. list-table:: **test-windows11-64-24h2/opt** 1671 :widths: 30 15 15 15 15 1672 :header-rows: 1 1673 1674 * - **Test Name** 1675 - mozilla-central 1676 - autoland 1677 - mozilla-release 1678 - mozilla-beta 1679 * - **browsertime-benchmark-firefox-jetstream3** 1680 - ❌ 1681 - ❌ 1682 - ❌ 1683 - ❌ 1684 1685 1686 1687 .. dropdown:: matrix-react-bench 1688 :class-container: anchor-id-matrix-react-bench-b 1689 1690 * Command to Run Locally 1691 1692 .. code-block:: 1693 1694 ./mach raptor -t matrix-react-bench 1695 1696 **Owner**: :jandem and SpiderMonkey Team 1697 1698 * **alert threshold**: 2.0 1699 * **apps**: firefox, chrome 1700 * **expected**: pass 1701 * **expose browser profiler**: true 1702 * **gecko profile interval**: 1 1703 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/matrix-react-bench.toml#17>`__ 1704 * **lower is better**: true 1705 * **page cycles**: 30 1706 * **page timeout**: 2000000 1707 * **repository**: https://github.com/mozilla/perf-automation 1708 * **repository path**: benchmarks/matrix-react-bench 1709 * **repository revision**: 61332db584026b73e37066d717a162825408c36b 1710 * **sparse checkout**: true 1711 * **subtest lower is better**: true 1712 * **subtest unit**: ms 1713 * **test url**: `<http://\<host\>:\<port\>/matrix_demo.html>`__ 1714 * **type**: benchmark 1715 * **unit**: ms 1716 * **Test Task**: 1717 1718 .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** 1719 :widths: 30 15 15 15 15 1720 :header-rows: 1 1721 1722 * - **Test Name** 1723 - mozilla-central 1724 - autoland 1725 - mozilla-release 1726 - mozilla-beta 1727 * - **browsertime-benchmark-firefox-matrix-react-bench** 1728 - ❌ 1729 - ❌ 1730 - ❌ 1731 - ❌ 1732 1733 1734 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 1735 :widths: 30 15 15 15 15 1736 :header-rows: 1 1737 1738 * - **Test Name** 1739 - mozilla-central 1740 - autoland 1741 - mozilla-release 1742 - mozilla-beta 1743 * - **browsertime-benchmark-firefox-matrix-react-bench** 1744 - ❌ 1745 - ❌ 1746 - ❌ 1747 - ❌ 1748 1749 1750 .. list-table:: **test-linux1804-64-qr/opt** 1751 :widths: 30 15 15 15 15 1752 :header-rows: 1 1753 1754 * - **Test Name** 1755 - mozilla-central 1756 - autoland 1757 - mozilla-release 1758 - mozilla-beta 1759 * - **browsertime-benchmark-firefox-matrix-react-bench** 1760 - ❌ 1761 - ❌ 1762 - ❌ 1763 - ❌ 1764 1765 1766 .. list-table:: **test-linux1804-64-shippable-qr/opt** 1767 :widths: 30 15 15 15 15 1768 :header-rows: 1 1769 1770 * - **Test Name** 1771 - mozilla-central 1772 - autoland 1773 - mozilla-release 1774 - mozilla-beta 1775 * - **browsertime-benchmark-chrome-matrix-react-bench** 1776 - ❌ 1777 - ❌ 1778 - ❌ 1779 - ❌ 1780 * - **browsertime-benchmark-firefox-matrix-react-bench** 1781 - ✅ 1782 - ✅ 1783 - ❌ 1784 - ❌ 1785 1786 1787 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 1788 :widths: 30 15 15 15 15 1789 :header-rows: 1 1790 1791 * - **Test Name** 1792 - mozilla-central 1793 - autoland 1794 - mozilla-release 1795 - mozilla-beta 1796 * - **browsertime-benchmark-firefox-matrix-react-bench** 1797 - ❌ 1798 - ❌ 1799 - ❌ 1800 - ❌ 1801 1802 1803 .. list-table:: **test-macosx1470-64-shippable/opt** 1804 :widths: 30 15 15 15 15 1805 :header-rows: 1 1806 1807 * - **Test Name** 1808 - mozilla-central 1809 - autoland 1810 - mozilla-release 1811 - mozilla-beta 1812 * - **browsertime-benchmark-chrome-matrix-react-bench** 1813 - ❌ 1814 - ❌ 1815 - ❌ 1816 - ❌ 1817 * - **browsertime-benchmark-firefox-matrix-react-bench** 1818 - ✅ 1819 - ✅ 1820 - ❌ 1821 - ❌ 1822 1823 1824 .. list-table:: **test-macosx1470-64/opt** 1825 :widths: 30 15 15 15 15 1826 :header-rows: 1 1827 1828 * - **Test Name** 1829 - mozilla-central 1830 - autoland 1831 - mozilla-release 1832 - mozilla-beta 1833 * - **browsertime-benchmark-firefox-matrix-react-bench** 1834 - ❌ 1835 - ❌ 1836 - ❌ 1837 - ❌ 1838 1839 1840 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 1841 :widths: 30 15 15 15 15 1842 :header-rows: 1 1843 1844 * - **Test Name** 1845 - mozilla-central 1846 - autoland 1847 - mozilla-release 1848 - mozilla-beta 1849 * - **browsertime-benchmark-firefox-matrix-react-bench** 1850 - ❌ 1851 - ❌ 1852 - ❌ 1853 - ❌ 1854 1855 1856 .. list-table:: **test-windows11-64-24h2-shippable/opt** 1857 :widths: 30 15 15 15 15 1858 :header-rows: 1 1859 1860 * - **Test Name** 1861 - mozilla-central 1862 - autoland 1863 - mozilla-release 1864 - mozilla-beta 1865 * - **browsertime-benchmark-chrome-matrix-react-bench** 1866 - ❌ 1867 - ❌ 1868 - ❌ 1869 - ❌ 1870 * - **browsertime-benchmark-firefox-matrix-react-bench** 1871 - ✅ 1872 - ✅ 1873 - ❌ 1874 - ❌ 1875 1876 1877 .. list-table:: **test-windows11-64-24h2/opt** 1878 :widths: 30 15 15 15 15 1879 :header-rows: 1 1880 1881 * - **Test Name** 1882 - mozilla-central 1883 - autoland 1884 - mozilla-release 1885 - mozilla-beta 1886 * - **browsertime-benchmark-firefox-matrix-react-bench** 1887 - ❌ 1888 - ❌ 1889 - ❌ 1890 - ❌ 1891 1892 1893 1894 .. dropdown:: motionmark-1-3 1895 :class-container: anchor-id-motionmark-1-3-b 1896 1897 * Command to Run Locally 1898 1899 .. code-block:: 1900 1901 ./mach raptor -t motionmark-1-3 1902 1903 **Owner**: Graphics Team 1904 1905 * **alert threshold**: 2.0 1906 * **apps**: firefox, chrome, safari, custom-car 1907 * **browser cycles**: 1 1908 * **cold**: true 1909 * **expected**: pass 1910 * **expose browser profiler**: true 1911 * **expose chrome trace**: true 1912 * **gecko profile features**: stackwalk,js,cpu,java,processcpu,memory 1913 * **gecko profile interval**: 1 1914 * **gecko profile threads**: GeckoMain,Compositor,Renderer,SwComposite,RenderBackend,SceneBuilder,WrWorker,CanvasWorkers,TextureUpdate 1915 * **host from parent**: false 1916 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/motionmark-1-3-desktop.toml#13>`__ 1917 * **lower is better**: false 1918 * **page cycles**: 1 1919 * **page timeout**: 600000 1920 * **repository**: https://github.com/webkit/motionmark 1921 * **repository revision**: be2a5fea89b6ef411b053ebeb95a6302b3dc0ecb 1922 * **subtest lower is better**: false 1923 * **subtest unit**: score 1924 * **suite name**: MotionMark 1925 * **support class**: motionmark-1-3.py 1926 * **test script**: motionmark-1-3.js 1927 * **test url**: `<http://\<host\>:\<port\>/MotionMark/developer.html?warmup-length=2000&warmup-frame-count=30&first-frame-minimum-length=0&test-interval=30&display=minimal&tiles=big&controller=ramp&system-frame-rate=60&frame-rate=60&time-measurement=performance>`__ 1928 * **type**: benchmark 1929 * **unit**: score 1930 * **Test Task**: 1931 1932 .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** 1933 :widths: 30 15 15 15 15 1934 :header-rows: 1 1935 1936 * - **Test Name** 1937 - mozilla-central 1938 - autoland 1939 - mozilla-release 1940 - mozilla-beta 1941 * - **browsertime-benchmark-motionmark-1-3-chrome-m-motionmark-1-3-nofis** 1942 - ❌ 1943 - ❌ 1944 - ❌ 1945 - ❌ 1946 * - **browsertime-benchmark-motionmark-1-3-cstm-car-m-motionmark-1-3-nofis** 1947 - ✅ 1948 - ❌ 1949 - ❌ 1950 - ❌ 1951 * - **browsertime-benchmark-motionmark-1-3-fenix-motionmark-1-3** 1952 - ✅ 1953 - ❌ 1954 - ❌ 1955 - ❌ 1956 * - **browsertime-benchmark-motionmark-1-3-fenix-motionmark-1-3-nofis** 1957 - ✅ 1958 - ❌ 1959 - ❌ 1960 - ❌ 1961 * - **browsertime-benchmark-motionmark-1-3-geckoview-motionmark-1-3** 1962 - ❌ 1963 - ❌ 1964 - ❌ 1965 - ❌ 1966 * - **browsertime-benchmark-motionmark-1-3-geckoview-motionmark-1-3-nofis** 1967 - ❌ 1968 - ❌ 1969 - ❌ 1970 - ❌ 1971 1972 1973 .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** 1974 :widths: 30 15 15 15 15 1975 :header-rows: 1 1976 1977 * - **Test Name** 1978 - mozilla-central 1979 - autoland 1980 - mozilla-release 1981 - mozilla-beta 1982 * - **browsertime-benchmark-motionmark-1-3-fenix-motionmark-1-3** 1983 - ❌ 1984 - ❌ 1985 - ❌ 1986 - ❌ 1987 * - **browsertime-benchmark-motionmark-1-3-fenix-motionmark-1-3-nofis** 1988 - ❌ 1989 - ❌ 1990 - ❌ 1991 - ❌ 1992 * - **browsertime-benchmark-motionmark-1-3-geckoview-motionmark-1-3** 1993 - ❌ 1994 - ❌ 1995 - ❌ 1996 - ❌ 1997 * - **browsertime-benchmark-motionmark-1-3-geckoview-motionmark-1-3-nofis** 1998 - ❌ 1999 - ❌ 2000 - ❌ 2001 - ❌ 2002 2003 2004 .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** 2005 :widths: 30 15 15 15 15 2006 :header-rows: 1 2007 2008 * - **Test Name** 2009 - mozilla-central 2010 - autoland 2011 - mozilla-release 2012 - mozilla-beta 2013 * - **browsertime-benchmark-firefox-motionmark-1-3** 2014 - ❌ 2015 - ❌ 2016 - ❌ 2017 - ❌ 2018 2019 2020 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 2021 :widths: 30 15 15 15 15 2022 :header-rows: 1 2023 2024 * - **Test Name** 2025 - mozilla-central 2026 - autoland 2027 - mozilla-release 2028 - mozilla-beta 2029 * - **browsertime-benchmark-firefox-motionmark-1-3** 2030 - ❌ 2031 - ❌ 2032 - ❌ 2033 - ❌ 2034 2035 2036 .. list-table:: **test-linux1804-64-qr/opt** 2037 :widths: 30 15 15 15 15 2038 :header-rows: 1 2039 2040 * - **Test Name** 2041 - mozilla-central 2042 - autoland 2043 - mozilla-release 2044 - mozilla-beta 2045 * - **browsertime-benchmark-firefox-motionmark-1-3** 2046 - ❌ 2047 - ❌ 2048 - ❌ 2049 - ❌ 2050 2051 2052 .. list-table:: **test-linux1804-64-shippable-qr/opt** 2053 :widths: 30 15 15 15 15 2054 :header-rows: 1 2055 2056 * - **Test Name** 2057 - mozilla-central 2058 - autoland 2059 - mozilla-release 2060 - mozilla-beta 2061 * - **browsertime-benchmark-chrome-motionmark-1-3** 2062 - ❌ 2063 - ❌ 2064 - ❌ 2065 - ❌ 2066 * - **browsertime-benchmark-custom-car-motionmark-1-3** 2067 - ❌ 2068 - ❌ 2069 - ❌ 2070 - ❌ 2071 * - **browsertime-benchmark-firefox-motionmark-1-3** 2072 - ✅ 2073 - ✅ 2074 - ❌ 2075 - ❌ 2076 2077 2078 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 2079 :widths: 30 15 15 15 15 2080 :header-rows: 1 2081 2082 * - **Test Name** 2083 - mozilla-central 2084 - autoland 2085 - mozilla-release 2086 - mozilla-beta 2087 * - **browsertime-benchmark-firefox-motionmark-1-3** 2088 - ❌ 2089 - ❌ 2090 - ❌ 2091 - ❌ 2092 2093 2094 .. list-table:: **test-macosx1470-64-shippable/opt** 2095 :widths: 30 15 15 15 15 2096 :header-rows: 1 2097 2098 * - **Test Name** 2099 - mozilla-central 2100 - autoland 2101 - mozilla-release 2102 - mozilla-beta 2103 * - **browsertime-benchmark-chrome-motionmark-1-3** 2104 - ❌ 2105 - ❌ 2106 - ❌ 2107 - ❌ 2108 * - **browsertime-benchmark-custom-car-motionmark-1-3** 2109 - ❌ 2110 - ❌ 2111 - ❌ 2112 - ❌ 2113 * - **browsertime-benchmark-firefox-motionmark-1-3** 2114 - ✅ 2115 - ✅ 2116 - ❌ 2117 - ❌ 2118 * - **browsertime-benchmark-safari-motionmark-1-3** 2119 - ❌ 2120 - ❌ 2121 - ❌ 2122 - ❌ 2123 2124 2125 .. list-table:: **test-macosx1470-64/opt** 2126 :widths: 30 15 15 15 15 2127 :header-rows: 1 2128 2129 * - **Test Name** 2130 - mozilla-central 2131 - autoland 2132 - mozilla-release 2133 - mozilla-beta 2134 * - **browsertime-benchmark-firefox-motionmark-1-3** 2135 - ❌ 2136 - ❌ 2137 - ❌ 2138 - ❌ 2139 2140 2141 .. list-table:: **test-macosx1500-aarch64-shippable/opt** 2142 :widths: 30 15 15 15 15 2143 :header-rows: 1 2144 2145 * - **Test Name** 2146 - mozilla-central 2147 - autoland 2148 - mozilla-release 2149 - mozilla-beta 2150 * - **browsertime-benchmark-chrome-motionmark-1-3** 2151 - ❌ 2152 - ❌ 2153 - ❌ 2154 - ❌ 2155 * - **browsertime-benchmark-custom-car-motionmark-1-3** 2156 - ❌ 2157 - ❌ 2158 - ❌ 2159 - ❌ 2160 * - **browsertime-benchmark-firefox-motionmark-1-3** 2161 - ✅ 2162 - ❌ 2163 - ❌ 2164 - ❌ 2165 * - **browsertime-benchmark-safari-motionmark-1-3** 2166 - ❌ 2167 - ❌ 2168 - ❌ 2169 - ❌ 2170 2171 2172 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 2173 :widths: 30 15 15 15 15 2174 :header-rows: 1 2175 2176 * - **Test Name** 2177 - mozilla-central 2178 - autoland 2179 - mozilla-release 2180 - mozilla-beta 2181 * - **browsertime-benchmark-firefox-motionmark-1-3** 2182 - ❌ 2183 - ❌ 2184 - ❌ 2185 - ❌ 2186 2187 2188 .. list-table:: **test-windows11-64-24h2-shippable/opt** 2189 :widths: 30 15 15 15 15 2190 :header-rows: 1 2191 2192 * - **Test Name** 2193 - mozilla-central 2194 - autoland 2195 - mozilla-release 2196 - mozilla-beta 2197 * - **browsertime-benchmark-chrome-motionmark-1-3** 2198 - ❌ 2199 - ❌ 2200 - ❌ 2201 - ❌ 2202 * - **browsertime-benchmark-custom-car-motionmark-1-3** 2203 - ❌ 2204 - ❌ 2205 - ❌ 2206 - ❌ 2207 * - **browsertime-benchmark-firefox-motionmark-1-3** 2208 - ✅ 2209 - ✅ 2210 - ❌ 2211 - ❌ 2212 2213 2214 .. list-table:: **test-windows11-64-24h2/opt** 2215 :widths: 30 15 15 15 15 2216 :header-rows: 1 2217 2218 * - **Test Name** 2219 - mozilla-central 2220 - autoland 2221 - mozilla-release 2222 - mozilla-beta 2223 * - **browsertime-benchmark-firefox-motionmark-1-3** 2224 - ❌ 2225 - ❌ 2226 - ❌ 2227 - ❌ 2228 2229 2230 **Owner**: Graphics Team 2231 2232 * **alert threshold**: 2.0 2233 * **apps**: fenix, geckoview, chrome-m, cstm-car-m 2234 * **browser cycles**: 1 2235 * **cold**: true 2236 * **expected**: pass 2237 * **expose browser profiler**: true 2238 * **gecko profile features**: stackwalk,js,cpu,java,processcpu,memory 2239 * **gecko profile interval**: 1 2240 * **gecko profile threads**: GeckoMain,Compositor,Renderer,SwComposite,RenderBackend,SceneBuilder,WrWorker,CanvasWorkers,TextureUpdate 2241 * **host from parent**: false 2242 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/motionmark-1-3-mobile.toml#12>`__ 2243 * **lower is better**: false 2244 * **page cycles**: 1 2245 * **page timeout**: 600000 2246 * **repository**: https://github.com/webkit/motionmark 2247 * **repository revision**: be2a5fea89b6ef411b053ebeb95a6302b3dc0ecb 2248 * **subtest lower is better**: false 2249 * **subtest unit**: score 2250 * **suite name**: MotionMark 2251 * **support class**: motionmark-1-3.py 2252 * **test script**: motionmark-1-3.js 2253 * **test url**: `<http://\<host\>:\<port\>/MotionMark/developer.html?warmup-length=2000&warmup-frame-count=30&first-frame-minimum-length=0&test-interval=30&display=minimal&tiles=big&controller=ramp&system-frame-rate=60&frame-rate=60&time-measurement=performance>`__ 2254 * **type**: benchmark 2255 * **unit**: score 2256 * **Test Task**: 2257 2258 .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** 2259 :widths: 30 15 15 15 15 2260 :header-rows: 1 2261 2262 * - **Test Name** 2263 - mozilla-central 2264 - autoland 2265 - mozilla-release 2266 - mozilla-beta 2267 * - **browsertime-benchmark-motionmark-1-3-chrome-m-motionmark-1-3-nofis** 2268 - ❌ 2269 - ❌ 2270 - ❌ 2271 - ❌ 2272 * - **browsertime-benchmark-motionmark-1-3-cstm-car-m-motionmark-1-3-nofis** 2273 - ✅ 2274 - ❌ 2275 - ❌ 2276 - ❌ 2277 * - **browsertime-benchmark-motionmark-1-3-fenix-motionmark-1-3** 2278 - ✅ 2279 - ❌ 2280 - ❌ 2281 - ❌ 2282 * - **browsertime-benchmark-motionmark-1-3-fenix-motionmark-1-3-nofis** 2283 - ✅ 2284 - ❌ 2285 - ❌ 2286 - ❌ 2287 * - **browsertime-benchmark-motionmark-1-3-geckoview-motionmark-1-3** 2288 - ❌ 2289 - ❌ 2290 - ❌ 2291 - ❌ 2292 * - **browsertime-benchmark-motionmark-1-3-geckoview-motionmark-1-3-nofis** 2293 - ❌ 2294 - ❌ 2295 - ❌ 2296 - ❌ 2297 2298 2299 .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** 2300 :widths: 30 15 15 15 15 2301 :header-rows: 1 2302 2303 * - **Test Name** 2304 - mozilla-central 2305 - autoland 2306 - mozilla-release 2307 - mozilla-beta 2308 * - **browsertime-benchmark-motionmark-1-3-fenix-motionmark-1-3** 2309 - ❌ 2310 - ❌ 2311 - ❌ 2312 - ❌ 2313 * - **browsertime-benchmark-motionmark-1-3-fenix-motionmark-1-3-nofis** 2314 - ❌ 2315 - ❌ 2316 - ❌ 2317 - ❌ 2318 * - **browsertime-benchmark-motionmark-1-3-geckoview-motionmark-1-3** 2319 - ❌ 2320 - ❌ 2321 - ❌ 2322 - ❌ 2323 * - **browsertime-benchmark-motionmark-1-3-geckoview-motionmark-1-3-nofis** 2324 - ❌ 2325 - ❌ 2326 - ❌ 2327 - ❌ 2328 2329 2330 .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** 2331 :widths: 30 15 15 15 15 2332 :header-rows: 1 2333 2334 * - **Test Name** 2335 - mozilla-central 2336 - autoland 2337 - mozilla-release 2338 - mozilla-beta 2339 * - **browsertime-benchmark-firefox-motionmark-1-3** 2340 - ❌ 2341 - ❌ 2342 - ❌ 2343 - ❌ 2344 2345 2346 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 2347 :widths: 30 15 15 15 15 2348 :header-rows: 1 2349 2350 * - **Test Name** 2351 - mozilla-central 2352 - autoland 2353 - mozilla-release 2354 - mozilla-beta 2355 * - **browsertime-benchmark-firefox-motionmark-1-3** 2356 - ❌ 2357 - ❌ 2358 - ❌ 2359 - ❌ 2360 2361 2362 .. list-table:: **test-linux1804-64-qr/opt** 2363 :widths: 30 15 15 15 15 2364 :header-rows: 1 2365 2366 * - **Test Name** 2367 - mozilla-central 2368 - autoland 2369 - mozilla-release 2370 - mozilla-beta 2371 * - **browsertime-benchmark-firefox-motionmark-1-3** 2372 - ❌ 2373 - ❌ 2374 - ❌ 2375 - ❌ 2376 2377 2378 .. list-table:: **test-linux1804-64-shippable-qr/opt** 2379 :widths: 30 15 15 15 15 2380 :header-rows: 1 2381 2382 * - **Test Name** 2383 - mozilla-central 2384 - autoland 2385 - mozilla-release 2386 - mozilla-beta 2387 * - **browsertime-benchmark-chrome-motionmark-1-3** 2388 - ❌ 2389 - ❌ 2390 - ❌ 2391 - ❌ 2392 * - **browsertime-benchmark-custom-car-motionmark-1-3** 2393 - ❌ 2394 - ❌ 2395 - ❌ 2396 - ❌ 2397 * - **browsertime-benchmark-firefox-motionmark-1-3** 2398 - ✅ 2399 - ✅ 2400 - ❌ 2401 - ❌ 2402 2403 2404 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 2405 :widths: 30 15 15 15 15 2406 :header-rows: 1 2407 2408 * - **Test Name** 2409 - mozilla-central 2410 - autoland 2411 - mozilla-release 2412 - mozilla-beta 2413 * - **browsertime-benchmark-firefox-motionmark-1-3** 2414 - ❌ 2415 - ❌ 2416 - ❌ 2417 - ❌ 2418 2419 2420 .. list-table:: **test-macosx1470-64-shippable/opt** 2421 :widths: 30 15 15 15 15 2422 :header-rows: 1 2423 2424 * - **Test Name** 2425 - mozilla-central 2426 - autoland 2427 - mozilla-release 2428 - mozilla-beta 2429 * - **browsertime-benchmark-chrome-motionmark-1-3** 2430 - ❌ 2431 - ❌ 2432 - ❌ 2433 - ❌ 2434 * - **browsertime-benchmark-custom-car-motionmark-1-3** 2435 - ❌ 2436 - ❌ 2437 - ❌ 2438 - ❌ 2439 * - **browsertime-benchmark-firefox-motionmark-1-3** 2440 - ✅ 2441 - ✅ 2442 - ❌ 2443 - ❌ 2444 * - **browsertime-benchmark-safari-motionmark-1-3** 2445 - ❌ 2446 - ❌ 2447 - ❌ 2448 - ❌ 2449 2450 2451 .. list-table:: **test-macosx1470-64/opt** 2452 :widths: 30 15 15 15 15 2453 :header-rows: 1 2454 2455 * - **Test Name** 2456 - mozilla-central 2457 - autoland 2458 - mozilla-release 2459 - mozilla-beta 2460 * - **browsertime-benchmark-firefox-motionmark-1-3** 2461 - ❌ 2462 - ❌ 2463 - ❌ 2464 - ❌ 2465 2466 2467 .. list-table:: **test-macosx1500-aarch64-shippable/opt** 2468 :widths: 30 15 15 15 15 2469 :header-rows: 1 2470 2471 * - **Test Name** 2472 - mozilla-central 2473 - autoland 2474 - mozilla-release 2475 - mozilla-beta 2476 * - **browsertime-benchmark-chrome-motionmark-1-3** 2477 - ❌ 2478 - ❌ 2479 - ❌ 2480 - ❌ 2481 * - **browsertime-benchmark-custom-car-motionmark-1-3** 2482 - ❌ 2483 - ❌ 2484 - ❌ 2485 - ❌ 2486 * - **browsertime-benchmark-firefox-motionmark-1-3** 2487 - ✅ 2488 - ❌ 2489 - ❌ 2490 - ❌ 2491 * - **browsertime-benchmark-safari-motionmark-1-3** 2492 - ❌ 2493 - ❌ 2494 - ❌ 2495 - ❌ 2496 2497 2498 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 2499 :widths: 30 15 15 15 15 2500 :header-rows: 1 2501 2502 * - **Test Name** 2503 - mozilla-central 2504 - autoland 2505 - mozilla-release 2506 - mozilla-beta 2507 * - **browsertime-benchmark-firefox-motionmark-1-3** 2508 - ❌ 2509 - ❌ 2510 - ❌ 2511 - ❌ 2512 2513 2514 .. list-table:: **test-windows11-64-24h2-shippable/opt** 2515 :widths: 30 15 15 15 15 2516 :header-rows: 1 2517 2518 * - **Test Name** 2519 - mozilla-central 2520 - autoland 2521 - mozilla-release 2522 - mozilla-beta 2523 * - **browsertime-benchmark-chrome-motionmark-1-3** 2524 - ❌ 2525 - ❌ 2526 - ❌ 2527 - ❌ 2528 * - **browsertime-benchmark-custom-car-motionmark-1-3** 2529 - ❌ 2530 - ❌ 2531 - ❌ 2532 - ❌ 2533 * - **browsertime-benchmark-firefox-motionmark-1-3** 2534 - ✅ 2535 - ✅ 2536 - ❌ 2537 - ❌ 2538 2539 2540 .. list-table:: **test-windows11-64-24h2/opt** 2541 :widths: 30 15 15 15 15 2542 :header-rows: 1 2543 2544 * - **Test Name** 2545 - mozilla-central 2546 - autoland 2547 - mozilla-release 2548 - mozilla-beta 2549 * - **browsertime-benchmark-firefox-motionmark-1-3** 2550 - ❌ 2551 - ❌ 2552 - ❌ 2553 - ❌ 2554 2555 2556 2557 .. dropdown:: motionmark-htmlsuite-1-3 2558 :class-container: anchor-id-motionmark-htmlsuite-1-3-b 2559 2560 * Command to Run Locally 2561 2562 .. code-block:: 2563 2564 ./mach raptor -t motionmark-htmlsuite-1-3 2565 2566 **Owner**: Graphics Team 2567 2568 * **alert threshold**: 2.0 2569 * **apps**: firefox, chrome, safari, custom-car 2570 * **browser cycles**: 1 2571 * **cold**: true 2572 * **expected**: pass 2573 * **expose browser profiler**: true 2574 * **expose chrome trace**: true 2575 * **gecko profile features**: stackwalk,js,cpu,java,processcpu,memory 2576 * **gecko profile interval**: 1 2577 * **gecko profile threads**: GeckoMain,Compositor,Renderer,SwComposite,RenderBackend,SceneBuilder,WrWorker,CanvasWorkers,TextureUpdate 2578 * **host from parent**: false 2579 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/motionmark-1-3-desktop.toml#29>`__ 2580 * **lower is better**: false 2581 * **page cycles**: 1 2582 * **page timeout**: 600000 2583 * **repository**: https://github.com/webkit/motionmark 2584 * **repository revision**: be2a5fea89b6ef411b053ebeb95a6302b3dc0ecb 2585 * **subtest lower is better**: false 2586 * **subtest unit**: score 2587 * **suite name**: HTML suite 2588 * **support class**: motionmark-1-3.py 2589 * **test script**: motionmark-1-3.js 2590 * **test url**: `<http://\<host\>:\<port\>/MotionMark/developer.html?warmup-length=2000&warmup-frame-count=30&first-frame-minimum-length=0&test-interval=30&display=minimal&tiles=big&controller=ramp&system-frame-rate=60&frame-rate=60&time-measurement=performance>`__ 2591 * **type**: benchmark 2592 * **unit**: score 2593 * **Test Task**: 2594 2595 .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** 2596 :widths: 30 15 15 15 15 2597 :header-rows: 1 2598 2599 * - **Test Name** 2600 - mozilla-central 2601 - autoland 2602 - mozilla-release 2603 - mozilla-beta 2604 * - **browsertime-benchmark-motionmark-1-3-chrome-m-motionmark-htmlsuite-1-3-nofis** 2605 - ❌ 2606 - ❌ 2607 - ❌ 2608 - ❌ 2609 * - **browsertime-benchmark-motionmark-1-3-cstm-car-m-motionmark-htmlsuite-1-3-nofis** 2610 - ✅ 2611 - ❌ 2612 - ❌ 2613 - ❌ 2614 * - **browsertime-benchmark-motionmark-1-3-fenix-motionmark-htmlsuite-1-3** 2615 - ✅ 2616 - ❌ 2617 - ❌ 2618 - ❌ 2619 * - **browsertime-benchmark-motionmark-1-3-fenix-motionmark-htmlsuite-1-3-nofis** 2620 - ✅ 2621 - ❌ 2622 - ❌ 2623 - ❌ 2624 * - **browsertime-benchmark-motionmark-1-3-geckoview-motionmark-htmlsuite-1-3** 2625 - ❌ 2626 - ❌ 2627 - ❌ 2628 - ❌ 2629 * - **browsertime-benchmark-motionmark-1-3-geckoview-motionmark-htmlsuite-1-3-nofis** 2630 - ❌ 2631 - ❌ 2632 - ❌ 2633 - ❌ 2634 2635 2636 .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** 2637 :widths: 30 15 15 15 15 2638 :header-rows: 1 2639 2640 * - **Test Name** 2641 - mozilla-central 2642 - autoland 2643 - mozilla-release 2644 - mozilla-beta 2645 * - **browsertime-benchmark-motionmark-1-3-fenix-motionmark-htmlsuite-1-3** 2646 - ❌ 2647 - ❌ 2648 - ❌ 2649 - ❌ 2650 * - **browsertime-benchmark-motionmark-1-3-fenix-motionmark-htmlsuite-1-3-nofis** 2651 - ❌ 2652 - ❌ 2653 - ❌ 2654 - ❌ 2655 * - **browsertime-benchmark-motionmark-1-3-geckoview-motionmark-htmlsuite-1-3** 2656 - ❌ 2657 - ❌ 2658 - ❌ 2659 - ❌ 2660 * - **browsertime-benchmark-motionmark-1-3-geckoview-motionmark-htmlsuite-1-3-nofis** 2661 - ❌ 2662 - ❌ 2663 - ❌ 2664 - ❌ 2665 2666 2667 .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** 2668 :widths: 30 15 15 15 15 2669 :header-rows: 1 2670 2671 * - **Test Name** 2672 - mozilla-central 2673 - autoland 2674 - mozilla-release 2675 - mozilla-beta 2676 * - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3** 2677 - ❌ 2678 - ❌ 2679 - ❌ 2680 - ❌ 2681 2682 2683 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 2684 :widths: 30 15 15 15 15 2685 :header-rows: 1 2686 2687 * - **Test Name** 2688 - mozilla-central 2689 - autoland 2690 - mozilla-release 2691 - mozilla-beta 2692 * - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3** 2693 - ❌ 2694 - ❌ 2695 - ❌ 2696 - ❌ 2697 2698 2699 .. list-table:: **test-linux1804-64-qr/opt** 2700 :widths: 30 15 15 15 15 2701 :header-rows: 1 2702 2703 * - **Test Name** 2704 - mozilla-central 2705 - autoland 2706 - mozilla-release 2707 - mozilla-beta 2708 * - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3** 2709 - ❌ 2710 - ❌ 2711 - ❌ 2712 - ❌ 2713 2714 2715 .. list-table:: **test-linux1804-64-shippable-qr/opt** 2716 :widths: 30 15 15 15 15 2717 :header-rows: 1 2718 2719 * - **Test Name** 2720 - mozilla-central 2721 - autoland 2722 - mozilla-release 2723 - mozilla-beta 2724 * - **browsertime-benchmark-chrome-motionmark-htmlsuite-1-3** 2725 - ❌ 2726 - ❌ 2727 - ❌ 2728 - ❌ 2729 * - **browsertime-benchmark-custom-car-motionmark-htmlsuite-1-3** 2730 - ❌ 2731 - ❌ 2732 - ❌ 2733 - ❌ 2734 * - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3** 2735 - ✅ 2736 - ✅ 2737 - ❌ 2738 - ❌ 2739 2740 2741 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 2742 :widths: 30 15 15 15 15 2743 :header-rows: 1 2744 2745 * - **Test Name** 2746 - mozilla-central 2747 - autoland 2748 - mozilla-release 2749 - mozilla-beta 2750 * - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3** 2751 - ❌ 2752 - ❌ 2753 - ❌ 2754 - ❌ 2755 2756 2757 .. list-table:: **test-macosx1470-64-shippable/opt** 2758 :widths: 30 15 15 15 15 2759 :header-rows: 1 2760 2761 * - **Test Name** 2762 - mozilla-central 2763 - autoland 2764 - mozilla-release 2765 - mozilla-beta 2766 * - **browsertime-benchmark-chrome-motionmark-htmlsuite-1-3** 2767 - ❌ 2768 - ❌ 2769 - ❌ 2770 - ❌ 2771 * - **browsertime-benchmark-custom-car-motionmark-htmlsuite-1-3** 2772 - ❌ 2773 - ❌ 2774 - ❌ 2775 - ❌ 2776 * - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3** 2777 - ✅ 2778 - ✅ 2779 - ❌ 2780 - ❌ 2781 * - **browsertime-benchmark-safari-motionmark-htmlsuite-1-3** 2782 - ❌ 2783 - ❌ 2784 - ❌ 2785 - ❌ 2786 2787 2788 .. list-table:: **test-macosx1470-64/opt** 2789 :widths: 30 15 15 15 15 2790 :header-rows: 1 2791 2792 * - **Test Name** 2793 - mozilla-central 2794 - autoland 2795 - mozilla-release 2796 - mozilla-beta 2797 * - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3** 2798 - ❌ 2799 - ❌ 2800 - ❌ 2801 - ❌ 2802 2803 2804 .. list-table:: **test-macosx1500-aarch64-shippable/opt** 2805 :widths: 30 15 15 15 15 2806 :header-rows: 1 2807 2808 * - **Test Name** 2809 - mozilla-central 2810 - autoland 2811 - mozilla-release 2812 - mozilla-beta 2813 * - **browsertime-benchmark-chrome-motionmark-htmlsuite-1-3** 2814 - ❌ 2815 - ❌ 2816 - ❌ 2817 - ❌ 2818 * - **browsertime-benchmark-custom-car-motionmark-htmlsuite-1-3** 2819 - ❌ 2820 - ❌ 2821 - ❌ 2822 - ❌ 2823 * - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3** 2824 - ✅ 2825 - ❌ 2826 - ❌ 2827 - ❌ 2828 * - **browsertime-benchmark-safari-motionmark-htmlsuite-1-3** 2829 - ❌ 2830 - ❌ 2831 - ❌ 2832 - ❌ 2833 2834 2835 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 2836 :widths: 30 15 15 15 15 2837 :header-rows: 1 2838 2839 * - **Test Name** 2840 - mozilla-central 2841 - autoland 2842 - mozilla-release 2843 - mozilla-beta 2844 * - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3** 2845 - ❌ 2846 - ❌ 2847 - ❌ 2848 - ❌ 2849 2850 2851 .. list-table:: **test-windows11-64-24h2-shippable/opt** 2852 :widths: 30 15 15 15 15 2853 :header-rows: 1 2854 2855 * - **Test Name** 2856 - mozilla-central 2857 - autoland 2858 - mozilla-release 2859 - mozilla-beta 2860 * - **browsertime-benchmark-chrome-motionmark-htmlsuite-1-3** 2861 - ❌ 2862 - ❌ 2863 - ❌ 2864 - ❌ 2865 * - **browsertime-benchmark-custom-car-motionmark-htmlsuite-1-3** 2866 - ❌ 2867 - ❌ 2868 - ❌ 2869 - ❌ 2870 * - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3** 2871 - ✅ 2872 - ✅ 2873 - ❌ 2874 - ❌ 2875 2876 2877 .. list-table:: **test-windows11-64-24h2/opt** 2878 :widths: 30 15 15 15 15 2879 :header-rows: 1 2880 2881 * - **Test Name** 2882 - mozilla-central 2883 - autoland 2884 - mozilla-release 2885 - mozilla-beta 2886 * - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3** 2887 - ❌ 2888 - ❌ 2889 - ❌ 2890 - ❌ 2891 2892 2893 **Owner**: Graphics Team 2894 2895 * **alert threshold**: 2.0 2896 * **apps**: fenix, geckoview, chrome-m, cstm-car-m 2897 * **browser cycles**: 1 2898 * **cold**: true 2899 * **expected**: pass 2900 * **expose browser profiler**: true 2901 * **gecko profile features**: stackwalk,js,cpu,java,processcpu,memory 2902 * **gecko profile interval**: 1 2903 * **gecko profile threads**: GeckoMain,Compositor,Renderer,SwComposite,RenderBackend,SceneBuilder,WrWorker,CanvasWorkers,TextureUpdate 2904 * **host from parent**: false 2905 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/motionmark-1-3-mobile.toml#28>`__ 2906 * **lower is better**: false 2907 * **page cycles**: 1 2908 * **page timeout**: 600000 2909 * **repository**: https://github.com/webkit/motionmark 2910 * **repository revision**: be2a5fea89b6ef411b053ebeb95a6302b3dc0ecb 2911 * **subtest lower is better**: false 2912 * **subtest unit**: score 2913 * **suite name**: HTML suite 2914 * **support class**: motionmark-1-3.py 2915 * **test script**: motionmark-1-3.js 2916 * **test url**: `<http://\<host\>:\<port\>/MotionMark/developer.html?warmup-length=2000&warmup-frame-count=30&first-frame-minimum-length=0&test-interval=30&display=minimal&tiles=big&controller=ramp&system-frame-rate=60&frame-rate=60&time-measurement=performance>`__ 2917 * **type**: benchmark 2918 * **unit**: score 2919 * **Test Task**: 2920 2921 .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** 2922 :widths: 30 15 15 15 15 2923 :header-rows: 1 2924 2925 * - **Test Name** 2926 - mozilla-central 2927 - autoland 2928 - mozilla-release 2929 - mozilla-beta 2930 * - **browsertime-benchmark-motionmark-1-3-chrome-m-motionmark-htmlsuite-1-3-nofis** 2931 - ❌ 2932 - ❌ 2933 - ❌ 2934 - ❌ 2935 * - **browsertime-benchmark-motionmark-1-3-cstm-car-m-motionmark-htmlsuite-1-3-nofis** 2936 - ✅ 2937 - ❌ 2938 - ❌ 2939 - ❌ 2940 * - **browsertime-benchmark-motionmark-1-3-fenix-motionmark-htmlsuite-1-3** 2941 - ✅ 2942 - ❌ 2943 - ❌ 2944 - ❌ 2945 * - **browsertime-benchmark-motionmark-1-3-fenix-motionmark-htmlsuite-1-3-nofis** 2946 - ✅ 2947 - ❌ 2948 - ❌ 2949 - ❌ 2950 * - **browsertime-benchmark-motionmark-1-3-geckoview-motionmark-htmlsuite-1-3** 2951 - ❌ 2952 - ❌ 2953 - ❌ 2954 - ❌ 2955 * - **browsertime-benchmark-motionmark-1-3-geckoview-motionmark-htmlsuite-1-3-nofis** 2956 - ❌ 2957 - ❌ 2958 - ❌ 2959 - ❌ 2960 2961 2962 .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** 2963 :widths: 30 15 15 15 15 2964 :header-rows: 1 2965 2966 * - **Test Name** 2967 - mozilla-central 2968 - autoland 2969 - mozilla-release 2970 - mozilla-beta 2971 * - **browsertime-benchmark-motionmark-1-3-fenix-motionmark-htmlsuite-1-3** 2972 - ❌ 2973 - ❌ 2974 - ❌ 2975 - ❌ 2976 * - **browsertime-benchmark-motionmark-1-3-fenix-motionmark-htmlsuite-1-3-nofis** 2977 - ❌ 2978 - ❌ 2979 - ❌ 2980 - ❌ 2981 * - **browsertime-benchmark-motionmark-1-3-geckoview-motionmark-htmlsuite-1-3** 2982 - ❌ 2983 - ❌ 2984 - ❌ 2985 - ❌ 2986 * - **browsertime-benchmark-motionmark-1-3-geckoview-motionmark-htmlsuite-1-3-nofis** 2987 - ❌ 2988 - ❌ 2989 - ❌ 2990 - ❌ 2991 2992 2993 .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** 2994 :widths: 30 15 15 15 15 2995 :header-rows: 1 2996 2997 * - **Test Name** 2998 - mozilla-central 2999 - autoland 3000 - mozilla-release 3001 - mozilla-beta 3002 * - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3** 3003 - ❌ 3004 - ❌ 3005 - ❌ 3006 - ❌ 3007 3008 3009 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 3010 :widths: 30 15 15 15 15 3011 :header-rows: 1 3012 3013 * - **Test Name** 3014 - mozilla-central 3015 - autoland 3016 - mozilla-release 3017 - mozilla-beta 3018 * - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3** 3019 - ❌ 3020 - ❌ 3021 - ❌ 3022 - ❌ 3023 3024 3025 .. list-table:: **test-linux1804-64-qr/opt** 3026 :widths: 30 15 15 15 15 3027 :header-rows: 1 3028 3029 * - **Test Name** 3030 - mozilla-central 3031 - autoland 3032 - mozilla-release 3033 - mozilla-beta 3034 * - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3** 3035 - ❌ 3036 - ❌ 3037 - ❌ 3038 - ❌ 3039 3040 3041 .. list-table:: **test-linux1804-64-shippable-qr/opt** 3042 :widths: 30 15 15 15 15 3043 :header-rows: 1 3044 3045 * - **Test Name** 3046 - mozilla-central 3047 - autoland 3048 - mozilla-release 3049 - mozilla-beta 3050 * - **browsertime-benchmark-chrome-motionmark-htmlsuite-1-3** 3051 - ❌ 3052 - ❌ 3053 - ❌ 3054 - ❌ 3055 * - **browsertime-benchmark-custom-car-motionmark-htmlsuite-1-3** 3056 - ❌ 3057 - ❌ 3058 - ❌ 3059 - ❌ 3060 * - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3** 3061 - ✅ 3062 - ✅ 3063 - ❌ 3064 - ❌ 3065 3066 3067 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 3068 :widths: 30 15 15 15 15 3069 :header-rows: 1 3070 3071 * - **Test Name** 3072 - mozilla-central 3073 - autoland 3074 - mozilla-release 3075 - mozilla-beta 3076 * - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3** 3077 - ❌ 3078 - ❌ 3079 - ❌ 3080 - ❌ 3081 3082 3083 .. list-table:: **test-macosx1470-64-shippable/opt** 3084 :widths: 30 15 15 15 15 3085 :header-rows: 1 3086 3087 * - **Test Name** 3088 - mozilla-central 3089 - autoland 3090 - mozilla-release 3091 - mozilla-beta 3092 * - **browsertime-benchmark-chrome-motionmark-htmlsuite-1-3** 3093 - ❌ 3094 - ❌ 3095 - ❌ 3096 - ❌ 3097 * - **browsertime-benchmark-custom-car-motionmark-htmlsuite-1-3** 3098 - ❌ 3099 - ❌ 3100 - ❌ 3101 - ❌ 3102 * - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3** 3103 - ✅ 3104 - ✅ 3105 - ❌ 3106 - ❌ 3107 * - **browsertime-benchmark-safari-motionmark-htmlsuite-1-3** 3108 - ❌ 3109 - ❌ 3110 - ❌ 3111 - ❌ 3112 3113 3114 .. list-table:: **test-macosx1470-64/opt** 3115 :widths: 30 15 15 15 15 3116 :header-rows: 1 3117 3118 * - **Test Name** 3119 - mozilla-central 3120 - autoland 3121 - mozilla-release 3122 - mozilla-beta 3123 * - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3** 3124 - ❌ 3125 - ❌ 3126 - ❌ 3127 - ❌ 3128 3129 3130 .. list-table:: **test-macosx1500-aarch64-shippable/opt** 3131 :widths: 30 15 15 15 15 3132 :header-rows: 1 3133 3134 * - **Test Name** 3135 - mozilla-central 3136 - autoland 3137 - mozilla-release 3138 - mozilla-beta 3139 * - **browsertime-benchmark-chrome-motionmark-htmlsuite-1-3** 3140 - ❌ 3141 - ❌ 3142 - ❌ 3143 - ❌ 3144 * - **browsertime-benchmark-custom-car-motionmark-htmlsuite-1-3** 3145 - ❌ 3146 - ❌ 3147 - ❌ 3148 - ❌ 3149 * - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3** 3150 - ✅ 3151 - ❌ 3152 - ❌ 3153 - ❌ 3154 * - **browsertime-benchmark-safari-motionmark-htmlsuite-1-3** 3155 - ❌ 3156 - ❌ 3157 - ❌ 3158 - ❌ 3159 3160 3161 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 3162 :widths: 30 15 15 15 15 3163 :header-rows: 1 3164 3165 * - **Test Name** 3166 - mozilla-central 3167 - autoland 3168 - mozilla-release 3169 - mozilla-beta 3170 * - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3** 3171 - ❌ 3172 - ❌ 3173 - ❌ 3174 - ❌ 3175 3176 3177 .. list-table:: **test-windows11-64-24h2-shippable/opt** 3178 :widths: 30 15 15 15 15 3179 :header-rows: 1 3180 3181 * - **Test Name** 3182 - mozilla-central 3183 - autoland 3184 - mozilla-release 3185 - mozilla-beta 3186 * - **browsertime-benchmark-chrome-motionmark-htmlsuite-1-3** 3187 - ❌ 3188 - ❌ 3189 - ❌ 3190 - ❌ 3191 * - **browsertime-benchmark-custom-car-motionmark-htmlsuite-1-3** 3192 - ❌ 3193 - ❌ 3194 - ❌ 3195 - ❌ 3196 * - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3** 3197 - ✅ 3198 - ✅ 3199 - ❌ 3200 - ❌ 3201 3202 3203 .. list-table:: **test-windows11-64-24h2/opt** 3204 :widths: 30 15 15 15 15 3205 :header-rows: 1 3206 3207 * - **Test Name** 3208 - mozilla-central 3209 - autoland 3210 - mozilla-release 3211 - mozilla-beta 3212 * - **browsertime-benchmark-firefox-motionmark-htmlsuite-1-3** 3213 - ❌ 3214 - ❌ 3215 - ❌ 3216 - ❌ 3217 3218 3219 3220 .. dropdown:: speedometer 3221 :class-container: anchor-id-speedometer-b 3222 3223 * Command to Run Locally 3224 3225 .. code-block:: 3226 3227 ./mach raptor -t speedometer 3228 3229 **Owner**: SpiderMonkey Team 3230 3231 * **alert threshold**: 2.0 3232 * **apps**: firefox, chrome, safari, safari-tp, custom-car 3233 * **expected**: pass 3234 * **expose browser profiler**: true 3235 * **gather cpuTime**: true 3236 * **gecko profile features**: stackwalk,js,cpu,processcpu,ipcmessages,nomarkerstacks 3237 * **gecko profile interval**: 1 3238 * **gecko profile threads**: GeckoMain,Compositor,Renderer,TaskController,StyleThread 3239 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/speedometer-desktop.toml#19>`__ 3240 * **lower is better**: false 3241 * **page cycles**: 5 3242 * **page timeout**: 600000 3243 * **subtest lower is better**: true 3244 * **subtest unit**: ms 3245 * **test url**: `<http://\<host\>:\<port\>/Speedometer/index.html?raptor>`__ 3246 * **type**: benchmark 3247 * **unit**: score 3248 * **Test Task**: 3249 3250 .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** 3251 :widths: 30 15 15 15 15 3252 :header-rows: 1 3253 3254 * - **Test Name** 3255 - mozilla-central 3256 - autoland 3257 - mozilla-release 3258 - mozilla-beta 3259 * - **browsertime-benchmark-speedometer-mobile-chrome-m-nofis** 3260 - ❌ 3261 - ❌ 3262 - ❌ 3263 - ❌ 3264 * - **browsertime-benchmark-speedometer-mobile-cstm-car-m-nofis** 3265 - ❌ 3266 - ❌ 3267 - ❌ 3268 - ❌ 3269 * - **browsertime-benchmark-speedometer-mobile-fenix** 3270 - ✅ 3271 - ✅ 3272 - ❌ 3273 - ❌ 3274 * - **browsertime-benchmark-speedometer-mobile-fenix-nofis** 3275 - ✅ 3276 - ✅ 3277 - ❌ 3278 - ❌ 3279 * - **browsertime-benchmark-speedometer-mobile-geckoview** 3280 - ❌ 3281 - ❌ 3282 - ❌ 3283 - ❌ 3284 * - **browsertime-benchmark-speedometer-mobile-geckoview-nofis** 3285 - ❌ 3286 - ❌ 3287 - ❌ 3288 - ❌ 3289 3290 3291 .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** 3292 :widths: 30 15 15 15 15 3293 :header-rows: 1 3294 3295 * - **Test Name** 3296 - mozilla-central 3297 - autoland 3298 - mozilla-release 3299 - mozilla-beta 3300 * - **browsertime-benchmark-speedometer-mobile-fenix** 3301 - ❌ 3302 - ❌ 3303 - ❌ 3304 - ❌ 3305 * - **browsertime-benchmark-speedometer-mobile-fenix-nofis** 3306 - ❌ 3307 - ❌ 3308 - ❌ 3309 - ❌ 3310 * - **browsertime-benchmark-speedometer-mobile-geckoview** 3311 - ❌ 3312 - ❌ 3313 - ❌ 3314 - ❌ 3315 * - **browsertime-benchmark-speedometer-mobile-geckoview-nofis** 3316 - ❌ 3317 - ❌ 3318 - ❌ 3319 - ❌ 3320 3321 3322 .. list-table:: **test-android-hw-p6-13-0-aarch64-shippable/opt** 3323 :widths: 30 15 15 15 15 3324 :header-rows: 1 3325 3326 * - **Test Name** 3327 - mozilla-central 3328 - autoland 3329 - mozilla-release 3330 - mozilla-beta 3331 * - **browsertime-benchmark-speedometer-mobile-chrome-m-nofis** 3332 - ❌ 3333 - ❌ 3334 - ❌ 3335 - ❌ 3336 * - **browsertime-benchmark-speedometer-mobile-cstm-car-m-nofis** 3337 - ❌ 3338 - ❌ 3339 - ❌ 3340 - ❌ 3341 * - **browsertime-benchmark-speedometer-mobile-fenix** 3342 - ❌ 3343 - ❌ 3344 - ❌ 3345 - ❌ 3346 * - **browsertime-benchmark-speedometer-mobile-fenix-nofis** 3347 - ❌ 3348 - ❌ 3349 - ❌ 3350 - ❌ 3351 * - **browsertime-benchmark-speedometer-mobile-geckoview** 3352 - ❌ 3353 - ❌ 3354 - ❌ 3355 - ❌ 3356 * - **browsertime-benchmark-speedometer-mobile-geckoview-nofis** 3357 - ❌ 3358 - ❌ 3359 - ❌ 3360 - ❌ 3361 3362 3363 .. list-table:: **test-android-hw-s24-14-0-aarch64-shippable/opt** 3364 :widths: 30 15 15 15 15 3365 :header-rows: 1 3366 3367 * - **Test Name** 3368 - mozilla-central 3369 - autoland 3370 - mozilla-release 3371 - mozilla-beta 3372 * - **browsertime-benchmark-speedometer-mobile-chrome-m-nofis** 3373 - ❌ 3374 - ❌ 3375 - ❌ 3376 - ❌ 3377 * - **browsertime-benchmark-speedometer-mobile-cstm-car-m-nofis** 3378 - ❌ 3379 - ❌ 3380 - ❌ 3381 - ❌ 3382 * - **browsertime-benchmark-speedometer-mobile-fenix** 3383 - ❌ 3384 - ❌ 3385 - ❌ 3386 - ❌ 3387 * - **browsertime-benchmark-speedometer-mobile-fenix-nofis** 3388 - ❌ 3389 - ❌ 3390 - ❌ 3391 - ❌ 3392 * - **browsertime-benchmark-speedometer-mobile-geckoview** 3393 - ❌ 3394 - ❌ 3395 - ❌ 3396 - ❌ 3397 * - **browsertime-benchmark-speedometer-mobile-geckoview-nofis** 3398 - ❌ 3399 - ❌ 3400 - ❌ 3401 - ❌ 3402 3403 3404 .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** 3405 :widths: 30 15 15 15 15 3406 :header-rows: 1 3407 3408 * - **Test Name** 3409 - mozilla-central 3410 - autoland 3411 - mozilla-release 3412 - mozilla-beta 3413 * - **browsertime-benchmark-firefox-speedometer** 3414 - ❌ 3415 - ❌ 3416 - ❌ 3417 - ❌ 3418 3419 3420 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 3421 :widths: 30 15 15 15 15 3422 :header-rows: 1 3423 3424 * - **Test Name** 3425 - mozilla-central 3426 - autoland 3427 - mozilla-release 3428 - mozilla-beta 3429 * - **browsertime-benchmark-firefox-speedometer** 3430 - ❌ 3431 - ✅ 3432 - ❌ 3433 - ❌ 3434 3435 3436 .. list-table:: **test-linux1804-64-qr/opt** 3437 :widths: 30 15 15 15 15 3438 :header-rows: 1 3439 3440 * - **Test Name** 3441 - mozilla-central 3442 - autoland 3443 - mozilla-release 3444 - mozilla-beta 3445 * - **browsertime-benchmark-firefox-speedometer** 3446 - ❌ 3447 - ❌ 3448 - ❌ 3449 - ❌ 3450 3451 3452 .. list-table:: **test-linux1804-64-shippable-qr/opt** 3453 :widths: 30 15 15 15 15 3454 :header-rows: 1 3455 3456 * - **Test Name** 3457 - mozilla-central 3458 - autoland 3459 - mozilla-release 3460 - mozilla-beta 3461 * - **browsertime-benchmark-chrome-speedometer** 3462 - ❌ 3463 - ❌ 3464 - ❌ 3465 - ❌ 3466 * - **browsertime-benchmark-custom-car-speedometer** 3467 - ❌ 3468 - ❌ 3469 - ❌ 3470 - ❌ 3471 * - **browsertime-benchmark-firefox-speedometer** 3472 - ✅ 3473 - ✅ 3474 - ❌ 3475 - ❌ 3476 3477 3478 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 3479 :widths: 30 15 15 15 15 3480 :header-rows: 1 3481 3482 * - **Test Name** 3483 - mozilla-central 3484 - autoland 3485 - mozilla-release 3486 - mozilla-beta 3487 * - **browsertime-benchmark-firefox-speedometer** 3488 - ❌ 3489 - ✅ 3490 - ❌ 3491 - ❌ 3492 3493 3494 .. list-table:: **test-macosx1470-64-shippable/opt** 3495 :widths: 30 15 15 15 15 3496 :header-rows: 1 3497 3498 * - **Test Name** 3499 - mozilla-central 3500 - autoland 3501 - mozilla-release 3502 - mozilla-beta 3503 * - **browsertime-benchmark-chrome-speedometer** 3504 - ❌ 3505 - ❌ 3506 - ❌ 3507 - ❌ 3508 * - **browsertime-benchmark-custom-car-speedometer** 3509 - ❌ 3510 - ❌ 3511 - ❌ 3512 - ❌ 3513 * - **browsertime-benchmark-firefox-speedometer** 3514 - ✅ 3515 - ✅ 3516 - ❌ 3517 - ❌ 3518 * - **browsertime-benchmark-safari-speedometer** 3519 - ❌ 3520 - ❌ 3521 - ❌ 3522 - ❌ 3523 3524 3525 .. list-table:: **test-macosx1470-64/opt** 3526 :widths: 30 15 15 15 15 3527 :header-rows: 1 3528 3529 * - **Test Name** 3530 - mozilla-central 3531 - autoland 3532 - mozilla-release 3533 - mozilla-beta 3534 * - **browsertime-benchmark-firefox-speedometer** 3535 - ❌ 3536 - ❌ 3537 - ❌ 3538 - ❌ 3539 3540 3541 .. list-table:: **test-macosx1500-aarch64-shippable/opt** 3542 :widths: 30 15 15 15 15 3543 :header-rows: 1 3544 3545 * - **Test Name** 3546 - mozilla-central 3547 - autoland 3548 - mozilla-release 3549 - mozilla-beta 3550 * - **browsertime-benchmark-chrome-speedometer** 3551 - ❌ 3552 - ❌ 3553 - ❌ 3554 - ❌ 3555 * - **browsertime-benchmark-custom-car-speedometer** 3556 - ❌ 3557 - ❌ 3558 - ❌ 3559 - ❌ 3560 * - **browsertime-benchmark-firefox-speedometer** 3561 - ✅ 3562 - ✅ 3563 - ❌ 3564 - ❌ 3565 * - **browsertime-benchmark-safari-speedometer** 3566 - ❌ 3567 - ❌ 3568 - ❌ 3569 - ❌ 3570 3571 3572 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 3573 :widths: 30 15 15 15 15 3574 :header-rows: 1 3575 3576 * - **Test Name** 3577 - mozilla-central 3578 - autoland 3579 - mozilla-release 3580 - mozilla-beta 3581 * - **browsertime-benchmark-firefox-speedometer** 3582 - ❌ 3583 - ✅ 3584 - ❌ 3585 - ❌ 3586 3587 3588 .. list-table:: **test-windows11-64-24h2-shippable/opt** 3589 :widths: 30 15 15 15 15 3590 :header-rows: 1 3591 3592 * - **Test Name** 3593 - mozilla-central 3594 - autoland 3595 - mozilla-release 3596 - mozilla-beta 3597 * - **browsertime-benchmark-chrome-speedometer** 3598 - ❌ 3599 - ❌ 3600 - ❌ 3601 - ❌ 3602 * - **browsertime-benchmark-custom-car-speedometer** 3603 - ❌ 3604 - ❌ 3605 - ❌ 3606 - ❌ 3607 * - **browsertime-benchmark-firefox-speedometer** 3608 - ✅ 3609 - ✅ 3610 - ❌ 3611 - ❌ 3612 3613 3614 .. list-table:: **test-windows11-64-24h2/opt** 3615 :widths: 30 15 15 15 15 3616 :header-rows: 1 3617 3618 * - **Test Name** 3619 - mozilla-central 3620 - autoland 3621 - mozilla-release 3622 - mozilla-beta 3623 * - **browsertime-benchmark-firefox-speedometer** 3624 - ❌ 3625 - ❌ 3626 - ❌ 3627 - ❌ 3628 3629 3630 **Owner**: SpiderMonkey Team 3631 3632 * **alert threshold**: 2.0 3633 * **apps**: fenix, geckoview, refbrow, chrome-m, cstm-car-m 3634 * **expected**: pass 3635 * **expose browser profiler**: true 3636 * **gather cpuTime**: true 3637 * **gecko profile features**: stackwalk,js,cpu,processcpu,ipcmessages,nomarkerstacks 3638 * **gecko profile interval**: 1 3639 * **gecko profile threads**: GeckoMain,Compositor,Renderer,TaskController,StyleThread 3640 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/speedometer-mobile.toml#19>`__ 3641 * **lower is better**: false 3642 * **page cycles**: 5 3643 * **page timeout**: 420000 3644 * **subtest lower is better**: true 3645 * **subtest unit**: ms 3646 * **test url**: `<http://\<host\>:\<port\>/Speedometer/index.html?raptor>`__ 3647 * **type**: benchmark 3648 * **unit**: score 3649 * **Test Task**: 3650 3651 .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** 3652 :widths: 30 15 15 15 15 3653 :header-rows: 1 3654 3655 * - **Test Name** 3656 - mozilla-central 3657 - autoland 3658 - mozilla-release 3659 - mozilla-beta 3660 * - **browsertime-benchmark-speedometer-mobile-chrome-m-nofis** 3661 - ❌ 3662 - ❌ 3663 - ❌ 3664 - ❌ 3665 * - **browsertime-benchmark-speedometer-mobile-cstm-car-m-nofis** 3666 - ❌ 3667 - ❌ 3668 - ❌ 3669 - ❌ 3670 * - **browsertime-benchmark-speedometer-mobile-fenix** 3671 - ✅ 3672 - ✅ 3673 - ❌ 3674 - ❌ 3675 * - **browsertime-benchmark-speedometer-mobile-fenix-nofis** 3676 - ✅ 3677 - ✅ 3678 - ❌ 3679 - ❌ 3680 * - **browsertime-benchmark-speedometer-mobile-geckoview** 3681 - ❌ 3682 - ❌ 3683 - ❌ 3684 - ❌ 3685 * - **browsertime-benchmark-speedometer-mobile-geckoview-nofis** 3686 - ❌ 3687 - ❌ 3688 - ❌ 3689 - ❌ 3690 3691 3692 .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** 3693 :widths: 30 15 15 15 15 3694 :header-rows: 1 3695 3696 * - **Test Name** 3697 - mozilla-central 3698 - autoland 3699 - mozilla-release 3700 - mozilla-beta 3701 * - **browsertime-benchmark-speedometer-mobile-fenix** 3702 - ❌ 3703 - ❌ 3704 - ❌ 3705 - ❌ 3706 * - **browsertime-benchmark-speedometer-mobile-fenix-nofis** 3707 - ❌ 3708 - ❌ 3709 - ❌ 3710 - ❌ 3711 * - **browsertime-benchmark-speedometer-mobile-geckoview** 3712 - ❌ 3713 - ❌ 3714 - ❌ 3715 - ❌ 3716 * - **browsertime-benchmark-speedometer-mobile-geckoview-nofis** 3717 - ❌ 3718 - ❌ 3719 - ❌ 3720 - ❌ 3721 3722 3723 .. list-table:: **test-android-hw-p6-13-0-aarch64-shippable/opt** 3724 :widths: 30 15 15 15 15 3725 :header-rows: 1 3726 3727 * - **Test Name** 3728 - mozilla-central 3729 - autoland 3730 - mozilla-release 3731 - mozilla-beta 3732 * - **browsertime-benchmark-speedometer-mobile-chrome-m-nofis** 3733 - ❌ 3734 - ❌ 3735 - ❌ 3736 - ❌ 3737 * - **browsertime-benchmark-speedometer-mobile-cstm-car-m-nofis** 3738 - ❌ 3739 - ❌ 3740 - ❌ 3741 - ❌ 3742 * - **browsertime-benchmark-speedometer-mobile-fenix** 3743 - ❌ 3744 - ❌ 3745 - ❌ 3746 - ❌ 3747 * - **browsertime-benchmark-speedometer-mobile-fenix-nofis** 3748 - ❌ 3749 - ❌ 3750 - ❌ 3751 - ❌ 3752 * - **browsertime-benchmark-speedometer-mobile-geckoview** 3753 - ❌ 3754 - ❌ 3755 - ❌ 3756 - ❌ 3757 * - **browsertime-benchmark-speedometer-mobile-geckoview-nofis** 3758 - ❌ 3759 - ❌ 3760 - ❌ 3761 - ❌ 3762 3763 3764 .. list-table:: **test-android-hw-s24-14-0-aarch64-shippable/opt** 3765 :widths: 30 15 15 15 15 3766 :header-rows: 1 3767 3768 * - **Test Name** 3769 - mozilla-central 3770 - autoland 3771 - mozilla-release 3772 - mozilla-beta 3773 * - **browsertime-benchmark-speedometer-mobile-chrome-m-nofis** 3774 - ❌ 3775 - ❌ 3776 - ❌ 3777 - ❌ 3778 * - **browsertime-benchmark-speedometer-mobile-cstm-car-m-nofis** 3779 - ❌ 3780 - ❌ 3781 - ❌ 3782 - ❌ 3783 * - **browsertime-benchmark-speedometer-mobile-fenix** 3784 - ❌ 3785 - ❌ 3786 - ❌ 3787 - ❌ 3788 * - **browsertime-benchmark-speedometer-mobile-fenix-nofis** 3789 - ❌ 3790 - ❌ 3791 - ❌ 3792 - ❌ 3793 * - **browsertime-benchmark-speedometer-mobile-geckoview** 3794 - ❌ 3795 - ❌ 3796 - ❌ 3797 - ❌ 3798 * - **browsertime-benchmark-speedometer-mobile-geckoview-nofis** 3799 - ❌ 3800 - ❌ 3801 - ❌ 3802 - ❌ 3803 3804 3805 .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** 3806 :widths: 30 15 15 15 15 3807 :header-rows: 1 3808 3809 * - **Test Name** 3810 - mozilla-central 3811 - autoland 3812 - mozilla-release 3813 - mozilla-beta 3814 * - **browsertime-benchmark-firefox-speedometer** 3815 - ❌ 3816 - ❌ 3817 - ❌ 3818 - ❌ 3819 3820 3821 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 3822 :widths: 30 15 15 15 15 3823 :header-rows: 1 3824 3825 * - **Test Name** 3826 - mozilla-central 3827 - autoland 3828 - mozilla-release 3829 - mozilla-beta 3830 * - **browsertime-benchmark-firefox-speedometer** 3831 - ❌ 3832 - ✅ 3833 - ❌ 3834 - ❌ 3835 3836 3837 .. list-table:: **test-linux1804-64-qr/opt** 3838 :widths: 30 15 15 15 15 3839 :header-rows: 1 3840 3841 * - **Test Name** 3842 - mozilla-central 3843 - autoland 3844 - mozilla-release 3845 - mozilla-beta 3846 * - **browsertime-benchmark-firefox-speedometer** 3847 - ❌ 3848 - ❌ 3849 - ❌ 3850 - ❌ 3851 3852 3853 .. list-table:: **test-linux1804-64-shippable-qr/opt** 3854 :widths: 30 15 15 15 15 3855 :header-rows: 1 3856 3857 * - **Test Name** 3858 - mozilla-central 3859 - autoland 3860 - mozilla-release 3861 - mozilla-beta 3862 * - **browsertime-benchmark-chrome-speedometer** 3863 - ❌ 3864 - ❌ 3865 - ❌ 3866 - ❌ 3867 * - **browsertime-benchmark-custom-car-speedometer** 3868 - ❌ 3869 - ❌ 3870 - ❌ 3871 - ❌ 3872 * - **browsertime-benchmark-firefox-speedometer** 3873 - ✅ 3874 - ✅ 3875 - ❌ 3876 - ❌ 3877 3878 3879 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 3880 :widths: 30 15 15 15 15 3881 :header-rows: 1 3882 3883 * - **Test Name** 3884 - mozilla-central 3885 - autoland 3886 - mozilla-release 3887 - mozilla-beta 3888 * - **browsertime-benchmark-firefox-speedometer** 3889 - ❌ 3890 - ✅ 3891 - ❌ 3892 - ❌ 3893 3894 3895 .. list-table:: **test-macosx1470-64-shippable/opt** 3896 :widths: 30 15 15 15 15 3897 :header-rows: 1 3898 3899 * - **Test Name** 3900 - mozilla-central 3901 - autoland 3902 - mozilla-release 3903 - mozilla-beta 3904 * - **browsertime-benchmark-chrome-speedometer** 3905 - ❌ 3906 - ❌ 3907 - ❌ 3908 - ❌ 3909 * - **browsertime-benchmark-custom-car-speedometer** 3910 - ❌ 3911 - ❌ 3912 - ❌ 3913 - ❌ 3914 * - **browsertime-benchmark-firefox-speedometer** 3915 - ✅ 3916 - ✅ 3917 - ❌ 3918 - ❌ 3919 * - **browsertime-benchmark-safari-speedometer** 3920 - ❌ 3921 - ❌ 3922 - ❌ 3923 - ❌ 3924 3925 3926 .. list-table:: **test-macosx1470-64/opt** 3927 :widths: 30 15 15 15 15 3928 :header-rows: 1 3929 3930 * - **Test Name** 3931 - mozilla-central 3932 - autoland 3933 - mozilla-release 3934 - mozilla-beta 3935 * - **browsertime-benchmark-firefox-speedometer** 3936 - ❌ 3937 - ❌ 3938 - ❌ 3939 - ❌ 3940 3941 3942 .. list-table:: **test-macosx1500-aarch64-shippable/opt** 3943 :widths: 30 15 15 15 15 3944 :header-rows: 1 3945 3946 * - **Test Name** 3947 - mozilla-central 3948 - autoland 3949 - mozilla-release 3950 - mozilla-beta 3951 * - **browsertime-benchmark-chrome-speedometer** 3952 - ❌ 3953 - ❌ 3954 - ❌ 3955 - ❌ 3956 * - **browsertime-benchmark-custom-car-speedometer** 3957 - ❌ 3958 - ❌ 3959 - ❌ 3960 - ❌ 3961 * - **browsertime-benchmark-firefox-speedometer** 3962 - ✅ 3963 - ✅ 3964 - ❌ 3965 - ❌ 3966 * - **browsertime-benchmark-safari-speedometer** 3967 - ❌ 3968 - ❌ 3969 - ❌ 3970 - ❌ 3971 3972 3973 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 3974 :widths: 30 15 15 15 15 3975 :header-rows: 1 3976 3977 * - **Test Name** 3978 - mozilla-central 3979 - autoland 3980 - mozilla-release 3981 - mozilla-beta 3982 * - **browsertime-benchmark-firefox-speedometer** 3983 - ❌ 3984 - ✅ 3985 - ❌ 3986 - ❌ 3987 3988 3989 .. list-table:: **test-windows11-64-24h2-shippable/opt** 3990 :widths: 30 15 15 15 15 3991 :header-rows: 1 3992 3993 * - **Test Name** 3994 - mozilla-central 3995 - autoland 3996 - mozilla-release 3997 - mozilla-beta 3998 * - **browsertime-benchmark-chrome-speedometer** 3999 - ❌ 4000 - ❌ 4001 - ❌ 4002 - ❌ 4003 * - **browsertime-benchmark-custom-car-speedometer** 4004 - ❌ 4005 - ❌ 4006 - ❌ 4007 - ❌ 4008 * - **browsertime-benchmark-firefox-speedometer** 4009 - ✅ 4010 - ✅ 4011 - ❌ 4012 - ❌ 4013 4014 4015 .. list-table:: **test-windows11-64-24h2/opt** 4016 :widths: 30 15 15 15 15 4017 :header-rows: 1 4018 4019 * - **Test Name** 4020 - mozilla-central 4021 - autoland 4022 - mozilla-release 4023 - mozilla-beta 4024 * - **browsertime-benchmark-firefox-speedometer** 4025 - ❌ 4026 - ❌ 4027 - ❌ 4028 - ❌ 4029 4030 4031 4032 .. dropdown:: speedometer3 4033 :class-container: anchor-id-speedometer3-b 4034 4035 * Command to Run Locally 4036 4037 .. code-block:: 4038 4039 ./mach raptor -t speedometer3 4040 4041 **Owner**: Performance Team 4042 4043 * **alert threshold**: 2.0 4044 * **apps**: firefox, chrome, safari, safari-tp, custom-car 4045 * **browser cycles**: 5 4046 * **cold**: true 4047 * **expected**: pass 4048 * **expose browser profiler**: true 4049 * **gather cpuTime**: true 4050 * **gecko profile features**: stackwalk,js,cpu,processcpu,ipcmessages,nomarkerstacks 4051 * **gecko profile interval**: 1 4052 * **gecko profile threads**: GeckoMain,Compositor,Renderer,TaskController,StyleThread 4053 * **host from parent**: false 4054 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/speedometer-desktop.toml#21>`__ 4055 * **lower is better**: false 4056 * **page cycles**: 5 4057 * **page timeout**: 600000 4058 * **subtest lower is better**: true 4059 * **subtest unit**: ms 4060 * **support class**: speedometer3.py 4061 * **test script**: speedometer3.js 4062 * **test url**: `<http://\<host\>:\<port\>/Speedometer3/index.html?raptor>`__ 4063 * **type**: benchmark 4064 * **unit**: score 4065 * **Test Task**: 4066 4067 .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** 4068 :widths: 30 15 15 15 15 4069 :header-rows: 1 4070 4071 * - **Test Name** 4072 - mozilla-central 4073 - autoland 4074 - mozilla-release 4075 - mozilla-beta 4076 * - **browsertime-benchmark-speedometer3-mobile-chrome-m-nofis** 4077 - ❌ 4078 - ❌ 4079 - ❌ 4080 - ❌ 4081 * - **browsertime-benchmark-speedometer3-mobile-cstm-car-m-nofis** 4082 - ❌ 4083 - ❌ 4084 - ❌ 4085 - ❌ 4086 * - **browsertime-benchmark-speedometer3-mobile-fenix** 4087 - ✅ 4088 - ✅ 4089 - ❌ 4090 - ❌ 4091 * - **browsertime-benchmark-speedometer3-mobile-fenix-nofis** 4092 - ✅ 4093 - ✅ 4094 - ❌ 4095 - ❌ 4096 * - **browsertime-benchmark-speedometer3-mobile-geckoview** 4097 - ❌ 4098 - ❌ 4099 - ❌ 4100 - ❌ 4101 * - **browsertime-benchmark-speedometer3-mobile-geckoview-nofis** 4102 - ❌ 4103 - ❌ 4104 - ❌ 4105 - ❌ 4106 4107 4108 .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** 4109 :widths: 30 15 15 15 15 4110 :header-rows: 1 4111 4112 * - **Test Name** 4113 - mozilla-central 4114 - autoland 4115 - mozilla-release 4116 - mozilla-beta 4117 * - **browsertime-benchmark-speedometer3-mobile-fenix** 4118 - ❌ 4119 - ❌ 4120 - ❌ 4121 - ❌ 4122 * - **browsertime-benchmark-speedometer3-mobile-fenix-nofis** 4123 - ❌ 4124 - ❌ 4125 - ❌ 4126 - ❌ 4127 * - **browsertime-benchmark-speedometer3-mobile-geckoview** 4128 - ❌ 4129 - ❌ 4130 - ❌ 4131 - ❌ 4132 * - **browsertime-benchmark-speedometer3-mobile-geckoview-nofis** 4133 - ❌ 4134 - ❌ 4135 - ❌ 4136 - ❌ 4137 4138 4139 .. list-table:: **test-android-hw-p6-13-0-aarch64-shippable/opt** 4140 :widths: 30 15 15 15 15 4141 :header-rows: 1 4142 4143 * - **Test Name** 4144 - mozilla-central 4145 - autoland 4146 - mozilla-release 4147 - mozilla-beta 4148 * - **browsertime-benchmark-speedometer3-mobile-chrome-m-nofis** 4149 - ✅ 4150 - ❌ 4151 - ❌ 4152 - ❌ 4153 * - **browsertime-benchmark-speedometer3-mobile-cstm-car-m-nofis** 4154 - ❌ 4155 - ❌ 4156 - ❌ 4157 - ❌ 4158 * - **browsertime-benchmark-speedometer3-mobile-fenix** 4159 - ✅ 4160 - ❌ 4161 - ❌ 4162 - ❌ 4163 * - **browsertime-benchmark-speedometer3-mobile-fenix-nofis** 4164 - ✅ 4165 - ❌ 4166 - ❌ 4167 - ❌ 4168 * - **browsertime-benchmark-speedometer3-mobile-geckoview** 4169 - ❌ 4170 - ❌ 4171 - ❌ 4172 - ❌ 4173 * - **browsertime-benchmark-speedometer3-mobile-geckoview-nofis** 4174 - ❌ 4175 - ❌ 4176 - ❌ 4177 - ❌ 4178 4179 4180 .. list-table:: **test-android-hw-s24-14-0-aarch64-shippable/opt** 4181 :widths: 30 15 15 15 15 4182 :header-rows: 1 4183 4184 * - **Test Name** 4185 - mozilla-central 4186 - autoland 4187 - mozilla-release 4188 - mozilla-beta 4189 * - **browsertime-benchmark-speedometer3-mobile-chrome-m-nofis** 4190 - ✅ 4191 - ❌ 4192 - ❌ 4193 - ❌ 4194 * - **browsertime-benchmark-speedometer3-mobile-cstm-car-m-nofis** 4195 - ❌ 4196 - ❌ 4197 - ❌ 4198 - ❌ 4199 * - **browsertime-benchmark-speedometer3-mobile-fenix** 4200 - ✅ 4201 - ❌ 4202 - ❌ 4203 - ❌ 4204 * - **browsertime-benchmark-speedometer3-mobile-fenix-nofis** 4205 - ✅ 4206 - ❌ 4207 - ❌ 4208 - ❌ 4209 * - **browsertime-benchmark-speedometer3-mobile-geckoview** 4210 - ❌ 4211 - ❌ 4212 - ❌ 4213 - ❌ 4214 * - **browsertime-benchmark-speedometer3-mobile-geckoview-nofis** 4215 - ❌ 4216 - ❌ 4217 - ❌ 4218 - ❌ 4219 4220 4221 .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** 4222 :widths: 30 15 15 15 15 4223 :header-rows: 1 4224 4225 * - **Test Name** 4226 - mozilla-central 4227 - autoland 4228 - mozilla-release 4229 - mozilla-beta 4230 * - **browsertime-benchmark-firefox-speedometer3** 4231 - ❌ 4232 - ❌ 4233 - ❌ 4234 - ❌ 4235 4236 4237 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 4238 :widths: 30 15 15 15 15 4239 :header-rows: 1 4240 4241 * - **Test Name** 4242 - mozilla-central 4243 - autoland 4244 - mozilla-release 4245 - mozilla-beta 4246 * - **browsertime-benchmark-firefox-speedometer3** 4247 - ✅ 4248 - ✅ 4249 - ❌ 4250 - ❌ 4251 4252 4253 .. list-table:: **test-linux1804-64-qr/opt** 4254 :widths: 30 15 15 15 15 4255 :header-rows: 1 4256 4257 * - **Test Name** 4258 - mozilla-central 4259 - autoland 4260 - mozilla-release 4261 - mozilla-beta 4262 * - **browsertime-benchmark-firefox-speedometer3** 4263 - ❌ 4264 - ❌ 4265 - ❌ 4266 - ❌ 4267 4268 4269 .. list-table:: **test-linux1804-64-shippable-qr/opt** 4270 :widths: 30 15 15 15 15 4271 :header-rows: 1 4272 4273 * - **Test Name** 4274 - mozilla-central 4275 - autoland 4276 - mozilla-release 4277 - mozilla-beta 4278 * - **browsertime-benchmark-chrome-speedometer3** 4279 - ❌ 4280 - ❌ 4281 - ❌ 4282 - ❌ 4283 * - **browsertime-benchmark-custom-car-speedometer3** 4284 - ❌ 4285 - ❌ 4286 - ❌ 4287 - ❌ 4288 * - **browsertime-benchmark-firefox-speedometer3** 4289 - ✅ 4290 - ✅ 4291 - ❌ 4292 - ❌ 4293 4294 4295 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 4296 :widths: 30 15 15 15 15 4297 :header-rows: 1 4298 4299 * - **Test Name** 4300 - mozilla-central 4301 - autoland 4302 - mozilla-release 4303 - mozilla-beta 4304 * - **browsertime-benchmark-firefox-speedometer3** 4305 - ✅ 4306 - ✅ 4307 - ❌ 4308 - ❌ 4309 4310 4311 .. list-table:: **test-macosx1470-64-shippable/opt** 4312 :widths: 30 15 15 15 15 4313 :header-rows: 1 4314 4315 * - **Test Name** 4316 - mozilla-central 4317 - autoland 4318 - mozilla-release 4319 - mozilla-beta 4320 * - **browsertime-benchmark-chrome-speedometer3** 4321 - ❌ 4322 - ❌ 4323 - ❌ 4324 - ❌ 4325 * - **browsertime-benchmark-custom-car-speedometer3** 4326 - ❌ 4327 - ❌ 4328 - ❌ 4329 - ❌ 4330 * - **browsertime-benchmark-firefox-speedometer3** 4331 - ✅ 4332 - ✅ 4333 - ❌ 4334 - ❌ 4335 4336 4337 .. list-table:: **test-macosx1470-64/opt** 4338 :widths: 30 15 15 15 15 4339 :header-rows: 1 4340 4341 * - **Test Name** 4342 - mozilla-central 4343 - autoland 4344 - mozilla-release 4345 - mozilla-beta 4346 * - **browsertime-benchmark-firefox-speedometer3** 4347 - ❌ 4348 - ❌ 4349 - ❌ 4350 - ❌ 4351 4352 4353 .. list-table:: **test-macosx1500-aarch64-shippable/opt** 4354 :widths: 30 15 15 15 15 4355 :header-rows: 1 4356 4357 * - **Test Name** 4358 - mozilla-central 4359 - autoland 4360 - mozilla-release 4361 - mozilla-beta 4362 * - **browsertime-benchmark-chrome-speedometer3** 4363 - ❌ 4364 - ❌ 4365 - ❌ 4366 - ❌ 4367 * - **browsertime-benchmark-custom-car-speedometer3** 4368 - ❌ 4369 - ❌ 4370 - ❌ 4371 - ❌ 4372 * - **browsertime-benchmark-firefox-speedometer3** 4373 - ✅ 4374 - ✅ 4375 - ❌ 4376 - ❌ 4377 * - **browsertime-benchmark-safari-speedometer3** 4378 - ❌ 4379 - ❌ 4380 - ❌ 4381 - ❌ 4382 * - **browsertime-benchmark-safari-tp-speedometer3** 4383 - ✅ 4384 - ❌ 4385 - ❌ 4386 - ❌ 4387 4388 4389 .. list-table:: **test-windows11-64-24h2-hw-ref-shippable/opt** 4390 :widths: 30 15 15 15 15 4391 :header-rows: 1 4392 4393 * - **Test Name** 4394 - mozilla-central 4395 - autoland 4396 - mozilla-release 4397 - mozilla-beta 4398 * - **browsertime-benchmark-chrome-speedometer3** 4399 - ❌ 4400 - ❌ 4401 - ❌ 4402 - ❌ 4403 * - **browsertime-benchmark-custom-car-speedometer3** 4404 - ❌ 4405 - ❌ 4406 - ❌ 4407 - ❌ 4408 * - **browsertime-benchmark-firefox-speedometer3** 4409 - ✅ 4410 - ❌ 4411 - ❌ 4412 - ❌ 4413 4414 4415 .. list-table:: **test-windows11-64-24h2-hw-ref/opt** 4416 :widths: 30 15 15 15 15 4417 :header-rows: 1 4418 4419 * - **Test Name** 4420 - mozilla-central 4421 - autoland 4422 - mozilla-release 4423 - mozilla-beta 4424 * - **browsertime-benchmark-firefox-speedometer3** 4425 - ❌ 4426 - ❌ 4427 - ❌ 4428 - ❌ 4429 4430 4431 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 4432 :widths: 30 15 15 15 15 4433 :header-rows: 1 4434 4435 * - **Test Name** 4436 - mozilla-central 4437 - autoland 4438 - mozilla-release 4439 - mozilla-beta 4440 * - **browsertime-benchmark-firefox-speedometer3** 4441 - ✅ 4442 - ✅ 4443 - ❌ 4444 - ❌ 4445 4446 4447 .. list-table:: **test-windows11-64-24h2-shippable/opt** 4448 :widths: 30 15 15 15 15 4449 :header-rows: 1 4450 4451 * - **Test Name** 4452 - mozilla-central 4453 - autoland 4454 - mozilla-release 4455 - mozilla-beta 4456 * - **browsertime-benchmark-chrome-speedometer3** 4457 - ❌ 4458 - ❌ 4459 - ❌ 4460 - ❌ 4461 * - **browsertime-benchmark-custom-car-speedometer3** 4462 - ❌ 4463 - ❌ 4464 - ❌ 4465 - ❌ 4466 * - **browsertime-benchmark-firefox-speedometer3** 4467 - ✅ 4468 - ✅ 4469 - ❌ 4470 - ❌ 4471 4472 4473 .. list-table:: **test-windows11-64-24h2/opt** 4474 :widths: 30 15 15 15 15 4475 :header-rows: 1 4476 4477 * - **Test Name** 4478 - mozilla-central 4479 - autoland 4480 - mozilla-release 4481 - mozilla-beta 4482 * - **browsertime-benchmark-firefox-speedometer3** 4483 - ❌ 4484 - ❌ 4485 - ❌ 4486 - ❌ 4487 4488 4489 **Owner**: Performance Team 4490 4491 * **alert threshold**: 2.0 4492 * **apps**: fenix, geckoview, refbrow, chrome-m, cstm-car-m 4493 * **browser cycles**: 5 4494 * **cold**: true 4495 * **expected**: pass 4496 * **expose browser profiler**: true 4497 * **gather cpuTime**: true 4498 * **gecko profile features**: stackwalk,js,cpu,processcpu,ipcmessages,nomarkerstacks 4499 * **gecko profile interval**: 1 4500 * **gecko profile threads**: GeckoMain,Compositor,Renderer,TaskController,StyleThread 4501 * **host from parent**: false 4502 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/speedometer-mobile.toml#21>`__ 4503 * **lower is better**: false 4504 * **page cycles**: 5 4505 * **page timeout**: 420000 4506 * **subtest lower is better**: true 4507 * **subtest unit**: ms 4508 * **support class**: speedometer3.py 4509 * **test script**: speedometer3.js 4510 * **test url**: `<http://\<host\>:\<port\>/Speedometer3/index.html?raptor>`__ 4511 * **type**: benchmark 4512 * **unit**: score 4513 * **Test Task**: 4514 4515 .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** 4516 :widths: 30 15 15 15 15 4517 :header-rows: 1 4518 4519 * - **Test Name** 4520 - mozilla-central 4521 - autoland 4522 - mozilla-release 4523 - mozilla-beta 4524 * - **browsertime-benchmark-speedometer3-mobile-chrome-m-nofis** 4525 - ❌ 4526 - ❌ 4527 - ❌ 4528 - ❌ 4529 * - **browsertime-benchmark-speedometer3-mobile-cstm-car-m-nofis** 4530 - ❌ 4531 - ❌ 4532 - ❌ 4533 - ❌ 4534 * - **browsertime-benchmark-speedometer3-mobile-fenix** 4535 - ✅ 4536 - ✅ 4537 - ❌ 4538 - ❌ 4539 * - **browsertime-benchmark-speedometer3-mobile-fenix-nofis** 4540 - ✅ 4541 - ✅ 4542 - ❌ 4543 - ❌ 4544 * - **browsertime-benchmark-speedometer3-mobile-geckoview** 4545 - ❌ 4546 - ❌ 4547 - ❌ 4548 - ❌ 4549 * - **browsertime-benchmark-speedometer3-mobile-geckoview-nofis** 4550 - ❌ 4551 - ❌ 4552 - ❌ 4553 - ❌ 4554 4555 4556 .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** 4557 :widths: 30 15 15 15 15 4558 :header-rows: 1 4559 4560 * - **Test Name** 4561 - mozilla-central 4562 - autoland 4563 - mozilla-release 4564 - mozilla-beta 4565 * - **browsertime-benchmark-speedometer3-mobile-fenix** 4566 - ❌ 4567 - ❌ 4568 - ❌ 4569 - ❌ 4570 * - **browsertime-benchmark-speedometer3-mobile-fenix-nofis** 4571 - ❌ 4572 - ❌ 4573 - ❌ 4574 - ❌ 4575 * - **browsertime-benchmark-speedometer3-mobile-geckoview** 4576 - ❌ 4577 - ❌ 4578 - ❌ 4579 - ❌ 4580 * - **browsertime-benchmark-speedometer3-mobile-geckoview-nofis** 4581 - ❌ 4582 - ❌ 4583 - ❌ 4584 - ❌ 4585 4586 4587 .. list-table:: **test-android-hw-p6-13-0-aarch64-shippable/opt** 4588 :widths: 30 15 15 15 15 4589 :header-rows: 1 4590 4591 * - **Test Name** 4592 - mozilla-central 4593 - autoland 4594 - mozilla-release 4595 - mozilla-beta 4596 * - **browsertime-benchmark-speedometer3-mobile-chrome-m-nofis** 4597 - ✅ 4598 - ❌ 4599 - ❌ 4600 - ❌ 4601 * - **browsertime-benchmark-speedometer3-mobile-cstm-car-m-nofis** 4602 - ❌ 4603 - ❌ 4604 - ❌ 4605 - ❌ 4606 * - **browsertime-benchmark-speedometer3-mobile-fenix** 4607 - ✅ 4608 - ❌ 4609 - ❌ 4610 - ❌ 4611 * - **browsertime-benchmark-speedometer3-mobile-fenix-nofis** 4612 - ✅ 4613 - ❌ 4614 - ❌ 4615 - ❌ 4616 * - **browsertime-benchmark-speedometer3-mobile-geckoview** 4617 - ❌ 4618 - ❌ 4619 - ❌ 4620 - ❌ 4621 * - **browsertime-benchmark-speedometer3-mobile-geckoview-nofis** 4622 - ❌ 4623 - ❌ 4624 - ❌ 4625 - ❌ 4626 4627 4628 .. list-table:: **test-android-hw-s24-14-0-aarch64-shippable/opt** 4629 :widths: 30 15 15 15 15 4630 :header-rows: 1 4631 4632 * - **Test Name** 4633 - mozilla-central 4634 - autoland 4635 - mozilla-release 4636 - mozilla-beta 4637 * - **browsertime-benchmark-speedometer3-mobile-chrome-m-nofis** 4638 - ✅ 4639 - ❌ 4640 - ❌ 4641 - ❌ 4642 * - **browsertime-benchmark-speedometer3-mobile-cstm-car-m-nofis** 4643 - ❌ 4644 - ❌ 4645 - ❌ 4646 - ❌ 4647 * - **browsertime-benchmark-speedometer3-mobile-fenix** 4648 - ✅ 4649 - ❌ 4650 - ❌ 4651 - ❌ 4652 * - **browsertime-benchmark-speedometer3-mobile-fenix-nofis** 4653 - ✅ 4654 - ❌ 4655 - ❌ 4656 - ❌ 4657 * - **browsertime-benchmark-speedometer3-mobile-geckoview** 4658 - ❌ 4659 - ❌ 4660 - ❌ 4661 - ❌ 4662 * - **browsertime-benchmark-speedometer3-mobile-geckoview-nofis** 4663 - ❌ 4664 - ❌ 4665 - ❌ 4666 - ❌ 4667 4668 4669 .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** 4670 :widths: 30 15 15 15 15 4671 :header-rows: 1 4672 4673 * - **Test Name** 4674 - mozilla-central 4675 - autoland 4676 - mozilla-release 4677 - mozilla-beta 4678 * - **browsertime-benchmark-firefox-speedometer3** 4679 - ❌ 4680 - ❌ 4681 - ❌ 4682 - ❌ 4683 4684 4685 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 4686 :widths: 30 15 15 15 15 4687 :header-rows: 1 4688 4689 * - **Test Name** 4690 - mozilla-central 4691 - autoland 4692 - mozilla-release 4693 - mozilla-beta 4694 * - **browsertime-benchmark-firefox-speedometer3** 4695 - ✅ 4696 - ✅ 4697 - ❌ 4698 - ❌ 4699 4700 4701 .. list-table:: **test-linux1804-64-qr/opt** 4702 :widths: 30 15 15 15 15 4703 :header-rows: 1 4704 4705 * - **Test Name** 4706 - mozilla-central 4707 - autoland 4708 - mozilla-release 4709 - mozilla-beta 4710 * - **browsertime-benchmark-firefox-speedometer3** 4711 - ❌ 4712 - ❌ 4713 - ❌ 4714 - ❌ 4715 4716 4717 .. list-table:: **test-linux1804-64-shippable-qr/opt** 4718 :widths: 30 15 15 15 15 4719 :header-rows: 1 4720 4721 * - **Test Name** 4722 - mozilla-central 4723 - autoland 4724 - mozilla-release 4725 - mozilla-beta 4726 * - **browsertime-benchmark-chrome-speedometer3** 4727 - ❌ 4728 - ❌ 4729 - ❌ 4730 - ❌ 4731 * - **browsertime-benchmark-custom-car-speedometer3** 4732 - ❌ 4733 - ❌ 4734 - ❌ 4735 - ❌ 4736 * - **browsertime-benchmark-firefox-speedometer3** 4737 - ✅ 4738 - ✅ 4739 - ❌ 4740 - ❌ 4741 4742 4743 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 4744 :widths: 30 15 15 15 15 4745 :header-rows: 1 4746 4747 * - **Test Name** 4748 - mozilla-central 4749 - autoland 4750 - mozilla-release 4751 - mozilla-beta 4752 * - **browsertime-benchmark-firefox-speedometer3** 4753 - ✅ 4754 - ✅ 4755 - ❌ 4756 - ❌ 4757 4758 4759 .. list-table:: **test-macosx1470-64-shippable/opt** 4760 :widths: 30 15 15 15 15 4761 :header-rows: 1 4762 4763 * - **Test Name** 4764 - mozilla-central 4765 - autoland 4766 - mozilla-release 4767 - mozilla-beta 4768 * - **browsertime-benchmark-chrome-speedometer3** 4769 - ❌ 4770 - ❌ 4771 - ❌ 4772 - ❌ 4773 * - **browsertime-benchmark-custom-car-speedometer3** 4774 - ❌ 4775 - ❌ 4776 - ❌ 4777 - ❌ 4778 * - **browsertime-benchmark-firefox-speedometer3** 4779 - ✅ 4780 - ✅ 4781 - ❌ 4782 - ❌ 4783 4784 4785 .. list-table:: **test-macosx1470-64/opt** 4786 :widths: 30 15 15 15 15 4787 :header-rows: 1 4788 4789 * - **Test Name** 4790 - mozilla-central 4791 - autoland 4792 - mozilla-release 4793 - mozilla-beta 4794 * - **browsertime-benchmark-firefox-speedometer3** 4795 - ❌ 4796 - ❌ 4797 - ❌ 4798 - ❌ 4799 4800 4801 .. list-table:: **test-macosx1500-aarch64-shippable/opt** 4802 :widths: 30 15 15 15 15 4803 :header-rows: 1 4804 4805 * - **Test Name** 4806 - mozilla-central 4807 - autoland 4808 - mozilla-release 4809 - mozilla-beta 4810 * - **browsertime-benchmark-chrome-speedometer3** 4811 - ❌ 4812 - ❌ 4813 - ❌ 4814 - ❌ 4815 * - **browsertime-benchmark-custom-car-speedometer3** 4816 - ❌ 4817 - ❌ 4818 - ❌ 4819 - ❌ 4820 * - **browsertime-benchmark-firefox-speedometer3** 4821 - ✅ 4822 - ✅ 4823 - ❌ 4824 - ❌ 4825 * - **browsertime-benchmark-safari-speedometer3** 4826 - ❌ 4827 - ❌ 4828 - ❌ 4829 - ❌ 4830 * - **browsertime-benchmark-safari-tp-speedometer3** 4831 - ✅ 4832 - ❌ 4833 - ❌ 4834 - ❌ 4835 4836 4837 .. list-table:: **test-windows11-64-24h2-hw-ref-shippable/opt** 4838 :widths: 30 15 15 15 15 4839 :header-rows: 1 4840 4841 * - **Test Name** 4842 - mozilla-central 4843 - autoland 4844 - mozilla-release 4845 - mozilla-beta 4846 * - **browsertime-benchmark-chrome-speedometer3** 4847 - ❌ 4848 - ❌ 4849 - ❌ 4850 - ❌ 4851 * - **browsertime-benchmark-custom-car-speedometer3** 4852 - ❌ 4853 - ❌ 4854 - ❌ 4855 - ❌ 4856 * - **browsertime-benchmark-firefox-speedometer3** 4857 - ✅ 4858 - ❌ 4859 - ❌ 4860 - ❌ 4861 4862 4863 .. list-table:: **test-windows11-64-24h2-hw-ref/opt** 4864 :widths: 30 15 15 15 15 4865 :header-rows: 1 4866 4867 * - **Test Name** 4868 - mozilla-central 4869 - autoland 4870 - mozilla-release 4871 - mozilla-beta 4872 * - **browsertime-benchmark-firefox-speedometer3** 4873 - ❌ 4874 - ❌ 4875 - ❌ 4876 - ❌ 4877 4878 4879 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 4880 :widths: 30 15 15 15 15 4881 :header-rows: 1 4882 4883 * - **Test Name** 4884 - mozilla-central 4885 - autoland 4886 - mozilla-release 4887 - mozilla-beta 4888 * - **browsertime-benchmark-firefox-speedometer3** 4889 - ✅ 4890 - ✅ 4891 - ❌ 4892 - ❌ 4893 4894 4895 .. list-table:: **test-windows11-64-24h2-shippable/opt** 4896 :widths: 30 15 15 15 15 4897 :header-rows: 1 4898 4899 * - **Test Name** 4900 - mozilla-central 4901 - autoland 4902 - mozilla-release 4903 - mozilla-beta 4904 * - **browsertime-benchmark-chrome-speedometer3** 4905 - ❌ 4906 - ❌ 4907 - ❌ 4908 - ❌ 4909 * - **browsertime-benchmark-custom-car-speedometer3** 4910 - ❌ 4911 - ❌ 4912 - ❌ 4913 - ❌ 4914 * - **browsertime-benchmark-firefox-speedometer3** 4915 - ✅ 4916 - ✅ 4917 - ❌ 4918 - ❌ 4919 4920 4921 .. list-table:: **test-windows11-64-24h2/opt** 4922 :widths: 30 15 15 15 15 4923 :header-rows: 1 4924 4925 * - **Test Name** 4926 - mozilla-central 4927 - autoland 4928 - mozilla-release 4929 - mozilla-beta 4930 * - **browsertime-benchmark-firefox-speedometer3** 4931 - ❌ 4932 - ❌ 4933 - ❌ 4934 - ❌ 4935 4936 4937 4938 .. dropdown:: stylebench 4939 :class-container: anchor-id-stylebench-b 4940 4941 * Command to Run Locally 4942 4943 .. code-block:: 4944 4945 ./mach raptor -t stylebench 4946 4947 **Owner**: :emilio and Layout Team 4948 4949 * **alert threshold**: 2.0 4950 * **apps**: firefox, chrome, safari 4951 * **expected**: pass 4952 * **expose browser profiler**: true 4953 * **gecko profile interval**: 1 4954 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/stylebench.toml#16>`__ 4955 * **lower is better**: false 4956 * **page cycles**: 5 4957 * **page timeout**: 140000 4958 * **subtest lower is better**: true 4959 * **subtest unit**: ms 4960 * **test url**: `<http://\<host\>:\<port\>/StyleBench/index.html?raptor>`__ 4961 * **type**: benchmark 4962 * **unit**: score 4963 * **Test Task**: 4964 4965 .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** 4966 :widths: 30 15 15 15 15 4967 :header-rows: 1 4968 4969 * - **Test Name** 4970 - mozilla-central 4971 - autoland 4972 - mozilla-release 4973 - mozilla-beta 4974 * - **browsertime-benchmark-firefox-stylebench** 4975 - ❌ 4976 - ❌ 4977 - ❌ 4978 - ❌ 4979 4980 4981 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 4982 :widths: 30 15 15 15 15 4983 :header-rows: 1 4984 4985 * - **Test Name** 4986 - mozilla-central 4987 - autoland 4988 - mozilla-release 4989 - mozilla-beta 4990 * - **browsertime-benchmark-firefox-stylebench** 4991 - ❌ 4992 - ❌ 4993 - ❌ 4994 - ❌ 4995 4996 4997 .. list-table:: **test-linux1804-64-qr/opt** 4998 :widths: 30 15 15 15 15 4999 :header-rows: 1 5000 5001 * - **Test Name** 5002 - mozilla-central 5003 - autoland 5004 - mozilla-release 5005 - mozilla-beta 5006 * - **browsertime-benchmark-firefox-stylebench** 5007 - ❌ 5008 - ❌ 5009 - ❌ 5010 - ❌ 5011 5012 5013 .. list-table:: **test-linux1804-64-shippable-qr/opt** 5014 :widths: 30 15 15 15 15 5015 :header-rows: 1 5016 5017 * - **Test Name** 5018 - mozilla-central 5019 - autoland 5020 - mozilla-release 5021 - mozilla-beta 5022 * - **browsertime-benchmark-chrome-stylebench** 5023 - ❌ 5024 - ❌ 5025 - ❌ 5026 - ❌ 5027 * - **browsertime-benchmark-firefox-stylebench** 5028 - ✅ 5029 - ✅ 5030 - ❌ 5031 - ❌ 5032 5033 5034 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 5035 :widths: 30 15 15 15 15 5036 :header-rows: 1 5037 5038 * - **Test Name** 5039 - mozilla-central 5040 - autoland 5041 - mozilla-release 5042 - mozilla-beta 5043 * - **browsertime-benchmark-firefox-stylebench** 5044 - ❌ 5045 - ❌ 5046 - ❌ 5047 - ❌ 5048 5049 5050 .. list-table:: **test-macosx1470-64-shippable/opt** 5051 :widths: 30 15 15 15 15 5052 :header-rows: 1 5053 5054 * - **Test Name** 5055 - mozilla-central 5056 - autoland 5057 - mozilla-release 5058 - mozilla-beta 5059 * - **browsertime-benchmark-chrome-stylebench** 5060 - ❌ 5061 - ❌ 5062 - ❌ 5063 - ❌ 5064 * - **browsertime-benchmark-firefox-stylebench** 5065 - ✅ 5066 - ✅ 5067 - ❌ 5068 - ❌ 5069 * - **browsertime-benchmark-safari-stylebench** 5070 - ❌ 5071 - ❌ 5072 - ❌ 5073 - ❌ 5074 5075 5076 .. list-table:: **test-macosx1470-64/opt** 5077 :widths: 30 15 15 15 15 5078 :header-rows: 1 5079 5080 * - **Test Name** 5081 - mozilla-central 5082 - autoland 5083 - mozilla-release 5084 - mozilla-beta 5085 * - **browsertime-benchmark-firefox-stylebench** 5086 - ❌ 5087 - ❌ 5088 - ❌ 5089 - ❌ 5090 5091 5092 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 5093 :widths: 30 15 15 15 15 5094 :header-rows: 1 5095 5096 * - **Test Name** 5097 - mozilla-central 5098 - autoland 5099 - mozilla-release 5100 - mozilla-beta 5101 * - **browsertime-benchmark-firefox-stylebench** 5102 - ❌ 5103 - ❌ 5104 - ❌ 5105 - ❌ 5106 5107 5108 .. list-table:: **test-windows11-64-24h2-shippable/opt** 5109 :widths: 30 15 15 15 15 5110 :header-rows: 1 5111 5112 * - **Test Name** 5113 - mozilla-central 5114 - autoland 5115 - mozilla-release 5116 - mozilla-beta 5117 * - **browsertime-benchmark-chrome-stylebench** 5118 - ❌ 5119 - ❌ 5120 - ❌ 5121 - ❌ 5122 * - **browsertime-benchmark-firefox-stylebench** 5123 - ✅ 5124 - ✅ 5125 - ❌ 5126 - ❌ 5127 5128 5129 .. list-table:: **test-windows11-64-24h2/opt** 5130 :widths: 30 15 15 15 15 5131 :header-rows: 1 5132 5133 * - **Test Name** 5134 - mozilla-central 5135 - autoland 5136 - mozilla-release 5137 - mozilla-beta 5138 * - **browsertime-benchmark-firefox-stylebench** 5139 - ❌ 5140 - ❌ 5141 - ❌ 5142 - ❌ 5143 5144 5145 5146 .. dropdown:: sunspider 5147 :class-container: anchor-id-sunspider-b 5148 5149 * Command to Run Locally 5150 5151 .. code-block:: 5152 5153 ./mach raptor -t sunspider 5154 5155 **Owner**: :jandem and SpiderMonkey Team 5156 5157 * **alert threshold**: 2.0 5158 * **apps**: firefox, chrome, safari 5159 * **expected**: pass 5160 * **expose browser profiler**: true 5161 * **gecko profile interval**: 1 5162 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/sunspider.toml#10>`__ 5163 * **lower is better**: true 5164 * **page cycles**: 5 5165 * **page timeout**: 55000 5166 * **test url**: `<http://\<host\>:\<port\>/SunSpider/sunspider-1.0.1/sunspider-1.0.1/driver.html?raptor>`__ 5167 * **type**: benchmark 5168 * **unit**: ms 5169 * **Test Task**: 5170 5171 .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** 5172 :widths: 30 15 15 15 15 5173 :header-rows: 1 5174 5175 * - **Test Name** 5176 - mozilla-central 5177 - autoland 5178 - mozilla-release 5179 - mozilla-beta 5180 * - **browsertime-benchmark-firefox-sunspider** 5181 - ❌ 5182 - ❌ 5183 - ❌ 5184 - ❌ 5185 5186 5187 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 5188 :widths: 30 15 15 15 15 5189 :header-rows: 1 5190 5191 * - **Test Name** 5192 - mozilla-central 5193 - autoland 5194 - mozilla-release 5195 - mozilla-beta 5196 * - **browsertime-benchmark-firefox-sunspider** 5197 - ❌ 5198 - ❌ 5199 - ❌ 5200 - ❌ 5201 5202 5203 .. list-table:: **test-linux1804-64-qr/opt** 5204 :widths: 30 15 15 15 15 5205 :header-rows: 1 5206 5207 * - **Test Name** 5208 - mozilla-central 5209 - autoland 5210 - mozilla-release 5211 - mozilla-beta 5212 * - **browsertime-benchmark-firefox-sunspider** 5213 - ❌ 5214 - ❌ 5215 - ❌ 5216 - ❌ 5217 5218 5219 .. list-table:: **test-linux1804-64-shippable-qr/opt** 5220 :widths: 30 15 15 15 15 5221 :header-rows: 1 5222 5223 * - **Test Name** 5224 - mozilla-central 5225 - autoland 5226 - mozilla-release 5227 - mozilla-beta 5228 * - **browsertime-benchmark-chrome-sunspider** 5229 - ❌ 5230 - ❌ 5231 - ❌ 5232 - ❌ 5233 * - **browsertime-benchmark-firefox-sunspider** 5234 - ✅ 5235 - ✅ 5236 - ❌ 5237 - ❌ 5238 5239 5240 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 5241 :widths: 30 15 15 15 15 5242 :header-rows: 1 5243 5244 * - **Test Name** 5245 - mozilla-central 5246 - autoland 5247 - mozilla-release 5248 - mozilla-beta 5249 * - **browsertime-benchmark-firefox-sunspider** 5250 - ❌ 5251 - ❌ 5252 - ❌ 5253 - ❌ 5254 5255 5256 .. list-table:: **test-macosx1470-64-shippable/opt** 5257 :widths: 30 15 15 15 15 5258 :header-rows: 1 5259 5260 * - **Test Name** 5261 - mozilla-central 5262 - autoland 5263 - mozilla-release 5264 - mozilla-beta 5265 * - **browsertime-benchmark-chrome-sunspider** 5266 - ❌ 5267 - ❌ 5268 - ❌ 5269 - ❌ 5270 * - **browsertime-benchmark-firefox-sunspider** 5271 - ✅ 5272 - ✅ 5273 - ❌ 5274 - ❌ 5275 * - **browsertime-benchmark-safari-sunspider** 5276 - ❌ 5277 - ❌ 5278 - ❌ 5279 - ❌ 5280 5281 5282 .. list-table:: **test-macosx1470-64/opt** 5283 :widths: 30 15 15 15 15 5284 :header-rows: 1 5285 5286 * - **Test Name** 5287 - mozilla-central 5288 - autoland 5289 - mozilla-release 5290 - mozilla-beta 5291 * - **browsertime-benchmark-firefox-sunspider** 5292 - ❌ 5293 - ❌ 5294 - ❌ 5295 - ❌ 5296 5297 5298 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 5299 :widths: 30 15 15 15 15 5300 :header-rows: 1 5301 5302 * - **Test Name** 5303 - mozilla-central 5304 - autoland 5305 - mozilla-release 5306 - mozilla-beta 5307 * - **browsertime-benchmark-firefox-sunspider** 5308 - ❌ 5309 - ❌ 5310 - ❌ 5311 - ❌ 5312 5313 5314 .. list-table:: **test-windows11-64-24h2-shippable/opt** 5315 :widths: 30 15 15 15 15 5316 :header-rows: 1 5317 5318 * - **Test Name** 5319 - mozilla-central 5320 - autoland 5321 - mozilla-release 5322 - mozilla-beta 5323 * - **browsertime-benchmark-chrome-sunspider** 5324 - ❌ 5325 - ❌ 5326 - ❌ 5327 - ❌ 5328 * - **browsertime-benchmark-firefox-sunspider** 5329 - ✅ 5330 - ✅ 5331 - ❌ 5332 - ❌ 5333 5334 5335 .. list-table:: **test-windows11-64-24h2/opt** 5336 :widths: 30 15 15 15 15 5337 :header-rows: 1 5338 5339 * - **Test Name** 5340 - mozilla-central 5341 - autoland 5342 - mozilla-release 5343 - mozilla-beta 5344 * - **browsertime-benchmark-firefox-sunspider** 5345 - ❌ 5346 - ❌ 5347 - ❌ 5348 - ❌ 5349 5350 5351 5352 .. dropdown:: twitch-animation 5353 :class-container: anchor-id-twitch-animation-b 5354 5355 * Command to Run Locally 5356 5357 .. code-block:: 5358 5359 ./mach raptor -t twitch-animation 5360 5361 **Owner**: :jrmuizel 5362 5363 * **alert threshold**: 2.0 5364 * **apps**: firefox 5365 * **expected**: pass 5366 * **expose browser profiler**: true 5367 * **gecko profile interval**: 1 5368 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/twitch-animation.toml#16>`__ 5369 * **lower is better**: true 5370 * **page cycles**: 1 5371 * **page timeout**: 2000000 5372 * **perfstats**: false 5373 * **repository**: https://github.com/mozilla/perf-automation 5374 * **repository path**: benchmarks/twitch-animation 5375 * **repository revision**: 61332db584026b73e37066d717a162825408c36b 5376 * **sparse checkout**: true 5377 * **subtest lower is better**: true 5378 * **subtest unit**: ms 5379 * **test url**: `<http://\<host\>:\<port\>/index.html>`__ 5380 * **type**: benchmark 5381 * **unit**: ms 5382 * **Test Task**: 5383 5384 .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** 5385 :widths: 30 15 15 15 15 5386 :header-rows: 1 5387 5388 * - **Test Name** 5389 - mozilla-central 5390 - autoland 5391 - mozilla-release 5392 - mozilla-beta 5393 * - **browsertime-benchmark-firefox-twitch-animation** 5394 - ❌ 5395 - ❌ 5396 - ❌ 5397 - ❌ 5398 5399 5400 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 5401 :widths: 30 15 15 15 15 5402 :header-rows: 1 5403 5404 * - **Test Name** 5405 - mozilla-central 5406 - autoland 5407 - mozilla-release 5408 - mozilla-beta 5409 * - **browsertime-benchmark-firefox-twitch-animation** 5410 - ❌ 5411 - ❌ 5412 - ❌ 5413 - ❌ 5414 5415 5416 .. list-table:: **test-linux1804-64-qr/opt** 5417 :widths: 30 15 15 15 15 5418 :header-rows: 1 5419 5420 * - **Test Name** 5421 - mozilla-central 5422 - autoland 5423 - mozilla-release 5424 - mozilla-beta 5425 * - **browsertime-benchmark-firefox-twitch-animation** 5426 - ❌ 5427 - ❌ 5428 - ❌ 5429 - ❌ 5430 5431 5432 .. list-table:: **test-linux1804-64-shippable-qr/opt** 5433 :widths: 30 15 15 15 15 5434 :header-rows: 1 5435 5436 * - **Test Name** 5437 - mozilla-central 5438 - autoland 5439 - mozilla-release 5440 - mozilla-beta 5441 * - **browsertime-benchmark-firefox-twitch-animation** 5442 - ✅ 5443 - ✅ 5444 - ❌ 5445 - ❌ 5446 5447 5448 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 5449 :widths: 30 15 15 15 15 5450 :header-rows: 1 5451 5452 * - **Test Name** 5453 - mozilla-central 5454 - autoland 5455 - mozilla-release 5456 - mozilla-beta 5457 * - **browsertime-benchmark-firefox-twitch-animation** 5458 - ❌ 5459 - ❌ 5460 - ❌ 5461 - ❌ 5462 5463 5464 .. list-table:: **test-macosx1470-64-shippable/opt** 5465 :widths: 30 15 15 15 15 5466 :header-rows: 1 5467 5468 * - **Test Name** 5469 - mozilla-central 5470 - autoland 5471 - mozilla-release 5472 - mozilla-beta 5473 * - **browsertime-benchmark-firefox-twitch-animation** 5474 - ✅ 5475 - ✅ 5476 - ❌ 5477 - ❌ 5478 5479 5480 .. list-table:: **test-macosx1470-64/opt** 5481 :widths: 30 15 15 15 15 5482 :header-rows: 1 5483 5484 * - **Test Name** 5485 - mozilla-central 5486 - autoland 5487 - mozilla-release 5488 - mozilla-beta 5489 * - **browsertime-benchmark-firefox-twitch-animation** 5490 - ❌ 5491 - ❌ 5492 - ❌ 5493 - ❌ 5494 5495 5496 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 5497 :widths: 30 15 15 15 15 5498 :header-rows: 1 5499 5500 * - **Test Name** 5501 - mozilla-central 5502 - autoland 5503 - mozilla-release 5504 - mozilla-beta 5505 * - **browsertime-benchmark-firefox-twitch-animation** 5506 - ❌ 5507 - ❌ 5508 - ❌ 5509 - ❌ 5510 5511 5512 .. list-table:: **test-windows11-64-24h2-shippable/opt** 5513 :widths: 30 15 15 15 15 5514 :header-rows: 1 5515 5516 * - **Test Name** 5517 - mozilla-central 5518 - autoland 5519 - mozilla-release 5520 - mozilla-beta 5521 * - **browsertime-benchmark-firefox-twitch-animation** 5522 - ✅ 5523 - ✅ 5524 - ❌ 5525 - ❌ 5526 5527 5528 .. list-table:: **test-windows11-64-24h2/opt** 5529 :widths: 30 15 15 15 15 5530 :header-rows: 1 5531 5532 * - **Test Name** 5533 - mozilla-central 5534 - autoland 5535 - mozilla-release 5536 - mozilla-beta 5537 * - **browsertime-benchmark-firefox-twitch-animation** 5538 - ❌ 5539 - ❌ 5540 - ❌ 5541 - ❌ 5542 5543 5544 5545 .. dropdown:: unity-webgl 5546 :class-container: anchor-id-unity-webgl-b 5547 5548 * Command to Run Locally 5549 5550 .. code-block:: 5551 5552 ./mach raptor -t unity-webgl 5553 5554 **Owner**: :jgilbert and Graphics(gfx) Team 5555 5556 * **alert threshold**: 2.0 5557 * **apps**: firefox, chrome 5558 * **expected**: pass 5559 * **expose browser profiler**: true 5560 * **gecko profile interval**: 1 5561 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/unity-webgl-desktop.toml#15>`__ 5562 * **lower is better**: false 5563 * **page cycles**: 5 5564 * **page timeout**: 420000 5565 * **repository**: https://github.com/mozilla/perf-automation 5566 * **repository path**: benchmarks/unity-webgl 5567 * **repository revision**: 61332db584026b73e37066d717a162825408c36b 5568 * **sparse checkout**: true 5569 * **test url**: `<http://\<host\>:\<port\>/index.html?raptor>`__ 5570 * **type**: benchmark 5571 * **unit**: score 5572 * **Test Task**: 5573 5574 .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** 5575 :widths: 30 15 15 15 15 5576 :header-rows: 1 5577 5578 * - **Test Name** 5579 - mozilla-central 5580 - autoland 5581 - mozilla-release 5582 - mozilla-beta 5583 * - **browsertime-benchmark-unity-webgl-mobile-chrome-m-nofis** 5584 - ✅ 5585 - ❌ 5586 - ❌ 5587 - ❌ 5588 * - **browsertime-benchmark-unity-webgl-mobile-fenix** 5589 - ✅ 5590 - ❌ 5591 - ❌ 5592 - ❌ 5593 * - **browsertime-benchmark-unity-webgl-mobile-fenix-nofis** 5594 - ✅ 5595 - ❌ 5596 - ❌ 5597 - ❌ 5598 * - **browsertime-benchmark-unity-webgl-mobile-geckoview** 5599 - ❌ 5600 - ❌ 5601 - ❌ 5602 - ❌ 5603 * - **browsertime-benchmark-unity-webgl-mobile-geckoview-nofis** 5604 - ❌ 5605 - ❌ 5606 - ❌ 5607 - ❌ 5608 * - **browsertime-benchmark-unity-webgl-mobile-refbrow** 5609 - ❌ 5610 - ❌ 5611 - ❌ 5612 - ❌ 5613 5614 5615 .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** 5616 :widths: 30 15 15 15 15 5617 :header-rows: 1 5618 5619 * - **Test Name** 5620 - mozilla-central 5621 - autoland 5622 - mozilla-release 5623 - mozilla-beta 5624 * - **browsertime-benchmark-unity-webgl-mobile-fenix** 5625 - ❌ 5626 - ❌ 5627 - ❌ 5628 - ❌ 5629 * - **browsertime-benchmark-unity-webgl-mobile-fenix-nofis** 5630 - ❌ 5631 - ❌ 5632 - ❌ 5633 - ❌ 5634 * - **browsertime-benchmark-unity-webgl-mobile-geckoview** 5635 - ❌ 5636 - ❌ 5637 - ❌ 5638 - ❌ 5639 * - **browsertime-benchmark-unity-webgl-mobile-geckoview-nofis** 5640 - ❌ 5641 - ❌ 5642 - ❌ 5643 - ❌ 5644 * - **browsertime-benchmark-unity-webgl-mobile-refbrow** 5645 - ❌ 5646 - ❌ 5647 - ❌ 5648 - ❌ 5649 5650 5651 .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** 5652 :widths: 30 15 15 15 15 5653 :header-rows: 1 5654 5655 * - **Test Name** 5656 - mozilla-central 5657 - autoland 5658 - mozilla-release 5659 - mozilla-beta 5660 * - **browsertime-benchmark-firefox-unity-webgl** 5661 - ❌ 5662 - ❌ 5663 - ❌ 5664 - ❌ 5665 5666 5667 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 5668 :widths: 30 15 15 15 15 5669 :header-rows: 1 5670 5671 * - **Test Name** 5672 - mozilla-central 5673 - autoland 5674 - mozilla-release 5675 - mozilla-beta 5676 * - **browsertime-benchmark-firefox-unity-webgl** 5677 - ❌ 5678 - ❌ 5679 - ❌ 5680 - ❌ 5681 5682 5683 .. list-table:: **test-linux1804-64-qr/opt** 5684 :widths: 30 15 15 15 15 5685 :header-rows: 1 5686 5687 * - **Test Name** 5688 - mozilla-central 5689 - autoland 5690 - mozilla-release 5691 - mozilla-beta 5692 * - **browsertime-benchmark-firefox-unity-webgl** 5693 - ❌ 5694 - ❌ 5695 - ❌ 5696 - ❌ 5697 5698 5699 .. list-table:: **test-linux1804-64-shippable-qr/opt** 5700 :widths: 30 15 15 15 15 5701 :header-rows: 1 5702 5703 * - **Test Name** 5704 - mozilla-central 5705 - autoland 5706 - mozilla-release 5707 - mozilla-beta 5708 * - **browsertime-benchmark-chrome-unity-webgl** 5709 - ❌ 5710 - ❌ 5711 - ❌ 5712 - ❌ 5713 * - **browsertime-benchmark-firefox-unity-webgl** 5714 - ✅ 5715 - ❌ 5716 - ❌ 5717 - ❌ 5718 5719 5720 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 5721 :widths: 30 15 15 15 15 5722 :header-rows: 1 5723 5724 * - **Test Name** 5725 - mozilla-central 5726 - autoland 5727 - mozilla-release 5728 - mozilla-beta 5729 * - **browsertime-benchmark-firefox-unity-webgl** 5730 - ❌ 5731 - ❌ 5732 - ❌ 5733 - ❌ 5734 5735 5736 .. list-table:: **test-macosx1470-64-shippable/opt** 5737 :widths: 30 15 15 15 15 5738 :header-rows: 1 5739 5740 * - **Test Name** 5741 - mozilla-central 5742 - autoland 5743 - mozilla-release 5744 - mozilla-beta 5745 * - **browsertime-benchmark-chrome-unity-webgl** 5746 - ❌ 5747 - ❌ 5748 - ❌ 5749 - ❌ 5750 * - **browsertime-benchmark-firefox-unity-webgl** 5751 - ✅ 5752 - ❌ 5753 - ❌ 5754 - ❌ 5755 5756 5757 .. list-table:: **test-macosx1470-64/opt** 5758 :widths: 30 15 15 15 15 5759 :header-rows: 1 5760 5761 * - **Test Name** 5762 - mozilla-central 5763 - autoland 5764 - mozilla-release 5765 - mozilla-beta 5766 * - **browsertime-benchmark-firefox-unity-webgl** 5767 - ❌ 5768 - ❌ 5769 - ❌ 5770 - ❌ 5771 5772 5773 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 5774 :widths: 30 15 15 15 15 5775 :header-rows: 1 5776 5777 * - **Test Name** 5778 - mozilla-central 5779 - autoland 5780 - mozilla-release 5781 - mozilla-beta 5782 * - **browsertime-benchmark-firefox-unity-webgl** 5783 - ❌ 5784 - ❌ 5785 - ❌ 5786 - ❌ 5787 5788 5789 .. list-table:: **test-windows11-64-24h2-shippable/opt** 5790 :widths: 30 15 15 15 15 5791 :header-rows: 1 5792 5793 * - **Test Name** 5794 - mozilla-central 5795 - autoland 5796 - mozilla-release 5797 - mozilla-beta 5798 * - **browsertime-benchmark-chrome-unity-webgl** 5799 - ❌ 5800 - ❌ 5801 - ❌ 5802 - ❌ 5803 * - **browsertime-benchmark-firefox-unity-webgl** 5804 - ✅ 5805 - ❌ 5806 - ❌ 5807 - ❌ 5808 5809 5810 .. list-table:: **test-windows11-64-24h2/opt** 5811 :widths: 30 15 15 15 15 5812 :header-rows: 1 5813 5814 * - **Test Name** 5815 - mozilla-central 5816 - autoland 5817 - mozilla-release 5818 - mozilla-beta 5819 * - **browsertime-benchmark-firefox-unity-webgl** 5820 - ❌ 5821 - ❌ 5822 - ❌ 5823 - ❌ 5824 5825 5826 **Owner**: :jgilbert and Graphics(gfx) Team 5827 5828 * **alert threshold**: 2.0 5829 * **apps**: geckoview, refbrow, fenix, chrome-m 5830 * **expected**: pass 5831 * **expose browser profiler**: true 5832 * **gecko profile interval**: 1 5833 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/unity-webgl-mobile.toml#14>`__ 5834 * **lower is better**: false 5835 * **page cycles**: 1 5836 * **page timeout**: 420000 5837 * **repository**: https://github.com/mozilla/perf-automation 5838 * **repository path**: benchmarks/unity-webgl 5839 * **repository revision**: 61332db584026b73e37066d717a162825408c36b 5840 * **test url**: `<http://\<host\>:\<port\>/index.html?raptor>`__ 5841 * **type**: benchmark 5842 * **unit**: score 5843 * **Test Task**: 5844 5845 .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** 5846 :widths: 30 15 15 15 15 5847 :header-rows: 1 5848 5849 * - **Test Name** 5850 - mozilla-central 5851 - autoland 5852 - mozilla-release 5853 - mozilla-beta 5854 * - **browsertime-benchmark-unity-webgl-mobile-chrome-m-nofis** 5855 - ✅ 5856 - ❌ 5857 - ❌ 5858 - ❌ 5859 * - **browsertime-benchmark-unity-webgl-mobile-fenix** 5860 - ✅ 5861 - ❌ 5862 - ❌ 5863 - ❌ 5864 * - **browsertime-benchmark-unity-webgl-mobile-fenix-nofis** 5865 - ✅ 5866 - ❌ 5867 - ❌ 5868 - ❌ 5869 * - **browsertime-benchmark-unity-webgl-mobile-geckoview** 5870 - ❌ 5871 - ❌ 5872 - ❌ 5873 - ❌ 5874 * - **browsertime-benchmark-unity-webgl-mobile-geckoview-nofis** 5875 - ❌ 5876 - ❌ 5877 - ❌ 5878 - ❌ 5879 * - **browsertime-benchmark-unity-webgl-mobile-refbrow** 5880 - ❌ 5881 - ❌ 5882 - ❌ 5883 - ❌ 5884 5885 5886 .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** 5887 :widths: 30 15 15 15 15 5888 :header-rows: 1 5889 5890 * - **Test Name** 5891 - mozilla-central 5892 - autoland 5893 - mozilla-release 5894 - mozilla-beta 5895 * - **browsertime-benchmark-unity-webgl-mobile-fenix** 5896 - ❌ 5897 - ❌ 5898 - ❌ 5899 - ❌ 5900 * - **browsertime-benchmark-unity-webgl-mobile-fenix-nofis** 5901 - ❌ 5902 - ❌ 5903 - ❌ 5904 - ❌ 5905 * - **browsertime-benchmark-unity-webgl-mobile-geckoview** 5906 - ❌ 5907 - ❌ 5908 - ❌ 5909 - ❌ 5910 * - **browsertime-benchmark-unity-webgl-mobile-geckoview-nofis** 5911 - ❌ 5912 - ❌ 5913 - ❌ 5914 - ❌ 5915 * - **browsertime-benchmark-unity-webgl-mobile-refbrow** 5916 - ❌ 5917 - ❌ 5918 - ❌ 5919 - ❌ 5920 5921 5922 .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** 5923 :widths: 30 15 15 15 15 5924 :header-rows: 1 5925 5926 * - **Test Name** 5927 - mozilla-central 5928 - autoland 5929 - mozilla-release 5930 - mozilla-beta 5931 * - **browsertime-benchmark-firefox-unity-webgl** 5932 - ❌ 5933 - ❌ 5934 - ❌ 5935 - ❌ 5936 5937 5938 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 5939 :widths: 30 15 15 15 15 5940 :header-rows: 1 5941 5942 * - **Test Name** 5943 - mozilla-central 5944 - autoland 5945 - mozilla-release 5946 - mozilla-beta 5947 * - **browsertime-benchmark-firefox-unity-webgl** 5948 - ❌ 5949 - ❌ 5950 - ❌ 5951 - ❌ 5952 5953 5954 .. list-table:: **test-linux1804-64-qr/opt** 5955 :widths: 30 15 15 15 15 5956 :header-rows: 1 5957 5958 * - **Test Name** 5959 - mozilla-central 5960 - autoland 5961 - mozilla-release 5962 - mozilla-beta 5963 * - **browsertime-benchmark-firefox-unity-webgl** 5964 - ❌ 5965 - ❌ 5966 - ❌ 5967 - ❌ 5968 5969 5970 .. list-table:: **test-linux1804-64-shippable-qr/opt** 5971 :widths: 30 15 15 15 15 5972 :header-rows: 1 5973 5974 * - **Test Name** 5975 - mozilla-central 5976 - autoland 5977 - mozilla-release 5978 - mozilla-beta 5979 * - **browsertime-benchmark-chrome-unity-webgl** 5980 - ❌ 5981 - ❌ 5982 - ❌ 5983 - ❌ 5984 * - **browsertime-benchmark-firefox-unity-webgl** 5985 - ✅ 5986 - ❌ 5987 - ❌ 5988 - ❌ 5989 5990 5991 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 5992 :widths: 30 15 15 15 15 5993 :header-rows: 1 5994 5995 * - **Test Name** 5996 - mozilla-central 5997 - autoland 5998 - mozilla-release 5999 - mozilla-beta 6000 * - **browsertime-benchmark-firefox-unity-webgl** 6001 - ❌ 6002 - ❌ 6003 - ❌ 6004 - ❌ 6005 6006 6007 .. list-table:: **test-macosx1470-64-shippable/opt** 6008 :widths: 30 15 15 15 15 6009 :header-rows: 1 6010 6011 * - **Test Name** 6012 - mozilla-central 6013 - autoland 6014 - mozilla-release 6015 - mozilla-beta 6016 * - **browsertime-benchmark-chrome-unity-webgl** 6017 - ❌ 6018 - ❌ 6019 - ❌ 6020 - ❌ 6021 * - **browsertime-benchmark-firefox-unity-webgl** 6022 - ✅ 6023 - ❌ 6024 - ❌ 6025 - ❌ 6026 6027 6028 .. list-table:: **test-macosx1470-64/opt** 6029 :widths: 30 15 15 15 15 6030 :header-rows: 1 6031 6032 * - **Test Name** 6033 - mozilla-central 6034 - autoland 6035 - mozilla-release 6036 - mozilla-beta 6037 * - **browsertime-benchmark-firefox-unity-webgl** 6038 - ❌ 6039 - ❌ 6040 - ❌ 6041 - ❌ 6042 6043 6044 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 6045 :widths: 30 15 15 15 15 6046 :header-rows: 1 6047 6048 * - **Test Name** 6049 - mozilla-central 6050 - autoland 6051 - mozilla-release 6052 - mozilla-beta 6053 * - **browsertime-benchmark-firefox-unity-webgl** 6054 - ❌ 6055 - ❌ 6056 - ❌ 6057 - ❌ 6058 6059 6060 .. list-table:: **test-windows11-64-24h2-shippable/opt** 6061 :widths: 30 15 15 15 15 6062 :header-rows: 1 6063 6064 * - **Test Name** 6065 - mozilla-central 6066 - autoland 6067 - mozilla-release 6068 - mozilla-beta 6069 * - **browsertime-benchmark-chrome-unity-webgl** 6070 - ❌ 6071 - ❌ 6072 - ❌ 6073 - ❌ 6074 * - **browsertime-benchmark-firefox-unity-webgl** 6075 - ✅ 6076 - ❌ 6077 - ❌ 6078 - ❌ 6079 6080 6081 .. list-table:: **test-windows11-64-24h2/opt** 6082 :widths: 30 15 15 15 15 6083 :header-rows: 1 6084 6085 * - **Test Name** 6086 - mozilla-central 6087 - autoland 6088 - mozilla-release 6089 - mozilla-beta 6090 * - **browsertime-benchmark-firefox-unity-webgl** 6091 - ❌ 6092 - ❌ 6093 - ❌ 6094 - ❌ 6095 6096 6097 6098 .. dropdown:: wasm-godot 6099 :class-container: anchor-id-wasm-godot-b 6100 6101 * Command to Run Locally 6102 6103 .. code-block:: 6104 6105 ./mach raptor -t wasm-godot 6106 6107 **Owner**: :lth and SpiderMonkey Team 6108 6109 * **alert threshold**: 2.0 6110 * **apps**: firefox, chrome, safari 6111 * **expected**: pass 6112 * **expose browser profiler**: true 6113 * **gecko profile interval**: 1 6114 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/wasm-godot.toml#11>`__ 6115 * **lower is better**: true 6116 * **newtab per cycle**: true 6117 * **page cycles**: 5 6118 * **page timeout**: 120000 6119 * **test url**: `<http://localhost:\<port\>/wasm-godot/index.html>`__ 6120 * **type**: benchmark 6121 * **unit**: ms 6122 * **Test Task**: 6123 6124 .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** 6125 :widths: 30 15 15 15 15 6126 :header-rows: 1 6127 6128 * - **Test Name** 6129 - mozilla-central 6130 - autoland 6131 - mozilla-release 6132 - mozilla-beta 6133 * - **browsertime-benchmark-wasm-firefox-wasm-godot** 6134 - ❌ 6135 - ❌ 6136 - ❌ 6137 - ❌ 6138 6139 6140 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 6141 :widths: 30 15 15 15 15 6142 :header-rows: 1 6143 6144 * - **Test Name** 6145 - mozilla-central 6146 - autoland 6147 - mozilla-release 6148 - mozilla-beta 6149 * - **browsertime-benchmark-wasm-firefox-wasm-godot** 6150 - ❌ 6151 - ❌ 6152 - ❌ 6153 - ❌ 6154 6155 6156 .. list-table:: **test-linux1804-64-qr/opt** 6157 :widths: 30 15 15 15 15 6158 :header-rows: 1 6159 6160 * - **Test Name** 6161 - mozilla-central 6162 - autoland 6163 - mozilla-release 6164 - mozilla-beta 6165 * - **browsertime-benchmark-wasm-firefox-wasm-godot** 6166 - ❌ 6167 - ❌ 6168 - ❌ 6169 - ❌ 6170 6171 6172 .. list-table:: **test-linux1804-64-shippable-qr/opt** 6173 :widths: 30 15 15 15 15 6174 :header-rows: 1 6175 6176 * - **Test Name** 6177 - mozilla-central 6178 - autoland 6179 - mozilla-release 6180 - mozilla-beta 6181 * - **browsertime-benchmark-wasm-chrome-wasm-godot** 6182 - ❌ 6183 - ❌ 6184 - ❌ 6185 - ❌ 6186 * - **browsertime-benchmark-wasm-firefox-wasm-godot** 6187 - ✅ 6188 - ❌ 6189 - ❌ 6190 - ❌ 6191 6192 6193 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 6194 :widths: 30 15 15 15 15 6195 :header-rows: 1 6196 6197 * - **Test Name** 6198 - mozilla-central 6199 - autoland 6200 - mozilla-release 6201 - mozilla-beta 6202 * - **browsertime-benchmark-wasm-firefox-wasm-godot** 6203 - ❌ 6204 - ❌ 6205 - ❌ 6206 - ❌ 6207 6208 6209 .. list-table:: **test-macosx1470-64-shippable/opt** 6210 :widths: 30 15 15 15 15 6211 :header-rows: 1 6212 6213 * - **Test Name** 6214 - mozilla-central 6215 - autoland 6216 - mozilla-release 6217 - mozilla-beta 6218 * - **browsertime-benchmark-wasm-chrome-wasm-godot** 6219 - ❌ 6220 - ❌ 6221 - ❌ 6222 - ❌ 6223 * - **browsertime-benchmark-wasm-firefox-wasm-godot** 6224 - ✅ 6225 - ❌ 6226 - ❌ 6227 - ❌ 6228 * - **browsertime-benchmark-wasm-safari-wasm-godot** 6229 - ❌ 6230 - ❌ 6231 - ❌ 6232 - ❌ 6233 6234 6235 .. list-table:: **test-macosx1470-64/opt** 6236 :widths: 30 15 15 15 15 6237 :header-rows: 1 6238 6239 * - **Test Name** 6240 - mozilla-central 6241 - autoland 6242 - mozilla-release 6243 - mozilla-beta 6244 * - **browsertime-benchmark-wasm-firefox-wasm-godot** 6245 - ❌ 6246 - ❌ 6247 - ❌ 6248 - ❌ 6249 6250 6251 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 6252 :widths: 30 15 15 15 15 6253 :header-rows: 1 6254 6255 * - **Test Name** 6256 - mozilla-central 6257 - autoland 6258 - mozilla-release 6259 - mozilla-beta 6260 * - **browsertime-benchmark-wasm-firefox-wasm-godot** 6261 - ❌ 6262 - ❌ 6263 - ❌ 6264 - ❌ 6265 6266 6267 .. list-table:: **test-windows11-64-24h2-shippable/opt** 6268 :widths: 30 15 15 15 15 6269 :header-rows: 1 6270 6271 * - **Test Name** 6272 - mozilla-central 6273 - autoland 6274 - mozilla-release 6275 - mozilla-beta 6276 * - **browsertime-benchmark-wasm-chrome-wasm-godot** 6277 - ❌ 6278 - ❌ 6279 - ❌ 6280 - ❌ 6281 * - **browsertime-benchmark-wasm-firefox-wasm-godot** 6282 - ✅ 6283 - ❌ 6284 - ❌ 6285 - ❌ 6286 6287 6288 .. list-table:: **test-windows11-64-24h2/opt** 6289 :widths: 30 15 15 15 15 6290 :header-rows: 1 6291 6292 * - **Test Name** 6293 - mozilla-central 6294 - autoland 6295 - mozilla-release 6296 - mozilla-beta 6297 * - **browsertime-benchmark-wasm-firefox-wasm-godot** 6298 - ❌ 6299 - ❌ 6300 - ❌ 6301 - ❌ 6302 6303 6304 6305 .. dropdown:: wasm-godot-baseline 6306 :class-container: anchor-id-wasm-godot-baseline-b 6307 6308 * Command to Run Locally 6309 6310 .. code-block:: 6311 6312 ./mach raptor -t wasm-godot-baseline 6313 6314 **Owner**: :lth and SpiderMonkey Team 6315 6316 * **alert threshold**: 2.0 6317 * **apps**: firefox 6318 * **expected**: pass 6319 * **expose browser profiler**: true 6320 * **gecko profile interval**: 1 6321 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/wasm-godot-baseline.toml#14>`__ 6322 * **lower is better**: true 6323 * **newtab per cycle**: true 6324 * **page cycles**: 5 6325 * **page timeout**: 120000 6326 * **preferences**: javascript.options.wasm_baselinejit=true javascript.options.wasm_optimizingjit=false 6327 * **test url**: `<http://localhost:\<port\>/wasm-godot/index.html>`__ 6328 * **type**: benchmark 6329 * **unit**: ms 6330 * **Test Task**: 6331 6332 .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** 6333 :widths: 30 15 15 15 15 6334 :header-rows: 1 6335 6336 * - **Test Name** 6337 - mozilla-central 6338 - autoland 6339 - mozilla-release 6340 - mozilla-beta 6341 * - **browsertime-benchmark-wasm-firefox-wasm-godot-baseline** 6342 - ❌ 6343 - ❌ 6344 - ❌ 6345 - ❌ 6346 6347 6348 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 6349 :widths: 30 15 15 15 15 6350 :header-rows: 1 6351 6352 * - **Test Name** 6353 - mozilla-central 6354 - autoland 6355 - mozilla-release 6356 - mozilla-beta 6357 * - **browsertime-benchmark-wasm-firefox-wasm-godot-baseline** 6358 - ❌ 6359 - ❌ 6360 - ❌ 6361 - ❌ 6362 6363 6364 .. list-table:: **test-linux1804-64-qr/opt** 6365 :widths: 30 15 15 15 15 6366 :header-rows: 1 6367 6368 * - **Test Name** 6369 - mozilla-central 6370 - autoland 6371 - mozilla-release 6372 - mozilla-beta 6373 * - **browsertime-benchmark-wasm-firefox-wasm-godot-baseline** 6374 - ❌ 6375 - ❌ 6376 - ❌ 6377 - ❌ 6378 6379 6380 .. list-table:: **test-linux1804-64-shippable-qr/opt** 6381 :widths: 30 15 15 15 15 6382 :header-rows: 1 6383 6384 * - **Test Name** 6385 - mozilla-central 6386 - autoland 6387 - mozilla-release 6388 - mozilla-beta 6389 * - **browsertime-benchmark-wasm-firefox-wasm-godot-baseline** 6390 - ✅ 6391 - ❌ 6392 - ❌ 6393 - ❌ 6394 6395 6396 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 6397 :widths: 30 15 15 15 15 6398 :header-rows: 1 6399 6400 * - **Test Name** 6401 - mozilla-central 6402 - autoland 6403 - mozilla-release 6404 - mozilla-beta 6405 * - **browsertime-benchmark-wasm-firefox-wasm-godot-baseline** 6406 - ❌ 6407 - ❌ 6408 - ❌ 6409 - ❌ 6410 6411 6412 .. list-table:: **test-macosx1470-64-shippable/opt** 6413 :widths: 30 15 15 15 15 6414 :header-rows: 1 6415 6416 * - **Test Name** 6417 - mozilla-central 6418 - autoland 6419 - mozilla-release 6420 - mozilla-beta 6421 * - **browsertime-benchmark-wasm-firefox-wasm-godot-baseline** 6422 - ✅ 6423 - ❌ 6424 - ❌ 6425 - ❌ 6426 6427 6428 .. list-table:: **test-macosx1470-64/opt** 6429 :widths: 30 15 15 15 15 6430 :header-rows: 1 6431 6432 * - **Test Name** 6433 - mozilla-central 6434 - autoland 6435 - mozilla-release 6436 - mozilla-beta 6437 * - **browsertime-benchmark-wasm-firefox-wasm-godot-baseline** 6438 - ❌ 6439 - ❌ 6440 - ❌ 6441 - ❌ 6442 6443 6444 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 6445 :widths: 30 15 15 15 15 6446 :header-rows: 1 6447 6448 * - **Test Name** 6449 - mozilla-central 6450 - autoland 6451 - mozilla-release 6452 - mozilla-beta 6453 * - **browsertime-benchmark-wasm-firefox-wasm-godot-baseline** 6454 - ❌ 6455 - ❌ 6456 - ❌ 6457 - ❌ 6458 6459 6460 .. list-table:: **test-windows11-64-24h2-shippable/opt** 6461 :widths: 30 15 15 15 15 6462 :header-rows: 1 6463 6464 * - **Test Name** 6465 - mozilla-central 6466 - autoland 6467 - mozilla-release 6468 - mozilla-beta 6469 * - **browsertime-benchmark-wasm-firefox-wasm-godot-baseline** 6470 - ✅ 6471 - ❌ 6472 - ❌ 6473 - ❌ 6474 6475 6476 .. list-table:: **test-windows11-64-24h2/opt** 6477 :widths: 30 15 15 15 15 6478 :header-rows: 1 6479 6480 * - **Test Name** 6481 - mozilla-central 6482 - autoland 6483 - mozilla-release 6484 - mozilla-beta 6485 * - **browsertime-benchmark-wasm-firefox-wasm-godot-baseline** 6486 - ❌ 6487 - ❌ 6488 - ❌ 6489 - ❌ 6490 6491 6492 6493 .. dropdown:: wasm-godot-optimizing 6494 :class-container: anchor-id-wasm-godot-optimizing-b 6495 6496 * Command to Run Locally 6497 6498 .. code-block:: 6499 6500 ./mach raptor -t wasm-godot-optimizing 6501 6502 **Owner**: :lth and SpiderMonkey Team 6503 6504 * **alert threshold**: 2.0 6505 * **apps**: firefox 6506 * **expected**: pass 6507 * **expose browser profiler**: true 6508 * **gecko profile interval**: 1 6509 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/wasm-godot-optimizing.toml#14>`__ 6510 * **lower is better**: true 6511 * **newtab per cycle**: true 6512 * **page cycles**: 5 6513 * **page timeout**: 120000 6514 * **preferences**: javascript.options.wasm_baselinejit=false javascript.options.wasm_optimizingjit=true 6515 * **test url**: `<http://localhost:\<port\>/wasm-godot/index.html>`__ 6516 * **type**: benchmark 6517 * **unit**: ms 6518 * **Test Task**: 6519 6520 .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** 6521 :widths: 30 15 15 15 15 6522 :header-rows: 1 6523 6524 * - **Test Name** 6525 - mozilla-central 6526 - autoland 6527 - mozilla-release 6528 - mozilla-beta 6529 * - **browsertime-benchmark-wasm-firefox-wasm-godot-optimizing** 6530 - ❌ 6531 - ❌ 6532 - ❌ 6533 - ❌ 6534 6535 6536 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 6537 :widths: 30 15 15 15 15 6538 :header-rows: 1 6539 6540 * - **Test Name** 6541 - mozilla-central 6542 - autoland 6543 - mozilla-release 6544 - mozilla-beta 6545 * - **browsertime-benchmark-wasm-firefox-wasm-godot-optimizing** 6546 - ❌ 6547 - ❌ 6548 - ❌ 6549 - ❌ 6550 6551 6552 .. list-table:: **test-linux1804-64-qr/opt** 6553 :widths: 30 15 15 15 15 6554 :header-rows: 1 6555 6556 * - **Test Name** 6557 - mozilla-central 6558 - autoland 6559 - mozilla-release 6560 - mozilla-beta 6561 * - **browsertime-benchmark-wasm-firefox-wasm-godot-optimizing** 6562 - ❌ 6563 - ❌ 6564 - ❌ 6565 - ❌ 6566 6567 6568 .. list-table:: **test-linux1804-64-shippable-qr/opt** 6569 :widths: 30 15 15 15 15 6570 :header-rows: 1 6571 6572 * - **Test Name** 6573 - mozilla-central 6574 - autoland 6575 - mozilla-release 6576 - mozilla-beta 6577 * - **browsertime-benchmark-wasm-firefox-wasm-godot-optimizing** 6578 - ✅ 6579 - ❌ 6580 - ❌ 6581 - ❌ 6582 6583 6584 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 6585 :widths: 30 15 15 15 15 6586 :header-rows: 1 6587 6588 * - **Test Name** 6589 - mozilla-central 6590 - autoland 6591 - mozilla-release 6592 - mozilla-beta 6593 * - **browsertime-benchmark-wasm-firefox-wasm-godot-optimizing** 6594 - ❌ 6595 - ❌ 6596 - ❌ 6597 - ❌ 6598 6599 6600 .. list-table:: **test-macosx1470-64-shippable/opt** 6601 :widths: 30 15 15 15 15 6602 :header-rows: 1 6603 6604 * - **Test Name** 6605 - mozilla-central 6606 - autoland 6607 - mozilla-release 6608 - mozilla-beta 6609 * - **browsertime-benchmark-wasm-firefox-wasm-godot-optimizing** 6610 - ✅ 6611 - ❌ 6612 - ❌ 6613 - ❌ 6614 6615 6616 .. list-table:: **test-macosx1470-64/opt** 6617 :widths: 30 15 15 15 15 6618 :header-rows: 1 6619 6620 * - **Test Name** 6621 - mozilla-central 6622 - autoland 6623 - mozilla-release 6624 - mozilla-beta 6625 * - **browsertime-benchmark-wasm-firefox-wasm-godot-optimizing** 6626 - ❌ 6627 - ❌ 6628 - ❌ 6629 - ❌ 6630 6631 6632 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 6633 :widths: 30 15 15 15 15 6634 :header-rows: 1 6635 6636 * - **Test Name** 6637 - mozilla-central 6638 - autoland 6639 - mozilla-release 6640 - mozilla-beta 6641 * - **browsertime-benchmark-wasm-firefox-wasm-godot-optimizing** 6642 - ❌ 6643 - ❌ 6644 - ❌ 6645 - ❌ 6646 6647 6648 .. list-table:: **test-windows11-64-24h2-shippable/opt** 6649 :widths: 30 15 15 15 15 6650 :header-rows: 1 6651 6652 * - **Test Name** 6653 - mozilla-central 6654 - autoland 6655 - mozilla-release 6656 - mozilla-beta 6657 * - **browsertime-benchmark-wasm-firefox-wasm-godot-optimizing** 6658 - ✅ 6659 - ❌ 6660 - ❌ 6661 - ❌ 6662 6663 6664 .. list-table:: **test-windows11-64-24h2/opt** 6665 :widths: 30 15 15 15 15 6666 :header-rows: 1 6667 6668 * - **Test Name** 6669 - mozilla-central 6670 - autoland 6671 - mozilla-release 6672 - mozilla-beta 6673 * - **browsertime-benchmark-wasm-firefox-wasm-godot-optimizing** 6674 - ❌ 6675 - ❌ 6676 - ❌ 6677 - ❌ 6678 6679 6680 6681 .. dropdown:: wasm-misc 6682 :class-container: anchor-id-wasm-misc-b 6683 6684 * Command to Run Locally 6685 6686 .. code-block:: 6687 6688 ./mach raptor -t wasm-misc 6689 6690 **Owner**: :lth and SpiderMonkey Team 6691 6692 * **alert threshold**: 2.0 6693 * **apps**: firefox, chrome 6694 * **expected**: pass 6695 * **expose browser profiler**: true 6696 * **gecko profile interval**: 1 6697 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/wasm-misc.toml#15>`__ 6698 * **lower is better**: true 6699 * **page cycles**: 5 6700 * **page timeout**: 1200000 6701 * **repository**: https://github.com/mozilla/perf-automation 6702 * **repository path**: benchmarks/wasm-misc 6703 * **repository revision**: 61332db584026b73e37066d717a162825408c36b 6704 * **sparse checkout**: true 6705 * **test url**: `<http://\<host\>:\<port\>/index.html?raptor>`__ 6706 * **type**: benchmark 6707 * **unit**: ms 6708 * **Test Task**: 6709 6710 .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** 6711 :widths: 30 15 15 15 15 6712 :header-rows: 1 6713 6714 * - **Test Name** 6715 - mozilla-central 6716 - autoland 6717 - mozilla-release 6718 - mozilla-beta 6719 * - **browsertime-benchmark-wasm-firefox-wasm-misc** 6720 - ❌ 6721 - ❌ 6722 - ❌ 6723 - ❌ 6724 6725 6726 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 6727 :widths: 30 15 15 15 15 6728 :header-rows: 1 6729 6730 * - **Test Name** 6731 - mozilla-central 6732 - autoland 6733 - mozilla-release 6734 - mozilla-beta 6735 * - **browsertime-benchmark-wasm-firefox-wasm-misc** 6736 - ❌ 6737 - ❌ 6738 - ❌ 6739 - ❌ 6740 6741 6742 .. list-table:: **test-linux1804-64-qr/opt** 6743 :widths: 30 15 15 15 15 6744 :header-rows: 1 6745 6746 * - **Test Name** 6747 - mozilla-central 6748 - autoland 6749 - mozilla-release 6750 - mozilla-beta 6751 * - **browsertime-benchmark-wasm-firefox-wasm-misc** 6752 - ❌ 6753 - ❌ 6754 - ❌ 6755 - ❌ 6756 6757 6758 .. list-table:: **test-linux1804-64-shippable-qr/opt** 6759 :widths: 30 15 15 15 15 6760 :header-rows: 1 6761 6762 * - **Test Name** 6763 - mozilla-central 6764 - autoland 6765 - mozilla-release 6766 - mozilla-beta 6767 * - **browsertime-benchmark-wasm-chrome-wasm-misc** 6768 - ❌ 6769 - ❌ 6770 - ❌ 6771 - ❌ 6772 * - **browsertime-benchmark-wasm-firefox-wasm-misc** 6773 - ✅ 6774 - ❌ 6775 - ❌ 6776 - ❌ 6777 6778 6779 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 6780 :widths: 30 15 15 15 15 6781 :header-rows: 1 6782 6783 * - **Test Name** 6784 - mozilla-central 6785 - autoland 6786 - mozilla-release 6787 - mozilla-beta 6788 * - **browsertime-benchmark-wasm-firefox-wasm-misc** 6789 - ❌ 6790 - ❌ 6791 - ❌ 6792 - ❌ 6793 6794 6795 .. list-table:: **test-macosx1470-64-shippable/opt** 6796 :widths: 30 15 15 15 15 6797 :header-rows: 1 6798 6799 * - **Test Name** 6800 - mozilla-central 6801 - autoland 6802 - mozilla-release 6803 - mozilla-beta 6804 * - **browsertime-benchmark-wasm-chrome-wasm-misc** 6805 - ❌ 6806 - ❌ 6807 - ❌ 6808 - ❌ 6809 * - **browsertime-benchmark-wasm-firefox-wasm-misc** 6810 - ✅ 6811 - ❌ 6812 - ❌ 6813 - ❌ 6814 6815 6816 .. list-table:: **test-macosx1470-64/opt** 6817 :widths: 30 15 15 15 15 6818 :header-rows: 1 6819 6820 * - **Test Name** 6821 - mozilla-central 6822 - autoland 6823 - mozilla-release 6824 - mozilla-beta 6825 * - **browsertime-benchmark-wasm-firefox-wasm-misc** 6826 - ❌ 6827 - ❌ 6828 - ❌ 6829 - ❌ 6830 6831 6832 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 6833 :widths: 30 15 15 15 15 6834 :header-rows: 1 6835 6836 * - **Test Name** 6837 - mozilla-central 6838 - autoland 6839 - mozilla-release 6840 - mozilla-beta 6841 * - **browsertime-benchmark-wasm-firefox-wasm-misc** 6842 - ❌ 6843 - ❌ 6844 - ❌ 6845 - ❌ 6846 6847 6848 .. list-table:: **test-windows11-64-24h2-shippable/opt** 6849 :widths: 30 15 15 15 15 6850 :header-rows: 1 6851 6852 * - **Test Name** 6853 - mozilla-central 6854 - autoland 6855 - mozilla-release 6856 - mozilla-beta 6857 * - **browsertime-benchmark-wasm-chrome-wasm-misc** 6858 - ❌ 6859 - ❌ 6860 - ❌ 6861 - ❌ 6862 * - **browsertime-benchmark-wasm-firefox-wasm-misc** 6863 - ✅ 6864 - ❌ 6865 - ❌ 6866 - ❌ 6867 6868 6869 .. list-table:: **test-windows11-64-24h2/opt** 6870 :widths: 30 15 15 15 15 6871 :header-rows: 1 6872 6873 * - **Test Name** 6874 - mozilla-central 6875 - autoland 6876 - mozilla-release 6877 - mozilla-beta 6878 * - **browsertime-benchmark-wasm-firefox-wasm-misc** 6879 - ❌ 6880 - ❌ 6881 - ❌ 6882 - ❌ 6883 6884 6885 6886 .. dropdown:: wasm-misc-baseline 6887 :class-container: anchor-id-wasm-misc-baseline-b 6888 6889 * Command to Run Locally 6890 6891 .. code-block:: 6892 6893 ./mach raptor -t wasm-misc-baseline 6894 6895 **Owner**: :lth and SpiderMonkey Team 6896 6897 * **alert threshold**: 2.0 6898 * **apps**: firefox 6899 * **expected**: pass 6900 * **expose browser profiler**: true 6901 * **gecko profile interval**: 1 6902 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/wasm-misc-baseline.toml#14>`__ 6903 * **lower is better**: true 6904 * **page cycles**: 5 6905 * **page timeout**: 1200000 6906 * **preferences**: javascript.options.wasm_baselinejit=true javascript.options.wasm_optimizingjit=false 6907 * **repository**: https://github.com/mozilla/perf-automation 6908 * **repository path**: benchmarks/wasm-misc 6909 * **repository revision**: 61332db584026b73e37066d717a162825408c36b 6910 * **sparse checkout**: true 6911 * **test url**: `<http://\<host\>:\<port\>/index.html?raptor>`__ 6912 * **type**: benchmark 6913 * **unit**: ms 6914 * **Test Task**: 6915 6916 .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** 6917 :widths: 30 15 15 15 15 6918 :header-rows: 1 6919 6920 * - **Test Name** 6921 - mozilla-central 6922 - autoland 6923 - mozilla-release 6924 - mozilla-beta 6925 * - **browsertime-benchmark-wasm-firefox-wasm-misc-baseline** 6926 - ❌ 6927 - ❌ 6928 - ❌ 6929 - ❌ 6930 6931 6932 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 6933 :widths: 30 15 15 15 15 6934 :header-rows: 1 6935 6936 * - **Test Name** 6937 - mozilla-central 6938 - autoland 6939 - mozilla-release 6940 - mozilla-beta 6941 * - **browsertime-benchmark-wasm-firefox-wasm-misc-baseline** 6942 - ❌ 6943 - ❌ 6944 - ❌ 6945 - ❌ 6946 6947 6948 .. list-table:: **test-linux1804-64-qr/opt** 6949 :widths: 30 15 15 15 15 6950 :header-rows: 1 6951 6952 * - **Test Name** 6953 - mozilla-central 6954 - autoland 6955 - mozilla-release 6956 - mozilla-beta 6957 * - **browsertime-benchmark-wasm-firefox-wasm-misc-baseline** 6958 - ❌ 6959 - ❌ 6960 - ❌ 6961 - ❌ 6962 6963 6964 .. list-table:: **test-linux1804-64-shippable-qr/opt** 6965 :widths: 30 15 15 15 15 6966 :header-rows: 1 6967 6968 * - **Test Name** 6969 - mozilla-central 6970 - autoland 6971 - mozilla-release 6972 - mozilla-beta 6973 * - **browsertime-benchmark-wasm-firefox-wasm-misc-baseline** 6974 - ✅ 6975 - ❌ 6976 - ❌ 6977 - ❌ 6978 6979 6980 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 6981 :widths: 30 15 15 15 15 6982 :header-rows: 1 6983 6984 * - **Test Name** 6985 - mozilla-central 6986 - autoland 6987 - mozilla-release 6988 - mozilla-beta 6989 * - **browsertime-benchmark-wasm-firefox-wasm-misc-baseline** 6990 - ❌ 6991 - ❌ 6992 - ❌ 6993 - ❌ 6994 6995 6996 .. list-table:: **test-macosx1470-64-shippable/opt** 6997 :widths: 30 15 15 15 15 6998 :header-rows: 1 6999 7000 * - **Test Name** 7001 - mozilla-central 7002 - autoland 7003 - mozilla-release 7004 - mozilla-beta 7005 * - **browsertime-benchmark-wasm-firefox-wasm-misc-baseline** 7006 - ✅ 7007 - ❌ 7008 - ❌ 7009 - ❌ 7010 7011 7012 .. list-table:: **test-macosx1470-64/opt** 7013 :widths: 30 15 15 15 15 7014 :header-rows: 1 7015 7016 * - **Test Name** 7017 - mozilla-central 7018 - autoland 7019 - mozilla-release 7020 - mozilla-beta 7021 * - **browsertime-benchmark-wasm-firefox-wasm-misc-baseline** 7022 - ❌ 7023 - ❌ 7024 - ❌ 7025 - ❌ 7026 7027 7028 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 7029 :widths: 30 15 15 15 15 7030 :header-rows: 1 7031 7032 * - **Test Name** 7033 - mozilla-central 7034 - autoland 7035 - mozilla-release 7036 - mozilla-beta 7037 * - **browsertime-benchmark-wasm-firefox-wasm-misc-baseline** 7038 - ❌ 7039 - ❌ 7040 - ❌ 7041 - ❌ 7042 7043 7044 .. list-table:: **test-windows11-64-24h2-shippable/opt** 7045 :widths: 30 15 15 15 15 7046 :header-rows: 1 7047 7048 * - **Test Name** 7049 - mozilla-central 7050 - autoland 7051 - mozilla-release 7052 - mozilla-beta 7053 * - **browsertime-benchmark-wasm-firefox-wasm-misc-baseline** 7054 - ✅ 7055 - ❌ 7056 - ❌ 7057 - ❌ 7058 7059 7060 .. list-table:: **test-windows11-64-24h2/opt** 7061 :widths: 30 15 15 15 15 7062 :header-rows: 1 7063 7064 * - **Test Name** 7065 - mozilla-central 7066 - autoland 7067 - mozilla-release 7068 - mozilla-beta 7069 * - **browsertime-benchmark-wasm-firefox-wasm-misc-baseline** 7070 - ❌ 7071 - ❌ 7072 - ❌ 7073 - ❌ 7074 7075 7076 7077 .. dropdown:: wasm-misc-optimizing 7078 :class-container: anchor-id-wasm-misc-optimizing-b 7079 7080 * Command to Run Locally 7081 7082 .. code-block:: 7083 7084 ./mach raptor -t wasm-misc-optimizing 7085 7086 **Owner**: :lth and SpiderMonkey Team 7087 7088 * **alert threshold**: 2.0 7089 * **apps**: firefox 7090 * **expected**: pass 7091 * **expose browser profiler**: true 7092 * **gecko profile interval**: 1 7093 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/wasm-misc-optimizing.toml#14>`__ 7094 * **lower is better**: true 7095 * **page cycles**: 5 7096 * **page timeout**: 1200000 7097 * **preferences**: javascript.options.wasm_baselinejit=false javascript.options.wasm_optimizingjit=true 7098 * **repository**: https://github.com/mozilla/perf-automation 7099 * **repository path**: benchmarks/wasm-misc 7100 * **repository revision**: 61332db584026b73e37066d717a162825408c36b 7101 * **sparse checkout**: true 7102 * **test url**: `<http://\<host\>:\<port\>/index.html?raptor>`__ 7103 * **type**: benchmark 7104 * **unit**: ms 7105 * **Test Task**: 7106 7107 .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** 7108 :widths: 30 15 15 15 15 7109 :header-rows: 1 7110 7111 * - **Test Name** 7112 - mozilla-central 7113 - autoland 7114 - mozilla-release 7115 - mozilla-beta 7116 * - **browsertime-benchmark-wasm-firefox-wasm-misc-optimizing** 7117 - ❌ 7118 - ❌ 7119 - ❌ 7120 - ❌ 7121 7122 7123 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 7124 :widths: 30 15 15 15 15 7125 :header-rows: 1 7126 7127 * - **Test Name** 7128 - mozilla-central 7129 - autoland 7130 - mozilla-release 7131 - mozilla-beta 7132 * - **browsertime-benchmark-wasm-firefox-wasm-misc-optimizing** 7133 - ❌ 7134 - ❌ 7135 - ❌ 7136 - ❌ 7137 7138 7139 .. list-table:: **test-linux1804-64-qr/opt** 7140 :widths: 30 15 15 15 15 7141 :header-rows: 1 7142 7143 * - **Test Name** 7144 - mozilla-central 7145 - autoland 7146 - mozilla-release 7147 - mozilla-beta 7148 * - **browsertime-benchmark-wasm-firefox-wasm-misc-optimizing** 7149 - ❌ 7150 - ❌ 7151 - ❌ 7152 - ❌ 7153 7154 7155 .. list-table:: **test-linux1804-64-shippable-qr/opt** 7156 :widths: 30 15 15 15 15 7157 :header-rows: 1 7158 7159 * - **Test Name** 7160 - mozilla-central 7161 - autoland 7162 - mozilla-release 7163 - mozilla-beta 7164 * - **browsertime-benchmark-wasm-firefox-wasm-misc-optimizing** 7165 - ✅ 7166 - ❌ 7167 - ❌ 7168 - ❌ 7169 7170 7171 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 7172 :widths: 30 15 15 15 15 7173 :header-rows: 1 7174 7175 * - **Test Name** 7176 - mozilla-central 7177 - autoland 7178 - mozilla-release 7179 - mozilla-beta 7180 * - **browsertime-benchmark-wasm-firefox-wasm-misc-optimizing** 7181 - ❌ 7182 - ❌ 7183 - ❌ 7184 - ❌ 7185 7186 7187 .. list-table:: **test-macosx1470-64-shippable/opt** 7188 :widths: 30 15 15 15 15 7189 :header-rows: 1 7190 7191 * - **Test Name** 7192 - mozilla-central 7193 - autoland 7194 - mozilla-release 7195 - mozilla-beta 7196 * - **browsertime-benchmark-wasm-firefox-wasm-misc-optimizing** 7197 - ✅ 7198 - ❌ 7199 - ❌ 7200 - ❌ 7201 7202 7203 .. list-table:: **test-macosx1470-64/opt** 7204 :widths: 30 15 15 15 15 7205 :header-rows: 1 7206 7207 * - **Test Name** 7208 - mozilla-central 7209 - autoland 7210 - mozilla-release 7211 - mozilla-beta 7212 * - **browsertime-benchmark-wasm-firefox-wasm-misc-optimizing** 7213 - ❌ 7214 - ❌ 7215 - ❌ 7216 - ❌ 7217 7218 7219 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 7220 :widths: 30 15 15 15 15 7221 :header-rows: 1 7222 7223 * - **Test Name** 7224 - mozilla-central 7225 - autoland 7226 - mozilla-release 7227 - mozilla-beta 7228 * - **browsertime-benchmark-wasm-firefox-wasm-misc-optimizing** 7229 - ❌ 7230 - ❌ 7231 - ❌ 7232 - ❌ 7233 7234 7235 .. list-table:: **test-windows11-64-24h2-shippable/opt** 7236 :widths: 30 15 15 15 15 7237 :header-rows: 1 7238 7239 * - **Test Name** 7240 - mozilla-central 7241 - autoland 7242 - mozilla-release 7243 - mozilla-beta 7244 * - **browsertime-benchmark-wasm-firefox-wasm-misc-optimizing** 7245 - ✅ 7246 - ❌ 7247 - ❌ 7248 - ❌ 7249 7250 7251 .. list-table:: **test-windows11-64-24h2/opt** 7252 :widths: 30 15 15 15 15 7253 :header-rows: 1 7254 7255 * - **Test Name** 7256 - mozilla-central 7257 - autoland 7258 - mozilla-release 7259 - mozilla-beta 7260 * - **browsertime-benchmark-wasm-firefox-wasm-misc-optimizing** 7261 - ❌ 7262 - ❌ 7263 - ❌ 7264 - ❌ 7265 7266 7267 7268 .. dropdown:: webaudio 7269 :class-container: anchor-id-webaudio-b 7270 7271 * Command to Run Locally 7272 7273 .. code-block:: 7274 7275 ./mach raptor -t webaudio 7276 7277 **Owner**: :padenot and Media Team 7278 7279 * **alert threshold**: 2.0 7280 * **apps**: firefox, chrome, safari 7281 * **expected**: pass 7282 * **expose browser profiler**: true 7283 * **gecko profile interval**: 1 7284 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/webaudio.toml#10>`__ 7285 * **lower is better**: true 7286 * **page cycles**: 5 7287 * **page timeout**: 360000 7288 * **preferences**: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false 7289 * **test url**: `<http://\<host\>:\<port\>/webaudio/index.html?raptor>`__ 7290 * **type**: benchmark 7291 * **unit**: score 7292 * **Test Task**: 7293 7294 .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** 7295 :widths: 30 15 15 15 15 7296 :header-rows: 1 7297 7298 * - **Test Name** 7299 - mozilla-central 7300 - autoland 7301 - mozilla-release 7302 - mozilla-beta 7303 * - **browsertime-benchmark-firefox-webaudio** 7304 - ❌ 7305 - ❌ 7306 - ❌ 7307 - ❌ 7308 7309 7310 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 7311 :widths: 30 15 15 15 15 7312 :header-rows: 1 7313 7314 * - **Test Name** 7315 - mozilla-central 7316 - autoland 7317 - mozilla-release 7318 - mozilla-beta 7319 * - **browsertime-benchmark-firefox-webaudio** 7320 - ❌ 7321 - ❌ 7322 - ❌ 7323 - ❌ 7324 7325 7326 .. list-table:: **test-linux1804-64-qr/opt** 7327 :widths: 30 15 15 15 15 7328 :header-rows: 1 7329 7330 * - **Test Name** 7331 - mozilla-central 7332 - autoland 7333 - mozilla-release 7334 - mozilla-beta 7335 * - **browsertime-benchmark-firefox-webaudio** 7336 - ❌ 7337 - ❌ 7338 - ❌ 7339 - ❌ 7340 7341 7342 .. list-table:: **test-linux1804-64-shippable-qr/opt** 7343 :widths: 30 15 15 15 15 7344 :header-rows: 1 7345 7346 * - **Test Name** 7347 - mozilla-central 7348 - autoland 7349 - mozilla-release 7350 - mozilla-beta 7351 * - **browsertime-benchmark-chrome-webaudio** 7352 - ❌ 7353 - ❌ 7354 - ❌ 7355 - ❌ 7356 * - **browsertime-benchmark-firefox-webaudio** 7357 - ✅ 7358 - ✅ 7359 - ❌ 7360 - ❌ 7361 7362 7363 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 7364 :widths: 30 15 15 15 15 7365 :header-rows: 1 7366 7367 * - **Test Name** 7368 - mozilla-central 7369 - autoland 7370 - mozilla-release 7371 - mozilla-beta 7372 * - **browsertime-benchmark-firefox-webaudio** 7373 - ❌ 7374 - ❌ 7375 - ❌ 7376 - ❌ 7377 7378 7379 .. list-table:: **test-macosx1470-64-shippable/opt** 7380 :widths: 30 15 15 15 15 7381 :header-rows: 1 7382 7383 * - **Test Name** 7384 - mozilla-central 7385 - autoland 7386 - mozilla-release 7387 - mozilla-beta 7388 * - **browsertime-benchmark-chrome-webaudio** 7389 - ❌ 7390 - ❌ 7391 - ❌ 7392 - ❌ 7393 * - **browsertime-benchmark-firefox-webaudio** 7394 - ✅ 7395 - ✅ 7396 - ❌ 7397 - ❌ 7398 * - **browsertime-benchmark-safari-webaudio** 7399 - ❌ 7400 - ❌ 7401 - ❌ 7402 - ❌ 7403 7404 7405 .. list-table:: **test-macosx1470-64/opt** 7406 :widths: 30 15 15 15 15 7407 :header-rows: 1 7408 7409 * - **Test Name** 7410 - mozilla-central 7411 - autoland 7412 - mozilla-release 7413 - mozilla-beta 7414 * - **browsertime-benchmark-firefox-webaudio** 7415 - ❌ 7416 - ❌ 7417 - ❌ 7418 - ❌ 7419 7420 7421 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 7422 :widths: 30 15 15 15 15 7423 :header-rows: 1 7424 7425 * - **Test Name** 7426 - mozilla-central 7427 - autoland 7428 - mozilla-release 7429 - mozilla-beta 7430 * - **browsertime-benchmark-firefox-webaudio** 7431 - ❌ 7432 - ❌ 7433 - ❌ 7434 - ❌ 7435 7436 7437 .. list-table:: **test-windows11-64-24h2-shippable/opt** 7438 :widths: 30 15 15 15 15 7439 :header-rows: 1 7440 7441 * - **Test Name** 7442 - mozilla-central 7443 - autoland 7444 - mozilla-release 7445 - mozilla-beta 7446 * - **browsertime-benchmark-chrome-webaudio** 7447 - ❌ 7448 - ❌ 7449 - ❌ 7450 - ❌ 7451 * - **browsertime-benchmark-firefox-webaudio** 7452 - ✅ 7453 - ✅ 7454 - ❌ 7455 - ❌ 7456 7457 7458 .. list-table:: **test-windows11-64-24h2/opt** 7459 :widths: 30 15 15 15 15 7460 :header-rows: 1 7461 7462 * - **Test Name** 7463 - mozilla-central 7464 - autoland 7465 - mozilla-release 7466 - mozilla-beta 7467 * - **browsertime-benchmark-firefox-webaudio** 7468 - ❌ 7469 - ❌ 7470 - ❌ 7471 - ❌ 7472 7473 7474 7475 .. dropdown:: youtube-playback-av1-sfr 7476 :class-container: anchor-id-youtube-playback-av1-sfr-b 7477 7478 * Command to Run Locally 7479 7480 .. code-block:: 7481 7482 ./mach raptor -t youtube-playback-av1-sfr 7483 7484 **Owner**: PerfTest Team 7485 7486 * **alert threshold**: 2.0 7487 * **apps**: firefox, geckoview, fenix, refbrow, chrome 7488 * **expected**: pass 7489 * **expose browser profiler**: true 7490 * **gecko profile interval**: 1000 7491 * **gecko profile threads**: MediaPlayback 7492 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/youtube-playback.toml#24>`__ 7493 * **lower is better**: true 7494 * **page cycles**: 1 7495 * **page timeout**: 2700000 7496 * **preferences**: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false 7497 * **subtest lower is better**: true 7498 * **subtest unit**: score 7499 * **test url**: `<https://prod.youtube-test.prod.webservices.mozgcp.net/main.html?test_type=playbackperf-sfr-av1-test&raptor=true&exclude=1,2&muted=true&command=run>`__ 7500 * **type**: benchmark 7501 * **unit**: score 7502 * **use live sites**: true 7503 * **Test Task**: 7504 7505 .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** 7506 :widths: 30 15 15 15 15 7507 :header-rows: 1 7508 7509 * - **Test Name** 7510 - mozilla-central 7511 - autoland 7512 - mozilla-release 7513 - mozilla-beta 7514 * - **browsertime-mobile-fenix-youtube-playback-av1-sfr** 7515 - ✅ 7516 - ❌ 7517 - ❌ 7518 - ❌ 7519 * - **browsertime-mobile-fenix-youtube-playback-av1-sfr-nofis** 7520 - ✅ 7521 - ❌ 7522 - ❌ 7523 - ❌ 7524 7525 7526 .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** 7527 :widths: 30 15 15 15 15 7528 :header-rows: 1 7529 7530 * - **Test Name** 7531 - mozilla-central 7532 - autoland 7533 - mozilla-release 7534 - mozilla-beta 7535 * - **browsertime-mobile-fenix-youtube-playback-av1-sfr** 7536 - ❌ 7537 - ❌ 7538 - ❌ 7539 - ❌ 7540 * - **browsertime-mobile-fenix-youtube-playback-av1-sfr-nofis** 7541 - ❌ 7542 - ❌ 7543 - ❌ 7544 - ❌ 7545 7546 7547 .. list-table:: **test-macosx1470-64-shippable/opt** 7548 :widths: 30 15 15 15 15 7549 :header-rows: 1 7550 7551 * - **Test Name** 7552 - mozilla-central 7553 - autoland 7554 - mozilla-release 7555 - mozilla-beta 7556 * - **browsertime-firefox-youtube-playback-av1-sfr** 7557 - ✅ 7558 - ❌ 7559 - ❌ 7560 - ❌ 7561 7562 7563 7564 .. dropdown:: youtube-playback-h264-1080p30 7565 :class-container: anchor-id-youtube-playback-h264-1080p30-b 7566 7567 * Command to Run Locally 7568 7569 .. code-block:: 7570 7571 ./mach raptor -t youtube-playback-h264-1080p30 7572 7573 **Owner**: PerfTest Team 7574 7575 * **alert threshold**: 2.0 7576 * **apps**: firefox 7577 * **expected**: pass 7578 * **expose browser profiler**: true 7579 * **gather cpuTime**: true 7580 * **gecko profile interval**: 1000 7581 * **gecko profile threads**: MediaPlayback 7582 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/youtube-playback.toml#28>`__ 7583 * **lower is better**: true 7584 * **page cycles**: 20 7585 * **page timeout**: 2700000 7586 * **preferences**: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false 7587 * **subtest lower is better**: true 7588 * **subtest unit**: score 7589 * **test url**: `<https://prod.youtube-test.prod.webservices.mozgcp.net/main.html?test_type=playbackperf-sfr-h264-test&tests=18&raptor=true&muted=true&command=run&exclude=1,2>`__ 7590 * **type**: benchmark 7591 * **unit**: score 7592 * **use live sites**: true 7593 * **Test Task**: 7594 7595 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 7596 :widths: 30 15 15 15 15 7597 :header-rows: 1 7598 7599 * - **Test Name** 7600 - mozilla-central 7601 - autoland 7602 - mozilla-release 7603 - mozilla-beta 7604 * - **browsertime-power-firefox-youtube-playback-h264-1080p30** 7605 - ❌ 7606 - ❌ 7607 - ❌ 7608 - ❌ 7609 7610 7611 .. list-table:: **test-linux1804-64-qr/opt** 7612 :widths: 30 15 15 15 15 7613 :header-rows: 1 7614 7615 * - **Test Name** 7616 - mozilla-central 7617 - autoland 7618 - mozilla-release 7619 - mozilla-beta 7620 * - **browsertime-power-firefox-youtube-playback-h264-1080p30** 7621 - ❌ 7622 - ❌ 7623 - ❌ 7624 - ❌ 7625 7626 7627 .. list-table:: **test-linux1804-64-shippable-qr/opt** 7628 :widths: 30 15 15 15 15 7629 :header-rows: 1 7630 7631 * - **Test Name** 7632 - mozilla-central 7633 - autoland 7634 - mozilla-release 7635 - mozilla-beta 7636 * - **browsertime-power-firefox-youtube-playback-h264-1080p30** 7637 - ❌ 7638 - ❌ 7639 - ❌ 7640 - ❌ 7641 7642 7643 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 7644 :widths: 30 15 15 15 15 7645 :header-rows: 1 7646 7647 * - **Test Name** 7648 - mozilla-central 7649 - autoland 7650 - mozilla-release 7651 - mozilla-beta 7652 * - **browsertime-power-firefox-youtube-playback-h264-1080p30** 7653 - ❌ 7654 - ❌ 7655 - ❌ 7656 - ❌ 7657 7658 7659 .. list-table:: **test-macosx1470-64-shippable/opt** 7660 :widths: 30 15 15 15 15 7661 :header-rows: 1 7662 7663 * - **Test Name** 7664 - mozilla-central 7665 - autoland 7666 - mozilla-release 7667 - mozilla-beta 7668 * - **browsertime-power-firefox-youtube-playback-h264-1080p30** 7669 - ✅ 7670 - ❌ 7671 - ❌ 7672 - ❌ 7673 7674 7675 .. list-table:: **test-macosx1470-64/opt** 7676 :widths: 30 15 15 15 15 7677 :header-rows: 1 7678 7679 * - **Test Name** 7680 - mozilla-central 7681 - autoland 7682 - mozilla-release 7683 - mozilla-beta 7684 * - **browsertime-power-firefox-youtube-playback-h264-1080p30** 7685 - ❌ 7686 - ❌ 7687 - ❌ 7688 - ❌ 7689 7690 7691 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 7692 :widths: 30 15 15 15 15 7693 :header-rows: 1 7694 7695 * - **Test Name** 7696 - mozilla-central 7697 - autoland 7698 - mozilla-release 7699 - mozilla-beta 7700 * - **browsertime-power-firefox-youtube-playback-h264-1080p30** 7701 - ❌ 7702 - ❌ 7703 - ❌ 7704 - ❌ 7705 7706 7707 .. list-table:: **test-windows11-64-24h2-shippable/opt** 7708 :widths: 30 15 15 15 15 7709 :header-rows: 1 7710 7711 * - **Test Name** 7712 - mozilla-central 7713 - autoland 7714 - mozilla-release 7715 - mozilla-beta 7716 * - **browsertime-power-firefox-youtube-playback-h264-1080p30** 7717 - ❌ 7718 - ❌ 7719 - ❌ 7720 - ❌ 7721 7722 7723 .. list-table:: **test-windows11-64-24h2/opt** 7724 :widths: 30 15 15 15 15 7725 :header-rows: 1 7726 7727 * - **Test Name** 7728 - mozilla-central 7729 - autoland 7730 - mozilla-release 7731 - mozilla-beta 7732 * - **browsertime-power-firefox-youtube-playback-h264-1080p30** 7733 - ❌ 7734 - ❌ 7735 - ❌ 7736 - ❌ 7737 7738 7739 7740 .. dropdown:: youtube-playback-h264-1080p60 7741 :class-container: anchor-id-youtube-playback-h264-1080p60-b 7742 7743 * Command to Run Locally 7744 7745 .. code-block:: 7746 7747 ./mach raptor -t youtube-playback-h264-1080p60 7748 7749 **Owner**: PerfTest Team 7750 7751 * **alert threshold**: 2.0 7752 * **apps**: firefox 7753 * **expected**: pass 7754 * **expose browser profiler**: true 7755 * **gather cpuTime**: true 7756 * **gecko profile interval**: 1000 7757 * **gecko profile threads**: MediaPlayback 7758 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/youtube-playback.toml#34>`__ 7759 * **lower is better**: true 7760 * **page cycles**: 20 7761 * **page timeout**: 2700000 7762 * **preferences**: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false 7763 * **subtest lower is better**: true 7764 * **subtest unit**: score 7765 * **test url**: `<https://prod.youtube-test.prod.webservices.mozgcp.net/main.html?test_type=playbackperf-hfr-test&raptor=true&tests=46&muted=true&command=run&exclude=1,2>`__ 7766 * **type**: benchmark 7767 * **unit**: score 7768 * **use live sites**: true 7769 * **Test Task**: 7770 7771 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 7772 :widths: 30 15 15 15 15 7773 :header-rows: 1 7774 7775 * - **Test Name** 7776 - mozilla-central 7777 - autoland 7778 - mozilla-release 7779 - mozilla-beta 7780 * - **browsertime-power-firefox-youtube-playback-h264-1080p60** 7781 - ❌ 7782 - ❌ 7783 - ❌ 7784 - ❌ 7785 7786 7787 .. list-table:: **test-linux1804-64-qr/opt** 7788 :widths: 30 15 15 15 15 7789 :header-rows: 1 7790 7791 * - **Test Name** 7792 - mozilla-central 7793 - autoland 7794 - mozilla-release 7795 - mozilla-beta 7796 * - **browsertime-power-firefox-youtube-playback-h264-1080p60** 7797 - ❌ 7798 - ❌ 7799 - ❌ 7800 - ❌ 7801 7802 7803 .. list-table:: **test-linux1804-64-shippable-qr/opt** 7804 :widths: 30 15 15 15 15 7805 :header-rows: 1 7806 7807 * - **Test Name** 7808 - mozilla-central 7809 - autoland 7810 - mozilla-release 7811 - mozilla-beta 7812 * - **browsertime-power-firefox-youtube-playback-h264-1080p60** 7813 - ❌ 7814 - ❌ 7815 - ❌ 7816 - ❌ 7817 7818 7819 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 7820 :widths: 30 15 15 15 15 7821 :header-rows: 1 7822 7823 * - **Test Name** 7824 - mozilla-central 7825 - autoland 7826 - mozilla-release 7827 - mozilla-beta 7828 * - **browsertime-power-firefox-youtube-playback-h264-1080p60** 7829 - ❌ 7830 - ❌ 7831 - ❌ 7832 - ❌ 7833 7834 7835 .. list-table:: **test-macosx1470-64-shippable/opt** 7836 :widths: 30 15 15 15 15 7837 :header-rows: 1 7838 7839 * - **Test Name** 7840 - mozilla-central 7841 - autoland 7842 - mozilla-release 7843 - mozilla-beta 7844 * - **browsertime-power-firefox-youtube-playback-h264-1080p60** 7845 - ✅ 7846 - ❌ 7847 - ❌ 7848 - ❌ 7849 7850 7851 .. list-table:: **test-macosx1470-64/opt** 7852 :widths: 30 15 15 15 15 7853 :header-rows: 1 7854 7855 * - **Test Name** 7856 - mozilla-central 7857 - autoland 7858 - mozilla-release 7859 - mozilla-beta 7860 * - **browsertime-power-firefox-youtube-playback-h264-1080p60** 7861 - ❌ 7862 - ❌ 7863 - ❌ 7864 - ❌ 7865 7866 7867 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 7868 :widths: 30 15 15 15 15 7869 :header-rows: 1 7870 7871 * - **Test Name** 7872 - mozilla-central 7873 - autoland 7874 - mozilla-release 7875 - mozilla-beta 7876 * - **browsertime-power-firefox-youtube-playback-h264-1080p60** 7877 - ❌ 7878 - ❌ 7879 - ❌ 7880 - ❌ 7881 7882 7883 .. list-table:: **test-windows11-64-24h2-shippable/opt** 7884 :widths: 30 15 15 15 15 7885 :header-rows: 1 7886 7887 * - **Test Name** 7888 - mozilla-central 7889 - autoland 7890 - mozilla-release 7891 - mozilla-beta 7892 * - **browsertime-power-firefox-youtube-playback-h264-1080p60** 7893 - ❌ 7894 - ❌ 7895 - ❌ 7896 - ❌ 7897 7898 7899 .. list-table:: **test-windows11-64-24h2/opt** 7900 :widths: 30 15 15 15 15 7901 :header-rows: 1 7902 7903 * - **Test Name** 7904 - mozilla-central 7905 - autoland 7906 - mozilla-release 7907 - mozilla-beta 7908 * - **browsertime-power-firefox-youtube-playback-h264-1080p60** 7909 - ❌ 7910 - ❌ 7911 - ❌ 7912 - ❌ 7913 7914 7915 7916 .. dropdown:: youtube-playback-h264-720p60 7917 :class-container: anchor-id-youtube-playback-h264-720p60-b 7918 7919 * Command to Run Locally 7920 7921 .. code-block:: 7922 7923 ./mach raptor -t youtube-playback-h264-720p60 7924 7925 **Owner**: PerfTest Team 7926 7927 * **alert threshold**: 2.0 7928 * **apps**: firefox, chrome, geckoview, fenix, refbrow, chrome-m 7929 * **browsertime args**: --pageCompleteWaitTime=10 --pageCompleteCheckPollTimeout=10 --browsertime.benchmark_wait_time=500 7930 * **expected**: pass 7931 * **expose browser profiler**: true 7932 * **gecko profile interval**: 1000 7933 * **gecko profile threads**: MediaPlayback 7934 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/youtube-playback.toml#82>`__ 7935 * **lower is better**: true 7936 * **page cycles**: 20 7937 * **page timeout**: 2700000 7938 * **preferences**: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false 7939 * **subtest lower is better**: true 7940 * **subtest unit**: score 7941 * **support class**: browsertime_benchmark.py 7942 * **test url**: `<https://prod.youtube-test.prod.webservices.mozgcp.net/main.html?test_type=playbackperf-hfr-test&tests=38&raptor=true&exclude=1,2&muted=true&command=run>`__ 7943 * **type**: benchmark 7944 * **unit**: score 7945 * **use live sites**: true 7946 * **Test Task**: 7947 7948 .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** 7949 :widths: 30 15 15 15 15 7950 :header-rows: 1 7951 7952 * - **Test Name** 7953 - mozilla-central 7954 - autoland 7955 - mozilla-release 7956 - mozilla-beta 7957 * - **browsertime-power-mobile-chrome-m-youtube-playback-h264-720p60-nofis** 7958 - ❌ 7959 - ❌ 7960 - ❌ 7961 - ❌ 7962 * - **browsertime-power-mobile-fenix-youtube-playback-h264-720p60** 7963 - ✅ 7964 - ✅ 7965 - ❌ 7966 - ❌ 7967 * - **browsertime-power-mobile-fenix-youtube-playback-h264-720p60-nofis** 7968 - ✅ 7969 - ✅ 7970 - ❌ 7971 - ❌ 7972 * - **browsertime-power-mobile-geckoview-youtube-playback-h264-720p60** 7973 - ❌ 7974 - ❌ 7975 - ❌ 7976 - ❌ 7977 * - **browsertime-power-mobile-geckoview-youtube-playback-h264-720p60-nofis** 7978 - ❌ 7979 - ❌ 7980 - ❌ 7981 - ❌ 7982 7983 7984 .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** 7985 :widths: 30 15 15 15 15 7986 :header-rows: 1 7987 7988 * - **Test Name** 7989 - mozilla-central 7990 - autoland 7991 - mozilla-release 7992 - mozilla-beta 7993 * - **browsertime-power-mobile-fenix-youtube-playback-h264-720p60** 7994 - ❌ 7995 - ❌ 7996 - ❌ 7997 - ❌ 7998 * - **browsertime-power-mobile-fenix-youtube-playback-h264-720p60-nofis** 7999 - ❌ 8000 - ❌ 8001 - ❌ 8002 - ❌ 8003 * - **browsertime-power-mobile-geckoview-youtube-playback-h264-720p60** 8004 - ❌ 8005 - ❌ 8006 - ❌ 8007 - ❌ 8008 * - **browsertime-power-mobile-geckoview-youtube-playback-h264-720p60-nofis** 8009 - ❌ 8010 - ❌ 8011 - ❌ 8012 - ❌ 8013 8014 8015 .. list-table:: **test-android-hw-p6-13-0-aarch64-shippable/opt** 8016 :widths: 30 15 15 15 15 8017 :header-rows: 1 8018 8019 * - **Test Name** 8020 - mozilla-central 8021 - autoland 8022 - mozilla-release 8023 - mozilla-beta 8024 * - **browsertime-power-mobile-chrome-m-youtube-playback-h264-720p60-nofis** 8025 - ❌ 8026 - ❌ 8027 - ❌ 8028 - ❌ 8029 * - **browsertime-power-mobile-fenix-youtube-playback-h264-720p60** 8030 - ❌ 8031 - ❌ 8032 - ❌ 8033 - ❌ 8034 * - **browsertime-power-mobile-fenix-youtube-playback-h264-720p60-nofis** 8035 - ❌ 8036 - ❌ 8037 - ❌ 8038 - ❌ 8039 * - **browsertime-power-mobile-geckoview-youtube-playback-h264-720p60** 8040 - ❌ 8041 - ❌ 8042 - ❌ 8043 - ❌ 8044 * - **browsertime-power-mobile-geckoview-youtube-playback-h264-720p60-nofis** 8045 - ❌ 8046 - ❌ 8047 - ❌ 8048 - ❌ 8049 8050 8051 .. list-table:: **test-android-hw-s24-14-0-aarch64-shippable/opt** 8052 :widths: 30 15 15 15 15 8053 :header-rows: 1 8054 8055 * - **Test Name** 8056 - mozilla-central 8057 - autoland 8058 - mozilla-release 8059 - mozilla-beta 8060 * - **browsertime-power-mobile-chrome-m-youtube-playback-h264-720p60-nofis** 8061 - ❌ 8062 - ❌ 8063 - ❌ 8064 - ❌ 8065 * - **browsertime-power-mobile-fenix-youtube-playback-h264-720p60** 8066 - ❌ 8067 - ❌ 8068 - ❌ 8069 - ❌ 8070 * - **browsertime-power-mobile-fenix-youtube-playback-h264-720p60-nofis** 8071 - ❌ 8072 - ❌ 8073 - ❌ 8074 - ❌ 8075 * - **browsertime-power-mobile-geckoview-youtube-playback-h264-720p60** 8076 - ❌ 8077 - ❌ 8078 - ❌ 8079 - ❌ 8080 * - **browsertime-power-mobile-geckoview-youtube-playback-h264-720p60-nofis** 8081 - ❌ 8082 - ❌ 8083 - ❌ 8084 - ❌ 8085 8086 8087 8088 .. dropdown:: youtube-playback-h264-full-1080p30 8089 :class-container: anchor-id-youtube-playback-h264-full-1080p30-b 8090 8091 * Command to Run Locally 8092 8093 .. code-block:: 8094 8095 ./mach raptor -t youtube-playback-h264-full-1080p30 8096 8097 **Owner**: PerfTest Team 8098 8099 * **alert threshold**: 2.0 8100 * **apps**: firefox 8101 * **expected**: pass 8102 * **expose browser profiler**: true 8103 * **gather cpuTime**: true 8104 * **gecko profile interval**: 1000 8105 * **gecko profile threads**: MediaPlayback 8106 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/youtube-playback.toml#40>`__ 8107 * **lower is better**: true 8108 * **page cycles**: 20 8109 * **page timeout**: 2700000 8110 * **preferences**: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false full-screen-api.allow-trusted-requests-only=false full-screen-api.warning.timeout=0 8111 * **subtest lower is better**: true 8112 * **subtest unit**: score 8113 * **test url**: `<https://prod.youtube-test.prod.webservices.mozgcp.net/main.html?test_type=playbackperf-sfr-h264-test&tests=18&raptor=true&muted=true&command=run&fullscreen=true&exclude=1,2>`__ 8114 * **type**: benchmark 8115 * **unit**: score 8116 * **use live sites**: true 8117 * **Test Task**: 8118 8119 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 8120 :widths: 30 15 15 15 15 8121 :header-rows: 1 8122 8123 * - **Test Name** 8124 - mozilla-central 8125 - autoland 8126 - mozilla-release 8127 - mozilla-beta 8128 * - **browsertime-power-firefox-youtube-playback-h264-full-1080p30** 8129 - ❌ 8130 - ❌ 8131 - ❌ 8132 - ❌ 8133 8134 8135 .. list-table:: **test-linux1804-64-qr/opt** 8136 :widths: 30 15 15 15 15 8137 :header-rows: 1 8138 8139 * - **Test Name** 8140 - mozilla-central 8141 - autoland 8142 - mozilla-release 8143 - mozilla-beta 8144 * - **browsertime-power-firefox-youtube-playback-h264-full-1080p30** 8145 - ❌ 8146 - ❌ 8147 - ❌ 8148 - ❌ 8149 8150 8151 .. list-table:: **test-linux1804-64-shippable-qr/opt** 8152 :widths: 30 15 15 15 15 8153 :header-rows: 1 8154 8155 * - **Test Name** 8156 - mozilla-central 8157 - autoland 8158 - mozilla-release 8159 - mozilla-beta 8160 * - **browsertime-power-firefox-youtube-playback-h264-full-1080p30** 8161 - ❌ 8162 - ❌ 8163 - ❌ 8164 - ❌ 8165 8166 8167 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 8168 :widths: 30 15 15 15 15 8169 :header-rows: 1 8170 8171 * - **Test Name** 8172 - mozilla-central 8173 - autoland 8174 - mozilla-release 8175 - mozilla-beta 8176 * - **browsertime-power-firefox-youtube-playback-h264-full-1080p30** 8177 - ❌ 8178 - ❌ 8179 - ❌ 8180 - ❌ 8181 8182 8183 .. list-table:: **test-macosx1470-64-shippable/opt** 8184 :widths: 30 15 15 15 15 8185 :header-rows: 1 8186 8187 * - **Test Name** 8188 - mozilla-central 8189 - autoland 8190 - mozilla-release 8191 - mozilla-beta 8192 * - **browsertime-power-firefox-youtube-playback-h264-full-1080p30** 8193 - ✅ 8194 - ❌ 8195 - ❌ 8196 - ❌ 8197 8198 8199 .. list-table:: **test-macosx1470-64/opt** 8200 :widths: 30 15 15 15 15 8201 :header-rows: 1 8202 8203 * - **Test Name** 8204 - mozilla-central 8205 - autoland 8206 - mozilla-release 8207 - mozilla-beta 8208 * - **browsertime-power-firefox-youtube-playback-h264-full-1080p30** 8209 - ❌ 8210 - ❌ 8211 - ❌ 8212 - ❌ 8213 8214 8215 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 8216 :widths: 30 15 15 15 15 8217 :header-rows: 1 8218 8219 * - **Test Name** 8220 - mozilla-central 8221 - autoland 8222 - mozilla-release 8223 - mozilla-beta 8224 * - **browsertime-power-firefox-youtube-playback-h264-full-1080p30** 8225 - ❌ 8226 - ❌ 8227 - ❌ 8228 - ❌ 8229 8230 8231 .. list-table:: **test-windows11-64-24h2-shippable/opt** 8232 :widths: 30 15 15 15 15 8233 :header-rows: 1 8234 8235 * - **Test Name** 8236 - mozilla-central 8237 - autoland 8238 - mozilla-release 8239 - mozilla-beta 8240 * - **browsertime-power-firefox-youtube-playback-h264-full-1080p30** 8241 - ❌ 8242 - ❌ 8243 - ❌ 8244 - ❌ 8245 8246 8247 .. list-table:: **test-windows11-64-24h2/opt** 8248 :widths: 30 15 15 15 15 8249 :header-rows: 1 8250 8251 * - **Test Name** 8252 - mozilla-central 8253 - autoland 8254 - mozilla-release 8255 - mozilla-beta 8256 * - **browsertime-power-firefox-youtube-playback-h264-full-1080p30** 8257 - ❌ 8258 - ❌ 8259 - ❌ 8260 - ❌ 8261 8262 8263 8264 .. dropdown:: youtube-playback-h264-full-1080p60 8265 :class-container: anchor-id-youtube-playback-h264-full-1080p60-b 8266 8267 * Command to Run Locally 8268 8269 .. code-block:: 8270 8271 ./mach raptor -t youtube-playback-h264-full-1080p60 8272 8273 **Owner**: PerfTest Team 8274 8275 * **alert threshold**: 2.0 8276 * **apps**: firefox 8277 * **expected**: pass 8278 * **expose browser profiler**: true 8279 * **gather cpuTime**: true 8280 * **gecko profile interval**: 1000 8281 * **gecko profile threads**: MediaPlayback 8282 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/youtube-playback.toml#55>`__ 8283 * **lower is better**: true 8284 * **page cycles**: 20 8285 * **page timeout**: 2700000 8286 * **preferences**: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false full-screen-api.allow-trusted-requests-only=false full-screen-api.warning.timeout=0 8287 * **subtest lower is better**: true 8288 * **subtest unit**: score 8289 * **test url**: `<https://prod.youtube-test.prod.webservices.mozgcp.net/main.html?test_type=playbackperf-hfr-test&raptor=true&tests=46&muted=true&command=run&fullscreen=true&exclude=1,2>`__ 8290 * **type**: benchmark 8291 * **unit**: score 8292 * **use live sites**: true 8293 * **Test Task**: 8294 8295 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 8296 :widths: 30 15 15 15 15 8297 :header-rows: 1 8298 8299 * - **Test Name** 8300 - mozilla-central 8301 - autoland 8302 - mozilla-release 8303 - mozilla-beta 8304 * - **browsertime-power-firefox-youtube-playback-h264-full-1080p60** 8305 - ❌ 8306 - ❌ 8307 - ❌ 8308 - ❌ 8309 8310 8311 .. list-table:: **test-linux1804-64-qr/opt** 8312 :widths: 30 15 15 15 15 8313 :header-rows: 1 8314 8315 * - **Test Name** 8316 - mozilla-central 8317 - autoland 8318 - mozilla-release 8319 - mozilla-beta 8320 * - **browsertime-power-firefox-youtube-playback-h264-full-1080p60** 8321 - ❌ 8322 - ❌ 8323 - ❌ 8324 - ❌ 8325 8326 8327 .. list-table:: **test-linux1804-64-shippable-qr/opt** 8328 :widths: 30 15 15 15 15 8329 :header-rows: 1 8330 8331 * - **Test Name** 8332 - mozilla-central 8333 - autoland 8334 - mozilla-release 8335 - mozilla-beta 8336 * - **browsertime-power-firefox-youtube-playback-h264-full-1080p60** 8337 - ❌ 8338 - ❌ 8339 - ❌ 8340 - ❌ 8341 8342 8343 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 8344 :widths: 30 15 15 15 15 8345 :header-rows: 1 8346 8347 * - **Test Name** 8348 - mozilla-central 8349 - autoland 8350 - mozilla-release 8351 - mozilla-beta 8352 * - **browsertime-power-firefox-youtube-playback-h264-full-1080p60** 8353 - ❌ 8354 - ❌ 8355 - ❌ 8356 - ❌ 8357 8358 8359 .. list-table:: **test-macosx1470-64-shippable/opt** 8360 :widths: 30 15 15 15 15 8361 :header-rows: 1 8362 8363 * - **Test Name** 8364 - mozilla-central 8365 - autoland 8366 - mozilla-release 8367 - mozilla-beta 8368 * - **browsertime-power-firefox-youtube-playback-h264-full-1080p60** 8369 - ✅ 8370 - ❌ 8371 - ❌ 8372 - ❌ 8373 8374 8375 .. list-table:: **test-macosx1470-64/opt** 8376 :widths: 30 15 15 15 15 8377 :header-rows: 1 8378 8379 * - **Test Name** 8380 - mozilla-central 8381 - autoland 8382 - mozilla-release 8383 - mozilla-beta 8384 * - **browsertime-power-firefox-youtube-playback-h264-full-1080p60** 8385 - ❌ 8386 - ❌ 8387 - ❌ 8388 - ❌ 8389 8390 8391 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 8392 :widths: 30 15 15 15 15 8393 :header-rows: 1 8394 8395 * - **Test Name** 8396 - mozilla-central 8397 - autoland 8398 - mozilla-release 8399 - mozilla-beta 8400 * - **browsertime-power-firefox-youtube-playback-h264-full-1080p60** 8401 - ❌ 8402 - ❌ 8403 - ❌ 8404 - ❌ 8405 8406 8407 .. list-table:: **test-windows11-64-24h2-shippable/opt** 8408 :widths: 30 15 15 15 15 8409 :header-rows: 1 8410 8411 * - **Test Name** 8412 - mozilla-central 8413 - autoland 8414 - mozilla-release 8415 - mozilla-beta 8416 * - **browsertime-power-firefox-youtube-playback-h264-full-1080p60** 8417 - ❌ 8418 - ❌ 8419 - ❌ 8420 - ❌ 8421 8422 8423 .. list-table:: **test-windows11-64-24h2/opt** 8424 :widths: 30 15 15 15 15 8425 :header-rows: 1 8426 8427 * - **Test Name** 8428 - mozilla-central 8429 - autoland 8430 - mozilla-release 8431 - mozilla-beta 8432 * - **browsertime-power-firefox-youtube-playback-h264-full-1080p60** 8433 - ❌ 8434 - ❌ 8435 - ❌ 8436 - ❌ 8437 8438 8439 8440 .. dropdown:: youtube-playback-h264-sfr 8441 :class-container: anchor-id-youtube-playback-h264-sfr-b 8442 8443 * Command to Run Locally 8444 8445 .. code-block:: 8446 8447 ./mach raptor -t youtube-playback-h264-sfr 8448 8449 **Owner**: PerfTest Team 8450 8451 * **alert threshold**: 2.0 8452 * **apps**: firefox, geckoview, fenix, refbrow, chrome 8453 * **expected**: pass 8454 * **expose browser profiler**: true 8455 * **gecko profile interval**: 1000 8456 * **gecko profile threads**: MediaPlayback 8457 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/youtube-playback.toml#70>`__ 8458 * **lower is better**: true 8459 * **page cycles**: 1 8460 * **page timeout**: 2700000 8461 * **preferences**: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false 8462 * **subtest lower is better**: true 8463 * **subtest unit**: score 8464 * **test url**: `<https://prod.youtube-test.prod.webservices.mozgcp.net/main.html?test_type=playbackperf-sfr-h264-test&raptor=true&exclude=1,2&muted=true&command=run>`__ 8465 * **type**: benchmark 8466 * **unit**: score 8467 * **use live sites**: true 8468 * **Test Task**: 8469 8470 .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** 8471 :widths: 30 15 15 15 15 8472 :header-rows: 1 8473 8474 * - **Test Name** 8475 - mozilla-central 8476 - autoland 8477 - mozilla-release 8478 - mozilla-beta 8479 * - **browsertime-mobile-geckoview-youtube-playback-h264-sfr** 8480 - ❌ 8481 - ❌ 8482 - ❌ 8483 - ❌ 8484 * - **browsertime-mobile-geckoview-youtube-playback-h264-sfr-nofis** 8485 - ❌ 8486 - ❌ 8487 - ❌ 8488 - ❌ 8489 * - **browsertime-mobile-refbrow-youtube-playback-h264-sfr** 8490 - ❌ 8491 - ❌ 8492 - ❌ 8493 - ❌ 8494 8495 8496 .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** 8497 :widths: 30 15 15 15 15 8498 :header-rows: 1 8499 8500 * - **Test Name** 8501 - mozilla-central 8502 - autoland 8503 - mozilla-release 8504 - mozilla-beta 8505 * - **browsertime-mobile-geckoview-youtube-playback-h264-sfr** 8506 - ❌ 8507 - ❌ 8508 - ❌ 8509 - ❌ 8510 * - **browsertime-mobile-geckoview-youtube-playback-h264-sfr-nofis** 8511 - ❌ 8512 - ❌ 8513 - ❌ 8514 - ❌ 8515 * - **browsertime-mobile-refbrow-youtube-playback-h264-sfr** 8516 - ❌ 8517 - ❌ 8518 - ❌ 8519 - ❌ 8520 8521 8522 .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** 8523 :widths: 30 15 15 15 15 8524 :header-rows: 1 8525 8526 * - **Test Name** 8527 - mozilla-central 8528 - autoland 8529 - mozilla-release 8530 - mozilla-beta 8531 * - **browsertime-firefox-youtube-playback-h264-sfr** 8532 - ❌ 8533 - ❌ 8534 - ❌ 8535 - ❌ 8536 8537 8538 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 8539 :widths: 30 15 15 15 15 8540 :header-rows: 1 8541 8542 * - **Test Name** 8543 - mozilla-central 8544 - autoland 8545 - mozilla-release 8546 - mozilla-beta 8547 * - **browsertime-firefox-youtube-playback-h264-sfr** 8548 - ❌ 8549 - ❌ 8550 - ❌ 8551 - ❌ 8552 8553 8554 .. list-table:: **test-linux1804-64-qr/opt** 8555 :widths: 30 15 15 15 15 8556 :header-rows: 1 8557 8558 * - **Test Name** 8559 - mozilla-central 8560 - autoland 8561 - mozilla-release 8562 - mozilla-beta 8563 * - **browsertime-firefox-youtube-playback-h264-sfr** 8564 - ❌ 8565 - ❌ 8566 - ❌ 8567 - ❌ 8568 8569 8570 .. list-table:: **test-linux1804-64-shippable-qr/opt** 8571 :widths: 30 15 15 15 15 8572 :header-rows: 1 8573 8574 * - **Test Name** 8575 - mozilla-central 8576 - autoland 8577 - mozilla-release 8578 - mozilla-beta 8579 * - **browsertime-firefox-youtube-playback-h264-sfr** 8580 - ✅ 8581 - ❌ 8582 - ❌ 8583 - ❌ 8584 8585 8586 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 8587 :widths: 30 15 15 15 15 8588 :header-rows: 1 8589 8590 * - **Test Name** 8591 - mozilla-central 8592 - autoland 8593 - mozilla-release 8594 - mozilla-beta 8595 * - **browsertime-firefox-youtube-playback-h264-sfr** 8596 - ❌ 8597 - ❌ 8598 - ❌ 8599 - ❌ 8600 8601 8602 .. list-table:: **test-macosx1470-64-shippable/opt** 8603 :widths: 30 15 15 15 15 8604 :header-rows: 1 8605 8606 * - **Test Name** 8607 - mozilla-central 8608 - autoland 8609 - mozilla-release 8610 - mozilla-beta 8611 * - **browsertime-firefox-youtube-playback-h264-sfr** 8612 - ✅ 8613 - ❌ 8614 - ❌ 8615 - ❌ 8616 8617 8618 .. list-table:: **test-macosx1470-64/opt** 8619 :widths: 30 15 15 15 15 8620 :header-rows: 1 8621 8622 * - **Test Name** 8623 - mozilla-central 8624 - autoland 8625 - mozilla-release 8626 - mozilla-beta 8627 * - **browsertime-firefox-youtube-playback-h264-sfr** 8628 - ❌ 8629 - ❌ 8630 - ❌ 8631 - ❌ 8632 8633 8634 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 8635 :widths: 30 15 15 15 15 8636 :header-rows: 1 8637 8638 * - **Test Name** 8639 - mozilla-central 8640 - autoland 8641 - mozilla-release 8642 - mozilla-beta 8643 * - **browsertime-firefox-youtube-playback-h264-sfr** 8644 - ❌ 8645 - ❌ 8646 - ❌ 8647 - ❌ 8648 8649 8650 .. list-table:: **test-windows11-64-24h2-shippable/opt** 8651 :widths: 30 15 15 15 15 8652 :header-rows: 1 8653 8654 * - **Test Name** 8655 - mozilla-central 8656 - autoland 8657 - mozilla-release 8658 - mozilla-beta 8659 * - **browsertime-firefox-youtube-playback-h264-sfr** 8660 - ✅ 8661 - ❌ 8662 - ❌ 8663 - ❌ 8664 8665 8666 .. list-table:: **test-windows11-64-24h2/opt** 8667 :widths: 30 15 15 15 15 8668 :header-rows: 1 8669 8670 * - **Test Name** 8671 - mozilla-central 8672 - autoland 8673 - mozilla-release 8674 - mozilla-beta 8675 * - **browsertime-firefox-youtube-playback-h264-sfr** 8676 - ❌ 8677 - ❌ 8678 - ❌ 8679 - ❌ 8680 8681 8682 8683 .. dropdown:: youtube-playback-hfr 8684 :class-container: anchor-id-youtube-playback-hfr-b 8685 8686 * Command to Run Locally 8687 8688 .. code-block:: 8689 8690 ./mach raptor -t youtube-playback-hfr 8691 8692 **Owner**: PerfTest Team 8693 8694 * **alert on**: `H2641080p60fps@1X_dropped_frames <raptor-metrics.html#youtube-playback-metrics>`__, `H264720p60fps@1X_dropped_frames <raptor-metrics.html#youtube-playback-metrics>`__ 8695 * **alert threshold**: 2.0 8696 * **apps**: firefox, geckoview, fenix, refbrow, chrome 8697 * **expected**: pass 8698 * **expose browser profiler**: true 8699 * **gecko profile interval**: 1000 8700 * **gecko profile threads**: MediaPlayback 8701 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/youtube-playback.toml#74>`__ 8702 * **lower is better**: true 8703 * **page cycles**: 1 8704 * **page timeout**: 2700000 8705 * **preferences**: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false 8706 * **subtest lower is better**: true 8707 * **subtest unit**: score 8708 * **test url**: `<https://prod.youtube-test.prod.webservices.mozgcp.net/main.html?test_type=playbackperf-hfr-test&raptor=true&exclude=1,2&muted=true&command=run>`__ 8709 * **type**: benchmark 8710 * **unit**: score 8711 * **use live sites**: true 8712 * **Test Task**: 8713 8714 .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** 8715 :widths: 30 15 15 15 15 8716 :header-rows: 1 8717 8718 * - **Test Name** 8719 - mozilla-central 8720 - autoland 8721 - mozilla-release 8722 - mozilla-beta 8723 * - **browsertime-mobile-fenix-youtube-playback-hfr** 8724 - ✅ 8725 - ❌ 8726 - ❌ 8727 - ❌ 8728 * - **browsertime-mobile-fenix-youtube-playback-hfr-nofis** 8729 - ✅ 8730 - ❌ 8731 - ❌ 8732 - ❌ 8733 * - **browsertime-mobile-geckoview-youtube-playback-hfr** 8734 - ❌ 8735 - ❌ 8736 - ❌ 8737 - ❌ 8738 * - **browsertime-mobile-geckoview-youtube-playback-hfr-nofis** 8739 - ❌ 8740 - ❌ 8741 - ❌ 8742 - ❌ 8743 * - **browsertime-mobile-refbrow-youtube-playback-hfr** 8744 - ❌ 8745 - ❌ 8746 - ❌ 8747 - ❌ 8748 8749 8750 .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** 8751 :widths: 30 15 15 15 15 8752 :header-rows: 1 8753 8754 * - **Test Name** 8755 - mozilla-central 8756 - autoland 8757 - mozilla-release 8758 - mozilla-beta 8759 * - **browsertime-mobile-fenix-youtube-playback-hfr** 8760 - ❌ 8761 - ❌ 8762 - ❌ 8763 - ❌ 8764 * - **browsertime-mobile-fenix-youtube-playback-hfr-nofis** 8765 - ❌ 8766 - ❌ 8767 - ❌ 8768 - ❌ 8769 * - **browsertime-mobile-geckoview-youtube-playback-hfr** 8770 - ❌ 8771 - ❌ 8772 - ❌ 8773 - ❌ 8774 * - **browsertime-mobile-geckoview-youtube-playback-hfr-nofis** 8775 - ❌ 8776 - ❌ 8777 - ❌ 8778 - ❌ 8779 * - **browsertime-mobile-refbrow-youtube-playback-hfr** 8780 - ❌ 8781 - ❌ 8782 - ❌ 8783 - ❌ 8784 8785 8786 .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** 8787 :widths: 30 15 15 15 15 8788 :header-rows: 1 8789 8790 * - **Test Name** 8791 - mozilla-central 8792 - autoland 8793 - mozilla-release 8794 - mozilla-beta 8795 * - **browsertime-firefox-youtube-playback-hfr** 8796 - ❌ 8797 - ❌ 8798 - ❌ 8799 - ❌ 8800 8801 8802 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 8803 :widths: 30 15 15 15 15 8804 :header-rows: 1 8805 8806 * - **Test Name** 8807 - mozilla-central 8808 - autoland 8809 - mozilla-release 8810 - mozilla-beta 8811 * - **browsertime-firefox-youtube-playback-hfr** 8812 - ❌ 8813 - ❌ 8814 - ❌ 8815 - ❌ 8816 8817 8818 .. list-table:: **test-linux1804-64-qr/opt** 8819 :widths: 30 15 15 15 15 8820 :header-rows: 1 8821 8822 * - **Test Name** 8823 - mozilla-central 8824 - autoland 8825 - mozilla-release 8826 - mozilla-beta 8827 * - **browsertime-firefox-youtube-playback-hfr** 8828 - ❌ 8829 - ❌ 8830 - ❌ 8831 - ❌ 8832 8833 8834 .. list-table:: **test-linux1804-64-shippable-qr/opt** 8835 :widths: 30 15 15 15 15 8836 :header-rows: 1 8837 8838 * - **Test Name** 8839 - mozilla-central 8840 - autoland 8841 - mozilla-release 8842 - mozilla-beta 8843 * - **browsertime-firefox-youtube-playback-hfr** 8844 - ✅ 8845 - ❌ 8846 - ❌ 8847 - ❌ 8848 8849 8850 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 8851 :widths: 30 15 15 15 15 8852 :header-rows: 1 8853 8854 * - **Test Name** 8855 - mozilla-central 8856 - autoland 8857 - mozilla-release 8858 - mozilla-beta 8859 * - **browsertime-firefox-youtube-playback-hfr** 8860 - ❌ 8861 - ❌ 8862 - ❌ 8863 - ❌ 8864 8865 8866 .. list-table:: **test-macosx1470-64-shippable/opt** 8867 :widths: 30 15 15 15 15 8868 :header-rows: 1 8869 8870 * - **Test Name** 8871 - mozilla-central 8872 - autoland 8873 - mozilla-release 8874 - mozilla-beta 8875 * - **browsertime-firefox-youtube-playback-hfr** 8876 - ✅ 8877 - ❌ 8878 - ❌ 8879 - ❌ 8880 8881 8882 .. list-table:: **test-macosx1470-64/opt** 8883 :widths: 30 15 15 15 15 8884 :header-rows: 1 8885 8886 * - **Test Name** 8887 - mozilla-central 8888 - autoland 8889 - mozilla-release 8890 - mozilla-beta 8891 * - **browsertime-firefox-youtube-playback-hfr** 8892 - ❌ 8893 - ❌ 8894 - ❌ 8895 - ❌ 8896 8897 8898 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 8899 :widths: 30 15 15 15 15 8900 :header-rows: 1 8901 8902 * - **Test Name** 8903 - mozilla-central 8904 - autoland 8905 - mozilla-release 8906 - mozilla-beta 8907 * - **browsertime-firefox-youtube-playback-hfr** 8908 - ❌ 8909 - ❌ 8910 - ❌ 8911 - ❌ 8912 8913 8914 .. list-table:: **test-windows11-64-24h2-shippable/opt** 8915 :widths: 30 15 15 15 15 8916 :header-rows: 1 8917 8918 * - **Test Name** 8919 - mozilla-central 8920 - autoland 8921 - mozilla-release 8922 - mozilla-beta 8923 * - **browsertime-firefox-youtube-playback-hfr** 8924 - ✅ 8925 - ❌ 8926 - ❌ 8927 - ❌ 8928 8929 8930 .. list-table:: **test-windows11-64-24h2/opt** 8931 :widths: 30 15 15 15 15 8932 :header-rows: 1 8933 8934 * - **Test Name** 8935 - mozilla-central 8936 - autoland 8937 - mozilla-release 8938 - mozilla-beta 8939 * - **browsertime-firefox-youtube-playback-hfr** 8940 - ❌ 8941 - ❌ 8942 - ❌ 8943 - ❌ 8944 8945 8946 8947 .. dropdown:: youtube-playback-v9-1080p30 8948 :class-container: anchor-id-youtube-playback-v9-1080p30-b 8949 8950 * Command to Run Locally 8951 8952 .. code-block:: 8953 8954 ./mach raptor -t youtube-playback-v9-1080p30 8955 8956 **Owner**: PerfTest Team 8957 8958 * **alert threshold**: 2.0 8959 * **apps**: firefox 8960 * **expected**: pass 8961 * **expose browser profiler**: true 8962 * **gather cpuTime**: true 8963 * **gecko profile interval**: 1000 8964 * **gecko profile threads**: MediaPlayback 8965 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/youtube-playback.toml#96>`__ 8966 * **lower is better**: true 8967 * **page cycles**: 20 8968 * **page timeout**: 2700000 8969 * **preferences**: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false 8970 * **subtest lower is better**: true 8971 * **subtest unit**: score 8972 * **test url**: `<https://prod.youtube-test.prod.webservices.mozgcp.net/main.html?test_type=playbackperf-sfr-vp9-test&raptor=true&tests=18&muted=true&command=run&exclude=1,2>`__ 8973 * **type**: benchmark 8974 * **unit**: score 8975 * **use live sites**: true 8976 * **Test Task**: 8977 8978 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 8979 :widths: 30 15 15 15 15 8980 :header-rows: 1 8981 8982 * - **Test Name** 8983 - mozilla-central 8984 - autoland 8985 - mozilla-release 8986 - mozilla-beta 8987 * - **browsertime-power-firefox-youtube-playback-v9-1080p30** 8988 - ❌ 8989 - ❌ 8990 - ❌ 8991 - ❌ 8992 8993 8994 .. list-table:: **test-linux1804-64-qr/opt** 8995 :widths: 30 15 15 15 15 8996 :header-rows: 1 8997 8998 * - **Test Name** 8999 - mozilla-central 9000 - autoland 9001 - mozilla-release 9002 - mozilla-beta 9003 * - **browsertime-power-firefox-youtube-playback-v9-1080p30** 9004 - ❌ 9005 - ❌ 9006 - ❌ 9007 - ❌ 9008 9009 9010 .. list-table:: **test-linux1804-64-shippable-qr/opt** 9011 :widths: 30 15 15 15 15 9012 :header-rows: 1 9013 9014 * - **Test Name** 9015 - mozilla-central 9016 - autoland 9017 - mozilla-release 9018 - mozilla-beta 9019 * - **browsertime-power-firefox-youtube-playback-v9-1080p30** 9020 - ❌ 9021 - ❌ 9022 - ❌ 9023 - ❌ 9024 9025 9026 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 9027 :widths: 30 15 15 15 15 9028 :header-rows: 1 9029 9030 * - **Test Name** 9031 - mozilla-central 9032 - autoland 9033 - mozilla-release 9034 - mozilla-beta 9035 * - **browsertime-power-firefox-youtube-playback-v9-1080p30** 9036 - ❌ 9037 - ❌ 9038 - ❌ 9039 - ❌ 9040 9041 9042 .. list-table:: **test-macosx1470-64-shippable/opt** 9043 :widths: 30 15 15 15 15 9044 :header-rows: 1 9045 9046 * - **Test Name** 9047 - mozilla-central 9048 - autoland 9049 - mozilla-release 9050 - mozilla-beta 9051 * - **browsertime-power-firefox-youtube-playback-v9-1080p30** 9052 - ✅ 9053 - ❌ 9054 - ❌ 9055 - ❌ 9056 9057 9058 .. list-table:: **test-macosx1470-64/opt** 9059 :widths: 30 15 15 15 15 9060 :header-rows: 1 9061 9062 * - **Test Name** 9063 - mozilla-central 9064 - autoland 9065 - mozilla-release 9066 - mozilla-beta 9067 * - **browsertime-power-firefox-youtube-playback-v9-1080p30** 9068 - ❌ 9069 - ❌ 9070 - ❌ 9071 - ❌ 9072 9073 9074 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 9075 :widths: 30 15 15 15 15 9076 :header-rows: 1 9077 9078 * - **Test Name** 9079 - mozilla-central 9080 - autoland 9081 - mozilla-release 9082 - mozilla-beta 9083 * - **browsertime-power-firefox-youtube-playback-v9-1080p30** 9084 - ❌ 9085 - ❌ 9086 - ❌ 9087 - ❌ 9088 9089 9090 .. list-table:: **test-windows11-64-24h2-shippable/opt** 9091 :widths: 30 15 15 15 15 9092 :header-rows: 1 9093 9094 * - **Test Name** 9095 - mozilla-central 9096 - autoland 9097 - mozilla-release 9098 - mozilla-beta 9099 * - **browsertime-power-firefox-youtube-playback-v9-1080p30** 9100 - ❌ 9101 - ❌ 9102 - ❌ 9103 - ❌ 9104 9105 9106 .. list-table:: **test-windows11-64-24h2/opt** 9107 :widths: 30 15 15 15 15 9108 :header-rows: 1 9109 9110 * - **Test Name** 9111 - mozilla-central 9112 - autoland 9113 - mozilla-release 9114 - mozilla-beta 9115 * - **browsertime-power-firefox-youtube-playback-v9-1080p30** 9116 - ❌ 9117 - ❌ 9118 - ❌ 9119 - ❌ 9120 9121 9122 9123 .. dropdown:: youtube-playback-v9-1080p60 9124 :class-container: anchor-id-youtube-playback-v9-1080p60-b 9125 9126 * Command to Run Locally 9127 9128 .. code-block:: 9129 9130 ./mach raptor -t youtube-playback-v9-1080p60 9131 9132 **Owner**: PerfTest Team 9133 9134 * **alert threshold**: 2.0 9135 * **apps**: firefox 9136 * **expected**: pass 9137 * **expose browser profiler**: true 9138 * **gather cpuTime**: true 9139 * **gecko profile interval**: 1000 9140 * **gecko profile threads**: MediaPlayback 9141 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/youtube-playback.toml#102>`__ 9142 * **lower is better**: true 9143 * **page cycles**: 20 9144 * **page timeout**: 2700000 9145 * **preferences**: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false 9146 * **subtest lower is better**: true 9147 * **subtest unit**: score 9148 * **test url**: `<https://prod.youtube-test.prod.webservices.mozgcp.net/main.html?test_type=playbackperf-hfr-test&raptor=true&tests=14&muted=true&command=run&exclude=1,2>`__ 9149 * **type**: benchmark 9150 * **unit**: score 9151 * **use live sites**: true 9152 * **Test Task**: 9153 9154 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 9155 :widths: 30 15 15 15 15 9156 :header-rows: 1 9157 9158 * - **Test Name** 9159 - mozilla-central 9160 - autoland 9161 - mozilla-release 9162 - mozilla-beta 9163 * - **browsertime-power-firefox-youtube-playback-v9-1080p60** 9164 - ❌ 9165 - ❌ 9166 - ❌ 9167 - ❌ 9168 9169 9170 .. list-table:: **test-linux1804-64-qr/opt** 9171 :widths: 30 15 15 15 15 9172 :header-rows: 1 9173 9174 * - **Test Name** 9175 - mozilla-central 9176 - autoland 9177 - mozilla-release 9178 - mozilla-beta 9179 * - **browsertime-power-firefox-youtube-playback-v9-1080p60** 9180 - ❌ 9181 - ❌ 9182 - ❌ 9183 - ❌ 9184 9185 9186 .. list-table:: **test-linux1804-64-shippable-qr/opt** 9187 :widths: 30 15 15 15 15 9188 :header-rows: 1 9189 9190 * - **Test Name** 9191 - mozilla-central 9192 - autoland 9193 - mozilla-release 9194 - mozilla-beta 9195 * - **browsertime-power-firefox-youtube-playback-v9-1080p60** 9196 - ❌ 9197 - ❌ 9198 - ❌ 9199 - ❌ 9200 9201 9202 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 9203 :widths: 30 15 15 15 15 9204 :header-rows: 1 9205 9206 * - **Test Name** 9207 - mozilla-central 9208 - autoland 9209 - mozilla-release 9210 - mozilla-beta 9211 * - **browsertime-power-firefox-youtube-playback-v9-1080p60** 9212 - ❌ 9213 - ❌ 9214 - ❌ 9215 - ❌ 9216 9217 9218 .. list-table:: **test-macosx1470-64-shippable/opt** 9219 :widths: 30 15 15 15 15 9220 :header-rows: 1 9221 9222 * - **Test Name** 9223 - mozilla-central 9224 - autoland 9225 - mozilla-release 9226 - mozilla-beta 9227 * - **browsertime-power-firefox-youtube-playback-v9-1080p60** 9228 - ✅ 9229 - ❌ 9230 - ❌ 9231 - ❌ 9232 9233 9234 .. list-table:: **test-macosx1470-64/opt** 9235 :widths: 30 15 15 15 15 9236 :header-rows: 1 9237 9238 * - **Test Name** 9239 - mozilla-central 9240 - autoland 9241 - mozilla-release 9242 - mozilla-beta 9243 * - **browsertime-power-firefox-youtube-playback-v9-1080p60** 9244 - ❌ 9245 - ❌ 9246 - ❌ 9247 - ❌ 9248 9249 9250 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 9251 :widths: 30 15 15 15 15 9252 :header-rows: 1 9253 9254 * - **Test Name** 9255 - mozilla-central 9256 - autoland 9257 - mozilla-release 9258 - mozilla-beta 9259 * - **browsertime-power-firefox-youtube-playback-v9-1080p60** 9260 - ❌ 9261 - ❌ 9262 - ❌ 9263 - ❌ 9264 9265 9266 .. list-table:: **test-windows11-64-24h2-shippable/opt** 9267 :widths: 30 15 15 15 15 9268 :header-rows: 1 9269 9270 * - **Test Name** 9271 - mozilla-central 9272 - autoland 9273 - mozilla-release 9274 - mozilla-beta 9275 * - **browsertime-power-firefox-youtube-playback-v9-1080p60** 9276 - ❌ 9277 - ❌ 9278 - ❌ 9279 - ❌ 9280 9281 9282 .. list-table:: **test-windows11-64-24h2/opt** 9283 :widths: 30 15 15 15 15 9284 :header-rows: 1 9285 9286 * - **Test Name** 9287 - mozilla-central 9288 - autoland 9289 - mozilla-release 9290 - mozilla-beta 9291 * - **browsertime-power-firefox-youtube-playback-v9-1080p60** 9292 - ❌ 9293 - ❌ 9294 - ❌ 9295 - ❌ 9296 9297 9298 9299 .. dropdown:: youtube-playback-v9-full-1080p30 9300 :class-container: anchor-id-youtube-playback-v9-full-1080p30-b 9301 9302 * Command to Run Locally 9303 9304 .. code-block:: 9305 9306 ./mach raptor -t youtube-playback-v9-full-1080p30 9307 9308 **Owner**: PerfTest Team 9309 9310 * **alert threshold**: 2.0 9311 * **apps**: firefox 9312 * **expected**: pass 9313 * **expose browser profiler**: true 9314 * **gather cpuTime**: true 9315 * **gecko profile interval**: 1000 9316 * **gecko profile threads**: MediaPlayback 9317 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/youtube-playback.toml#108>`__ 9318 * **lower is better**: true 9319 * **page cycles**: 20 9320 * **page timeout**: 2700000 9321 * **preferences**: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false full-screen-api.allow-trusted-requests-only=false full-screen-api.warning.timeout=0 9322 * **subtest lower is better**: true 9323 * **subtest unit**: score 9324 * **test url**: `<https://prod.youtube-test.prod.webservices.mozgcp.net/main.html?test_type=playbackperf-sfr-vp9-test&raptor=true&tests=18&muted=true&command=run&fullscreen=true&exclude=1,2>`__ 9325 * **type**: benchmark 9326 * **unit**: score 9327 * **use live sites**: true 9328 * **Test Task**: 9329 9330 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 9331 :widths: 30 15 15 15 15 9332 :header-rows: 1 9333 9334 * - **Test Name** 9335 - mozilla-central 9336 - autoland 9337 - mozilla-release 9338 - mozilla-beta 9339 * - **browsertime-power-firefox-youtube-playback-v9-full-1080p30** 9340 - ❌ 9341 - ❌ 9342 - ❌ 9343 - ❌ 9344 9345 9346 .. list-table:: **test-linux1804-64-qr/opt** 9347 :widths: 30 15 15 15 15 9348 :header-rows: 1 9349 9350 * - **Test Name** 9351 - mozilla-central 9352 - autoland 9353 - mozilla-release 9354 - mozilla-beta 9355 * - **browsertime-power-firefox-youtube-playback-v9-full-1080p30** 9356 - ❌ 9357 - ❌ 9358 - ❌ 9359 - ❌ 9360 9361 9362 .. list-table:: **test-linux1804-64-shippable-qr/opt** 9363 :widths: 30 15 15 15 15 9364 :header-rows: 1 9365 9366 * - **Test Name** 9367 - mozilla-central 9368 - autoland 9369 - mozilla-release 9370 - mozilla-beta 9371 * - **browsertime-power-firefox-youtube-playback-v9-full-1080p30** 9372 - ❌ 9373 - ❌ 9374 - ❌ 9375 - ❌ 9376 9377 9378 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 9379 :widths: 30 15 15 15 15 9380 :header-rows: 1 9381 9382 * - **Test Name** 9383 - mozilla-central 9384 - autoland 9385 - mozilla-release 9386 - mozilla-beta 9387 * - **browsertime-power-firefox-youtube-playback-v9-full-1080p30** 9388 - ❌ 9389 - ❌ 9390 - ❌ 9391 - ❌ 9392 9393 9394 .. list-table:: **test-macosx1470-64-shippable/opt** 9395 :widths: 30 15 15 15 15 9396 :header-rows: 1 9397 9398 * - **Test Name** 9399 - mozilla-central 9400 - autoland 9401 - mozilla-release 9402 - mozilla-beta 9403 * - **browsertime-power-firefox-youtube-playback-v9-full-1080p30** 9404 - ✅ 9405 - ❌ 9406 - ❌ 9407 - ❌ 9408 9409 9410 .. list-table:: **test-macosx1470-64/opt** 9411 :widths: 30 15 15 15 15 9412 :header-rows: 1 9413 9414 * - **Test Name** 9415 - mozilla-central 9416 - autoland 9417 - mozilla-release 9418 - mozilla-beta 9419 * - **browsertime-power-firefox-youtube-playback-v9-full-1080p30** 9420 - ❌ 9421 - ❌ 9422 - ❌ 9423 - ❌ 9424 9425 9426 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 9427 :widths: 30 15 15 15 15 9428 :header-rows: 1 9429 9430 * - **Test Name** 9431 - mozilla-central 9432 - autoland 9433 - mozilla-release 9434 - mozilla-beta 9435 * - **browsertime-power-firefox-youtube-playback-v9-full-1080p30** 9436 - ❌ 9437 - ❌ 9438 - ❌ 9439 - ❌ 9440 9441 9442 .. list-table:: **test-windows11-64-24h2-shippable/opt** 9443 :widths: 30 15 15 15 15 9444 :header-rows: 1 9445 9446 * - **Test Name** 9447 - mozilla-central 9448 - autoland 9449 - mozilla-release 9450 - mozilla-beta 9451 * - **browsertime-power-firefox-youtube-playback-v9-full-1080p30** 9452 - ❌ 9453 - ❌ 9454 - ❌ 9455 - ❌ 9456 9457 9458 .. list-table:: **test-windows11-64-24h2/opt** 9459 :widths: 30 15 15 15 15 9460 :header-rows: 1 9461 9462 * - **Test Name** 9463 - mozilla-central 9464 - autoland 9465 - mozilla-release 9466 - mozilla-beta 9467 * - **browsertime-power-firefox-youtube-playback-v9-full-1080p30** 9468 - ❌ 9469 - ❌ 9470 - ❌ 9471 - ❌ 9472 9473 9474 9475 .. dropdown:: youtube-playback-v9-full-1080p60 9476 :class-container: anchor-id-youtube-playback-v9-full-1080p60-b 9477 9478 * Command to Run Locally 9479 9480 .. code-block:: 9481 9482 ./mach raptor -t youtube-playback-v9-full-1080p60 9483 9484 **Owner**: PerfTest Team 9485 9486 * **alert threshold**: 2.0 9487 * **apps**: firefox 9488 * **expected**: pass 9489 * **expose browser profiler**: true 9490 * **gather cpuTime**: true 9491 * **gecko profile interval**: 1000 9492 * **gecko profile threads**: MediaPlayback 9493 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/youtube-playback.toml#123>`__ 9494 * **lower is better**: true 9495 * **page cycles**: 20 9496 * **page timeout**: 2700000 9497 * **preferences**: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false full-screen-api.allow-trusted-requests-only=false full-screen-api.warning.timeout=0 9498 * **subtest lower is better**: true 9499 * **subtest unit**: score 9500 * **test url**: `<https://prod.youtube-test.prod.webservices.mozgcp.net/main.html?test_type=playbackperf-hfr-test&raptor=true&tests=14&muted=true&command=run&fullscreen=true&exclude=1,2>`__ 9501 * **type**: benchmark 9502 * **unit**: score 9503 * **use live sites**: true 9504 * **Test Task**: 9505 9506 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 9507 :widths: 30 15 15 15 15 9508 :header-rows: 1 9509 9510 * - **Test Name** 9511 - mozilla-central 9512 - autoland 9513 - mozilla-release 9514 - mozilla-beta 9515 * - **browsertime-power-firefox-youtube-playback-v9-full-1080p60** 9516 - ❌ 9517 - ❌ 9518 - ❌ 9519 - ❌ 9520 9521 9522 .. list-table:: **test-linux1804-64-qr/opt** 9523 :widths: 30 15 15 15 15 9524 :header-rows: 1 9525 9526 * - **Test Name** 9527 - mozilla-central 9528 - autoland 9529 - mozilla-release 9530 - mozilla-beta 9531 * - **browsertime-power-firefox-youtube-playback-v9-full-1080p60** 9532 - ❌ 9533 - ❌ 9534 - ❌ 9535 - ❌ 9536 9537 9538 .. list-table:: **test-linux1804-64-shippable-qr/opt** 9539 :widths: 30 15 15 15 15 9540 :header-rows: 1 9541 9542 * - **Test Name** 9543 - mozilla-central 9544 - autoland 9545 - mozilla-release 9546 - mozilla-beta 9547 * - **browsertime-power-firefox-youtube-playback-v9-full-1080p60** 9548 - ❌ 9549 - ❌ 9550 - ❌ 9551 - ❌ 9552 9553 9554 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 9555 :widths: 30 15 15 15 15 9556 :header-rows: 1 9557 9558 * - **Test Name** 9559 - mozilla-central 9560 - autoland 9561 - mozilla-release 9562 - mozilla-beta 9563 * - **browsertime-power-firefox-youtube-playback-v9-full-1080p60** 9564 - ❌ 9565 - ❌ 9566 - ❌ 9567 - ❌ 9568 9569 9570 .. list-table:: **test-macosx1470-64-shippable/opt** 9571 :widths: 30 15 15 15 15 9572 :header-rows: 1 9573 9574 * - **Test Name** 9575 - mozilla-central 9576 - autoland 9577 - mozilla-release 9578 - mozilla-beta 9579 * - **browsertime-power-firefox-youtube-playback-v9-full-1080p60** 9580 - ✅ 9581 - ❌ 9582 - ❌ 9583 - ❌ 9584 9585 9586 .. list-table:: **test-macosx1470-64/opt** 9587 :widths: 30 15 15 15 15 9588 :header-rows: 1 9589 9590 * - **Test Name** 9591 - mozilla-central 9592 - autoland 9593 - mozilla-release 9594 - mozilla-beta 9595 * - **browsertime-power-firefox-youtube-playback-v9-full-1080p60** 9596 - ❌ 9597 - ❌ 9598 - ❌ 9599 - ❌ 9600 9601 9602 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 9603 :widths: 30 15 15 15 15 9604 :header-rows: 1 9605 9606 * - **Test Name** 9607 - mozilla-central 9608 - autoland 9609 - mozilla-release 9610 - mozilla-beta 9611 * - **browsertime-power-firefox-youtube-playback-v9-full-1080p60** 9612 - ❌ 9613 - ❌ 9614 - ❌ 9615 - ❌ 9616 9617 9618 .. list-table:: **test-windows11-64-24h2-shippable/opt** 9619 :widths: 30 15 15 15 15 9620 :header-rows: 1 9621 9622 * - **Test Name** 9623 - mozilla-central 9624 - autoland 9625 - mozilla-release 9626 - mozilla-beta 9627 * - **browsertime-power-firefox-youtube-playback-v9-full-1080p60** 9628 - ❌ 9629 - ❌ 9630 - ❌ 9631 - ❌ 9632 9633 9634 .. list-table:: **test-windows11-64-24h2/opt** 9635 :widths: 30 15 15 15 15 9636 :header-rows: 1 9637 9638 * - **Test Name** 9639 - mozilla-central 9640 - autoland 9641 - mozilla-release 9642 - mozilla-beta 9643 * - **browsertime-power-firefox-youtube-playback-v9-full-1080p60** 9644 - ❌ 9645 - ❌ 9646 - ❌ 9647 - ❌ 9648 9649 9650 9651 .. dropdown:: youtube-playback-vp9-720p60 9652 :class-container: anchor-id-youtube-playback-vp9-720p60-b 9653 9654 * Command to Run Locally 9655 9656 .. code-block:: 9657 9658 ./mach raptor -t youtube-playback-vp9-720p60 9659 9660 **Owner**: PerfTest Team 9661 9662 * **alert threshold**: 2.0 9663 * **apps**: firefox, chrome, geckoview, fenix, refbrow, chrome-m 9664 * **browsertime args**: --pageCompleteWaitTime=10 --pageCompleteCheckPollTimeout=10 --browsertime.benchmark_wait_time=500 9665 * **expected**: pass 9666 * **expose browser profiler**: true 9667 * **gecko profile interval**: 1000 9668 * **gecko profile threads**: MediaPlayback 9669 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/youtube-playback.toml#89>`__ 9670 * **lower is better**: true 9671 * **page cycles**: 20 9672 * **page timeout**: 2700000 9673 * **preferences**: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false 9674 * **subtest lower is better**: true 9675 * **subtest unit**: score 9676 * **support class**: browsertime_benchmark.py 9677 * **test url**: `<https://prod.youtube-test.prod.webservices.mozgcp.net/main.html?test_type=playbackperf-hfr-test&tests=6&raptor=true&exclude=1,2&muted=true&command=run>`__ 9678 * **type**: benchmark 9679 * **unit**: score 9680 * **use live sites**: true 9681 * **Test Task**: 9682 9683 .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** 9684 :widths: 30 15 15 15 15 9685 :header-rows: 1 9686 9687 * - **Test Name** 9688 - mozilla-central 9689 - autoland 9690 - mozilla-release 9691 - mozilla-beta 9692 * - **browsertime-power-mobile-chrome-m-youtube-playback-vp9-720p60-nofis** 9693 - ❌ 9694 - ❌ 9695 - ❌ 9696 - ❌ 9697 * - **browsertime-power-mobile-fenix-youtube-playback-vp9-720p60** 9698 - ✅ 9699 - ✅ 9700 - ❌ 9701 - ❌ 9702 * - **browsertime-power-mobile-fenix-youtube-playback-vp9-720p60-nofis** 9703 - ✅ 9704 - ✅ 9705 - ❌ 9706 - ❌ 9707 * - **browsertime-power-mobile-geckoview-youtube-playback-vp9-720p60** 9708 - ❌ 9709 - ❌ 9710 - ❌ 9711 - ❌ 9712 * - **browsertime-power-mobile-geckoview-youtube-playback-vp9-720p60-nofis** 9713 - ❌ 9714 - ❌ 9715 - ❌ 9716 - ❌ 9717 9718 9719 .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** 9720 :widths: 30 15 15 15 15 9721 :header-rows: 1 9722 9723 * - **Test Name** 9724 - mozilla-central 9725 - autoland 9726 - mozilla-release 9727 - mozilla-beta 9728 * - **browsertime-power-mobile-fenix-youtube-playback-vp9-720p60** 9729 - ❌ 9730 - ❌ 9731 - ❌ 9732 - ❌ 9733 * - **browsertime-power-mobile-fenix-youtube-playback-vp9-720p60-nofis** 9734 - ❌ 9735 - ❌ 9736 - ❌ 9737 - ❌ 9738 * - **browsertime-power-mobile-geckoview-youtube-playback-vp9-720p60** 9739 - ❌ 9740 - ❌ 9741 - ❌ 9742 - ❌ 9743 * - **browsertime-power-mobile-geckoview-youtube-playback-vp9-720p60-nofis** 9744 - ❌ 9745 - ❌ 9746 - ❌ 9747 - ❌ 9748 9749 9750 .. list-table:: **test-android-hw-p6-13-0-aarch64-shippable/opt** 9751 :widths: 30 15 15 15 15 9752 :header-rows: 1 9753 9754 * - **Test Name** 9755 - mozilla-central 9756 - autoland 9757 - mozilla-release 9758 - mozilla-beta 9759 * - **browsertime-power-mobile-chrome-m-youtube-playback-vp9-720p60-nofis** 9760 - ❌ 9761 - ❌ 9762 - ❌ 9763 - ❌ 9764 * - **browsertime-power-mobile-fenix-youtube-playback-vp9-720p60** 9765 - ❌ 9766 - ❌ 9767 - ❌ 9768 - ❌ 9769 * - **browsertime-power-mobile-fenix-youtube-playback-vp9-720p60-nofis** 9770 - ❌ 9771 - ❌ 9772 - ❌ 9773 - ❌ 9774 * - **browsertime-power-mobile-geckoview-youtube-playback-vp9-720p60** 9775 - ❌ 9776 - ❌ 9777 - ❌ 9778 - ❌ 9779 * - **browsertime-power-mobile-geckoview-youtube-playback-vp9-720p60-nofis** 9780 - ❌ 9781 - ❌ 9782 - ❌ 9783 - ❌ 9784 9785 9786 .. list-table:: **test-android-hw-s24-14-0-aarch64-shippable/opt** 9787 :widths: 30 15 15 15 15 9788 :header-rows: 1 9789 9790 * - **Test Name** 9791 - mozilla-central 9792 - autoland 9793 - mozilla-release 9794 - mozilla-beta 9795 * - **browsertime-power-mobile-chrome-m-youtube-playback-vp9-720p60-nofis** 9796 - ❌ 9797 - ❌ 9798 - ❌ 9799 - ❌ 9800 * - **browsertime-power-mobile-fenix-youtube-playback-vp9-720p60** 9801 - ❌ 9802 - ❌ 9803 - ❌ 9804 - ❌ 9805 * - **browsertime-power-mobile-fenix-youtube-playback-vp9-720p60-nofis** 9806 - ❌ 9807 - ❌ 9808 - ❌ 9809 - ❌ 9810 * - **browsertime-power-mobile-geckoview-youtube-playback-vp9-720p60** 9811 - ❌ 9812 - ❌ 9813 - ❌ 9814 - ❌ 9815 * - **browsertime-power-mobile-geckoview-youtube-playback-vp9-720p60-nofis** 9816 - ❌ 9817 - ❌ 9818 - ❌ 9819 - ❌ 9820 9821 9822 9823 .. dropdown:: youtube-playback-vp9-sfr 9824 :class-container: anchor-id-youtube-playback-vp9-sfr-b 9825 9826 * Command to Run Locally 9827 9828 .. code-block:: 9829 9830 ./mach raptor -t youtube-playback-vp9-sfr 9831 9832 **Owner**: PerfTest Team 9833 9834 * **alert threshold**: 2.0 9835 * **apps**: firefox, geckoview, fenix, refbrow, chrome 9836 * **expected**: pass 9837 * **expose browser profiler**: true 9838 * **gecko profile interval**: 1000 9839 * **gecko profile threads**: MediaPlayback 9840 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/youtube-playback.toml#138>`__ 9841 * **lower is better**: true 9842 * **page cycles**: 1 9843 * **page timeout**: 2700000 9844 * **preferences**: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false 9845 * **subtest lower is better**: true 9846 * **subtest unit**: score 9847 * **test url**: `<https://prod.youtube-test.prod.webservices.mozgcp.net/main.html?test_type=playbackperf-sfr-vp9-test&raptor=true&exclude=1,2&muted=true&command=run>`__ 9848 * **type**: benchmark 9849 * **unit**: score 9850 * **use live sites**: true 9851 * **Test Task**: 9852 9853 .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** 9854 :widths: 30 15 15 15 15 9855 :header-rows: 1 9856 9857 * - **Test Name** 9858 - mozilla-central 9859 - autoland 9860 - mozilla-release 9861 - mozilla-beta 9862 * - **browsertime-mobile-fenix-youtube-playback-vp9-sfr** 9863 - ✅ 9864 - ❌ 9865 - ❌ 9866 - ❌ 9867 * - **browsertime-mobile-fenix-youtube-playback-vp9-sfr-nofis** 9868 - ✅ 9869 - ❌ 9870 - ❌ 9871 - ❌ 9872 9873 9874 .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** 9875 :widths: 30 15 15 15 15 9876 :header-rows: 1 9877 9878 * - **Test Name** 9879 - mozilla-central 9880 - autoland 9881 - mozilla-release 9882 - mozilla-beta 9883 * - **browsertime-mobile-fenix-youtube-playback-vp9-sfr** 9884 - ❌ 9885 - ❌ 9886 - ❌ 9887 - ❌ 9888 * - **browsertime-mobile-fenix-youtube-playback-vp9-sfr-nofis** 9889 - ❌ 9890 - ❌ 9891 - ❌ 9892 - ❌ 9893 9894 9895 .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** 9896 :widths: 30 15 15 15 15 9897 :header-rows: 1 9898 9899 * - **Test Name** 9900 - mozilla-central 9901 - autoland 9902 - mozilla-release 9903 - mozilla-beta 9904 * - **browsertime-firefox-youtube-playback-vp9-sfr** 9905 - ❌ 9906 - ❌ 9907 - ❌ 9908 - ❌ 9909 9910 9911 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 9912 :widths: 30 15 15 15 15 9913 :header-rows: 1 9914 9915 * - **Test Name** 9916 - mozilla-central 9917 - autoland 9918 - mozilla-release 9919 - mozilla-beta 9920 * - **browsertime-firefox-youtube-playback-vp9-sfr** 9921 - ❌ 9922 - ❌ 9923 - ❌ 9924 - ❌ 9925 9926 9927 .. list-table:: **test-linux1804-64-qr/opt** 9928 :widths: 30 15 15 15 15 9929 :header-rows: 1 9930 9931 * - **Test Name** 9932 - mozilla-central 9933 - autoland 9934 - mozilla-release 9935 - mozilla-beta 9936 * - **browsertime-firefox-youtube-playback-vp9-sfr** 9937 - ❌ 9938 - ❌ 9939 - ❌ 9940 - ❌ 9941 9942 9943 .. list-table:: **test-linux1804-64-shippable-qr/opt** 9944 :widths: 30 15 15 15 15 9945 :header-rows: 1 9946 9947 * - **Test Name** 9948 - mozilla-central 9949 - autoland 9950 - mozilla-release 9951 - mozilla-beta 9952 * - **browsertime-firefox-youtube-playback-vp9-sfr** 9953 - ✅ 9954 - ❌ 9955 - ❌ 9956 - ❌ 9957 9958 9959 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 9960 :widths: 30 15 15 15 15 9961 :header-rows: 1 9962 9963 * - **Test Name** 9964 - mozilla-central 9965 - autoland 9966 - mozilla-release 9967 - mozilla-beta 9968 * - **browsertime-firefox-youtube-playback-vp9-sfr** 9969 - ❌ 9970 - ❌ 9971 - ❌ 9972 - ❌ 9973 9974 9975 .. list-table:: **test-macosx1470-64-shippable/opt** 9976 :widths: 30 15 15 15 15 9977 :header-rows: 1 9978 9979 * - **Test Name** 9980 - mozilla-central 9981 - autoland 9982 - mozilla-release 9983 - mozilla-beta 9984 * - **browsertime-firefox-youtube-playback-vp9-sfr** 9985 - ✅ 9986 - ❌ 9987 - ❌ 9988 - ❌ 9989 9990 9991 .. list-table:: **test-macosx1470-64/opt** 9992 :widths: 30 15 15 15 15 9993 :header-rows: 1 9994 9995 * - **Test Name** 9996 - mozilla-central 9997 - autoland 9998 - mozilla-release 9999 - mozilla-beta 10000 * - **browsertime-firefox-youtube-playback-vp9-sfr** 10001 - ❌ 10002 - ❌ 10003 - ❌ 10004 - ❌ 10005 10006 10007 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 10008 :widths: 30 15 15 15 15 10009 :header-rows: 1 10010 10011 * - **Test Name** 10012 - mozilla-central 10013 - autoland 10014 - mozilla-release 10015 - mozilla-beta 10016 * - **browsertime-firefox-youtube-playback-vp9-sfr** 10017 - ❌ 10018 - ❌ 10019 - ❌ 10020 - ❌ 10021 10022 10023 .. list-table:: **test-windows11-64-24h2-shippable/opt** 10024 :widths: 30 15 15 15 15 10025 :header-rows: 1 10026 10027 * - **Test Name** 10028 - mozilla-central 10029 - autoland 10030 - mozilla-release 10031 - mozilla-beta 10032 * - **browsertime-firefox-youtube-playback-vp9-sfr** 10033 - ✅ 10034 - ❌ 10035 - ❌ 10036 - ❌ 10037 10038 10039 .. list-table:: **test-windows11-64-24h2/opt** 10040 :widths: 30 15 15 15 15 10041 :header-rows: 1 10042 10043 * - **Test Name** 10044 - mozilla-central 10045 - autoland 10046 - mozilla-release 10047 - mozilla-beta 10048 * - **browsertime-firefox-youtube-playback-vp9-sfr** 10049 - ❌ 10050 - ❌ 10051 - ❌ 10052 - ❌ 10053 10054 10055 10056 .. dropdown:: youtube-playback-widevine-h264-sfr 10057 :class-container: anchor-id-youtube-playback-widevine-h264-sfr-b 10058 10059 * Command to Run Locally 10060 10061 .. code-block:: 10062 10063 ./mach raptor -t youtube-playback-widevine-h264-sfr 10064 10065 **Owner**: PerfTest Team 10066 10067 * **alert threshold**: 2.0 10068 * **apps**: firefox, geckoview, fenix, refbrow, chrome 10069 * **expected**: pass 10070 * **expose browser profiler**: true 10071 * **gecko profile interval**: 1000 10072 * **gecko profile threads**: MediaPlayback 10073 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/youtube-playback.toml#142>`__ 10074 * **lower is better**: true 10075 * **page cycles**: 1 10076 * **page timeout**: 2700000 10077 * **preferences**: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false media.eme.enabled=true media.gmp-manager.updateEnabled=true media.eme.require-app-approval=false 10078 * **subtest lower is better**: true 10079 * **subtest unit**: score 10080 * **test url**: `<https://prod.youtube-test.prod.webservices.mozgcp.net/main.html?test_type=playbackperf-widevine-sfr-h264-test&raptor=true&exclude=1,2&muted=true&command=run>`__ 10081 * **type**: benchmark 10082 * **unit**: score 10083 * **use live sites**: true 10084 * **Test Task**: 10085 10086 .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** 10087 :widths: 30 15 15 15 15 10088 :header-rows: 1 10089 10090 * - **Test Name** 10091 - mozilla-central 10092 - autoland 10093 - mozilla-release 10094 - mozilla-beta 10095 * - **browsertime-firefox-youtube-playback-widevine-h264-sfr** 10096 - ❌ 10097 - ❌ 10098 - ❌ 10099 - ❌ 10100 10101 10102 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 10103 :widths: 30 15 15 15 15 10104 :header-rows: 1 10105 10106 * - **Test Name** 10107 - mozilla-central 10108 - autoland 10109 - mozilla-release 10110 - mozilla-beta 10111 * - **browsertime-firefox-youtube-playback-widevine-h264-sfr** 10112 - ❌ 10113 - ❌ 10114 - ❌ 10115 - ❌ 10116 10117 10118 .. list-table:: **test-linux1804-64-qr/opt** 10119 :widths: 30 15 15 15 15 10120 :header-rows: 1 10121 10122 * - **Test Name** 10123 - mozilla-central 10124 - autoland 10125 - mozilla-release 10126 - mozilla-beta 10127 * - **browsertime-firefox-youtube-playback-widevine-h264-sfr** 10128 - ❌ 10129 - ❌ 10130 - ❌ 10131 - ❌ 10132 10133 10134 .. list-table:: **test-linux1804-64-shippable-qr/opt** 10135 :widths: 30 15 15 15 15 10136 :header-rows: 1 10137 10138 * - **Test Name** 10139 - mozilla-central 10140 - autoland 10141 - mozilla-release 10142 - mozilla-beta 10143 * - **browsertime-firefox-youtube-playback-widevine-h264-sfr** 10144 - ✅ 10145 - ❌ 10146 - ❌ 10147 - ❌ 10148 10149 10150 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 10151 :widths: 30 15 15 15 15 10152 :header-rows: 1 10153 10154 * - **Test Name** 10155 - mozilla-central 10156 - autoland 10157 - mozilla-release 10158 - mozilla-beta 10159 * - **browsertime-firefox-youtube-playback-widevine-h264-sfr** 10160 - ❌ 10161 - ❌ 10162 - ❌ 10163 - ❌ 10164 10165 10166 .. list-table:: **test-macosx1470-64-shippable/opt** 10167 :widths: 30 15 15 15 15 10168 :header-rows: 1 10169 10170 * - **Test Name** 10171 - mozilla-central 10172 - autoland 10173 - mozilla-release 10174 - mozilla-beta 10175 * - **browsertime-firefox-youtube-playback-widevine-h264-sfr** 10176 - ✅ 10177 - ❌ 10178 - ❌ 10179 - ❌ 10180 10181 10182 .. list-table:: **test-macosx1470-64/opt** 10183 :widths: 30 15 15 15 15 10184 :header-rows: 1 10185 10186 * - **Test Name** 10187 - mozilla-central 10188 - autoland 10189 - mozilla-release 10190 - mozilla-beta 10191 * - **browsertime-firefox-youtube-playback-widevine-h264-sfr** 10192 - ❌ 10193 - ❌ 10194 - ❌ 10195 - ❌ 10196 10197 10198 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 10199 :widths: 30 15 15 15 15 10200 :header-rows: 1 10201 10202 * - **Test Name** 10203 - mozilla-central 10204 - autoland 10205 - mozilla-release 10206 - mozilla-beta 10207 * - **browsertime-firefox-youtube-playback-widevine-h264-sfr** 10208 - ❌ 10209 - ❌ 10210 - ❌ 10211 - ❌ 10212 10213 10214 .. list-table:: **test-windows11-64-24h2-shippable/opt** 10215 :widths: 30 15 15 15 15 10216 :header-rows: 1 10217 10218 * - **Test Name** 10219 - mozilla-central 10220 - autoland 10221 - mozilla-release 10222 - mozilla-beta 10223 * - **browsertime-firefox-youtube-playback-widevine-h264-sfr** 10224 - ✅ 10225 - ❌ 10226 - ❌ 10227 - ❌ 10228 10229 10230 .. list-table:: **test-windows11-64-24h2/opt** 10231 :widths: 30 15 15 15 15 10232 :header-rows: 1 10233 10234 * - **Test Name** 10235 - mozilla-central 10236 - autoland 10237 - mozilla-release 10238 - mozilla-beta 10239 * - **browsertime-firefox-youtube-playback-widevine-h264-sfr** 10240 - ❌ 10241 - ❌ 10242 - ❌ 10243 - ❌ 10244 10245 10246 10247 .. dropdown:: youtube-playback-widevine-hfr 10248 :class-container: anchor-id-youtube-playback-widevine-hfr-b 10249 10250 * Command to Run Locally 10251 10252 .. code-block:: 10253 10254 ./mach raptor -t youtube-playback-widevine-hfr 10255 10256 **Owner**: PerfTest Team 10257 10258 * **alert threshold**: 2.0 10259 * **apps**: firefox, geckoview, fenix, refbrow, chrome 10260 * **expected**: pass 10261 * **expose browser profiler**: true 10262 * **gecko profile interval**: 1000 10263 * **gecko profile threads**: MediaPlayback 10264 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/youtube-playback.toml#156>`__ 10265 * **lower is better**: true 10266 * **page cycles**: 1 10267 * **page timeout**: 2700000 10268 * **preferences**: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false media.eme.enabled=true media.gmp-manager.updateEnabled=true media.eme.require-app-approval=false 10269 * **subtest lower is better**: true 10270 * **subtest unit**: score 10271 * **test url**: `<https://prod.youtube-test.prod.webservices.mozgcp.net/main.html?test_type=playbackperf-widevine-hfr-test&raptor=true&exclude=1,2&muted=true&command=run>`__ 10272 * **type**: benchmark 10273 * **unit**: score 10274 * **use live sites**: true 10275 * **Test Task**: 10276 10277 .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** 10278 :widths: 30 15 15 15 15 10279 :header-rows: 1 10280 10281 * - **Test Name** 10282 - mozilla-central 10283 - autoland 10284 - mozilla-release 10285 - mozilla-beta 10286 * - **browsertime-firefox-youtube-playback-widevine-hfr** 10287 - ❌ 10288 - ❌ 10289 - ❌ 10290 - ❌ 10291 10292 10293 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 10294 :widths: 30 15 15 15 15 10295 :header-rows: 1 10296 10297 * - **Test Name** 10298 - mozilla-central 10299 - autoland 10300 - mozilla-release 10301 - mozilla-beta 10302 * - **browsertime-firefox-youtube-playback-widevine-hfr** 10303 - ❌ 10304 - ❌ 10305 - ❌ 10306 - ❌ 10307 10308 10309 .. list-table:: **test-linux1804-64-qr/opt** 10310 :widths: 30 15 15 15 15 10311 :header-rows: 1 10312 10313 * - **Test Name** 10314 - mozilla-central 10315 - autoland 10316 - mozilla-release 10317 - mozilla-beta 10318 * - **browsertime-firefox-youtube-playback-widevine-hfr** 10319 - ❌ 10320 - ❌ 10321 - ❌ 10322 - ❌ 10323 10324 10325 .. list-table:: **test-linux1804-64-shippable-qr/opt** 10326 :widths: 30 15 15 15 15 10327 :header-rows: 1 10328 10329 * - **Test Name** 10330 - mozilla-central 10331 - autoland 10332 - mozilla-release 10333 - mozilla-beta 10334 * - **browsertime-firefox-youtube-playback-widevine-hfr** 10335 - ✅ 10336 - ❌ 10337 - ❌ 10338 - ❌ 10339 10340 10341 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 10342 :widths: 30 15 15 15 15 10343 :header-rows: 1 10344 10345 * - **Test Name** 10346 - mozilla-central 10347 - autoland 10348 - mozilla-release 10349 - mozilla-beta 10350 * - **browsertime-firefox-youtube-playback-widevine-hfr** 10351 - ❌ 10352 - ❌ 10353 - ❌ 10354 - ❌ 10355 10356 10357 .. list-table:: **test-macosx1470-64-shippable/opt** 10358 :widths: 30 15 15 15 15 10359 :header-rows: 1 10360 10361 * - **Test Name** 10362 - mozilla-central 10363 - autoland 10364 - mozilla-release 10365 - mozilla-beta 10366 * - **browsertime-firefox-youtube-playback-widevine-hfr** 10367 - ✅ 10368 - ❌ 10369 - ❌ 10370 - ❌ 10371 10372 10373 .. list-table:: **test-macosx1470-64/opt** 10374 :widths: 30 15 15 15 15 10375 :header-rows: 1 10376 10377 * - **Test Name** 10378 - mozilla-central 10379 - autoland 10380 - mozilla-release 10381 - mozilla-beta 10382 * - **browsertime-firefox-youtube-playback-widevine-hfr** 10383 - ❌ 10384 - ❌ 10385 - ❌ 10386 - ❌ 10387 10388 10389 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 10390 :widths: 30 15 15 15 15 10391 :header-rows: 1 10392 10393 * - **Test Name** 10394 - mozilla-central 10395 - autoland 10396 - mozilla-release 10397 - mozilla-beta 10398 * - **browsertime-firefox-youtube-playback-widevine-hfr** 10399 - ❌ 10400 - ❌ 10401 - ❌ 10402 - ❌ 10403 10404 10405 .. list-table:: **test-windows11-64-24h2-shippable/opt** 10406 :widths: 30 15 15 15 15 10407 :header-rows: 1 10408 10409 * - **Test Name** 10410 - mozilla-central 10411 - autoland 10412 - mozilla-release 10413 - mozilla-beta 10414 * - **browsertime-firefox-youtube-playback-widevine-hfr** 10415 - ✅ 10416 - ❌ 10417 - ❌ 10418 - ❌ 10419 10420 10421 .. list-table:: **test-windows11-64-24h2/opt** 10422 :widths: 30 15 15 15 15 10423 :header-rows: 1 10424 10425 * - **Test Name** 10426 - mozilla-central 10427 - autoland 10428 - mozilla-release 10429 - mozilla-beta 10430 * - **browsertime-firefox-youtube-playback-widevine-hfr** 10431 - ❌ 10432 - ❌ 10433 - ❌ 10434 - ❌ 10435 10436 10437 10438 .. dropdown:: youtube-playback-widevine-vp9-sfr 10439 :class-container: anchor-id-youtube-playback-widevine-vp9-sfr-b 10440 10441 * Command to Run Locally 10442 10443 .. code-block:: 10444 10445 ./mach raptor -t youtube-playback-widevine-vp9-sfr 10446 10447 **Owner**: PerfTest Team 10448 10449 * **alert threshold**: 2.0 10450 * **apps**: firefox, geckoview, fenix, refbrow, chrome 10451 * **expected**: pass 10452 * **expose browser profiler**: true 10453 * **gecko profile interval**: 1000 10454 * **gecko profile threads**: MediaPlayback 10455 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/benchmarks/youtube-playback.toml#170>`__ 10456 * **lower is better**: true 10457 * **page cycles**: 1 10458 * **page timeout**: 2700000 10459 * **preferences**: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false media.eme.enabled=true media.gmp-manager.updateEnabled=true media.eme.require-app-approval=false 10460 * **subtest lower is better**: true 10461 * **subtest unit**: score 10462 * **test url**: `<https://prod.youtube-test.prod.webservices.mozgcp.net/main.html?test_type=playbackperf-widevine-sfr-vp9-test&raptor=true&exclude=1,2&muted=true&command=run>`__ 10463 * **type**: benchmark 10464 * **unit**: score 10465 * **use live sites**: true 10466 * **Test Task**: 10467 10468 .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** 10469 :widths: 30 15 15 15 15 10470 :header-rows: 1 10471 10472 * - **Test Name** 10473 - mozilla-central 10474 - autoland 10475 - mozilla-release 10476 - mozilla-beta 10477 * - **browsertime-firefox-youtube-playback-widevine-vp9-sfr** 10478 - ❌ 10479 - ❌ 10480 - ❌ 10481 - ❌ 10482 10483 10484 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 10485 :widths: 30 15 15 15 15 10486 :header-rows: 1 10487 10488 * - **Test Name** 10489 - mozilla-central 10490 - autoland 10491 - mozilla-release 10492 - mozilla-beta 10493 * - **browsertime-firefox-youtube-playback-widevine-vp9-sfr** 10494 - ❌ 10495 - ❌ 10496 - ❌ 10497 - ❌ 10498 10499 10500 .. list-table:: **test-linux1804-64-qr/opt** 10501 :widths: 30 15 15 15 15 10502 :header-rows: 1 10503 10504 * - **Test Name** 10505 - mozilla-central 10506 - autoland 10507 - mozilla-release 10508 - mozilla-beta 10509 * - **browsertime-firefox-youtube-playback-widevine-vp9-sfr** 10510 - ❌ 10511 - ❌ 10512 - ❌ 10513 - ❌ 10514 10515 10516 .. list-table:: **test-linux1804-64-shippable-qr/opt** 10517 :widths: 30 15 15 15 15 10518 :header-rows: 1 10519 10520 * - **Test Name** 10521 - mozilla-central 10522 - autoland 10523 - mozilla-release 10524 - mozilla-beta 10525 * - **browsertime-firefox-youtube-playback-widevine-vp9-sfr** 10526 - ✅ 10527 - ❌ 10528 - ❌ 10529 - ❌ 10530 10531 10532 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 10533 :widths: 30 15 15 15 15 10534 :header-rows: 1 10535 10536 * - **Test Name** 10537 - mozilla-central 10538 - autoland 10539 - mozilla-release 10540 - mozilla-beta 10541 * - **browsertime-firefox-youtube-playback-widevine-vp9-sfr** 10542 - ❌ 10543 - ❌ 10544 - ❌ 10545 - ❌ 10546 10547 10548 .. list-table:: **test-macosx1470-64-shippable/opt** 10549 :widths: 30 15 15 15 15 10550 :header-rows: 1 10551 10552 * - **Test Name** 10553 - mozilla-central 10554 - autoland 10555 - mozilla-release 10556 - mozilla-beta 10557 * - **browsertime-firefox-youtube-playback-widevine-vp9-sfr** 10558 - ✅ 10559 - ❌ 10560 - ❌ 10561 - ❌ 10562 10563 10564 .. list-table:: **test-macosx1470-64/opt** 10565 :widths: 30 15 15 15 15 10566 :header-rows: 1 10567 10568 * - **Test Name** 10569 - mozilla-central 10570 - autoland 10571 - mozilla-release 10572 - mozilla-beta 10573 * - **browsertime-firefox-youtube-playback-widevine-vp9-sfr** 10574 - ❌ 10575 - ❌ 10576 - ❌ 10577 - ❌ 10578 10579 10580 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 10581 :widths: 30 15 15 15 15 10582 :header-rows: 1 10583 10584 * - **Test Name** 10585 - mozilla-central 10586 - autoland 10587 - mozilla-release 10588 - mozilla-beta 10589 * - **browsertime-firefox-youtube-playback-widevine-vp9-sfr** 10590 - ❌ 10591 - ❌ 10592 - ❌ 10593 - ❌ 10594 10595 10596 .. list-table:: **test-windows11-64-24h2-shippable/opt** 10597 :widths: 30 15 15 15 15 10598 :header-rows: 1 10599 10600 * - **Test Name** 10601 - mozilla-central 10602 - autoland 10603 - mozilla-release 10604 - mozilla-beta 10605 * - **browsertime-firefox-youtube-playback-widevine-vp9-sfr** 10606 - ✅ 10607 - ❌ 10608 - ❌ 10609 - ❌ 10610 10611 10612 .. list-table:: **test-windows11-64-24h2/opt** 10613 :widths: 30 15 15 15 15 10614 :header-rows: 1 10615 10616 * - **Test Name** 10617 - mozilla-central 10618 - autoland 10619 - mozilla-release 10620 - mozilla-beta 10621 * - **browsertime-firefox-youtube-playback-widevine-vp9-sfr** 10622 - ❌ 10623 - ❌ 10624 - ❌ 10625 - ❌ 10626 10627 10628 10629 10630 Custom 10631 ------ 10632 Browsertime tests that use a custom pageload test script. These use the pageload type, but may have other intentions. 10633 10634 .. dropdown:: addMab1 10635 :class-container: anchor-id-addMab1-c 10636 10637 * Command to Run Locally 10638 10639 .. code-block:: 10640 10641 ./mach raptor -t addMab1 10642 10643 **Owner**: DOM Lifecycle, Workers and Storage Team 10644 10645 **Description**: Use add API to send many small ArrayBuffers to IndexedDB in one transaction 10646 10647 * **alert threshold**: 2.0 10648 * **apps**: firefox, chrome, safari 10649 * **browser cycles**: 1 10650 * **browsertime args**: --browsertime.iterations=16384 --browsertime.chunk_size=1024 --browsertime.buffer_type=ArrayBuffer --browsertime.atomic=1 10651 * **custom data**: true 10652 * **expected**: pass 10653 * **gecko profile entries**: 131072000 10654 * **gecko profile features**: js,stackwalk,cpu,memory 10655 * **gecko profile threads**: GeckoMain,DOM Worker,IndexedDB 10656 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-indexeddb.toml#50>`__ 10657 * **lower is better**: true 10658 * **measure**: cpuTime 10659 * **output timeout**: 2000000 10660 * **page cycles**: 1 10661 * **page timeout**: 1800000 10662 * **playback**: mitmproxy 10663 * **playback pageset manifest**: mitm8-linux-firefox-example.manifest 10664 * **subtest unit**: ms 10665 * **test script**: indexeddb_write.js 10666 * **test summary**: flatten 10667 * **test url**: `<https://www.example.com>`__ 10668 * **type**: pageload 10669 * **unit**: ms 10670 * **use live sites**: false 10671 * **Test Task**: 10672 10673 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 10674 :widths: 30 15 15 15 15 10675 :header-rows: 1 10676 10677 * - **Test Name** 10678 - mozilla-central 10679 - autoland 10680 - mozilla-release 10681 - mozilla-beta 10682 * - **browsertime-indexeddb-firefox-addMab1** 10683 - ❌ 10684 - ❌ 10685 - ❌ 10686 - ❌ 10687 10688 10689 .. list-table:: **test-linux1804-64-qr/opt** 10690 :widths: 30 15 15 15 15 10691 :header-rows: 1 10692 10693 * - **Test Name** 10694 - mozilla-central 10695 - autoland 10696 - mozilla-release 10697 - mozilla-beta 10698 * - **browsertime-indexeddb-firefox-addMab1** 10699 - ❌ 10700 - ❌ 10701 - ❌ 10702 - ❌ 10703 10704 10705 .. list-table:: **test-linux1804-64-shippable-qr/opt** 10706 :widths: 30 15 15 15 15 10707 :header-rows: 1 10708 10709 * - **Test Name** 10710 - mozilla-central 10711 - autoland 10712 - mozilla-release 10713 - mozilla-beta 10714 * - **browsertime-indexeddb-chrome-addMab1** 10715 - ❌ 10716 - ❌ 10717 - ❌ 10718 - ❌ 10719 * - **browsertime-indexeddb-firefox-addMab1** 10720 - ✅ 10721 - ✅ 10722 - ❌ 10723 - ❌ 10724 10725 10726 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 10727 :widths: 30 15 15 15 15 10728 :header-rows: 1 10729 10730 * - **Test Name** 10731 - mozilla-central 10732 - autoland 10733 - mozilla-release 10734 - mozilla-beta 10735 * - **browsertime-indexeddb-firefox-addMab1** 10736 - ❌ 10737 - ❌ 10738 - ❌ 10739 - ❌ 10740 10741 10742 .. list-table:: **test-macosx1470-64-shippable/opt** 10743 :widths: 30 15 15 15 15 10744 :header-rows: 1 10745 10746 * - **Test Name** 10747 - mozilla-central 10748 - autoland 10749 - mozilla-release 10750 - mozilla-beta 10751 * - **browsertime-indexeddb-chrome-addMab1** 10752 - ❌ 10753 - ❌ 10754 - ❌ 10755 - ❌ 10756 * - **browsertime-indexeddb-firefox-addMab1** 10757 - ✅ 10758 - ✅ 10759 - ❌ 10760 - ❌ 10761 10762 10763 .. list-table:: **test-macosx1470-64/opt** 10764 :widths: 30 15 15 15 15 10765 :header-rows: 1 10766 10767 * - **Test Name** 10768 - mozilla-central 10769 - autoland 10770 - mozilla-release 10771 - mozilla-beta 10772 * - **browsertime-indexeddb-firefox-addMab1** 10773 - ❌ 10774 - ❌ 10775 - ❌ 10776 - ❌ 10777 10778 10779 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 10780 :widths: 30 15 15 15 15 10781 :header-rows: 1 10782 10783 * - **Test Name** 10784 - mozilla-central 10785 - autoland 10786 - mozilla-release 10787 - mozilla-beta 10788 * - **browsertime-indexeddb-firefox-addMab1** 10789 - ❌ 10790 - ❌ 10791 - ❌ 10792 - ❌ 10793 10794 10795 .. list-table:: **test-windows11-64-24h2-shippable/opt** 10796 :widths: 30 15 15 15 15 10797 :header-rows: 1 10798 10799 * - **Test Name** 10800 - mozilla-central 10801 - autoland 10802 - mozilla-release 10803 - mozilla-beta 10804 * - **browsertime-indexeddb-chrome-addMab1** 10805 - ❌ 10806 - ❌ 10807 - ❌ 10808 - ❌ 10809 * - **browsertime-indexeddb-firefox-addMab1** 10810 - ✅ 10811 - ✅ 10812 - ❌ 10813 - ❌ 10814 10815 10816 .. list-table:: **test-windows11-64-24h2/opt** 10817 :widths: 30 15 15 15 15 10818 :header-rows: 1 10819 10820 * - **Test Name** 10821 - mozilla-central 10822 - autoland 10823 - mozilla-release 10824 - mozilla-beta 10825 * - **browsertime-indexeddb-firefox-addMab1** 10826 - ❌ 10827 - ❌ 10828 - ❌ 10829 - ❌ 10830 10831 10832 10833 .. dropdown:: addMabN 10834 :class-container: anchor-id-addMabN-c 10835 10836 * Command to Run Locally 10837 10838 .. code-block:: 10839 10840 ./mach raptor -t addMabN 10841 10842 **Owner**: DOM Lifecycle, Workers and Storage Team 10843 10844 **Description**: Use add API to send many small ArrayBuffers to IndexedDB independently 10845 10846 * **alert threshold**: 2.0 10847 * **apps**: firefox, chrome, safari 10848 * **browser cycles**: 1 10849 * **browsertime args**: --browsertime.iterations=16384 --browsertime.chunk_size=1024 --browsertime.buffer_type=ArrayBuffer --browsertime.atomic=0 10850 * **custom data**: true 10851 * **expected**: pass 10852 * **gecko profile entries**: 131072000 10853 * **gecko profile features**: js,stackwalk,cpu,memory 10854 * **gecko profile threads**: GeckoMain,DOM Worker,IndexedDB 10855 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-indexeddb.toml#54>`__ 10856 * **lower is better**: true 10857 * **measure**: cpuTime 10858 * **output timeout**: 2000000 10859 * **page cycles**: 1 10860 * **page timeout**: 1800000 10861 * **playback**: mitmproxy 10862 * **playback pageset manifest**: mitm8-linux-firefox-example.manifest 10863 * **subtest unit**: ms 10864 * **test script**: indexeddb_write.js 10865 * **test summary**: flatten 10866 * **test url**: `<https://www.example.com>`__ 10867 * **type**: pageload 10868 * **unit**: ms 10869 * **use live sites**: false 10870 * **Test Task**: 10871 10872 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 10873 :widths: 30 15 15 15 15 10874 :header-rows: 1 10875 10876 * - **Test Name** 10877 - mozilla-central 10878 - autoland 10879 - mozilla-release 10880 - mozilla-beta 10881 * - **browsertime-indexeddb-firefox-addMabN** 10882 - ❌ 10883 - ❌ 10884 - ❌ 10885 - ❌ 10886 10887 10888 .. list-table:: **test-linux1804-64-qr/opt** 10889 :widths: 30 15 15 15 15 10890 :header-rows: 1 10891 10892 * - **Test Name** 10893 - mozilla-central 10894 - autoland 10895 - mozilla-release 10896 - mozilla-beta 10897 * - **browsertime-indexeddb-firefox-addMabN** 10898 - ❌ 10899 - ❌ 10900 - ❌ 10901 - ❌ 10902 10903 10904 .. list-table:: **test-linux1804-64-shippable-qr/opt** 10905 :widths: 30 15 15 15 15 10906 :header-rows: 1 10907 10908 * - **Test Name** 10909 - mozilla-central 10910 - autoland 10911 - mozilla-release 10912 - mozilla-beta 10913 * - **browsertime-indexeddb-chrome-addMabN** 10914 - ❌ 10915 - ❌ 10916 - ❌ 10917 - ❌ 10918 * - **browsertime-indexeddb-firefox-addMabN** 10919 - ✅ 10920 - ✅ 10921 - ❌ 10922 - ❌ 10923 10924 10925 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 10926 :widths: 30 15 15 15 15 10927 :header-rows: 1 10928 10929 * - **Test Name** 10930 - mozilla-central 10931 - autoland 10932 - mozilla-release 10933 - mozilla-beta 10934 * - **browsertime-indexeddb-firefox-addMabN** 10935 - ❌ 10936 - ❌ 10937 - ❌ 10938 - ❌ 10939 10940 10941 .. list-table:: **test-macosx1470-64-shippable/opt** 10942 :widths: 30 15 15 15 15 10943 :header-rows: 1 10944 10945 * - **Test Name** 10946 - mozilla-central 10947 - autoland 10948 - mozilla-release 10949 - mozilla-beta 10950 * - **browsertime-indexeddb-chrome-addMabN** 10951 - ❌ 10952 - ❌ 10953 - ❌ 10954 - ❌ 10955 * - **browsertime-indexeddb-firefox-addMabN** 10956 - ✅ 10957 - ✅ 10958 - ❌ 10959 - ❌ 10960 10961 10962 .. list-table:: **test-macosx1470-64/opt** 10963 :widths: 30 15 15 15 15 10964 :header-rows: 1 10965 10966 * - **Test Name** 10967 - mozilla-central 10968 - autoland 10969 - mozilla-release 10970 - mozilla-beta 10971 * - **browsertime-indexeddb-firefox-addMabN** 10972 - ❌ 10973 - ❌ 10974 - ❌ 10975 - ❌ 10976 10977 10978 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 10979 :widths: 30 15 15 15 15 10980 :header-rows: 1 10981 10982 * - **Test Name** 10983 - mozilla-central 10984 - autoland 10985 - mozilla-release 10986 - mozilla-beta 10987 * - **browsertime-indexeddb-firefox-addMabN** 10988 - ❌ 10989 - ❌ 10990 - ❌ 10991 - ❌ 10992 10993 10994 .. list-table:: **test-windows11-64-24h2-shippable/opt** 10995 :widths: 30 15 15 15 15 10996 :header-rows: 1 10997 10998 * - **Test Name** 10999 - mozilla-central 11000 - autoland 11001 - mozilla-release 11002 - mozilla-beta 11003 * - **browsertime-indexeddb-chrome-addMabN** 11004 - ❌ 11005 - ❌ 11006 - ❌ 11007 - ❌ 11008 * - **browsertime-indexeddb-firefox-addMabN** 11009 - ✅ 11010 - ✅ 11011 - ❌ 11012 - ❌ 11013 11014 11015 .. list-table:: **test-windows11-64-24h2/opt** 11016 :widths: 30 15 15 15 15 11017 :header-rows: 1 11018 11019 * - **Test Name** 11020 - mozilla-central 11021 - autoland 11022 - mozilla-release 11023 - mozilla-beta 11024 * - **browsertime-indexeddb-firefox-addMabN** 11025 - ❌ 11026 - ❌ 11027 - ❌ 11028 - ❌ 11029 11030 11031 11032 .. dropdown:: addMar1 11033 :class-container: anchor-id-addMar1-c 11034 11035 * Command to Run Locally 11036 11037 .. code-block:: 11038 11039 ./mach raptor -t addMar1 11040 11041 **Owner**: DOM Lifecycle, Workers and Storage Team 11042 11043 **Description**: Use add API to send many small Arrays to IndexedDB in one transaction 11044 11045 * **alert threshold**: 2.0 11046 * **apps**: firefox, chrome, safari 11047 * **browser cycles**: 1 11048 * **browsertime args**: --browsertime.iterations=16384 --browsertime.chunk_size=1024 --browsertime.buffer_type=Array --browsertime.atomic=1 11049 * **custom data**: true 11050 * **expected**: pass 11051 * **gecko profile entries**: 131072000 11052 * **gecko profile features**: js,stackwalk,cpu,memory 11053 * **gecko profile threads**: GeckoMain,DOM Worker,IndexedDB 11054 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-indexeddb.toml#58>`__ 11055 * **lower is better**: true 11056 * **measure**: cpuTime 11057 * **output timeout**: 2000000 11058 * **page cycles**: 1 11059 * **page timeout**: 1800000 11060 * **playback**: mitmproxy 11061 * **playback pageset manifest**: mitm8-linux-firefox-example.manifest 11062 * **subtest unit**: ms 11063 * **test script**: indexeddb_write.js 11064 * **test summary**: flatten 11065 * **test url**: `<https://www.example.com>`__ 11066 * **type**: pageload 11067 * **unit**: ms 11068 * **use live sites**: false 11069 * **Test Task**: 11070 11071 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 11072 :widths: 30 15 15 15 15 11073 :header-rows: 1 11074 11075 * - **Test Name** 11076 - mozilla-central 11077 - autoland 11078 - mozilla-release 11079 - mozilla-beta 11080 * - **browsertime-indexeddb-firefox-addMar1** 11081 - ❌ 11082 - ❌ 11083 - ❌ 11084 - ❌ 11085 11086 11087 .. list-table:: **test-linux1804-64-qr/opt** 11088 :widths: 30 15 15 15 15 11089 :header-rows: 1 11090 11091 * - **Test Name** 11092 - mozilla-central 11093 - autoland 11094 - mozilla-release 11095 - mozilla-beta 11096 * - **browsertime-indexeddb-firefox-addMar1** 11097 - ❌ 11098 - ❌ 11099 - ❌ 11100 - ❌ 11101 11102 11103 .. list-table:: **test-linux1804-64-shippable-qr/opt** 11104 :widths: 30 15 15 15 15 11105 :header-rows: 1 11106 11107 * - **Test Name** 11108 - mozilla-central 11109 - autoland 11110 - mozilla-release 11111 - mozilla-beta 11112 * - **browsertime-indexeddb-chrome-addMar1** 11113 - ❌ 11114 - ❌ 11115 - ❌ 11116 - ❌ 11117 * - **browsertime-indexeddb-firefox-addMar1** 11118 - ✅ 11119 - ✅ 11120 - ❌ 11121 - ❌ 11122 11123 11124 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 11125 :widths: 30 15 15 15 15 11126 :header-rows: 1 11127 11128 * - **Test Name** 11129 - mozilla-central 11130 - autoland 11131 - mozilla-release 11132 - mozilla-beta 11133 * - **browsertime-indexeddb-firefox-addMar1** 11134 - ❌ 11135 - ❌ 11136 - ❌ 11137 - ❌ 11138 11139 11140 .. list-table:: **test-macosx1470-64-shippable/opt** 11141 :widths: 30 15 15 15 15 11142 :header-rows: 1 11143 11144 * - **Test Name** 11145 - mozilla-central 11146 - autoland 11147 - mozilla-release 11148 - mozilla-beta 11149 * - **browsertime-indexeddb-chrome-addMar1** 11150 - ❌ 11151 - ❌ 11152 - ❌ 11153 - ❌ 11154 * - **browsertime-indexeddb-firefox-addMar1** 11155 - ✅ 11156 - ✅ 11157 - ❌ 11158 - ❌ 11159 11160 11161 .. list-table:: **test-macosx1470-64/opt** 11162 :widths: 30 15 15 15 15 11163 :header-rows: 1 11164 11165 * - **Test Name** 11166 - mozilla-central 11167 - autoland 11168 - mozilla-release 11169 - mozilla-beta 11170 * - **browsertime-indexeddb-firefox-addMar1** 11171 - ❌ 11172 - ❌ 11173 - ❌ 11174 - ❌ 11175 11176 11177 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 11178 :widths: 30 15 15 15 15 11179 :header-rows: 1 11180 11181 * - **Test Name** 11182 - mozilla-central 11183 - autoland 11184 - mozilla-release 11185 - mozilla-beta 11186 * - **browsertime-indexeddb-firefox-addMar1** 11187 - ❌ 11188 - ❌ 11189 - ❌ 11190 - ❌ 11191 11192 11193 .. list-table:: **test-windows11-64-24h2-shippable/opt** 11194 :widths: 30 15 15 15 15 11195 :header-rows: 1 11196 11197 * - **Test Name** 11198 - mozilla-central 11199 - autoland 11200 - mozilla-release 11201 - mozilla-beta 11202 * - **browsertime-indexeddb-chrome-addMar1** 11203 - ❌ 11204 - ❌ 11205 - ❌ 11206 - ❌ 11207 * - **browsertime-indexeddb-firefox-addMar1** 11208 - ✅ 11209 - ✅ 11210 - ❌ 11211 - ❌ 11212 11213 11214 .. list-table:: **test-windows11-64-24h2/opt** 11215 :widths: 30 15 15 15 15 11216 :header-rows: 1 11217 11218 * - **Test Name** 11219 - mozilla-central 11220 - autoland 11221 - mozilla-release 11222 - mozilla-beta 11223 * - **browsertime-indexeddb-firefox-addMar1** 11224 - ❌ 11225 - ❌ 11226 - ❌ 11227 - ❌ 11228 11229 11230 11231 .. dropdown:: addMarN 11232 :class-container: anchor-id-addMarN-c 11233 11234 * Command to Run Locally 11235 11236 .. code-block:: 11237 11238 ./mach raptor -t addMarN 11239 11240 **Owner**: DOM Lifecycle, Workers and Storage Team 11241 11242 **Description**: Use add API to send many small Arrays to IndexedDB independently 11243 11244 * **alert threshold**: 2.0 11245 * **apps**: firefox, chrome, safari 11246 * **browser cycles**: 1 11247 * **browsertime args**: --browsertime.iterations=16384 --browsertime.chunk_size=1024 --browsertime.buffer_type=Array --browsertime.atomic=0 11248 * **custom data**: true 11249 * **expected**: pass 11250 * **gecko profile entries**: 131072000 11251 * **gecko profile features**: js,stackwalk,cpu,memory 11252 * **gecko profile threads**: GeckoMain,DOM Worker,IndexedDB 11253 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-indexeddb.toml#62>`__ 11254 * **lower is better**: true 11255 * **measure**: cpuTime 11256 * **output timeout**: 2000000 11257 * **page cycles**: 1 11258 * **page timeout**: 1800000 11259 * **playback**: mitmproxy 11260 * **playback pageset manifest**: mitm8-linux-firefox-example.manifest 11261 * **subtest unit**: ms 11262 * **test script**: indexeddb_write.js 11263 * **test summary**: flatten 11264 * **test url**: `<https://www.example.com>`__ 11265 * **type**: pageload 11266 * **unit**: ms 11267 * **use live sites**: false 11268 * **Test Task**: 11269 11270 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 11271 :widths: 30 15 15 15 15 11272 :header-rows: 1 11273 11274 * - **Test Name** 11275 - mozilla-central 11276 - autoland 11277 - mozilla-release 11278 - mozilla-beta 11279 * - **browsertime-indexeddb-firefox-addMarN** 11280 - ❌ 11281 - ❌ 11282 - ❌ 11283 - ❌ 11284 11285 11286 .. list-table:: **test-linux1804-64-qr/opt** 11287 :widths: 30 15 15 15 15 11288 :header-rows: 1 11289 11290 * - **Test Name** 11291 - mozilla-central 11292 - autoland 11293 - mozilla-release 11294 - mozilla-beta 11295 * - **browsertime-indexeddb-firefox-addMarN** 11296 - ❌ 11297 - ❌ 11298 - ❌ 11299 - ❌ 11300 11301 11302 .. list-table:: **test-linux1804-64-shippable-qr/opt** 11303 :widths: 30 15 15 15 15 11304 :header-rows: 1 11305 11306 * - **Test Name** 11307 - mozilla-central 11308 - autoland 11309 - mozilla-release 11310 - mozilla-beta 11311 * - **browsertime-indexeddb-chrome-addMarN** 11312 - ❌ 11313 - ❌ 11314 - ❌ 11315 - ❌ 11316 * - **browsertime-indexeddb-firefox-addMarN** 11317 - ✅ 11318 - ✅ 11319 - ❌ 11320 - ❌ 11321 11322 11323 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 11324 :widths: 30 15 15 15 15 11325 :header-rows: 1 11326 11327 * - **Test Name** 11328 - mozilla-central 11329 - autoland 11330 - mozilla-release 11331 - mozilla-beta 11332 * - **browsertime-indexeddb-firefox-addMarN** 11333 - ❌ 11334 - ❌ 11335 - ❌ 11336 - ❌ 11337 11338 11339 .. list-table:: **test-macosx1470-64-shippable/opt** 11340 :widths: 30 15 15 15 15 11341 :header-rows: 1 11342 11343 * - **Test Name** 11344 - mozilla-central 11345 - autoland 11346 - mozilla-release 11347 - mozilla-beta 11348 * - **browsertime-indexeddb-chrome-addMarN** 11349 - ❌ 11350 - ❌ 11351 - ❌ 11352 - ❌ 11353 * - **browsertime-indexeddb-firefox-addMarN** 11354 - ✅ 11355 - ✅ 11356 - ❌ 11357 - ❌ 11358 11359 11360 .. list-table:: **test-macosx1470-64/opt** 11361 :widths: 30 15 15 15 15 11362 :header-rows: 1 11363 11364 * - **Test Name** 11365 - mozilla-central 11366 - autoland 11367 - mozilla-release 11368 - mozilla-beta 11369 * - **browsertime-indexeddb-firefox-addMarN** 11370 - ❌ 11371 - ❌ 11372 - ❌ 11373 - ❌ 11374 11375 11376 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 11377 :widths: 30 15 15 15 15 11378 :header-rows: 1 11379 11380 * - **Test Name** 11381 - mozilla-central 11382 - autoland 11383 - mozilla-release 11384 - mozilla-beta 11385 * - **browsertime-indexeddb-firefox-addMarN** 11386 - ❌ 11387 - ❌ 11388 - ❌ 11389 - ❌ 11390 11391 11392 .. list-table:: **test-windows11-64-24h2-shippable/opt** 11393 :widths: 30 15 15 15 15 11394 :header-rows: 1 11395 11396 * - **Test Name** 11397 - mozilla-central 11398 - autoland 11399 - mozilla-release 11400 - mozilla-beta 11401 * - **browsertime-indexeddb-chrome-addMarN** 11402 - ❌ 11403 - ❌ 11404 - ❌ 11405 - ❌ 11406 * - **browsertime-indexeddb-firefox-addMarN** 11407 - ✅ 11408 - ✅ 11409 - ❌ 11410 - ❌ 11411 11412 11413 .. list-table:: **test-windows11-64-24h2/opt** 11414 :widths: 30 15 15 15 15 11415 :header-rows: 1 11416 11417 * - **Test Name** 11418 - mozilla-central 11419 - autoland 11420 - mozilla-release 11421 - mozilla-beta 11422 * - **browsertime-indexeddb-firefox-addMarN** 11423 - ❌ 11424 - ❌ 11425 - ❌ 11426 - ❌ 11427 11428 11429 11430 .. dropdown:: addMbl1 11431 :class-container: anchor-id-addMbl1-c 11432 11433 * Command to Run Locally 11434 11435 .. code-block:: 11436 11437 ./mach raptor -t addMbl1 11438 11439 **Owner**: DOM Lifecycle, Workers and Storage Team 11440 11441 **Description**: Use add API to send many small Blobs to IndexedDB in one transaction 11442 11443 * **alert threshold**: 2.0 11444 * **apps**: firefox, chrome, safari 11445 * **browser cycles**: 1 11446 * **browsertime args**: --browsertime.iterations=16384 --browsertime.chunk_size=1024 --browsertime.buffer_type=Blob --browsertime.atomic=1 11447 * **custom data**: true 11448 * **expected**: pass 11449 * **gecko profile entries**: 131072000 11450 * **gecko profile features**: js,stackwalk,cpu,memory 11451 * **gecko profile threads**: GeckoMain,DOM Worker,IndexedDB 11452 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-indexeddb.toml#66>`__ 11453 * **lower is better**: true 11454 * **measure**: cpuTime 11455 * **output timeout**: 2000000 11456 * **page cycles**: 1 11457 * **page timeout**: 1800000 11458 * **playback**: mitmproxy 11459 * **playback pageset manifest**: mitm8-linux-firefox-example.manifest 11460 * **subtest unit**: ms 11461 * **test script**: indexeddb_write.js 11462 * **test summary**: flatten 11463 * **test url**: `<https://www.example.com>`__ 11464 * **type**: pageload 11465 * **unit**: ms 11466 * **use live sites**: false 11467 * **Test Task**: 11468 11469 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 11470 :widths: 30 15 15 15 15 11471 :header-rows: 1 11472 11473 * - **Test Name** 11474 - mozilla-central 11475 - autoland 11476 - mozilla-release 11477 - mozilla-beta 11478 * - **browsertime-indexeddb-firefox-addMbl1** 11479 - ❌ 11480 - ❌ 11481 - ❌ 11482 - ❌ 11483 11484 11485 .. list-table:: **test-linux1804-64-qr/opt** 11486 :widths: 30 15 15 15 15 11487 :header-rows: 1 11488 11489 * - **Test Name** 11490 - mozilla-central 11491 - autoland 11492 - mozilla-release 11493 - mozilla-beta 11494 * - **browsertime-indexeddb-firefox-addMbl1** 11495 - ❌ 11496 - ❌ 11497 - ❌ 11498 - ❌ 11499 11500 11501 .. list-table:: **test-linux1804-64-shippable-qr/opt** 11502 :widths: 30 15 15 15 15 11503 :header-rows: 1 11504 11505 * - **Test Name** 11506 - mozilla-central 11507 - autoland 11508 - mozilla-release 11509 - mozilla-beta 11510 * - **browsertime-indexeddb-chrome-addMbl1** 11511 - ❌ 11512 - ❌ 11513 - ❌ 11514 - ❌ 11515 * - **browsertime-indexeddb-firefox-addMbl1** 11516 - ✅ 11517 - ✅ 11518 - ❌ 11519 - ❌ 11520 11521 11522 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 11523 :widths: 30 15 15 15 15 11524 :header-rows: 1 11525 11526 * - **Test Name** 11527 - mozilla-central 11528 - autoland 11529 - mozilla-release 11530 - mozilla-beta 11531 * - **browsertime-indexeddb-firefox-addMbl1** 11532 - ❌ 11533 - ❌ 11534 - ❌ 11535 - ❌ 11536 11537 11538 .. list-table:: **test-macosx1470-64-shippable/opt** 11539 :widths: 30 15 15 15 15 11540 :header-rows: 1 11541 11542 * - **Test Name** 11543 - mozilla-central 11544 - autoland 11545 - mozilla-release 11546 - mozilla-beta 11547 * - **browsertime-indexeddb-chrome-addMbl1** 11548 - ❌ 11549 - ❌ 11550 - ❌ 11551 - ❌ 11552 * - **browsertime-indexeddb-firefox-addMbl1** 11553 - ✅ 11554 - ✅ 11555 - ❌ 11556 - ❌ 11557 11558 11559 .. list-table:: **test-macosx1470-64/opt** 11560 :widths: 30 15 15 15 15 11561 :header-rows: 1 11562 11563 * - **Test Name** 11564 - mozilla-central 11565 - autoland 11566 - mozilla-release 11567 - mozilla-beta 11568 * - **browsertime-indexeddb-firefox-addMbl1** 11569 - ❌ 11570 - ❌ 11571 - ❌ 11572 - ❌ 11573 11574 11575 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 11576 :widths: 30 15 15 15 15 11577 :header-rows: 1 11578 11579 * - **Test Name** 11580 - mozilla-central 11581 - autoland 11582 - mozilla-release 11583 - mozilla-beta 11584 * - **browsertime-indexeddb-firefox-addMbl1** 11585 - ❌ 11586 - ❌ 11587 - ❌ 11588 - ❌ 11589 11590 11591 .. list-table:: **test-windows11-64-24h2-shippable/opt** 11592 :widths: 30 15 15 15 15 11593 :header-rows: 1 11594 11595 * - **Test Name** 11596 - mozilla-central 11597 - autoland 11598 - mozilla-release 11599 - mozilla-beta 11600 * - **browsertime-indexeddb-chrome-addMbl1** 11601 - ❌ 11602 - ❌ 11603 - ❌ 11604 - ❌ 11605 * - **browsertime-indexeddb-firefox-addMbl1** 11606 - ✅ 11607 - ✅ 11608 - ❌ 11609 - ❌ 11610 11611 11612 .. list-table:: **test-windows11-64-24h2/opt** 11613 :widths: 30 15 15 15 15 11614 :header-rows: 1 11615 11616 * - **Test Name** 11617 - mozilla-central 11618 - autoland 11619 - mozilla-release 11620 - mozilla-beta 11621 * - **browsertime-indexeddb-firefox-addMbl1** 11622 - ❌ 11623 - ❌ 11624 - ❌ 11625 - ❌ 11626 11627 11628 11629 .. dropdown:: addMblN 11630 :class-container: anchor-id-addMblN-c 11631 11632 * Command to Run Locally 11633 11634 .. code-block:: 11635 11636 ./mach raptor -t addMblN 11637 11638 **Owner**: DOM Lifecycle, Workers and Storage Team 11639 11640 **Description**: Use add API to send many small Blobs to IndexedDB independently 11641 11642 * **alert threshold**: 2.0 11643 * **apps**: firefox, chrome, safari 11644 * **browser cycles**: 1 11645 * **browsertime args**: --browsertime.iterations=16384 --browsertime.chunk_size=1024 --browsertime.buffer_type=Blob --browsertime.atomic=0 11646 * **custom data**: true 11647 * **expected**: pass 11648 * **gecko profile entries**: 131072000 11649 * **gecko profile features**: js,stackwalk,cpu,memory 11650 * **gecko profile threads**: GeckoMain,DOM Worker,IndexedDB 11651 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-indexeddb.toml#70>`__ 11652 * **lower is better**: true 11653 * **measure**: cpuTime 11654 * **output timeout**: 2000000 11655 * **page cycles**: 1 11656 * **page timeout**: 1800000 11657 * **playback**: mitmproxy 11658 * **playback pageset manifest**: mitm8-linux-firefox-example.manifest 11659 * **subtest unit**: ms 11660 * **test script**: indexeddb_write.js 11661 * **test summary**: flatten 11662 * **test url**: `<https://www.example.com>`__ 11663 * **type**: pageload 11664 * **unit**: ms 11665 * **use live sites**: false 11666 * **Test Task**: 11667 11668 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 11669 :widths: 30 15 15 15 15 11670 :header-rows: 1 11671 11672 * - **Test Name** 11673 - mozilla-central 11674 - autoland 11675 - mozilla-release 11676 - mozilla-beta 11677 * - **browsertime-indexeddb-firefox-addMblN** 11678 - ❌ 11679 - ❌ 11680 - ❌ 11681 - ❌ 11682 11683 11684 .. list-table:: **test-linux1804-64-qr/opt** 11685 :widths: 30 15 15 15 15 11686 :header-rows: 1 11687 11688 * - **Test Name** 11689 - mozilla-central 11690 - autoland 11691 - mozilla-release 11692 - mozilla-beta 11693 * - **browsertime-indexeddb-firefox-addMblN** 11694 - ❌ 11695 - ❌ 11696 - ❌ 11697 - ❌ 11698 11699 11700 .. list-table:: **test-linux1804-64-shippable-qr/opt** 11701 :widths: 30 15 15 15 15 11702 :header-rows: 1 11703 11704 * - **Test Name** 11705 - mozilla-central 11706 - autoland 11707 - mozilla-release 11708 - mozilla-beta 11709 * - **browsertime-indexeddb-chrome-addMblN** 11710 - ❌ 11711 - ❌ 11712 - ❌ 11713 - ❌ 11714 * - **browsertime-indexeddb-firefox-addMblN** 11715 - ✅ 11716 - ✅ 11717 - ❌ 11718 - ❌ 11719 11720 11721 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 11722 :widths: 30 15 15 15 15 11723 :header-rows: 1 11724 11725 * - **Test Name** 11726 - mozilla-central 11727 - autoland 11728 - mozilla-release 11729 - mozilla-beta 11730 * - **browsertime-indexeddb-firefox-addMblN** 11731 - ❌ 11732 - ❌ 11733 - ❌ 11734 - ❌ 11735 11736 11737 .. list-table:: **test-macosx1470-64-shippable/opt** 11738 :widths: 30 15 15 15 15 11739 :header-rows: 1 11740 11741 * - **Test Name** 11742 - mozilla-central 11743 - autoland 11744 - mozilla-release 11745 - mozilla-beta 11746 * - **browsertime-indexeddb-chrome-addMblN** 11747 - ❌ 11748 - ❌ 11749 - ❌ 11750 - ❌ 11751 * - **browsertime-indexeddb-firefox-addMblN** 11752 - ✅ 11753 - ✅ 11754 - ❌ 11755 - ❌ 11756 11757 11758 .. list-table:: **test-macosx1470-64/opt** 11759 :widths: 30 15 15 15 15 11760 :header-rows: 1 11761 11762 * - **Test Name** 11763 - mozilla-central 11764 - autoland 11765 - mozilla-release 11766 - mozilla-beta 11767 * - **browsertime-indexeddb-firefox-addMblN** 11768 - ❌ 11769 - ❌ 11770 - ❌ 11771 - ❌ 11772 11773 11774 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 11775 :widths: 30 15 15 15 15 11776 :header-rows: 1 11777 11778 * - **Test Name** 11779 - mozilla-central 11780 - autoland 11781 - mozilla-release 11782 - mozilla-beta 11783 * - **browsertime-indexeddb-firefox-addMblN** 11784 - ❌ 11785 - ❌ 11786 - ❌ 11787 - ❌ 11788 11789 11790 .. list-table:: **test-windows11-64-24h2-shippable/opt** 11791 :widths: 30 15 15 15 15 11792 :header-rows: 1 11793 11794 * - **Test Name** 11795 - mozilla-central 11796 - autoland 11797 - mozilla-release 11798 - mozilla-beta 11799 * - **browsertime-indexeddb-chrome-addMblN** 11800 - ❌ 11801 - ❌ 11802 - ❌ 11803 - ❌ 11804 * - **browsertime-indexeddb-firefox-addMblN** 11805 - ✅ 11806 - ✅ 11807 - ❌ 11808 - ❌ 11809 11810 11811 .. list-table:: **test-windows11-64-24h2/opt** 11812 :widths: 30 15 15 15 15 11813 :header-rows: 1 11814 11815 * - **Test Name** 11816 - mozilla-central 11817 - autoland 11818 - mozilla-release 11819 - mozilla-beta 11820 * - **browsertime-indexeddb-firefox-addMblN** 11821 - ❌ 11822 - ❌ 11823 - ❌ 11824 - ❌ 11825 11826 11827 11828 .. dropdown:: addkAB1 11829 :class-container: anchor-id-addkAB1-c 11830 11831 * Command to Run Locally 11832 11833 .. code-block:: 11834 11835 ./mach raptor -t addkAB1 11836 11837 **Owner**: DOM Lifecycle, Workers and Storage Team 11838 11839 **Description**: Use add API to send a couple of large ArrayBuffers to IndexedDB in one transaction 11840 11841 * **alert threshold**: 2.0 11842 * **apps**: firefox, chrome, safari 11843 * **browser cycles**: 1 11844 * **browsertime args**: --browsertime.iterations=128 --browsertime.chunk_size=1048576 --browsertime.buffer_type=ArrayBuffer --browsertime.atomic=1 11845 * **custom data**: true 11846 * **expected**: pass 11847 * **gecko profile entries**: 131072000 11848 * **gecko profile features**: js,stackwalk,cpu,memory 11849 * **gecko profile threads**: GeckoMain,DOM Worker,IndexedDB 11850 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-indexeddb.toml#74>`__ 11851 * **lower is better**: true 11852 * **measure**: cpuTime 11853 * **output timeout**: 2000000 11854 * **page cycles**: 1 11855 * **page timeout**: 1800000 11856 * **playback**: mitmproxy 11857 * **playback pageset manifest**: mitm8-linux-firefox-example.manifest 11858 * **subtest unit**: ms 11859 * **test script**: indexeddb_write.js 11860 * **test summary**: flatten 11861 * **test url**: `<https://www.example.com>`__ 11862 * **type**: pageload 11863 * **unit**: ms 11864 * **use live sites**: false 11865 * **Test Task**: 11866 11867 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 11868 :widths: 30 15 15 15 15 11869 :header-rows: 1 11870 11871 * - **Test Name** 11872 - mozilla-central 11873 - autoland 11874 - mozilla-release 11875 - mozilla-beta 11876 * - **browsertime-indexeddb-firefox-addkAB1** 11877 - ❌ 11878 - ❌ 11879 - ❌ 11880 - ❌ 11881 11882 11883 .. list-table:: **test-linux1804-64-qr/opt** 11884 :widths: 30 15 15 15 15 11885 :header-rows: 1 11886 11887 * - **Test Name** 11888 - mozilla-central 11889 - autoland 11890 - mozilla-release 11891 - mozilla-beta 11892 * - **browsertime-indexeddb-firefox-addkAB1** 11893 - ❌ 11894 - ❌ 11895 - ❌ 11896 - ❌ 11897 11898 11899 .. list-table:: **test-linux1804-64-shippable-qr/opt** 11900 :widths: 30 15 15 15 15 11901 :header-rows: 1 11902 11903 * - **Test Name** 11904 - mozilla-central 11905 - autoland 11906 - mozilla-release 11907 - mozilla-beta 11908 * - **browsertime-indexeddb-chrome-addkAB1** 11909 - ❌ 11910 - ❌ 11911 - ❌ 11912 - ❌ 11913 * - **browsertime-indexeddb-firefox-addkAB1** 11914 - ✅ 11915 - ✅ 11916 - ❌ 11917 - ❌ 11918 11919 11920 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 11921 :widths: 30 15 15 15 15 11922 :header-rows: 1 11923 11924 * - **Test Name** 11925 - mozilla-central 11926 - autoland 11927 - mozilla-release 11928 - mozilla-beta 11929 * - **browsertime-indexeddb-firefox-addkAB1** 11930 - ❌ 11931 - ❌ 11932 - ❌ 11933 - ❌ 11934 11935 11936 .. list-table:: **test-macosx1470-64-shippable/opt** 11937 :widths: 30 15 15 15 15 11938 :header-rows: 1 11939 11940 * - **Test Name** 11941 - mozilla-central 11942 - autoland 11943 - mozilla-release 11944 - mozilla-beta 11945 * - **browsertime-indexeddb-chrome-addkAB1** 11946 - ❌ 11947 - ❌ 11948 - ❌ 11949 - ❌ 11950 * - **browsertime-indexeddb-firefox-addkAB1** 11951 - ✅ 11952 - ✅ 11953 - ❌ 11954 - ❌ 11955 11956 11957 .. list-table:: **test-macosx1470-64/opt** 11958 :widths: 30 15 15 15 15 11959 :header-rows: 1 11960 11961 * - **Test Name** 11962 - mozilla-central 11963 - autoland 11964 - mozilla-release 11965 - mozilla-beta 11966 * - **browsertime-indexeddb-firefox-addkAB1** 11967 - ❌ 11968 - ❌ 11969 - ❌ 11970 - ❌ 11971 11972 11973 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 11974 :widths: 30 15 15 15 15 11975 :header-rows: 1 11976 11977 * - **Test Name** 11978 - mozilla-central 11979 - autoland 11980 - mozilla-release 11981 - mozilla-beta 11982 * - **browsertime-indexeddb-firefox-addkAB1** 11983 - ❌ 11984 - ❌ 11985 - ❌ 11986 - ❌ 11987 11988 11989 .. list-table:: **test-windows11-64-24h2-shippable/opt** 11990 :widths: 30 15 15 15 15 11991 :header-rows: 1 11992 11993 * - **Test Name** 11994 - mozilla-central 11995 - autoland 11996 - mozilla-release 11997 - mozilla-beta 11998 * - **browsertime-indexeddb-chrome-addkAB1** 11999 - ❌ 12000 - ❌ 12001 - ❌ 12002 - ❌ 12003 * - **browsertime-indexeddb-firefox-addkAB1** 12004 - ✅ 12005 - ✅ 12006 - ❌ 12007 - ❌ 12008 12009 12010 .. list-table:: **test-windows11-64-24h2/opt** 12011 :widths: 30 15 15 15 15 12012 :header-rows: 1 12013 12014 * - **Test Name** 12015 - mozilla-central 12016 - autoland 12017 - mozilla-release 12018 - mozilla-beta 12019 * - **browsertime-indexeddb-firefox-addkAB1** 12020 - ❌ 12021 - ❌ 12022 - ❌ 12023 - ❌ 12024 12025 12026 12027 .. dropdown:: addkABN 12028 :class-container: anchor-id-addkABN-c 12029 12030 * Command to Run Locally 12031 12032 .. code-block:: 12033 12034 ./mach raptor -t addkABN 12035 12036 **Owner**: DOM Lifecycle, Workers and Storage Team 12037 12038 **Description**: Use add API to send a couple of large ArrayBuffers to IndexedDB independently 12039 12040 * **alert threshold**: 2.0 12041 * **apps**: firefox, chrome, safari 12042 * **browser cycles**: 1 12043 * **browsertime args**: --browsertime.iterations=128 --browsertime.chunk_size=1048576 --browsertime.buffer_type=ArrayBuffer --browsertime.atomic=0 12044 * **custom data**: true 12045 * **expected**: pass 12046 * **gecko profile entries**: 131072000 12047 * **gecko profile features**: js,stackwalk,cpu,memory 12048 * **gecko profile threads**: GeckoMain,DOM Worker,IndexedDB 12049 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-indexeddb.toml#78>`__ 12050 * **lower is better**: true 12051 * **measure**: cpuTime 12052 * **output timeout**: 2000000 12053 * **page cycles**: 1 12054 * **page timeout**: 1800000 12055 * **playback**: mitmproxy 12056 * **playback pageset manifest**: mitm8-linux-firefox-example.manifest 12057 * **subtest unit**: ms 12058 * **test script**: indexeddb_write.js 12059 * **test summary**: flatten 12060 * **test url**: `<https://www.example.com>`__ 12061 * **type**: pageload 12062 * **unit**: ms 12063 * **use live sites**: false 12064 * **Test Task**: 12065 12066 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 12067 :widths: 30 15 15 15 15 12068 :header-rows: 1 12069 12070 * - **Test Name** 12071 - mozilla-central 12072 - autoland 12073 - mozilla-release 12074 - mozilla-beta 12075 * - **browsertime-indexeddb-firefox-addkABN** 12076 - ❌ 12077 - ❌ 12078 - ❌ 12079 - ❌ 12080 12081 12082 .. list-table:: **test-linux1804-64-qr/opt** 12083 :widths: 30 15 15 15 15 12084 :header-rows: 1 12085 12086 * - **Test Name** 12087 - mozilla-central 12088 - autoland 12089 - mozilla-release 12090 - mozilla-beta 12091 * - **browsertime-indexeddb-firefox-addkABN** 12092 - ❌ 12093 - ❌ 12094 - ❌ 12095 - ❌ 12096 12097 12098 .. list-table:: **test-linux1804-64-shippable-qr/opt** 12099 :widths: 30 15 15 15 15 12100 :header-rows: 1 12101 12102 * - **Test Name** 12103 - mozilla-central 12104 - autoland 12105 - mozilla-release 12106 - mozilla-beta 12107 * - **browsertime-indexeddb-chrome-addkABN** 12108 - ❌ 12109 - ❌ 12110 - ❌ 12111 - ❌ 12112 * - **browsertime-indexeddb-firefox-addkABN** 12113 - ✅ 12114 - ✅ 12115 - ❌ 12116 - ❌ 12117 12118 12119 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 12120 :widths: 30 15 15 15 15 12121 :header-rows: 1 12122 12123 * - **Test Name** 12124 - mozilla-central 12125 - autoland 12126 - mozilla-release 12127 - mozilla-beta 12128 * - **browsertime-indexeddb-firefox-addkABN** 12129 - ❌ 12130 - ❌ 12131 - ❌ 12132 - ❌ 12133 12134 12135 .. list-table:: **test-macosx1470-64-shippable/opt** 12136 :widths: 30 15 15 15 15 12137 :header-rows: 1 12138 12139 * - **Test Name** 12140 - mozilla-central 12141 - autoland 12142 - mozilla-release 12143 - mozilla-beta 12144 * - **browsertime-indexeddb-chrome-addkABN** 12145 - ❌ 12146 - ❌ 12147 - ❌ 12148 - ❌ 12149 * - **browsertime-indexeddb-firefox-addkABN** 12150 - ✅ 12151 - ✅ 12152 - ❌ 12153 - ❌ 12154 12155 12156 .. list-table:: **test-macosx1470-64/opt** 12157 :widths: 30 15 15 15 15 12158 :header-rows: 1 12159 12160 * - **Test Name** 12161 - mozilla-central 12162 - autoland 12163 - mozilla-release 12164 - mozilla-beta 12165 * - **browsertime-indexeddb-firefox-addkABN** 12166 - ❌ 12167 - ❌ 12168 - ❌ 12169 - ❌ 12170 12171 12172 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 12173 :widths: 30 15 15 15 15 12174 :header-rows: 1 12175 12176 * - **Test Name** 12177 - mozilla-central 12178 - autoland 12179 - mozilla-release 12180 - mozilla-beta 12181 * - **browsertime-indexeddb-firefox-addkABN** 12182 - ❌ 12183 - ❌ 12184 - ❌ 12185 - ❌ 12186 12187 12188 .. list-table:: **test-windows11-64-24h2-shippable/opt** 12189 :widths: 30 15 15 15 15 12190 :header-rows: 1 12191 12192 * - **Test Name** 12193 - mozilla-central 12194 - autoland 12195 - mozilla-release 12196 - mozilla-beta 12197 * - **browsertime-indexeddb-chrome-addkABN** 12198 - ❌ 12199 - ❌ 12200 - ❌ 12201 - ❌ 12202 * - **browsertime-indexeddb-firefox-addkABN** 12203 - ✅ 12204 - ✅ 12205 - ❌ 12206 - ❌ 12207 12208 12209 .. list-table:: **test-windows11-64-24h2/opt** 12210 :widths: 30 15 15 15 15 12211 :header-rows: 1 12212 12213 * - **Test Name** 12214 - mozilla-central 12215 - autoland 12216 - mozilla-release 12217 - mozilla-beta 12218 * - **browsertime-indexeddb-firefox-addkABN** 12219 - ❌ 12220 - ❌ 12221 - ❌ 12222 - ❌ 12223 12224 12225 12226 .. dropdown:: addkAR1 12227 :class-container: anchor-id-addkAR1-c 12228 12229 * Command to Run Locally 12230 12231 .. code-block:: 12232 12233 ./mach raptor -t addkAR1 12234 12235 **Owner**: DOM Lifecycle, Workers and Storage Team 12236 12237 **Description**: Use add API to send a couple of large JS Arrays to IndexedDB in one transaction 12238 12239 * **alert threshold**: 2.0 12240 * **apps**: firefox, chrome, safari 12241 * **browser cycles**: 1 12242 * **browsertime args**: --browsertime.iterations=128 --browsertime.chunk_size=1048576 --browsertime.buffer_type=Array --browsertime.atomic=1 12243 * **custom data**: true 12244 * **expected**: pass 12245 * **gecko profile entries**: 131072000 12246 * **gecko profile features**: js,stackwalk,cpu,memory 12247 * **gecko profile threads**: GeckoMain,DOM Worker,IndexedDB 12248 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-indexeddb.toml#82>`__ 12249 * **lower is better**: true 12250 * **measure**: cpuTime 12251 * **output timeout**: 2000000 12252 * **page cycles**: 1 12253 * **page timeout**: 1800000 12254 * **playback**: mitmproxy 12255 * **playback pageset manifest**: mitm8-linux-firefox-example.manifest 12256 * **subtest unit**: ms 12257 * **test script**: indexeddb_write.js 12258 * **test summary**: flatten 12259 * **test url**: `<https://www.example.com>`__ 12260 * **type**: pageload 12261 * **unit**: ms 12262 * **use live sites**: false 12263 * **Test Task**: 12264 12265 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 12266 :widths: 30 15 15 15 15 12267 :header-rows: 1 12268 12269 * - **Test Name** 12270 - mozilla-central 12271 - autoland 12272 - mozilla-release 12273 - mozilla-beta 12274 * - **browsertime-indexeddb-firefox-addkAR1** 12275 - ❌ 12276 - ❌ 12277 - ❌ 12278 - ❌ 12279 12280 12281 .. list-table:: **test-linux1804-64-qr/opt** 12282 :widths: 30 15 15 15 15 12283 :header-rows: 1 12284 12285 * - **Test Name** 12286 - mozilla-central 12287 - autoland 12288 - mozilla-release 12289 - mozilla-beta 12290 * - **browsertime-indexeddb-firefox-addkAR1** 12291 - ❌ 12292 - ❌ 12293 - ❌ 12294 - ❌ 12295 12296 12297 .. list-table:: **test-linux1804-64-shippable-qr/opt** 12298 :widths: 30 15 15 15 15 12299 :header-rows: 1 12300 12301 * - **Test Name** 12302 - mozilla-central 12303 - autoland 12304 - mozilla-release 12305 - mozilla-beta 12306 * - **browsertime-indexeddb-chrome-addkAR1** 12307 - ❌ 12308 - ❌ 12309 - ❌ 12310 - ❌ 12311 * - **browsertime-indexeddb-firefox-addkAR1** 12312 - ✅ 12313 - ✅ 12314 - ❌ 12315 - ❌ 12316 12317 12318 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 12319 :widths: 30 15 15 15 15 12320 :header-rows: 1 12321 12322 * - **Test Name** 12323 - mozilla-central 12324 - autoland 12325 - mozilla-release 12326 - mozilla-beta 12327 * - **browsertime-indexeddb-firefox-addkAR1** 12328 - ❌ 12329 - ❌ 12330 - ❌ 12331 - ❌ 12332 12333 12334 .. list-table:: **test-macosx1470-64-shippable/opt** 12335 :widths: 30 15 15 15 15 12336 :header-rows: 1 12337 12338 * - **Test Name** 12339 - mozilla-central 12340 - autoland 12341 - mozilla-release 12342 - mozilla-beta 12343 * - **browsertime-indexeddb-chrome-addkAR1** 12344 - ❌ 12345 - ❌ 12346 - ❌ 12347 - ❌ 12348 * - **browsertime-indexeddb-firefox-addkAR1** 12349 - ✅ 12350 - ✅ 12351 - ❌ 12352 - ❌ 12353 12354 12355 .. list-table:: **test-macosx1470-64/opt** 12356 :widths: 30 15 15 15 15 12357 :header-rows: 1 12358 12359 * - **Test Name** 12360 - mozilla-central 12361 - autoland 12362 - mozilla-release 12363 - mozilla-beta 12364 * - **browsertime-indexeddb-firefox-addkAR1** 12365 - ❌ 12366 - ❌ 12367 - ❌ 12368 - ❌ 12369 12370 12371 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 12372 :widths: 30 15 15 15 15 12373 :header-rows: 1 12374 12375 * - **Test Name** 12376 - mozilla-central 12377 - autoland 12378 - mozilla-release 12379 - mozilla-beta 12380 * - **browsertime-indexeddb-firefox-addkAR1** 12381 - ❌ 12382 - ❌ 12383 - ❌ 12384 - ❌ 12385 12386 12387 .. list-table:: **test-windows11-64-24h2-shippable/opt** 12388 :widths: 30 15 15 15 15 12389 :header-rows: 1 12390 12391 * - **Test Name** 12392 - mozilla-central 12393 - autoland 12394 - mozilla-release 12395 - mozilla-beta 12396 * - **browsertime-indexeddb-chrome-addkAR1** 12397 - ❌ 12398 - ❌ 12399 - ❌ 12400 - ❌ 12401 * - **browsertime-indexeddb-firefox-addkAR1** 12402 - ✅ 12403 - ✅ 12404 - ❌ 12405 - ❌ 12406 12407 12408 .. list-table:: **test-windows11-64-24h2/opt** 12409 :widths: 30 15 15 15 15 12410 :header-rows: 1 12411 12412 * - **Test Name** 12413 - mozilla-central 12414 - autoland 12415 - mozilla-release 12416 - mozilla-beta 12417 * - **browsertime-indexeddb-firefox-addkAR1** 12418 - ❌ 12419 - ❌ 12420 - ❌ 12421 - ❌ 12422 12423 12424 12425 .. dropdown:: addkARN 12426 :class-container: anchor-id-addkARN-c 12427 12428 * Command to Run Locally 12429 12430 .. code-block:: 12431 12432 ./mach raptor -t addkARN 12433 12434 **Owner**: DOM Lifecycle, Workers and Storage Team 12435 12436 **Description**: Use add API to send a couple of large JS Arrays to IndexedDB independently 12437 12438 * **alert threshold**: 2.0 12439 * **apps**: firefox, chrome, safari 12440 * **browser cycles**: 1 12441 * **browsertime args**: --browsertime.iterations=128 --browsertime.chunk_size=1048576 --browsertime.buffer_type=Array --browsertime.atomic=0 12442 * **custom data**: true 12443 * **expected**: pass 12444 * **gecko profile entries**: 131072000 12445 * **gecko profile features**: js,stackwalk,cpu,memory 12446 * **gecko profile threads**: GeckoMain,DOM Worker,IndexedDB 12447 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-indexeddb.toml#86>`__ 12448 * **lower is better**: true 12449 * **measure**: cpuTime 12450 * **output timeout**: 2000000 12451 * **page cycles**: 1 12452 * **page timeout**: 1800000 12453 * **playback**: mitmproxy 12454 * **playback pageset manifest**: mitm8-linux-firefox-example.manifest 12455 * **subtest unit**: ms 12456 * **test script**: indexeddb_write.js 12457 * **test summary**: flatten 12458 * **test url**: `<https://www.example.com>`__ 12459 * **type**: pageload 12460 * **unit**: ms 12461 * **use live sites**: false 12462 * **Test Task**: 12463 12464 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 12465 :widths: 30 15 15 15 15 12466 :header-rows: 1 12467 12468 * - **Test Name** 12469 - mozilla-central 12470 - autoland 12471 - mozilla-release 12472 - mozilla-beta 12473 * - **browsertime-indexeddb-firefox-addkARN** 12474 - ❌ 12475 - ❌ 12476 - ❌ 12477 - ❌ 12478 12479 12480 .. list-table:: **test-linux1804-64-qr/opt** 12481 :widths: 30 15 15 15 15 12482 :header-rows: 1 12483 12484 * - **Test Name** 12485 - mozilla-central 12486 - autoland 12487 - mozilla-release 12488 - mozilla-beta 12489 * - **browsertime-indexeddb-firefox-addkARN** 12490 - ❌ 12491 - ❌ 12492 - ❌ 12493 - ❌ 12494 12495 12496 .. list-table:: **test-linux1804-64-shippable-qr/opt** 12497 :widths: 30 15 15 15 15 12498 :header-rows: 1 12499 12500 * - **Test Name** 12501 - mozilla-central 12502 - autoland 12503 - mozilla-release 12504 - mozilla-beta 12505 * - **browsertime-indexeddb-chrome-addkARN** 12506 - ❌ 12507 - ❌ 12508 - ❌ 12509 - ❌ 12510 * - **browsertime-indexeddb-firefox-addkARN** 12511 - ✅ 12512 - ✅ 12513 - ❌ 12514 - ❌ 12515 12516 12517 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 12518 :widths: 30 15 15 15 15 12519 :header-rows: 1 12520 12521 * - **Test Name** 12522 - mozilla-central 12523 - autoland 12524 - mozilla-release 12525 - mozilla-beta 12526 * - **browsertime-indexeddb-firefox-addkARN** 12527 - ❌ 12528 - ❌ 12529 - ❌ 12530 - ❌ 12531 12532 12533 .. list-table:: **test-macosx1470-64-shippable/opt** 12534 :widths: 30 15 15 15 15 12535 :header-rows: 1 12536 12537 * - **Test Name** 12538 - mozilla-central 12539 - autoland 12540 - mozilla-release 12541 - mozilla-beta 12542 * - **browsertime-indexeddb-chrome-addkARN** 12543 - ❌ 12544 - ❌ 12545 - ❌ 12546 - ❌ 12547 * - **browsertime-indexeddb-firefox-addkARN** 12548 - ✅ 12549 - ✅ 12550 - ❌ 12551 - ❌ 12552 12553 12554 .. list-table:: **test-macosx1470-64/opt** 12555 :widths: 30 15 15 15 15 12556 :header-rows: 1 12557 12558 * - **Test Name** 12559 - mozilla-central 12560 - autoland 12561 - mozilla-release 12562 - mozilla-beta 12563 * - **browsertime-indexeddb-firefox-addkARN** 12564 - ❌ 12565 - ❌ 12566 - ❌ 12567 - ❌ 12568 12569 12570 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 12571 :widths: 30 15 15 15 15 12572 :header-rows: 1 12573 12574 * - **Test Name** 12575 - mozilla-central 12576 - autoland 12577 - mozilla-release 12578 - mozilla-beta 12579 * - **browsertime-indexeddb-firefox-addkARN** 12580 - ❌ 12581 - ❌ 12582 - ❌ 12583 - ❌ 12584 12585 12586 .. list-table:: **test-windows11-64-24h2-shippable/opt** 12587 :widths: 30 15 15 15 15 12588 :header-rows: 1 12589 12590 * - **Test Name** 12591 - mozilla-central 12592 - autoland 12593 - mozilla-release 12594 - mozilla-beta 12595 * - **browsertime-indexeddb-chrome-addkARN** 12596 - ❌ 12597 - ❌ 12598 - ❌ 12599 - ❌ 12600 * - **browsertime-indexeddb-firefox-addkARN** 12601 - ✅ 12602 - ✅ 12603 - ❌ 12604 - ❌ 12605 12606 12607 .. list-table:: **test-windows11-64-24h2/opt** 12608 :widths: 30 15 15 15 15 12609 :header-rows: 1 12610 12611 * - **Test Name** 12612 - mozilla-central 12613 - autoland 12614 - mozilla-release 12615 - mozilla-beta 12616 * - **browsertime-indexeddb-firefox-addkARN** 12617 - ❌ 12618 - ❌ 12619 - ❌ 12620 - ❌ 12621 12622 12623 12624 .. dropdown:: addkBL1 12625 :class-container: anchor-id-addkBL1-c 12626 12627 * Command to Run Locally 12628 12629 .. code-block:: 12630 12631 ./mach raptor -t addkBL1 12632 12633 **Owner**: DOM Lifecycle, Workers and Storage Team 12634 12635 **Description**: Use add API to send a couple of large Blobs to IndexedDB in one transaction 12636 12637 * **alert threshold**: 2.0 12638 * **apps**: firefox, chrome, safari 12639 * **browser cycles**: 1 12640 * **browsertime args**: --browsertime.iterations=128 --browsertime.chunk_size=1048576 --browsertime.buffer_type=Blob --browsertime.atomic=1 12641 * **custom data**: true 12642 * **expected**: pass 12643 * **gecko profile entries**: 131072000 12644 * **gecko profile features**: js,stackwalk,cpu,memory 12645 * **gecko profile threads**: GeckoMain,DOM Worker,IndexedDB 12646 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-indexeddb.toml#90>`__ 12647 * **lower is better**: true 12648 * **measure**: cpuTime 12649 * **output timeout**: 2000000 12650 * **page cycles**: 1 12651 * **page timeout**: 1800000 12652 * **playback**: mitmproxy 12653 * **playback pageset manifest**: mitm8-linux-firefox-example.manifest 12654 * **subtest unit**: ms 12655 * **test script**: indexeddb_write.js 12656 * **test summary**: flatten 12657 * **test url**: `<https://www.example.com>`__ 12658 * **type**: pageload 12659 * **unit**: ms 12660 * **use live sites**: false 12661 * **Test Task**: 12662 12663 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 12664 :widths: 30 15 15 15 15 12665 :header-rows: 1 12666 12667 * - **Test Name** 12668 - mozilla-central 12669 - autoland 12670 - mozilla-release 12671 - mozilla-beta 12672 * - **browsertime-indexeddb-firefox-addkBL1** 12673 - ❌ 12674 - ❌ 12675 - ❌ 12676 - ❌ 12677 12678 12679 .. list-table:: **test-linux1804-64-qr/opt** 12680 :widths: 30 15 15 15 15 12681 :header-rows: 1 12682 12683 * - **Test Name** 12684 - mozilla-central 12685 - autoland 12686 - mozilla-release 12687 - mozilla-beta 12688 * - **browsertime-indexeddb-firefox-addkBL1** 12689 - ❌ 12690 - ❌ 12691 - ❌ 12692 - ❌ 12693 12694 12695 .. list-table:: **test-linux1804-64-shippable-qr/opt** 12696 :widths: 30 15 15 15 15 12697 :header-rows: 1 12698 12699 * - **Test Name** 12700 - mozilla-central 12701 - autoland 12702 - mozilla-release 12703 - mozilla-beta 12704 * - **browsertime-indexeddb-chrome-addkBL1** 12705 - ❌ 12706 - ❌ 12707 - ❌ 12708 - ❌ 12709 * - **browsertime-indexeddb-firefox-addkBL1** 12710 - ✅ 12711 - ✅ 12712 - ❌ 12713 - ❌ 12714 12715 12716 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 12717 :widths: 30 15 15 15 15 12718 :header-rows: 1 12719 12720 * - **Test Name** 12721 - mozilla-central 12722 - autoland 12723 - mozilla-release 12724 - mozilla-beta 12725 * - **browsertime-indexeddb-firefox-addkBL1** 12726 - ❌ 12727 - ❌ 12728 - ❌ 12729 - ❌ 12730 12731 12732 .. list-table:: **test-macosx1470-64-shippable/opt** 12733 :widths: 30 15 15 15 15 12734 :header-rows: 1 12735 12736 * - **Test Name** 12737 - mozilla-central 12738 - autoland 12739 - mozilla-release 12740 - mozilla-beta 12741 * - **browsertime-indexeddb-chrome-addkBL1** 12742 - ❌ 12743 - ❌ 12744 - ❌ 12745 - ❌ 12746 * - **browsertime-indexeddb-firefox-addkBL1** 12747 - ✅ 12748 - ✅ 12749 - ❌ 12750 - ❌ 12751 12752 12753 .. list-table:: **test-macosx1470-64/opt** 12754 :widths: 30 15 15 15 15 12755 :header-rows: 1 12756 12757 * - **Test Name** 12758 - mozilla-central 12759 - autoland 12760 - mozilla-release 12761 - mozilla-beta 12762 * - **browsertime-indexeddb-firefox-addkBL1** 12763 - ❌ 12764 - ❌ 12765 - ❌ 12766 - ❌ 12767 12768 12769 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 12770 :widths: 30 15 15 15 15 12771 :header-rows: 1 12772 12773 * - **Test Name** 12774 - mozilla-central 12775 - autoland 12776 - mozilla-release 12777 - mozilla-beta 12778 * - **browsertime-indexeddb-firefox-addkBL1** 12779 - ❌ 12780 - ❌ 12781 - ❌ 12782 - ❌ 12783 12784 12785 .. list-table:: **test-windows11-64-24h2-shippable/opt** 12786 :widths: 30 15 15 15 15 12787 :header-rows: 1 12788 12789 * - **Test Name** 12790 - mozilla-central 12791 - autoland 12792 - mozilla-release 12793 - mozilla-beta 12794 * - **browsertime-indexeddb-chrome-addkBL1** 12795 - ❌ 12796 - ❌ 12797 - ❌ 12798 - ❌ 12799 * - **browsertime-indexeddb-firefox-addkBL1** 12800 - ✅ 12801 - ✅ 12802 - ❌ 12803 - ❌ 12804 12805 12806 .. list-table:: **test-windows11-64-24h2/opt** 12807 :widths: 30 15 15 15 15 12808 :header-rows: 1 12809 12810 * - **Test Name** 12811 - mozilla-central 12812 - autoland 12813 - mozilla-release 12814 - mozilla-beta 12815 * - **browsertime-indexeddb-firefox-addkBL1** 12816 - ❌ 12817 - ❌ 12818 - ❌ 12819 - ❌ 12820 12821 12822 12823 .. dropdown:: addkBLN 12824 :class-container: anchor-id-addkBLN-c 12825 12826 * Command to Run Locally 12827 12828 .. code-block:: 12829 12830 ./mach raptor -t addkBLN 12831 12832 **Owner**: DOM Lifecycle, Workers and Storage Team 12833 12834 **Description**: Use add API to send a couple of large Blobs to IndexedDB independently 12835 12836 * **alert threshold**: 2.0 12837 * **apps**: firefox, chrome, safari 12838 * **browser cycles**: 1 12839 * **browsertime args**: --browsertime.iterations=128 --browsertime.chunk_size=1048576 --browsertime.buffer_type=Blob --browsertime.atomic=0 12840 * **custom data**: true 12841 * **expected**: pass 12842 * **gecko profile entries**: 131072000 12843 * **gecko profile features**: js,stackwalk,cpu,memory 12844 * **gecko profile threads**: GeckoMain,DOM Worker,IndexedDB 12845 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-indexeddb.toml#94>`__ 12846 * **lower is better**: true 12847 * **measure**: cpuTime 12848 * **output timeout**: 2000000 12849 * **page cycles**: 1 12850 * **page timeout**: 1800000 12851 * **playback**: mitmproxy 12852 * **playback pageset manifest**: mitm8-linux-firefox-example.manifest 12853 * **subtest unit**: ms 12854 * **test script**: indexeddb_write.js 12855 * **test summary**: flatten 12856 * **test url**: `<https://www.example.com>`__ 12857 * **type**: pageload 12858 * **unit**: ms 12859 * **use live sites**: false 12860 * **Test Task**: 12861 12862 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 12863 :widths: 30 15 15 15 15 12864 :header-rows: 1 12865 12866 * - **Test Name** 12867 - mozilla-central 12868 - autoland 12869 - mozilla-release 12870 - mozilla-beta 12871 * - **browsertime-indexeddb-firefox-addkBLN** 12872 - ❌ 12873 - ❌ 12874 - ❌ 12875 - ❌ 12876 12877 12878 .. list-table:: **test-linux1804-64-qr/opt** 12879 :widths: 30 15 15 15 15 12880 :header-rows: 1 12881 12882 * - **Test Name** 12883 - mozilla-central 12884 - autoland 12885 - mozilla-release 12886 - mozilla-beta 12887 * - **browsertime-indexeddb-firefox-addkBLN** 12888 - ❌ 12889 - ❌ 12890 - ❌ 12891 - ❌ 12892 12893 12894 .. list-table:: **test-linux1804-64-shippable-qr/opt** 12895 :widths: 30 15 15 15 15 12896 :header-rows: 1 12897 12898 * - **Test Name** 12899 - mozilla-central 12900 - autoland 12901 - mozilla-release 12902 - mozilla-beta 12903 * - **browsertime-indexeddb-chrome-addkBLN** 12904 - ❌ 12905 - ❌ 12906 - ❌ 12907 - ❌ 12908 * - **browsertime-indexeddb-firefox-addkBLN** 12909 - ✅ 12910 - ✅ 12911 - ❌ 12912 - ❌ 12913 12914 12915 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 12916 :widths: 30 15 15 15 15 12917 :header-rows: 1 12918 12919 * - **Test Name** 12920 - mozilla-central 12921 - autoland 12922 - mozilla-release 12923 - mozilla-beta 12924 * - **browsertime-indexeddb-firefox-addkBLN** 12925 - ❌ 12926 - ❌ 12927 - ❌ 12928 - ❌ 12929 12930 12931 .. list-table:: **test-macosx1470-64-shippable/opt** 12932 :widths: 30 15 15 15 15 12933 :header-rows: 1 12934 12935 * - **Test Name** 12936 - mozilla-central 12937 - autoland 12938 - mozilla-release 12939 - mozilla-beta 12940 * - **browsertime-indexeddb-chrome-addkBLN** 12941 - ❌ 12942 - ❌ 12943 - ❌ 12944 - ❌ 12945 * - **browsertime-indexeddb-firefox-addkBLN** 12946 - ✅ 12947 - ✅ 12948 - ❌ 12949 - ❌ 12950 12951 12952 .. list-table:: **test-macosx1470-64/opt** 12953 :widths: 30 15 15 15 15 12954 :header-rows: 1 12955 12956 * - **Test Name** 12957 - mozilla-central 12958 - autoland 12959 - mozilla-release 12960 - mozilla-beta 12961 * - **browsertime-indexeddb-firefox-addkBLN** 12962 - ❌ 12963 - ❌ 12964 - ❌ 12965 - ❌ 12966 12967 12968 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 12969 :widths: 30 15 15 15 15 12970 :header-rows: 1 12971 12972 * - **Test Name** 12973 - mozilla-central 12974 - autoland 12975 - mozilla-release 12976 - mozilla-beta 12977 * - **browsertime-indexeddb-firefox-addkBLN** 12978 - ❌ 12979 - ❌ 12980 - ❌ 12981 - ❌ 12982 12983 12984 .. list-table:: **test-windows11-64-24h2-shippable/opt** 12985 :widths: 30 15 15 15 15 12986 :header-rows: 1 12987 12988 * - **Test Name** 12989 - mozilla-central 12990 - autoland 12991 - mozilla-release 12992 - mozilla-beta 12993 * - **browsertime-indexeddb-chrome-addkBLN** 12994 - ❌ 12995 - ❌ 12996 - ❌ 12997 - ❌ 12998 * - **browsertime-indexeddb-firefox-addkBLN** 12999 - ✅ 13000 - ✅ 13001 - ❌ 13002 - ❌ 13003 13004 13005 .. list-table:: **test-windows11-64-24h2/opt** 13006 :widths: 30 15 15 15 15 13007 :header-rows: 1 13008 13009 * - **Test Name** 13010 - mozilla-central 13011 - autoland 13012 - mozilla-release 13013 - mozilla-beta 13014 * - **browsertime-indexeddb-firefox-addkBLN** 13015 - ❌ 13016 - ❌ 13017 - ❌ 13018 - ❌ 13019 13020 13021 13022 .. dropdown:: browsertime 13023 :class-container: anchor-id-browsertime-c 13024 13025 * Command to Run Locally 13026 13027 .. code-block:: 13028 13029 ./mach raptor -t browsertime 13030 13031 **Owner**: PerfTest Team 13032 13033 **Description**: Used to run vanilla browsertime tests through raptor. For example: `./mach raptor -t browsertime --browsertime-arg url=https://www.sitespeed.io --browsertime-arg iterations=3` 13034 13035 * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__ 13036 * **alert threshold**: 2.0 13037 * **apps**: firefox 13038 * **browser cycles**: 1 13039 * **expected**: pass 13040 * **gecko profile interval**: 1 13041 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-custom.toml#17>`__ 13042 * **lower is better**: true 13043 * **measure**: fnbpaint, fcp, dcf, loadtime 13044 * **page cycles**: 1 13045 * **page timeout**: 60000 13046 * **playback**: mitmproxy 13047 * **playback pageset manifest**: null.manifest 13048 * **playback version**: 11.0.0 13049 * **support class**: browsertime_pageload.py 13050 * **test script**: None 13051 * **test url**: `<None>`__ 13052 * **type**: pageload 13053 * **unit**: ms 13054 * **use live sites**: true 13055 13056 .. dropdown:: connect 13057 :class-container: anchor-id-connect-c 13058 13059 * Command to Run Locally 13060 13061 .. code-block:: 13062 13063 ./mach raptor -t connect 13064 13065 **Owner**: Network Team 13066 13067 **Description**: Verifies that connection time on a pageload is zero when a speculative connection has first been made 13068 13069 * **alert change type**: absolute 13070 * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__ 13071 * **alert threshold**: 10.0 13072 * **apps**: firefox 13073 * **browser cycles**: 3 13074 * **cold**: true 13075 * **custom data**: true 13076 * **expected**: pass 13077 * **gecko profile interval**: 1 13078 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-speculative.toml#18>`__ 13079 * **lower is better**: true 13080 * **page cycles**: 1 13081 * **page timeout**: 60000 13082 * **test script**: speculative-connect.js 13083 * **test url**: `<None>`__ 13084 * **type**: pageload 13085 * **unit**: ms 13086 * **use live sites**: true 13087 * **Test Task**: 13088 13089 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 13090 :widths: 30 15 15 15 15 13091 :header-rows: 1 13092 13093 * - **Test Name** 13094 - mozilla-central 13095 - autoland 13096 - mozilla-release 13097 - mozilla-beta 13098 * - **browsertime-speculative-firefox-connect** 13099 - ❌ 13100 - ❌ 13101 - ❌ 13102 - ❌ 13103 13104 13105 .. list-table:: **test-linux1804-64-qr/opt** 13106 :widths: 30 15 15 15 15 13107 :header-rows: 1 13108 13109 * - **Test Name** 13110 - mozilla-central 13111 - autoland 13112 - mozilla-release 13113 - mozilla-beta 13114 * - **browsertime-speculative-firefox-connect** 13115 - ❌ 13116 - ❌ 13117 - ❌ 13118 - ❌ 13119 13120 13121 .. list-table:: **test-linux1804-64-shippable-qr/opt** 13122 :widths: 30 15 15 15 15 13123 :header-rows: 1 13124 13125 * - **Test Name** 13126 - mozilla-central 13127 - autoland 13128 - mozilla-release 13129 - mozilla-beta 13130 * - **browsertime-speculative-firefox-connect** 13131 - ❌ 13132 - ✅ 13133 - ❌ 13134 - ❌ 13135 13136 13137 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 13138 :widths: 30 15 15 15 15 13139 :header-rows: 1 13140 13141 * - **Test Name** 13142 - mozilla-central 13143 - autoland 13144 - mozilla-release 13145 - mozilla-beta 13146 * - **browsertime-speculative-firefox-connect** 13147 - ❌ 13148 - ❌ 13149 - ❌ 13150 - ❌ 13151 13152 13153 .. list-table:: **test-macosx1470-64-shippable/opt** 13154 :widths: 30 15 15 15 15 13155 :header-rows: 1 13156 13157 * - **Test Name** 13158 - mozilla-central 13159 - autoland 13160 - mozilla-release 13161 - mozilla-beta 13162 * - **browsertime-speculative-firefox-connect** 13163 - ❌ 13164 - ✅ 13165 - ❌ 13166 - ❌ 13167 13168 13169 .. list-table:: **test-macosx1470-64/opt** 13170 :widths: 30 15 15 15 15 13171 :header-rows: 1 13172 13173 * - **Test Name** 13174 - mozilla-central 13175 - autoland 13176 - mozilla-release 13177 - mozilla-beta 13178 * - **browsertime-speculative-firefox-connect** 13179 - ❌ 13180 - ❌ 13181 - ❌ 13182 - ❌ 13183 13184 13185 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 13186 :widths: 30 15 15 15 15 13187 :header-rows: 1 13188 13189 * - **Test Name** 13190 - mozilla-central 13191 - autoland 13192 - mozilla-release 13193 - mozilla-beta 13194 * - **browsertime-speculative-firefox-connect** 13195 - ❌ 13196 - ❌ 13197 - ❌ 13198 - ❌ 13199 13200 13201 .. list-table:: **test-windows11-64-24h2-shippable/opt** 13202 :widths: 30 15 15 15 15 13203 :header-rows: 1 13204 13205 * - **Test Name** 13206 - mozilla-central 13207 - autoland 13208 - mozilla-release 13209 - mozilla-beta 13210 * - **browsertime-speculative-firefox-connect** 13211 - ❌ 13212 - ✅ 13213 - ❌ 13214 - ❌ 13215 13216 13217 .. list-table:: **test-windows11-64-24h2/opt** 13218 :widths: 30 15 15 15 15 13219 :header-rows: 1 13220 13221 * - **Test Name** 13222 - mozilla-central 13223 - autoland 13224 - mozilla-release 13225 - mozilla-beta 13226 * - **browsertime-speculative-firefox-connect** 13227 - ❌ 13228 - ❌ 13229 - ❌ 13230 - ❌ 13231 13232 13233 13234 .. dropdown:: constant-regression 13235 :class-container: anchor-id-constant-regression-c 13236 13237 * Command to Run Locally 13238 13239 .. code-block:: 13240 13241 ./mach raptor -t constant-regression 13242 13243 **Owner**: PerfTest Team 13244 13245 **Description**: Generates a constant value that can be changed to induce a regression. 13246 13247 * **alert threshold**: 2.0 13248 * **apps**: firefox, chrome, safari, geckoview, fenix 13249 * **browser cycles**: 1 13250 * **browsertime args**: --browsertime.constant_value=1500 13251 * **custom data**: true 13252 * **expected**: pass 13253 * **fore window**: 1 13254 * **gecko profile interval**: 1 13255 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-regression-test.toml#23>`__ 13256 * **lower is better**: true 13257 * **max back window**: 3 13258 * **min back window**: 2 13259 * **output timeout**: 2000000 13260 * **page cycles**: 1 13261 * **page timeout**: 1800000 13262 * **subtest unit**: ms 13263 * **test script**: constant_regression_test.js 13264 * **test summary**: flatten 13265 * **test url**: `<None>`__ 13266 * **type**: pageload 13267 * **unit**: score 13268 * **use live sites**: true 13269 * **Test Task**: 13270 13271 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 13272 :widths: 30 15 15 15 15 13273 :header-rows: 1 13274 13275 * - **Test Name** 13276 - mozilla-central 13277 - autoland 13278 - mozilla-release 13279 - mozilla-beta 13280 * - **browsertime-regression-tests-firefox-constant-regression** 13281 - ❌ 13282 - ✅ 13283 - ❌ 13284 - ❌ 13285 13286 13287 .. list-table:: **test-linux1804-64-qr/opt** 13288 :widths: 30 15 15 15 15 13289 :header-rows: 1 13290 13291 * - **Test Name** 13292 - mozilla-central 13293 - autoland 13294 - mozilla-release 13295 - mozilla-beta 13296 * - **browsertime-regression-tests-firefox-constant-regression** 13297 - ❌ 13298 - ✅ 13299 - ❌ 13300 - ❌ 13301 13302 13303 13304 .. dropdown:: getkeyrng 13305 :class-container: anchor-id-getkeyrng-c 13306 13307 * Command to Run Locally 13308 13309 .. code-block:: 13310 13311 ./mach raptor -t getkeyrng 13312 13313 **Owner**: DOM Lifecycle, Workers and Storage Team 13314 13315 **Description**: Measures the speed of key-range based reads of IndexedDB 13316 13317 * **alert threshold**: 2.0 13318 * **apps**: firefox, chrome, safari 13319 * **browser cycles**: 1 13320 * **custom data**: true 13321 * **expected**: pass 13322 * **gecko profile entries**: 131072000 13323 * **gecko profile features**: js,stackwalk,cpu,memory 13324 * **gecko profile threads**: GeckoMain,DOM Worker,IndexedDB 13325 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-indexeddb.toml#98>`__ 13326 * **lower is better**: true 13327 * **measure**: cpuTime 13328 * **output timeout**: 2000000 13329 * **page cycles**: 1 13330 * **page timeout**: 1800000 13331 * **playback**: mitmproxy 13332 * **playback pageset manifest**: mitm8-linux-firefox-example.manifest 13333 * **subtest unit**: ms 13334 * **support class**: browsertime_pageload.py 13335 * **test script**: indexeddb_getkeyrange.js 13336 * **test summary**: flatten 13337 * **test url**: `<https://www.example.com>`__ 13338 * **type**: pageload 13339 * **unit**: ms 13340 * **use live sites**: false 13341 * **Test Task**: 13342 13343 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 13344 :widths: 30 15 15 15 15 13345 :header-rows: 1 13346 13347 * - **Test Name** 13348 - mozilla-central 13349 - autoland 13350 - mozilla-release 13351 - mozilla-beta 13352 * - **browsertime-indexeddb-firefox-getkeyrng** 13353 - ❌ 13354 - ❌ 13355 - ❌ 13356 - ❌ 13357 13358 13359 .. list-table:: **test-linux1804-64-qr/opt** 13360 :widths: 30 15 15 15 15 13361 :header-rows: 1 13362 13363 * - **Test Name** 13364 - mozilla-central 13365 - autoland 13366 - mozilla-release 13367 - mozilla-beta 13368 * - **browsertime-indexeddb-firefox-getkeyrng** 13369 - ❌ 13370 - ❌ 13371 - ❌ 13372 - ❌ 13373 13374 13375 .. list-table:: **test-linux1804-64-shippable-qr/opt** 13376 :widths: 30 15 15 15 15 13377 :header-rows: 1 13378 13379 * - **Test Name** 13380 - mozilla-central 13381 - autoland 13382 - mozilla-release 13383 - mozilla-beta 13384 * - **browsertime-indexeddb-chrome-getkeyrng** 13385 - ❌ 13386 - ❌ 13387 - ❌ 13388 - ❌ 13389 * - **browsertime-indexeddb-firefox-getkeyrng** 13390 - ✅ 13391 - ✅ 13392 - ❌ 13393 - ❌ 13394 13395 13396 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 13397 :widths: 30 15 15 15 15 13398 :header-rows: 1 13399 13400 * - **Test Name** 13401 - mozilla-central 13402 - autoland 13403 - mozilla-release 13404 - mozilla-beta 13405 * - **browsertime-indexeddb-firefox-getkeyrng** 13406 - ❌ 13407 - ❌ 13408 - ❌ 13409 - ❌ 13410 13411 13412 .. list-table:: **test-macosx1470-64-shippable/opt** 13413 :widths: 30 15 15 15 15 13414 :header-rows: 1 13415 13416 * - **Test Name** 13417 - mozilla-central 13418 - autoland 13419 - mozilla-release 13420 - mozilla-beta 13421 * - **browsertime-indexeddb-chrome-getkeyrng** 13422 - ❌ 13423 - ❌ 13424 - ❌ 13425 - ❌ 13426 * - **browsertime-indexeddb-firefox-getkeyrng** 13427 - ✅ 13428 - ✅ 13429 - ❌ 13430 - ❌ 13431 13432 13433 .. list-table:: **test-macosx1470-64/opt** 13434 :widths: 30 15 15 15 15 13435 :header-rows: 1 13436 13437 * - **Test Name** 13438 - mozilla-central 13439 - autoland 13440 - mozilla-release 13441 - mozilla-beta 13442 * - **browsertime-indexeddb-firefox-getkeyrng** 13443 - ❌ 13444 - ❌ 13445 - ❌ 13446 - ❌ 13447 13448 13449 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 13450 :widths: 30 15 15 15 15 13451 :header-rows: 1 13452 13453 * - **Test Name** 13454 - mozilla-central 13455 - autoland 13456 - mozilla-release 13457 - mozilla-beta 13458 * - **browsertime-indexeddb-firefox-getkeyrng** 13459 - ❌ 13460 - ❌ 13461 - ❌ 13462 - ❌ 13463 13464 13465 .. list-table:: **test-windows11-64-24h2-shippable/opt** 13466 :widths: 30 15 15 15 15 13467 :header-rows: 1 13468 13469 * - **Test Name** 13470 - mozilla-central 13471 - autoland 13472 - mozilla-release 13473 - mozilla-beta 13474 * - **browsertime-indexeddb-chrome-getkeyrng** 13475 - ❌ 13476 - ❌ 13477 - ❌ 13478 - ❌ 13479 * - **browsertime-indexeddb-firefox-getkeyrng** 13480 - ✅ 13481 - ✅ 13482 - ❌ 13483 - ❌ 13484 13485 13486 .. list-table:: **test-windows11-64-24h2/opt** 13487 :widths: 30 15 15 15 15 13488 :header-rows: 1 13489 13490 * - **Test Name** 13491 - mozilla-central 13492 - autoland 13493 - mozilla-release 13494 - mozilla-beta 13495 * - **browsertime-indexeddb-firefox-getkeyrng** 13496 - ❌ 13497 - ❌ 13498 - ❌ 13499 - ❌ 13500 13501 13502 13503 .. dropdown:: h2-download 13504 :class-container: anchor-id-h2-download-c 13505 13506 * Command to Run Locally 13507 13508 .. code-block:: 13509 13510 ./mach raptor -t h2-download 13511 13512 **Owner**: Network Team 13513 13514 **Description**: Measures HTTP/2 download throughput with a local server 13515 13516 * **alert threshold**: 2.0 13517 * **apps**: firefox, chrome, custom-car 13518 * **browser cycles**: 1 13519 * **browsertime args**: --browsertime.test_type=h2_download --browsertime.iterations=10 --firefox.preference=network.http.http3.enable:false 13520 * **custom data**: true 13521 * **expected**: pass 13522 * **gecko profile interval**: 1 13523 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-network-bench.toml#38>`__ 13524 * **lower is better**: false 13525 * **output timeout**: 2000000 13526 * **page cycles**: 1 13527 * **page timeout**: 1800000 13528 * **subtest lower is better**: false 13529 * **subtest name filters**: tests/,iterations/ 13530 * **subtest unit**: mbps 13531 * **support class**: network_bench.py 13532 * **test script**: network_bench.js 13533 * **test url**: `<None>`__ 13534 * **type**: pageload 13535 * **unit**: mbps 13536 * **Test Task**: 13537 13538 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 13539 :widths: 30 15 15 15 15 13540 :header-rows: 1 13541 13542 * - **Test Name** 13543 - mozilla-central 13544 - autoland 13545 - mozilla-release 13546 - mozilla-beta 13547 * - **browsertime-network-bench-firefox-h2-download** 13548 - ❌ 13549 - ❌ 13550 - ❌ 13551 - ❌ 13552 * - **browsertime-network-bench-firefox-h2-download-100M_40ms-0** 13553 - ❌ 13554 - ❌ 13555 - ❌ 13556 - ❌ 13557 * - **browsertime-network-bench-firefox-h2-download-10M_40ms-0** 13558 - ❌ 13559 - ❌ 13560 - ❌ 13561 - ❌ 13562 * - **browsertime-network-bench-firefox-h2-download-1M_400ms-0** 13563 - ❌ 13564 - ❌ 13565 - ❌ 13566 - ❌ 13567 * - **browsertime-network-bench-firefox-h2-download-300M_40ms-0** 13568 - ❌ 13569 - ❌ 13570 - ❌ 13571 - ❌ 13572 * - **browsertime-network-bench-firefox-h2-download-300M_80ms-0** 13573 - ❌ 13574 - ❌ 13575 - ❌ 13576 - ❌ 13577 13578 13579 .. list-table:: **test-linux1804-64-qr/opt** 13580 :widths: 30 15 15 15 15 13581 :header-rows: 1 13582 13583 * - **Test Name** 13584 - mozilla-central 13585 - autoland 13586 - mozilla-release 13587 - mozilla-beta 13588 * - **browsertime-network-bench-firefox-h2-download** 13589 - ❌ 13590 - ❌ 13591 - ❌ 13592 - ❌ 13593 * - **browsertime-network-bench-firefox-h2-download-100M_40ms-0** 13594 - ❌ 13595 - ❌ 13596 - ❌ 13597 - ❌ 13598 * - **browsertime-network-bench-firefox-h2-download-10M_40ms-0** 13599 - ❌ 13600 - ❌ 13601 - ❌ 13602 - ❌ 13603 * - **browsertime-network-bench-firefox-h2-download-1M_400ms-0** 13604 - ❌ 13605 - ❌ 13606 - ❌ 13607 - ❌ 13608 * - **browsertime-network-bench-firefox-h2-download-300M_40ms-0** 13609 - ❌ 13610 - ❌ 13611 - ❌ 13612 - ❌ 13613 * - **browsertime-network-bench-firefox-h2-download-300M_80ms-0** 13614 - ❌ 13615 - ❌ 13616 - ❌ 13617 - ❌ 13618 13619 13620 .. list-table:: **test-linux1804-64-shippable-qr/opt** 13621 :widths: 30 15 15 15 15 13622 :header-rows: 1 13623 13624 * - **Test Name** 13625 - mozilla-central 13626 - autoland 13627 - mozilla-release 13628 - mozilla-beta 13629 * - **browsertime-network-bench-chrome-h2-download** 13630 - ✅ 13631 - ❌ 13632 - ❌ 13633 - ❌ 13634 * - **browsertime-network-bench-chrome-h2-download-100M_40ms-0** 13635 - ✅ 13636 - ❌ 13637 - ❌ 13638 - ❌ 13639 * - **browsertime-network-bench-chrome-h2-download-10M_40ms-0** 13640 - ✅ 13641 - ❌ 13642 - ❌ 13643 - ❌ 13644 * - **browsertime-network-bench-chrome-h2-download-1M_400ms-0** 13645 - ✅ 13646 - ❌ 13647 - ❌ 13648 - ❌ 13649 * - **browsertime-network-bench-chrome-h2-download-300M_40ms-0** 13650 - ✅ 13651 - ❌ 13652 - ❌ 13653 - ❌ 13654 * - **browsertime-network-bench-chrome-h2-download-300M_80ms-0** 13655 - ✅ 13656 - ❌ 13657 - ❌ 13658 - ❌ 13659 * - **browsertime-network-bench-custom-car-h2-download** 13660 - ✅ 13661 - ❌ 13662 - ❌ 13663 - ❌ 13664 * - **browsertime-network-bench-custom-car-h2-download-100M_40ms-0** 13665 - ✅ 13666 - ❌ 13667 - ❌ 13668 - ❌ 13669 * - **browsertime-network-bench-custom-car-h2-download-10M_40ms-0** 13670 - ✅ 13671 - ❌ 13672 - ❌ 13673 - ❌ 13674 * - **browsertime-network-bench-custom-car-h2-download-1M_400ms-0** 13675 - ✅ 13676 - ❌ 13677 - ❌ 13678 - ❌ 13679 * - **browsertime-network-bench-custom-car-h2-download-300M_40ms-0** 13680 - ✅ 13681 - ❌ 13682 - ❌ 13683 - ❌ 13684 * - **browsertime-network-bench-custom-car-h2-download-300M_80ms-0** 13685 - ✅ 13686 - ❌ 13687 - ❌ 13688 - ❌ 13689 * - **browsertime-network-bench-firefox-h2-download** 13690 - ✅ 13691 - ❌ 13692 - ❌ 13693 - ❌ 13694 * - **browsertime-network-bench-firefox-h2-download-100M_40ms-0** 13695 - ✅ 13696 - ❌ 13697 - ❌ 13698 - ❌ 13699 * - **browsertime-network-bench-firefox-h2-download-10M_40ms-0** 13700 - ✅ 13701 - ❌ 13702 - ❌ 13703 - ❌ 13704 * - **browsertime-network-bench-firefox-h2-download-1M_400ms-0** 13705 - ✅ 13706 - ❌ 13707 - ❌ 13708 - ❌ 13709 * - **browsertime-network-bench-firefox-h2-download-300M_40ms-0** 13710 - ✅ 13711 - ❌ 13712 - ❌ 13713 - ❌ 13714 * - **browsertime-network-bench-firefox-h2-download-300M_80ms-0** 13715 - ✅ 13716 - ❌ 13717 - ❌ 13718 - ❌ 13719 13720 13721 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 13722 :widths: 30 15 15 15 15 13723 :header-rows: 1 13724 13725 * - **Test Name** 13726 - mozilla-central 13727 - autoland 13728 - mozilla-release 13729 - mozilla-beta 13730 * - **browsertime-network-bench-firefox-h2-download** 13731 - ❌ 13732 - ❌ 13733 - ❌ 13734 - ❌ 13735 * - **browsertime-network-bench-firefox-h2-download-100M_40ms-0** 13736 - ❌ 13737 - ❌ 13738 - ❌ 13739 - ❌ 13740 * - **browsertime-network-bench-firefox-h2-download-10M_40ms-0** 13741 - ❌ 13742 - ❌ 13743 - ❌ 13744 - ❌ 13745 * - **browsertime-network-bench-firefox-h2-download-1M_400ms-0** 13746 - ❌ 13747 - ❌ 13748 - ❌ 13749 - ❌ 13750 * - **browsertime-network-bench-firefox-h2-download-300M_40ms-0** 13751 - ❌ 13752 - ❌ 13753 - ❌ 13754 - ❌ 13755 * - **browsertime-network-bench-firefox-h2-download-300M_80ms-0** 13756 - ❌ 13757 - ❌ 13758 - ❌ 13759 - ❌ 13760 13761 13762 .. list-table:: **test-macosx1470-64-shippable/opt** 13763 :widths: 30 15 15 15 15 13764 :header-rows: 1 13765 13766 * - **Test Name** 13767 - mozilla-central 13768 - autoland 13769 - mozilla-release 13770 - mozilla-beta 13771 * - **browsertime-network-bench-chrome-h2-download** 13772 - ❌ 13773 - ❌ 13774 - ❌ 13775 - ❌ 13776 * - **browsertime-network-bench-chrome-h2-download-100M_40ms-0** 13777 - ❌ 13778 - ❌ 13779 - ❌ 13780 - ❌ 13781 * - **browsertime-network-bench-chrome-h2-download-10M_40ms-0** 13782 - ❌ 13783 - ❌ 13784 - ❌ 13785 - ❌ 13786 * - **browsertime-network-bench-chrome-h2-download-1M_400ms-0** 13787 - ❌ 13788 - ❌ 13789 - ❌ 13790 - ❌ 13791 * - **browsertime-network-bench-chrome-h2-download-300M_40ms-0** 13792 - ❌ 13793 - ❌ 13794 - ❌ 13795 - ❌ 13796 * - **browsertime-network-bench-chrome-h2-download-300M_80ms-0** 13797 - ❌ 13798 - ❌ 13799 - ❌ 13800 - ❌ 13801 * - **browsertime-network-bench-custom-car-h2-download** 13802 - ❌ 13803 - ❌ 13804 - ❌ 13805 - ❌ 13806 * - **browsertime-network-bench-custom-car-h2-download-100M_40ms-0** 13807 - ❌ 13808 - ❌ 13809 - ❌ 13810 - ❌ 13811 * - **browsertime-network-bench-custom-car-h2-download-10M_40ms-0** 13812 - ❌ 13813 - ❌ 13814 - ❌ 13815 - ❌ 13816 * - **browsertime-network-bench-custom-car-h2-download-1M_400ms-0** 13817 - ❌ 13818 - ❌ 13819 - ❌ 13820 - ❌ 13821 * - **browsertime-network-bench-custom-car-h2-download-300M_40ms-0** 13822 - ❌ 13823 - ❌ 13824 - ❌ 13825 - ❌ 13826 * - **browsertime-network-bench-custom-car-h2-download-300M_80ms-0** 13827 - ❌ 13828 - ❌ 13829 - ❌ 13830 - ❌ 13831 * - **browsertime-network-bench-firefox-h2-download** 13832 - ❌ 13833 - ❌ 13834 - ❌ 13835 - ❌ 13836 * - **browsertime-network-bench-firefox-h2-download-100M_40ms-0** 13837 - ❌ 13838 - ❌ 13839 - ❌ 13840 - ❌ 13841 * - **browsertime-network-bench-firefox-h2-download-10M_40ms-0** 13842 - ❌ 13843 - ❌ 13844 - ❌ 13845 - ❌ 13846 * - **browsertime-network-bench-firefox-h2-download-1M_400ms-0** 13847 - ❌ 13848 - ❌ 13849 - ❌ 13850 - ❌ 13851 * - **browsertime-network-bench-firefox-h2-download-300M_40ms-0** 13852 - ❌ 13853 - ❌ 13854 - ❌ 13855 - ❌ 13856 * - **browsertime-network-bench-firefox-h2-download-300M_80ms-0** 13857 - ❌ 13858 - ❌ 13859 - ❌ 13860 - ❌ 13861 13862 13863 .. list-table:: **test-macosx1470-64/opt** 13864 :widths: 30 15 15 15 15 13865 :header-rows: 1 13866 13867 * - **Test Name** 13868 - mozilla-central 13869 - autoland 13870 - mozilla-release 13871 - mozilla-beta 13872 * - **browsertime-network-bench-firefox-h2-download** 13873 - ❌ 13874 - ❌ 13875 - ❌ 13876 - ❌ 13877 * - **browsertime-network-bench-firefox-h2-download-100M_40ms-0** 13878 - ❌ 13879 - ❌ 13880 - ❌ 13881 - ❌ 13882 * - **browsertime-network-bench-firefox-h2-download-10M_40ms-0** 13883 - ❌ 13884 - ❌ 13885 - ❌ 13886 - ❌ 13887 * - **browsertime-network-bench-firefox-h2-download-1M_400ms-0** 13888 - ❌ 13889 - ❌ 13890 - ❌ 13891 - ❌ 13892 * - **browsertime-network-bench-firefox-h2-download-300M_40ms-0** 13893 - ❌ 13894 - ❌ 13895 - ❌ 13896 - ❌ 13897 * - **browsertime-network-bench-firefox-h2-download-300M_80ms-0** 13898 - ❌ 13899 - ❌ 13900 - ❌ 13901 - ❌ 13902 13903 13904 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 13905 :widths: 30 15 15 15 15 13906 :header-rows: 1 13907 13908 * - **Test Name** 13909 - mozilla-central 13910 - autoland 13911 - mozilla-release 13912 - mozilla-beta 13913 * - **browsertime-network-bench-firefox-h2-download** 13914 - ❌ 13915 - ❌ 13916 - ❌ 13917 - ❌ 13918 * - **browsertime-network-bench-firefox-h2-download-100M_40ms-0** 13919 - ❌ 13920 - ❌ 13921 - ❌ 13922 - ❌ 13923 * - **browsertime-network-bench-firefox-h2-download-10M_40ms-0** 13924 - ❌ 13925 - ❌ 13926 - ❌ 13927 - ❌ 13928 * - **browsertime-network-bench-firefox-h2-download-1M_400ms-0** 13929 - ❌ 13930 - ❌ 13931 - ❌ 13932 - ❌ 13933 * - **browsertime-network-bench-firefox-h2-download-300M_40ms-0** 13934 - ❌ 13935 - ❌ 13936 - ❌ 13937 - ❌ 13938 * - **browsertime-network-bench-firefox-h2-download-300M_80ms-0** 13939 - ❌ 13940 - ❌ 13941 - ❌ 13942 - ❌ 13943 13944 13945 .. list-table:: **test-windows11-64-24h2-shippable/opt** 13946 :widths: 30 15 15 15 15 13947 :header-rows: 1 13948 13949 * - **Test Name** 13950 - mozilla-central 13951 - autoland 13952 - mozilla-release 13953 - mozilla-beta 13954 * - **browsertime-network-bench-chrome-h2-download** 13955 - ❌ 13956 - ❌ 13957 - ❌ 13958 - ❌ 13959 * - **browsertime-network-bench-chrome-h2-download-100M_40ms-0** 13960 - ❌ 13961 - ❌ 13962 - ❌ 13963 - ❌ 13964 * - **browsertime-network-bench-chrome-h2-download-10M_40ms-0** 13965 - ❌ 13966 - ❌ 13967 - ❌ 13968 - ❌ 13969 * - **browsertime-network-bench-chrome-h2-download-1M_400ms-0** 13970 - ❌ 13971 - ❌ 13972 - ❌ 13973 - ❌ 13974 * - **browsertime-network-bench-chrome-h2-download-300M_40ms-0** 13975 - ❌ 13976 - ❌ 13977 - ❌ 13978 - ❌ 13979 * - **browsertime-network-bench-chrome-h2-download-300M_80ms-0** 13980 - ❌ 13981 - ❌ 13982 - ❌ 13983 - ❌ 13984 * - **browsertime-network-bench-custom-car-h2-download** 13985 - ❌ 13986 - ❌ 13987 - ❌ 13988 - ❌ 13989 * - **browsertime-network-bench-custom-car-h2-download-100M_40ms-0** 13990 - ❌ 13991 - ❌ 13992 - ❌ 13993 - ❌ 13994 * - **browsertime-network-bench-custom-car-h2-download-10M_40ms-0** 13995 - ❌ 13996 - ❌ 13997 - ❌ 13998 - ❌ 13999 * - **browsertime-network-bench-custom-car-h2-download-1M_400ms-0** 14000 - ❌ 14001 - ❌ 14002 - ❌ 14003 - ❌ 14004 * - **browsertime-network-bench-custom-car-h2-download-300M_40ms-0** 14005 - ❌ 14006 - ❌ 14007 - ❌ 14008 - ❌ 14009 * - **browsertime-network-bench-custom-car-h2-download-300M_80ms-0** 14010 - ❌ 14011 - ❌ 14012 - ❌ 14013 - ❌ 14014 * - **browsertime-network-bench-firefox-h2-download** 14015 - ❌ 14016 - ❌ 14017 - ❌ 14018 - ❌ 14019 * - **browsertime-network-bench-firefox-h2-download-100M_40ms-0** 14020 - ❌ 14021 - ❌ 14022 - ❌ 14023 - ❌ 14024 * - **browsertime-network-bench-firefox-h2-download-10M_40ms-0** 14025 - ❌ 14026 - ❌ 14027 - ❌ 14028 - ❌ 14029 * - **browsertime-network-bench-firefox-h2-download-1M_400ms-0** 14030 - ❌ 14031 - ❌ 14032 - ❌ 14033 - ❌ 14034 * - **browsertime-network-bench-firefox-h2-download-300M_40ms-0** 14035 - ❌ 14036 - ❌ 14037 - ❌ 14038 - ❌ 14039 * - **browsertime-network-bench-firefox-h2-download-300M_80ms-0** 14040 - ❌ 14041 - ❌ 14042 - ❌ 14043 - ❌ 14044 14045 14046 .. list-table:: **test-windows11-64-24h2/opt** 14047 :widths: 30 15 15 15 15 14048 :header-rows: 1 14049 14050 * - **Test Name** 14051 - mozilla-central 14052 - autoland 14053 - mozilla-release 14054 - mozilla-beta 14055 * - **browsertime-network-bench-firefox-h2-download** 14056 - ❌ 14057 - ❌ 14058 - ❌ 14059 - ❌ 14060 * - **browsertime-network-bench-firefox-h2-download-100M_40ms-0** 14061 - ❌ 14062 - ❌ 14063 - ❌ 14064 - ❌ 14065 * - **browsertime-network-bench-firefox-h2-download-10M_40ms-0** 14066 - ❌ 14067 - ❌ 14068 - ❌ 14069 - ❌ 14070 * - **browsertime-network-bench-firefox-h2-download-1M_400ms-0** 14071 - ❌ 14072 - ❌ 14073 - ❌ 14074 - ❌ 14075 * - **browsertime-network-bench-firefox-h2-download-300M_40ms-0** 14076 - ❌ 14077 - ❌ 14078 - ❌ 14079 - ❌ 14080 * - **browsertime-network-bench-firefox-h2-download-300M_80ms-0** 14081 - ❌ 14082 - ❌ 14083 - ❌ 14084 - ❌ 14085 14086 14087 14088 .. dropdown:: h2-upload 14089 :class-container: anchor-id-h2-upload-c 14090 14091 * Command to Run Locally 14092 14093 .. code-block:: 14094 14095 ./mach raptor -t h2-upload 14096 14097 **Owner**: Network Team 14098 14099 **Description**: Measures HTTP/2 file upload throughput with a local server 14100 14101 * **alert threshold**: 2.0 14102 * **apps**: firefox, chrome, custom-car 14103 * **browser cycles**: 1 14104 * **browsertime args**: --browsertime.test_type=h2_upload --browsertime.iterations=10 --firefox.preference=network.http.http3.enable:false 14105 * **custom data**: true 14106 * **expected**: pass 14107 * **gecko profile interval**: 1 14108 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-network-bench.toml#34>`__ 14109 * **lower is better**: false 14110 * **output timeout**: 2000000 14111 * **page cycles**: 1 14112 * **page timeout**: 1800000 14113 * **subtest lower is better**: false 14114 * **subtest name filters**: tests/,iterations/ 14115 * **subtest unit**: mbps 14116 * **support class**: network_bench.py 14117 * **test script**: network_bench.js 14118 * **test url**: `<None>`__ 14119 * **type**: pageload 14120 * **unit**: mbps 14121 * **Test Task**: 14122 14123 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 14124 :widths: 30 15 15 15 15 14125 :header-rows: 1 14126 14127 * - **Test Name** 14128 - mozilla-central 14129 - autoland 14130 - mozilla-release 14131 - mozilla-beta 14132 * - **browsertime-network-bench-firefox-h2-upload** 14133 - ❌ 14134 - ❌ 14135 - ❌ 14136 - ❌ 14137 * - **browsertime-network-bench-firefox-h2-upload-100M_40ms-0** 14138 - ❌ 14139 - ❌ 14140 - ❌ 14141 - ❌ 14142 * - **browsertime-network-bench-firefox-h2-upload-10M_40ms-0** 14143 - ❌ 14144 - ❌ 14145 - ❌ 14146 - ❌ 14147 * - **browsertime-network-bench-firefox-h2-upload-1M_400ms-0** 14148 - ❌ 14149 - ❌ 14150 - ❌ 14151 - ❌ 14152 * - **browsertime-network-bench-firefox-h2-upload-300M_40ms-0** 14153 - ❌ 14154 - ❌ 14155 - ❌ 14156 - ❌ 14157 * - **browsertime-network-bench-firefox-h2-upload-300M_80ms-0** 14158 - ❌ 14159 - ❌ 14160 - ❌ 14161 - ❌ 14162 14163 14164 .. list-table:: **test-linux1804-64-qr/opt** 14165 :widths: 30 15 15 15 15 14166 :header-rows: 1 14167 14168 * - **Test Name** 14169 - mozilla-central 14170 - autoland 14171 - mozilla-release 14172 - mozilla-beta 14173 * - **browsertime-network-bench-firefox-h2-upload** 14174 - ❌ 14175 - ❌ 14176 - ❌ 14177 - ❌ 14178 * - **browsertime-network-bench-firefox-h2-upload-100M_40ms-0** 14179 - ❌ 14180 - ❌ 14181 - ❌ 14182 - ❌ 14183 * - **browsertime-network-bench-firefox-h2-upload-10M_40ms-0** 14184 - ❌ 14185 - ❌ 14186 - ❌ 14187 - ❌ 14188 * - **browsertime-network-bench-firefox-h2-upload-1M_400ms-0** 14189 - ❌ 14190 - ❌ 14191 - ❌ 14192 - ❌ 14193 * - **browsertime-network-bench-firefox-h2-upload-300M_40ms-0** 14194 - ❌ 14195 - ❌ 14196 - ❌ 14197 - ❌ 14198 * - **browsertime-network-bench-firefox-h2-upload-300M_80ms-0** 14199 - ❌ 14200 - ❌ 14201 - ❌ 14202 - ❌ 14203 14204 14205 .. list-table:: **test-linux1804-64-shippable-qr/opt** 14206 :widths: 30 15 15 15 15 14207 :header-rows: 1 14208 14209 * - **Test Name** 14210 - mozilla-central 14211 - autoland 14212 - mozilla-release 14213 - mozilla-beta 14214 * - **browsertime-network-bench-chrome-h2-upload** 14215 - ✅ 14216 - ❌ 14217 - ❌ 14218 - ❌ 14219 * - **browsertime-network-bench-chrome-h2-upload-100M_40ms-0** 14220 - ✅ 14221 - ❌ 14222 - ❌ 14223 - ❌ 14224 * - **browsertime-network-bench-chrome-h2-upload-10M_40ms-0** 14225 - ✅ 14226 - ❌ 14227 - ❌ 14228 - ❌ 14229 * - **browsertime-network-bench-chrome-h2-upload-1M_400ms-0** 14230 - ✅ 14231 - ❌ 14232 - ❌ 14233 - ❌ 14234 * - **browsertime-network-bench-chrome-h2-upload-300M_40ms-0** 14235 - ✅ 14236 - ❌ 14237 - ❌ 14238 - ❌ 14239 * - **browsertime-network-bench-chrome-h2-upload-300M_80ms-0** 14240 - ✅ 14241 - ❌ 14242 - ❌ 14243 - ❌ 14244 * - **browsertime-network-bench-custom-car-h2-upload** 14245 - ✅ 14246 - ❌ 14247 - ❌ 14248 - ❌ 14249 * - **browsertime-network-bench-custom-car-h2-upload-100M_40ms-0** 14250 - ✅ 14251 - ❌ 14252 - ❌ 14253 - ❌ 14254 * - **browsertime-network-bench-custom-car-h2-upload-10M_40ms-0** 14255 - ✅ 14256 - ❌ 14257 - ❌ 14258 - ❌ 14259 * - **browsertime-network-bench-custom-car-h2-upload-1M_400ms-0** 14260 - ✅ 14261 - ❌ 14262 - ❌ 14263 - ❌ 14264 * - **browsertime-network-bench-custom-car-h2-upload-300M_40ms-0** 14265 - ✅ 14266 - ❌ 14267 - ❌ 14268 - ❌ 14269 * - **browsertime-network-bench-custom-car-h2-upload-300M_80ms-0** 14270 - ✅ 14271 - ❌ 14272 - ❌ 14273 - ❌ 14274 * - **browsertime-network-bench-firefox-h2-upload** 14275 - ✅ 14276 - ❌ 14277 - ❌ 14278 - ❌ 14279 * - **browsertime-network-bench-firefox-h2-upload-100M_40ms-0** 14280 - ✅ 14281 - ❌ 14282 - ❌ 14283 - ❌ 14284 * - **browsertime-network-bench-firefox-h2-upload-10M_40ms-0** 14285 - ✅ 14286 - ❌ 14287 - ❌ 14288 - ❌ 14289 * - **browsertime-network-bench-firefox-h2-upload-1M_400ms-0** 14290 - ✅ 14291 - ❌ 14292 - ❌ 14293 - ❌ 14294 * - **browsertime-network-bench-firefox-h2-upload-300M_40ms-0** 14295 - ✅ 14296 - ❌ 14297 - ❌ 14298 - ❌ 14299 * - **browsertime-network-bench-firefox-h2-upload-300M_80ms-0** 14300 - ✅ 14301 - ❌ 14302 - ❌ 14303 - ❌ 14304 14305 14306 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 14307 :widths: 30 15 15 15 15 14308 :header-rows: 1 14309 14310 * - **Test Name** 14311 - mozilla-central 14312 - autoland 14313 - mozilla-release 14314 - mozilla-beta 14315 * - **browsertime-network-bench-firefox-h2-upload** 14316 - ❌ 14317 - ❌ 14318 - ❌ 14319 - ❌ 14320 * - **browsertime-network-bench-firefox-h2-upload-100M_40ms-0** 14321 - ❌ 14322 - ❌ 14323 - ❌ 14324 - ❌ 14325 * - **browsertime-network-bench-firefox-h2-upload-10M_40ms-0** 14326 - ❌ 14327 - ❌ 14328 - ❌ 14329 - ❌ 14330 * - **browsertime-network-bench-firefox-h2-upload-1M_400ms-0** 14331 - ❌ 14332 - ❌ 14333 - ❌ 14334 - ❌ 14335 * - **browsertime-network-bench-firefox-h2-upload-300M_40ms-0** 14336 - ❌ 14337 - ❌ 14338 - ❌ 14339 - ❌ 14340 * - **browsertime-network-bench-firefox-h2-upload-300M_80ms-0** 14341 - ❌ 14342 - ❌ 14343 - ❌ 14344 - ❌ 14345 14346 14347 .. list-table:: **test-macosx1470-64-shippable/opt** 14348 :widths: 30 15 15 15 15 14349 :header-rows: 1 14350 14351 * - **Test Name** 14352 - mozilla-central 14353 - autoland 14354 - mozilla-release 14355 - mozilla-beta 14356 * - **browsertime-network-bench-chrome-h2-upload** 14357 - ❌ 14358 - ❌ 14359 - ❌ 14360 - ❌ 14361 * - **browsertime-network-bench-chrome-h2-upload-100M_40ms-0** 14362 - ❌ 14363 - ❌ 14364 - ❌ 14365 - ❌ 14366 * - **browsertime-network-bench-chrome-h2-upload-10M_40ms-0** 14367 - ❌ 14368 - ❌ 14369 - ❌ 14370 - ❌ 14371 * - **browsertime-network-bench-chrome-h2-upload-1M_400ms-0** 14372 - ❌ 14373 - ❌ 14374 - ❌ 14375 - ❌ 14376 * - **browsertime-network-bench-chrome-h2-upload-300M_40ms-0** 14377 - ❌ 14378 - ❌ 14379 - ❌ 14380 - ❌ 14381 * - **browsertime-network-bench-chrome-h2-upload-300M_80ms-0** 14382 - ❌ 14383 - ❌ 14384 - ❌ 14385 - ❌ 14386 * - **browsertime-network-bench-custom-car-h2-upload** 14387 - ❌ 14388 - ❌ 14389 - ❌ 14390 - ❌ 14391 * - **browsertime-network-bench-custom-car-h2-upload-100M_40ms-0** 14392 - ❌ 14393 - ❌ 14394 - ❌ 14395 - ❌ 14396 * - **browsertime-network-bench-custom-car-h2-upload-10M_40ms-0** 14397 - ❌ 14398 - ❌ 14399 - ❌ 14400 - ❌ 14401 * - **browsertime-network-bench-custom-car-h2-upload-1M_400ms-0** 14402 - ❌ 14403 - ❌ 14404 - ❌ 14405 - ❌ 14406 * - **browsertime-network-bench-custom-car-h2-upload-300M_40ms-0** 14407 - ❌ 14408 - ❌ 14409 - ❌ 14410 - ❌ 14411 * - **browsertime-network-bench-custom-car-h2-upload-300M_80ms-0** 14412 - ❌ 14413 - ❌ 14414 - ❌ 14415 - ❌ 14416 * - **browsertime-network-bench-firefox-h2-upload** 14417 - ❌ 14418 - ❌ 14419 - ❌ 14420 - ❌ 14421 * - **browsertime-network-bench-firefox-h2-upload-100M_40ms-0** 14422 - ❌ 14423 - ❌ 14424 - ❌ 14425 - ❌ 14426 * - **browsertime-network-bench-firefox-h2-upload-10M_40ms-0** 14427 - ❌ 14428 - ❌ 14429 - ❌ 14430 - ❌ 14431 * - **browsertime-network-bench-firefox-h2-upload-1M_400ms-0** 14432 - ❌ 14433 - ❌ 14434 - ❌ 14435 - ❌ 14436 * - **browsertime-network-bench-firefox-h2-upload-300M_40ms-0** 14437 - ❌ 14438 - ❌ 14439 - ❌ 14440 - ❌ 14441 * - **browsertime-network-bench-firefox-h2-upload-300M_80ms-0** 14442 - ❌ 14443 - ❌ 14444 - ❌ 14445 - ❌ 14446 14447 14448 .. list-table:: **test-macosx1470-64/opt** 14449 :widths: 30 15 15 15 15 14450 :header-rows: 1 14451 14452 * - **Test Name** 14453 - mozilla-central 14454 - autoland 14455 - mozilla-release 14456 - mozilla-beta 14457 * - **browsertime-network-bench-firefox-h2-upload** 14458 - ❌ 14459 - ❌ 14460 - ❌ 14461 - ❌ 14462 * - **browsertime-network-bench-firefox-h2-upload-100M_40ms-0** 14463 - ❌ 14464 - ❌ 14465 - ❌ 14466 - ❌ 14467 * - **browsertime-network-bench-firefox-h2-upload-10M_40ms-0** 14468 - ❌ 14469 - ❌ 14470 - ❌ 14471 - ❌ 14472 * - **browsertime-network-bench-firefox-h2-upload-1M_400ms-0** 14473 - ❌ 14474 - ❌ 14475 - ❌ 14476 - ❌ 14477 * - **browsertime-network-bench-firefox-h2-upload-300M_40ms-0** 14478 - ❌ 14479 - ❌ 14480 - ❌ 14481 - ❌ 14482 * - **browsertime-network-bench-firefox-h2-upload-300M_80ms-0** 14483 - ❌ 14484 - ❌ 14485 - ❌ 14486 - ❌ 14487 14488 14489 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 14490 :widths: 30 15 15 15 15 14491 :header-rows: 1 14492 14493 * - **Test Name** 14494 - mozilla-central 14495 - autoland 14496 - mozilla-release 14497 - mozilla-beta 14498 * - **browsertime-network-bench-firefox-h2-upload** 14499 - ❌ 14500 - ❌ 14501 - ❌ 14502 - ❌ 14503 * - **browsertime-network-bench-firefox-h2-upload-100M_40ms-0** 14504 - ❌ 14505 - ❌ 14506 - ❌ 14507 - ❌ 14508 * - **browsertime-network-bench-firefox-h2-upload-10M_40ms-0** 14509 - ❌ 14510 - ❌ 14511 - ❌ 14512 - ❌ 14513 * - **browsertime-network-bench-firefox-h2-upload-1M_400ms-0** 14514 - ❌ 14515 - ❌ 14516 - ❌ 14517 - ❌ 14518 * - **browsertime-network-bench-firefox-h2-upload-300M_40ms-0** 14519 - ❌ 14520 - ❌ 14521 - ❌ 14522 - ❌ 14523 * - **browsertime-network-bench-firefox-h2-upload-300M_80ms-0** 14524 - ❌ 14525 - ❌ 14526 - ❌ 14527 - ❌ 14528 14529 14530 .. list-table:: **test-windows11-64-24h2-shippable/opt** 14531 :widths: 30 15 15 15 15 14532 :header-rows: 1 14533 14534 * - **Test Name** 14535 - mozilla-central 14536 - autoland 14537 - mozilla-release 14538 - mozilla-beta 14539 * - **browsertime-network-bench-chrome-h2-upload** 14540 - ❌ 14541 - ❌ 14542 - ❌ 14543 - ❌ 14544 * - **browsertime-network-bench-chrome-h2-upload-100M_40ms-0** 14545 - ❌ 14546 - ❌ 14547 - ❌ 14548 - ❌ 14549 * - **browsertime-network-bench-chrome-h2-upload-10M_40ms-0** 14550 - ❌ 14551 - ❌ 14552 - ❌ 14553 - ❌ 14554 * - **browsertime-network-bench-chrome-h2-upload-1M_400ms-0** 14555 - ❌ 14556 - ❌ 14557 - ❌ 14558 - ❌ 14559 * - **browsertime-network-bench-chrome-h2-upload-300M_40ms-0** 14560 - ❌ 14561 - ❌ 14562 - ❌ 14563 - ❌ 14564 * - **browsertime-network-bench-chrome-h2-upload-300M_80ms-0** 14565 - ❌ 14566 - ❌ 14567 - ❌ 14568 - ❌ 14569 * - **browsertime-network-bench-custom-car-h2-upload** 14570 - ❌ 14571 - ❌ 14572 - ❌ 14573 - ❌ 14574 * - **browsertime-network-bench-custom-car-h2-upload-100M_40ms-0** 14575 - ❌ 14576 - ❌ 14577 - ❌ 14578 - ❌ 14579 * - **browsertime-network-bench-custom-car-h2-upload-10M_40ms-0** 14580 - ❌ 14581 - ❌ 14582 - ❌ 14583 - ❌ 14584 * - **browsertime-network-bench-custom-car-h2-upload-1M_400ms-0** 14585 - ❌ 14586 - ❌ 14587 - ❌ 14588 - ❌ 14589 * - **browsertime-network-bench-custom-car-h2-upload-300M_40ms-0** 14590 - ❌ 14591 - ❌ 14592 - ❌ 14593 - ❌ 14594 * - **browsertime-network-bench-custom-car-h2-upload-300M_80ms-0** 14595 - ❌ 14596 - ❌ 14597 - ❌ 14598 - ❌ 14599 * - **browsertime-network-bench-firefox-h2-upload** 14600 - ❌ 14601 - ❌ 14602 - ❌ 14603 - ❌ 14604 * - **browsertime-network-bench-firefox-h2-upload-100M_40ms-0** 14605 - ❌ 14606 - ❌ 14607 - ❌ 14608 - ❌ 14609 * - **browsertime-network-bench-firefox-h2-upload-10M_40ms-0** 14610 - ❌ 14611 - ❌ 14612 - ❌ 14613 - ❌ 14614 * - **browsertime-network-bench-firefox-h2-upload-1M_400ms-0** 14615 - ❌ 14616 - ❌ 14617 - ❌ 14618 - ❌ 14619 * - **browsertime-network-bench-firefox-h2-upload-300M_40ms-0** 14620 - ❌ 14621 - ❌ 14622 - ❌ 14623 - ❌ 14624 * - **browsertime-network-bench-firefox-h2-upload-300M_80ms-0** 14625 - ❌ 14626 - ❌ 14627 - ❌ 14628 - ❌ 14629 14630 14631 .. list-table:: **test-windows11-64-24h2/opt** 14632 :widths: 30 15 15 15 15 14633 :header-rows: 1 14634 14635 * - **Test Name** 14636 - mozilla-central 14637 - autoland 14638 - mozilla-release 14639 - mozilla-beta 14640 * - **browsertime-network-bench-firefox-h2-upload** 14641 - ❌ 14642 - ❌ 14643 - ❌ 14644 - ❌ 14645 * - **browsertime-network-bench-firefox-h2-upload-100M_40ms-0** 14646 - ❌ 14647 - ❌ 14648 - ❌ 14649 - ❌ 14650 * - **browsertime-network-bench-firefox-h2-upload-10M_40ms-0** 14651 - ❌ 14652 - ❌ 14653 - ❌ 14654 - ❌ 14655 * - **browsertime-network-bench-firefox-h2-upload-1M_400ms-0** 14656 - ❌ 14657 - ❌ 14658 - ❌ 14659 - ❌ 14660 * - **browsertime-network-bench-firefox-h2-upload-300M_40ms-0** 14661 - ❌ 14662 - ❌ 14663 - ❌ 14664 - ❌ 14665 * - **browsertime-network-bench-firefox-h2-upload-300M_80ms-0** 14666 - ❌ 14667 - ❌ 14668 - ❌ 14669 - ❌ 14670 14671 14672 14673 .. dropdown:: h3-download 14674 :class-container: anchor-id-h3-download-c 14675 14676 * Command to Run Locally 14677 14678 .. code-block:: 14679 14680 ./mach raptor -t h3-download 14681 14682 **Owner**: Network Team 14683 14684 **Description**: Measures HTTP/3 download throughput with a local server 14685 14686 * **alert threshold**: 2.0 14687 * **apps**: firefox, chrome, custom-car 14688 * **browser cycles**: 1 14689 * **browsertime args**: --browsertime.test_type=h3_download --browsertime.iterations=10 --firefox.preference=network.http.http3.enable:true 14690 * **custom data**: true 14691 * **expected**: pass 14692 * **gecko profile interval**: 1 14693 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-network-bench.toml#28>`__ 14694 * **lower is better**: false 14695 * **output timeout**: 2000000 14696 * **page cycles**: 1 14697 * **page timeout**: 1800000 14698 * **subtest lower is better**: false 14699 * **subtest name filters**: tests/,iterations/ 14700 * **subtest unit**: mbps 14701 * **support class**: network_bench.py 14702 * **test script**: network_bench.js 14703 * **test url**: `<None>`__ 14704 * **type**: pageload 14705 * **unit**: mbps 14706 * **Test Task**: 14707 14708 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 14709 :widths: 30 15 15 15 15 14710 :header-rows: 1 14711 14712 * - **Test Name** 14713 - mozilla-central 14714 - autoland 14715 - mozilla-release 14716 - mozilla-beta 14717 * - **browsertime-network-bench-firefox-h3-download** 14718 - ❌ 14719 - ❌ 14720 - ❌ 14721 - ❌ 14722 * - **browsertime-network-bench-firefox-h3-download-100M_40ms-0** 14723 - ❌ 14724 - ❌ 14725 - ❌ 14726 - ❌ 14727 * - **browsertime-network-bench-firefox-h3-download-10M_40ms-0** 14728 - ❌ 14729 - ❌ 14730 - ❌ 14731 - ❌ 14732 * - **browsertime-network-bench-firefox-h3-download-1M_400ms-0** 14733 - ❌ 14734 - ❌ 14735 - ❌ 14736 - ❌ 14737 * - **browsertime-network-bench-firefox-h3-download-300M_40ms-0** 14738 - ❌ 14739 - ❌ 14740 - ❌ 14741 - ❌ 14742 * - **browsertime-network-bench-firefox-h3-download-300M_80ms-0** 14743 - ❌ 14744 - ❌ 14745 - ❌ 14746 - ❌ 14747 14748 14749 .. list-table:: **test-linux1804-64-qr/opt** 14750 :widths: 30 15 15 15 15 14751 :header-rows: 1 14752 14753 * - **Test Name** 14754 - mozilla-central 14755 - autoland 14756 - mozilla-release 14757 - mozilla-beta 14758 * - **browsertime-network-bench-firefox-h3-download** 14759 - ❌ 14760 - ❌ 14761 - ❌ 14762 - ❌ 14763 * - **browsertime-network-bench-firefox-h3-download-100M_40ms-0** 14764 - ❌ 14765 - ❌ 14766 - ❌ 14767 - ❌ 14768 * - **browsertime-network-bench-firefox-h3-download-10M_40ms-0** 14769 - ❌ 14770 - ❌ 14771 - ❌ 14772 - ❌ 14773 * - **browsertime-network-bench-firefox-h3-download-1M_400ms-0** 14774 - ❌ 14775 - ❌ 14776 - ❌ 14777 - ❌ 14778 * - **browsertime-network-bench-firefox-h3-download-300M_40ms-0** 14779 - ❌ 14780 - ❌ 14781 - ❌ 14782 - ❌ 14783 * - **browsertime-network-bench-firefox-h3-download-300M_80ms-0** 14784 - ❌ 14785 - ❌ 14786 - ❌ 14787 - ❌ 14788 14789 14790 .. list-table:: **test-linux1804-64-shippable-qr/opt** 14791 :widths: 30 15 15 15 15 14792 :header-rows: 1 14793 14794 * - **Test Name** 14795 - mozilla-central 14796 - autoland 14797 - mozilla-release 14798 - mozilla-beta 14799 * - **browsertime-network-bench-chrome-h3-download** 14800 - ✅ 14801 - ❌ 14802 - ❌ 14803 - ❌ 14804 * - **browsertime-network-bench-chrome-h3-download-100M_40ms-0** 14805 - ✅ 14806 - ❌ 14807 - ❌ 14808 - ❌ 14809 * - **browsertime-network-bench-chrome-h3-download-10M_40ms-0** 14810 - ✅ 14811 - ❌ 14812 - ❌ 14813 - ❌ 14814 * - **browsertime-network-bench-chrome-h3-download-1M_400ms-0** 14815 - ✅ 14816 - ❌ 14817 - ❌ 14818 - ❌ 14819 * - **browsertime-network-bench-chrome-h3-download-300M_40ms-0** 14820 - ✅ 14821 - ❌ 14822 - ❌ 14823 - ❌ 14824 * - **browsertime-network-bench-chrome-h3-download-300M_80ms-0** 14825 - ✅ 14826 - ❌ 14827 - ❌ 14828 - ❌ 14829 * - **browsertime-network-bench-custom-car-h3-download** 14830 - ✅ 14831 - ❌ 14832 - ❌ 14833 - ❌ 14834 * - **browsertime-network-bench-custom-car-h3-download-100M_40ms-0** 14835 - ✅ 14836 - ❌ 14837 - ❌ 14838 - ❌ 14839 * - **browsertime-network-bench-custom-car-h3-download-10M_40ms-0** 14840 - ✅ 14841 - ❌ 14842 - ❌ 14843 - ❌ 14844 * - **browsertime-network-bench-custom-car-h3-download-1M_400ms-0** 14845 - ✅ 14846 - ❌ 14847 - ❌ 14848 - ❌ 14849 * - **browsertime-network-bench-custom-car-h3-download-300M_40ms-0** 14850 - ✅ 14851 - ❌ 14852 - ❌ 14853 - ❌ 14854 * - **browsertime-network-bench-custom-car-h3-download-300M_80ms-0** 14855 - ✅ 14856 - ❌ 14857 - ❌ 14858 - ❌ 14859 * - **browsertime-network-bench-firefox-h3-download** 14860 - ✅ 14861 - ❌ 14862 - ❌ 14863 - ❌ 14864 * - **browsertime-network-bench-firefox-h3-download-100M_40ms-0** 14865 - ✅ 14866 - ❌ 14867 - ❌ 14868 - ❌ 14869 * - **browsertime-network-bench-firefox-h3-download-10M_40ms-0** 14870 - ✅ 14871 - ❌ 14872 - ❌ 14873 - ❌ 14874 * - **browsertime-network-bench-firefox-h3-download-1M_400ms-0** 14875 - ✅ 14876 - ❌ 14877 - ❌ 14878 - ❌ 14879 * - **browsertime-network-bench-firefox-h3-download-300M_40ms-0** 14880 - ✅ 14881 - ❌ 14882 - ❌ 14883 - ❌ 14884 * - **browsertime-network-bench-firefox-h3-download-300M_80ms-0** 14885 - ✅ 14886 - ❌ 14887 - ❌ 14888 - ❌ 14889 14890 14891 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 14892 :widths: 30 15 15 15 15 14893 :header-rows: 1 14894 14895 * - **Test Name** 14896 - mozilla-central 14897 - autoland 14898 - mozilla-release 14899 - mozilla-beta 14900 * - **browsertime-network-bench-firefox-h3-download** 14901 - ❌ 14902 - ❌ 14903 - ❌ 14904 - ❌ 14905 * - **browsertime-network-bench-firefox-h3-download-100M_40ms-0** 14906 - ❌ 14907 - ❌ 14908 - ❌ 14909 - ❌ 14910 * - **browsertime-network-bench-firefox-h3-download-10M_40ms-0** 14911 - ❌ 14912 - ❌ 14913 - ❌ 14914 - ❌ 14915 * - **browsertime-network-bench-firefox-h3-download-1M_400ms-0** 14916 - ❌ 14917 - ❌ 14918 - ❌ 14919 - ❌ 14920 * - **browsertime-network-bench-firefox-h3-download-300M_40ms-0** 14921 - ❌ 14922 - ❌ 14923 - ❌ 14924 - ❌ 14925 * - **browsertime-network-bench-firefox-h3-download-300M_80ms-0** 14926 - ❌ 14927 - ❌ 14928 - ❌ 14929 - ❌ 14930 14931 14932 .. list-table:: **test-macosx1470-64-shippable/opt** 14933 :widths: 30 15 15 15 15 14934 :header-rows: 1 14935 14936 * - **Test Name** 14937 - mozilla-central 14938 - autoland 14939 - mozilla-release 14940 - mozilla-beta 14941 * - **browsertime-network-bench-chrome-h3-download** 14942 - ❌ 14943 - ❌ 14944 - ❌ 14945 - ❌ 14946 * - **browsertime-network-bench-chrome-h3-download-100M_40ms-0** 14947 - ❌ 14948 - ❌ 14949 - ❌ 14950 - ❌ 14951 * - **browsertime-network-bench-chrome-h3-download-10M_40ms-0** 14952 - ❌ 14953 - ❌ 14954 - ❌ 14955 - ❌ 14956 * - **browsertime-network-bench-chrome-h3-download-1M_400ms-0** 14957 - ❌ 14958 - ❌ 14959 - ❌ 14960 - ❌ 14961 * - **browsertime-network-bench-chrome-h3-download-300M_40ms-0** 14962 - ❌ 14963 - ❌ 14964 - ❌ 14965 - ❌ 14966 * - **browsertime-network-bench-chrome-h3-download-300M_80ms-0** 14967 - ❌ 14968 - ❌ 14969 - ❌ 14970 - ❌ 14971 * - **browsertime-network-bench-custom-car-h3-download** 14972 - ❌ 14973 - ❌ 14974 - ❌ 14975 - ❌ 14976 * - **browsertime-network-bench-custom-car-h3-download-100M_40ms-0** 14977 - ❌ 14978 - ❌ 14979 - ❌ 14980 - ❌ 14981 * - **browsertime-network-bench-custom-car-h3-download-10M_40ms-0** 14982 - ❌ 14983 - ❌ 14984 - ❌ 14985 - ❌ 14986 * - **browsertime-network-bench-custom-car-h3-download-1M_400ms-0** 14987 - ❌ 14988 - ❌ 14989 - ❌ 14990 - ❌ 14991 * - **browsertime-network-bench-custom-car-h3-download-300M_40ms-0** 14992 - ❌ 14993 - ❌ 14994 - ❌ 14995 - ❌ 14996 * - **browsertime-network-bench-custom-car-h3-download-300M_80ms-0** 14997 - ❌ 14998 - ❌ 14999 - ❌ 15000 - ❌ 15001 * - **browsertime-network-bench-firefox-h3-download** 15002 - ❌ 15003 - ❌ 15004 - ❌ 15005 - ❌ 15006 * - **browsertime-network-bench-firefox-h3-download-100M_40ms-0** 15007 - ❌ 15008 - ❌ 15009 - ❌ 15010 - ❌ 15011 * - **browsertime-network-bench-firefox-h3-download-10M_40ms-0** 15012 - ❌ 15013 - ❌ 15014 - ❌ 15015 - ❌ 15016 * - **browsertime-network-bench-firefox-h3-download-1M_400ms-0** 15017 - ❌ 15018 - ❌ 15019 - ❌ 15020 - ❌ 15021 * - **browsertime-network-bench-firefox-h3-download-300M_40ms-0** 15022 - ❌ 15023 - ❌ 15024 - ❌ 15025 - ❌ 15026 * - **browsertime-network-bench-firefox-h3-download-300M_80ms-0** 15027 - ❌ 15028 - ❌ 15029 - ❌ 15030 - ❌ 15031 15032 15033 .. list-table:: **test-macosx1470-64/opt** 15034 :widths: 30 15 15 15 15 15035 :header-rows: 1 15036 15037 * - **Test Name** 15038 - mozilla-central 15039 - autoland 15040 - mozilla-release 15041 - mozilla-beta 15042 * - **browsertime-network-bench-firefox-h3-download** 15043 - ❌ 15044 - ❌ 15045 - ❌ 15046 - ❌ 15047 * - **browsertime-network-bench-firefox-h3-download-100M_40ms-0** 15048 - ❌ 15049 - ❌ 15050 - ❌ 15051 - ❌ 15052 * - **browsertime-network-bench-firefox-h3-download-10M_40ms-0** 15053 - ❌ 15054 - ❌ 15055 - ❌ 15056 - ❌ 15057 * - **browsertime-network-bench-firefox-h3-download-1M_400ms-0** 15058 - ❌ 15059 - ❌ 15060 - ❌ 15061 - ❌ 15062 * - **browsertime-network-bench-firefox-h3-download-300M_40ms-0** 15063 - ❌ 15064 - ❌ 15065 - ❌ 15066 - ❌ 15067 * - **browsertime-network-bench-firefox-h3-download-300M_80ms-0** 15068 - ❌ 15069 - ❌ 15070 - ❌ 15071 - ❌ 15072 15073 15074 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 15075 :widths: 30 15 15 15 15 15076 :header-rows: 1 15077 15078 * - **Test Name** 15079 - mozilla-central 15080 - autoland 15081 - mozilla-release 15082 - mozilla-beta 15083 * - **browsertime-network-bench-firefox-h3-download** 15084 - ❌ 15085 - ❌ 15086 - ❌ 15087 - ❌ 15088 * - **browsertime-network-bench-firefox-h3-download-100M_40ms-0** 15089 - ❌ 15090 - ❌ 15091 - ❌ 15092 - ❌ 15093 * - **browsertime-network-bench-firefox-h3-download-10M_40ms-0** 15094 - ❌ 15095 - ❌ 15096 - ❌ 15097 - ❌ 15098 * - **browsertime-network-bench-firefox-h3-download-1M_400ms-0** 15099 - ❌ 15100 - ❌ 15101 - ❌ 15102 - ❌ 15103 * - **browsertime-network-bench-firefox-h3-download-300M_40ms-0** 15104 - ❌ 15105 - ❌ 15106 - ❌ 15107 - ❌ 15108 * - **browsertime-network-bench-firefox-h3-download-300M_80ms-0** 15109 - ❌ 15110 - ❌ 15111 - ❌ 15112 - ❌ 15113 15114 15115 .. list-table:: **test-windows11-64-24h2-shippable/opt** 15116 :widths: 30 15 15 15 15 15117 :header-rows: 1 15118 15119 * - **Test Name** 15120 - mozilla-central 15121 - autoland 15122 - mozilla-release 15123 - mozilla-beta 15124 * - **browsertime-network-bench-chrome-h3-download** 15125 - ❌ 15126 - ❌ 15127 - ❌ 15128 - ❌ 15129 * - **browsertime-network-bench-chrome-h3-download-100M_40ms-0** 15130 - ❌ 15131 - ❌ 15132 - ❌ 15133 - ❌ 15134 * - **browsertime-network-bench-chrome-h3-download-10M_40ms-0** 15135 - ❌ 15136 - ❌ 15137 - ❌ 15138 - ❌ 15139 * - **browsertime-network-bench-chrome-h3-download-1M_400ms-0** 15140 - ❌ 15141 - ❌ 15142 - ❌ 15143 - ❌ 15144 * - **browsertime-network-bench-chrome-h3-download-300M_40ms-0** 15145 - ❌ 15146 - ❌ 15147 - ❌ 15148 - ❌ 15149 * - **browsertime-network-bench-chrome-h3-download-300M_80ms-0** 15150 - ❌ 15151 - ❌ 15152 - ❌ 15153 - ❌ 15154 * - **browsertime-network-bench-custom-car-h3-download** 15155 - ❌ 15156 - ❌ 15157 - ❌ 15158 - ❌ 15159 * - **browsertime-network-bench-custom-car-h3-download-100M_40ms-0** 15160 - ❌ 15161 - ❌ 15162 - ❌ 15163 - ❌ 15164 * - **browsertime-network-bench-custom-car-h3-download-10M_40ms-0** 15165 - ❌ 15166 - ❌ 15167 - ❌ 15168 - ❌ 15169 * - **browsertime-network-bench-custom-car-h3-download-1M_400ms-0** 15170 - ❌ 15171 - ❌ 15172 - ❌ 15173 - ❌ 15174 * - **browsertime-network-bench-custom-car-h3-download-300M_40ms-0** 15175 - ❌ 15176 - ❌ 15177 - ❌ 15178 - ❌ 15179 * - **browsertime-network-bench-custom-car-h3-download-300M_80ms-0** 15180 - ❌ 15181 - ❌ 15182 - ❌ 15183 - ❌ 15184 * - **browsertime-network-bench-firefox-h3-download** 15185 - ❌ 15186 - ❌ 15187 - ❌ 15188 - ❌ 15189 * - **browsertime-network-bench-firefox-h3-download-100M_40ms-0** 15190 - ❌ 15191 - ❌ 15192 - ❌ 15193 - ❌ 15194 * - **browsertime-network-bench-firefox-h3-download-10M_40ms-0** 15195 - ❌ 15196 - ❌ 15197 - ❌ 15198 - ❌ 15199 * - **browsertime-network-bench-firefox-h3-download-1M_400ms-0** 15200 - ❌ 15201 - ❌ 15202 - ❌ 15203 - ❌ 15204 * - **browsertime-network-bench-firefox-h3-download-300M_40ms-0** 15205 - ❌ 15206 - ❌ 15207 - ❌ 15208 - ❌ 15209 * - **browsertime-network-bench-firefox-h3-download-300M_80ms-0** 15210 - ❌ 15211 - ❌ 15212 - ❌ 15213 - ❌ 15214 15215 15216 .. list-table:: **test-windows11-64-24h2/opt** 15217 :widths: 30 15 15 15 15 15218 :header-rows: 1 15219 15220 * - **Test Name** 15221 - mozilla-central 15222 - autoland 15223 - mozilla-release 15224 - mozilla-beta 15225 * - **browsertime-network-bench-firefox-h3-download** 15226 - ❌ 15227 - ❌ 15228 - ❌ 15229 - ❌ 15230 * - **browsertime-network-bench-firefox-h3-download-100M_40ms-0** 15231 - ❌ 15232 - ❌ 15233 - ❌ 15234 - ❌ 15235 * - **browsertime-network-bench-firefox-h3-download-10M_40ms-0** 15236 - ❌ 15237 - ❌ 15238 - ❌ 15239 - ❌ 15240 * - **browsertime-network-bench-firefox-h3-download-1M_400ms-0** 15241 - ❌ 15242 - ❌ 15243 - ❌ 15244 - ❌ 15245 * - **browsertime-network-bench-firefox-h3-download-300M_40ms-0** 15246 - ❌ 15247 - ❌ 15248 - ❌ 15249 - ❌ 15250 * - **browsertime-network-bench-firefox-h3-download-300M_80ms-0** 15251 - ❌ 15252 - ❌ 15253 - ❌ 15254 - ❌ 15255 15256 15257 15258 .. dropdown:: h3-upload 15259 :class-container: anchor-id-h3-upload-c 15260 15261 * Command to Run Locally 15262 15263 .. code-block:: 15264 15265 ./mach raptor -t h3-upload 15266 15267 **Owner**: Network Team 15268 15269 **Description**: Measures HTTP/3 file upload throughput with a local server 15270 15271 * **alert threshold**: 2.0 15272 * **apps**: firefox, chrome, custom-car 15273 * **browser cycles**: 1 15274 * **browsertime args**: --browsertime.test_type=h3_upload --browsertime.iterations=10 --firefox.preference=network.http.http3.enable:true 15275 * **custom data**: true 15276 * **expected**: pass 15277 * **gecko profile interval**: 1 15278 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-network-bench.toml#24>`__ 15279 * **lower is better**: false 15280 * **output timeout**: 2000000 15281 * **page cycles**: 1 15282 * **page timeout**: 1800000 15283 * **subtest lower is better**: false 15284 * **subtest name filters**: tests/,iterations/ 15285 * **subtest unit**: mbps 15286 * **support class**: network_bench.py 15287 * **test script**: network_bench.js 15288 * **test url**: `<None>`__ 15289 * **type**: pageload 15290 * **unit**: mbps 15291 * **Test Task**: 15292 15293 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 15294 :widths: 30 15 15 15 15 15295 :header-rows: 1 15296 15297 * - **Test Name** 15298 - mozilla-central 15299 - autoland 15300 - mozilla-release 15301 - mozilla-beta 15302 * - **browsertime-network-bench-firefox-h3-upload** 15303 - ❌ 15304 - ❌ 15305 - ❌ 15306 - ❌ 15307 * - **browsertime-network-bench-firefox-h3-upload-100M_40ms-0** 15308 - ❌ 15309 - ❌ 15310 - ❌ 15311 - ❌ 15312 * - **browsertime-network-bench-firefox-h3-upload-10M_40ms-0** 15313 - ❌ 15314 - ❌ 15315 - ❌ 15316 - ❌ 15317 * - **browsertime-network-bench-firefox-h3-upload-1M_400ms-0** 15318 - ❌ 15319 - ❌ 15320 - ❌ 15321 - ❌ 15322 * - **browsertime-network-bench-firefox-h3-upload-300M_40ms-0** 15323 - ❌ 15324 - ❌ 15325 - ❌ 15326 - ❌ 15327 * - **browsertime-network-bench-firefox-h3-upload-300M_80ms-0** 15328 - ❌ 15329 - ❌ 15330 - ❌ 15331 - ❌ 15332 15333 15334 .. list-table:: **test-linux1804-64-qr/opt** 15335 :widths: 30 15 15 15 15 15336 :header-rows: 1 15337 15338 * - **Test Name** 15339 - mozilla-central 15340 - autoland 15341 - mozilla-release 15342 - mozilla-beta 15343 * - **browsertime-network-bench-firefox-h3-upload** 15344 - ❌ 15345 - ❌ 15346 - ❌ 15347 - ❌ 15348 * - **browsertime-network-bench-firefox-h3-upload-100M_40ms-0** 15349 - ❌ 15350 - ❌ 15351 - ❌ 15352 - ❌ 15353 * - **browsertime-network-bench-firefox-h3-upload-10M_40ms-0** 15354 - ❌ 15355 - ❌ 15356 - ❌ 15357 - ❌ 15358 * - **browsertime-network-bench-firefox-h3-upload-1M_400ms-0** 15359 - ❌ 15360 - ❌ 15361 - ❌ 15362 - ❌ 15363 * - **browsertime-network-bench-firefox-h3-upload-300M_40ms-0** 15364 - ❌ 15365 - ❌ 15366 - ❌ 15367 - ❌ 15368 * - **browsertime-network-bench-firefox-h3-upload-300M_80ms-0** 15369 - ❌ 15370 - ❌ 15371 - ❌ 15372 - ❌ 15373 15374 15375 .. list-table:: **test-linux1804-64-shippable-qr/opt** 15376 :widths: 30 15 15 15 15 15377 :header-rows: 1 15378 15379 * - **Test Name** 15380 - mozilla-central 15381 - autoland 15382 - mozilla-release 15383 - mozilla-beta 15384 * - **browsertime-network-bench-chrome-h3-upload** 15385 - ✅ 15386 - ❌ 15387 - ❌ 15388 - ❌ 15389 * - **browsertime-network-bench-chrome-h3-upload-100M_40ms-0** 15390 - ✅ 15391 - ❌ 15392 - ❌ 15393 - ❌ 15394 * - **browsertime-network-bench-chrome-h3-upload-10M_40ms-0** 15395 - ✅ 15396 - ❌ 15397 - ❌ 15398 - ❌ 15399 * - **browsertime-network-bench-chrome-h3-upload-1M_400ms-0** 15400 - ✅ 15401 - ❌ 15402 - ❌ 15403 - ❌ 15404 * - **browsertime-network-bench-chrome-h3-upload-300M_40ms-0** 15405 - ✅ 15406 - ❌ 15407 - ❌ 15408 - ❌ 15409 * - **browsertime-network-bench-chrome-h3-upload-300M_80ms-0** 15410 - ✅ 15411 - ❌ 15412 - ❌ 15413 - ❌ 15414 * - **browsertime-network-bench-custom-car-h3-upload** 15415 - ✅ 15416 - ❌ 15417 - ❌ 15418 - ❌ 15419 * - **browsertime-network-bench-custom-car-h3-upload-100M_40ms-0** 15420 - ✅ 15421 - ❌ 15422 - ❌ 15423 - ❌ 15424 * - **browsertime-network-bench-custom-car-h3-upload-10M_40ms-0** 15425 - ✅ 15426 - ❌ 15427 - ❌ 15428 - ❌ 15429 * - **browsertime-network-bench-custom-car-h3-upload-1M_400ms-0** 15430 - ✅ 15431 - ❌ 15432 - ❌ 15433 - ❌ 15434 * - **browsertime-network-bench-custom-car-h3-upload-300M_40ms-0** 15435 - ✅ 15436 - ❌ 15437 - ❌ 15438 - ❌ 15439 * - **browsertime-network-bench-custom-car-h3-upload-300M_80ms-0** 15440 - ✅ 15441 - ❌ 15442 - ❌ 15443 - ❌ 15444 * - **browsertime-network-bench-firefox-h3-upload** 15445 - ✅ 15446 - ❌ 15447 - ❌ 15448 - ❌ 15449 * - **browsertime-network-bench-firefox-h3-upload-100M_40ms-0** 15450 - ✅ 15451 - ❌ 15452 - ❌ 15453 - ❌ 15454 * - **browsertime-network-bench-firefox-h3-upload-10M_40ms-0** 15455 - ✅ 15456 - ❌ 15457 - ❌ 15458 - ❌ 15459 * - **browsertime-network-bench-firefox-h3-upload-1M_400ms-0** 15460 - ✅ 15461 - ❌ 15462 - ❌ 15463 - ❌ 15464 * - **browsertime-network-bench-firefox-h3-upload-300M_40ms-0** 15465 - ✅ 15466 - ❌ 15467 - ❌ 15468 - ❌ 15469 * - **browsertime-network-bench-firefox-h3-upload-300M_80ms-0** 15470 - ✅ 15471 - ❌ 15472 - ❌ 15473 - ❌ 15474 15475 15476 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 15477 :widths: 30 15 15 15 15 15478 :header-rows: 1 15479 15480 * - **Test Name** 15481 - mozilla-central 15482 - autoland 15483 - mozilla-release 15484 - mozilla-beta 15485 * - **browsertime-network-bench-firefox-h3-upload** 15486 - ❌ 15487 - ❌ 15488 - ❌ 15489 - ❌ 15490 * - **browsertime-network-bench-firefox-h3-upload-100M_40ms-0** 15491 - ❌ 15492 - ❌ 15493 - ❌ 15494 - ❌ 15495 * - **browsertime-network-bench-firefox-h3-upload-10M_40ms-0** 15496 - ❌ 15497 - ❌ 15498 - ❌ 15499 - ❌ 15500 * - **browsertime-network-bench-firefox-h3-upload-1M_400ms-0** 15501 - ❌ 15502 - ❌ 15503 - ❌ 15504 - ❌ 15505 * - **browsertime-network-bench-firefox-h3-upload-300M_40ms-0** 15506 - ❌ 15507 - ❌ 15508 - ❌ 15509 - ❌ 15510 * - **browsertime-network-bench-firefox-h3-upload-300M_80ms-0** 15511 - ❌ 15512 - ❌ 15513 - ❌ 15514 - ❌ 15515 15516 15517 .. list-table:: **test-macosx1470-64-shippable/opt** 15518 :widths: 30 15 15 15 15 15519 :header-rows: 1 15520 15521 * - **Test Name** 15522 - mozilla-central 15523 - autoland 15524 - mozilla-release 15525 - mozilla-beta 15526 * - **browsertime-network-bench-chrome-h3-upload** 15527 - ❌ 15528 - ❌ 15529 - ❌ 15530 - ❌ 15531 * - **browsertime-network-bench-chrome-h3-upload-100M_40ms-0** 15532 - ❌ 15533 - ❌ 15534 - ❌ 15535 - ❌ 15536 * - **browsertime-network-bench-chrome-h3-upload-10M_40ms-0** 15537 - ❌ 15538 - ❌ 15539 - ❌ 15540 - ❌ 15541 * - **browsertime-network-bench-chrome-h3-upload-1M_400ms-0** 15542 - ❌ 15543 - ❌ 15544 - ❌ 15545 - ❌ 15546 * - **browsertime-network-bench-chrome-h3-upload-300M_40ms-0** 15547 - ❌ 15548 - ❌ 15549 - ❌ 15550 - ❌ 15551 * - **browsertime-network-bench-chrome-h3-upload-300M_80ms-0** 15552 - ❌ 15553 - ❌ 15554 - ❌ 15555 - ❌ 15556 * - **browsertime-network-bench-custom-car-h3-upload** 15557 - ❌ 15558 - ❌ 15559 - ❌ 15560 - ❌ 15561 * - **browsertime-network-bench-custom-car-h3-upload-100M_40ms-0** 15562 - ❌ 15563 - ❌ 15564 - ❌ 15565 - ❌ 15566 * - **browsertime-network-bench-custom-car-h3-upload-10M_40ms-0** 15567 - ❌ 15568 - ❌ 15569 - ❌ 15570 - ❌ 15571 * - **browsertime-network-bench-custom-car-h3-upload-1M_400ms-0** 15572 - ❌ 15573 - ❌ 15574 - ❌ 15575 - ❌ 15576 * - **browsertime-network-bench-custom-car-h3-upload-300M_40ms-0** 15577 - ❌ 15578 - ❌ 15579 - ❌ 15580 - ❌ 15581 * - **browsertime-network-bench-custom-car-h3-upload-300M_80ms-0** 15582 - ❌ 15583 - ❌ 15584 - ❌ 15585 - ❌ 15586 * - **browsertime-network-bench-firefox-h3-upload** 15587 - ❌ 15588 - ❌ 15589 - ❌ 15590 - ❌ 15591 * - **browsertime-network-bench-firefox-h3-upload-100M_40ms-0** 15592 - ❌ 15593 - ❌ 15594 - ❌ 15595 - ❌ 15596 * - **browsertime-network-bench-firefox-h3-upload-10M_40ms-0** 15597 - ❌ 15598 - ❌ 15599 - ❌ 15600 - ❌ 15601 * - **browsertime-network-bench-firefox-h3-upload-1M_400ms-0** 15602 - ❌ 15603 - ❌ 15604 - ❌ 15605 - ❌ 15606 * - **browsertime-network-bench-firefox-h3-upload-300M_40ms-0** 15607 - ❌ 15608 - ❌ 15609 - ❌ 15610 - ❌ 15611 * - **browsertime-network-bench-firefox-h3-upload-300M_80ms-0** 15612 - ❌ 15613 - ❌ 15614 - ❌ 15615 - ❌ 15616 15617 15618 .. list-table:: **test-macosx1470-64/opt** 15619 :widths: 30 15 15 15 15 15620 :header-rows: 1 15621 15622 * - **Test Name** 15623 - mozilla-central 15624 - autoland 15625 - mozilla-release 15626 - mozilla-beta 15627 * - **browsertime-network-bench-firefox-h3-upload** 15628 - ❌ 15629 - ❌ 15630 - ❌ 15631 - ❌ 15632 * - **browsertime-network-bench-firefox-h3-upload-100M_40ms-0** 15633 - ❌ 15634 - ❌ 15635 - ❌ 15636 - ❌ 15637 * - **browsertime-network-bench-firefox-h3-upload-10M_40ms-0** 15638 - ❌ 15639 - ❌ 15640 - ❌ 15641 - ❌ 15642 * - **browsertime-network-bench-firefox-h3-upload-1M_400ms-0** 15643 - ❌ 15644 - ❌ 15645 - ❌ 15646 - ❌ 15647 * - **browsertime-network-bench-firefox-h3-upload-300M_40ms-0** 15648 - ❌ 15649 - ❌ 15650 - ❌ 15651 - ❌ 15652 * - **browsertime-network-bench-firefox-h3-upload-300M_80ms-0** 15653 - ❌ 15654 - ❌ 15655 - ❌ 15656 - ❌ 15657 15658 15659 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 15660 :widths: 30 15 15 15 15 15661 :header-rows: 1 15662 15663 * - **Test Name** 15664 - mozilla-central 15665 - autoland 15666 - mozilla-release 15667 - mozilla-beta 15668 * - **browsertime-network-bench-firefox-h3-upload** 15669 - ❌ 15670 - ❌ 15671 - ❌ 15672 - ❌ 15673 * - **browsertime-network-bench-firefox-h3-upload-100M_40ms-0** 15674 - ❌ 15675 - ❌ 15676 - ❌ 15677 - ❌ 15678 * - **browsertime-network-bench-firefox-h3-upload-10M_40ms-0** 15679 - ❌ 15680 - ❌ 15681 - ❌ 15682 - ❌ 15683 * - **browsertime-network-bench-firefox-h3-upload-1M_400ms-0** 15684 - ❌ 15685 - ❌ 15686 - ❌ 15687 - ❌ 15688 * - **browsertime-network-bench-firefox-h3-upload-300M_40ms-0** 15689 - ❌ 15690 - ❌ 15691 - ❌ 15692 - ❌ 15693 * - **browsertime-network-bench-firefox-h3-upload-300M_80ms-0** 15694 - ❌ 15695 - ❌ 15696 - ❌ 15697 - ❌ 15698 15699 15700 .. list-table:: **test-windows11-64-24h2-shippable/opt** 15701 :widths: 30 15 15 15 15 15702 :header-rows: 1 15703 15704 * - **Test Name** 15705 - mozilla-central 15706 - autoland 15707 - mozilla-release 15708 - mozilla-beta 15709 * - **browsertime-network-bench-chrome-h3-upload** 15710 - ❌ 15711 - ❌ 15712 - ❌ 15713 - ❌ 15714 * - **browsertime-network-bench-chrome-h3-upload-100M_40ms-0** 15715 - ❌ 15716 - ❌ 15717 - ❌ 15718 - ❌ 15719 * - **browsertime-network-bench-chrome-h3-upload-10M_40ms-0** 15720 - ❌ 15721 - ❌ 15722 - ❌ 15723 - ❌ 15724 * - **browsertime-network-bench-chrome-h3-upload-1M_400ms-0** 15725 - ❌ 15726 - ❌ 15727 - ❌ 15728 - ❌ 15729 * - **browsertime-network-bench-chrome-h3-upload-300M_40ms-0** 15730 - ❌ 15731 - ❌ 15732 - ❌ 15733 - ❌ 15734 * - **browsertime-network-bench-chrome-h3-upload-300M_80ms-0** 15735 - ❌ 15736 - ❌ 15737 - ❌ 15738 - ❌ 15739 * - **browsertime-network-bench-custom-car-h3-upload** 15740 - ❌ 15741 - ❌ 15742 - ❌ 15743 - ❌ 15744 * - **browsertime-network-bench-custom-car-h3-upload-100M_40ms-0** 15745 - ❌ 15746 - ❌ 15747 - ❌ 15748 - ❌ 15749 * - **browsertime-network-bench-custom-car-h3-upload-10M_40ms-0** 15750 - ❌ 15751 - ❌ 15752 - ❌ 15753 - ❌ 15754 * - **browsertime-network-bench-custom-car-h3-upload-1M_400ms-0** 15755 - ❌ 15756 - ❌ 15757 - ❌ 15758 - ❌ 15759 * - **browsertime-network-bench-custom-car-h3-upload-300M_40ms-0** 15760 - ❌ 15761 - ❌ 15762 - ❌ 15763 - ❌ 15764 * - **browsertime-network-bench-custom-car-h3-upload-300M_80ms-0** 15765 - ❌ 15766 - ❌ 15767 - ❌ 15768 - ❌ 15769 * - **browsertime-network-bench-firefox-h3-upload** 15770 - ❌ 15771 - ❌ 15772 - ❌ 15773 - ❌ 15774 * - **browsertime-network-bench-firefox-h3-upload-100M_40ms-0** 15775 - ❌ 15776 - ❌ 15777 - ❌ 15778 - ❌ 15779 * - **browsertime-network-bench-firefox-h3-upload-10M_40ms-0** 15780 - ❌ 15781 - ❌ 15782 - ❌ 15783 - ❌ 15784 * - **browsertime-network-bench-firefox-h3-upload-1M_400ms-0** 15785 - ❌ 15786 - ❌ 15787 - ❌ 15788 - ❌ 15789 * - **browsertime-network-bench-firefox-h3-upload-300M_40ms-0** 15790 - ❌ 15791 - ❌ 15792 - ❌ 15793 - ❌ 15794 * - **browsertime-network-bench-firefox-h3-upload-300M_80ms-0** 15795 - ❌ 15796 - ❌ 15797 - ❌ 15798 - ❌ 15799 15800 15801 .. list-table:: **test-windows11-64-24h2/opt** 15802 :widths: 30 15 15 15 15 15803 :header-rows: 1 15804 15805 * - **Test Name** 15806 - mozilla-central 15807 - autoland 15808 - mozilla-release 15809 - mozilla-beta 15810 * - **browsertime-network-bench-firefox-h3-upload** 15811 - ❌ 15812 - ❌ 15813 - ❌ 15814 - ❌ 15815 * - **browsertime-network-bench-firefox-h3-upload-100M_40ms-0** 15816 - ❌ 15817 - ❌ 15818 - ❌ 15819 - ❌ 15820 * - **browsertime-network-bench-firefox-h3-upload-10M_40ms-0** 15821 - ❌ 15822 - ❌ 15823 - ❌ 15824 - ❌ 15825 * - **browsertime-network-bench-firefox-h3-upload-1M_400ms-0** 15826 - ❌ 15827 - ❌ 15828 - ❌ 15829 - ❌ 15830 * - **browsertime-network-bench-firefox-h3-upload-300M_40ms-0** 15831 - ❌ 15832 - ❌ 15833 - ❌ 15834 - ❌ 15835 * - **browsertime-network-bench-firefox-h3-upload-300M_80ms-0** 15836 - ❌ 15837 - ❌ 15838 - ❌ 15839 - ❌ 15840 15841 15842 15843 .. dropdown:: idb-open-few-par 15844 :class-container: anchor-id-idb-open-few-par-c 15845 15846 * Command to Run Locally 15847 15848 .. code-block:: 15849 15850 ./mach raptor -t idb-open-few-par 15851 15852 **Owner**: DOM Lifecycle, Workers and Storage Team 15853 15854 **Description**: Measures opening a few IndexedDB databases in parallel 15855 15856 * **alert threshold**: 2.0 15857 * **apps**: firefox, chrome, safari 15858 * **browser cycles**: 1 15859 * **browsertime args**: --browsertime.iterations=1000 --browsertime.parallel=1 15860 * **custom data**: true 15861 * **expected**: pass 15862 * **gecko profile entries**: 131072000 15863 * **gecko profile features**: js,stackwalk,cpu,memory 15864 * **gecko profile threads**: GeckoMain,DOM Worker,IndexedDB 15865 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-indexeddb.toml#36>`__ 15866 * **lower is better**: true 15867 * **measure**: cpuTime 15868 * **output timeout**: 2000000 15869 * **page cycles**: 1 15870 * **page timeout**: 1800000 15871 * **playback**: mitmproxy 15872 * **playback pageset manifest**: mitm8-linux-firefox-example.manifest 15873 * **subtest unit**: ms 15874 * **test script**: indexeddb_open.js 15875 * **test summary**: flatten 15876 * **test url**: `<https://www.example.com>`__ 15877 * **type**: pageload 15878 * **unit**: ms 15879 * **use live sites**: false 15880 * **Test Task**: 15881 15882 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 15883 :widths: 30 15 15 15 15 15884 :header-rows: 1 15885 15886 * - **Test Name** 15887 - mozilla-central 15888 - autoland 15889 - mozilla-release 15890 - mozilla-beta 15891 * - **browsertime-indexeddb-firefox-idb-open-few-par** 15892 - ❌ 15893 - ❌ 15894 - ❌ 15895 - ❌ 15896 15897 15898 .. list-table:: **test-linux1804-64-qr/opt** 15899 :widths: 30 15 15 15 15 15900 :header-rows: 1 15901 15902 * - **Test Name** 15903 - mozilla-central 15904 - autoland 15905 - mozilla-release 15906 - mozilla-beta 15907 * - **browsertime-indexeddb-firefox-idb-open-few-par** 15908 - ❌ 15909 - ❌ 15910 - ❌ 15911 - ❌ 15912 15913 15914 .. list-table:: **test-linux1804-64-shippable-qr/opt** 15915 :widths: 30 15 15 15 15 15916 :header-rows: 1 15917 15918 * - **Test Name** 15919 - mozilla-central 15920 - autoland 15921 - mozilla-release 15922 - mozilla-beta 15923 * - **browsertime-indexeddb-chrome-idb-open-few-par** 15924 - ❌ 15925 - ❌ 15926 - ❌ 15927 - ❌ 15928 * - **browsertime-indexeddb-firefox-idb-open-few-par** 15929 - ✅ 15930 - ✅ 15931 - ❌ 15932 - ❌ 15933 15934 15935 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 15936 :widths: 30 15 15 15 15 15937 :header-rows: 1 15938 15939 * - **Test Name** 15940 - mozilla-central 15941 - autoland 15942 - mozilla-release 15943 - mozilla-beta 15944 * - **browsertime-indexeddb-firefox-idb-open-few-par** 15945 - ❌ 15946 - ❌ 15947 - ❌ 15948 - ❌ 15949 15950 15951 .. list-table:: **test-macosx1470-64-shippable/opt** 15952 :widths: 30 15 15 15 15 15953 :header-rows: 1 15954 15955 * - **Test Name** 15956 - mozilla-central 15957 - autoland 15958 - mozilla-release 15959 - mozilla-beta 15960 * - **browsertime-indexeddb-chrome-idb-open-few-par** 15961 - ❌ 15962 - ❌ 15963 - ❌ 15964 - ❌ 15965 * - **browsertime-indexeddb-firefox-idb-open-few-par** 15966 - ✅ 15967 - ✅ 15968 - ❌ 15969 - ❌ 15970 15971 15972 .. list-table:: **test-macosx1470-64/opt** 15973 :widths: 30 15 15 15 15 15974 :header-rows: 1 15975 15976 * - **Test Name** 15977 - mozilla-central 15978 - autoland 15979 - mozilla-release 15980 - mozilla-beta 15981 * - **browsertime-indexeddb-firefox-idb-open-few-par** 15982 - ❌ 15983 - ❌ 15984 - ❌ 15985 - ❌ 15986 15987 15988 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 15989 :widths: 30 15 15 15 15 15990 :header-rows: 1 15991 15992 * - **Test Name** 15993 - mozilla-central 15994 - autoland 15995 - mozilla-release 15996 - mozilla-beta 15997 * - **browsertime-indexeddb-firefox-idb-open-few-par** 15998 - ❌ 15999 - ❌ 16000 - ❌ 16001 - ❌ 16002 16003 16004 .. list-table:: **test-windows11-64-24h2-shippable/opt** 16005 :widths: 30 15 15 15 15 16006 :header-rows: 1 16007 16008 * - **Test Name** 16009 - mozilla-central 16010 - autoland 16011 - mozilla-release 16012 - mozilla-beta 16013 * - **browsertime-indexeddb-chrome-idb-open-few-par** 16014 - ❌ 16015 - ❌ 16016 - ❌ 16017 - ❌ 16018 * - **browsertime-indexeddb-firefox-idb-open-few-par** 16019 - ✅ 16020 - ✅ 16021 - ❌ 16022 - ❌ 16023 16024 16025 .. list-table:: **test-windows11-64-24h2/opt** 16026 :widths: 30 15 15 15 15 16027 :header-rows: 1 16028 16029 * - **Test Name** 16030 - mozilla-central 16031 - autoland 16032 - mozilla-release 16033 - mozilla-beta 16034 * - **browsertime-indexeddb-firefox-idb-open-few-par** 16035 - ❌ 16036 - ❌ 16037 - ❌ 16038 - ❌ 16039 16040 16041 16042 .. dropdown:: idb-open-few-seq 16043 :class-container: anchor-id-idb-open-few-seq-c 16044 16045 * Command to Run Locally 16046 16047 .. code-block:: 16048 16049 ./mach raptor -t idb-open-few-seq 16050 16051 **Owner**: DOM Lifecycle, Workers and Storage Team 16052 16053 **Description**: Measures opening a few IndexedDB databases in sequence 16054 16055 * **alert threshold**: 2.0 16056 * **apps**: firefox, chrome, safari 16057 * **browser cycles**: 1 16058 * **browsertime args**: --browsertime.iterations=1000 --browsertime.parallel=0 16059 * **custom data**: true 16060 * **expected**: pass 16061 * **gecko profile entries**: 131072000 16062 * **gecko profile features**: js,stackwalk,cpu,memory 16063 * **gecko profile threads**: GeckoMain,DOM Worker,IndexedDB 16064 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-indexeddb.toml#40>`__ 16065 * **lower is better**: true 16066 * **measure**: cpuTime 16067 * **output timeout**: 2000000 16068 * **page cycles**: 1 16069 * **page timeout**: 1800000 16070 * **playback**: mitmproxy 16071 * **playback pageset manifest**: mitm8-linux-firefox-example.manifest 16072 * **subtest unit**: ms 16073 * **test script**: indexeddb_open.js 16074 * **test summary**: flatten 16075 * **test url**: `<https://www.example.com>`__ 16076 * **type**: pageload 16077 * **unit**: ms 16078 * **use live sites**: false 16079 * **Test Task**: 16080 16081 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 16082 :widths: 30 15 15 15 15 16083 :header-rows: 1 16084 16085 * - **Test Name** 16086 - mozilla-central 16087 - autoland 16088 - mozilla-release 16089 - mozilla-beta 16090 * - **browsertime-indexeddb-firefox-idb-open-few-seq** 16091 - ❌ 16092 - ❌ 16093 - ❌ 16094 - ❌ 16095 16096 16097 .. list-table:: **test-linux1804-64-qr/opt** 16098 :widths: 30 15 15 15 15 16099 :header-rows: 1 16100 16101 * - **Test Name** 16102 - mozilla-central 16103 - autoland 16104 - mozilla-release 16105 - mozilla-beta 16106 * - **browsertime-indexeddb-firefox-idb-open-few-seq** 16107 - ❌ 16108 - ❌ 16109 - ❌ 16110 - ❌ 16111 16112 16113 .. list-table:: **test-linux1804-64-shippable-qr/opt** 16114 :widths: 30 15 15 15 15 16115 :header-rows: 1 16116 16117 * - **Test Name** 16118 - mozilla-central 16119 - autoland 16120 - mozilla-release 16121 - mozilla-beta 16122 * - **browsertime-indexeddb-chrome-idb-open-few-seq** 16123 - ❌ 16124 - ❌ 16125 - ❌ 16126 - ❌ 16127 * - **browsertime-indexeddb-firefox-idb-open-few-seq** 16128 - ✅ 16129 - ✅ 16130 - ❌ 16131 - ❌ 16132 16133 16134 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 16135 :widths: 30 15 15 15 15 16136 :header-rows: 1 16137 16138 * - **Test Name** 16139 - mozilla-central 16140 - autoland 16141 - mozilla-release 16142 - mozilla-beta 16143 * - **browsertime-indexeddb-firefox-idb-open-few-seq** 16144 - ❌ 16145 - ❌ 16146 - ❌ 16147 - ❌ 16148 16149 16150 .. list-table:: **test-macosx1470-64-shippable/opt** 16151 :widths: 30 15 15 15 15 16152 :header-rows: 1 16153 16154 * - **Test Name** 16155 - mozilla-central 16156 - autoland 16157 - mozilla-release 16158 - mozilla-beta 16159 * - **browsertime-indexeddb-chrome-idb-open-few-seq** 16160 - ❌ 16161 - ❌ 16162 - ❌ 16163 - ❌ 16164 * - **browsertime-indexeddb-firefox-idb-open-few-seq** 16165 - ✅ 16166 - ✅ 16167 - ❌ 16168 - ❌ 16169 16170 16171 .. list-table:: **test-macosx1470-64/opt** 16172 :widths: 30 15 15 15 15 16173 :header-rows: 1 16174 16175 * - **Test Name** 16176 - mozilla-central 16177 - autoland 16178 - mozilla-release 16179 - mozilla-beta 16180 * - **browsertime-indexeddb-firefox-idb-open-few-seq** 16181 - ❌ 16182 - ❌ 16183 - ❌ 16184 - ❌ 16185 16186 16187 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 16188 :widths: 30 15 15 15 15 16189 :header-rows: 1 16190 16191 * - **Test Name** 16192 - mozilla-central 16193 - autoland 16194 - mozilla-release 16195 - mozilla-beta 16196 * - **browsertime-indexeddb-firefox-idb-open-few-seq** 16197 - ❌ 16198 - ❌ 16199 - ❌ 16200 - ❌ 16201 16202 16203 .. list-table:: **test-windows11-64-24h2-shippable/opt** 16204 :widths: 30 15 15 15 15 16205 :header-rows: 1 16206 16207 * - **Test Name** 16208 - mozilla-central 16209 - autoland 16210 - mozilla-release 16211 - mozilla-beta 16212 * - **browsertime-indexeddb-chrome-idb-open-few-seq** 16213 - ❌ 16214 - ❌ 16215 - ❌ 16216 - ❌ 16217 * - **browsertime-indexeddb-firefox-idb-open-few-seq** 16218 - ✅ 16219 - ✅ 16220 - ❌ 16221 - ❌ 16222 16223 16224 .. list-table:: **test-windows11-64-24h2/opt** 16225 :widths: 30 15 15 15 15 16226 :header-rows: 1 16227 16228 * - **Test Name** 16229 - mozilla-central 16230 - autoland 16231 - mozilla-release 16232 - mozilla-beta 16233 * - **browsertime-indexeddb-firefox-idb-open-few-seq** 16234 - ❌ 16235 - ❌ 16236 - ❌ 16237 - ❌ 16238 16239 16240 16241 .. dropdown:: idb-open-many-par 16242 :class-container: anchor-id-idb-open-many-par-c 16243 16244 * Command to Run Locally 16245 16246 .. code-block:: 16247 16248 ./mach raptor -t idb-open-many-par 16249 16250 **Owner**: DOM Lifecycle, Workers and Storage Team 16251 16252 **Description**: Measures opening many IndexedDB databases in parallel 16253 16254 * **alert threshold**: 2.0 16255 * **apps**: firefox, chrome, safari 16256 * **browser cycles**: 1 16257 * **browsertime args**: --browsertime.iterations=10000 --browsertime.parallel=1 16258 * **custom data**: true 16259 * **expected**: pass 16260 * **gecko profile entries**: 131072000 16261 * **gecko profile features**: js,stackwalk,cpu,memory 16262 * **gecko profile threads**: GeckoMain,DOM Worker,IndexedDB 16263 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-indexeddb.toml#28>`__ 16264 * **lower is better**: true 16265 * **measure**: cpuTime 16266 * **output timeout**: 2000000 16267 * **page cycles**: 1 16268 * **page timeout**: 1800000 16269 * **playback**: mitmproxy 16270 * **playback pageset manifest**: mitm8-linux-firefox-example.manifest 16271 * **subtest unit**: ms 16272 * **test script**: indexeddb_open.js 16273 * **test summary**: flatten 16274 * **test url**: `<https://www.example.com>`__ 16275 * **type**: pageload 16276 * **unit**: ms 16277 * **use live sites**: false 16278 * **Test Task**: 16279 16280 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 16281 :widths: 30 15 15 15 15 16282 :header-rows: 1 16283 16284 * - **Test Name** 16285 - mozilla-central 16286 - autoland 16287 - mozilla-release 16288 - mozilla-beta 16289 * - **browsertime-indexeddb-firefox-idb-open-many-par** 16290 - ❌ 16291 - ❌ 16292 - ❌ 16293 - ❌ 16294 16295 16296 .. list-table:: **test-linux1804-64-qr/opt** 16297 :widths: 30 15 15 15 15 16298 :header-rows: 1 16299 16300 * - **Test Name** 16301 - mozilla-central 16302 - autoland 16303 - mozilla-release 16304 - mozilla-beta 16305 * - **browsertime-indexeddb-firefox-idb-open-many-par** 16306 - ❌ 16307 - ❌ 16308 - ❌ 16309 - ❌ 16310 16311 16312 .. list-table:: **test-linux1804-64-shippable-qr/opt** 16313 :widths: 30 15 15 15 15 16314 :header-rows: 1 16315 16316 * - **Test Name** 16317 - mozilla-central 16318 - autoland 16319 - mozilla-release 16320 - mozilla-beta 16321 * - **browsertime-indexeddb-chrome-idb-open-many-par** 16322 - ❌ 16323 - ❌ 16324 - ❌ 16325 - ❌ 16326 * - **browsertime-indexeddb-firefox-idb-open-many-par** 16327 - ✅ 16328 - ✅ 16329 - ❌ 16330 - ❌ 16331 16332 16333 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 16334 :widths: 30 15 15 15 15 16335 :header-rows: 1 16336 16337 * - **Test Name** 16338 - mozilla-central 16339 - autoland 16340 - mozilla-release 16341 - mozilla-beta 16342 * - **browsertime-indexeddb-firefox-idb-open-many-par** 16343 - ❌ 16344 - ❌ 16345 - ❌ 16346 - ❌ 16347 16348 16349 .. list-table:: **test-macosx1470-64-shippable/opt** 16350 :widths: 30 15 15 15 15 16351 :header-rows: 1 16352 16353 * - **Test Name** 16354 - mozilla-central 16355 - autoland 16356 - mozilla-release 16357 - mozilla-beta 16358 * - **browsertime-indexeddb-chrome-idb-open-many-par** 16359 - ❌ 16360 - ❌ 16361 - ❌ 16362 - ❌ 16363 * - **browsertime-indexeddb-firefox-idb-open-many-par** 16364 - ✅ 16365 - ✅ 16366 - ❌ 16367 - ❌ 16368 16369 16370 .. list-table:: **test-macosx1470-64/opt** 16371 :widths: 30 15 15 15 15 16372 :header-rows: 1 16373 16374 * - **Test Name** 16375 - mozilla-central 16376 - autoland 16377 - mozilla-release 16378 - mozilla-beta 16379 * - **browsertime-indexeddb-firefox-idb-open-many-par** 16380 - ❌ 16381 - ❌ 16382 - ❌ 16383 - ❌ 16384 16385 16386 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 16387 :widths: 30 15 15 15 15 16388 :header-rows: 1 16389 16390 * - **Test Name** 16391 - mozilla-central 16392 - autoland 16393 - mozilla-release 16394 - mozilla-beta 16395 * - **browsertime-indexeddb-firefox-idb-open-many-par** 16396 - ❌ 16397 - ❌ 16398 - ❌ 16399 - ❌ 16400 16401 16402 .. list-table:: **test-windows11-64-24h2-shippable/opt** 16403 :widths: 30 15 15 15 15 16404 :header-rows: 1 16405 16406 * - **Test Name** 16407 - mozilla-central 16408 - autoland 16409 - mozilla-release 16410 - mozilla-beta 16411 * - **browsertime-indexeddb-chrome-idb-open-many-par** 16412 - ❌ 16413 - ❌ 16414 - ❌ 16415 - ❌ 16416 * - **browsertime-indexeddb-firefox-idb-open-many-par** 16417 - ✅ 16418 - ✅ 16419 - ❌ 16420 - ❌ 16421 16422 16423 .. list-table:: **test-windows11-64-24h2/opt** 16424 :widths: 30 15 15 15 15 16425 :header-rows: 1 16426 16427 * - **Test Name** 16428 - mozilla-central 16429 - autoland 16430 - mozilla-release 16431 - mozilla-beta 16432 * - **browsertime-indexeddb-firefox-idb-open-many-par** 16433 - ❌ 16434 - ❌ 16435 - ❌ 16436 - ❌ 16437 16438 16439 16440 .. dropdown:: idb-open-many-seq 16441 :class-container: anchor-id-idb-open-many-seq-c 16442 16443 * Command to Run Locally 16444 16445 .. code-block:: 16446 16447 ./mach raptor -t idb-open-many-seq 16448 16449 **Owner**: DOM Lifecycle, Workers and Storage Team 16450 16451 **Description**: Measures opening many IndexedDB databases in sequence 16452 16453 * **alert threshold**: 2.0 16454 * **apps**: firefox, chrome, safari 16455 * **browser cycles**: 1 16456 * **browsertime args**: --browsertime.iterations=10000 --browsertime.parallel=0 16457 * **custom data**: true 16458 * **expected**: pass 16459 * **gecko profile entries**: 131072000 16460 * **gecko profile features**: js,stackwalk,cpu,memory 16461 * **gecko profile threads**: GeckoMain,DOM Worker,IndexedDB 16462 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-indexeddb.toml#32>`__ 16463 * **lower is better**: true 16464 * **measure**: cpuTime 16465 * **output timeout**: 2000000 16466 * **page cycles**: 1 16467 * **page timeout**: 1800000 16468 * **playback**: mitmproxy 16469 * **playback pageset manifest**: mitm8-linux-firefox-example.manifest 16470 * **subtest unit**: ms 16471 * **test script**: indexeddb_open.js 16472 * **test summary**: flatten 16473 * **test url**: `<https://www.example.com>`__ 16474 * **type**: pageload 16475 * **unit**: ms 16476 * **use live sites**: false 16477 * **Test Task**: 16478 16479 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 16480 :widths: 30 15 15 15 15 16481 :header-rows: 1 16482 16483 * - **Test Name** 16484 - mozilla-central 16485 - autoland 16486 - mozilla-release 16487 - mozilla-beta 16488 * - **browsertime-indexeddb-firefox-idb-open-many-seq** 16489 - ❌ 16490 - ❌ 16491 - ❌ 16492 - ❌ 16493 16494 16495 .. list-table:: **test-linux1804-64-qr/opt** 16496 :widths: 30 15 15 15 15 16497 :header-rows: 1 16498 16499 * - **Test Name** 16500 - mozilla-central 16501 - autoland 16502 - mozilla-release 16503 - mozilla-beta 16504 * - **browsertime-indexeddb-firefox-idb-open-many-seq** 16505 - ❌ 16506 - ❌ 16507 - ❌ 16508 - ❌ 16509 16510 16511 .. list-table:: **test-linux1804-64-shippable-qr/opt** 16512 :widths: 30 15 15 15 15 16513 :header-rows: 1 16514 16515 * - **Test Name** 16516 - mozilla-central 16517 - autoland 16518 - mozilla-release 16519 - mozilla-beta 16520 * - **browsertime-indexeddb-chrome-idb-open-many-seq** 16521 - ❌ 16522 - ❌ 16523 - ❌ 16524 - ❌ 16525 * - **browsertime-indexeddb-firefox-idb-open-many-seq** 16526 - ✅ 16527 - ✅ 16528 - ❌ 16529 - ❌ 16530 16531 16532 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 16533 :widths: 30 15 15 15 15 16534 :header-rows: 1 16535 16536 * - **Test Name** 16537 - mozilla-central 16538 - autoland 16539 - mozilla-release 16540 - mozilla-beta 16541 * - **browsertime-indexeddb-firefox-idb-open-many-seq** 16542 - ❌ 16543 - ❌ 16544 - ❌ 16545 - ❌ 16546 16547 16548 .. list-table:: **test-macosx1470-64-shippable/opt** 16549 :widths: 30 15 15 15 15 16550 :header-rows: 1 16551 16552 * - **Test Name** 16553 - mozilla-central 16554 - autoland 16555 - mozilla-release 16556 - mozilla-beta 16557 * - **browsertime-indexeddb-chrome-idb-open-many-seq** 16558 - ❌ 16559 - ❌ 16560 - ❌ 16561 - ❌ 16562 * - **browsertime-indexeddb-firefox-idb-open-many-seq** 16563 - ✅ 16564 - ✅ 16565 - ❌ 16566 - ❌ 16567 16568 16569 .. list-table:: **test-macosx1470-64/opt** 16570 :widths: 30 15 15 15 15 16571 :header-rows: 1 16572 16573 * - **Test Name** 16574 - mozilla-central 16575 - autoland 16576 - mozilla-release 16577 - mozilla-beta 16578 * - **browsertime-indexeddb-firefox-idb-open-many-seq** 16579 - ❌ 16580 - ❌ 16581 - ❌ 16582 - ❌ 16583 16584 16585 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 16586 :widths: 30 15 15 15 15 16587 :header-rows: 1 16588 16589 * - **Test Name** 16590 - mozilla-central 16591 - autoland 16592 - mozilla-release 16593 - mozilla-beta 16594 * - **browsertime-indexeddb-firefox-idb-open-many-seq** 16595 - ❌ 16596 - ❌ 16597 - ❌ 16598 - ❌ 16599 16600 16601 .. list-table:: **test-windows11-64-24h2-shippable/opt** 16602 :widths: 30 15 15 15 15 16603 :header-rows: 1 16604 16605 * - **Test Name** 16606 - mozilla-central 16607 - autoland 16608 - mozilla-release 16609 - mozilla-beta 16610 * - **browsertime-indexeddb-chrome-idb-open-many-seq** 16611 - ❌ 16612 - ❌ 16613 - ❌ 16614 - ❌ 16615 * - **browsertime-indexeddb-firefox-idb-open-many-seq** 16616 - ✅ 16617 - ✅ 16618 - ❌ 16619 - ❌ 16620 16621 16622 .. list-table:: **test-windows11-64-24h2/opt** 16623 :widths: 30 15 15 15 15 16624 :header-rows: 1 16625 16626 * - **Test Name** 16627 - mozilla-central 16628 - autoland 16629 - mozilla-release 16630 - mozilla-beta 16631 * - **browsertime-indexeddb-firefox-idb-open-many-seq** 16632 - ❌ 16633 - ❌ 16634 - ❌ 16635 - ❌ 16636 16637 16638 16639 .. dropdown:: process-switch 16640 :class-container: anchor-id-process-switch-c 16641 16642 * Command to Run Locally 16643 16644 .. code-block:: 16645 16646 ./mach raptor -t process-switch 16647 16648 **Owner**: PerfTest Team 16649 16650 **Description**: Measures process switch time 16651 16652 * **accept zero vismet**: true 16653 * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__ 16654 * **alert threshold**: 2.0 16655 * **apps**: firefox, chrome 16656 * **browser cycles**: 25 16657 * **browsertime args**: --pageCompleteWaitTime=1000 --pageCompleteCheckInactivity=true 16658 * **expected**: pass 16659 * **gecko profile interval**: 1 16660 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-process-switch.toml#20>`__ 16661 * **lower is better**: true 16662 * **measure**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange 16663 * **page cycles**: 25 16664 * **page timeout**: 60000 16665 * **playback**: mitmproxy 16666 * **playback pageset manifest**: mitm5-linux-firefox-proc-switch.manifest 16667 * **playback version**: 5.1.1 16668 * **support class**: browsertime_pageload.py 16669 * **test script**: process_switch.js 16670 * **test url**: `<https://mozilla.seanfeng.dev/files/red.html,https://mozilla.pettay.fi/moztests/blue.html>`__ 16671 * **type**: pageload 16672 * **unit**: ms 16673 * **use live sites**: false 16674 * **Test Task**: 16675 16676 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 16677 :widths: 30 15 15 15 15 16678 :header-rows: 1 16679 16680 * - **Test Name** 16681 - mozilla-central 16682 - autoland 16683 - mozilla-release 16684 - mozilla-beta 16685 * - **browsertime-custom-firefox-process-switch** 16686 - ❌ 16687 - ❌ 16688 - ❌ 16689 - ❌ 16690 16691 16692 .. list-table:: **test-linux1804-64-qr/opt** 16693 :widths: 30 15 15 15 15 16694 :header-rows: 1 16695 16696 * - **Test Name** 16697 - mozilla-central 16698 - autoland 16699 - mozilla-release 16700 - mozilla-beta 16701 * - **browsertime-custom-firefox-process-switch** 16702 - ❌ 16703 - ❌ 16704 - ❌ 16705 - ❌ 16706 16707 16708 .. list-table:: **test-linux1804-64-shippable-qr/opt** 16709 :widths: 30 15 15 15 15 16710 :header-rows: 1 16711 16712 * - **Test Name** 16713 - mozilla-central 16714 - autoland 16715 - mozilla-release 16716 - mozilla-beta 16717 * - **browsertime-custom-firefox-process-switch** 16718 - ✅ 16719 - ❌ 16720 - ❌ 16721 - ❌ 16722 16723 16724 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 16725 :widths: 30 15 15 15 15 16726 :header-rows: 1 16727 16728 * - **Test Name** 16729 - mozilla-central 16730 - autoland 16731 - mozilla-release 16732 - mozilla-beta 16733 * - **browsertime-custom-firefox-process-switch** 16734 - ❌ 16735 - ❌ 16736 - ❌ 16737 - ❌ 16738 16739 16740 .. list-table:: **test-macosx1470-64-shippable/opt** 16741 :widths: 30 15 15 15 15 16742 :header-rows: 1 16743 16744 * - **Test Name** 16745 - mozilla-central 16746 - autoland 16747 - mozilla-release 16748 - mozilla-beta 16749 * - **browsertime-custom-firefox-process-switch** 16750 - ✅ 16751 - ❌ 16752 - ❌ 16753 - ❌ 16754 16755 16756 .. list-table:: **test-macosx1470-64/opt** 16757 :widths: 30 15 15 15 15 16758 :header-rows: 1 16759 16760 * - **Test Name** 16761 - mozilla-central 16762 - autoland 16763 - mozilla-release 16764 - mozilla-beta 16765 * - **browsertime-custom-firefox-process-switch** 16766 - ❌ 16767 - ❌ 16768 - ❌ 16769 - ❌ 16770 16771 16772 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 16773 :widths: 30 15 15 15 15 16774 :header-rows: 1 16775 16776 * - **Test Name** 16777 - mozilla-central 16778 - autoland 16779 - mozilla-release 16780 - mozilla-beta 16781 * - **browsertime-custom-firefox-process-switch** 16782 - ❌ 16783 - ❌ 16784 - ❌ 16785 - ❌ 16786 16787 16788 .. list-table:: **test-windows11-64-24h2-shippable/opt** 16789 :widths: 30 15 15 15 15 16790 :header-rows: 1 16791 16792 * - **Test Name** 16793 - mozilla-central 16794 - autoland 16795 - mozilla-release 16796 - mozilla-beta 16797 * - **browsertime-custom-firefox-process-switch** 16798 - ✅ 16799 - ❌ 16800 - ❌ 16801 - ❌ 16802 16803 16804 .. list-table:: **test-windows11-64-24h2/opt** 16805 :widths: 30 15 15 15 15 16806 :header-rows: 1 16807 16808 * - **Test Name** 16809 - mozilla-central 16810 - autoland 16811 - mozilla-release 16812 - mozilla-beta 16813 * - **browsertime-custom-firefox-process-switch** 16814 - ❌ 16815 - ❌ 16816 - ❌ 16817 - ❌ 16818 16819 16820 16821 .. dropdown:: sample-python-support 16822 :class-container: anchor-id-sample-python-support-c 16823 16824 * Command to Run Locally 16825 16826 .. code-block:: 16827 16828 ./mach raptor -t sample-python-support 16829 16830 **Owner**: PerfTest Team 16831 16832 **Description**: A sample test that uses a python support file to modify the test command. 16833 16834 * **alert threshold**: 2.0 16835 * **apps**: firefox 16836 * **browser cycles**: 1 16837 * **browsertime args**: --browsertime.constant_value={replace-with-constant-value} 16838 * **custom data**: true 16839 * **expected**: pass 16840 * **fore window**: 1 16841 * **gecko profile interval**: 1 16842 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-sample-python-support.toml#22>`__ 16843 * **lower is better**: true 16844 * **max back window**: 3 16845 * **min back window**: 2 16846 * **output timeout**: 2000000 16847 * **page cycles**: 1 16848 * **page timeout**: 1800000 16849 * **subtest unit**: ms 16850 * **support class**: sample_python_support.py 16851 * **test script**: constant_regression_test.js 16852 * **test summary**: flatten 16853 * **test url**: `<None>`__ 16854 * **type**: pageload 16855 * **unit**: score 16856 * **use live sites**: true 16857 16858 .. dropdown:: throttled 16859 :class-container: anchor-id-throttled-c 16860 16861 * Command to Run Locally 16862 16863 .. code-block:: 16864 16865 ./mach raptor -t throttled 16866 16867 **Owner**: Network Team 16868 16869 **Description**: Pageload test using a throttled network environment 16870 16871 * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__ 16872 * **alert threshold**: 2.0 16873 * **apps**: firefox 16874 * **browser cycles**: 3 16875 * **cold**: true 16876 * **custom data**: true 16877 * **expected**: pass 16878 * **gecko profile interval**: 1 16879 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-throttled-pageload.toml#17>`__ 16880 * **lower is better**: true 16881 * **page cycles**: 1 16882 * **page timeout**: 60000 16883 * **test script**: throttled_pageload.js 16884 * **test url**: `<None>`__ 16885 * **type**: pageload 16886 * **unit**: ms 16887 * **use live sites**: true 16888 * **Test Task**: 16889 16890 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 16891 :widths: 30 15 15 15 15 16892 :header-rows: 1 16893 16894 * - **Test Name** 16895 - mozilla-central 16896 - autoland 16897 - mozilla-release 16898 - mozilla-beta 16899 * - **browsertime-throttled-firefox-throttled** 16900 - ❌ 16901 - ❌ 16902 - ❌ 16903 - ❌ 16904 16905 16906 .. list-table:: **test-linux1804-64-qr/opt** 16907 :widths: 30 15 15 15 15 16908 :header-rows: 1 16909 16910 * - **Test Name** 16911 - mozilla-central 16912 - autoland 16913 - mozilla-release 16914 - mozilla-beta 16915 * - **browsertime-throttled-firefox-throttled** 16916 - ❌ 16917 - ❌ 16918 - ❌ 16919 - ❌ 16920 16921 16922 .. list-table:: **test-linux1804-64-shippable-qr/opt** 16923 :widths: 30 15 15 15 15 16924 :header-rows: 1 16925 16926 * - **Test Name** 16927 - mozilla-central 16928 - autoland 16929 - mozilla-release 16930 - mozilla-beta 16931 * - **browsertime-throttled-firefox-throttled** 16932 - ❌ 16933 - ❌ 16934 - ❌ 16935 - ❌ 16936 16937 16938 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 16939 :widths: 30 15 15 15 15 16940 :header-rows: 1 16941 16942 * - **Test Name** 16943 - mozilla-central 16944 - autoland 16945 - mozilla-release 16946 - mozilla-beta 16947 * - **browsertime-throttled-firefox-throttled** 16948 - ❌ 16949 - ❌ 16950 - ❌ 16951 - ❌ 16952 16953 16954 .. list-table:: **test-macosx1470-64-shippable/opt** 16955 :widths: 30 15 15 15 15 16956 :header-rows: 1 16957 16958 * - **Test Name** 16959 - mozilla-central 16960 - autoland 16961 - mozilla-release 16962 - mozilla-beta 16963 * - **browsertime-throttled-firefox-throttled** 16964 - ❌ 16965 - ❌ 16966 - ❌ 16967 - ❌ 16968 16969 16970 .. list-table:: **test-macosx1470-64/opt** 16971 :widths: 30 15 15 15 15 16972 :header-rows: 1 16973 16974 * - **Test Name** 16975 - mozilla-central 16976 - autoland 16977 - mozilla-release 16978 - mozilla-beta 16979 * - **browsertime-throttled-firefox-throttled** 16980 - ❌ 16981 - ❌ 16982 - ❌ 16983 - ❌ 16984 16985 16986 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 16987 :widths: 30 15 15 15 15 16988 :header-rows: 1 16989 16990 * - **Test Name** 16991 - mozilla-central 16992 - autoland 16993 - mozilla-release 16994 - mozilla-beta 16995 * - **browsertime-throttled-firefox-throttled** 16996 - ❌ 16997 - ❌ 16998 - ❌ 16999 - ❌ 17000 17001 17002 .. list-table:: **test-windows11-64-24h2-shippable/opt** 17003 :widths: 30 15 15 15 15 17004 :header-rows: 1 17005 17006 * - **Test Name** 17007 - mozilla-central 17008 - autoland 17009 - mozilla-release 17010 - mozilla-beta 17011 * - **browsertime-throttled-firefox-throttled** 17012 - ❌ 17013 - ❌ 17014 - ❌ 17015 - ❌ 17016 17017 17018 .. list-table:: **test-windows11-64-24h2/opt** 17019 :widths: 30 15 15 15 15 17020 :header-rows: 1 17021 17022 * - **Test Name** 17023 - mozilla-central 17024 - autoland 17025 - mozilla-release 17026 - mozilla-beta 17027 * - **browsertime-throttled-firefox-throttled** 17028 - ❌ 17029 - ❌ 17030 - ❌ 17031 - ❌ 17032 17033 17034 17035 .. dropdown:: tp6-bench 17036 :class-container: anchor-id-tp6-bench-c 17037 17038 * Command to Run Locally 17039 17040 .. code-block:: 17041 17042 ./mach raptor -t tp6-bench 17043 17044 **Owner**: PerfTest Team 17045 17046 **Description**: A pageload benchmark test that quickly runs through a selection of the pages available to produce a single overall metric for fcp, lcp, and loadtime. The metrics from all pages get summarized with the geomean, and mean. 17047 17048 17049 * **alert threshold**: 2.0 17050 * **apps**: firefox, chrome, chromium, safari 17051 * **browser cycles**: 1 17052 * **cold**: true 17053 * **custom data**: true 17054 * **expected**: pass 17055 * **gecko profile interval**: 1 17056 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-tp6-bench.toml#19>`__ 17057 * **lower is better**: true 17058 * **output timeout**: 2000000 17059 * **page cycles**: 1 17060 * **page timeout**: 1800000 17061 * **playback**: mitmproxy 17062 * **playback pageset manifest**: None 17063 * **playback version**: 8.1.1 17064 * **subtest unit**: ms 17065 * **support class**: browsertime_tp6_bench.py 17066 * **test script**: browsertime_tp6_bench.js 17067 * **test summary**: flatten 17068 * **test url**: `<None>`__ 17069 * **type**: pageload 17070 * **unit**: ms 17071 * **Test Task**: 17072 17073 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 17074 :widths: 30 15 15 15 15 17075 :header-rows: 1 17076 17077 * - **Test Name** 17078 - mozilla-central 17079 - autoland 17080 - mozilla-release 17081 - mozilla-beta 17082 * - **browsertime-pageload-benchmark-firefox-tp6-bench** 17083 - ❌ 17084 - ❌ 17085 - ❌ 17086 - ❌ 17087 17088 17089 .. list-table:: **test-linux1804-64-qr/opt** 17090 :widths: 30 15 15 15 15 17091 :header-rows: 1 17092 17093 * - **Test Name** 17094 - mozilla-central 17095 - autoland 17096 - mozilla-release 17097 - mozilla-beta 17098 * - **browsertime-pageload-benchmark-firefox-tp6-bench** 17099 - ❌ 17100 - ❌ 17101 - ❌ 17102 - ❌ 17103 17104 17105 .. list-table:: **test-linux1804-64-shippable-qr/opt** 17106 :widths: 30 15 15 15 15 17107 :header-rows: 1 17108 17109 * - **Test Name** 17110 - mozilla-central 17111 - autoland 17112 - mozilla-release 17113 - mozilla-beta 17114 * - **browsertime-pageload-benchmark-firefox-tp6-bench** 17115 - ❌ 17116 - ✅ 17117 - ❌ 17118 - ❌ 17119 17120 17121 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 17122 :widths: 30 15 15 15 15 17123 :header-rows: 1 17124 17125 * - **Test Name** 17126 - mozilla-central 17127 - autoland 17128 - mozilla-release 17129 - mozilla-beta 17130 * - **browsertime-pageload-benchmark-firefox-tp6-bench** 17131 - ❌ 17132 - ❌ 17133 - ❌ 17134 - ❌ 17135 17136 17137 .. list-table:: **test-macosx1470-64-shippable/opt** 17138 :widths: 30 15 15 15 15 17139 :header-rows: 1 17140 17141 * - **Test Name** 17142 - mozilla-central 17143 - autoland 17144 - mozilla-release 17145 - mozilla-beta 17146 * - **browsertime-pageload-benchmark-firefox-tp6-bench** 17147 - ❌ 17148 - ❌ 17149 - ❌ 17150 - ❌ 17151 17152 17153 .. list-table:: **test-macosx1470-64/opt** 17154 :widths: 30 15 15 15 15 17155 :header-rows: 1 17156 17157 * - **Test Name** 17158 - mozilla-central 17159 - autoland 17160 - mozilla-release 17161 - mozilla-beta 17162 * - **browsertime-pageload-benchmark-firefox-tp6-bench** 17163 - ❌ 17164 - ❌ 17165 - ❌ 17166 - ❌ 17167 17168 17169 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 17170 :widths: 30 15 15 15 15 17171 :header-rows: 1 17172 17173 * - **Test Name** 17174 - mozilla-central 17175 - autoland 17176 - mozilla-release 17177 - mozilla-beta 17178 * - **browsertime-pageload-benchmark-firefox-tp6-bench** 17179 - ❌ 17180 - ❌ 17181 - ❌ 17182 - ❌ 17183 17184 17185 .. list-table:: **test-windows11-64-24h2-shippable/opt** 17186 :widths: 30 15 15 15 15 17187 :header-rows: 1 17188 17189 * - **Test Name** 17190 - mozilla-central 17191 - autoland 17192 - mozilla-release 17193 - mozilla-beta 17194 * - **browsertime-pageload-benchmark-firefox-tp6-bench** 17195 - ❌ 17196 - ✅ 17197 - ❌ 17198 - ❌ 17199 17200 17201 .. list-table:: **test-windows11-64-24h2/opt** 17202 :widths: 30 15 15 15 15 17203 :header-rows: 1 17204 17205 * - **Test Name** 17206 - mozilla-central 17207 - autoland 17208 - mozilla-release 17209 - mozilla-beta 17210 * - **browsertime-pageload-benchmark-firefox-tp6-bench** 17211 - ❌ 17212 - ❌ 17213 - ❌ 17214 - ❌ 17215 17216 17217 17218 .. dropdown:: trr-cira 17219 :class-container: anchor-id-trr-cira-c 17220 17221 * Command to Run Locally 17222 17223 .. code-block:: 17224 17225 ./mach raptor -t trr-cira 17226 17227 **Owner**: Network Team 17228 17229 **Description**: Tests DNS lookup time on a CIRA TRR server. 17230 17231 * **alert threshold**: 2.0 17232 * **apps**: firefox,fenix 17233 * **browser cycles**: 3 17234 * **browsertime args**: --browsertime.test_type=browser_idle --firefox.preference network.trr.mode:3 --firefox.preference network.trr.uri:https://private.canadianshield.cira.ca/dns-query 17235 * **cold**: true 17236 * **custom data**: true 17237 * **expected**: pass 17238 * **gecko profile interval**: 1 17239 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-trr-performance.toml#23>`__ 17240 * **lower is better**: true 17241 * **page cycles**: 1 17242 * **page timeout**: 60000 17243 * **test script**: trr_performance.js 17244 * **test url**: `<None>`__ 17245 * **type**: pageload 17246 * **unit**: ms 17247 * **use live sites**: true 17248 * **Test Task**: 17249 17250 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 17251 :widths: 30 15 15 15 15 17252 :header-rows: 1 17253 17254 * - **Test Name** 17255 - mozilla-central 17256 - autoland 17257 - mozilla-release 17258 - mozilla-beta 17259 * - **browsertime-trr-performance-firefox-trr-cira** 17260 - ❌ 17261 - ❌ 17262 - ❌ 17263 - ❌ 17264 17265 17266 .. list-table:: **test-linux1804-64-qr/opt** 17267 :widths: 30 15 15 15 15 17268 :header-rows: 1 17269 17270 * - **Test Name** 17271 - mozilla-central 17272 - autoland 17273 - mozilla-release 17274 - mozilla-beta 17275 * - **browsertime-trr-performance-firefox-trr-cira** 17276 - ❌ 17277 - ❌ 17278 - ❌ 17279 - ❌ 17280 17281 17282 .. list-table:: **test-linux1804-64-shippable-qr/opt** 17283 :widths: 30 15 15 15 15 17284 :header-rows: 1 17285 17286 * - **Test Name** 17287 - mozilla-central 17288 - autoland 17289 - mozilla-release 17290 - mozilla-beta 17291 * - **browsertime-trr-performance-firefox-trr-cira** 17292 - ❌ 17293 - ❌ 17294 - ❌ 17295 - ❌ 17296 17297 17298 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 17299 :widths: 30 15 15 15 15 17300 :header-rows: 1 17301 17302 * - **Test Name** 17303 - mozilla-central 17304 - autoland 17305 - mozilla-release 17306 - mozilla-beta 17307 * - **browsertime-trr-performance-firefox-trr-cira** 17308 - ❌ 17309 - ❌ 17310 - ❌ 17311 - ❌ 17312 17313 17314 .. list-table:: **test-macosx1470-64-shippable/opt** 17315 :widths: 30 15 15 15 15 17316 :header-rows: 1 17317 17318 * - **Test Name** 17319 - mozilla-central 17320 - autoland 17321 - mozilla-release 17322 - mozilla-beta 17323 * - **browsertime-trr-performance-firefox-trr-cira** 17324 - ❌ 17325 - ❌ 17326 - ❌ 17327 - ❌ 17328 17329 17330 .. list-table:: **test-macosx1470-64/opt** 17331 :widths: 30 15 15 15 15 17332 :header-rows: 1 17333 17334 * - **Test Name** 17335 - mozilla-central 17336 - autoland 17337 - mozilla-release 17338 - mozilla-beta 17339 * - **browsertime-trr-performance-firefox-trr-cira** 17340 - ❌ 17341 - ❌ 17342 - ❌ 17343 - ❌ 17344 17345 17346 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 17347 :widths: 30 15 15 15 15 17348 :header-rows: 1 17349 17350 * - **Test Name** 17351 - mozilla-central 17352 - autoland 17353 - mozilla-release 17354 - mozilla-beta 17355 * - **browsertime-trr-performance-firefox-trr-cira** 17356 - ❌ 17357 - ❌ 17358 - ❌ 17359 - ❌ 17360 17361 17362 .. list-table:: **test-windows11-64-24h2-shippable/opt** 17363 :widths: 30 15 15 15 15 17364 :header-rows: 1 17365 17366 * - **Test Name** 17367 - mozilla-central 17368 - autoland 17369 - mozilla-release 17370 - mozilla-beta 17371 * - **browsertime-trr-performance-firefox-trr-cira** 17372 - ✅ 17373 - ❌ 17374 - ❌ 17375 - ❌ 17376 17377 17378 .. list-table:: **test-windows11-64-24h2/opt** 17379 :widths: 30 15 15 15 15 17380 :header-rows: 1 17381 17382 * - **Test Name** 17383 - mozilla-central 17384 - autoland 17385 - mozilla-release 17386 - mozilla-beta 17387 * - **browsertime-trr-performance-firefox-trr-cira** 17388 - ❌ 17389 - ❌ 17390 - ❌ 17391 - ❌ 17392 17393 17394 17395 .. dropdown:: trr-clou-m 17396 :class-container: anchor-id-trr-clou-m-c 17397 17398 * Command to Run Locally 17399 17400 .. code-block:: 17401 17402 ./mach raptor -t trr-clou-m 17403 17404 **Owner**: Network Team 17405 17406 **Description**: Tests DNS lookup time on a Cloudflare TRR server, mobile. 17407 17408 * **alert threshold**: 2.0 17409 * **apps**: firefox,fenix 17410 * **browser cycles**: 3 17411 * **browsertime args**: --browsertime.test_type=trr_warm --firefox.preference network.trr.mode:3 --firefox.preference network.trr.uri:https://mozilla.cloudflare-dns.com/dns-query 17412 * **cold**: true 17413 * **custom data**: true 17414 * **expected**: pass 17415 * **gecko profile interval**: 1 17416 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-trr-performance.toml#79>`__ 17417 * **lower is better**: true 17418 * **page cycles**: 1 17419 * **page timeout**: 60000 17420 * **test script**: trr_performance.js 17421 * **test url**: `<None>`__ 17422 * **type**: pageload 17423 * **unit**: ms 17424 * **use live sites**: true 17425 * **Test Task**: 17426 17427 .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** 17428 :widths: 30 15 15 15 15 17429 :header-rows: 1 17430 17431 * - **Test Name** 17432 - mozilla-central 17433 - autoland 17434 - mozilla-release 17435 - mozilla-beta 17436 * - **browsertime-trr-performance-m-fenix-trr-clou-m** 17437 - ✅ 17438 - ❌ 17439 - ❌ 17440 - ❌ 17441 * - **browsertime-trr-performance-m-fenix-trr-clou-m-nofis** 17442 - ✅ 17443 - ❌ 17444 - ❌ 17445 - ❌ 17446 17447 17448 .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** 17449 :widths: 30 15 15 15 15 17450 :header-rows: 1 17451 17452 * - **Test Name** 17453 - mozilla-central 17454 - autoland 17455 - mozilla-release 17456 - mozilla-beta 17457 * - **browsertime-trr-performance-m-fenix-trr-clou-m** 17458 - ❌ 17459 - ❌ 17460 - ❌ 17461 - ❌ 17462 * - **browsertime-trr-performance-m-fenix-trr-clou-m-nofis** 17463 - ❌ 17464 - ❌ 17465 - ❌ 17466 - ❌ 17467 17468 17469 17470 .. dropdown:: trr-cloudf 17471 :class-container: anchor-id-trr-cloudf-c 17472 17473 * Command to Run Locally 17474 17475 .. code-block:: 17476 17477 ./mach raptor -t trr-cloudf 17478 17479 **Owner**: Network Team 17480 17481 **Description**: Tests DNS lookup time on a Cloudflare TRR server. 17482 17483 * **alert threshold**: 2.0 17484 * **apps**: firefox,fenix 17485 * **browser cycles**: 3 17486 * **browsertime args**: --browsertime.test_type=browser_idle --firefox.preference network.trr.mode:3 --firefox.preference network.trr.uri:https://mozilla.cloudflare-dns.com/dns-query 17487 * **cold**: true 17488 * **custom data**: true 17489 * **expected**: pass 17490 * **gecko profile interval**: 1 17491 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-trr-performance.toml#16>`__ 17492 * **lower is better**: true 17493 * **page cycles**: 1 17494 * **page timeout**: 60000 17495 * **test script**: trr_performance.js 17496 * **test url**: `<None>`__ 17497 * **type**: pageload 17498 * **unit**: ms 17499 * **use live sites**: true 17500 * **Test Task**: 17501 17502 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 17503 :widths: 30 15 15 15 15 17504 :header-rows: 1 17505 17506 * - **Test Name** 17507 - mozilla-central 17508 - autoland 17509 - mozilla-release 17510 - mozilla-beta 17511 * - **browsertime-trr-performance-firefox-trr-cloudf** 17512 - ❌ 17513 - ❌ 17514 - ❌ 17515 - ❌ 17516 17517 17518 .. list-table:: **test-linux1804-64-qr/opt** 17519 :widths: 30 15 15 15 15 17520 :header-rows: 1 17521 17522 * - **Test Name** 17523 - mozilla-central 17524 - autoland 17525 - mozilla-release 17526 - mozilla-beta 17527 * - **browsertime-trr-performance-firefox-trr-cloudf** 17528 - ❌ 17529 - ❌ 17530 - ❌ 17531 - ❌ 17532 17533 17534 .. list-table:: **test-linux1804-64-shippable-qr/opt** 17535 :widths: 30 15 15 15 15 17536 :header-rows: 1 17537 17538 * - **Test Name** 17539 - mozilla-central 17540 - autoland 17541 - mozilla-release 17542 - mozilla-beta 17543 * - **browsertime-trr-performance-firefox-trr-cloudf** 17544 - ❌ 17545 - ❌ 17546 - ❌ 17547 - ❌ 17548 17549 17550 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 17551 :widths: 30 15 15 15 15 17552 :header-rows: 1 17553 17554 * - **Test Name** 17555 - mozilla-central 17556 - autoland 17557 - mozilla-release 17558 - mozilla-beta 17559 * - **browsertime-trr-performance-firefox-trr-cloudf** 17560 - ❌ 17561 - ❌ 17562 - ❌ 17563 - ❌ 17564 17565 17566 .. list-table:: **test-macosx1470-64-shippable/opt** 17567 :widths: 30 15 15 15 15 17568 :header-rows: 1 17569 17570 * - **Test Name** 17571 - mozilla-central 17572 - autoland 17573 - mozilla-release 17574 - mozilla-beta 17575 * - **browsertime-trr-performance-firefox-trr-cloudf** 17576 - ❌ 17577 - ❌ 17578 - ❌ 17579 - ❌ 17580 17581 17582 .. list-table:: **test-macosx1470-64/opt** 17583 :widths: 30 15 15 15 15 17584 :header-rows: 1 17585 17586 * - **Test Name** 17587 - mozilla-central 17588 - autoland 17589 - mozilla-release 17590 - mozilla-beta 17591 * - **browsertime-trr-performance-firefox-trr-cloudf** 17592 - ❌ 17593 - ❌ 17594 - ❌ 17595 - ❌ 17596 17597 17598 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 17599 :widths: 30 15 15 15 15 17600 :header-rows: 1 17601 17602 * - **Test Name** 17603 - mozilla-central 17604 - autoland 17605 - mozilla-release 17606 - mozilla-beta 17607 * - **browsertime-trr-performance-firefox-trr-cloudf** 17608 - ❌ 17609 - ❌ 17610 - ❌ 17611 - ❌ 17612 17613 17614 .. list-table:: **test-windows11-64-24h2-shippable/opt** 17615 :widths: 30 15 15 15 15 17616 :header-rows: 1 17617 17618 * - **Test Name** 17619 - mozilla-central 17620 - autoland 17621 - mozilla-release 17622 - mozilla-beta 17623 * - **browsertime-trr-performance-firefox-trr-cloudf** 17624 - ✅ 17625 - ❌ 17626 - ❌ 17627 - ❌ 17628 17629 17630 .. list-table:: **test-windows11-64-24h2/opt** 17631 :widths: 30 15 15 15 15 17632 :header-rows: 1 17633 17634 * - **Test Name** 17635 - mozilla-central 17636 - autoland 17637 - mozilla-release 17638 - mozilla-beta 17639 * - **browsertime-trr-performance-firefox-trr-cloudf** 17640 - ❌ 17641 - ❌ 17642 - ❌ 17643 - ❌ 17644 17645 17646 17647 .. dropdown:: trr-comcas 17648 :class-container: anchor-id-trr-comcas-c 17649 17650 * Command to Run Locally 17651 17652 .. code-block:: 17653 17654 ./mach raptor -t trr-comcas 17655 17656 **Owner**: Network Team 17657 17658 **Description**: Tests DNS lookup time on a Comcast TRR server. 17659 17660 * **alert threshold**: 2.0 17661 * **apps**: firefox,fenix 17662 * **browser cycles**: 3 17663 * **browsertime args**: --browsertime.test_type=browser_idle --firefox.preference network.trr.mode:3 --firefox.preference network.trr.uri:https://doh.xfinity.com/dns-query 17664 * **cold**: true 17665 * **custom data**: true 17666 * **expected**: pass 17667 * **gecko profile interval**: 1 17668 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-trr-performance.toml#30>`__ 17669 * **lower is better**: true 17670 * **page cycles**: 1 17671 * **page timeout**: 60000 17672 * **test script**: trr_performance.js 17673 * **test url**: `<None>`__ 17674 * **type**: pageload 17675 * **unit**: ms 17676 * **use live sites**: true 17677 * **Test Task**: 17678 17679 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 17680 :widths: 30 15 15 15 15 17681 :header-rows: 1 17682 17683 * - **Test Name** 17684 - mozilla-central 17685 - autoland 17686 - mozilla-release 17687 - mozilla-beta 17688 * - **browsertime-trr-performance-firefox-trr-comcas** 17689 - ❌ 17690 - ❌ 17691 - ❌ 17692 - ❌ 17693 17694 17695 .. list-table:: **test-linux1804-64-qr/opt** 17696 :widths: 30 15 15 15 15 17697 :header-rows: 1 17698 17699 * - **Test Name** 17700 - mozilla-central 17701 - autoland 17702 - mozilla-release 17703 - mozilla-beta 17704 * - **browsertime-trr-performance-firefox-trr-comcas** 17705 - ❌ 17706 - ❌ 17707 - ❌ 17708 - ❌ 17709 17710 17711 .. list-table:: **test-linux1804-64-shippable-qr/opt** 17712 :widths: 30 15 15 15 15 17713 :header-rows: 1 17714 17715 * - **Test Name** 17716 - mozilla-central 17717 - autoland 17718 - mozilla-release 17719 - mozilla-beta 17720 * - **browsertime-trr-performance-firefox-trr-comcas** 17721 - ❌ 17722 - ❌ 17723 - ❌ 17724 - ❌ 17725 17726 17727 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 17728 :widths: 30 15 15 15 15 17729 :header-rows: 1 17730 17731 * - **Test Name** 17732 - mozilla-central 17733 - autoland 17734 - mozilla-release 17735 - mozilla-beta 17736 * - **browsertime-trr-performance-firefox-trr-comcas** 17737 - ❌ 17738 - ❌ 17739 - ❌ 17740 - ❌ 17741 17742 17743 .. list-table:: **test-macosx1470-64-shippable/opt** 17744 :widths: 30 15 15 15 15 17745 :header-rows: 1 17746 17747 * - **Test Name** 17748 - mozilla-central 17749 - autoland 17750 - mozilla-release 17751 - mozilla-beta 17752 * - **browsertime-trr-performance-firefox-trr-comcas** 17753 - ❌ 17754 - ❌ 17755 - ❌ 17756 - ❌ 17757 17758 17759 .. list-table:: **test-macosx1470-64/opt** 17760 :widths: 30 15 15 15 15 17761 :header-rows: 1 17762 17763 * - **Test Name** 17764 - mozilla-central 17765 - autoland 17766 - mozilla-release 17767 - mozilla-beta 17768 * - **browsertime-trr-performance-firefox-trr-comcas** 17769 - ❌ 17770 - ❌ 17771 - ❌ 17772 - ❌ 17773 17774 17775 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 17776 :widths: 30 15 15 15 15 17777 :header-rows: 1 17778 17779 * - **Test Name** 17780 - mozilla-central 17781 - autoland 17782 - mozilla-release 17783 - mozilla-beta 17784 * - **browsertime-trr-performance-firefox-trr-comcas** 17785 - ❌ 17786 - ❌ 17787 - ❌ 17788 - ❌ 17789 17790 17791 .. list-table:: **test-windows11-64-24h2-shippable/opt** 17792 :widths: 30 15 15 15 15 17793 :header-rows: 1 17794 17795 * - **Test Name** 17796 - mozilla-central 17797 - autoland 17798 - mozilla-release 17799 - mozilla-beta 17800 * - **browsertime-trr-performance-firefox-trr-comcas** 17801 - ✅ 17802 - ❌ 17803 - ❌ 17804 - ❌ 17805 17806 17807 .. list-table:: **test-windows11-64-24h2/opt** 17808 :widths: 30 15 15 15 15 17809 :header-rows: 1 17810 17811 * - **Test Name** 17812 - mozilla-central 17813 - autoland 17814 - mozilla-release 17815 - mozilla-beta 17816 * - **browsertime-trr-performance-firefox-trr-comcas** 17817 - ❌ 17818 - ❌ 17819 - ❌ 17820 - ❌ 17821 17822 17823 17824 .. dropdown:: trr-multi 17825 :class-container: anchor-id-trr-multi-c 17826 17827 * Command to Run Locally 17828 17829 .. code-block:: 17830 17831 ./mach raptor -t trr-multi 17832 17833 **Owner**: Network Team 17834 17835 **Description**: Tests multi-domain DNS lookup and pageload performance on a Cloudflare TRR server. 17836 17837 * **alert threshold**: 2.0 17838 * **apps**: firefox,fenix 17839 * **browser cycles**: 3 17840 * **browsertime args**: --browsertime.test_type=browser_idle --firefox.preference network.trr.mode:3 --firefox.preference network.trr.uri:https://mozilla.cloudflare-dns.com/dns-query 17841 * **cold**: true 17842 * **custom data**: true 17843 * **expected**: pass 17844 * **gecko profile interval**: 1 17845 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-trr-performance.toml#114>`__ 17846 * **lower is better**: true 17847 * **page cycles**: 1 17848 * **page timeout**: 60000 17849 * **test script**: trr_multi_domain_performance.js 17850 * **test url**: `<None>`__ 17851 * **type**: pageload 17852 * **unit**: ms 17853 * **use live sites**: true 17854 * **Test Task**: 17855 17856 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 17857 :widths: 30 15 15 15 15 17858 :header-rows: 1 17859 17860 * - **Test Name** 17861 - mozilla-central 17862 - autoland 17863 - mozilla-release 17864 - mozilla-beta 17865 * - **browsertime-trr-performance-firefox-trr-multi** 17866 - ❌ 17867 - ❌ 17868 - ❌ 17869 - ❌ 17870 17871 17872 .. list-table:: **test-linux1804-64-qr/opt** 17873 :widths: 30 15 15 15 15 17874 :header-rows: 1 17875 17876 * - **Test Name** 17877 - mozilla-central 17878 - autoland 17879 - mozilla-release 17880 - mozilla-beta 17881 * - **browsertime-trr-performance-firefox-trr-multi** 17882 - ❌ 17883 - ❌ 17884 - ❌ 17885 - ❌ 17886 17887 17888 .. list-table:: **test-linux1804-64-shippable-qr/opt** 17889 :widths: 30 15 15 15 15 17890 :header-rows: 1 17891 17892 * - **Test Name** 17893 - mozilla-central 17894 - autoland 17895 - mozilla-release 17896 - mozilla-beta 17897 * - **browsertime-trr-performance-firefox-trr-multi** 17898 - ❌ 17899 - ❌ 17900 - ❌ 17901 - ❌ 17902 17903 17904 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 17905 :widths: 30 15 15 15 15 17906 :header-rows: 1 17907 17908 * - **Test Name** 17909 - mozilla-central 17910 - autoland 17911 - mozilla-release 17912 - mozilla-beta 17913 * - **browsertime-trr-performance-firefox-trr-multi** 17914 - ❌ 17915 - ❌ 17916 - ❌ 17917 - ❌ 17918 17919 17920 .. list-table:: **test-macosx1470-64-shippable/opt** 17921 :widths: 30 15 15 15 15 17922 :header-rows: 1 17923 17924 * - **Test Name** 17925 - mozilla-central 17926 - autoland 17927 - mozilla-release 17928 - mozilla-beta 17929 * - **browsertime-trr-performance-firefox-trr-multi** 17930 - ❌ 17931 - ❌ 17932 - ❌ 17933 - ❌ 17934 17935 17936 .. list-table:: **test-macosx1470-64/opt** 17937 :widths: 30 15 15 15 15 17938 :header-rows: 1 17939 17940 * - **Test Name** 17941 - mozilla-central 17942 - autoland 17943 - mozilla-release 17944 - mozilla-beta 17945 * - **browsertime-trr-performance-firefox-trr-multi** 17946 - ❌ 17947 - ❌ 17948 - ❌ 17949 - ❌ 17950 17951 17952 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 17953 :widths: 30 15 15 15 15 17954 :header-rows: 1 17955 17956 * - **Test Name** 17957 - mozilla-central 17958 - autoland 17959 - mozilla-release 17960 - mozilla-beta 17961 * - **browsertime-trr-performance-firefox-trr-multi** 17962 - ❌ 17963 - ❌ 17964 - ❌ 17965 - ❌ 17966 17967 17968 .. list-table:: **test-windows11-64-24h2-shippable/opt** 17969 :widths: 30 15 15 15 15 17970 :header-rows: 1 17971 17972 * - **Test Name** 17973 - mozilla-central 17974 - autoland 17975 - mozilla-release 17976 - mozilla-beta 17977 * - **browsertime-trr-performance-firefox-trr-multi** 17978 - ✅ 17979 - ❌ 17980 - ❌ 17981 - ❌ 17982 17983 17984 .. list-table:: **test-windows11-64-24h2/opt** 17985 :widths: 30 15 15 15 15 17986 :header-rows: 1 17987 17988 * - **Test Name** 17989 - mozilla-central 17990 - autoland 17991 - mozilla-release 17992 - mozilla-beta 17993 * - **browsertime-trr-performance-firefox-trr-multi** 17994 - ❌ 17995 - ❌ 17996 - ❌ 17997 - ❌ 17998 17999 18000 18001 .. dropdown:: trr-multm 18002 :class-container: anchor-id-trr-multm-c 18003 18004 * Command to Run Locally 18005 18006 .. code-block:: 18007 18008 ./mach raptor -t trr-multm 18009 18010 **Owner**: Network Team 18011 18012 **Description**: Tests multi-domain DNS lookup and pageload performance on a Cloudflare TRR server, mobile. 18013 18014 * **alert threshold**: 2.0 18015 * **apps**: firefox,fenix 18016 * **browser cycles**: 3 18017 * **browsertime args**: --browsertime.test_type=browser_idle --firefox.preference network.trr.mode:3 --firefox.preference network.trr.uri:https://mozilla.cloudflare-dns.com/dns-query 18018 * **cold**: true 18019 * **custom data**: true 18020 * **expected**: pass 18021 * **gecko profile interval**: 1 18022 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-trr-performance.toml#121>`__ 18023 * **lower is better**: true 18024 * **page cycles**: 1 18025 * **page timeout**: 60000 18026 * **test script**: trr_multi_domain_performance.js 18027 * **test url**: `<None>`__ 18028 * **type**: pageload 18029 * **unit**: ms 18030 * **use live sites**: true 18031 * **Test Task**: 18032 18033 .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** 18034 :widths: 30 15 15 15 15 18035 :header-rows: 1 18036 18037 * - **Test Name** 18038 - mozilla-central 18039 - autoland 18040 - mozilla-release 18041 - mozilla-beta 18042 * - **browsertime-trr-performance-m-fenix-trr-multm** 18043 - ✅ 18044 - ❌ 18045 - ❌ 18046 - ❌ 18047 * - **browsertime-trr-performance-m-fenix-trr-multm-nofis** 18048 - ✅ 18049 - ❌ 18050 - ❌ 18051 - ❌ 18052 18053 18054 .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** 18055 :widths: 30 15 15 15 15 18056 :header-rows: 1 18057 18058 * - **Test Name** 18059 - mozilla-central 18060 - autoland 18061 - mozilla-release 18062 - mozilla-beta 18063 * - **browsertime-trr-performance-m-fenix-trr-multm** 18064 - ❌ 18065 - ❌ 18066 - ❌ 18067 - ❌ 18068 * - **browsertime-trr-performance-m-fenix-trr-multm-nofis** 18069 - ❌ 18070 - ❌ 18071 - ❌ 18072 - ❌ 18073 18074 18075 18076 .. dropdown:: trr-native 18077 :class-container: anchor-id-trr-native-c 18078 18079 * Command to Run Locally 18080 18081 .. code-block:: 18082 18083 ./mach raptor -t trr-native 18084 18085 **Owner**: Network Team 18086 18087 **Description**: Tests DNS lookup time via native DNS. 18088 18089 * **alert threshold**: 2.0 18090 * **apps**: firefox,fenix 18091 * **browser cycles**: 3 18092 * **browsertime args**: --browsertime.test_type=browser_idle --firefox.preference network.trr.mode:0 18093 * **cold**: true 18094 * **custom data**: true 18095 * **expected**: pass 18096 * **gecko profile interval**: 1 18097 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-trr-performance.toml#44>`__ 18098 * **lower is better**: true 18099 * **page cycles**: 1 18100 * **page timeout**: 60000 18101 * **test script**: trr_performance.js 18102 * **test url**: `<None>`__ 18103 * **type**: pageload 18104 * **unit**: ms 18105 * **use live sites**: true 18106 * **Test Task**: 18107 18108 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 18109 :widths: 30 15 15 15 15 18110 :header-rows: 1 18111 18112 * - **Test Name** 18113 - mozilla-central 18114 - autoland 18115 - mozilla-release 18116 - mozilla-beta 18117 * - **browsertime-trr-performance-firefox-trr-native** 18118 - ❌ 18119 - ❌ 18120 - ❌ 18121 - ❌ 18122 18123 18124 .. list-table:: **test-linux1804-64-qr/opt** 18125 :widths: 30 15 15 15 15 18126 :header-rows: 1 18127 18128 * - **Test Name** 18129 - mozilla-central 18130 - autoland 18131 - mozilla-release 18132 - mozilla-beta 18133 * - **browsertime-trr-performance-firefox-trr-native** 18134 - ❌ 18135 - ❌ 18136 - ❌ 18137 - ❌ 18138 18139 18140 .. list-table:: **test-linux1804-64-shippable-qr/opt** 18141 :widths: 30 15 15 15 15 18142 :header-rows: 1 18143 18144 * - **Test Name** 18145 - mozilla-central 18146 - autoland 18147 - mozilla-release 18148 - mozilla-beta 18149 * - **browsertime-trr-performance-firefox-trr-native** 18150 - ❌ 18151 - ❌ 18152 - ❌ 18153 - ❌ 18154 18155 18156 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 18157 :widths: 30 15 15 15 15 18158 :header-rows: 1 18159 18160 * - **Test Name** 18161 - mozilla-central 18162 - autoland 18163 - mozilla-release 18164 - mozilla-beta 18165 * - **browsertime-trr-performance-firefox-trr-native** 18166 - ❌ 18167 - ❌ 18168 - ❌ 18169 - ❌ 18170 18171 18172 .. list-table:: **test-macosx1470-64-shippable/opt** 18173 :widths: 30 15 15 15 15 18174 :header-rows: 1 18175 18176 * - **Test Name** 18177 - mozilla-central 18178 - autoland 18179 - mozilla-release 18180 - mozilla-beta 18181 * - **browsertime-trr-performance-firefox-trr-native** 18182 - ❌ 18183 - ❌ 18184 - ❌ 18185 - ❌ 18186 18187 18188 .. list-table:: **test-macosx1470-64/opt** 18189 :widths: 30 15 15 15 15 18190 :header-rows: 1 18191 18192 * - **Test Name** 18193 - mozilla-central 18194 - autoland 18195 - mozilla-release 18196 - mozilla-beta 18197 * - **browsertime-trr-performance-firefox-trr-native** 18198 - ❌ 18199 - ❌ 18200 - ❌ 18201 - ❌ 18202 18203 18204 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 18205 :widths: 30 15 15 15 15 18206 :header-rows: 1 18207 18208 * - **Test Name** 18209 - mozilla-central 18210 - autoland 18211 - mozilla-release 18212 - mozilla-beta 18213 * - **browsertime-trr-performance-firefox-trr-native** 18214 - ❌ 18215 - ❌ 18216 - ❌ 18217 - ❌ 18218 18219 18220 .. list-table:: **test-windows11-64-24h2-shippable/opt** 18221 :widths: 30 15 15 15 15 18222 :header-rows: 1 18223 18224 * - **Test Name** 18225 - mozilla-central 18226 - autoland 18227 - mozilla-release 18228 - mozilla-beta 18229 * - **browsertime-trr-performance-firefox-trr-native** 18230 - ✅ 18231 - ❌ 18232 - ❌ 18233 - ❌ 18234 18235 18236 .. list-table:: **test-windows11-64-24h2/opt** 18237 :widths: 30 15 15 15 15 18238 :header-rows: 1 18239 18240 * - **Test Name** 18241 - mozilla-central 18242 - autoland 18243 - mozilla-release 18244 - mozilla-beta 18245 * - **browsertime-trr-performance-firefox-trr-native** 18246 - ❌ 18247 - ❌ 18248 - ❌ 18249 - ❌ 18250 18251 18252 18253 .. dropdown:: trr-natv-m 18254 :class-container: anchor-id-trr-natv-m-c 18255 18256 * Command to Run Locally 18257 18258 .. code-block:: 18259 18260 ./mach raptor -t trr-natv-m 18261 18262 **Owner**: Network Team 18263 18264 **Description**: Tests DNS lookup time via native DNS, mobile. 18265 18266 * **alert threshold**: 2.0 18267 * **apps**: firefox,fenix 18268 * **browser cycles**: 3 18269 * **browsertime args**: --browsertime.test_type=browser_idle --firefox.preference network.trr.mode:0 18270 * **cold**: true 18271 * **custom data**: true 18272 * **expected**: pass 18273 * **gecko profile interval**: 1 18274 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-trr-performance.toml#93>`__ 18275 * **lower is better**: true 18276 * **page cycles**: 1 18277 * **page timeout**: 60000 18278 * **test script**: trr_performance.js 18279 * **test url**: `<None>`__ 18280 * **type**: pageload 18281 * **unit**: ms 18282 * **use live sites**: true 18283 * **Test Task**: 18284 18285 .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** 18286 :widths: 30 15 15 15 15 18287 :header-rows: 1 18288 18289 * - **Test Name** 18290 - mozilla-central 18291 - autoland 18292 - mozilla-release 18293 - mozilla-beta 18294 * - **browsertime-trr-performance-m-fenix-trr-natv-m** 18295 - ✅ 18296 - ❌ 18297 - ❌ 18298 - ❌ 18299 * - **browsertime-trr-performance-m-fenix-trr-natv-m-nofis** 18300 - ✅ 18301 - ❌ 18302 - ❌ 18303 - ❌ 18304 18305 18306 .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** 18307 :widths: 30 15 15 15 15 18308 :header-rows: 1 18309 18310 * - **Test Name** 18311 - mozilla-central 18312 - autoland 18313 - mozilla-release 18314 - mozilla-beta 18315 * - **browsertime-trr-performance-m-fenix-trr-natv-m** 18316 - ❌ 18317 - ❌ 18318 - ❌ 18319 - ❌ 18320 * - **browsertime-trr-performance-m-fenix-trr-natv-m-nofis** 18321 - ❌ 18322 - ❌ 18323 - ❌ 18324 - ❌ 18325 18326 18327 18328 .. dropdown:: trr-next 18329 :class-container: anchor-id-trr-next-c 18330 18331 * Command to Run Locally 18332 18333 .. code-block:: 18334 18335 ./mach raptor -t trr-next 18336 18337 **Owner**: Network Team 18338 18339 **Description**: Tests DNS lookup time on a NextDNS TRR server. 18340 18341 * **alert threshold**: 2.0 18342 * **apps**: firefox,fenix 18343 * **browser cycles**: 3 18344 * **browsertime args**: --browsertime.test_type=browser_idle --firefox.preference network.trr.mode:3 --firefox.preference network.trr.uri:https://firefox.dns.nextdns.io/dns-query 18345 * **cold**: true 18346 * **custom data**: true 18347 * **expected**: pass 18348 * **gecko profile interval**: 1 18349 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-trr-performance.toml#37>`__ 18350 * **lower is better**: true 18351 * **page cycles**: 1 18352 * **page timeout**: 60000 18353 * **test script**: trr_performance.js 18354 * **test url**: `<None>`__ 18355 * **type**: pageload 18356 * **unit**: ms 18357 * **use live sites**: true 18358 * **Test Task**: 18359 18360 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 18361 :widths: 30 15 15 15 15 18362 :header-rows: 1 18363 18364 * - **Test Name** 18365 - mozilla-central 18366 - autoland 18367 - mozilla-release 18368 - mozilla-beta 18369 * - **browsertime-trr-performance-firefox-trr-next** 18370 - ❌ 18371 - ❌ 18372 - ❌ 18373 - ❌ 18374 18375 18376 .. list-table:: **test-linux1804-64-qr/opt** 18377 :widths: 30 15 15 15 15 18378 :header-rows: 1 18379 18380 * - **Test Name** 18381 - mozilla-central 18382 - autoland 18383 - mozilla-release 18384 - mozilla-beta 18385 * - **browsertime-trr-performance-firefox-trr-next** 18386 - ❌ 18387 - ❌ 18388 - ❌ 18389 - ❌ 18390 18391 18392 .. list-table:: **test-linux1804-64-shippable-qr/opt** 18393 :widths: 30 15 15 15 15 18394 :header-rows: 1 18395 18396 * - **Test Name** 18397 - mozilla-central 18398 - autoland 18399 - mozilla-release 18400 - mozilla-beta 18401 * - **browsertime-trr-performance-firefox-trr-next** 18402 - ❌ 18403 - ❌ 18404 - ❌ 18405 - ❌ 18406 18407 18408 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 18409 :widths: 30 15 15 15 15 18410 :header-rows: 1 18411 18412 * - **Test Name** 18413 - mozilla-central 18414 - autoland 18415 - mozilla-release 18416 - mozilla-beta 18417 * - **browsertime-trr-performance-firefox-trr-next** 18418 - ❌ 18419 - ❌ 18420 - ❌ 18421 - ❌ 18422 18423 18424 .. list-table:: **test-macosx1470-64-shippable/opt** 18425 :widths: 30 15 15 15 15 18426 :header-rows: 1 18427 18428 * - **Test Name** 18429 - mozilla-central 18430 - autoland 18431 - mozilla-release 18432 - mozilla-beta 18433 * - **browsertime-trr-performance-firefox-trr-next** 18434 - ❌ 18435 - ❌ 18436 - ❌ 18437 - ❌ 18438 18439 18440 .. list-table:: **test-macosx1470-64/opt** 18441 :widths: 30 15 15 15 15 18442 :header-rows: 1 18443 18444 * - **Test Name** 18445 - mozilla-central 18446 - autoland 18447 - mozilla-release 18448 - mozilla-beta 18449 * - **browsertime-trr-performance-firefox-trr-next** 18450 - ❌ 18451 - ❌ 18452 - ❌ 18453 - ❌ 18454 18455 18456 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 18457 :widths: 30 15 15 15 15 18458 :header-rows: 1 18459 18460 * - **Test Name** 18461 - mozilla-central 18462 - autoland 18463 - mozilla-release 18464 - mozilla-beta 18465 * - **browsertime-trr-performance-firefox-trr-next** 18466 - ❌ 18467 - ❌ 18468 - ❌ 18469 - ❌ 18470 18471 18472 .. list-table:: **test-windows11-64-24h2-shippable/opt** 18473 :widths: 30 15 15 15 15 18474 :header-rows: 1 18475 18476 * - **Test Name** 18477 - mozilla-central 18478 - autoland 18479 - mozilla-release 18480 - mozilla-beta 18481 * - **browsertime-trr-performance-firefox-trr-next** 18482 - ✅ 18483 - ❌ 18484 - ❌ 18485 - ❌ 18486 18487 18488 .. list-table:: **test-windows11-64-24h2/opt** 18489 :widths: 30 15 15 15 15 18490 :header-rows: 1 18491 18492 * - **Test Name** 18493 - mozilla-central 18494 - autoland 18495 - mozilla-release 18496 - mozilla-beta 18497 * - **browsertime-trr-performance-firefox-trr-next** 18498 - ❌ 18499 - ❌ 18500 - ❌ 18501 - ❌ 18502 18503 18504 18505 .. dropdown:: trr-next-m 18506 :class-container: anchor-id-trr-next-m-c 18507 18508 * Command to Run Locally 18509 18510 .. code-block:: 18511 18512 ./mach raptor -t trr-next-m 18513 18514 **Owner**: Network Team 18515 18516 **Description**: Tests DNS lookup time on a NextDNS TRR server, mobile. 18517 18518 * **alert threshold**: 2.0 18519 * **apps**: firefox,fenix 18520 * **browser cycles**: 3 18521 * **browsertime args**: --browsertime.test_type=browser_idle --firefox.preference network.trr.mode:3 --firefox.preference network.trr.uri:https://firefox.dns.nextdns.io/dns-query 18522 * **cold**: true 18523 * **custom data**: true 18524 * **expected**: pass 18525 * **gecko profile interval**: 1 18526 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-trr-performance.toml#86>`__ 18527 * **lower is better**: true 18528 * **page cycles**: 1 18529 * **page timeout**: 60000 18530 * **test script**: trr_performance.js 18531 * **test url**: `<None>`__ 18532 * **type**: pageload 18533 * **unit**: ms 18534 * **use live sites**: true 18535 * **Test Task**: 18536 18537 .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** 18538 :widths: 30 15 15 15 15 18539 :header-rows: 1 18540 18541 * - **Test Name** 18542 - mozilla-central 18543 - autoland 18544 - mozilla-release 18545 - mozilla-beta 18546 * - **browsertime-trr-performance-m-fenix-trr-next-m** 18547 - ✅ 18548 - ❌ 18549 - ❌ 18550 - ❌ 18551 * - **browsertime-trr-performance-m-fenix-trr-next-m-nofis** 18552 - ✅ 18553 - ❌ 18554 - ❌ 18555 - ❌ 18556 18557 18558 .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** 18559 :widths: 30 15 15 15 15 18560 :header-rows: 1 18561 18562 * - **Test Name** 18563 - mozilla-central 18564 - autoland 18565 - mozilla-release 18566 - mozilla-beta 18567 * - **browsertime-trr-performance-m-fenix-trr-next-m** 18568 - ❌ 18569 - ❌ 18570 - ❌ 18571 - ❌ 18572 * - **browsertime-trr-performance-m-fenix-trr-next-m-nofis** 18573 - ❌ 18574 - ❌ 18575 - ❌ 18576 - ❌ 18577 18578 18579 18580 .. dropdown:: trr-w-cira 18581 :class-container: anchor-id-trr-w-cira-c 18582 18583 * Command to Run Locally 18584 18585 .. code-block:: 18586 18587 ./mach raptor -t trr-w-cira 18588 18589 **Owner**: Network Team 18590 18591 **Description**: Tests DNS lookup time on a CIRA TRR server, with the TRR connection warmed up. 18592 18593 * **alert threshold**: 2.0 18594 * **apps**: firefox,fenix 18595 * **browser cycles**: 3 18596 * **browsertime args**: --browsertime.test_type=trr_warm --firefox.preference network.trr.mode:3 --firefox.preference network.trr.uri:https://private.canadianshield.cira.ca/dns-query 18597 * **cold**: true 18598 * **custom data**: true 18599 * **expected**: pass 18600 * **gecko profile interval**: 1 18601 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-trr-performance.toml#58>`__ 18602 * **lower is better**: true 18603 * **page cycles**: 1 18604 * **page timeout**: 60000 18605 * **test script**: trr_performance.js 18606 * **test url**: `<None>`__ 18607 * **type**: pageload 18608 * **unit**: ms 18609 * **use live sites**: true 18610 * **Test Task**: 18611 18612 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 18613 :widths: 30 15 15 15 15 18614 :header-rows: 1 18615 18616 * - **Test Name** 18617 - mozilla-central 18618 - autoland 18619 - mozilla-release 18620 - mozilla-beta 18621 * - **browsertime-trr-performance-firefox-trr-w-cira** 18622 - ❌ 18623 - ❌ 18624 - ❌ 18625 - ❌ 18626 18627 18628 .. list-table:: **test-linux1804-64-qr/opt** 18629 :widths: 30 15 15 15 15 18630 :header-rows: 1 18631 18632 * - **Test Name** 18633 - mozilla-central 18634 - autoland 18635 - mozilla-release 18636 - mozilla-beta 18637 * - **browsertime-trr-performance-firefox-trr-w-cira** 18638 - ❌ 18639 - ❌ 18640 - ❌ 18641 - ❌ 18642 18643 18644 .. list-table:: **test-linux1804-64-shippable-qr/opt** 18645 :widths: 30 15 15 15 15 18646 :header-rows: 1 18647 18648 * - **Test Name** 18649 - mozilla-central 18650 - autoland 18651 - mozilla-release 18652 - mozilla-beta 18653 * - **browsertime-trr-performance-firefox-trr-w-cira** 18654 - ❌ 18655 - ❌ 18656 - ❌ 18657 - ❌ 18658 18659 18660 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 18661 :widths: 30 15 15 15 15 18662 :header-rows: 1 18663 18664 * - **Test Name** 18665 - mozilla-central 18666 - autoland 18667 - mozilla-release 18668 - mozilla-beta 18669 * - **browsertime-trr-performance-firefox-trr-w-cira** 18670 - ❌ 18671 - ❌ 18672 - ❌ 18673 - ❌ 18674 18675 18676 .. list-table:: **test-macosx1470-64-shippable/opt** 18677 :widths: 30 15 15 15 15 18678 :header-rows: 1 18679 18680 * - **Test Name** 18681 - mozilla-central 18682 - autoland 18683 - mozilla-release 18684 - mozilla-beta 18685 * - **browsertime-trr-performance-firefox-trr-w-cira** 18686 - ❌ 18687 - ❌ 18688 - ❌ 18689 - ❌ 18690 18691 18692 .. list-table:: **test-macosx1470-64/opt** 18693 :widths: 30 15 15 15 15 18694 :header-rows: 1 18695 18696 * - **Test Name** 18697 - mozilla-central 18698 - autoland 18699 - mozilla-release 18700 - mozilla-beta 18701 * - **browsertime-trr-performance-firefox-trr-w-cira** 18702 - ❌ 18703 - ❌ 18704 - ❌ 18705 - ❌ 18706 18707 18708 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 18709 :widths: 30 15 15 15 15 18710 :header-rows: 1 18711 18712 * - **Test Name** 18713 - mozilla-central 18714 - autoland 18715 - mozilla-release 18716 - mozilla-beta 18717 * - **browsertime-trr-performance-firefox-trr-w-cira** 18718 - ❌ 18719 - ❌ 18720 - ❌ 18721 - ❌ 18722 18723 18724 .. list-table:: **test-windows11-64-24h2-shippable/opt** 18725 :widths: 30 15 15 15 15 18726 :header-rows: 1 18727 18728 * - **Test Name** 18729 - mozilla-central 18730 - autoland 18731 - mozilla-release 18732 - mozilla-beta 18733 * - **browsertime-trr-performance-firefox-trr-w-cira** 18734 - ✅ 18735 - ❌ 18736 - ❌ 18737 - ❌ 18738 18739 18740 .. list-table:: **test-windows11-64-24h2/opt** 18741 :widths: 30 15 15 15 15 18742 :header-rows: 1 18743 18744 * - **Test Name** 18745 - mozilla-central 18746 - autoland 18747 - mozilla-release 18748 - mozilla-beta 18749 * - **browsertime-trr-performance-firefox-trr-w-cira** 18750 - ❌ 18751 - ❌ 18752 - ❌ 18753 - ❌ 18754 18755 18756 18757 .. dropdown:: trr-w-cl-m 18758 :class-container: anchor-id-trr-w-cl-m-c 18759 18760 * Command to Run Locally 18761 18762 .. code-block:: 18763 18764 ./mach raptor -t trr-w-cl-m 18765 18766 **Owner**: Network Team 18767 18768 **Description**: Tests DNS lookup time on a Cloudflare TRR server, with the TRR connection warmed up, mobile. 18769 18770 * **alert threshold**: 2.0 18771 * **apps**: firefox,fenix 18772 * **browser cycles**: 3 18773 * **browsertime args**: --browsertime.test_type=trr_warm --firefox.preference network.trr.mode:3 --firefox.preference network.trr.uri:https://mozilla.cloudflare-dns.com/dns-query 18774 * **cold**: true 18775 * **custom data**: true 18776 * **expected**: pass 18777 * **gecko profile interval**: 1 18778 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-trr-performance.toml#100>`__ 18779 * **lower is better**: true 18780 * **page cycles**: 1 18781 * **page timeout**: 60000 18782 * **test script**: trr_performance.js 18783 * **test url**: `<None>`__ 18784 * **type**: pageload 18785 * **unit**: ms 18786 * **use live sites**: true 18787 * **Test Task**: 18788 18789 .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** 18790 :widths: 30 15 15 15 15 18791 :header-rows: 1 18792 18793 * - **Test Name** 18794 - mozilla-central 18795 - autoland 18796 - mozilla-release 18797 - mozilla-beta 18798 * - **browsertime-trr-performance-m-fenix-trr-w-cl-m** 18799 - ✅ 18800 - ❌ 18801 - ❌ 18802 - ❌ 18803 * - **browsertime-trr-performance-m-fenix-trr-w-cl-m-nofis** 18804 - ✅ 18805 - ❌ 18806 - ❌ 18807 - ❌ 18808 18809 18810 .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** 18811 :widths: 30 15 15 15 15 18812 :header-rows: 1 18813 18814 * - **Test Name** 18815 - mozilla-central 18816 - autoland 18817 - mozilla-release 18818 - mozilla-beta 18819 * - **browsertime-trr-performance-m-fenix-trr-w-cl-m** 18820 - ❌ 18821 - ❌ 18822 - ❌ 18823 - ❌ 18824 * - **browsertime-trr-performance-m-fenix-trr-w-cl-m-nofis** 18825 - ❌ 18826 - ❌ 18827 - ❌ 18828 - ❌ 18829 18830 18831 18832 .. dropdown:: trr-w-clou 18833 :class-container: anchor-id-trr-w-clou-c 18834 18835 * Command to Run Locally 18836 18837 .. code-block:: 18838 18839 ./mach raptor -t trr-w-clou 18840 18841 **Owner**: Network Team 18842 18843 **Description**: Tests DNS lookup time on a Cloudflare TRR server, with the TRR connection warmed up. 18844 18845 * **alert threshold**: 2.0 18846 * **apps**: firefox,fenix 18847 * **browser cycles**: 3 18848 * **browsertime args**: --browsertime.test_type=trr_warm --firefox.preference network.trr.mode:3 --firefox.preference network.trr.uri:https://mozilla.cloudflare-dns.com/dns-query 18849 * **cold**: true 18850 * **custom data**: true 18851 * **expected**: pass 18852 * **gecko profile interval**: 1 18853 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-trr-performance.toml#51>`__ 18854 * **lower is better**: true 18855 * **page cycles**: 1 18856 * **page timeout**: 60000 18857 * **test script**: trr_performance.js 18858 * **test url**: `<None>`__ 18859 * **type**: pageload 18860 * **unit**: ms 18861 * **use live sites**: true 18862 * **Test Task**: 18863 18864 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 18865 :widths: 30 15 15 15 15 18866 :header-rows: 1 18867 18868 * - **Test Name** 18869 - mozilla-central 18870 - autoland 18871 - mozilla-release 18872 - mozilla-beta 18873 * - **browsertime-trr-performance-firefox-trr-w-clou** 18874 - ❌ 18875 - ❌ 18876 - ❌ 18877 - ❌ 18878 18879 18880 .. list-table:: **test-linux1804-64-qr/opt** 18881 :widths: 30 15 15 15 15 18882 :header-rows: 1 18883 18884 * - **Test Name** 18885 - mozilla-central 18886 - autoland 18887 - mozilla-release 18888 - mozilla-beta 18889 * - **browsertime-trr-performance-firefox-trr-w-clou** 18890 - ❌ 18891 - ❌ 18892 - ❌ 18893 - ❌ 18894 18895 18896 .. list-table:: **test-linux1804-64-shippable-qr/opt** 18897 :widths: 30 15 15 15 15 18898 :header-rows: 1 18899 18900 * - **Test Name** 18901 - mozilla-central 18902 - autoland 18903 - mozilla-release 18904 - mozilla-beta 18905 * - **browsertime-trr-performance-firefox-trr-w-clou** 18906 - ❌ 18907 - ❌ 18908 - ❌ 18909 - ❌ 18910 18911 18912 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 18913 :widths: 30 15 15 15 15 18914 :header-rows: 1 18915 18916 * - **Test Name** 18917 - mozilla-central 18918 - autoland 18919 - mozilla-release 18920 - mozilla-beta 18921 * - **browsertime-trr-performance-firefox-trr-w-clou** 18922 - ❌ 18923 - ❌ 18924 - ❌ 18925 - ❌ 18926 18927 18928 .. list-table:: **test-macosx1470-64-shippable/opt** 18929 :widths: 30 15 15 15 15 18930 :header-rows: 1 18931 18932 * - **Test Name** 18933 - mozilla-central 18934 - autoland 18935 - mozilla-release 18936 - mozilla-beta 18937 * - **browsertime-trr-performance-firefox-trr-w-clou** 18938 - ❌ 18939 - ❌ 18940 - ❌ 18941 - ❌ 18942 18943 18944 .. list-table:: **test-macosx1470-64/opt** 18945 :widths: 30 15 15 15 15 18946 :header-rows: 1 18947 18948 * - **Test Name** 18949 - mozilla-central 18950 - autoland 18951 - mozilla-release 18952 - mozilla-beta 18953 * - **browsertime-trr-performance-firefox-trr-w-clou** 18954 - ❌ 18955 - ❌ 18956 - ❌ 18957 - ❌ 18958 18959 18960 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 18961 :widths: 30 15 15 15 15 18962 :header-rows: 1 18963 18964 * - **Test Name** 18965 - mozilla-central 18966 - autoland 18967 - mozilla-release 18968 - mozilla-beta 18969 * - **browsertime-trr-performance-firefox-trr-w-clou** 18970 - ❌ 18971 - ❌ 18972 - ❌ 18973 - ❌ 18974 18975 18976 .. list-table:: **test-windows11-64-24h2-shippable/opt** 18977 :widths: 30 15 15 15 15 18978 :header-rows: 1 18979 18980 * - **Test Name** 18981 - mozilla-central 18982 - autoland 18983 - mozilla-release 18984 - mozilla-beta 18985 * - **browsertime-trr-performance-firefox-trr-w-clou** 18986 - ✅ 18987 - ❌ 18988 - ❌ 18989 - ❌ 18990 18991 18992 .. list-table:: **test-windows11-64-24h2/opt** 18993 :widths: 30 15 15 15 15 18994 :header-rows: 1 18995 18996 * - **Test Name** 18997 - mozilla-central 18998 - autoland 18999 - mozilla-release 19000 - mozilla-beta 19001 * - **browsertime-trr-performance-firefox-trr-w-clou** 19002 - ❌ 19003 - ❌ 19004 - ❌ 19005 - ❌ 19006 19007 19008 19009 .. dropdown:: trr-w-comc 19010 :class-container: anchor-id-trr-w-comc-c 19011 19012 * Command to Run Locally 19013 19014 .. code-block:: 19015 19016 ./mach raptor -t trr-w-comc 19017 19018 **Owner**: Network Team 19019 19020 **Description**: Tests DNS lookup time on a Comcast TRR server, with the TRR connection warmed up. 19021 19022 * **alert threshold**: 2.0 19023 * **apps**: firefox,fenix 19024 * **browser cycles**: 3 19025 * **browsertime args**: --browsertime.test_type=trr_warm --firefox.preference network.trr.mode:3 --firefox.preference network.trr.uri:https://doh.xfinity.com/dns-query 19026 * **cold**: true 19027 * **custom data**: true 19028 * **expected**: pass 19029 * **gecko profile interval**: 1 19030 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-trr-performance.toml#65>`__ 19031 * **lower is better**: true 19032 * **page cycles**: 1 19033 * **page timeout**: 60000 19034 * **test script**: trr_performance.js 19035 * **test url**: `<None>`__ 19036 * **type**: pageload 19037 * **unit**: ms 19038 * **use live sites**: true 19039 * **Test Task**: 19040 19041 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 19042 :widths: 30 15 15 15 15 19043 :header-rows: 1 19044 19045 * - **Test Name** 19046 - mozilla-central 19047 - autoland 19048 - mozilla-release 19049 - mozilla-beta 19050 * - **browsertime-trr-performance-firefox-trr-w-comc** 19051 - ❌ 19052 - ❌ 19053 - ❌ 19054 - ❌ 19055 19056 19057 .. list-table:: **test-linux1804-64-qr/opt** 19058 :widths: 30 15 15 15 15 19059 :header-rows: 1 19060 19061 * - **Test Name** 19062 - mozilla-central 19063 - autoland 19064 - mozilla-release 19065 - mozilla-beta 19066 * - **browsertime-trr-performance-firefox-trr-w-comc** 19067 - ❌ 19068 - ❌ 19069 - ❌ 19070 - ❌ 19071 19072 19073 .. list-table:: **test-linux1804-64-shippable-qr/opt** 19074 :widths: 30 15 15 15 15 19075 :header-rows: 1 19076 19077 * - **Test Name** 19078 - mozilla-central 19079 - autoland 19080 - mozilla-release 19081 - mozilla-beta 19082 * - **browsertime-trr-performance-firefox-trr-w-comc** 19083 - ❌ 19084 - ❌ 19085 - ❌ 19086 - ❌ 19087 19088 19089 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 19090 :widths: 30 15 15 15 15 19091 :header-rows: 1 19092 19093 * - **Test Name** 19094 - mozilla-central 19095 - autoland 19096 - mozilla-release 19097 - mozilla-beta 19098 * - **browsertime-trr-performance-firefox-trr-w-comc** 19099 - ❌ 19100 - ❌ 19101 - ❌ 19102 - ❌ 19103 19104 19105 .. list-table:: **test-macosx1470-64-shippable/opt** 19106 :widths: 30 15 15 15 15 19107 :header-rows: 1 19108 19109 * - **Test Name** 19110 - mozilla-central 19111 - autoland 19112 - mozilla-release 19113 - mozilla-beta 19114 * - **browsertime-trr-performance-firefox-trr-w-comc** 19115 - ❌ 19116 - ❌ 19117 - ❌ 19118 - ❌ 19119 19120 19121 .. list-table:: **test-macosx1470-64/opt** 19122 :widths: 30 15 15 15 15 19123 :header-rows: 1 19124 19125 * - **Test Name** 19126 - mozilla-central 19127 - autoland 19128 - mozilla-release 19129 - mozilla-beta 19130 * - **browsertime-trr-performance-firefox-trr-w-comc** 19131 - ❌ 19132 - ❌ 19133 - ❌ 19134 - ❌ 19135 19136 19137 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 19138 :widths: 30 15 15 15 15 19139 :header-rows: 1 19140 19141 * - **Test Name** 19142 - mozilla-central 19143 - autoland 19144 - mozilla-release 19145 - mozilla-beta 19146 * - **browsertime-trr-performance-firefox-trr-w-comc** 19147 - ❌ 19148 - ❌ 19149 - ❌ 19150 - ❌ 19151 19152 19153 .. list-table:: **test-windows11-64-24h2-shippable/opt** 19154 :widths: 30 15 15 15 15 19155 :header-rows: 1 19156 19157 * - **Test Name** 19158 - mozilla-central 19159 - autoland 19160 - mozilla-release 19161 - mozilla-beta 19162 * - **browsertime-trr-performance-firefox-trr-w-comc** 19163 - ✅ 19164 - ❌ 19165 - ❌ 19166 - ❌ 19167 19168 19169 .. list-table:: **test-windows11-64-24h2/opt** 19170 :widths: 30 15 15 15 15 19171 :header-rows: 1 19172 19173 * - **Test Name** 19174 - mozilla-central 19175 - autoland 19176 - mozilla-release 19177 - mozilla-beta 19178 * - **browsertime-trr-performance-firefox-trr-w-comc** 19179 - ❌ 19180 - ❌ 19181 - ❌ 19182 - ❌ 19183 19184 19185 19186 .. dropdown:: trr-w-ne-m 19187 :class-container: anchor-id-trr-w-ne-m-c 19188 19189 * Command to Run Locally 19190 19191 .. code-block:: 19192 19193 ./mach raptor -t trr-w-ne-m 19194 19195 **Owner**: Network Team 19196 19197 **Description**: Tests DNS lookup time on a NextDNS TRR server, with the TRR connection warmed up, mobile. 19198 19199 * **alert threshold**: 2.0 19200 * **apps**: firefox,fenix 19201 * **browser cycles**: 3 19202 * **browsertime args**: --browsertime.test_type=trr_warm --firefox.preference network.trr.mode:3 --firefox.preference network.trr.uri:https://firefox.dns.nextdns.io/dns-query 19203 * **cold**: true 19204 * **custom data**: true 19205 * **expected**: pass 19206 * **gecko profile interval**: 1 19207 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-trr-performance.toml#107>`__ 19208 * **lower is better**: true 19209 * **page cycles**: 1 19210 * **page timeout**: 60000 19211 * **test script**: trr_performance.js 19212 * **test url**: `<None>`__ 19213 * **type**: pageload 19214 * **unit**: ms 19215 * **use live sites**: true 19216 * **Test Task**: 19217 19218 .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** 19219 :widths: 30 15 15 15 15 19220 :header-rows: 1 19221 19222 * - **Test Name** 19223 - mozilla-central 19224 - autoland 19225 - mozilla-release 19226 - mozilla-beta 19227 * - **browsertime-trr-performance-m-fenix-trr-w-ne-m** 19228 - ✅ 19229 - ❌ 19230 - ❌ 19231 - ❌ 19232 * - **browsertime-trr-performance-m-fenix-trr-w-ne-m-nofis** 19233 - ✅ 19234 - ❌ 19235 - ❌ 19236 - ❌ 19237 19238 19239 .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** 19240 :widths: 30 15 15 15 15 19241 :header-rows: 1 19242 19243 * - **Test Name** 19244 - mozilla-central 19245 - autoland 19246 - mozilla-release 19247 - mozilla-beta 19248 * - **browsertime-trr-performance-m-fenix-trr-w-ne-m** 19249 - ❌ 19250 - ❌ 19251 - ❌ 19252 - ❌ 19253 * - **browsertime-trr-performance-m-fenix-trr-w-ne-m-nofis** 19254 - ❌ 19255 - ❌ 19256 - ❌ 19257 - ❌ 19258 19259 19260 19261 .. dropdown:: trr-w-next 19262 :class-container: anchor-id-trr-w-next-c 19263 19264 * Command to Run Locally 19265 19266 .. code-block:: 19267 19268 ./mach raptor -t trr-w-next 19269 19270 **Owner**: Network Team 19271 19272 **Description**: Tests DNS lookup time on a NextDNS TRR server, with the TRR connection warmed up. 19273 19274 * **alert threshold**: 2.0 19275 * **apps**: firefox,fenix 19276 * **browser cycles**: 3 19277 * **browsertime args**: --browsertime.test_type=trr_warm --firefox.preference network.trr.mode:3 --firefox.preference network.trr.uri:https://firefox.dns.nextdns.io/dns-query 19278 * **cold**: true 19279 * **custom data**: true 19280 * **expected**: pass 19281 * **gecko profile interval**: 1 19282 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-trr-performance.toml#72>`__ 19283 * **lower is better**: true 19284 * **page cycles**: 1 19285 * **page timeout**: 60000 19286 * **test script**: trr_performance.js 19287 * **test url**: `<None>`__ 19288 * **type**: pageload 19289 * **unit**: ms 19290 * **use live sites**: true 19291 * **Test Task**: 19292 19293 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 19294 :widths: 30 15 15 15 15 19295 :header-rows: 1 19296 19297 * - **Test Name** 19298 - mozilla-central 19299 - autoland 19300 - mozilla-release 19301 - mozilla-beta 19302 * - **browsertime-trr-performance-firefox-trr-w-next** 19303 - ❌ 19304 - ❌ 19305 - ❌ 19306 - ❌ 19307 19308 19309 .. list-table:: **test-linux1804-64-qr/opt** 19310 :widths: 30 15 15 15 15 19311 :header-rows: 1 19312 19313 * - **Test Name** 19314 - mozilla-central 19315 - autoland 19316 - mozilla-release 19317 - mozilla-beta 19318 * - **browsertime-trr-performance-firefox-trr-w-next** 19319 - ❌ 19320 - ❌ 19321 - ❌ 19322 - ❌ 19323 19324 19325 .. list-table:: **test-linux1804-64-shippable-qr/opt** 19326 :widths: 30 15 15 15 15 19327 :header-rows: 1 19328 19329 * - **Test Name** 19330 - mozilla-central 19331 - autoland 19332 - mozilla-release 19333 - mozilla-beta 19334 * - **browsertime-trr-performance-firefox-trr-w-next** 19335 - ❌ 19336 - ❌ 19337 - ❌ 19338 - ❌ 19339 19340 19341 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 19342 :widths: 30 15 15 15 15 19343 :header-rows: 1 19344 19345 * - **Test Name** 19346 - mozilla-central 19347 - autoland 19348 - mozilla-release 19349 - mozilla-beta 19350 * - **browsertime-trr-performance-firefox-trr-w-next** 19351 - ❌ 19352 - ❌ 19353 - ❌ 19354 - ❌ 19355 19356 19357 .. list-table:: **test-macosx1470-64-shippable/opt** 19358 :widths: 30 15 15 15 15 19359 :header-rows: 1 19360 19361 * - **Test Name** 19362 - mozilla-central 19363 - autoland 19364 - mozilla-release 19365 - mozilla-beta 19366 * - **browsertime-trr-performance-firefox-trr-w-next** 19367 - ❌ 19368 - ❌ 19369 - ❌ 19370 - ❌ 19371 19372 19373 .. list-table:: **test-macosx1470-64/opt** 19374 :widths: 30 15 15 15 15 19375 :header-rows: 1 19376 19377 * - **Test Name** 19378 - mozilla-central 19379 - autoland 19380 - mozilla-release 19381 - mozilla-beta 19382 * - **browsertime-trr-performance-firefox-trr-w-next** 19383 - ❌ 19384 - ❌ 19385 - ❌ 19386 - ❌ 19387 19388 19389 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 19390 :widths: 30 15 15 15 15 19391 :header-rows: 1 19392 19393 * - **Test Name** 19394 - mozilla-central 19395 - autoland 19396 - mozilla-release 19397 - mozilla-beta 19398 * - **browsertime-trr-performance-firefox-trr-w-next** 19399 - ❌ 19400 - ❌ 19401 - ❌ 19402 - ❌ 19403 19404 19405 .. list-table:: **test-windows11-64-24h2-shippable/opt** 19406 :widths: 30 15 15 15 15 19407 :header-rows: 1 19408 19409 * - **Test Name** 19410 - mozilla-central 19411 - autoland 19412 - mozilla-release 19413 - mozilla-beta 19414 * - **browsertime-trr-performance-firefox-trr-w-next** 19415 - ✅ 19416 - ❌ 19417 - ❌ 19418 - ❌ 19419 19420 19421 .. list-table:: **test-windows11-64-24h2/opt** 19422 :widths: 30 15 15 15 15 19423 :header-rows: 1 19424 19425 * - **Test Name** 19426 - mozilla-central 19427 - autoland 19428 - mozilla-release 19429 - mozilla-beta 19430 * - **browsertime-trr-performance-firefox-trr-w-next** 19431 - ❌ 19432 - ❌ 19433 - ❌ 19434 - ❌ 19435 19436 19437 19438 .. dropdown:: upload 19439 :class-container: anchor-id-upload-c 19440 19441 * Command to Run Locally 19442 19443 .. code-block:: 19444 19445 ./mach raptor -t upload 19446 19447 **Owner**: Network Team 19448 19449 **Description**: Measures HTTP/2 file upload throughput with a remote server 19450 19451 * **alert threshold**: 2.0 19452 * **apps**: firefox, chrome, safari 19453 * **browser cycles**: 1 19454 * **browsertime args**: --browsertime.test_type=h2_upload --browsertime.iterations=10 --browsertime.server_url=https://uploadtest-381620.uc.r.appspot.com --firefox.preference=network.http.http3.enable:false --chrome.args disable-quic 19455 * **custom data**: true 19456 * **expected**: pass 19457 * **gecko profile interval**: 1 19458 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-upload.toml#16>`__ 19459 * **lower is better**: false 19460 * **output timeout**: 2000000 19461 * **page cycles**: 1 19462 * **page timeout**: 1800000 19463 * **subtest lower is better**: false 19464 * **subtest name filters**: tests/,iterations/ 19465 * **subtest unit**: mbps 19466 * **test script**: network_bench.js 19467 * **test url**: `<None>`__ 19468 * **type**: pageload 19469 * **unit**: mbps 19470 * **use live sites**: true 19471 * **Test Task**: 19472 19473 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 19474 :widths: 30 15 15 15 15 19475 :header-rows: 1 19476 19477 * - **Test Name** 19478 - mozilla-central 19479 - autoland 19480 - mozilla-release 19481 - mozilla-beta 19482 * - **browsertime-upload-firefox-upload** 19483 - ❌ 19484 - ❌ 19485 - ❌ 19486 - ❌ 19487 19488 19489 .. list-table:: **test-linux1804-64-qr/opt** 19490 :widths: 30 15 15 15 15 19491 :header-rows: 1 19492 19493 * - **Test Name** 19494 - mozilla-central 19495 - autoland 19496 - mozilla-release 19497 - mozilla-beta 19498 * - **browsertime-upload-firefox-upload** 19499 - ❌ 19500 - ❌ 19501 - ❌ 19502 - ❌ 19503 19504 19505 .. list-table:: **test-linux1804-64-shippable-qr/opt** 19506 :widths: 30 15 15 15 15 19507 :header-rows: 1 19508 19509 * - **Test Name** 19510 - mozilla-central 19511 - autoland 19512 - mozilla-release 19513 - mozilla-beta 19514 * - **browsertime-upload-chrome-upload** 19515 - ❌ 19516 - ❌ 19517 - ❌ 19518 - ❌ 19519 * - **browsertime-upload-firefox-upload** 19520 - ✅ 19521 - ✅ 19522 - ❌ 19523 - ❌ 19524 19525 19526 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 19527 :widths: 30 15 15 15 15 19528 :header-rows: 1 19529 19530 * - **Test Name** 19531 - mozilla-central 19532 - autoland 19533 - mozilla-release 19534 - mozilla-beta 19535 * - **browsertime-upload-firefox-upload** 19536 - ❌ 19537 - ❌ 19538 - ❌ 19539 - ❌ 19540 19541 19542 .. list-table:: **test-macosx1470-64-shippable/opt** 19543 :widths: 30 15 15 15 15 19544 :header-rows: 1 19545 19546 * - **Test Name** 19547 - mozilla-central 19548 - autoland 19549 - mozilla-release 19550 - mozilla-beta 19551 * - **browsertime-upload-chrome-upload** 19552 - ❌ 19553 - ❌ 19554 - ❌ 19555 - ❌ 19556 * - **browsertime-upload-firefox-upload** 19557 - ✅ 19558 - ✅ 19559 - ❌ 19560 - ❌ 19561 * - **browsertime-upload-safari-upload** 19562 - ❌ 19563 - ❌ 19564 - ❌ 19565 - ❌ 19566 19567 19568 .. list-table:: **test-macosx1470-64/opt** 19569 :widths: 30 15 15 15 15 19570 :header-rows: 1 19571 19572 * - **Test Name** 19573 - mozilla-central 19574 - autoland 19575 - mozilla-release 19576 - mozilla-beta 19577 * - **browsertime-upload-firefox-upload** 19578 - ❌ 19579 - ❌ 19580 - ❌ 19581 - ❌ 19582 19583 19584 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 19585 :widths: 30 15 15 15 15 19586 :header-rows: 1 19587 19588 * - **Test Name** 19589 - mozilla-central 19590 - autoland 19591 - mozilla-release 19592 - mozilla-beta 19593 * - **browsertime-upload-firefox-upload** 19594 - ❌ 19595 - ❌ 19596 - ❌ 19597 - ❌ 19598 19599 19600 .. list-table:: **test-windows11-64-24h2-shippable/opt** 19601 :widths: 30 15 15 15 15 19602 :header-rows: 1 19603 19604 * - **Test Name** 19605 - mozilla-central 19606 - autoland 19607 - mozilla-release 19608 - mozilla-beta 19609 * - **browsertime-upload-chrome-upload** 19610 - ❌ 19611 - ❌ 19612 - ❌ 19613 - ❌ 19614 * - **browsertime-upload-firefox-upload** 19615 - ✅ 19616 - ✅ 19617 - ❌ 19618 - ❌ 19619 19620 19621 .. list-table:: **test-windows11-64-24h2/opt** 19622 :widths: 30 15 15 15 15 19623 :header-rows: 1 19624 19625 * - **Test Name** 19626 - mozilla-central 19627 - autoland 19628 - mozilla-release 19629 - mozilla-beta 19630 * - **browsertime-upload-firefox-upload** 19631 - ❌ 19632 - ❌ 19633 - ❌ 19634 - ❌ 19635 19636 19637 19638 .. dropdown:: upload-h3 19639 :class-container: anchor-id-upload-h3-c 19640 19641 * Command to Run Locally 19642 19643 .. code-block:: 19644 19645 ./mach raptor -t upload-h3 19646 19647 **Owner**: Network Team 19648 19649 **Description**: Measures HTTP/3 file upload throughput with a remote server 19650 19651 * **alert threshold**: 2.0 19652 * **apps**: firefox, chrome, safari 19653 * **browser cycles**: 1 19654 * **browsertime args**: --browsertime.test_type=h3_upload --browsertime.iterations=10 --browsertime.server_url=https://uploadtest-381620.uc.r.appspot.com --firefox.preference=network.http.http3.enable:true 19655 * **custom data**: true 19656 * **expected**: pass 19657 * **gecko profile interval**: 1 19658 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-upload.toml#31>`__ 19659 * **lower is better**: false 19660 * **output timeout**: 2000000 19661 * **page cycles**: 1 19662 * **page timeout**: 1800000 19663 * **subtest lower is better**: false 19664 * **subtest name filters**: tests/,iterations/ 19665 * **subtest unit**: mbps 19666 * **test script**: network_bench.js 19667 * **test url**: `<None>`__ 19668 * **type**: pageload 19669 * **unit**: mbps 19670 * **use live sites**: true 19671 * **Test Task**: 19672 19673 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 19674 :widths: 30 15 15 15 15 19675 :header-rows: 1 19676 19677 * - **Test Name** 19678 - mozilla-central 19679 - autoland 19680 - mozilla-release 19681 - mozilla-beta 19682 * - **browsertime-upload-firefox-upload-h3** 19683 - ❌ 19684 - ❌ 19685 - ❌ 19686 - ❌ 19687 19688 19689 .. list-table:: **test-linux1804-64-qr/opt** 19690 :widths: 30 15 15 15 15 19691 :header-rows: 1 19692 19693 * - **Test Name** 19694 - mozilla-central 19695 - autoland 19696 - mozilla-release 19697 - mozilla-beta 19698 * - **browsertime-upload-firefox-upload-h3** 19699 - ❌ 19700 - ❌ 19701 - ❌ 19702 - ❌ 19703 19704 19705 .. list-table:: **test-linux1804-64-shippable-qr/opt** 19706 :widths: 30 15 15 15 15 19707 :header-rows: 1 19708 19709 * - **Test Name** 19710 - mozilla-central 19711 - autoland 19712 - mozilla-release 19713 - mozilla-beta 19714 * - **browsertime-upload-chrome-upload-h3** 19715 - ❌ 19716 - ❌ 19717 - ❌ 19718 - ❌ 19719 * - **browsertime-upload-firefox-upload-h3** 19720 - ✅ 19721 - ✅ 19722 - ❌ 19723 - ❌ 19724 19725 19726 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 19727 :widths: 30 15 15 15 15 19728 :header-rows: 1 19729 19730 * - **Test Name** 19731 - mozilla-central 19732 - autoland 19733 - mozilla-release 19734 - mozilla-beta 19735 * - **browsertime-upload-firefox-upload-h3** 19736 - ❌ 19737 - ❌ 19738 - ❌ 19739 - ❌ 19740 19741 19742 .. list-table:: **test-macosx1470-64-shippable/opt** 19743 :widths: 30 15 15 15 15 19744 :header-rows: 1 19745 19746 * - **Test Name** 19747 - mozilla-central 19748 - autoland 19749 - mozilla-release 19750 - mozilla-beta 19751 * - **browsertime-upload-chrome-upload-h3** 19752 - ❌ 19753 - ❌ 19754 - ❌ 19755 - ❌ 19756 * - **browsertime-upload-firefox-upload-h3** 19757 - ✅ 19758 - ✅ 19759 - ❌ 19760 - ❌ 19761 * - **browsertime-upload-safari-upload-h3** 19762 - ❌ 19763 - ❌ 19764 - ❌ 19765 - ❌ 19766 19767 19768 .. list-table:: **test-macosx1470-64/opt** 19769 :widths: 30 15 15 15 15 19770 :header-rows: 1 19771 19772 * - **Test Name** 19773 - mozilla-central 19774 - autoland 19775 - mozilla-release 19776 - mozilla-beta 19777 * - **browsertime-upload-firefox-upload-h3** 19778 - ❌ 19779 - ❌ 19780 - ❌ 19781 - ❌ 19782 19783 19784 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 19785 :widths: 30 15 15 15 15 19786 :header-rows: 1 19787 19788 * - **Test Name** 19789 - mozilla-central 19790 - autoland 19791 - mozilla-release 19792 - mozilla-beta 19793 * - **browsertime-upload-firefox-upload-h3** 19794 - ❌ 19795 - ❌ 19796 - ❌ 19797 - ❌ 19798 19799 19800 .. list-table:: **test-windows11-64-24h2-shippable/opt** 19801 :widths: 30 15 15 15 15 19802 :header-rows: 1 19803 19804 * - **Test Name** 19805 - mozilla-central 19806 - autoland 19807 - mozilla-release 19808 - mozilla-beta 19809 * - **browsertime-upload-chrome-upload-h3** 19810 - ❌ 19811 - ❌ 19812 - ❌ 19813 - ❌ 19814 * - **browsertime-upload-firefox-upload-h3** 19815 - ✅ 19816 - ✅ 19817 - ❌ 19818 - ❌ 19819 19820 19821 .. list-table:: **test-windows11-64-24h2/opt** 19822 :widths: 30 15 15 15 15 19823 :header-rows: 1 19824 19825 * - **Test Name** 19826 - mozilla-central 19827 - autoland 19828 - mozilla-release 19829 - mozilla-beta 19830 * - **browsertime-upload-firefox-upload-h3** 19831 - ❌ 19832 - ❌ 19833 - ❌ 19834 - ❌ 19835 19836 19837 19838 .. dropdown:: ve-av1-q 19839 :class-container: anchor-id-ve-av1-q-c 19840 19841 * Command to Run Locally 19842 19843 .. code-block:: 19844 19845 ./mach raptor -t ve-av1-q 19846 19847 **Owner**: :chunmin and Media Team 19848 19849 **Description**: Measures AV1 encoding performance for 1080p video in quality mode. 19850 19851 * **alert threshold**: 2.0 19852 * **apps**: firefox, chrome, safari, custom-car 19853 * **expected**: pass 19854 * **expose browser profiler**: true 19855 * **gecko profile interval**: 1 19856 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-webcodecs.toml#22>`__ 19857 * **lower is better**: true 19858 * **page cycles**: 3 19859 * **page timeout**: 360000 19860 * **repository**: https://github.com/mozilla/perf-automation 19861 * **repository path**: benchmarks/webcodecs 19862 * **repository revision**: d34775ba6b6cef6068005c05b570d6c79eb0f7d8 19863 * **sparse checkout**: true 19864 * **support class**: browsertime_benchmark.py 19865 * **test url**: `<http://\<host\>:\<port\>/index.html?raptor&codecs=av01.0.04M.08&latencyModes=quality&width=1920&height=1080&framerate=30>`__ 19866 * **type**: benchmark 19867 * **unit**: score 19868 * **Test Task**: 19869 19870 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 19871 :widths: 30 15 15 15 15 19872 :header-rows: 1 19873 19874 * - **Test Name** 19875 - mozilla-central 19876 - autoland 19877 - mozilla-release 19878 - mozilla-beta 19879 * - **browsertime-webcodecs-firefox-ve-av1-q** 19880 - ✅ 19881 - ✅ 19882 - ❌ 19883 - ❌ 19884 19885 19886 .. list-table:: **test-linux1804-64-qr/opt** 19887 :widths: 30 15 15 15 15 19888 :header-rows: 1 19889 19890 * - **Test Name** 19891 - mozilla-central 19892 - autoland 19893 - mozilla-release 19894 - mozilla-beta 19895 * - **browsertime-webcodecs-firefox-ve-av1-q** 19896 - ✅ 19897 - ✅ 19898 - ❌ 19899 - ❌ 19900 19901 19902 .. list-table:: **test-linux1804-64-shippable-qr/opt** 19903 :widths: 30 15 15 15 15 19904 :header-rows: 1 19905 19906 * - **Test Name** 19907 - mozilla-central 19908 - autoland 19909 - mozilla-release 19910 - mozilla-beta 19911 * - **browsertime-webcodecs-chrome-ve-av1-q** 19912 - ❌ 19913 - ❌ 19914 - ❌ 19915 - ❌ 19916 * - **browsertime-webcodecs-custom-car-ve-av1-q** 19917 - ❌ 19918 - ❌ 19919 - ❌ 19920 - ❌ 19921 * - **browsertime-webcodecs-firefox-ve-av1-q** 19922 - ✅ 19923 - ✅ 19924 - ❌ 19925 - ❌ 19926 19927 19928 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 19929 :widths: 30 15 15 15 15 19930 :header-rows: 1 19931 19932 * - **Test Name** 19933 - mozilla-central 19934 - autoland 19935 - mozilla-release 19936 - mozilla-beta 19937 * - **browsertime-webcodecs-firefox-ve-av1-q** 19938 - ✅ 19939 - ✅ 19940 - ❌ 19941 - ❌ 19942 19943 19944 .. list-table:: **test-macosx1470-64-shippable/opt** 19945 :widths: 30 15 15 15 15 19946 :header-rows: 1 19947 19948 * - **Test Name** 19949 - mozilla-central 19950 - autoland 19951 - mozilla-release 19952 - mozilla-beta 19953 * - **browsertime-webcodecs-chrome-ve-av1-q** 19954 - ❌ 19955 - ❌ 19956 - ❌ 19957 - ❌ 19958 * - **browsertime-webcodecs-custom-car-ve-av1-q** 19959 - ❌ 19960 - ❌ 19961 - ❌ 19962 - ❌ 19963 * - **browsertime-webcodecs-firefox-ve-av1-q** 19964 - ✅ 19965 - ✅ 19966 - ❌ 19967 - ❌ 19968 * - **browsertime-webcodecs-safari-ve-av1-q** 19969 - ❌ 19970 - ❌ 19971 - ❌ 19972 - ❌ 19973 19974 19975 .. list-table:: **test-macosx1470-64/opt** 19976 :widths: 30 15 15 15 15 19977 :header-rows: 1 19978 19979 * - **Test Name** 19980 - mozilla-central 19981 - autoland 19982 - mozilla-release 19983 - mozilla-beta 19984 * - **browsertime-webcodecs-firefox-ve-av1-q** 19985 - ✅ 19986 - ✅ 19987 - ❌ 19988 - ❌ 19989 19990 19991 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 19992 :widths: 30 15 15 15 15 19993 :header-rows: 1 19994 19995 * - **Test Name** 19996 - mozilla-central 19997 - autoland 19998 - mozilla-release 19999 - mozilla-beta 20000 * - **browsertime-webcodecs-firefox-ve-av1-q** 20001 - ✅ 20002 - ✅ 20003 - ❌ 20004 - ❌ 20005 20006 20007 .. list-table:: **test-windows11-64-24h2-shippable/opt** 20008 :widths: 30 15 15 15 15 20009 :header-rows: 1 20010 20011 * - **Test Name** 20012 - mozilla-central 20013 - autoland 20014 - mozilla-release 20015 - mozilla-beta 20016 * - **browsertime-webcodecs-chrome-ve-av1-q** 20017 - ❌ 20018 - ❌ 20019 - ❌ 20020 - ❌ 20021 * - **browsertime-webcodecs-custom-car-ve-av1-q** 20022 - ❌ 20023 - ❌ 20024 - ❌ 20025 - ❌ 20026 * - **browsertime-webcodecs-firefox-ve-av1-q** 20027 - ✅ 20028 - ✅ 20029 - ❌ 20030 - ❌ 20031 20032 20033 .. list-table:: **test-windows11-64-24h2/opt** 20034 :widths: 30 15 15 15 15 20035 :header-rows: 1 20036 20037 * - **Test Name** 20038 - mozilla-central 20039 - autoland 20040 - mozilla-release 20041 - mozilla-beta 20042 * - **browsertime-webcodecs-firefox-ve-av1-q** 20043 - ✅ 20044 - ✅ 20045 - ❌ 20046 - ❌ 20047 20048 20049 20050 .. dropdown:: ve-av1-rt 20051 :class-container: anchor-id-ve-av1-rt-c 20052 20053 * Command to Run Locally 20054 20055 .. code-block:: 20056 20057 ./mach raptor -t ve-av1-rt 20058 20059 **Owner**: :chunmin and Media Team 20060 20061 **Description**: Measures AV1 encoding performance for 1080p video in real-time mode. 20062 20063 * **alert threshold**: 2.0 20064 * **apps**: firefox, chrome, safari, custom-car 20065 * **expected**: pass 20066 * **expose browser profiler**: true 20067 * **gecko profile interval**: 1 20068 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-webcodecs.toml#19>`__ 20069 * **lower is better**: true 20070 * **page cycles**: 3 20071 * **page timeout**: 360000 20072 * **repository**: https://github.com/mozilla/perf-automation 20073 * **repository path**: benchmarks/webcodecs 20074 * **repository revision**: d34775ba6b6cef6068005c05b570d6c79eb0f7d8 20075 * **sparse checkout**: true 20076 * **support class**: browsertime_benchmark.py 20077 * **test url**: `<http://\<host\>:\<port\>/index.html?raptor&codecs=av01.0.04M.08&latencyModes=realtime&width=1920&height=1080&framerate=30>`__ 20078 * **type**: benchmark 20079 * **unit**: score 20080 * **Test Task**: 20081 20082 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 20083 :widths: 30 15 15 15 15 20084 :header-rows: 1 20085 20086 * - **Test Name** 20087 - mozilla-central 20088 - autoland 20089 - mozilla-release 20090 - mozilla-beta 20091 * - **browsertime-webcodecs-firefox-ve-av1-rt** 20092 - ✅ 20093 - ✅ 20094 - ❌ 20095 - ❌ 20096 20097 20098 .. list-table:: **test-linux1804-64-qr/opt** 20099 :widths: 30 15 15 15 15 20100 :header-rows: 1 20101 20102 * - **Test Name** 20103 - mozilla-central 20104 - autoland 20105 - mozilla-release 20106 - mozilla-beta 20107 * - **browsertime-webcodecs-firefox-ve-av1-rt** 20108 - ✅ 20109 - ✅ 20110 - ❌ 20111 - ❌ 20112 20113 20114 .. list-table:: **test-linux1804-64-shippable-qr/opt** 20115 :widths: 30 15 15 15 15 20116 :header-rows: 1 20117 20118 * - **Test Name** 20119 - mozilla-central 20120 - autoland 20121 - mozilla-release 20122 - mozilla-beta 20123 * - **browsertime-webcodecs-chrome-ve-av1-rt** 20124 - ❌ 20125 - ❌ 20126 - ❌ 20127 - ❌ 20128 * - **browsertime-webcodecs-custom-car-ve-av1-rt** 20129 - ❌ 20130 - ❌ 20131 - ❌ 20132 - ❌ 20133 * - **browsertime-webcodecs-firefox-ve-av1-rt** 20134 - ✅ 20135 - ✅ 20136 - ❌ 20137 - ❌ 20138 20139 20140 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 20141 :widths: 30 15 15 15 15 20142 :header-rows: 1 20143 20144 * - **Test Name** 20145 - mozilla-central 20146 - autoland 20147 - mozilla-release 20148 - mozilla-beta 20149 * - **browsertime-webcodecs-firefox-ve-av1-rt** 20150 - ✅ 20151 - ✅ 20152 - ❌ 20153 - ❌ 20154 20155 20156 .. list-table:: **test-macosx1470-64-shippable/opt** 20157 :widths: 30 15 15 15 15 20158 :header-rows: 1 20159 20160 * - **Test Name** 20161 - mozilla-central 20162 - autoland 20163 - mozilla-release 20164 - mozilla-beta 20165 * - **browsertime-webcodecs-chrome-ve-av1-rt** 20166 - ❌ 20167 - ❌ 20168 - ❌ 20169 - ❌ 20170 * - **browsertime-webcodecs-custom-car-ve-av1-rt** 20171 - ❌ 20172 - ❌ 20173 - ❌ 20174 - ❌ 20175 * - **browsertime-webcodecs-firefox-ve-av1-rt** 20176 - ✅ 20177 - ✅ 20178 - ❌ 20179 - ❌ 20180 * - **browsertime-webcodecs-safari-ve-av1-rt** 20181 - ❌ 20182 - ❌ 20183 - ❌ 20184 - ❌ 20185 20186 20187 .. list-table:: **test-macosx1470-64/opt** 20188 :widths: 30 15 15 15 15 20189 :header-rows: 1 20190 20191 * - **Test Name** 20192 - mozilla-central 20193 - autoland 20194 - mozilla-release 20195 - mozilla-beta 20196 * - **browsertime-webcodecs-firefox-ve-av1-rt** 20197 - ✅ 20198 - ✅ 20199 - ❌ 20200 - ❌ 20201 20202 20203 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 20204 :widths: 30 15 15 15 15 20205 :header-rows: 1 20206 20207 * - **Test Name** 20208 - mozilla-central 20209 - autoland 20210 - mozilla-release 20211 - mozilla-beta 20212 * - **browsertime-webcodecs-firefox-ve-av1-rt** 20213 - ✅ 20214 - ✅ 20215 - ❌ 20216 - ❌ 20217 20218 20219 .. list-table:: **test-windows11-64-24h2-shippable/opt** 20220 :widths: 30 15 15 15 15 20221 :header-rows: 1 20222 20223 * - **Test Name** 20224 - mozilla-central 20225 - autoland 20226 - mozilla-release 20227 - mozilla-beta 20228 * - **browsertime-webcodecs-chrome-ve-av1-rt** 20229 - ❌ 20230 - ❌ 20231 - ❌ 20232 - ❌ 20233 * - **browsertime-webcodecs-custom-car-ve-av1-rt** 20234 - ❌ 20235 - ❌ 20236 - ❌ 20237 - ❌ 20238 * - **browsertime-webcodecs-firefox-ve-av1-rt** 20239 - ✅ 20240 - ✅ 20241 - ❌ 20242 - ❌ 20243 20244 20245 .. list-table:: **test-windows11-64-24h2/opt** 20246 :widths: 30 15 15 15 15 20247 :header-rows: 1 20248 20249 * - **Test Name** 20250 - mozilla-central 20251 - autoland 20252 - mozilla-release 20253 - mozilla-beta 20254 * - **browsertime-webcodecs-firefox-ve-av1-rt** 20255 - ✅ 20256 - ✅ 20257 - ❌ 20258 - ❌ 20259 20260 20261 20262 .. dropdown:: ve-h264-q 20263 :class-container: anchor-id-ve-h264-q-c 20264 20265 * Command to Run Locally 20266 20267 .. code-block:: 20268 20269 ./mach raptor -t ve-h264-q 20270 20271 **Owner**: :chunmin and Media Team 20272 20273 **Description**: Measures H264-baseline encoding performance for 1080p video in quality mode using AVC format. 20274 20275 * **alert threshold**: 2.0 20276 * **apps**: firefox, chrome, safari, custom-car 20277 * **expected**: pass 20278 * **expose browser profiler**: true 20279 * **gecko profile interval**: 1 20280 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-webcodecs.toml#28>`__ 20281 * **lower is better**: true 20282 * **page cycles**: 3 20283 * **page timeout**: 360000 20284 * **repository**: https://github.com/mozilla/perf-automation 20285 * **repository path**: benchmarks/webcodecs 20286 * **repository revision**: d34775ba6b6cef6068005c05b570d6c79eb0f7d8 20287 * **sparse checkout**: true 20288 * **support class**: browsertime_benchmark.py 20289 * **test url**: `<http://\<host\>:\<port\>/index.html?raptor&codecs=avc1.42001E:avc&latencyModes=quality&width=1920&height=1080&framerate=30>`__ 20290 * **type**: benchmark 20291 * **unit**: score 20292 * **Test Task**: 20293 20294 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 20295 :widths: 30 15 15 15 15 20296 :header-rows: 1 20297 20298 * - **Test Name** 20299 - mozilla-central 20300 - autoland 20301 - mozilla-release 20302 - mozilla-beta 20303 * - **browsertime-webcodecs-firefox-ve-h264-q** 20304 - ✅ 20305 - ✅ 20306 - ❌ 20307 - ❌ 20308 20309 20310 .. list-table:: **test-macosx1470-64-shippable/opt** 20311 :widths: 30 15 15 15 15 20312 :header-rows: 1 20313 20314 * - **Test Name** 20315 - mozilla-central 20316 - autoland 20317 - mozilla-release 20318 - mozilla-beta 20319 * - **browsertime-webcodecs-firefox-ve-h264-q** 20320 - ✅ 20321 - ✅ 20322 - ❌ 20323 - ❌ 20324 * - **browsertime-webcodecs-safari-ve-h264-q** 20325 - ❌ 20326 - ❌ 20327 - ❌ 20328 - ❌ 20329 20330 20331 .. list-table:: **test-macosx1470-64/opt** 20332 :widths: 30 15 15 15 15 20333 :header-rows: 1 20334 20335 * - **Test Name** 20336 - mozilla-central 20337 - autoland 20338 - mozilla-release 20339 - mozilla-beta 20340 * - **browsertime-webcodecs-firefox-ve-h264-q** 20341 - ✅ 20342 - ✅ 20343 - ❌ 20344 - ❌ 20345 20346 20347 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 20348 :widths: 30 15 15 15 15 20349 :header-rows: 1 20350 20351 * - **Test Name** 20352 - mozilla-central 20353 - autoland 20354 - mozilla-release 20355 - mozilla-beta 20356 * - **browsertime-webcodecs-firefox-ve-h264-q** 20357 - ✅ 20358 - ✅ 20359 - ❌ 20360 - ❌ 20361 20362 20363 .. list-table:: **test-windows11-64-24h2-shippable/opt** 20364 :widths: 30 15 15 15 15 20365 :header-rows: 1 20366 20367 * - **Test Name** 20368 - mozilla-central 20369 - autoland 20370 - mozilla-release 20371 - mozilla-beta 20372 * - **browsertime-webcodecs-firefox-ve-h264-q** 20373 - ✅ 20374 - ✅ 20375 - ❌ 20376 - ❌ 20377 20378 20379 .. list-table:: **test-windows11-64-24h2/opt** 20380 :widths: 30 15 15 15 15 20381 :header-rows: 1 20382 20383 * - **Test Name** 20384 - mozilla-central 20385 - autoland 20386 - mozilla-release 20387 - mozilla-beta 20388 * - **browsertime-webcodecs-firefox-ve-h264-q** 20389 - ✅ 20390 - ✅ 20391 - ❌ 20392 - ❌ 20393 20394 20395 20396 .. dropdown:: ve-h264-q-sd 20397 :class-container: anchor-id-ve-h264-q-sd-c 20398 20399 * Command to Run Locally 20400 20401 .. code-block:: 20402 20403 ./mach raptor -t ve-h264-q-sd 20404 20405 **Owner**: :chunmin and Media Team 20406 20407 **Description**: Measures H264-baseline encoding performance for 480p video in quality mode using AVC format. 20408 20409 * **alert threshold**: 2.0 20410 * **apps**: firefox, chrome, safari, custom-car 20411 * **expected**: pass 20412 * **expose browser profiler**: true 20413 * **gecko profile interval**: 1 20414 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-webcodecs.toml#34>`__ 20415 * **lower is better**: true 20416 * **page cycles**: 3 20417 * **page timeout**: 360000 20418 * **repository**: https://github.com/mozilla/perf-automation 20419 * **repository path**: benchmarks/webcodecs 20420 * **repository revision**: d34775ba6b6cef6068005c05b570d6c79eb0f7d8 20421 * **sparse checkout**: true 20422 * **support class**: browsertime_benchmark.py 20423 * **test url**: `<http://\<host\>:\<port\>/index.html?raptor&codecs=avc1.42001E:avc&latencyModes=quality&width=640&height=480&framerate=30>`__ 20424 * **type**: benchmark 20425 * **unit**: score 20426 * **Test Task**: 20427 20428 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 20429 :widths: 30 15 15 15 15 20430 :header-rows: 1 20431 20432 * - **Test Name** 20433 - mozilla-central 20434 - autoland 20435 - mozilla-release 20436 - mozilla-beta 20437 * - **browsertime-webcodecs-firefox-ve-h264-q-sd** 20438 - ✅ 20439 - ✅ 20440 - ❌ 20441 - ❌ 20442 20443 20444 .. list-table:: **test-macosx1470-64-shippable/opt** 20445 :widths: 30 15 15 15 15 20446 :header-rows: 1 20447 20448 * - **Test Name** 20449 - mozilla-central 20450 - autoland 20451 - mozilla-release 20452 - mozilla-beta 20453 * - **browsertime-webcodecs-chrome-ve-h264-q-sd** 20454 - ❌ 20455 - ❌ 20456 - ❌ 20457 - ❌ 20458 * - **browsertime-webcodecs-custom-car-ve-h264-q-sd** 20459 - ❌ 20460 - ❌ 20461 - ❌ 20462 - ❌ 20463 * - **browsertime-webcodecs-firefox-ve-h264-q-sd** 20464 - ✅ 20465 - ✅ 20466 - ❌ 20467 - ❌ 20468 * - **browsertime-webcodecs-safari-ve-h264-q-sd** 20469 - ❌ 20470 - ❌ 20471 - ❌ 20472 - ❌ 20473 20474 20475 .. list-table:: **test-macosx1470-64/opt** 20476 :widths: 30 15 15 15 15 20477 :header-rows: 1 20478 20479 * - **Test Name** 20480 - mozilla-central 20481 - autoland 20482 - mozilla-release 20483 - mozilla-beta 20484 * - **browsertime-webcodecs-firefox-ve-h264-q-sd** 20485 - ✅ 20486 - ✅ 20487 - ❌ 20488 - ❌ 20489 20490 20491 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 20492 :widths: 30 15 15 15 15 20493 :header-rows: 1 20494 20495 * - **Test Name** 20496 - mozilla-central 20497 - autoland 20498 - mozilla-release 20499 - mozilla-beta 20500 * - **browsertime-webcodecs-firefox-ve-h264-q-sd** 20501 - ✅ 20502 - ✅ 20503 - ❌ 20504 - ❌ 20505 20506 20507 .. list-table:: **test-windows11-64-24h2-shippable/opt** 20508 :widths: 30 15 15 15 15 20509 :header-rows: 1 20510 20511 * - **Test Name** 20512 - mozilla-central 20513 - autoland 20514 - mozilla-release 20515 - mozilla-beta 20516 * - **browsertime-webcodecs-chrome-ve-h264-q-sd** 20517 - ❌ 20518 - ❌ 20519 - ❌ 20520 - ❌ 20521 * - **browsertime-webcodecs-custom-car-ve-h264-q-sd** 20522 - ❌ 20523 - ❌ 20524 - ❌ 20525 - ❌ 20526 * - **browsertime-webcodecs-firefox-ve-h264-q-sd** 20527 - ✅ 20528 - ✅ 20529 - ❌ 20530 - ❌ 20531 20532 20533 .. list-table:: **test-windows11-64-24h2/opt** 20534 :widths: 30 15 15 15 15 20535 :header-rows: 1 20536 20537 * - **Test Name** 20538 - mozilla-central 20539 - autoland 20540 - mozilla-release 20541 - mozilla-beta 20542 * - **browsertime-webcodecs-firefox-ve-h264-q-sd** 20543 - ✅ 20544 - ✅ 20545 - ❌ 20546 - ❌ 20547 20548 20549 20550 .. dropdown:: ve-h264-rt 20551 :class-container: anchor-id-ve-h264-rt-c 20552 20553 * Command to Run Locally 20554 20555 .. code-block:: 20556 20557 ./mach raptor -t ve-h264-rt 20558 20559 **Owner**: :chunmin and Media Team 20560 20561 **Description**: Measures H264-baseline encoding performance for 1080p video in real-time mode using Annex B format. 20562 20563 * **alert threshold**: 2.0 20564 * **apps**: firefox, chrome, safari, custom-car 20565 * **expected**: pass 20566 * **expose browser profiler**: true 20567 * **gecko profile interval**: 1 20568 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-webcodecs.toml#25>`__ 20569 * **lower is better**: true 20570 * **page cycles**: 3 20571 * **page timeout**: 360000 20572 * **repository**: https://github.com/mozilla/perf-automation 20573 * **repository path**: benchmarks/webcodecs 20574 * **repository revision**: d34775ba6b6cef6068005c05b570d6c79eb0f7d8 20575 * **sparse checkout**: true 20576 * **support class**: browsertime_benchmark.py 20577 * **test url**: `<http://\<host\>:\<port\>/index.html?raptor&codecs=avc1.42001E:annexb&latencyModes=realtime&width=1920&height=1080&framerate=30>`__ 20578 * **type**: benchmark 20579 * **unit**: score 20580 * **Test Task**: 20581 20582 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 20583 :widths: 30 15 15 15 15 20584 :header-rows: 1 20585 20586 * - **Test Name** 20587 - mozilla-central 20588 - autoland 20589 - mozilla-release 20590 - mozilla-beta 20591 * - **browsertime-webcodecs-firefox-ve-h264-rt** 20592 - ✅ 20593 - ✅ 20594 - ❌ 20595 - ❌ 20596 20597 20598 .. list-table:: **test-macosx1470-64-shippable/opt** 20599 :widths: 30 15 15 15 15 20600 :header-rows: 1 20601 20602 * - **Test Name** 20603 - mozilla-central 20604 - autoland 20605 - mozilla-release 20606 - mozilla-beta 20607 * - **browsertime-webcodecs-firefox-ve-h264-rt** 20608 - ✅ 20609 - ✅ 20610 - ❌ 20611 - ❌ 20612 * - **browsertime-webcodecs-safari-ve-h264-rt** 20613 - ❌ 20614 - ❌ 20615 - ❌ 20616 - ❌ 20617 20618 20619 .. list-table:: **test-macosx1470-64/opt** 20620 :widths: 30 15 15 15 15 20621 :header-rows: 1 20622 20623 * - **Test Name** 20624 - mozilla-central 20625 - autoland 20626 - mozilla-release 20627 - mozilla-beta 20628 * - **browsertime-webcodecs-firefox-ve-h264-rt** 20629 - ✅ 20630 - ✅ 20631 - ❌ 20632 - ❌ 20633 20634 20635 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 20636 :widths: 30 15 15 15 15 20637 :header-rows: 1 20638 20639 * - **Test Name** 20640 - mozilla-central 20641 - autoland 20642 - mozilla-release 20643 - mozilla-beta 20644 * - **browsertime-webcodecs-firefox-ve-h264-rt** 20645 - ✅ 20646 - ✅ 20647 - ❌ 20648 - ❌ 20649 20650 20651 .. list-table:: **test-windows11-64-24h2-shippable/opt** 20652 :widths: 30 15 15 15 15 20653 :header-rows: 1 20654 20655 * - **Test Name** 20656 - mozilla-central 20657 - autoland 20658 - mozilla-release 20659 - mozilla-beta 20660 * - **browsertime-webcodecs-firefox-ve-h264-rt** 20661 - ✅ 20662 - ✅ 20663 - ❌ 20664 - ❌ 20665 20666 20667 .. list-table:: **test-windows11-64-24h2/opt** 20668 :widths: 30 15 15 15 15 20669 :header-rows: 1 20670 20671 * - **Test Name** 20672 - mozilla-central 20673 - autoland 20674 - mozilla-release 20675 - mozilla-beta 20676 * - **browsertime-webcodecs-firefox-ve-h264-rt** 20677 - ✅ 20678 - ✅ 20679 - ❌ 20680 - ❌ 20681 20682 20683 20684 .. dropdown:: ve-h264-rt-sd 20685 :class-container: anchor-id-ve-h264-rt-sd-c 20686 20687 * Command to Run Locally 20688 20689 .. code-block:: 20690 20691 ./mach raptor -t ve-h264-rt-sd 20692 20693 **Owner**: :chunmin and Media Team 20694 20695 **Description**: Measures H264-baseline encoding performance for 480p video in real-time mode using Annex B format. 20696 20697 * **alert threshold**: 2.0 20698 * **apps**: firefox, chrome, safari, custom-car 20699 * **expected**: pass 20700 * **expose browser profiler**: true 20701 * **gecko profile interval**: 1 20702 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-webcodecs.toml#31>`__ 20703 * **lower is better**: true 20704 * **page cycles**: 3 20705 * **page timeout**: 360000 20706 * **repository**: https://github.com/mozilla/perf-automation 20707 * **repository path**: benchmarks/webcodecs 20708 * **repository revision**: d34775ba6b6cef6068005c05b570d6c79eb0f7d8 20709 * **sparse checkout**: true 20710 * **support class**: browsertime_benchmark.py 20711 * **test url**: `<http://\<host\>:\<port\>/index.html?raptor&codecs=avc1.42001E:annexb&latencyModes=realtime&width=640&height=480&framerate=30>`__ 20712 * **type**: benchmark 20713 * **unit**: score 20714 * **Test Task**: 20715 20716 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 20717 :widths: 30 15 15 15 15 20718 :header-rows: 1 20719 20720 * - **Test Name** 20721 - mozilla-central 20722 - autoland 20723 - mozilla-release 20724 - mozilla-beta 20725 * - **browsertime-webcodecs-firefox-ve-h264-rt-sd** 20726 - ✅ 20727 - ✅ 20728 - ❌ 20729 - ❌ 20730 20731 20732 .. list-table:: **test-macosx1470-64-shippable/opt** 20733 :widths: 30 15 15 15 15 20734 :header-rows: 1 20735 20736 * - **Test Name** 20737 - mozilla-central 20738 - autoland 20739 - mozilla-release 20740 - mozilla-beta 20741 * - **browsertime-webcodecs-chrome-ve-h264-rt-sd** 20742 - ❌ 20743 - ❌ 20744 - ❌ 20745 - ❌ 20746 * - **browsertime-webcodecs-custom-car-ve-h264-rt-sd** 20747 - ❌ 20748 - ❌ 20749 - ❌ 20750 - ❌ 20751 * - **browsertime-webcodecs-firefox-ve-h264-rt-sd** 20752 - ✅ 20753 - ✅ 20754 - ❌ 20755 - ❌ 20756 * - **browsertime-webcodecs-safari-ve-h264-rt-sd** 20757 - ❌ 20758 - ❌ 20759 - ❌ 20760 - ❌ 20761 20762 20763 .. list-table:: **test-macosx1470-64/opt** 20764 :widths: 30 15 15 15 15 20765 :header-rows: 1 20766 20767 * - **Test Name** 20768 - mozilla-central 20769 - autoland 20770 - mozilla-release 20771 - mozilla-beta 20772 * - **browsertime-webcodecs-firefox-ve-h264-rt-sd** 20773 - ✅ 20774 - ✅ 20775 - ❌ 20776 - ❌ 20777 20778 20779 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 20780 :widths: 30 15 15 15 15 20781 :header-rows: 1 20782 20783 * - **Test Name** 20784 - mozilla-central 20785 - autoland 20786 - mozilla-release 20787 - mozilla-beta 20788 * - **browsertime-webcodecs-firefox-ve-h264-rt-sd** 20789 - ✅ 20790 - ✅ 20791 - ❌ 20792 - ❌ 20793 20794 20795 .. list-table:: **test-windows11-64-24h2-shippable/opt** 20796 :widths: 30 15 15 15 15 20797 :header-rows: 1 20798 20799 * - **Test Name** 20800 - mozilla-central 20801 - autoland 20802 - mozilla-release 20803 - mozilla-beta 20804 * - **browsertime-webcodecs-chrome-ve-h264-rt-sd** 20805 - ❌ 20806 - ❌ 20807 - ❌ 20808 - ❌ 20809 * - **browsertime-webcodecs-custom-car-ve-h264-rt-sd** 20810 - ❌ 20811 - ❌ 20812 - ❌ 20813 - ❌ 20814 * - **browsertime-webcodecs-firefox-ve-h264-rt-sd** 20815 - ✅ 20816 - ✅ 20817 - ❌ 20818 - ❌ 20819 20820 20821 .. list-table:: **test-windows11-64-24h2/opt** 20822 :widths: 30 15 15 15 15 20823 :header-rows: 1 20824 20825 * - **Test Name** 20826 - mozilla-central 20827 - autoland 20828 - mozilla-release 20829 - mozilla-beta 20830 * - **browsertime-webcodecs-firefox-ve-h264-rt-sd** 20831 - ✅ 20832 - ✅ 20833 - ❌ 20834 - ❌ 20835 20836 20837 20838 .. dropdown:: ve-vp8-q 20839 :class-container: anchor-id-ve-vp8-q-c 20840 20841 * Command to Run Locally 20842 20843 .. code-block:: 20844 20845 ./mach raptor -t ve-vp8-q 20846 20847 **Owner**: :chunmin and Media Team 20848 20849 **Description**: Measures VP8 encoding performance for 1080p video in quality mode. 20850 20851 * **alert threshold**: 2.0 20852 * **apps**: firefox, chrome, safari, custom-car 20853 * **expected**: pass 20854 * **expose browser profiler**: true 20855 * **gecko profile interval**: 1 20856 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-webcodecs.toml#40>`__ 20857 * **lower is better**: true 20858 * **page cycles**: 3 20859 * **page timeout**: 360000 20860 * **repository**: https://github.com/mozilla/perf-automation 20861 * **repository path**: benchmarks/webcodecs 20862 * **repository revision**: d34775ba6b6cef6068005c05b570d6c79eb0f7d8 20863 * **sparse checkout**: true 20864 * **support class**: browsertime_benchmark.py 20865 * **test url**: `<http://\<host\>:\<port\>/index.html?raptor&codecs=vp8&latencyModes=quality&width=1920&height=1080&framerate=30>`__ 20866 * **type**: benchmark 20867 * **unit**: score 20868 * **Test Task**: 20869 20870 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 20871 :widths: 30 15 15 15 15 20872 :header-rows: 1 20873 20874 * - **Test Name** 20875 - mozilla-central 20876 - autoland 20877 - mozilla-release 20878 - mozilla-beta 20879 * - **browsertime-webcodecs-firefox-ve-vp8-q** 20880 - ✅ 20881 - ✅ 20882 - ❌ 20883 - ❌ 20884 20885 20886 .. list-table:: **test-linux1804-64-qr/opt** 20887 :widths: 30 15 15 15 15 20888 :header-rows: 1 20889 20890 * - **Test Name** 20891 - mozilla-central 20892 - autoland 20893 - mozilla-release 20894 - mozilla-beta 20895 * - **browsertime-webcodecs-firefox-ve-vp8-q** 20896 - ✅ 20897 - ✅ 20898 - ❌ 20899 - ❌ 20900 20901 20902 .. list-table:: **test-linux1804-64-shippable-qr/opt** 20903 :widths: 30 15 15 15 15 20904 :header-rows: 1 20905 20906 * - **Test Name** 20907 - mozilla-central 20908 - autoland 20909 - mozilla-release 20910 - mozilla-beta 20911 * - **browsertime-webcodecs-chrome-ve-vp8-q** 20912 - ❌ 20913 - ❌ 20914 - ❌ 20915 - ❌ 20916 * - **browsertime-webcodecs-custom-car-ve-vp8-q** 20917 - ❌ 20918 - ❌ 20919 - ❌ 20920 - ❌ 20921 * - **browsertime-webcodecs-firefox-ve-vp8-q** 20922 - ✅ 20923 - ✅ 20924 - ❌ 20925 - ❌ 20926 20927 20928 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 20929 :widths: 30 15 15 15 15 20930 :header-rows: 1 20931 20932 * - **Test Name** 20933 - mozilla-central 20934 - autoland 20935 - mozilla-release 20936 - mozilla-beta 20937 * - **browsertime-webcodecs-firefox-ve-vp8-q** 20938 - ✅ 20939 - ✅ 20940 - ❌ 20941 - ❌ 20942 20943 20944 .. list-table:: **test-macosx1470-64-shippable/opt** 20945 :widths: 30 15 15 15 15 20946 :header-rows: 1 20947 20948 * - **Test Name** 20949 - mozilla-central 20950 - autoland 20951 - mozilla-release 20952 - mozilla-beta 20953 * - **browsertime-webcodecs-chrome-ve-vp8-q** 20954 - ❌ 20955 - ❌ 20956 - ❌ 20957 - ❌ 20958 * - **browsertime-webcodecs-custom-car-ve-vp8-q** 20959 - ❌ 20960 - ❌ 20961 - ❌ 20962 - ❌ 20963 * - **browsertime-webcodecs-firefox-ve-vp8-q** 20964 - ✅ 20965 - ✅ 20966 - ❌ 20967 - ❌ 20968 * - **browsertime-webcodecs-safari-ve-vp8-q** 20969 - ❌ 20970 - ❌ 20971 - ❌ 20972 - ❌ 20973 20974 20975 .. list-table:: **test-macosx1470-64/opt** 20976 :widths: 30 15 15 15 15 20977 :header-rows: 1 20978 20979 * - **Test Name** 20980 - mozilla-central 20981 - autoland 20982 - mozilla-release 20983 - mozilla-beta 20984 * - **browsertime-webcodecs-firefox-ve-vp8-q** 20985 - ✅ 20986 - ✅ 20987 - ❌ 20988 - ❌ 20989 20990 20991 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 20992 :widths: 30 15 15 15 15 20993 :header-rows: 1 20994 20995 * - **Test Name** 20996 - mozilla-central 20997 - autoland 20998 - mozilla-release 20999 - mozilla-beta 21000 * - **browsertime-webcodecs-firefox-ve-vp8-q** 21001 - ✅ 21002 - ✅ 21003 - ❌ 21004 - ❌ 21005 21006 21007 .. list-table:: **test-windows11-64-24h2-shippable/opt** 21008 :widths: 30 15 15 15 15 21009 :header-rows: 1 21010 21011 * - **Test Name** 21012 - mozilla-central 21013 - autoland 21014 - mozilla-release 21015 - mozilla-beta 21016 * - **browsertime-webcodecs-chrome-ve-vp8-q** 21017 - ❌ 21018 - ❌ 21019 - ❌ 21020 - ❌ 21021 * - **browsertime-webcodecs-custom-car-ve-vp8-q** 21022 - ❌ 21023 - ❌ 21024 - ❌ 21025 - ❌ 21026 * - **browsertime-webcodecs-firefox-ve-vp8-q** 21027 - ✅ 21028 - ✅ 21029 - ❌ 21030 - ❌ 21031 21032 21033 .. list-table:: **test-windows11-64-24h2/opt** 21034 :widths: 30 15 15 15 15 21035 :header-rows: 1 21036 21037 * - **Test Name** 21038 - mozilla-central 21039 - autoland 21040 - mozilla-release 21041 - mozilla-beta 21042 * - **browsertime-webcodecs-firefox-ve-vp8-q** 21043 - ✅ 21044 - ✅ 21045 - ❌ 21046 - ❌ 21047 21048 21049 21050 .. dropdown:: ve-vp8-rt 21051 :class-container: anchor-id-ve-vp8-rt-c 21052 21053 * Command to Run Locally 21054 21055 .. code-block:: 21056 21057 ./mach raptor -t ve-vp8-rt 21058 21059 **Owner**: :chunmin and Media Team 21060 21061 **Description**: Measures VP8 encoding performance for 1080p video in real-time mode. 21062 21063 * **alert threshold**: 2.0 21064 * **apps**: firefox, chrome, safari, custom-car 21065 * **expected**: pass 21066 * **expose browser profiler**: true 21067 * **gecko profile interval**: 1 21068 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-webcodecs.toml#37>`__ 21069 * **lower is better**: true 21070 * **page cycles**: 3 21071 * **page timeout**: 360000 21072 * **repository**: https://github.com/mozilla/perf-automation 21073 * **repository path**: benchmarks/webcodecs 21074 * **repository revision**: d34775ba6b6cef6068005c05b570d6c79eb0f7d8 21075 * **sparse checkout**: true 21076 * **support class**: browsertime_benchmark.py 21077 * **test url**: `<http://\<host\>:\<port\>/index.html?raptor&codecs=vp8&latencyModes=realtime&width=1920&height=1080&framerate=30>`__ 21078 * **type**: benchmark 21079 * **unit**: score 21080 * **Test Task**: 21081 21082 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 21083 :widths: 30 15 15 15 15 21084 :header-rows: 1 21085 21086 * - **Test Name** 21087 - mozilla-central 21088 - autoland 21089 - mozilla-release 21090 - mozilla-beta 21091 * - **browsertime-webcodecs-firefox-ve-vp8-rt** 21092 - ✅ 21093 - ✅ 21094 - ❌ 21095 - ❌ 21096 21097 21098 .. list-table:: **test-linux1804-64-qr/opt** 21099 :widths: 30 15 15 15 15 21100 :header-rows: 1 21101 21102 * - **Test Name** 21103 - mozilla-central 21104 - autoland 21105 - mozilla-release 21106 - mozilla-beta 21107 * - **browsertime-webcodecs-firefox-ve-vp8-rt** 21108 - ✅ 21109 - ✅ 21110 - ❌ 21111 - ❌ 21112 21113 21114 .. list-table:: **test-linux1804-64-shippable-qr/opt** 21115 :widths: 30 15 15 15 15 21116 :header-rows: 1 21117 21118 * - **Test Name** 21119 - mozilla-central 21120 - autoland 21121 - mozilla-release 21122 - mozilla-beta 21123 * - **browsertime-webcodecs-chrome-ve-vp8-rt** 21124 - ❌ 21125 - ❌ 21126 - ❌ 21127 - ❌ 21128 * - **browsertime-webcodecs-custom-car-ve-vp8-rt** 21129 - ❌ 21130 - ❌ 21131 - ❌ 21132 - ❌ 21133 * - **browsertime-webcodecs-firefox-ve-vp8-rt** 21134 - ✅ 21135 - ✅ 21136 - ❌ 21137 - ❌ 21138 21139 21140 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 21141 :widths: 30 15 15 15 15 21142 :header-rows: 1 21143 21144 * - **Test Name** 21145 - mozilla-central 21146 - autoland 21147 - mozilla-release 21148 - mozilla-beta 21149 * - **browsertime-webcodecs-firefox-ve-vp8-rt** 21150 - ✅ 21151 - ✅ 21152 - ❌ 21153 - ❌ 21154 21155 21156 .. list-table:: **test-macosx1470-64-shippable/opt** 21157 :widths: 30 15 15 15 15 21158 :header-rows: 1 21159 21160 * - **Test Name** 21161 - mozilla-central 21162 - autoland 21163 - mozilla-release 21164 - mozilla-beta 21165 * - **browsertime-webcodecs-chrome-ve-vp8-rt** 21166 - ❌ 21167 - ❌ 21168 - ❌ 21169 - ❌ 21170 * - **browsertime-webcodecs-custom-car-ve-vp8-rt** 21171 - ❌ 21172 - ❌ 21173 - ❌ 21174 - ❌ 21175 * - **browsertime-webcodecs-firefox-ve-vp8-rt** 21176 - ✅ 21177 - ✅ 21178 - ❌ 21179 - ❌ 21180 * - **browsertime-webcodecs-safari-ve-vp8-rt** 21181 - ❌ 21182 - ❌ 21183 - ❌ 21184 - ❌ 21185 21186 21187 .. list-table:: **test-macosx1470-64/opt** 21188 :widths: 30 15 15 15 15 21189 :header-rows: 1 21190 21191 * - **Test Name** 21192 - mozilla-central 21193 - autoland 21194 - mozilla-release 21195 - mozilla-beta 21196 * - **browsertime-webcodecs-firefox-ve-vp8-rt** 21197 - ✅ 21198 - ✅ 21199 - ❌ 21200 - ❌ 21201 21202 21203 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 21204 :widths: 30 15 15 15 15 21205 :header-rows: 1 21206 21207 * - **Test Name** 21208 - mozilla-central 21209 - autoland 21210 - mozilla-release 21211 - mozilla-beta 21212 * - **browsertime-webcodecs-firefox-ve-vp8-rt** 21213 - ✅ 21214 - ✅ 21215 - ❌ 21216 - ❌ 21217 21218 21219 .. list-table:: **test-windows11-64-24h2-shippable/opt** 21220 :widths: 30 15 15 15 15 21221 :header-rows: 1 21222 21223 * - **Test Name** 21224 - mozilla-central 21225 - autoland 21226 - mozilla-release 21227 - mozilla-beta 21228 * - **browsertime-webcodecs-chrome-ve-vp8-rt** 21229 - ❌ 21230 - ❌ 21231 - ❌ 21232 - ❌ 21233 * - **browsertime-webcodecs-custom-car-ve-vp8-rt** 21234 - ❌ 21235 - ❌ 21236 - ❌ 21237 - ❌ 21238 * - **browsertime-webcodecs-firefox-ve-vp8-rt** 21239 - ✅ 21240 - ✅ 21241 - ❌ 21242 - ❌ 21243 21244 21245 .. list-table:: **test-windows11-64-24h2/opt** 21246 :widths: 30 15 15 15 15 21247 :header-rows: 1 21248 21249 * - **Test Name** 21250 - mozilla-central 21251 - autoland 21252 - mozilla-release 21253 - mozilla-beta 21254 * - **browsertime-webcodecs-firefox-ve-vp8-rt** 21255 - ✅ 21256 - ✅ 21257 - ❌ 21258 - ❌ 21259 21260 21261 21262 .. dropdown:: ve-vp9-q 21263 :class-container: anchor-id-ve-vp9-q-c 21264 21265 * Command to Run Locally 21266 21267 .. code-block:: 21268 21269 ./mach raptor -t ve-vp9-q 21270 21271 **Owner**: :chunmin and Media Team 21272 21273 **Description**: Measures VP9 encoding performance for 1080p video in quality mode. 21274 21275 * **alert threshold**: 2.0 21276 * **apps**: firefox, chrome, safari, custom-car 21277 * **expected**: pass 21278 * **expose browser profiler**: true 21279 * **gecko profile interval**: 1 21280 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-webcodecs.toml#46>`__ 21281 * **lower is better**: true 21282 * **page cycles**: 3 21283 * **page timeout**: 360000 21284 * **repository**: https://github.com/mozilla/perf-automation 21285 * **repository path**: benchmarks/webcodecs 21286 * **repository revision**: d34775ba6b6cef6068005c05b570d6c79eb0f7d8 21287 * **sparse checkout**: true 21288 * **support class**: browsertime_benchmark.py 21289 * **test url**: `<http://\<host\>:\<port\>/index.html?raptor&codecs=vp09.00.10.08&latencyModes=quality&width=1920&height=1080&framerate=30>`__ 21290 * **type**: benchmark 21291 * **unit**: score 21292 * **Test Task**: 21293 21294 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 21295 :widths: 30 15 15 15 15 21296 :header-rows: 1 21297 21298 * - **Test Name** 21299 - mozilla-central 21300 - autoland 21301 - mozilla-release 21302 - mozilla-beta 21303 * - **browsertime-webcodecs-firefox-ve-vp9-q** 21304 - ✅ 21305 - ✅ 21306 - ❌ 21307 - ❌ 21308 21309 21310 .. list-table:: **test-linux1804-64-qr/opt** 21311 :widths: 30 15 15 15 15 21312 :header-rows: 1 21313 21314 * - **Test Name** 21315 - mozilla-central 21316 - autoland 21317 - mozilla-release 21318 - mozilla-beta 21319 * - **browsertime-webcodecs-firefox-ve-vp9-q** 21320 - ✅ 21321 - ✅ 21322 - ❌ 21323 - ❌ 21324 21325 21326 .. list-table:: **test-linux1804-64-shippable-qr/opt** 21327 :widths: 30 15 15 15 15 21328 :header-rows: 1 21329 21330 * - **Test Name** 21331 - mozilla-central 21332 - autoland 21333 - mozilla-release 21334 - mozilla-beta 21335 * - **browsertime-webcodecs-chrome-ve-vp9-q** 21336 - ❌ 21337 - ❌ 21338 - ❌ 21339 - ❌ 21340 * - **browsertime-webcodecs-custom-car-ve-vp9-q** 21341 - ❌ 21342 - ❌ 21343 - ❌ 21344 - ❌ 21345 * - **browsertime-webcodecs-firefox-ve-vp9-q** 21346 - ✅ 21347 - ✅ 21348 - ❌ 21349 - ❌ 21350 21351 21352 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 21353 :widths: 30 15 15 15 15 21354 :header-rows: 1 21355 21356 * - **Test Name** 21357 - mozilla-central 21358 - autoland 21359 - mozilla-release 21360 - mozilla-beta 21361 * - **browsertime-webcodecs-firefox-ve-vp9-q** 21362 - ✅ 21363 - ✅ 21364 - ❌ 21365 - ❌ 21366 21367 21368 .. list-table:: **test-macosx1470-64-shippable/opt** 21369 :widths: 30 15 15 15 15 21370 :header-rows: 1 21371 21372 * - **Test Name** 21373 - mozilla-central 21374 - autoland 21375 - mozilla-release 21376 - mozilla-beta 21377 * - **browsertime-webcodecs-chrome-ve-vp9-q** 21378 - ❌ 21379 - ❌ 21380 - ❌ 21381 - ❌ 21382 * - **browsertime-webcodecs-custom-car-ve-vp9-q** 21383 - ❌ 21384 - ❌ 21385 - ❌ 21386 - ❌ 21387 * - **browsertime-webcodecs-firefox-ve-vp9-q** 21388 - ✅ 21389 - ✅ 21390 - ❌ 21391 - ❌ 21392 * - **browsertime-webcodecs-safari-ve-vp9-q** 21393 - ❌ 21394 - ❌ 21395 - ❌ 21396 - ❌ 21397 21398 21399 .. list-table:: **test-macosx1470-64/opt** 21400 :widths: 30 15 15 15 15 21401 :header-rows: 1 21402 21403 * - **Test Name** 21404 - mozilla-central 21405 - autoland 21406 - mozilla-release 21407 - mozilla-beta 21408 * - **browsertime-webcodecs-firefox-ve-vp9-q** 21409 - ✅ 21410 - ✅ 21411 - ❌ 21412 - ❌ 21413 21414 21415 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 21416 :widths: 30 15 15 15 15 21417 :header-rows: 1 21418 21419 * - **Test Name** 21420 - mozilla-central 21421 - autoland 21422 - mozilla-release 21423 - mozilla-beta 21424 * - **browsertime-webcodecs-firefox-ve-vp9-q** 21425 - ✅ 21426 - ✅ 21427 - ❌ 21428 - ❌ 21429 21430 21431 .. list-table:: **test-windows11-64-24h2-shippable/opt** 21432 :widths: 30 15 15 15 15 21433 :header-rows: 1 21434 21435 * - **Test Name** 21436 - mozilla-central 21437 - autoland 21438 - mozilla-release 21439 - mozilla-beta 21440 * - **browsertime-webcodecs-chrome-ve-vp9-q** 21441 - ❌ 21442 - ❌ 21443 - ❌ 21444 - ❌ 21445 * - **browsertime-webcodecs-custom-car-ve-vp9-q** 21446 - ❌ 21447 - ❌ 21448 - ❌ 21449 - ❌ 21450 * - **browsertime-webcodecs-firefox-ve-vp9-q** 21451 - ✅ 21452 - ✅ 21453 - ❌ 21454 - ❌ 21455 21456 21457 .. list-table:: **test-windows11-64-24h2/opt** 21458 :widths: 30 15 15 15 15 21459 :header-rows: 1 21460 21461 * - **Test Name** 21462 - mozilla-central 21463 - autoland 21464 - mozilla-release 21465 - mozilla-beta 21466 * - **browsertime-webcodecs-firefox-ve-vp9-q** 21467 - ✅ 21468 - ✅ 21469 - ❌ 21470 - ❌ 21471 21472 21473 21474 .. dropdown:: ve-vp9-rt 21475 :class-container: anchor-id-ve-vp9-rt-c 21476 21477 * Command to Run Locally 21478 21479 .. code-block:: 21480 21481 ./mach raptor -t ve-vp9-rt 21482 21483 **Owner**: :chunmin and Media Team 21484 21485 **Description**: Measures VP9 encoding performance for 1080p video in real-time mode. 21486 21487 * **alert threshold**: 2.0 21488 * **apps**: firefox, chrome, safari, custom-car 21489 * **expected**: pass 21490 * **expose browser profiler**: true 21491 * **gecko profile interval**: 1 21492 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-webcodecs.toml#43>`__ 21493 * **lower is better**: true 21494 * **page cycles**: 3 21495 * **page timeout**: 360000 21496 * **repository**: https://github.com/mozilla/perf-automation 21497 * **repository path**: benchmarks/webcodecs 21498 * **repository revision**: d34775ba6b6cef6068005c05b570d6c79eb0f7d8 21499 * **sparse checkout**: true 21500 * **support class**: browsertime_benchmark.py 21501 * **test url**: `<http://\<host\>:\<port\>/index.html?raptor&codecs=vp09.00.10.08&latencyModes=realtime&width=1920&height=1080&framerate=30>`__ 21502 * **type**: benchmark 21503 * **unit**: score 21504 * **Test Task**: 21505 21506 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 21507 :widths: 30 15 15 15 15 21508 :header-rows: 1 21509 21510 * - **Test Name** 21511 - mozilla-central 21512 - autoland 21513 - mozilla-release 21514 - mozilla-beta 21515 * - **browsertime-webcodecs-firefox-ve-vp9-rt** 21516 - ✅ 21517 - ✅ 21518 - ❌ 21519 - ❌ 21520 21521 21522 .. list-table:: **test-linux1804-64-qr/opt** 21523 :widths: 30 15 15 15 15 21524 :header-rows: 1 21525 21526 * - **Test Name** 21527 - mozilla-central 21528 - autoland 21529 - mozilla-release 21530 - mozilla-beta 21531 * - **browsertime-webcodecs-firefox-ve-vp9-rt** 21532 - ✅ 21533 - ✅ 21534 - ❌ 21535 - ❌ 21536 21537 21538 .. list-table:: **test-linux1804-64-shippable-qr/opt** 21539 :widths: 30 15 15 15 15 21540 :header-rows: 1 21541 21542 * - **Test Name** 21543 - mozilla-central 21544 - autoland 21545 - mozilla-release 21546 - mozilla-beta 21547 * - **browsertime-webcodecs-chrome-ve-vp9-rt** 21548 - ❌ 21549 - ❌ 21550 - ❌ 21551 - ❌ 21552 * - **browsertime-webcodecs-custom-car-ve-vp9-rt** 21553 - ❌ 21554 - ❌ 21555 - ❌ 21556 - ❌ 21557 * - **browsertime-webcodecs-firefox-ve-vp9-rt** 21558 - ✅ 21559 - ✅ 21560 - ❌ 21561 - ❌ 21562 21563 21564 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 21565 :widths: 30 15 15 15 15 21566 :header-rows: 1 21567 21568 * - **Test Name** 21569 - mozilla-central 21570 - autoland 21571 - mozilla-release 21572 - mozilla-beta 21573 * - **browsertime-webcodecs-firefox-ve-vp9-rt** 21574 - ✅ 21575 - ✅ 21576 - ❌ 21577 - ❌ 21578 21579 21580 .. list-table:: **test-macosx1470-64-shippable/opt** 21581 :widths: 30 15 15 15 15 21582 :header-rows: 1 21583 21584 * - **Test Name** 21585 - mozilla-central 21586 - autoland 21587 - mozilla-release 21588 - mozilla-beta 21589 * - **browsertime-webcodecs-chrome-ve-vp9-rt** 21590 - ❌ 21591 - ❌ 21592 - ❌ 21593 - ❌ 21594 * - **browsertime-webcodecs-custom-car-ve-vp9-rt** 21595 - ❌ 21596 - ❌ 21597 - ❌ 21598 - ❌ 21599 * - **browsertime-webcodecs-firefox-ve-vp9-rt** 21600 - ✅ 21601 - ✅ 21602 - ❌ 21603 - ❌ 21604 * - **browsertime-webcodecs-safari-ve-vp9-rt** 21605 - ❌ 21606 - ❌ 21607 - ❌ 21608 - ❌ 21609 21610 21611 .. list-table:: **test-macosx1470-64/opt** 21612 :widths: 30 15 15 15 15 21613 :header-rows: 1 21614 21615 * - **Test Name** 21616 - mozilla-central 21617 - autoland 21618 - mozilla-release 21619 - mozilla-beta 21620 * - **browsertime-webcodecs-firefox-ve-vp9-rt** 21621 - ✅ 21622 - ✅ 21623 - ❌ 21624 - ❌ 21625 21626 21627 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 21628 :widths: 30 15 15 15 15 21629 :header-rows: 1 21630 21631 * - **Test Name** 21632 - mozilla-central 21633 - autoland 21634 - mozilla-release 21635 - mozilla-beta 21636 * - **browsertime-webcodecs-firefox-ve-vp9-rt** 21637 - ✅ 21638 - ✅ 21639 - ❌ 21640 - ❌ 21641 21642 21643 .. list-table:: **test-windows11-64-24h2-shippable/opt** 21644 :widths: 30 15 15 15 15 21645 :header-rows: 1 21646 21647 * - **Test Name** 21648 - mozilla-central 21649 - autoland 21650 - mozilla-release 21651 - mozilla-beta 21652 * - **browsertime-webcodecs-chrome-ve-vp9-rt** 21653 - ❌ 21654 - ❌ 21655 - ❌ 21656 - ❌ 21657 * - **browsertime-webcodecs-custom-car-ve-vp9-rt** 21658 - ❌ 21659 - ❌ 21660 - ❌ 21661 - ❌ 21662 * - **browsertime-webcodecs-firefox-ve-vp9-rt** 21663 - ✅ 21664 - ✅ 21665 - ❌ 21666 - ❌ 21667 21668 21669 .. list-table:: **test-windows11-64-24h2/opt** 21670 :widths: 30 15 15 15 15 21671 :header-rows: 1 21672 21673 * - **Test Name** 21674 - mozilla-central 21675 - autoland 21676 - mozilla-release 21677 - mozilla-beta 21678 * - **browsertime-webcodecs-firefox-ve-vp9-rt** 21679 - ✅ 21680 - ✅ 21681 - ❌ 21682 - ❌ 21683 21684 21685 21686 .. dropdown:: vpl-av1 21687 :class-container: anchor-id-vpl-av1-c 21688 21689 * Command to Run Locally 21690 21691 .. code-block:: 21692 21693 ./mach raptor -t vpl-av1 21694 21695 **Owner**: :aosmond and the Media Team 21696 21697 **Description**: Measures AV1 1080p video playback latency. 21698 21699 * **alert on**: `estimatedFirstFrameLatency <raptor-metrics.html#estimated-frame-latency-(first)>`__, `estimatedAnyFrameLatency <raptor-metrics.html#estimated-frame-latency-(any)>`__ 21700 * **alert threshold**: 2.0 21701 * **apps**: chrome, chrome-m, geckoview, fenix, firefox, safari 21702 * **benchmark webserver**: true 21703 * **browser cycles**: 20 21704 * **expected**: pass 21705 * **gecko profile features**: stackwalk,js,cpu,java,processcpu,screenshots,memory 21706 * **gecko profile interval**: 1 21707 * **gecko profile threads**: BackgroundThreadPool,Compositor,decoder,GeckoMain,gmp,graph,grph,InotifyEventThread,IPDL Background,media,ModuleProcessThread,PacerThread,RemVidChild,RenderBackend,Renderer,SwComposite,TextureUpdate,ImageBridgeChld 21708 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-video-playback-latency.toml#37>`__ 21709 * **lower is better**: true 21710 * **measure**: firstFrame, secondFrame, lastFrame, estimatedFirstFrameLatency, estimatedAnyFrameLatency 21711 * **newtab per cycle**: true 21712 * **page cycles**: 20 21713 * **page timeout**: 20000 21714 * **preferences**: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false 21715 * **repository**: https://github.com/mozilla/perf-automation 21716 * **repository path**: benchmarks/video-playback-latency 21717 * **repository revision**: e3d0295c15cfdd6f32e6d4270de0ed5d6c1632cd 21718 * **sparse checkout**: true 21719 * **support class**: video_playback_latency.py 21720 * **test url**: `<http://\<host\>:\<port\>/av1_1080p.html>`__ 21721 * **type**: pageload 21722 * **unit**: ms 21723 * **Test Task**: 21724 21725 .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** 21726 :widths: 30 15 15 15 15 21727 :header-rows: 1 21728 21729 * - **Test Name** 21730 - mozilla-central 21731 - autoland 21732 - mozilla-release 21733 - mozilla-beta 21734 * - **browsertime-video-playback-latency-mobile-chrome-m-vpl-av1-nofis** 21735 - ❌ 21736 - ❌ 21737 - ❌ 21738 - ❌ 21739 * - **browsertime-video-playback-latency-mobile-fenix-vpl-av1** 21740 - ✅ 21741 - ✅ 21742 - ❌ 21743 - ❌ 21744 * - **browsertime-video-playback-latency-mobile-fenix-vpl-av1-nofis** 21745 - ✅ 21746 - ✅ 21747 - ❌ 21748 - ❌ 21749 * - **browsertime-video-playback-latency-mobile-geckoview-vpl-av1** 21750 - ❌ 21751 - ❌ 21752 - ❌ 21753 - ❌ 21754 * - **browsertime-video-playback-latency-mobile-geckoview-vpl-av1-nofis** 21755 - ❌ 21756 - ❌ 21757 - ❌ 21758 - ❌ 21759 21760 21761 .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** 21762 :widths: 30 15 15 15 15 21763 :header-rows: 1 21764 21765 * - **Test Name** 21766 - mozilla-central 21767 - autoland 21768 - mozilla-release 21769 - mozilla-beta 21770 * - **browsertime-video-playback-latency-mobile-fenix-vpl-av1** 21771 - ❌ 21772 - ❌ 21773 - ❌ 21774 - ❌ 21775 * - **browsertime-video-playback-latency-mobile-fenix-vpl-av1-nofis** 21776 - ❌ 21777 - ❌ 21778 - ❌ 21779 - ❌ 21780 * - **browsertime-video-playback-latency-mobile-geckoview-vpl-av1** 21781 - ❌ 21782 - ❌ 21783 - ❌ 21784 - ❌ 21785 * - **browsertime-video-playback-latency-mobile-geckoview-vpl-av1-nofis** 21786 - ❌ 21787 - ❌ 21788 - ❌ 21789 - ❌ 21790 21791 21792 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 21793 :widths: 30 15 15 15 15 21794 :header-rows: 1 21795 21796 * - **Test Name** 21797 - mozilla-central 21798 - autoland 21799 - mozilla-release 21800 - mozilla-beta 21801 * - **browsertime-video-playback-latency-firefox-vpl-av1** 21802 - ❌ 21803 - ❌ 21804 - ❌ 21805 - ❌ 21806 21807 21808 .. list-table:: **test-linux1804-64-qr/opt** 21809 :widths: 30 15 15 15 15 21810 :header-rows: 1 21811 21812 * - **Test Name** 21813 - mozilla-central 21814 - autoland 21815 - mozilla-release 21816 - mozilla-beta 21817 * - **browsertime-video-playback-latency-firefox-vpl-av1** 21818 - ❌ 21819 - ❌ 21820 - ❌ 21821 - ❌ 21822 21823 21824 .. list-table:: **test-linux1804-64-shippable-qr/opt** 21825 :widths: 30 15 15 15 15 21826 :header-rows: 1 21827 21828 * - **Test Name** 21829 - mozilla-central 21830 - autoland 21831 - mozilla-release 21832 - mozilla-beta 21833 * - **browsertime-video-playback-latency-chrome-vpl-av1** 21834 - ❌ 21835 - ❌ 21836 - ❌ 21837 - ❌ 21838 * - **browsertime-video-playback-latency-firefox-vpl-av1** 21839 - ✅ 21840 - ✅ 21841 - ❌ 21842 - ❌ 21843 21844 21845 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 21846 :widths: 30 15 15 15 15 21847 :header-rows: 1 21848 21849 * - **Test Name** 21850 - mozilla-central 21851 - autoland 21852 - mozilla-release 21853 - mozilla-beta 21854 * - **browsertime-video-playback-latency-firefox-vpl-av1** 21855 - ❌ 21856 - ❌ 21857 - ❌ 21858 - ❌ 21859 21860 21861 .. list-table:: **test-macosx1470-64-shippable/opt** 21862 :widths: 30 15 15 15 15 21863 :header-rows: 1 21864 21865 * - **Test Name** 21866 - mozilla-central 21867 - autoland 21868 - mozilla-release 21869 - mozilla-beta 21870 * - **browsertime-video-playback-latency-chrome-vpl-av1** 21871 - ❌ 21872 - ❌ 21873 - ❌ 21874 - ❌ 21875 * - **browsertime-video-playback-latency-firefox-vpl-av1** 21876 - ✅ 21877 - ✅ 21878 - ❌ 21879 - ❌ 21880 21881 21882 .. list-table:: **test-macosx1470-64/opt** 21883 :widths: 30 15 15 15 15 21884 :header-rows: 1 21885 21886 * - **Test Name** 21887 - mozilla-central 21888 - autoland 21889 - mozilla-release 21890 - mozilla-beta 21891 * - **browsertime-video-playback-latency-firefox-vpl-av1** 21892 - ❌ 21893 - ❌ 21894 - ❌ 21895 - ❌ 21896 21897 21898 .. list-table:: **test-windows11-64-24h2-hw-ref-shippable/opt** 21899 :widths: 30 15 15 15 15 21900 :header-rows: 1 21901 21902 * - **Test Name** 21903 - mozilla-central 21904 - autoland 21905 - mozilla-release 21906 - mozilla-beta 21907 * - **browsertime-video-playback-latency-chrome-vpl-av1** 21908 - ❌ 21909 - ❌ 21910 - ❌ 21911 - ❌ 21912 * - **browsertime-video-playback-latency-firefox-vpl-av1** 21913 - ❌ 21914 - ❌ 21915 - ❌ 21916 - ❌ 21917 21918 21919 .. list-table:: **test-windows11-64-24h2-hw-ref/opt** 21920 :widths: 30 15 15 15 15 21921 :header-rows: 1 21922 21923 * - **Test Name** 21924 - mozilla-central 21925 - autoland 21926 - mozilla-release 21927 - mozilla-beta 21928 * - **browsertime-video-playback-latency-firefox-vpl-av1** 21929 - ❌ 21930 - ❌ 21931 - ❌ 21932 - ❌ 21933 21934 21935 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 21936 :widths: 30 15 15 15 15 21937 :header-rows: 1 21938 21939 * - **Test Name** 21940 - mozilla-central 21941 - autoland 21942 - mozilla-release 21943 - mozilla-beta 21944 * - **browsertime-video-playback-latency-firefox-vpl-av1** 21945 - ❌ 21946 - ❌ 21947 - ❌ 21948 - ❌ 21949 21950 21951 .. list-table:: **test-windows11-64-24h2-shippable/opt** 21952 :widths: 30 15 15 15 15 21953 :header-rows: 1 21954 21955 * - **Test Name** 21956 - mozilla-central 21957 - autoland 21958 - mozilla-release 21959 - mozilla-beta 21960 * - **browsertime-video-playback-latency-chrome-vpl-av1** 21961 - ❌ 21962 - ❌ 21963 - ❌ 21964 - ❌ 21965 * - **browsertime-video-playback-latency-firefox-vpl-av1** 21966 - ❌ 21967 - ❌ 21968 - ❌ 21969 - ❌ 21970 21971 21972 .. list-table:: **test-windows11-64-24h2/opt** 21973 :widths: 30 15 15 15 15 21974 :header-rows: 1 21975 21976 * - **Test Name** 21977 - mozilla-central 21978 - autoland 21979 - mozilla-release 21980 - mozilla-beta 21981 * - **browsertime-video-playback-latency-firefox-vpl-av1** 21982 - ❌ 21983 - ❌ 21984 - ❌ 21985 - ❌ 21986 21987 21988 21989 .. dropdown:: vpl-h264 21990 :class-container: anchor-id-vpl-h264-c 21991 21992 * Command to Run Locally 21993 21994 .. code-block:: 21995 21996 ./mach raptor -t vpl-h264 21997 21998 **Owner**: :aosmond and the Media Team 21999 22000 **Description**: Measures H264 1080p video playback latency. 22001 22002 * **alert on**: `estimatedFirstFrameLatency <raptor-metrics.html#estimated-frame-latency-(first)>`__, `estimatedAnyFrameLatency <raptor-metrics.html#estimated-frame-latency-(any)>`__ 22003 * **alert threshold**: 2.0 22004 * **apps**: chrome, chrome-m, geckoview, fenix, firefox, safari 22005 * **benchmark webserver**: true 22006 * **browser cycles**: 20 22007 * **expected**: pass 22008 * **gecko profile features**: stackwalk,js,cpu,java,processcpu,screenshots,memory 22009 * **gecko profile interval**: 1 22010 * **gecko profile threads**: BackgroundThreadPool,Compositor,decoder,GeckoMain,gmp,graph,grph,InotifyEventThread,IPDL Background,media,ModuleProcessThread,PacerThread,RemVidChild,RenderBackend,Renderer,SwComposite,TextureUpdate,ImageBridgeChld 22011 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-video-playback-latency.toml#31>`__ 22012 * **lower is better**: true 22013 * **measure**: firstFrame, secondFrame, lastFrame, estimatedFirstFrameLatency, estimatedAnyFrameLatency 22014 * **newtab per cycle**: true 22015 * **page cycles**: 20 22016 * **page timeout**: 20000 22017 * **preferences**: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false 22018 * **repository**: https://github.com/mozilla/perf-automation 22019 * **repository path**: benchmarks/video-playback-latency 22020 * **repository revision**: e3d0295c15cfdd6f32e6d4270de0ed5d6c1632cd 22021 * **sparse checkout**: true 22022 * **support class**: video_playback_latency.py 22023 * **test url**: `<http://\<host\>:\<port\>/h264_1080p.html>`__ 22024 * **type**: pageload 22025 * **unit**: ms 22026 * **Test Task**: 22027 22028 .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** 22029 :widths: 30 15 15 15 15 22030 :header-rows: 1 22031 22032 * - **Test Name** 22033 - mozilla-central 22034 - autoland 22035 - mozilla-release 22036 - mozilla-beta 22037 * - **browsertime-video-playback-latency-mobile-chrome-m-vpl-h264-nofis** 22038 - ❌ 22039 - ❌ 22040 - ❌ 22041 - ❌ 22042 * - **browsertime-video-playback-latency-mobile-fenix-vpl-h264** 22043 - ✅ 22044 - ✅ 22045 - ❌ 22046 - ❌ 22047 * - **browsertime-video-playback-latency-mobile-fenix-vpl-h264-nofis** 22048 - ✅ 22049 - ✅ 22050 - ❌ 22051 - ❌ 22052 * - **browsertime-video-playback-latency-mobile-geckoview-vpl-h264** 22053 - ❌ 22054 - ❌ 22055 - ❌ 22056 - ❌ 22057 * - **browsertime-video-playback-latency-mobile-geckoview-vpl-h264-nofis** 22058 - ❌ 22059 - ❌ 22060 - ❌ 22061 - ❌ 22062 22063 22064 .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** 22065 :widths: 30 15 15 15 15 22066 :header-rows: 1 22067 22068 * - **Test Name** 22069 - mozilla-central 22070 - autoland 22071 - mozilla-release 22072 - mozilla-beta 22073 * - **browsertime-video-playback-latency-mobile-fenix-vpl-h264** 22074 - ❌ 22075 - ❌ 22076 - ❌ 22077 - ❌ 22078 * - **browsertime-video-playback-latency-mobile-fenix-vpl-h264-nofis** 22079 - ❌ 22080 - ❌ 22081 - ❌ 22082 - ❌ 22083 * - **browsertime-video-playback-latency-mobile-geckoview-vpl-h264** 22084 - ❌ 22085 - ❌ 22086 - ❌ 22087 - ❌ 22088 * - **browsertime-video-playback-latency-mobile-geckoview-vpl-h264-nofis** 22089 - ❌ 22090 - ❌ 22091 - ❌ 22092 - ❌ 22093 22094 22095 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 22096 :widths: 30 15 15 15 15 22097 :header-rows: 1 22098 22099 * - **Test Name** 22100 - mozilla-central 22101 - autoland 22102 - mozilla-release 22103 - mozilla-beta 22104 * - **browsertime-video-playback-latency-firefox-vpl-h264** 22105 - ❌ 22106 - ❌ 22107 - ❌ 22108 - ❌ 22109 22110 22111 .. list-table:: **test-linux1804-64-qr/opt** 22112 :widths: 30 15 15 15 15 22113 :header-rows: 1 22114 22115 * - **Test Name** 22116 - mozilla-central 22117 - autoland 22118 - mozilla-release 22119 - mozilla-beta 22120 * - **browsertime-video-playback-latency-firefox-vpl-h264** 22121 - ❌ 22122 - ❌ 22123 - ❌ 22124 - ❌ 22125 22126 22127 .. list-table:: **test-linux1804-64-shippable-qr/opt** 22128 :widths: 30 15 15 15 15 22129 :header-rows: 1 22130 22131 * - **Test Name** 22132 - mozilla-central 22133 - autoland 22134 - mozilla-release 22135 - mozilla-beta 22136 * - **browsertime-video-playback-latency-chrome-vpl-h264** 22137 - ❌ 22138 - ❌ 22139 - ❌ 22140 - ❌ 22141 * - **browsertime-video-playback-latency-firefox-vpl-h264** 22142 - ✅ 22143 - ✅ 22144 - ❌ 22145 - ❌ 22146 22147 22148 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 22149 :widths: 30 15 15 15 15 22150 :header-rows: 1 22151 22152 * - **Test Name** 22153 - mozilla-central 22154 - autoland 22155 - mozilla-release 22156 - mozilla-beta 22157 * - **browsertime-video-playback-latency-firefox-vpl-h264** 22158 - ❌ 22159 - ❌ 22160 - ❌ 22161 - ❌ 22162 22163 22164 .. list-table:: **test-macosx1470-64-shippable/opt** 22165 :widths: 30 15 15 15 15 22166 :header-rows: 1 22167 22168 * - **Test Name** 22169 - mozilla-central 22170 - autoland 22171 - mozilla-release 22172 - mozilla-beta 22173 * - **browsertime-video-playback-latency-chrome-vpl-h264** 22174 - ❌ 22175 - ❌ 22176 - ❌ 22177 - ❌ 22178 * - **browsertime-video-playback-latency-firefox-vpl-h264** 22179 - ✅ 22180 - ✅ 22181 - ❌ 22182 - ❌ 22183 * - **browsertime-video-playback-latency-safari-vpl-h264** 22184 - ❌ 22185 - ❌ 22186 - ❌ 22187 - ❌ 22188 22189 22190 .. list-table:: **test-macosx1470-64/opt** 22191 :widths: 30 15 15 15 15 22192 :header-rows: 1 22193 22194 * - **Test Name** 22195 - mozilla-central 22196 - autoland 22197 - mozilla-release 22198 - mozilla-beta 22199 * - **browsertime-video-playback-latency-firefox-vpl-h264** 22200 - ❌ 22201 - ❌ 22202 - ❌ 22203 - ❌ 22204 22205 22206 .. list-table:: **test-windows11-64-24h2-hw-ref-shippable/opt** 22207 :widths: 30 15 15 15 15 22208 :header-rows: 1 22209 22210 * - **Test Name** 22211 - mozilla-central 22212 - autoland 22213 - mozilla-release 22214 - mozilla-beta 22215 * - **browsertime-video-playback-latency-chrome-vpl-h264** 22216 - ❌ 22217 - ❌ 22218 - ❌ 22219 - ❌ 22220 * - **browsertime-video-playback-latency-firefox-vpl-h264** 22221 - ❌ 22222 - ❌ 22223 - ❌ 22224 - ❌ 22225 22226 22227 .. list-table:: **test-windows11-64-24h2-hw-ref/opt** 22228 :widths: 30 15 15 15 15 22229 :header-rows: 1 22230 22231 * - **Test Name** 22232 - mozilla-central 22233 - autoland 22234 - mozilla-release 22235 - mozilla-beta 22236 * - **browsertime-video-playback-latency-firefox-vpl-h264** 22237 - ❌ 22238 - ❌ 22239 - ❌ 22240 - ❌ 22241 22242 22243 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 22244 :widths: 30 15 15 15 15 22245 :header-rows: 1 22246 22247 * - **Test Name** 22248 - mozilla-central 22249 - autoland 22250 - mozilla-release 22251 - mozilla-beta 22252 * - **browsertime-video-playback-latency-firefox-vpl-h264** 22253 - ❌ 22254 - ❌ 22255 - ❌ 22256 - ❌ 22257 22258 22259 .. list-table:: **test-windows11-64-24h2-shippable/opt** 22260 :widths: 30 15 15 15 15 22261 :header-rows: 1 22262 22263 * - **Test Name** 22264 - mozilla-central 22265 - autoland 22266 - mozilla-release 22267 - mozilla-beta 22268 * - **browsertime-video-playback-latency-chrome-vpl-h264** 22269 - ❌ 22270 - ❌ 22271 - ❌ 22272 - ❌ 22273 * - **browsertime-video-playback-latency-firefox-vpl-h264** 22274 - ❌ 22275 - ❌ 22276 - ❌ 22277 - ❌ 22278 22279 22280 .. list-table:: **test-windows11-64-24h2/opt** 22281 :widths: 30 15 15 15 15 22282 :header-rows: 1 22283 22284 * - **Test Name** 22285 - mozilla-central 22286 - autoland 22287 - mozilla-release 22288 - mozilla-beta 22289 * - **browsertime-video-playback-latency-firefox-vpl-h264** 22290 - ❌ 22291 - ❌ 22292 - ❌ 22293 - ❌ 22294 22295 22296 22297 .. dropdown:: vpl-vp9 22298 :class-container: anchor-id-vpl-vp9-c 22299 22300 * Command to Run Locally 22301 22302 .. code-block:: 22303 22304 ./mach raptor -t vpl-vp9 22305 22306 **Owner**: :aosmond and the Media Team 22307 22308 **Description**: Measures VP9 1080p video playback latency. 22309 22310 * **alert on**: `estimatedFirstFrameLatency <raptor-metrics.html#estimated-frame-latency-(first)>`__, `estimatedAnyFrameLatency <raptor-metrics.html#estimated-frame-latency-(any)>`__ 22311 * **alert threshold**: 2.0 22312 * **apps**: chrome, chrome-m, geckoview, fenix, firefox, safari 22313 * **benchmark webserver**: true 22314 * **browser cycles**: 20 22315 * **expected**: pass 22316 * **gecko profile features**: stackwalk,js,cpu,java,processcpu,screenshots,memory 22317 * **gecko profile interval**: 1 22318 * **gecko profile threads**: BackgroundThreadPool,Compositor,decoder,GeckoMain,gmp,graph,grph,InotifyEventThread,IPDL Background,media,ModuleProcessThread,PacerThread,RemVidChild,RenderBackend,Renderer,SwComposite,TextureUpdate,ImageBridgeChld 22319 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-video-playback-latency.toml#34>`__ 22320 * **lower is better**: true 22321 * **measure**: firstFrame, secondFrame, lastFrame, estimatedFirstFrameLatency, estimatedAnyFrameLatency 22322 * **newtab per cycle**: true 22323 * **page cycles**: 20 22324 * **page timeout**: 20000 22325 * **preferences**: media.autoplay.default=0 media.autoplay.ask-permission=false media.autoplay.blocking_policy=0 media.allowed-to-play.enabled=true media.block-autoplay-until-in-foreground=false 22326 * **repository**: https://github.com/mozilla/perf-automation 22327 * **repository path**: benchmarks/video-playback-latency 22328 * **repository revision**: e3d0295c15cfdd6f32e6d4270de0ed5d6c1632cd 22329 * **sparse checkout**: true 22330 * **support class**: video_playback_latency.py 22331 * **test url**: `<http://\<host\>:\<port\>/vp9_1080p.html>`__ 22332 * **type**: pageload 22333 * **unit**: ms 22334 * **Test Task**: 22335 22336 .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** 22337 :widths: 30 15 15 15 15 22338 :header-rows: 1 22339 22340 * - **Test Name** 22341 - mozilla-central 22342 - autoland 22343 - mozilla-release 22344 - mozilla-beta 22345 * - **browsertime-video-playback-latency-mobile-chrome-m-vpl-vp9-nofis** 22346 - ❌ 22347 - ❌ 22348 - ❌ 22349 - ❌ 22350 * - **browsertime-video-playback-latency-mobile-fenix-vpl-vp9** 22351 - ✅ 22352 - ✅ 22353 - ❌ 22354 - ❌ 22355 * - **browsertime-video-playback-latency-mobile-fenix-vpl-vp9-nofis** 22356 - ✅ 22357 - ✅ 22358 - ❌ 22359 - ❌ 22360 * - **browsertime-video-playback-latency-mobile-geckoview-vpl-vp9** 22361 - ❌ 22362 - ❌ 22363 - ❌ 22364 - ❌ 22365 * - **browsertime-video-playback-latency-mobile-geckoview-vpl-vp9-nofis** 22366 - ❌ 22367 - ❌ 22368 - ❌ 22369 - ❌ 22370 22371 22372 .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** 22373 :widths: 30 15 15 15 15 22374 :header-rows: 1 22375 22376 * - **Test Name** 22377 - mozilla-central 22378 - autoland 22379 - mozilla-release 22380 - mozilla-beta 22381 * - **browsertime-video-playback-latency-mobile-fenix-vpl-vp9** 22382 - ❌ 22383 - ❌ 22384 - ❌ 22385 - ❌ 22386 * - **browsertime-video-playback-latency-mobile-fenix-vpl-vp9-nofis** 22387 - ❌ 22388 - ❌ 22389 - ❌ 22390 - ❌ 22391 * - **browsertime-video-playback-latency-mobile-geckoview-vpl-vp9** 22392 - ❌ 22393 - ❌ 22394 - ❌ 22395 - ❌ 22396 * - **browsertime-video-playback-latency-mobile-geckoview-vpl-vp9-nofis** 22397 - ❌ 22398 - ❌ 22399 - ❌ 22400 - ❌ 22401 22402 22403 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 22404 :widths: 30 15 15 15 15 22405 :header-rows: 1 22406 22407 * - **Test Name** 22408 - mozilla-central 22409 - autoland 22410 - mozilla-release 22411 - mozilla-beta 22412 * - **browsertime-video-playback-latency-firefox-vpl-vp9** 22413 - ❌ 22414 - ❌ 22415 - ❌ 22416 - ❌ 22417 22418 22419 .. list-table:: **test-linux1804-64-qr/opt** 22420 :widths: 30 15 15 15 15 22421 :header-rows: 1 22422 22423 * - **Test Name** 22424 - mozilla-central 22425 - autoland 22426 - mozilla-release 22427 - mozilla-beta 22428 * - **browsertime-video-playback-latency-firefox-vpl-vp9** 22429 - ❌ 22430 - ❌ 22431 - ❌ 22432 - ❌ 22433 22434 22435 .. list-table:: **test-linux1804-64-shippable-qr/opt** 22436 :widths: 30 15 15 15 15 22437 :header-rows: 1 22438 22439 * - **Test Name** 22440 - mozilla-central 22441 - autoland 22442 - mozilla-release 22443 - mozilla-beta 22444 * - **browsertime-video-playback-latency-chrome-vpl-vp9** 22445 - ❌ 22446 - ❌ 22447 - ❌ 22448 - ❌ 22449 * - **browsertime-video-playback-latency-firefox-vpl-vp9** 22450 - ✅ 22451 - ✅ 22452 - ❌ 22453 - ❌ 22454 22455 22456 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 22457 :widths: 30 15 15 15 15 22458 :header-rows: 1 22459 22460 * - **Test Name** 22461 - mozilla-central 22462 - autoland 22463 - mozilla-release 22464 - mozilla-beta 22465 * - **browsertime-video-playback-latency-firefox-vpl-vp9** 22466 - ❌ 22467 - ❌ 22468 - ❌ 22469 - ❌ 22470 22471 22472 .. list-table:: **test-macosx1470-64-shippable/opt** 22473 :widths: 30 15 15 15 15 22474 :header-rows: 1 22475 22476 * - **Test Name** 22477 - mozilla-central 22478 - autoland 22479 - mozilla-release 22480 - mozilla-beta 22481 * - **browsertime-video-playback-latency-chrome-vpl-vp9** 22482 - ❌ 22483 - ❌ 22484 - ❌ 22485 - ❌ 22486 * - **browsertime-video-playback-latency-firefox-vpl-vp9** 22487 - ✅ 22488 - ✅ 22489 - ❌ 22490 - ❌ 22491 22492 22493 .. list-table:: **test-macosx1470-64/opt** 22494 :widths: 30 15 15 15 15 22495 :header-rows: 1 22496 22497 * - **Test Name** 22498 - mozilla-central 22499 - autoland 22500 - mozilla-release 22501 - mozilla-beta 22502 * - **browsertime-video-playback-latency-firefox-vpl-vp9** 22503 - ❌ 22504 - ❌ 22505 - ❌ 22506 - ❌ 22507 22508 22509 .. list-table:: **test-windows11-64-24h2-hw-ref-shippable/opt** 22510 :widths: 30 15 15 15 15 22511 :header-rows: 1 22512 22513 * - **Test Name** 22514 - mozilla-central 22515 - autoland 22516 - mozilla-release 22517 - mozilla-beta 22518 * - **browsertime-video-playback-latency-chrome-vpl-vp9** 22519 - ❌ 22520 - ❌ 22521 - ❌ 22522 - ❌ 22523 * - **browsertime-video-playback-latency-firefox-vpl-vp9** 22524 - ❌ 22525 - ❌ 22526 - ❌ 22527 - ❌ 22528 22529 22530 .. list-table:: **test-windows11-64-24h2-hw-ref/opt** 22531 :widths: 30 15 15 15 15 22532 :header-rows: 1 22533 22534 * - **Test Name** 22535 - mozilla-central 22536 - autoland 22537 - mozilla-release 22538 - mozilla-beta 22539 * - **browsertime-video-playback-latency-firefox-vpl-vp9** 22540 - ❌ 22541 - ❌ 22542 - ❌ 22543 - ❌ 22544 22545 22546 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 22547 :widths: 30 15 15 15 15 22548 :header-rows: 1 22549 22550 * - **Test Name** 22551 - mozilla-central 22552 - autoland 22553 - mozilla-release 22554 - mozilla-beta 22555 * - **browsertime-video-playback-latency-firefox-vpl-vp9** 22556 - ❌ 22557 - ❌ 22558 - ❌ 22559 - ❌ 22560 22561 22562 .. list-table:: **test-windows11-64-24h2-shippable/opt** 22563 :widths: 30 15 15 15 15 22564 :header-rows: 1 22565 22566 * - **Test Name** 22567 - mozilla-central 22568 - autoland 22569 - mozilla-release 22570 - mozilla-beta 22571 * - **browsertime-video-playback-latency-chrome-vpl-vp9** 22572 - ❌ 22573 - ❌ 22574 - ❌ 22575 - ❌ 22576 * - **browsertime-video-playback-latency-firefox-vpl-vp9** 22577 - ❌ 22578 - ❌ 22579 - ❌ 22580 - ❌ 22581 22582 22583 .. list-table:: **test-windows11-64-24h2/opt** 22584 :widths: 30 15 15 15 15 22585 :header-rows: 1 22586 22587 * - **Test Name** 22588 - mozilla-central 22589 - autoland 22590 - mozilla-release 22591 - mozilla-beta 22592 * - **browsertime-video-playback-latency-firefox-vpl-vp9** 22593 - ❌ 22594 - ❌ 22595 - ❌ 22596 - ❌ 22597 22598 22599 22600 .. dropdown:: welcome 22601 :class-container: anchor-id-welcome-c 22602 22603 * Command to Run Locally 22604 22605 .. code-block:: 22606 22607 ./mach raptor -t welcome 22608 22609 **Owner**: PerfTest Team 22610 22611 **Description**: Measures pageload metrics for the first-install about:welcome page 22612 22613 * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__ 22614 * **alert threshold**: 2.0 22615 * **apps**: firefox 22616 * **browser cycles**: 25 22617 * **expected**: pass 22618 * **gecko profile interval**: 1 22619 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/custom/browsertime-welcome.toml#18>`__ 22620 * **lower is better**: true 22621 * **measure**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange 22622 * **page cycles**: 25 22623 * **page timeout**: 60000 22624 * **playback**: mitmproxy 22625 * **playback pageset manifest**: mitm5-linux-firefox-welcome.manifest 22626 * **playback version**: 11.0.0 22627 * **support class**: browsertime_pageload.py 22628 * **test script**: welcome.js 22629 * **test url**: `<about:welcome>`__ 22630 * **type**: pageload 22631 * **unit**: ms 22632 * **use live sites**: false 22633 * **Test Task**: 22634 22635 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 22636 :widths: 30 15 15 15 15 22637 :header-rows: 1 22638 22639 * - **Test Name** 22640 - mozilla-central 22641 - autoland 22642 - mozilla-release 22643 - mozilla-beta 22644 * - **browsertime-first-install-firefox-welcome** 22645 - ❌ 22646 - ❌ 22647 - ❌ 22648 - ❌ 22649 22650 22651 .. list-table:: **test-linux1804-64-qr/opt** 22652 :widths: 30 15 15 15 15 22653 :header-rows: 1 22654 22655 * - **Test Name** 22656 - mozilla-central 22657 - autoland 22658 - mozilla-release 22659 - mozilla-beta 22660 * - **browsertime-first-install-firefox-welcome** 22661 - ❌ 22662 - ❌ 22663 - ❌ 22664 - ❌ 22665 22666 22667 .. list-table:: **test-linux1804-64-shippable-qr/opt** 22668 :widths: 30 15 15 15 15 22669 :header-rows: 1 22670 22671 * - **Test Name** 22672 - mozilla-central 22673 - autoland 22674 - mozilla-release 22675 - mozilla-beta 22676 * - **browsertime-first-install-firefox-welcome** 22677 - ✅ 22678 - ✅ 22679 - ❌ 22680 - ❌ 22681 22682 22683 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 22684 :widths: 30 15 15 15 15 22685 :header-rows: 1 22686 22687 * - **Test Name** 22688 - mozilla-central 22689 - autoland 22690 - mozilla-release 22691 - mozilla-beta 22692 * - **browsertime-first-install-firefox-welcome** 22693 - ❌ 22694 - ❌ 22695 - ❌ 22696 - ❌ 22697 22698 22699 .. list-table:: **test-macosx1470-64-shippable/opt** 22700 :widths: 30 15 15 15 15 22701 :header-rows: 1 22702 22703 * - **Test Name** 22704 - mozilla-central 22705 - autoland 22706 - mozilla-release 22707 - mozilla-beta 22708 * - **browsertime-first-install-firefox-welcome** 22709 - ✅ 22710 - ✅ 22711 - ❌ 22712 - ❌ 22713 22714 22715 .. list-table:: **test-macosx1470-64/opt** 22716 :widths: 30 15 15 15 15 22717 :header-rows: 1 22718 22719 * - **Test Name** 22720 - mozilla-central 22721 - autoland 22722 - mozilla-release 22723 - mozilla-beta 22724 * - **browsertime-first-install-firefox-welcome** 22725 - ❌ 22726 - ❌ 22727 - ❌ 22728 - ❌ 22729 22730 22731 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 22732 :widths: 30 15 15 15 15 22733 :header-rows: 1 22734 22735 * - **Test Name** 22736 - mozilla-central 22737 - autoland 22738 - mozilla-release 22739 - mozilla-beta 22740 * - **browsertime-first-install-firefox-welcome** 22741 - ❌ 22742 - ❌ 22743 - ❌ 22744 - ❌ 22745 22746 22747 .. list-table:: **test-windows11-64-24h2-shippable/opt** 22748 :widths: 30 15 15 15 15 22749 :header-rows: 1 22750 22751 * - **Test Name** 22752 - mozilla-central 22753 - autoland 22754 - mozilla-release 22755 - mozilla-beta 22756 * - **browsertime-first-install-firefox-welcome** 22757 - ✅ 22758 - ✅ 22759 - ❌ 22760 - ❌ 22761 22762 22763 .. list-table:: **test-windows11-64-24h2/opt** 22764 :widths: 30 15 15 15 15 22765 :header-rows: 1 22766 22767 * - **Test Name** 22768 - mozilla-central 22769 - autoland 22770 - mozilla-release 22771 - mozilla-beta 22772 * - **browsertime-first-install-firefox-welcome** 22773 - ❌ 22774 - ❌ 22775 - ❌ 22776 - ❌ 22777 22778 22779 22780 22781 Desktop 22782 ------- 22783 Tests for page-load performance. The links direct to the actual websites that are being tested. 22784 22785 .. dropdown:: amazon 22786 :class-container: anchor-id-amazon-d 22787 22788 * Command to Run Locally 22789 22790 .. code-block:: 22791 22792 ./mach raptor -t amazon 22793 22794 **Owner**: PerfTest Team 22795 22796 * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__, `largestContentfulPaint <raptor-metrics.html#largest-contentful-paint>`__ 22797 * **alert threshold**: 2.0 22798 * **apps**: firefox, chrome, safari, custom-car 22799 * **benchmark page**: false 22800 * **browser cycles**: 25 22801 * **expected**: pass 22802 * **gecko profile interval**: 1 22803 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#22>`__ 22804 * **lower is better**: true 22805 * **page cycles**: 25 22806 * **page timeout**: 60000 22807 * **playback**: mitmproxy 22808 * **playback pageset manifest**: mitm11-windows-firefox-amazon.manifest 22809 * **playback pageset manifest backup**: mitm8-linux-firefox-amazon.manifest 22810 * **playback version**: 11.0.0 22811 * **secondary url**: `<https://www.amazon.com/Acer-A515-46-R14K-Quad-Core-Processor-Backlit/dp/B08VKNVDDR/ref=sr_1_3?dchild=1&keywords=laptop&qid=1627047187&sr=8-3>`__ 22812 * **support class**: browsertime_pageload.py 22813 * **test url**: `<https://www.amazon.com/s?k=laptop&ref=nb_sb_noss_1>`__ 22814 * **type**: pageload 22815 * **unit**: ms 22816 * **use live sites**: false 22817 * **Test Task**: 22818 22819 .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** 22820 :widths: 30 15 15 15 15 22821 :header-rows: 1 22822 22823 * - **Test Name** 22824 - mozilla-central 22825 - autoland 22826 - mozilla-release 22827 - mozilla-beta 22828 * - **browsertime-tp6-bytecode-firefox-amazon** 22829 - ❌ 22830 - ❌ 22831 - ❌ 22832 - ❌ 22833 * - **browsertime-tp6-essential-firefox-amazon** 22834 - ❌ 22835 - ❌ 22836 - ❌ 22837 - ❌ 22838 * - **browsertime-tp6-live-firefox-amazon** 22839 - ❌ 22840 - ❌ 22841 - ❌ 22842 - ❌ 22843 * - **browsertime-tp6-webextensions-firefox-amazon** 22844 - ❌ 22845 - ❌ 22846 - ❌ 22847 - ❌ 22848 22849 22850 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 22851 :widths: 30 15 15 15 15 22852 :header-rows: 1 22853 22854 * - **Test Name** 22855 - mozilla-central 22856 - autoland 22857 - mozilla-release 22858 - mozilla-beta 22859 * - **browsertime-tp6-bytecode-firefox-amazon** 22860 - ❌ 22861 - ❌ 22862 - ❌ 22863 - ❌ 22864 * - **browsertime-tp6-essential-firefox-amazon** 22865 - ❌ 22866 - ❌ 22867 - ❌ 22868 - ❌ 22869 * - **browsertime-tp6-live-firefox-amazon** 22870 - ❌ 22871 - ❌ 22872 - ❌ 22873 - ❌ 22874 * - **browsertime-tp6-webextensions-firefox-amazon** 22875 - ❌ 22876 - ❌ 22877 - ❌ 22878 - ❌ 22879 22880 22881 .. list-table:: **test-linux1804-64-qr/opt** 22882 :widths: 30 15 15 15 15 22883 :header-rows: 1 22884 22885 * - **Test Name** 22886 - mozilla-central 22887 - autoland 22888 - mozilla-release 22889 - mozilla-beta 22890 * - **browsertime-tp6-bytecode-firefox-amazon** 22891 - ❌ 22892 - ❌ 22893 - ❌ 22894 - ❌ 22895 * - **browsertime-tp6-essential-firefox-amazon** 22896 - ❌ 22897 - ❌ 22898 - ❌ 22899 - ❌ 22900 * - **browsertime-tp6-live-firefox-amazon** 22901 - ❌ 22902 - ❌ 22903 - ❌ 22904 - ❌ 22905 * - **browsertime-tp6-webextensions-firefox-amazon** 22906 - ❌ 22907 - ❌ 22908 - ❌ 22909 - ❌ 22910 22911 22912 .. list-table:: **test-linux1804-64-shippable-qr/opt** 22913 :widths: 30 15 15 15 15 22914 :header-rows: 1 22915 22916 * - **Test Name** 22917 - mozilla-central 22918 - autoland 22919 - mozilla-release 22920 - mozilla-beta 22921 * - **browsertime-tp6-bytecode-firefox-amazon** 22922 - ✅ 22923 - ✅ 22924 - ❌ 22925 - ❌ 22926 * - **browsertime-tp6-essential-chrome-amazon** 22927 - ❌ 22928 - ❌ 22929 - ❌ 22930 - ❌ 22931 * - **browsertime-tp6-essential-custom-car-amazon** 22932 - ❌ 22933 - ❌ 22934 - ❌ 22935 - ❌ 22936 * - **browsertime-tp6-essential-firefox-amazon** 22937 - ✅ 22938 - ✅ 22939 - ❌ 22940 - ❌ 22941 * - **browsertime-tp6-live-chrome-amazon** 22942 - ❌ 22943 - ❌ 22944 - ❌ 22945 - ❌ 22946 * - **browsertime-tp6-live-firefox-amazon** 22947 - ❌ 22948 - ❌ 22949 - ❌ 22950 - ❌ 22951 * - **browsertime-tp6-profiling-firefox-amazon** 22952 - ✅ 22953 - ❌ 22954 - ❌ 22955 - ❌ 22956 * - **browsertime-tp6-webextensions-firefox-amazon** 22957 - ✅ 22958 - ✅ 22959 - ❌ 22960 - ❌ 22961 22962 22963 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 22964 :widths: 30 15 15 15 15 22965 :header-rows: 1 22966 22967 * - **Test Name** 22968 - mozilla-central 22969 - autoland 22970 - mozilla-release 22971 - mozilla-beta 22972 * - **browsertime-tp6-bytecode-firefox-amazon** 22973 - ❌ 22974 - ❌ 22975 - ❌ 22976 - ❌ 22977 * - **browsertime-tp6-essential-firefox-amazon** 22978 - ❌ 22979 - ❌ 22980 - ❌ 22981 - ❌ 22982 * - **browsertime-tp6-live-firefox-amazon** 22983 - ❌ 22984 - ❌ 22985 - ❌ 22986 - ❌ 22987 * - **browsertime-tp6-webextensions-firefox-amazon** 22988 - ❌ 22989 - ❌ 22990 - ❌ 22991 - ❌ 22992 22993 22994 .. list-table:: **test-macosx1470-64-shippable/opt** 22995 :widths: 30 15 15 15 15 22996 :header-rows: 1 22997 22998 * - **Test Name** 22999 - mozilla-central 23000 - autoland 23001 - mozilla-release 23002 - mozilla-beta 23003 * - **browsertime-tp6-bytecode-firefox-amazon** 23004 - ✅ 23005 - ✅ 23006 - ❌ 23007 - ❌ 23008 * - **browsertime-tp6-essential-chrome-amazon** 23009 - ❌ 23010 - ❌ 23011 - ❌ 23012 - ❌ 23013 * - **browsertime-tp6-essential-custom-car-amazon** 23014 - ❌ 23015 - ❌ 23016 - ❌ 23017 - ❌ 23018 * - **browsertime-tp6-essential-firefox-amazon** 23019 - ✅ 23020 - ✅ 23021 - ❌ 23022 - ❌ 23023 * - **browsertime-tp6-live-chrome-amazon** 23024 - ❌ 23025 - ❌ 23026 - ❌ 23027 - ❌ 23028 * - **browsertime-tp6-live-firefox-amazon** 23029 - ❌ 23030 - ❌ 23031 - ❌ 23032 - ❌ 23033 * - **browsertime-tp6-live-safari-amazon** 23034 - ❌ 23035 - ❌ 23036 - ❌ 23037 - ❌ 23038 * - **browsertime-tp6-profiling-firefox-amazon** 23039 - ✅ 23040 - ❌ 23041 - ❌ 23042 - ❌ 23043 * - **browsertime-tp6-webextensions-firefox-amazon** 23044 - ✅ 23045 - ✅ 23046 - ❌ 23047 - ❌ 23048 23049 23050 .. list-table:: **test-macosx1470-64/opt** 23051 :widths: 30 15 15 15 15 23052 :header-rows: 1 23053 23054 * - **Test Name** 23055 - mozilla-central 23056 - autoland 23057 - mozilla-release 23058 - mozilla-beta 23059 * - **browsertime-tp6-bytecode-firefox-amazon** 23060 - ❌ 23061 - ❌ 23062 - ❌ 23063 - ❌ 23064 * - **browsertime-tp6-essential-firefox-amazon** 23065 - ❌ 23066 - ❌ 23067 - ❌ 23068 - ❌ 23069 * - **browsertime-tp6-live-firefox-amazon** 23070 - ❌ 23071 - ❌ 23072 - ❌ 23073 - ❌ 23074 * - **browsertime-tp6-webextensions-firefox-amazon** 23075 - ❌ 23076 - ❌ 23077 - ❌ 23078 - ❌ 23079 23080 23081 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 23082 :widths: 30 15 15 15 15 23083 :header-rows: 1 23084 23085 * - **Test Name** 23086 - mozilla-central 23087 - autoland 23088 - mozilla-release 23089 - mozilla-beta 23090 * - **browsertime-tp6-bytecode-firefox-amazon** 23091 - ❌ 23092 - ❌ 23093 - ❌ 23094 - ❌ 23095 * - **browsertime-tp6-essential-firefox-amazon** 23096 - ❌ 23097 - ❌ 23098 - ❌ 23099 - ❌ 23100 * - **browsertime-tp6-live-firefox-amazon** 23101 - ❌ 23102 - ❌ 23103 - ❌ 23104 - ❌ 23105 * - **browsertime-tp6-webextensions-firefox-amazon** 23106 - ❌ 23107 - ❌ 23108 - ❌ 23109 - ❌ 23110 23111 23112 .. list-table:: **test-windows11-64-24h2-shippable/opt** 23113 :widths: 30 15 15 15 15 23114 :header-rows: 1 23115 23116 * - **Test Name** 23117 - mozilla-central 23118 - autoland 23119 - mozilla-release 23120 - mozilla-beta 23121 * - **browsertime-tp6-bytecode-firefox-amazon** 23122 - ✅ 23123 - ✅ 23124 - ❌ 23125 - ❌ 23126 * - **browsertime-tp6-essential-chrome-amazon** 23127 - ❌ 23128 - ❌ 23129 - ❌ 23130 - ❌ 23131 * - **browsertime-tp6-essential-custom-car-amazon** 23132 - ❌ 23133 - ❌ 23134 - ❌ 23135 - ❌ 23136 * - **browsertime-tp6-essential-firefox-amazon** 23137 - ✅ 23138 - ✅ 23139 - ❌ 23140 - ❌ 23141 * - **browsertime-tp6-live-chrome-amazon** 23142 - ❌ 23143 - ❌ 23144 - ❌ 23145 - ❌ 23146 * - **browsertime-tp6-live-firefox-amazon** 23147 - ❌ 23148 - ❌ 23149 - ❌ 23150 - ❌ 23151 * - **browsertime-tp6-webextensions-firefox-amazon** 23152 - ✅ 23153 - ✅ 23154 - ❌ 23155 - ❌ 23156 23157 23158 .. list-table:: **test-windows11-64-24h2/opt** 23159 :widths: 30 15 15 15 15 23160 :header-rows: 1 23161 23162 * - **Test Name** 23163 - mozilla-central 23164 - autoland 23165 - mozilla-release 23166 - mozilla-beta 23167 * - **browsertime-tp6-bytecode-firefox-amazon** 23168 - ❌ 23169 - ❌ 23170 - ❌ 23171 - ❌ 23172 * - **browsertime-tp6-essential-firefox-amazon** 23173 - ❌ 23174 - ❌ 23175 - ❌ 23176 - ❌ 23177 * - **browsertime-tp6-live-firefox-amazon** 23178 - ❌ 23179 - ❌ 23180 - ❌ 23181 - ❌ 23182 * - **browsertime-tp6-webextensions-firefox-amazon** 23183 - ❌ 23184 - ❌ 23185 - ❌ 23186 - ❌ 23187 23188 23189 23190 .. dropdown:: bing-search 23191 :class-container: anchor-id-bing-search-d 23192 23193 * Command to Run Locally 23194 23195 .. code-block:: 23196 23197 ./mach raptor -t bing-search 23198 23199 **Owner**: PerfTest Team 23200 23201 * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__, `largestContentfulPaint <raptor-metrics.html#largest-contentful-paint>`__ 23202 * **alert threshold**: 2.0 23203 * **apps**: firefox, chrome, safari, custom-car 23204 * **benchmark page**: true 23205 * **browser cycles**: 25 23206 * **expected**: pass 23207 * **gecko profile interval**: 1 23208 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#29>`__ 23209 * **lower is better**: true 23210 * **page cycles**: 25 23211 * **page timeout**: 60000 23212 * **playback**: mitmproxy 23213 * **playback pageset manifest**: mitm8-darwin-firefox-bing-search.manifest 23214 * **playback version**: 11.0.0 23215 * **support class**: browsertime_pageload.py 23216 * **test url**: `<https://www.bing.com/search?q=barack+obama>`__ 23217 * **type**: pageload 23218 * **unit**: ms 23219 * **use live sites**: false 23220 * **Test Task**: 23221 23222 .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** 23223 :widths: 30 15 15 15 15 23224 :header-rows: 1 23225 23226 * - **Test Name** 23227 - mozilla-central 23228 - autoland 23229 - mozilla-release 23230 - mozilla-beta 23231 * - **browsertime-tp6-bytecode-firefox-bing-search** 23232 - ❌ 23233 - ❌ 23234 - ❌ 23235 - ❌ 23236 * - **browsertime-tp6-essential-firefox-bing-search** 23237 - ❌ 23238 - ❌ 23239 - ❌ 23240 - ❌ 23241 * - **browsertime-tp6-live-firefox-bing-search** 23242 - ❌ 23243 - ❌ 23244 - ❌ 23245 - ❌ 23246 23247 23248 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 23249 :widths: 30 15 15 15 15 23250 :header-rows: 1 23251 23252 * - **Test Name** 23253 - mozilla-central 23254 - autoland 23255 - mozilla-release 23256 - mozilla-beta 23257 * - **browsertime-tp6-bytecode-firefox-bing-search** 23258 - ❌ 23259 - ❌ 23260 - ❌ 23261 - ❌ 23262 * - **browsertime-tp6-essential-firefox-bing-search** 23263 - ❌ 23264 - ❌ 23265 - ❌ 23266 - ❌ 23267 * - **browsertime-tp6-live-firefox-bing-search** 23268 - ❌ 23269 - ❌ 23270 - ❌ 23271 - ❌ 23272 23273 23274 .. list-table:: **test-linux1804-64-qr/opt** 23275 :widths: 30 15 15 15 15 23276 :header-rows: 1 23277 23278 * - **Test Name** 23279 - mozilla-central 23280 - autoland 23281 - mozilla-release 23282 - mozilla-beta 23283 * - **browsertime-tp6-bytecode-firefox-bing-search** 23284 - ❌ 23285 - ❌ 23286 - ❌ 23287 - ❌ 23288 * - **browsertime-tp6-essential-firefox-bing-search** 23289 - ❌ 23290 - ❌ 23291 - ❌ 23292 - ❌ 23293 * - **browsertime-tp6-live-firefox-bing-search** 23294 - ❌ 23295 - ❌ 23296 - ❌ 23297 - ❌ 23298 23299 23300 .. list-table:: **test-linux1804-64-shippable-qr/opt** 23301 :widths: 30 15 15 15 15 23302 :header-rows: 1 23303 23304 * - **Test Name** 23305 - mozilla-central 23306 - autoland 23307 - mozilla-release 23308 - mozilla-beta 23309 * - **browsertime-tp6-bytecode-firefox-bing-search** 23310 - ✅ 23311 - ✅ 23312 - ❌ 23313 - ❌ 23314 * - **browsertime-tp6-essential-chrome-bing-search** 23315 - ❌ 23316 - ❌ 23317 - ❌ 23318 - ❌ 23319 * - **browsertime-tp6-essential-custom-car-bing-search** 23320 - ❌ 23321 - ❌ 23322 - ❌ 23323 - ❌ 23324 * - **browsertime-tp6-essential-firefox-bing-search** 23325 - ✅ 23326 - ✅ 23327 - ❌ 23328 - ❌ 23329 * - **browsertime-tp6-live-chrome-bing-search** 23330 - ❌ 23331 - ❌ 23332 - ❌ 23333 - ❌ 23334 * - **browsertime-tp6-live-firefox-bing-search** 23335 - ❌ 23336 - ❌ 23337 - ❌ 23338 - ❌ 23339 23340 23341 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 23342 :widths: 30 15 15 15 15 23343 :header-rows: 1 23344 23345 * - **Test Name** 23346 - mozilla-central 23347 - autoland 23348 - mozilla-release 23349 - mozilla-beta 23350 * - **browsertime-tp6-bytecode-firefox-bing-search** 23351 - ❌ 23352 - ❌ 23353 - ❌ 23354 - ❌ 23355 * - **browsertime-tp6-essential-firefox-bing-search** 23356 - ❌ 23357 - ❌ 23358 - ❌ 23359 - ❌ 23360 * - **browsertime-tp6-live-firefox-bing-search** 23361 - ❌ 23362 - ❌ 23363 - ❌ 23364 - ❌ 23365 23366 23367 .. list-table:: **test-macosx1470-64-shippable/opt** 23368 :widths: 30 15 15 15 15 23369 :header-rows: 1 23370 23371 * - **Test Name** 23372 - mozilla-central 23373 - autoland 23374 - mozilla-release 23375 - mozilla-beta 23376 * - **browsertime-tp6-bytecode-firefox-bing-search** 23377 - ✅ 23378 - ✅ 23379 - ❌ 23380 - ❌ 23381 * - **browsertime-tp6-essential-chrome-bing-search** 23382 - ❌ 23383 - ❌ 23384 - ❌ 23385 - ❌ 23386 * - **browsertime-tp6-essential-custom-car-bing-search** 23387 - ❌ 23388 - ❌ 23389 - ❌ 23390 - ❌ 23391 * - **browsertime-tp6-essential-firefox-bing-search** 23392 - ✅ 23393 - ✅ 23394 - ❌ 23395 - ❌ 23396 * - **browsertime-tp6-live-chrome-bing-search** 23397 - ❌ 23398 - ❌ 23399 - ❌ 23400 - ❌ 23401 * - **browsertime-tp6-live-firefox-bing-search** 23402 - ❌ 23403 - ❌ 23404 - ❌ 23405 - ❌ 23406 * - **browsertime-tp6-live-safari-bing-search** 23407 - ❌ 23408 - ❌ 23409 - ❌ 23410 - ❌ 23411 23412 23413 .. list-table:: **test-macosx1470-64/opt** 23414 :widths: 30 15 15 15 15 23415 :header-rows: 1 23416 23417 * - **Test Name** 23418 - mozilla-central 23419 - autoland 23420 - mozilla-release 23421 - mozilla-beta 23422 * - **browsertime-tp6-bytecode-firefox-bing-search** 23423 - ❌ 23424 - ❌ 23425 - ❌ 23426 - ❌ 23427 * - **browsertime-tp6-essential-firefox-bing-search** 23428 - ❌ 23429 - ❌ 23430 - ❌ 23431 - ❌ 23432 * - **browsertime-tp6-live-firefox-bing-search** 23433 - ❌ 23434 - ❌ 23435 - ❌ 23436 - ❌ 23437 23438 23439 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 23440 :widths: 30 15 15 15 15 23441 :header-rows: 1 23442 23443 * - **Test Name** 23444 - mozilla-central 23445 - autoland 23446 - mozilla-release 23447 - mozilla-beta 23448 * - **browsertime-tp6-bytecode-firefox-bing-search** 23449 - ❌ 23450 - ❌ 23451 - ❌ 23452 - ❌ 23453 * - **browsertime-tp6-essential-firefox-bing-search** 23454 - ❌ 23455 - ❌ 23456 - ❌ 23457 - ❌ 23458 * - **browsertime-tp6-live-firefox-bing-search** 23459 - ❌ 23460 - ❌ 23461 - ❌ 23462 - ❌ 23463 23464 23465 .. list-table:: **test-windows11-64-24h2-shippable/opt** 23466 :widths: 30 15 15 15 15 23467 :header-rows: 1 23468 23469 * - **Test Name** 23470 - mozilla-central 23471 - autoland 23472 - mozilla-release 23473 - mozilla-beta 23474 * - **browsertime-tp6-bytecode-firefox-bing-search** 23475 - ✅ 23476 - ✅ 23477 - ❌ 23478 - ❌ 23479 * - **browsertime-tp6-essential-chrome-bing-search** 23480 - ❌ 23481 - ❌ 23482 - ❌ 23483 - ❌ 23484 * - **browsertime-tp6-essential-custom-car-bing-search** 23485 - ❌ 23486 - ❌ 23487 - ❌ 23488 - ❌ 23489 * - **browsertime-tp6-essential-firefox-bing-search** 23490 - ✅ 23491 - ✅ 23492 - ❌ 23493 - ❌ 23494 * - **browsertime-tp6-live-chrome-bing-search** 23495 - ❌ 23496 - ❌ 23497 - ❌ 23498 - ❌ 23499 * - **browsertime-tp6-live-firefox-bing-search** 23500 - ❌ 23501 - ❌ 23502 - ❌ 23503 - ❌ 23504 23505 23506 .. list-table:: **test-windows11-64-24h2/opt** 23507 :widths: 30 15 15 15 15 23508 :header-rows: 1 23509 23510 * - **Test Name** 23511 - mozilla-central 23512 - autoland 23513 - mozilla-release 23514 - mozilla-beta 23515 * - **browsertime-tp6-bytecode-firefox-bing-search** 23516 - ❌ 23517 - ❌ 23518 - ❌ 23519 - ❌ 23520 * - **browsertime-tp6-essential-firefox-bing-search** 23521 - ❌ 23522 - ❌ 23523 - ❌ 23524 - ❌ 23525 * - **browsertime-tp6-live-firefox-bing-search** 23526 - ❌ 23527 - ❌ 23528 - ❌ 23529 - ❌ 23530 23531 23532 23533 .. dropdown:: buzzfeed 23534 :class-container: anchor-id-buzzfeed-d 23535 23536 * Command to Run Locally 23537 23538 .. code-block:: 23539 23540 ./mach raptor -t buzzfeed 23541 23542 **Owner**: PerfTest Team 23543 23544 * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__, `largestContentfulPaint <raptor-metrics.html#largest-contentful-paint>`__ 23545 * **alert threshold**: 2.0 23546 * **apps**: firefox, chrome, safari, custom-car 23547 * **benchmark page**: false 23548 * **browser cycles**: 25 23549 * **expected**: pass 23550 * **gecko profile interval**: 1 23551 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#33>`__ 23552 * **lower is better**: true 23553 * **page cycles**: 25 23554 * **page timeout**: 60000 23555 * **playback**: mitmproxy 23556 * **playback pageset manifest**: mitm11-windows-firefox-buzzfeed.manifest 23557 * **playback pageset manifest backup**: mitm7-linux-firefox-buzzfeed.manifest 23558 * **playback version**: 11.0.0 23559 * **secondary url**: `<https://www.buzzfeed.com/quizzes>`__ 23560 * **support class**: browsertime_pageload.py 23561 * **test url**: `<https://www.buzzfeed.com/>`__ 23562 * **type**: pageload 23563 * **unit**: ms 23564 * **use live sites**: false 23565 * **Test Task**: 23566 23567 .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** 23568 :widths: 30 15 15 15 15 23569 :header-rows: 1 23570 23571 * - **Test Name** 23572 - mozilla-central 23573 - autoland 23574 - mozilla-release 23575 - mozilla-beta 23576 * - **browsertime-tp6-firefox-buzzfeed** 23577 - ❌ 23578 - ❌ 23579 - ❌ 23580 - ❌ 23581 23582 23583 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 23584 :widths: 30 15 15 15 15 23585 :header-rows: 1 23586 23587 * - **Test Name** 23588 - mozilla-central 23589 - autoland 23590 - mozilla-release 23591 - mozilla-beta 23592 * - **browsertime-tp6-firefox-buzzfeed** 23593 - ❌ 23594 - ❌ 23595 - ❌ 23596 - ❌ 23597 23598 23599 .. list-table:: **test-linux1804-64-qr/opt** 23600 :widths: 30 15 15 15 15 23601 :header-rows: 1 23602 23603 * - **Test Name** 23604 - mozilla-central 23605 - autoland 23606 - mozilla-release 23607 - mozilla-beta 23608 * - **browsertime-tp6-firefox-buzzfeed** 23609 - ❌ 23610 - ❌ 23611 - ❌ 23612 - ❌ 23613 23614 23615 .. list-table:: **test-linux1804-64-shippable-qr/opt** 23616 :widths: 30 15 15 15 15 23617 :header-rows: 1 23618 23619 * - **Test Name** 23620 - mozilla-central 23621 - autoland 23622 - mozilla-release 23623 - mozilla-beta 23624 * - **browsertime-tp6-chrome-buzzfeed** 23625 - ❌ 23626 - ❌ 23627 - ❌ 23628 - ❌ 23629 * - **browsertime-tp6-custom-car-buzzfeed** 23630 - ❌ 23631 - ❌ 23632 - ❌ 23633 - ❌ 23634 * - **browsertime-tp6-firefox-buzzfeed** 23635 - ✅ 23636 - ✅ 23637 - ❌ 23638 - ❌ 23639 23640 23641 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 23642 :widths: 30 15 15 15 15 23643 :header-rows: 1 23644 23645 * - **Test Name** 23646 - mozilla-central 23647 - autoland 23648 - mozilla-release 23649 - mozilla-beta 23650 * - **browsertime-tp6-firefox-buzzfeed** 23651 - ❌ 23652 - ❌ 23653 - ❌ 23654 - ❌ 23655 23656 23657 .. list-table:: **test-macosx1470-64-shippable/opt** 23658 :widths: 30 15 15 15 15 23659 :header-rows: 1 23660 23661 * - **Test Name** 23662 - mozilla-central 23663 - autoland 23664 - mozilla-release 23665 - mozilla-beta 23666 * - **browsertime-tp6-chrome-buzzfeed** 23667 - ❌ 23668 - ❌ 23669 - ❌ 23670 - ❌ 23671 * - **browsertime-tp6-custom-car-buzzfeed** 23672 - ❌ 23673 - ❌ 23674 - ❌ 23675 - ❌ 23676 * - **browsertime-tp6-firefox-buzzfeed** 23677 - ✅ 23678 - ✅ 23679 - ❌ 23680 - ❌ 23681 23682 23683 .. list-table:: **test-macosx1470-64/opt** 23684 :widths: 30 15 15 15 15 23685 :header-rows: 1 23686 23687 * - **Test Name** 23688 - mozilla-central 23689 - autoland 23690 - mozilla-release 23691 - mozilla-beta 23692 * - **browsertime-tp6-firefox-buzzfeed** 23693 - ❌ 23694 - ❌ 23695 - ❌ 23696 - ❌ 23697 23698 23699 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 23700 :widths: 30 15 15 15 15 23701 :header-rows: 1 23702 23703 * - **Test Name** 23704 - mozilla-central 23705 - autoland 23706 - mozilla-release 23707 - mozilla-beta 23708 * - **browsertime-tp6-firefox-buzzfeed** 23709 - ❌ 23710 - ❌ 23711 - ❌ 23712 - ❌ 23713 23714 23715 .. list-table:: **test-windows11-64-24h2-shippable/opt** 23716 :widths: 30 15 15 15 15 23717 :header-rows: 1 23718 23719 * - **Test Name** 23720 - mozilla-central 23721 - autoland 23722 - mozilla-release 23723 - mozilla-beta 23724 * - **browsertime-tp6-chrome-buzzfeed** 23725 - ❌ 23726 - ❌ 23727 - ❌ 23728 - ❌ 23729 * - **browsertime-tp6-custom-car-buzzfeed** 23730 - ❌ 23731 - ❌ 23732 - ❌ 23733 - ❌ 23734 * - **browsertime-tp6-firefox-buzzfeed** 23735 - ✅ 23736 - ✅ 23737 - ❌ 23738 - ❌ 23739 23740 23741 .. list-table:: **test-windows11-64-24h2/opt** 23742 :widths: 30 15 15 15 15 23743 :header-rows: 1 23744 23745 * - **Test Name** 23746 - mozilla-central 23747 - autoland 23748 - mozilla-release 23749 - mozilla-beta 23750 * - **browsertime-tp6-firefox-buzzfeed** 23751 - ❌ 23752 - ❌ 23753 - ❌ 23754 - ❌ 23755 23756 23757 23758 .. dropdown:: cnn 23759 :class-container: anchor-id-cnn-d 23760 23761 * Command to Run Locally 23762 23763 .. code-block:: 23764 23765 ./mach raptor -t cnn 23766 23767 **Owner**: PerfTest Team 23768 23769 * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__, `largestContentfulPaint <raptor-metrics.html#largest-contentful-paint>`__ 23770 * **alert threshold**: 2.0 23771 * **apps**: firefox, chrome, safari, custom-car 23772 * **benchmark page**: true 23773 * **browser cycles**: 25 23774 * **expected**: pass 23775 * **gecko profile interval**: 1 23776 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#40>`__ 23777 * **lower is better**: true 23778 * **page cycles**: 25 23779 * **page timeout**: 60000 23780 * **playback**: mitmproxy 23781 * **playback pageset manifest**: mitm11-windows-firefox-cnn.manifest 23782 * **playback pageset manifest backup**: mitm8-linux-firefox-cnn.manifest 23783 * **playback version**: 11.0.0 23784 * **secondary url**: `<https://www.cnn.com/weather>`__ 23785 * **support class**: browsertime_pageload.py 23786 * **test url**: `<https://www.cnn.com/2021/03/22/weather/climate-change-warm-waters-lake-michigan/index.html>`__ 23787 * **type**: pageload 23788 * **unit**: ms 23789 * **use live sites**: false 23790 * **Test Task**: 23791 23792 .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** 23793 :widths: 30 15 15 15 15 23794 :header-rows: 1 23795 23796 * - **Test Name** 23797 - mozilla-central 23798 - autoland 23799 - mozilla-release 23800 - mozilla-beta 23801 * - **browsertime-tp6-bytecode-firefox-cnn** 23802 - ❌ 23803 - ❌ 23804 - ❌ 23805 - ❌ 23806 * - **browsertime-tp6-essential-firefox-cnn** 23807 - ❌ 23808 - ❌ 23809 - ❌ 23810 - ❌ 23811 * - **browsertime-tp6-live-sheriffed-firefox-cnn** 23812 - ❌ 23813 - ❌ 23814 - ❌ 23815 - ❌ 23816 23817 23818 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 23819 :widths: 30 15 15 15 15 23820 :header-rows: 1 23821 23822 * - **Test Name** 23823 - mozilla-central 23824 - autoland 23825 - mozilla-release 23826 - mozilla-beta 23827 * - **browsertime-tp6-bytecode-firefox-cnn** 23828 - ❌ 23829 - ❌ 23830 - ❌ 23831 - ❌ 23832 * - **browsertime-tp6-essential-firefox-cnn** 23833 - ❌ 23834 - ❌ 23835 - ❌ 23836 - ❌ 23837 * - **browsertime-tp6-live-sheriffed-firefox-cnn** 23838 - ❌ 23839 - ❌ 23840 - ❌ 23841 - ❌ 23842 23843 23844 .. list-table:: **test-linux1804-64-qr/opt** 23845 :widths: 30 15 15 15 15 23846 :header-rows: 1 23847 23848 * - **Test Name** 23849 - mozilla-central 23850 - autoland 23851 - mozilla-release 23852 - mozilla-beta 23853 * - **browsertime-tp6-bytecode-firefox-cnn** 23854 - ❌ 23855 - ❌ 23856 - ❌ 23857 - ❌ 23858 * - **browsertime-tp6-essential-firefox-cnn** 23859 - ❌ 23860 - ❌ 23861 - ❌ 23862 - ❌ 23863 * - **browsertime-tp6-live-sheriffed-firefox-cnn** 23864 - ❌ 23865 - ❌ 23866 - ❌ 23867 - ❌ 23868 23869 23870 .. list-table:: **test-linux1804-64-shippable-qr/opt** 23871 :widths: 30 15 15 15 15 23872 :header-rows: 1 23873 23874 * - **Test Name** 23875 - mozilla-central 23876 - autoland 23877 - mozilla-release 23878 - mozilla-beta 23879 * - **browsertime-tp6-bytecode-firefox-cnn** 23880 - ✅ 23881 - ✅ 23882 - ❌ 23883 - ❌ 23884 * - **browsertime-tp6-essential-chrome-cnn** 23885 - ❌ 23886 - ❌ 23887 - ❌ 23888 - ❌ 23889 * - **browsertime-tp6-essential-custom-car-cnn** 23890 - ❌ 23891 - ❌ 23892 - ❌ 23893 - ❌ 23894 * - **browsertime-tp6-essential-firefox-cnn** 23895 - ✅ 23896 - ✅ 23897 - ❌ 23898 - ❌ 23899 * - **browsertime-tp6-live-sheriffed-firefox-cnn** 23900 - ❌ 23901 - ❌ 23902 - ❌ 23903 - ❌ 23904 23905 23906 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 23907 :widths: 30 15 15 15 15 23908 :header-rows: 1 23909 23910 * - **Test Name** 23911 - mozilla-central 23912 - autoland 23913 - mozilla-release 23914 - mozilla-beta 23915 * - **browsertime-tp6-bytecode-firefox-cnn** 23916 - ❌ 23917 - ❌ 23918 - ❌ 23919 - ❌ 23920 * - **browsertime-tp6-essential-firefox-cnn** 23921 - ❌ 23922 - ❌ 23923 - ❌ 23924 - ❌ 23925 * - **browsertime-tp6-live-sheriffed-firefox-cnn** 23926 - ❌ 23927 - ❌ 23928 - ❌ 23929 - ❌ 23930 23931 23932 .. list-table:: **test-macosx1470-64-shippable/opt** 23933 :widths: 30 15 15 15 15 23934 :header-rows: 1 23935 23936 * - **Test Name** 23937 - mozilla-central 23938 - autoland 23939 - mozilla-release 23940 - mozilla-beta 23941 * - **browsertime-tp6-bytecode-firefox-cnn** 23942 - ✅ 23943 - ✅ 23944 - ❌ 23945 - ❌ 23946 * - **browsertime-tp6-essential-chrome-cnn** 23947 - ❌ 23948 - ❌ 23949 - ❌ 23950 - ❌ 23951 * - **browsertime-tp6-essential-custom-car-cnn** 23952 - ❌ 23953 - ❌ 23954 - ❌ 23955 - ❌ 23956 * - **browsertime-tp6-essential-firefox-cnn** 23957 - ✅ 23958 - ✅ 23959 - ❌ 23960 - ❌ 23961 * - **browsertime-tp6-live-sheriffed-firefox-cnn** 23962 - ❌ 23963 - ❌ 23964 - ❌ 23965 - ❌ 23966 23967 23968 .. list-table:: **test-macosx1470-64/opt** 23969 :widths: 30 15 15 15 15 23970 :header-rows: 1 23971 23972 * - **Test Name** 23973 - mozilla-central 23974 - autoland 23975 - mozilla-release 23976 - mozilla-beta 23977 * - **browsertime-tp6-bytecode-firefox-cnn** 23978 - ❌ 23979 - ❌ 23980 - ❌ 23981 - ❌ 23982 * - **browsertime-tp6-essential-firefox-cnn** 23983 - ❌ 23984 - ❌ 23985 - ❌ 23986 - ❌ 23987 * - **browsertime-tp6-live-sheriffed-firefox-cnn** 23988 - ❌ 23989 - ❌ 23990 - ❌ 23991 - ❌ 23992 23993 23994 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 23995 :widths: 30 15 15 15 15 23996 :header-rows: 1 23997 23998 * - **Test Name** 23999 - mozilla-central 24000 - autoland 24001 - mozilla-release 24002 - mozilla-beta 24003 * - **browsertime-tp6-bytecode-firefox-cnn** 24004 - ❌ 24005 - ❌ 24006 - ❌ 24007 - ❌ 24008 * - **browsertime-tp6-essential-firefox-cnn** 24009 - ❌ 24010 - ❌ 24011 - ❌ 24012 - ❌ 24013 * - **browsertime-tp6-live-sheriffed-firefox-cnn** 24014 - ❌ 24015 - ❌ 24016 - ❌ 24017 - ❌ 24018 24019 24020 .. list-table:: **test-windows11-64-24h2-shippable/opt** 24021 :widths: 30 15 15 15 15 24022 :header-rows: 1 24023 24024 * - **Test Name** 24025 - mozilla-central 24026 - autoland 24027 - mozilla-release 24028 - mozilla-beta 24029 * - **browsertime-tp6-bytecode-firefox-cnn** 24030 - ✅ 24031 - ✅ 24032 - ❌ 24033 - ❌ 24034 * - **browsertime-tp6-essential-chrome-cnn** 24035 - ❌ 24036 - ❌ 24037 - ❌ 24038 - ❌ 24039 * - **browsertime-tp6-essential-custom-car-cnn** 24040 - ❌ 24041 - ❌ 24042 - ❌ 24043 - ❌ 24044 * - **browsertime-tp6-essential-firefox-cnn** 24045 - ✅ 24046 - ✅ 24047 - ❌ 24048 - ❌ 24049 * - **browsertime-tp6-live-sheriffed-firefox-cnn** 24050 - ❌ 24051 - ❌ 24052 - ❌ 24053 - ❌ 24054 24055 24056 .. list-table:: **test-windows11-64-24h2/opt** 24057 :widths: 30 15 15 15 15 24058 :header-rows: 1 24059 24060 * - **Test Name** 24061 - mozilla-central 24062 - autoland 24063 - mozilla-release 24064 - mozilla-beta 24065 * - **browsertime-tp6-bytecode-firefox-cnn** 24066 - ❌ 24067 - ❌ 24068 - ❌ 24069 - ❌ 24070 * - **browsertime-tp6-essential-firefox-cnn** 24071 - ❌ 24072 - ❌ 24073 - ❌ 24074 - ❌ 24075 * - **browsertime-tp6-live-sheriffed-firefox-cnn** 24076 - ❌ 24077 - ❌ 24078 - ❌ 24079 - ❌ 24080 24081 24082 24083 .. dropdown:: docomo 24084 :class-container: anchor-id-docomo-d 24085 24086 * Command to Run Locally 24087 24088 .. code-block:: 24089 24090 ./mach raptor -t docomo 24091 24092 **Owner**: PerfTest Team 24093 24094 * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__, `largestContentfulPaint <raptor-metrics.html#largest-contentful-paint>`__ 24095 * **alert threshold**: 2.0 24096 * **apps**: firefox, chrome 24097 * **benchmark page**: false 24098 * **browser cycles**: 25 24099 * **expected**: pass 24100 * **gecko profile interval**: 1 24101 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp7/desktop/browsertime-tp7.toml#23>`__ 24102 * **lower is better**: true 24103 * **page cycles**: 25 24104 * **page timeout**: 60000 24105 * **playback**: mitmproxy 24106 * **playback pageset manifest**: mitm8-linux-firefox-docomo.manifest 24107 * **playback version**: 11.0.0 24108 * **secondary url**: `<https://www.docomo.ne.jp/iphone/?icid=CRP_menu_to_CRP_IPH>`__ 24109 * **support class**: browsertime_pageload.py 24110 * **test url**: `<https://www.docomo.ne.jp/>`__ 24111 * **type**: pageload 24112 * **unit**: ms 24113 * **use live sites**: false 24114 * **Test Task**: 24115 24116 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 24117 :widths: 30 15 15 15 15 24118 :header-rows: 1 24119 24120 * - **Test Name** 24121 - mozilla-central 24122 - autoland 24123 - mozilla-release 24124 - mozilla-beta 24125 * - **browsertime-tp7-firefox-docomo** 24126 - ❌ 24127 - ❌ 24128 - ❌ 24129 - ❌ 24130 24131 24132 .. list-table:: **test-linux1804-64-qr/opt** 24133 :widths: 30 15 15 15 15 24134 :header-rows: 1 24135 24136 * - **Test Name** 24137 - mozilla-central 24138 - autoland 24139 - mozilla-release 24140 - mozilla-beta 24141 * - **browsertime-tp7-firefox-docomo** 24142 - ❌ 24143 - ❌ 24144 - ❌ 24145 - ❌ 24146 24147 24148 .. list-table:: **test-linux1804-64-shippable-qr/opt** 24149 :widths: 30 15 15 15 15 24150 :header-rows: 1 24151 24152 * - **Test Name** 24153 - mozilla-central 24154 - autoland 24155 - mozilla-release 24156 - mozilla-beta 24157 * - **browsertime-tp7-chrome-docomo** 24158 - ❌ 24159 - ❌ 24160 - ❌ 24161 - ❌ 24162 * - **browsertime-tp7-firefox-docomo** 24163 - ❌ 24164 - ❌ 24165 - ❌ 24166 - ❌ 24167 24168 24169 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 24170 :widths: 30 15 15 15 15 24171 :header-rows: 1 24172 24173 * - **Test Name** 24174 - mozilla-central 24175 - autoland 24176 - mozilla-release 24177 - mozilla-beta 24178 * - **browsertime-tp7-firefox-docomo** 24179 - ❌ 24180 - ❌ 24181 - ❌ 24182 - ❌ 24183 24184 24185 .. list-table:: **test-macosx1470-64-shippable/opt** 24186 :widths: 30 15 15 15 15 24187 :header-rows: 1 24188 24189 * - **Test Name** 24190 - mozilla-central 24191 - autoland 24192 - mozilla-release 24193 - mozilla-beta 24194 * - **browsertime-tp7-chrome-docomo** 24195 - ❌ 24196 - ❌ 24197 - ❌ 24198 - ❌ 24199 * - **browsertime-tp7-firefox-docomo** 24200 - ❌ 24201 - ❌ 24202 - ❌ 24203 - ❌ 24204 24205 24206 .. list-table:: **test-macosx1470-64/opt** 24207 :widths: 30 15 15 15 15 24208 :header-rows: 1 24209 24210 * - **Test Name** 24211 - mozilla-central 24212 - autoland 24213 - mozilla-release 24214 - mozilla-beta 24215 * - **browsertime-tp7-firefox-docomo** 24216 - ❌ 24217 - ❌ 24218 - ❌ 24219 - ❌ 24220 24221 24222 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 24223 :widths: 30 15 15 15 15 24224 :header-rows: 1 24225 24226 * - **Test Name** 24227 - mozilla-central 24228 - autoland 24229 - mozilla-release 24230 - mozilla-beta 24231 * - **browsertime-tp7-firefox-docomo** 24232 - ❌ 24233 - ❌ 24234 - ❌ 24235 - ❌ 24236 24237 24238 .. list-table:: **test-windows11-64-24h2-shippable/opt** 24239 :widths: 30 15 15 15 15 24240 :header-rows: 1 24241 24242 * - **Test Name** 24243 - mozilla-central 24244 - autoland 24245 - mozilla-release 24246 - mozilla-beta 24247 * - **browsertime-tp7-chrome-docomo** 24248 - ❌ 24249 - ❌ 24250 - ❌ 24251 - ❌ 24252 * - **browsertime-tp7-firefox-docomo** 24253 - ❌ 24254 - ❌ 24255 - ❌ 24256 - ❌ 24257 24258 24259 .. list-table:: **test-windows11-64-24h2/opt** 24260 :widths: 30 15 15 15 15 24261 :header-rows: 1 24262 24263 * - **Test Name** 24264 - mozilla-central 24265 - autoland 24266 - mozilla-release 24267 - mozilla-beta 24268 * - **browsertime-tp7-firefox-docomo** 24269 - ❌ 24270 - ❌ 24271 - ❌ 24272 - ❌ 24273 24274 24275 24276 .. dropdown:: ebay 24277 :class-container: anchor-id-ebay-d 24278 24279 * Command to Run Locally 24280 24281 .. code-block:: 24282 24283 ./mach raptor -t ebay 24284 24285 **Owner**: PerfTest Team 24286 24287 * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__, `largestContentfulPaint <raptor-metrics.html#largest-contentful-paint>`__ 24288 * **alert threshold**: 2.0 24289 * **apps**: firefox, chrome, safari, custom-car 24290 * **benchmark page**: true 24291 * **browser cycles**: 25 24292 * **expected**: pass 24293 * **gecko profile interval**: 1 24294 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#46>`__ 24295 * **lower is better**: true 24296 * **page cycles**: 25 24297 * **page timeout**: 60000 24298 * **playback**: mitmproxy 24299 * **playback pageset manifest**: mitm11-windows-firefox-ebay.manifest 24300 * **playback pageset manifest backup**: mitm8-linux-firefox-ebay.manifest 24301 * **playback version**: 11.0.0 24302 * **secondary url**: `<https://www.ebay.com/deals>`__ 24303 * **support class**: browsertime_pageload.py 24304 * **test url**: `<https://www.ebay.com/>`__ 24305 * **type**: pageload 24306 * **unit**: ms 24307 * **use live sites**: false 24308 * **Test Task**: 24309 24310 .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** 24311 :widths: 30 15 15 15 15 24312 :header-rows: 1 24313 24314 * - **Test Name** 24315 - mozilla-central 24316 - autoland 24317 - mozilla-release 24318 - mozilla-beta 24319 * - **browsertime-tp6-firefox-ebay** 24320 - ❌ 24321 - ❌ 24322 - ❌ 24323 - ❌ 24324 * - **browsertime-tp6-live-firefox-ebay** 24325 - ❌ 24326 - ❌ 24327 - ❌ 24328 - ❌ 24329 24330 24331 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 24332 :widths: 30 15 15 15 15 24333 :header-rows: 1 24334 24335 * - **Test Name** 24336 - mozilla-central 24337 - autoland 24338 - mozilla-release 24339 - mozilla-beta 24340 * - **browsertime-tp6-firefox-ebay** 24341 - ❌ 24342 - ❌ 24343 - ❌ 24344 - ❌ 24345 * - **browsertime-tp6-live-firefox-ebay** 24346 - ❌ 24347 - ❌ 24348 - ❌ 24349 - ❌ 24350 24351 24352 .. list-table:: **test-linux1804-64-qr/opt** 24353 :widths: 30 15 15 15 15 24354 :header-rows: 1 24355 24356 * - **Test Name** 24357 - mozilla-central 24358 - autoland 24359 - mozilla-release 24360 - mozilla-beta 24361 * - **browsertime-tp6-firefox-ebay** 24362 - ❌ 24363 - ❌ 24364 - ❌ 24365 - ❌ 24366 * - **browsertime-tp6-live-firefox-ebay** 24367 - ❌ 24368 - ❌ 24369 - ❌ 24370 - ❌ 24371 24372 24373 .. list-table:: **test-linux1804-64-shippable-qr/opt** 24374 :widths: 30 15 15 15 15 24375 :header-rows: 1 24376 24377 * - **Test Name** 24378 - mozilla-central 24379 - autoland 24380 - mozilla-release 24381 - mozilla-beta 24382 * - **browsertime-tp6-chrome-ebay** 24383 - ❌ 24384 - ❌ 24385 - ❌ 24386 - ❌ 24387 * - **browsertime-tp6-custom-car-ebay** 24388 - ❌ 24389 - ❌ 24390 - ❌ 24391 - ❌ 24392 * - **browsertime-tp6-firefox-ebay** 24393 - ✅ 24394 - ✅ 24395 - ❌ 24396 - ❌ 24397 * - **browsertime-tp6-live-chrome-ebay** 24398 - ❌ 24399 - ❌ 24400 - ❌ 24401 - ❌ 24402 * - **browsertime-tp6-live-firefox-ebay** 24403 - ❌ 24404 - ❌ 24405 - ❌ 24406 - ❌ 24407 24408 24409 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 24410 :widths: 30 15 15 15 15 24411 :header-rows: 1 24412 24413 * - **Test Name** 24414 - mozilla-central 24415 - autoland 24416 - mozilla-release 24417 - mozilla-beta 24418 * - **browsertime-tp6-firefox-ebay** 24419 - ❌ 24420 - ❌ 24421 - ❌ 24422 - ❌ 24423 * - **browsertime-tp6-live-firefox-ebay** 24424 - ❌ 24425 - ❌ 24426 - ❌ 24427 - ❌ 24428 24429 24430 .. list-table:: **test-macosx1470-64-shippable/opt** 24431 :widths: 30 15 15 15 15 24432 :header-rows: 1 24433 24434 * - **Test Name** 24435 - mozilla-central 24436 - autoland 24437 - mozilla-release 24438 - mozilla-beta 24439 * - **browsertime-tp6-chrome-ebay** 24440 - ❌ 24441 - ❌ 24442 - ❌ 24443 - ❌ 24444 * - **browsertime-tp6-custom-car-ebay** 24445 - ❌ 24446 - ❌ 24447 - ❌ 24448 - ❌ 24449 * - **browsertime-tp6-firefox-ebay** 24450 - ✅ 24451 - ✅ 24452 - ❌ 24453 - ❌ 24454 * - **browsertime-tp6-live-chrome-ebay** 24455 - ❌ 24456 - ❌ 24457 - ❌ 24458 - ❌ 24459 * - **browsertime-tp6-live-firefox-ebay** 24460 - ❌ 24461 - ❌ 24462 - ❌ 24463 - ❌ 24464 * - **browsertime-tp6-live-safari-ebay** 24465 - ❌ 24466 - ❌ 24467 - ❌ 24468 - ❌ 24469 24470 24471 .. list-table:: **test-macosx1470-64/opt** 24472 :widths: 30 15 15 15 15 24473 :header-rows: 1 24474 24475 * - **Test Name** 24476 - mozilla-central 24477 - autoland 24478 - mozilla-release 24479 - mozilla-beta 24480 * - **browsertime-tp6-firefox-ebay** 24481 - ❌ 24482 - ❌ 24483 - ❌ 24484 - ❌ 24485 * - **browsertime-tp6-live-firefox-ebay** 24486 - ❌ 24487 - ❌ 24488 - ❌ 24489 - ❌ 24490 24491 24492 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 24493 :widths: 30 15 15 15 15 24494 :header-rows: 1 24495 24496 * - **Test Name** 24497 - mozilla-central 24498 - autoland 24499 - mozilla-release 24500 - mozilla-beta 24501 * - **browsertime-tp6-firefox-ebay** 24502 - ❌ 24503 - ❌ 24504 - ❌ 24505 - ❌ 24506 * - **browsertime-tp6-live-firefox-ebay** 24507 - ❌ 24508 - ❌ 24509 - ❌ 24510 - ❌ 24511 24512 24513 .. list-table:: **test-windows11-64-24h2-shippable/opt** 24514 :widths: 30 15 15 15 15 24515 :header-rows: 1 24516 24517 * - **Test Name** 24518 - mozilla-central 24519 - autoland 24520 - mozilla-release 24521 - mozilla-beta 24522 * - **browsertime-tp6-chrome-ebay** 24523 - ❌ 24524 - ❌ 24525 - ❌ 24526 - ❌ 24527 * - **browsertime-tp6-custom-car-ebay** 24528 - ❌ 24529 - ❌ 24530 - ❌ 24531 - ❌ 24532 * - **browsertime-tp6-firefox-ebay** 24533 - ✅ 24534 - ✅ 24535 - ❌ 24536 - ❌ 24537 * - **browsertime-tp6-live-chrome-ebay** 24538 - ❌ 24539 - ❌ 24540 - ❌ 24541 - ❌ 24542 * - **browsertime-tp6-live-firefox-ebay** 24543 - ❌ 24544 - ❌ 24545 - ❌ 24546 - ❌ 24547 24548 24549 .. list-table:: **test-windows11-64-24h2/opt** 24550 :widths: 30 15 15 15 15 24551 :header-rows: 1 24552 24553 * - **Test Name** 24554 - mozilla-central 24555 - autoland 24556 - mozilla-release 24557 - mozilla-beta 24558 * - **browsertime-tp6-firefox-ebay** 24559 - ❌ 24560 - ❌ 24561 - ❌ 24562 - ❌ 24563 * - **browsertime-tp6-live-firefox-ebay** 24564 - ❌ 24565 - ❌ 24566 - ❌ 24567 - ❌ 24568 24569 24570 24571 .. dropdown:: espn 24572 :class-container: anchor-id-espn-d 24573 24574 * Command to Run Locally 24575 24576 .. code-block:: 24577 24578 ./mach raptor -t espn 24579 24580 **Owner**: PerfTest Team 24581 24582 * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__, `largestContentfulPaint <raptor-metrics.html#largest-contentful-paint>`__ 24583 * **alert threshold**: 2.0 24584 * **apps**: firefox, chrome, safari, custom-car 24585 * **benchmark page**: false 24586 * **browser cycles**: 25 24587 * **expected**: pass 24588 * **gecko profile interval**: 1 24589 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#52>`__ 24590 * **lower is better**: true 24591 * **page cycles**: 25 24592 * **page timeout**: 60000 24593 * **playback**: mitmproxy 24594 * **playback pageset manifest**: mitm11-windows-firefox-espn.manifest 24595 * **playback pageset manifest backup**: mitm8-linux-firefox-espn.manifest 24596 * **playback version**: 11.0.0 24597 * **secondary url**: `<https://www.espn.com/nba/draft/news>`__ 24598 * **support class**: browsertime_pageload.py 24599 * **test url**: `<https://www.espn.com/nba/story/_/page/allstarweekend25788027/the-comparison-lebron-james-michael-jordan-their-own-words>`__ 24600 * **type**: pageload 24601 * **unit**: ms 24602 * **use live sites**: false 24603 * **Test Task**: 24604 24605 .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** 24606 :widths: 30 15 15 15 15 24607 :header-rows: 1 24608 24609 * - **Test Name** 24610 - mozilla-central 24611 - autoland 24612 - mozilla-release 24613 - mozilla-beta 24614 * - **browsertime-tp6-firefox-espn** 24615 - ❌ 24616 - ❌ 24617 - ❌ 24618 - ❌ 24619 24620 24621 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 24622 :widths: 30 15 15 15 15 24623 :header-rows: 1 24624 24625 * - **Test Name** 24626 - mozilla-central 24627 - autoland 24628 - mozilla-release 24629 - mozilla-beta 24630 * - **browsertime-tp6-firefox-espn** 24631 - ❌ 24632 - ❌ 24633 - ❌ 24634 - ❌ 24635 24636 24637 .. list-table:: **test-linux1804-64-qr/opt** 24638 :widths: 30 15 15 15 15 24639 :header-rows: 1 24640 24641 * - **Test Name** 24642 - mozilla-central 24643 - autoland 24644 - mozilla-release 24645 - mozilla-beta 24646 * - **browsertime-tp6-firefox-espn** 24647 - ❌ 24648 - ❌ 24649 - ❌ 24650 - ❌ 24651 24652 24653 .. list-table:: **test-linux1804-64-shippable-qr/opt** 24654 :widths: 30 15 15 15 15 24655 :header-rows: 1 24656 24657 * - **Test Name** 24658 - mozilla-central 24659 - autoland 24660 - mozilla-release 24661 - mozilla-beta 24662 * - **browsertime-tp6-chrome-espn** 24663 - ❌ 24664 - ❌ 24665 - ❌ 24666 - ❌ 24667 * - **browsertime-tp6-custom-car-espn** 24668 - ❌ 24669 - ❌ 24670 - ❌ 24671 - ❌ 24672 * - **browsertime-tp6-firefox-espn** 24673 - ✅ 24674 - ✅ 24675 - ❌ 24676 - ❌ 24677 24678 24679 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 24680 :widths: 30 15 15 15 15 24681 :header-rows: 1 24682 24683 * - **Test Name** 24684 - mozilla-central 24685 - autoland 24686 - mozilla-release 24687 - mozilla-beta 24688 * - **browsertime-tp6-firefox-espn** 24689 - ❌ 24690 - ❌ 24691 - ❌ 24692 - ❌ 24693 24694 24695 .. list-table:: **test-macosx1470-64-shippable/opt** 24696 :widths: 30 15 15 15 15 24697 :header-rows: 1 24698 24699 * - **Test Name** 24700 - mozilla-central 24701 - autoland 24702 - mozilla-release 24703 - mozilla-beta 24704 * - **browsertime-tp6-chrome-espn** 24705 - ❌ 24706 - ❌ 24707 - ❌ 24708 - ❌ 24709 * - **browsertime-tp6-custom-car-espn** 24710 - ❌ 24711 - ❌ 24712 - ❌ 24713 - ❌ 24714 * - **browsertime-tp6-firefox-espn** 24715 - ✅ 24716 - ✅ 24717 - ❌ 24718 - ❌ 24719 24720 24721 .. list-table:: **test-macosx1470-64/opt** 24722 :widths: 30 15 15 15 15 24723 :header-rows: 1 24724 24725 * - **Test Name** 24726 - mozilla-central 24727 - autoland 24728 - mozilla-release 24729 - mozilla-beta 24730 * - **browsertime-tp6-firefox-espn** 24731 - ❌ 24732 - ❌ 24733 - ❌ 24734 - ❌ 24735 24736 24737 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 24738 :widths: 30 15 15 15 15 24739 :header-rows: 1 24740 24741 * - **Test Name** 24742 - mozilla-central 24743 - autoland 24744 - mozilla-release 24745 - mozilla-beta 24746 * - **browsertime-tp6-firefox-espn** 24747 - ❌ 24748 - ❌ 24749 - ❌ 24750 - ❌ 24751 24752 24753 .. list-table:: **test-windows11-64-24h2-shippable/opt** 24754 :widths: 30 15 15 15 15 24755 :header-rows: 1 24756 24757 * - **Test Name** 24758 - mozilla-central 24759 - autoland 24760 - mozilla-release 24761 - mozilla-beta 24762 * - **browsertime-tp6-chrome-espn** 24763 - ❌ 24764 - ❌ 24765 - ❌ 24766 - ❌ 24767 * - **browsertime-tp6-custom-car-espn** 24768 - ❌ 24769 - ❌ 24770 - ❌ 24771 - ❌ 24772 * - **browsertime-tp6-firefox-espn** 24773 - ✅ 24774 - ✅ 24775 - ❌ 24776 - ❌ 24777 24778 24779 .. list-table:: **test-windows11-64-24h2/opt** 24780 :widths: 30 15 15 15 15 24781 :header-rows: 1 24782 24783 * - **Test Name** 24784 - mozilla-central 24785 - autoland 24786 - mozilla-release 24787 - mozilla-beta 24788 * - **browsertime-tp6-firefox-espn** 24789 - ❌ 24790 - ❌ 24791 - ❌ 24792 - ❌ 24793 24794 24795 24796 .. dropdown:: expedia 24797 :class-container: anchor-id-expedia-d 24798 24799 * Command to Run Locally 24800 24801 .. code-block:: 24802 24803 ./mach raptor -t expedia 24804 24805 **Owner**: PerfTest Team 24806 24807 * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__, `largestContentfulPaint <raptor-metrics.html#largest-contentful-paint>`__ 24808 * **alert threshold**: 2.0 24809 * **apps**: firefox, chrome, safari, custom-car 24810 * **benchmark page**: true 24811 * **browser cycles**: 25 24812 * **expected**: pass 24813 * **gecko profile interval**: 1 24814 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#59>`__ 24815 * **lower is better**: true 24816 * **page cycles**: 25 24817 * **page timeout**: 60000 24818 * **playback**: mitmproxy 24819 * **playback pageset manifest**: mitm8-darwin-firefox-expedia.manifest 24820 * **playback version**: 11.0.0 24821 * **secondary url**: `<https://groups.expedia.com/Group-Rate/?locale=en_US&ol=1>`__ 24822 * **support class**: browsertime_pageload.py 24823 * **test url**: `<https://expedia.com/Hotel-Search?destination=New+York%2C+New+York&latLong=40.756680%2C-73.986470®ionId=178293&startDate=&endDate=&rooms=1&_xpid=11905%7C1&adults=2>`__ 24824 * **type**: pageload 24825 * **unit**: ms 24826 * **use live sites**: false 24827 * **Test Task**: 24828 24829 .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** 24830 :widths: 30 15 15 15 15 24831 :header-rows: 1 24832 24833 * - **Test Name** 24834 - mozilla-central 24835 - autoland 24836 - mozilla-release 24837 - mozilla-beta 24838 * - **browsertime-tp6-firefox-expedia** 24839 - ❌ 24840 - ❌ 24841 - ❌ 24842 - ❌ 24843 24844 24845 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 24846 :widths: 30 15 15 15 15 24847 :header-rows: 1 24848 24849 * - **Test Name** 24850 - mozilla-central 24851 - autoland 24852 - mozilla-release 24853 - mozilla-beta 24854 * - **browsertime-tp6-firefox-expedia** 24855 - ❌ 24856 - ❌ 24857 - ❌ 24858 - ❌ 24859 24860 24861 .. list-table:: **test-linux1804-64-qr/opt** 24862 :widths: 30 15 15 15 15 24863 :header-rows: 1 24864 24865 * - **Test Name** 24866 - mozilla-central 24867 - autoland 24868 - mozilla-release 24869 - mozilla-beta 24870 * - **browsertime-tp6-firefox-expedia** 24871 - ❌ 24872 - ❌ 24873 - ❌ 24874 - ❌ 24875 24876 24877 .. list-table:: **test-linux1804-64-shippable-qr/opt** 24878 :widths: 30 15 15 15 15 24879 :header-rows: 1 24880 24881 * - **Test Name** 24882 - mozilla-central 24883 - autoland 24884 - mozilla-release 24885 - mozilla-beta 24886 * - **browsertime-tp6-chrome-expedia** 24887 - ❌ 24888 - ❌ 24889 - ❌ 24890 - ❌ 24891 * - **browsertime-tp6-custom-car-expedia** 24892 - ❌ 24893 - ❌ 24894 - ❌ 24895 - ❌ 24896 * - **browsertime-tp6-firefox-expedia** 24897 - ✅ 24898 - ✅ 24899 - ❌ 24900 - ❌ 24901 24902 24903 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 24904 :widths: 30 15 15 15 15 24905 :header-rows: 1 24906 24907 * - **Test Name** 24908 - mozilla-central 24909 - autoland 24910 - mozilla-release 24911 - mozilla-beta 24912 * - **browsertime-tp6-firefox-expedia** 24913 - ❌ 24914 - ❌ 24915 - ❌ 24916 - ❌ 24917 24918 24919 .. list-table:: **test-macosx1470-64-shippable/opt** 24920 :widths: 30 15 15 15 15 24921 :header-rows: 1 24922 24923 * - **Test Name** 24924 - mozilla-central 24925 - autoland 24926 - mozilla-release 24927 - mozilla-beta 24928 * - **browsertime-tp6-chrome-expedia** 24929 - ❌ 24930 - ❌ 24931 - ❌ 24932 - ❌ 24933 * - **browsertime-tp6-custom-car-expedia** 24934 - ❌ 24935 - ❌ 24936 - ❌ 24937 - ❌ 24938 * - **browsertime-tp6-firefox-expedia** 24939 - ✅ 24940 - ✅ 24941 - ❌ 24942 - ❌ 24943 24944 24945 .. list-table:: **test-macosx1470-64/opt** 24946 :widths: 30 15 15 15 15 24947 :header-rows: 1 24948 24949 * - **Test Name** 24950 - mozilla-central 24951 - autoland 24952 - mozilla-release 24953 - mozilla-beta 24954 * - **browsertime-tp6-firefox-expedia** 24955 - ❌ 24956 - ❌ 24957 - ❌ 24958 - ❌ 24959 24960 24961 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 24962 :widths: 30 15 15 15 15 24963 :header-rows: 1 24964 24965 * - **Test Name** 24966 - mozilla-central 24967 - autoland 24968 - mozilla-release 24969 - mozilla-beta 24970 * - **browsertime-tp6-firefox-expedia** 24971 - ❌ 24972 - ❌ 24973 - ❌ 24974 - ❌ 24975 24976 24977 .. list-table:: **test-windows11-64-24h2-shippable/opt** 24978 :widths: 30 15 15 15 15 24979 :header-rows: 1 24980 24981 * - **Test Name** 24982 - mozilla-central 24983 - autoland 24984 - mozilla-release 24985 - mozilla-beta 24986 * - **browsertime-tp6-chrome-expedia** 24987 - ❌ 24988 - ❌ 24989 - ❌ 24990 - ❌ 24991 * - **browsertime-tp6-custom-car-expedia** 24992 - ❌ 24993 - ❌ 24994 - ❌ 24995 - ❌ 24996 * - **browsertime-tp6-firefox-expedia** 24997 - ✅ 24998 - ✅ 24999 - ❌ 25000 - ❌ 25001 25002 25003 .. list-table:: **test-windows11-64-24h2/opt** 25004 :widths: 30 15 15 15 15 25005 :header-rows: 1 25006 25007 * - **Test Name** 25008 - mozilla-central 25009 - autoland 25010 - mozilla-release 25011 - mozilla-beta 25012 * - **browsertime-tp6-firefox-expedia** 25013 - ❌ 25014 - ❌ 25015 - ❌ 25016 - ❌ 25017 25018 25019 25020 .. dropdown:: facebook 25021 :class-container: anchor-id-facebook-d 25022 25023 * Command to Run Locally 25024 25025 .. code-block:: 25026 25027 ./mach raptor -t facebook 25028 25029 **Owner**: PerfTest Team 25030 25031 * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__, `largestContentfulPaint <raptor-metrics.html#largest-contentful-paint>`__ 25032 * **alert threshold**: 2.0 25033 * **apps**: firefox, chrome, safari, custom-car 25034 * **benchmark page**: true 25035 * **browser cycles**: 25 25036 * **expected**: pass 25037 * **gecko profile interval**: 1 25038 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#64>`__ 25039 * **lower is better**: true 25040 * **page cycles**: 25 25041 * **page timeout**: 60000 25042 * **playback**: mitmproxy 25043 * **playback pageset manifest**: mitm11-windows-firefox-facebook.manifest 25044 * **playback pageset manifest backup**: mitm6-linux-firefox-facebook.manifest 25045 * **playback version**: 11.0.0 25046 * **secondary url**: `<https://www.facebook.com/marketplace/?ref=bookmark>`__ 25047 * **support class**: browsertime_pageload.py 25048 * **test url**: `<https://www.facebook.com>`__ 25049 * **type**: pageload 25050 * **unit**: ms 25051 * **use live sites**: false 25052 * **Test Task**: 25053 25054 .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** 25055 :widths: 30 15 15 15 15 25056 :header-rows: 1 25057 25058 * - **Test Name** 25059 - mozilla-central 25060 - autoland 25061 - mozilla-release 25062 - mozilla-beta 25063 * - **browsertime-tp6-firefox-facebook** 25064 - ❌ 25065 - ❌ 25066 - ❌ 25067 - ❌ 25068 * - **browsertime-tp6-live-firefox-facebook** 25069 - ❌ 25070 - ❌ 25071 - ❌ 25072 - ❌ 25073 25074 25075 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 25076 :widths: 30 15 15 15 15 25077 :header-rows: 1 25078 25079 * - **Test Name** 25080 - mozilla-central 25081 - autoland 25082 - mozilla-release 25083 - mozilla-beta 25084 * - **browsertime-tp6-firefox-facebook** 25085 - ❌ 25086 - ❌ 25087 - ❌ 25088 - ❌ 25089 * - **browsertime-tp6-live-firefox-facebook** 25090 - ❌ 25091 - ❌ 25092 - ❌ 25093 - ❌ 25094 25095 25096 .. list-table:: **test-linux1804-64-qr/opt** 25097 :widths: 30 15 15 15 15 25098 :header-rows: 1 25099 25100 * - **Test Name** 25101 - mozilla-central 25102 - autoland 25103 - mozilla-release 25104 - mozilla-beta 25105 * - **browsertime-tp6-firefox-facebook** 25106 - ❌ 25107 - ❌ 25108 - ❌ 25109 - ❌ 25110 * - **browsertime-tp6-live-firefox-facebook** 25111 - ❌ 25112 - ❌ 25113 - ❌ 25114 - ❌ 25115 25116 25117 .. list-table:: **test-linux1804-64-shippable-qr/opt** 25118 :widths: 30 15 15 15 15 25119 :header-rows: 1 25120 25121 * - **Test Name** 25122 - mozilla-central 25123 - autoland 25124 - mozilla-release 25125 - mozilla-beta 25126 * - **browsertime-tp6-chrome-facebook** 25127 - ❌ 25128 - ❌ 25129 - ❌ 25130 - ❌ 25131 * - **browsertime-tp6-custom-car-facebook** 25132 - ❌ 25133 - ❌ 25134 - ❌ 25135 - ❌ 25136 * - **browsertime-tp6-firefox-facebook** 25137 - ✅ 25138 - ✅ 25139 - ❌ 25140 - ❌ 25141 * - **browsertime-tp6-live-chrome-facebook** 25142 - ❌ 25143 - ❌ 25144 - ❌ 25145 - ❌ 25146 * - **browsertime-tp6-live-firefox-facebook** 25147 - ❌ 25148 - ❌ 25149 - ❌ 25150 - ❌ 25151 25152 25153 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 25154 :widths: 30 15 15 15 15 25155 :header-rows: 1 25156 25157 * - **Test Name** 25158 - mozilla-central 25159 - autoland 25160 - mozilla-release 25161 - mozilla-beta 25162 * - **browsertime-tp6-firefox-facebook** 25163 - ❌ 25164 - ❌ 25165 - ❌ 25166 - ❌ 25167 * - **browsertime-tp6-live-firefox-facebook** 25168 - ❌ 25169 - ❌ 25170 - ❌ 25171 - ❌ 25172 25173 25174 .. list-table:: **test-macosx1470-64-shippable/opt** 25175 :widths: 30 15 15 15 15 25176 :header-rows: 1 25177 25178 * - **Test Name** 25179 - mozilla-central 25180 - autoland 25181 - mozilla-release 25182 - mozilla-beta 25183 * - **browsertime-tp6-chrome-facebook** 25184 - ❌ 25185 - ❌ 25186 - ❌ 25187 - ❌ 25188 * - **browsertime-tp6-custom-car-facebook** 25189 - ❌ 25190 - ❌ 25191 - ❌ 25192 - ❌ 25193 * - **browsertime-tp6-firefox-facebook** 25194 - ✅ 25195 - ✅ 25196 - ❌ 25197 - ❌ 25198 * - **browsertime-tp6-live-chrome-facebook** 25199 - ❌ 25200 - ❌ 25201 - ❌ 25202 - ❌ 25203 * - **browsertime-tp6-live-firefox-facebook** 25204 - ❌ 25205 - ❌ 25206 - ❌ 25207 - ❌ 25208 25209 25210 .. list-table:: **test-macosx1470-64/opt** 25211 :widths: 30 15 15 15 15 25212 :header-rows: 1 25213 25214 * - **Test Name** 25215 - mozilla-central 25216 - autoland 25217 - mozilla-release 25218 - mozilla-beta 25219 * - **browsertime-tp6-firefox-facebook** 25220 - ❌ 25221 - ❌ 25222 - ❌ 25223 - ❌ 25224 * - **browsertime-tp6-live-firefox-facebook** 25225 - ❌ 25226 - ❌ 25227 - ❌ 25228 - ❌ 25229 25230 25231 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 25232 :widths: 30 15 15 15 15 25233 :header-rows: 1 25234 25235 * - **Test Name** 25236 - mozilla-central 25237 - autoland 25238 - mozilla-release 25239 - mozilla-beta 25240 * - **browsertime-tp6-firefox-facebook** 25241 - ❌ 25242 - ❌ 25243 - ❌ 25244 - ❌ 25245 * - **browsertime-tp6-live-firefox-facebook** 25246 - ❌ 25247 - ❌ 25248 - ❌ 25249 - ❌ 25250 25251 25252 .. list-table:: **test-windows11-64-24h2-shippable/opt** 25253 :widths: 30 15 15 15 15 25254 :header-rows: 1 25255 25256 * - **Test Name** 25257 - mozilla-central 25258 - autoland 25259 - mozilla-release 25260 - mozilla-beta 25261 * - **browsertime-tp6-chrome-facebook** 25262 - ❌ 25263 - ❌ 25264 - ❌ 25265 - ❌ 25266 * - **browsertime-tp6-custom-car-facebook** 25267 - ❌ 25268 - ❌ 25269 - ❌ 25270 - ❌ 25271 * - **browsertime-tp6-firefox-facebook** 25272 - ✅ 25273 - ✅ 25274 - ❌ 25275 - ❌ 25276 * - **browsertime-tp6-live-chrome-facebook** 25277 - ❌ 25278 - ❌ 25279 - ❌ 25280 - ❌ 25281 * - **browsertime-tp6-live-firefox-facebook** 25282 - ❌ 25283 - ❌ 25284 - ❌ 25285 - ❌ 25286 25287 25288 .. list-table:: **test-windows11-64-24h2/opt** 25289 :widths: 30 15 15 15 15 25290 :header-rows: 1 25291 25292 * - **Test Name** 25293 - mozilla-central 25294 - autoland 25295 - mozilla-release 25296 - mozilla-beta 25297 * - **browsertime-tp6-firefox-facebook** 25298 - ❌ 25299 - ❌ 25300 - ❌ 25301 - ❌ 25302 * - **browsertime-tp6-live-firefox-facebook** 25303 - ❌ 25304 - ❌ 25305 - ❌ 25306 - ❌ 25307 25308 25309 25310 .. dropdown:: fandom 25311 :class-container: anchor-id-fandom-d 25312 25313 * Command to Run Locally 25314 25315 .. code-block:: 25316 25317 ./mach raptor -t fandom 25318 25319 **Owner**: PerfTest Team 25320 25321 * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__, `largestContentfulPaint <raptor-metrics.html#largest-contentful-paint>`__ 25322 * **alert threshold**: 2.0 25323 * **apps**: firefox, chrome, safari, custom-car 25324 * **benchmark page**: false 25325 * **browser cycles**: 25 25326 * **expected**: pass 25327 * **gecko profile interval**: 1 25328 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#71>`__ 25329 * **lower is better**: true 25330 * **page cycles**: 25 25331 * **page timeout**: 60000 25332 * **playback**: mitmproxy 25333 * **playback pageset manifest**: mitm11-windows-firefox-fandom.manifest 25334 * **playback pageset manifest backup**: mitm5-linux-firefox-fandom.manifest 25335 * **playback version**: 11.0.0 25336 * **support class**: browsertime_pageload.py 25337 * **test url**: `<https://www.fandom.com/articles/fallout-76-will-live-and-die-on-the-creativity-of-its-playerbase>`__ 25338 * **type**: pageload 25339 * **unit**: ms 25340 * **use live sites**: false 25341 * **Test Task**: 25342 25343 .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** 25344 :widths: 30 15 15 15 15 25345 :header-rows: 1 25346 25347 * - **Test Name** 25348 - mozilla-central 25349 - autoland 25350 - mozilla-release 25351 - mozilla-beta 25352 * - **browsertime-tp6-bytecode-firefox-fandom** 25353 - ❌ 25354 - ❌ 25355 - ❌ 25356 - ❌ 25357 * - **browsertime-tp6-essential-firefox-fandom** 25358 - ❌ 25359 - ❌ 25360 - ❌ 25361 - ❌ 25362 * - **browsertime-tp6-live-firefox-fandom** 25363 - ❌ 25364 - ❌ 25365 - ❌ 25366 - ❌ 25367 25368 25369 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 25370 :widths: 30 15 15 15 15 25371 :header-rows: 1 25372 25373 * - **Test Name** 25374 - mozilla-central 25375 - autoland 25376 - mozilla-release 25377 - mozilla-beta 25378 * - **browsertime-tp6-bytecode-firefox-fandom** 25379 - ❌ 25380 - ❌ 25381 - ❌ 25382 - ❌ 25383 * - **browsertime-tp6-essential-firefox-fandom** 25384 - ❌ 25385 - ❌ 25386 - ❌ 25387 - ❌ 25388 * - **browsertime-tp6-live-firefox-fandom** 25389 - ❌ 25390 - ❌ 25391 - ❌ 25392 - ❌ 25393 25394 25395 .. list-table:: **test-linux1804-64-qr/opt** 25396 :widths: 30 15 15 15 15 25397 :header-rows: 1 25398 25399 * - **Test Name** 25400 - mozilla-central 25401 - autoland 25402 - mozilla-release 25403 - mozilla-beta 25404 * - **browsertime-tp6-bytecode-firefox-fandom** 25405 - ❌ 25406 - ❌ 25407 - ❌ 25408 - ❌ 25409 * - **browsertime-tp6-essential-firefox-fandom** 25410 - ❌ 25411 - ❌ 25412 - ❌ 25413 - ❌ 25414 * - **browsertime-tp6-live-firefox-fandom** 25415 - ❌ 25416 - ❌ 25417 - ❌ 25418 - ❌ 25419 25420 25421 .. list-table:: **test-linux1804-64-shippable-qr/opt** 25422 :widths: 30 15 15 15 15 25423 :header-rows: 1 25424 25425 * - **Test Name** 25426 - mozilla-central 25427 - autoland 25428 - mozilla-release 25429 - mozilla-beta 25430 * - **browsertime-tp6-bytecode-firefox-fandom** 25431 - ✅ 25432 - ✅ 25433 - ❌ 25434 - ❌ 25435 * - **browsertime-tp6-essential-chrome-fandom** 25436 - ❌ 25437 - ❌ 25438 - ❌ 25439 - ❌ 25440 * - **browsertime-tp6-essential-custom-car-fandom** 25441 - ❌ 25442 - ❌ 25443 - ❌ 25444 - ❌ 25445 * - **browsertime-tp6-essential-firefox-fandom** 25446 - ✅ 25447 - ✅ 25448 - ❌ 25449 - ❌ 25450 * - **browsertime-tp6-live-chrome-fandom** 25451 - ❌ 25452 - ❌ 25453 - ❌ 25454 - ❌ 25455 * - **browsertime-tp6-live-firefox-fandom** 25456 - ❌ 25457 - ❌ 25458 - ❌ 25459 - ❌ 25460 25461 25462 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 25463 :widths: 30 15 15 15 15 25464 :header-rows: 1 25465 25466 * - **Test Name** 25467 - mozilla-central 25468 - autoland 25469 - mozilla-release 25470 - mozilla-beta 25471 * - **browsertime-tp6-bytecode-firefox-fandom** 25472 - ❌ 25473 - ❌ 25474 - ❌ 25475 - ❌ 25476 * - **browsertime-tp6-essential-firefox-fandom** 25477 - ❌ 25478 - ❌ 25479 - ❌ 25480 - ❌ 25481 * - **browsertime-tp6-live-firefox-fandom** 25482 - ❌ 25483 - ❌ 25484 - ❌ 25485 - ❌ 25486 25487 25488 .. list-table:: **test-macosx1470-64-shippable/opt** 25489 :widths: 30 15 15 15 15 25490 :header-rows: 1 25491 25492 * - **Test Name** 25493 - mozilla-central 25494 - autoland 25495 - mozilla-release 25496 - mozilla-beta 25497 * - **browsertime-tp6-bytecode-firefox-fandom** 25498 - ✅ 25499 - ✅ 25500 - ❌ 25501 - ❌ 25502 * - **browsertime-tp6-essential-chrome-fandom** 25503 - ❌ 25504 - ❌ 25505 - ❌ 25506 - ❌ 25507 * - **browsertime-tp6-essential-custom-car-fandom** 25508 - ❌ 25509 - ❌ 25510 - ❌ 25511 - ❌ 25512 * - **browsertime-tp6-essential-firefox-fandom** 25513 - ✅ 25514 - ✅ 25515 - ❌ 25516 - ❌ 25517 * - **browsertime-tp6-live-chrome-fandom** 25518 - ❌ 25519 - ❌ 25520 - ❌ 25521 - ❌ 25522 * - **browsertime-tp6-live-firefox-fandom** 25523 - ❌ 25524 - ❌ 25525 - ❌ 25526 - ❌ 25527 * - **browsertime-tp6-live-safari-fandom** 25528 - ❌ 25529 - ❌ 25530 - ❌ 25531 - ❌ 25532 25533 25534 .. list-table:: **test-macosx1470-64/opt** 25535 :widths: 30 15 15 15 15 25536 :header-rows: 1 25537 25538 * - **Test Name** 25539 - mozilla-central 25540 - autoland 25541 - mozilla-release 25542 - mozilla-beta 25543 * - **browsertime-tp6-bytecode-firefox-fandom** 25544 - ❌ 25545 - ❌ 25546 - ❌ 25547 - ❌ 25548 * - **browsertime-tp6-essential-firefox-fandom** 25549 - ❌ 25550 - ❌ 25551 - ❌ 25552 - ❌ 25553 * - **browsertime-tp6-live-firefox-fandom** 25554 - ❌ 25555 - ❌ 25556 - ❌ 25557 - ❌ 25558 25559 25560 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 25561 :widths: 30 15 15 15 15 25562 :header-rows: 1 25563 25564 * - **Test Name** 25565 - mozilla-central 25566 - autoland 25567 - mozilla-release 25568 - mozilla-beta 25569 * - **browsertime-tp6-bytecode-firefox-fandom** 25570 - ❌ 25571 - ❌ 25572 - ❌ 25573 - ❌ 25574 * - **browsertime-tp6-essential-firefox-fandom** 25575 - ❌ 25576 - ❌ 25577 - ❌ 25578 - ❌ 25579 * - **browsertime-tp6-live-firefox-fandom** 25580 - ❌ 25581 - ❌ 25582 - ❌ 25583 - ❌ 25584 25585 25586 .. list-table:: **test-windows11-64-24h2-shippable/opt** 25587 :widths: 30 15 15 15 15 25588 :header-rows: 1 25589 25590 * - **Test Name** 25591 - mozilla-central 25592 - autoland 25593 - mozilla-release 25594 - mozilla-beta 25595 * - **browsertime-tp6-bytecode-firefox-fandom** 25596 - ✅ 25597 - ✅ 25598 - ❌ 25599 - ❌ 25600 * - **browsertime-tp6-essential-chrome-fandom** 25601 - ❌ 25602 - ❌ 25603 - ❌ 25604 - ❌ 25605 * - **browsertime-tp6-essential-custom-car-fandom** 25606 - ❌ 25607 - ❌ 25608 - ❌ 25609 - ❌ 25610 * - **browsertime-tp6-essential-firefox-fandom** 25611 - ✅ 25612 - ✅ 25613 - ❌ 25614 - ❌ 25615 * - **browsertime-tp6-live-chrome-fandom** 25616 - ❌ 25617 - ❌ 25618 - ❌ 25619 - ❌ 25620 * - **browsertime-tp6-live-firefox-fandom** 25621 - ❌ 25622 - ❌ 25623 - ❌ 25624 - ❌ 25625 25626 25627 .. list-table:: **test-windows11-64-24h2/opt** 25628 :widths: 30 15 15 15 15 25629 :header-rows: 1 25630 25631 * - **Test Name** 25632 - mozilla-central 25633 - autoland 25634 - mozilla-release 25635 - mozilla-beta 25636 * - **browsertime-tp6-bytecode-firefox-fandom** 25637 - ❌ 25638 - ❌ 25639 - ❌ 25640 - ❌ 25641 * - **browsertime-tp6-essential-firefox-fandom** 25642 - ❌ 25643 - ❌ 25644 - ❌ 25645 - ❌ 25646 * - **browsertime-tp6-live-firefox-fandom** 25647 - ❌ 25648 - ❌ 25649 - ❌ 25650 - ❌ 25651 25652 25653 25654 .. dropdown:: google-docs 25655 :class-container: anchor-id-google-docs-d 25656 25657 * Command to Run Locally 25658 25659 .. code-block:: 25660 25661 ./mach raptor -t google-docs 25662 25663 **Owner**: PerfTest Team 25664 25665 * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__, `largestContentfulPaint <raptor-metrics.html#largest-contentful-paint>`__ 25666 * **alert threshold**: 2.0 25667 * **apps**: firefox, chrome, safari, custom-car 25668 * **benchmark page**: true 25669 * **browser cycles**: 25 25670 * **expected**: pass 25671 * **gecko profile interval**: 1 25672 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#77>`__ 25673 * **lower is better**: true 25674 * **page complete wait time**: 8000 25675 * **page cycles**: 25 25676 * **page timeout**: 60000 25677 * **playback**: mitmproxy 25678 * **playback pageset manifest**: mitm11-windows-firefox-google-docs.manifest 25679 * **playback pageset manifest backup**: mitm8-linux-firefox-google-docs.manifest 25680 * **playback version**: 11.0.0 25681 * **secondary url**: `<https://docs.google.com/document/d/1vUnn0ePU-ynArE1OdxyEHXR2G0sl74ja_st_4OOzlgE/preview>`__ 25682 * **support class**: browsertime_pageload.py 25683 * **test url**: `<https://docs.google.com/document/d/1US-07msg12slQtI_xchzYxcKlTs6Fp7WqIc6W5GK5M8/edit?usp=sharing>`__ 25684 * **type**: pageload 25685 * **unit**: ms 25686 * **use live sites**: false 25687 * **Test Task**: 25688 25689 .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** 25690 :widths: 30 15 15 15 15 25691 :header-rows: 1 25692 25693 * - **Test Name** 25694 - mozilla-central 25695 - autoland 25696 - mozilla-release 25697 - mozilla-beta 25698 * - **browsertime-tp6-firefox-google-docs** 25699 - ❌ 25700 - ❌ 25701 - ❌ 25702 - ❌ 25703 * - **browsertime-tp6-live-firefox-google-docs** 25704 - ❌ 25705 - ❌ 25706 - ❌ 25707 - ❌ 25708 25709 25710 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 25711 :widths: 30 15 15 15 15 25712 :header-rows: 1 25713 25714 * - **Test Name** 25715 - mozilla-central 25716 - autoland 25717 - mozilla-release 25718 - mozilla-beta 25719 * - **browsertime-tp6-firefox-google-docs** 25720 - ❌ 25721 - ❌ 25722 - ❌ 25723 - ❌ 25724 * - **browsertime-tp6-live-firefox-google-docs** 25725 - ❌ 25726 - ❌ 25727 - ❌ 25728 - ❌ 25729 25730 25731 .. list-table:: **test-linux1804-64-qr/opt** 25732 :widths: 30 15 15 15 15 25733 :header-rows: 1 25734 25735 * - **Test Name** 25736 - mozilla-central 25737 - autoland 25738 - mozilla-release 25739 - mozilla-beta 25740 * - **browsertime-tp6-firefox-google-docs** 25741 - ❌ 25742 - ❌ 25743 - ❌ 25744 - ❌ 25745 * - **browsertime-tp6-live-firefox-google-docs** 25746 - ❌ 25747 - ❌ 25748 - ❌ 25749 - ❌ 25750 25751 25752 .. list-table:: **test-linux1804-64-shippable-qr/opt** 25753 :widths: 30 15 15 15 15 25754 :header-rows: 1 25755 25756 * - **Test Name** 25757 - mozilla-central 25758 - autoland 25759 - mozilla-release 25760 - mozilla-beta 25761 * - **browsertime-tp6-chrome-google-docs** 25762 - ❌ 25763 - ❌ 25764 - ❌ 25765 - ❌ 25766 * - **browsertime-tp6-custom-car-google-docs** 25767 - ❌ 25768 - ❌ 25769 - ❌ 25770 - ❌ 25771 * - **browsertime-tp6-firefox-google-docs** 25772 - ✅ 25773 - ✅ 25774 - ❌ 25775 - ❌ 25776 * - **browsertime-tp6-live-chrome-google-docs** 25777 - ❌ 25778 - ❌ 25779 - ❌ 25780 - ❌ 25781 * - **browsertime-tp6-live-firefox-google-docs** 25782 - ❌ 25783 - ❌ 25784 - ❌ 25785 - ❌ 25786 25787 25788 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 25789 :widths: 30 15 15 15 15 25790 :header-rows: 1 25791 25792 * - **Test Name** 25793 - mozilla-central 25794 - autoland 25795 - mozilla-release 25796 - mozilla-beta 25797 * - **browsertime-tp6-firefox-google-docs** 25798 - ❌ 25799 - ❌ 25800 - ❌ 25801 - ❌ 25802 * - **browsertime-tp6-live-firefox-google-docs** 25803 - ❌ 25804 - ❌ 25805 - ❌ 25806 - ❌ 25807 25808 25809 .. list-table:: **test-macosx1470-64-shippable/opt** 25810 :widths: 30 15 15 15 15 25811 :header-rows: 1 25812 25813 * - **Test Name** 25814 - mozilla-central 25815 - autoland 25816 - mozilla-release 25817 - mozilla-beta 25818 * - **browsertime-tp6-chrome-google-docs** 25819 - ❌ 25820 - ❌ 25821 - ❌ 25822 - ❌ 25823 * - **browsertime-tp6-custom-car-google-docs** 25824 - ❌ 25825 - ❌ 25826 - ❌ 25827 - ❌ 25828 * - **browsertime-tp6-firefox-google-docs** 25829 - ✅ 25830 - ✅ 25831 - ❌ 25832 - ❌ 25833 * - **browsertime-tp6-live-chrome-google-docs** 25834 - ❌ 25835 - ❌ 25836 - ❌ 25837 - ❌ 25838 * - **browsertime-tp6-live-firefox-google-docs** 25839 - ❌ 25840 - ❌ 25841 - ❌ 25842 - ❌ 25843 * - **browsertime-tp6-live-safari-google-docs** 25844 - ❌ 25845 - ❌ 25846 - ❌ 25847 - ❌ 25848 25849 25850 .. list-table:: **test-macosx1470-64/opt** 25851 :widths: 30 15 15 15 15 25852 :header-rows: 1 25853 25854 * - **Test Name** 25855 - mozilla-central 25856 - autoland 25857 - mozilla-release 25858 - mozilla-beta 25859 * - **browsertime-tp6-firefox-google-docs** 25860 - ❌ 25861 - ❌ 25862 - ❌ 25863 - ❌ 25864 * - **browsertime-tp6-live-firefox-google-docs** 25865 - ❌ 25866 - ❌ 25867 - ❌ 25868 - ❌ 25869 25870 25871 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 25872 :widths: 30 15 15 15 15 25873 :header-rows: 1 25874 25875 * - **Test Name** 25876 - mozilla-central 25877 - autoland 25878 - mozilla-release 25879 - mozilla-beta 25880 * - **browsertime-tp6-firefox-google-docs** 25881 - ❌ 25882 - ❌ 25883 - ❌ 25884 - ❌ 25885 * - **browsertime-tp6-live-firefox-google-docs** 25886 - ❌ 25887 - ❌ 25888 - ❌ 25889 - ❌ 25890 25891 25892 .. list-table:: **test-windows11-64-24h2-shippable/opt** 25893 :widths: 30 15 15 15 15 25894 :header-rows: 1 25895 25896 * - **Test Name** 25897 - mozilla-central 25898 - autoland 25899 - mozilla-release 25900 - mozilla-beta 25901 * - **browsertime-tp6-chrome-google-docs** 25902 - ❌ 25903 - ❌ 25904 - ❌ 25905 - ❌ 25906 * - **browsertime-tp6-custom-car-google-docs** 25907 - ❌ 25908 - ❌ 25909 - ❌ 25910 - ❌ 25911 * - **browsertime-tp6-firefox-google-docs** 25912 - ✅ 25913 - ✅ 25914 - ❌ 25915 - ❌ 25916 * - **browsertime-tp6-live-chrome-google-docs** 25917 - ❌ 25918 - ❌ 25919 - ❌ 25920 - ❌ 25921 * - **browsertime-tp6-live-firefox-google-docs** 25922 - ❌ 25923 - ❌ 25924 - ❌ 25925 - ❌ 25926 25927 25928 .. list-table:: **test-windows11-64-24h2/opt** 25929 :widths: 30 15 15 15 15 25930 :header-rows: 1 25931 25932 * - **Test Name** 25933 - mozilla-central 25934 - autoland 25935 - mozilla-release 25936 - mozilla-beta 25937 * - **browsertime-tp6-firefox-google-docs** 25938 - ❌ 25939 - ❌ 25940 - ❌ 25941 - ❌ 25942 * - **browsertime-tp6-live-firefox-google-docs** 25943 - ❌ 25944 - ❌ 25945 - ❌ 25946 - ❌ 25947 25948 25949 25950 .. dropdown:: google-mail 25951 :class-container: anchor-id-google-mail-d 25952 25953 * Command to Run Locally 25954 25955 .. code-block:: 25956 25957 ./mach raptor -t google-mail 25958 25959 **Owner**: PerfTest Team 25960 25961 * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__, `largestContentfulPaint <raptor-metrics.html#largest-contentful-paint>`__ 25962 * **alert threshold**: 2.0 25963 * **apps**: firefox, chrome, safari, custom-car 25964 * **benchmark page**: false 25965 * **browser cycles**: 25 25966 * **expected**: pass 25967 * **gecko profile interval**: 1 25968 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#84>`__ 25969 * **lower is better**: true 25970 * **page cycles**: 25 25971 * **page timeout**: 60000 25972 * **playback**: mitmproxy 25973 * **playback pageset manifest**: mitm5-linux-firefox-google-mail.manifest 25974 * **playback version**: 11.0.0 25975 * **support class**: browsertime_pageload.py 25976 * **test url**: `<https://mail.google.com/>`__ 25977 * **type**: pageload 25978 * **unit**: ms 25979 * **use live sites**: false 25980 * **Test Task**: 25981 25982 .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** 25983 :widths: 30 15 15 15 15 25984 :header-rows: 1 25985 25986 * - **Test Name** 25987 - mozilla-central 25988 - autoland 25989 - mozilla-release 25990 - mozilla-beta 25991 * - **browsertime-tp6-firefox-google-mail** 25992 - ❌ 25993 - ❌ 25994 - ❌ 25995 - ❌ 25996 * - **browsertime-tp6-live-firefox-google-mail** 25997 - ❌ 25998 - ❌ 25999 - ❌ 26000 - ❌ 26001 26002 26003 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 26004 :widths: 30 15 15 15 15 26005 :header-rows: 1 26006 26007 * - **Test Name** 26008 - mozilla-central 26009 - autoland 26010 - mozilla-release 26011 - mozilla-beta 26012 * - **browsertime-tp6-firefox-google-mail** 26013 - ❌ 26014 - ❌ 26015 - ❌ 26016 - ❌ 26017 * - **browsertime-tp6-live-firefox-google-mail** 26018 - ❌ 26019 - ❌ 26020 - ❌ 26021 - ❌ 26022 26023 26024 .. list-table:: **test-linux1804-64-qr/opt** 26025 :widths: 30 15 15 15 15 26026 :header-rows: 1 26027 26028 * - **Test Name** 26029 - mozilla-central 26030 - autoland 26031 - mozilla-release 26032 - mozilla-beta 26033 * - **browsertime-tp6-firefox-google-mail** 26034 - ❌ 26035 - ❌ 26036 - ❌ 26037 - ❌ 26038 * - **browsertime-tp6-live-firefox-google-mail** 26039 - ❌ 26040 - ❌ 26041 - ❌ 26042 - ❌ 26043 26044 26045 .. list-table:: **test-linux1804-64-shippable-qr/opt** 26046 :widths: 30 15 15 15 15 26047 :header-rows: 1 26048 26049 * - **Test Name** 26050 - mozilla-central 26051 - autoland 26052 - mozilla-release 26053 - mozilla-beta 26054 * - **browsertime-tp6-chrome-google-mail** 26055 - ❌ 26056 - ❌ 26057 - ❌ 26058 - ❌ 26059 * - **browsertime-tp6-custom-car-google-mail** 26060 - ❌ 26061 - ❌ 26062 - ❌ 26063 - ❌ 26064 * - **browsertime-tp6-firefox-google-mail** 26065 - ✅ 26066 - ✅ 26067 - ❌ 26068 - ❌ 26069 * - **browsertime-tp6-live-chrome-google-mail** 26070 - ❌ 26071 - ❌ 26072 - ❌ 26073 - ❌ 26074 * - **browsertime-tp6-live-firefox-google-mail** 26075 - ❌ 26076 - ❌ 26077 - ❌ 26078 - ❌ 26079 26080 26081 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 26082 :widths: 30 15 15 15 15 26083 :header-rows: 1 26084 26085 * - **Test Name** 26086 - mozilla-central 26087 - autoland 26088 - mozilla-release 26089 - mozilla-beta 26090 * - **browsertime-tp6-firefox-google-mail** 26091 - ❌ 26092 - ❌ 26093 - ❌ 26094 - ❌ 26095 * - **browsertime-tp6-live-firefox-google-mail** 26096 - ❌ 26097 - ❌ 26098 - ❌ 26099 - ❌ 26100 26101 26102 .. list-table:: **test-macosx1470-64-shippable/opt** 26103 :widths: 30 15 15 15 15 26104 :header-rows: 1 26105 26106 * - **Test Name** 26107 - mozilla-central 26108 - autoland 26109 - mozilla-release 26110 - mozilla-beta 26111 * - **browsertime-tp6-chrome-google-mail** 26112 - ❌ 26113 - ❌ 26114 - ❌ 26115 - ❌ 26116 * - **browsertime-tp6-custom-car-google-mail** 26117 - ❌ 26118 - ❌ 26119 - ❌ 26120 - ❌ 26121 * - **browsertime-tp6-firefox-google-mail** 26122 - ✅ 26123 - ✅ 26124 - ❌ 26125 - ❌ 26126 * - **browsertime-tp6-live-chrome-google-mail** 26127 - ❌ 26128 - ❌ 26129 - ❌ 26130 - ❌ 26131 * - **browsertime-tp6-live-firefox-google-mail** 26132 - ❌ 26133 - ❌ 26134 - ❌ 26135 - ❌ 26136 * - **browsertime-tp6-live-safari-google-mail** 26137 - ❌ 26138 - ❌ 26139 - ❌ 26140 - ❌ 26141 26142 26143 .. list-table:: **test-macosx1470-64/opt** 26144 :widths: 30 15 15 15 15 26145 :header-rows: 1 26146 26147 * - **Test Name** 26148 - mozilla-central 26149 - autoland 26150 - mozilla-release 26151 - mozilla-beta 26152 * - **browsertime-tp6-firefox-google-mail** 26153 - ❌ 26154 - ❌ 26155 - ❌ 26156 - ❌ 26157 * - **browsertime-tp6-live-firefox-google-mail** 26158 - ❌ 26159 - ❌ 26160 - ❌ 26161 - ❌ 26162 26163 26164 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 26165 :widths: 30 15 15 15 15 26166 :header-rows: 1 26167 26168 * - **Test Name** 26169 - mozilla-central 26170 - autoland 26171 - mozilla-release 26172 - mozilla-beta 26173 * - **browsertime-tp6-firefox-google-mail** 26174 - ❌ 26175 - ❌ 26176 - ❌ 26177 - ❌ 26178 * - **browsertime-tp6-live-firefox-google-mail** 26179 - ❌ 26180 - ❌ 26181 - ❌ 26182 - ❌ 26183 26184 26185 .. list-table:: **test-windows11-64-24h2-shippable/opt** 26186 :widths: 30 15 15 15 15 26187 :header-rows: 1 26188 26189 * - **Test Name** 26190 - mozilla-central 26191 - autoland 26192 - mozilla-release 26193 - mozilla-beta 26194 * - **browsertime-tp6-chrome-google-mail** 26195 - ❌ 26196 - ❌ 26197 - ❌ 26198 - ❌ 26199 * - **browsertime-tp6-custom-car-google-mail** 26200 - ❌ 26201 - ❌ 26202 - ❌ 26203 - ❌ 26204 * - **browsertime-tp6-firefox-google-mail** 26205 - ✅ 26206 - ✅ 26207 - ❌ 26208 - ❌ 26209 * - **browsertime-tp6-live-chrome-google-mail** 26210 - ❌ 26211 - ❌ 26212 - ❌ 26213 - ❌ 26214 * - **browsertime-tp6-live-firefox-google-mail** 26215 - ❌ 26216 - ❌ 26217 - ❌ 26218 - ❌ 26219 26220 26221 .. list-table:: **test-windows11-64-24h2/opt** 26222 :widths: 30 15 15 15 15 26223 :header-rows: 1 26224 26225 * - **Test Name** 26226 - mozilla-central 26227 - autoland 26228 - mozilla-release 26229 - mozilla-beta 26230 * - **browsertime-tp6-firefox-google-mail** 26231 - ❌ 26232 - ❌ 26233 - ❌ 26234 - ❌ 26235 * - **browsertime-tp6-live-firefox-google-mail** 26236 - ❌ 26237 - ❌ 26238 - ❌ 26239 - ❌ 26240 26241 26242 26243 .. dropdown:: google-search 26244 :class-container: anchor-id-google-search-d 26245 26246 * Command to Run Locally 26247 26248 .. code-block:: 26249 26250 ./mach raptor -t google-search 26251 26252 **Owner**: PerfTest Team 26253 26254 * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__, `largestContentfulPaint <raptor-metrics.html#largest-contentful-paint>`__ 26255 * **alert threshold**: 2.0 26256 * **apps**: firefox, chrome, safari, custom-car 26257 * **benchmark page**: true 26258 * **browser cycles**: 25 26259 * **expected**: pass 26260 * **gecko profile interval**: 1 26261 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#89>`__ 26262 * **lower is better**: true 26263 * **page cycles**: 25 26264 * **page timeout**: 60000 26265 * **playback**: mitmproxy 26266 * **playback pageset manifest**: mitm11-windows-firefox-google-search.manifest 26267 * **playback pageset manifest backup**: mitm8-linux-firefox-google-search.manifest 26268 * **playback version**: 11.0.0 26269 * **support class**: browsertime_pageload.py 26270 * **test url**: `<https://www.google.com/search?hl=en&q=barack+obama&cad=h>`__ 26271 * **type**: pageload 26272 * **unit**: ms 26273 * **use live sites**: false 26274 * **Test Task**: 26275 26276 .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** 26277 :widths: 30 15 15 15 15 26278 :header-rows: 1 26279 26280 * - **Test Name** 26281 - mozilla-central 26282 - autoland 26283 - mozilla-release 26284 - mozilla-beta 26285 * - **browsertime-tp6-firefox-google-search** 26286 - ❌ 26287 - ❌ 26288 - ❌ 26289 - ❌ 26290 * - **browsertime-tp6-live-firefox-google-search** 26291 - ❌ 26292 - ❌ 26293 - ❌ 26294 - ❌ 26295 26296 26297 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 26298 :widths: 30 15 15 15 15 26299 :header-rows: 1 26300 26301 * - **Test Name** 26302 - mozilla-central 26303 - autoland 26304 - mozilla-release 26305 - mozilla-beta 26306 * - **browsertime-tp6-firefox-google-search** 26307 - ❌ 26308 - ❌ 26309 - ❌ 26310 - ❌ 26311 * - **browsertime-tp6-live-firefox-google-search** 26312 - ❌ 26313 - ❌ 26314 - ❌ 26315 - ❌ 26316 26317 26318 .. list-table:: **test-linux1804-64-qr/opt** 26319 :widths: 30 15 15 15 15 26320 :header-rows: 1 26321 26322 * - **Test Name** 26323 - mozilla-central 26324 - autoland 26325 - mozilla-release 26326 - mozilla-beta 26327 * - **browsertime-tp6-firefox-google-search** 26328 - ❌ 26329 - ❌ 26330 - ❌ 26331 - ❌ 26332 * - **browsertime-tp6-live-firefox-google-search** 26333 - ❌ 26334 - ❌ 26335 - ❌ 26336 - ❌ 26337 26338 26339 .. list-table:: **test-linux1804-64-shippable-qr/opt** 26340 :widths: 30 15 15 15 15 26341 :header-rows: 1 26342 26343 * - **Test Name** 26344 - mozilla-central 26345 - autoland 26346 - mozilla-release 26347 - mozilla-beta 26348 * - **browsertime-tp6-chrome-google-search** 26349 - ❌ 26350 - ❌ 26351 - ❌ 26352 - ❌ 26353 * - **browsertime-tp6-custom-car-google-search** 26354 - ❌ 26355 - ❌ 26356 - ❌ 26357 - ❌ 26358 * - **browsertime-tp6-firefox-google-search** 26359 - ✅ 26360 - ✅ 26361 - ❌ 26362 - ❌ 26363 * - **browsertime-tp6-live-chrome-google-search** 26364 - ❌ 26365 - ❌ 26366 - ❌ 26367 - ❌ 26368 * - **browsertime-tp6-live-firefox-google-search** 26369 - ❌ 26370 - ❌ 26371 - ❌ 26372 - ❌ 26373 26374 26375 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 26376 :widths: 30 15 15 15 15 26377 :header-rows: 1 26378 26379 * - **Test Name** 26380 - mozilla-central 26381 - autoland 26382 - mozilla-release 26383 - mozilla-beta 26384 * - **browsertime-tp6-firefox-google-search** 26385 - ❌ 26386 - ❌ 26387 - ❌ 26388 - ❌ 26389 * - **browsertime-tp6-live-firefox-google-search** 26390 - ❌ 26391 - ❌ 26392 - ❌ 26393 - ❌ 26394 26395 26396 .. list-table:: **test-macosx1470-64-shippable/opt** 26397 :widths: 30 15 15 15 15 26398 :header-rows: 1 26399 26400 * - **Test Name** 26401 - mozilla-central 26402 - autoland 26403 - mozilla-release 26404 - mozilla-beta 26405 * - **browsertime-tp6-chrome-google-search** 26406 - ❌ 26407 - ❌ 26408 - ❌ 26409 - ❌ 26410 * - **browsertime-tp6-custom-car-google-search** 26411 - ❌ 26412 - ❌ 26413 - ❌ 26414 - ❌ 26415 * - **browsertime-tp6-firefox-google-search** 26416 - ✅ 26417 - ✅ 26418 - ❌ 26419 - ❌ 26420 * - **browsertime-tp6-live-chrome-google-search** 26421 - ❌ 26422 - ❌ 26423 - ❌ 26424 - ❌ 26425 * - **browsertime-tp6-live-firefox-google-search** 26426 - ❌ 26427 - ❌ 26428 - ❌ 26429 - ❌ 26430 * - **browsertime-tp6-live-safari-google-search** 26431 - ❌ 26432 - ❌ 26433 - ❌ 26434 - ❌ 26435 26436 26437 .. list-table:: **test-macosx1470-64/opt** 26438 :widths: 30 15 15 15 15 26439 :header-rows: 1 26440 26441 * - **Test Name** 26442 - mozilla-central 26443 - autoland 26444 - mozilla-release 26445 - mozilla-beta 26446 * - **browsertime-tp6-firefox-google-search** 26447 - ❌ 26448 - ❌ 26449 - ❌ 26450 - ❌ 26451 * - **browsertime-tp6-live-firefox-google-search** 26452 - ❌ 26453 - ❌ 26454 - ❌ 26455 - ❌ 26456 26457 26458 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 26459 :widths: 30 15 15 15 15 26460 :header-rows: 1 26461 26462 * - **Test Name** 26463 - mozilla-central 26464 - autoland 26465 - mozilla-release 26466 - mozilla-beta 26467 * - **browsertime-tp6-firefox-google-search** 26468 - ❌ 26469 - ❌ 26470 - ❌ 26471 - ❌ 26472 * - **browsertime-tp6-live-firefox-google-search** 26473 - ❌ 26474 - ❌ 26475 - ❌ 26476 - ❌ 26477 26478 26479 .. list-table:: **test-windows11-64-24h2-shippable/opt** 26480 :widths: 30 15 15 15 15 26481 :header-rows: 1 26482 26483 * - **Test Name** 26484 - mozilla-central 26485 - autoland 26486 - mozilla-release 26487 - mozilla-beta 26488 * - **browsertime-tp6-chrome-google-search** 26489 - ❌ 26490 - ❌ 26491 - ❌ 26492 - ❌ 26493 * - **browsertime-tp6-custom-car-google-search** 26494 - ❌ 26495 - ❌ 26496 - ❌ 26497 - ❌ 26498 * - **browsertime-tp6-firefox-google-search** 26499 - ✅ 26500 - ✅ 26501 - ❌ 26502 - ❌ 26503 * - **browsertime-tp6-live-chrome-google-search** 26504 - ❌ 26505 - ❌ 26506 - ❌ 26507 - ❌ 26508 * - **browsertime-tp6-live-firefox-google-search** 26509 - ❌ 26510 - ❌ 26511 - ❌ 26512 - ❌ 26513 26514 26515 .. list-table:: **test-windows11-64-24h2/opt** 26516 :widths: 30 15 15 15 15 26517 :header-rows: 1 26518 26519 * - **Test Name** 26520 - mozilla-central 26521 - autoland 26522 - mozilla-release 26523 - mozilla-beta 26524 * - **browsertime-tp6-firefox-google-search** 26525 - ❌ 26526 - ❌ 26527 - ❌ 26528 - ❌ 26529 * - **browsertime-tp6-live-firefox-google-search** 26530 - ❌ 26531 - ❌ 26532 - ❌ 26533 - ❌ 26534 26535 26536 26537 .. dropdown:: google-slides 26538 :class-container: anchor-id-google-slides-d 26539 26540 * Command to Run Locally 26541 26542 .. code-block:: 26543 26544 ./mach raptor -t google-slides 26545 26546 **Owner**: PerfTest Team 26547 26548 * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__, `largestContentfulPaint <raptor-metrics.html#largest-contentful-paint>`__ 26549 * **alert threshold**: 2.0 26550 * **apps**: firefox, chrome, safari, custom-car 26551 * **benchmark page**: false 26552 * **browser cycles**: 25 26553 * **expected**: pass 26554 * **gecko profile interval**: 1 26555 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#94>`__ 26556 * **lower is better**: true 26557 * **page cycles**: 25 26558 * **page timeout**: 60000 26559 * **playback**: mitmproxy 26560 * **playback pageset manifest**: mitm8-linux-firefox-google-slides.manifest 26561 * **playback version**: 11.0.0 26562 * **secondary url**: `<https://docs.google.com/presentation/d/e/2PACX-1vRWwPQQFMDkSR4RtYc7HSAGm-hoprespfemIk5SatJxd2o8yrFfrMeAAUkjdfalC5PpjJ9ZKgfsuQ1T/pub?start=false&loop=false&delayms=3000>`__ 26563 * **support class**: browsertime_pageload.py 26564 * **test url**: `<https://docs.google.com/presentation/d/1Ici0ceWwpFvmIb3EmKeWSq_vAQdmmdFcWqaiLqUkJng/edit?usp=sharing>`__ 26565 * **type**: pageload 26566 * **unit**: ms 26567 * **use live sites**: false 26568 * **Test Task**: 26569 26570 .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** 26571 :widths: 30 15 15 15 15 26572 :header-rows: 1 26573 26574 * - **Test Name** 26575 - mozilla-central 26576 - autoland 26577 - mozilla-release 26578 - mozilla-beta 26579 * - **browsertime-tp6-bytecode-firefox-google-slides** 26580 - ❌ 26581 - ❌ 26582 - ❌ 26583 - ❌ 26584 * - **browsertime-tp6-essential-firefox-google-slides** 26585 - ❌ 26586 - ❌ 26587 - ❌ 26588 - ❌ 26589 * - **browsertime-tp6-live-firefox-google-slides** 26590 - ❌ 26591 - ❌ 26592 - ❌ 26593 - ❌ 26594 26595 26596 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 26597 :widths: 30 15 15 15 15 26598 :header-rows: 1 26599 26600 * - **Test Name** 26601 - mozilla-central 26602 - autoland 26603 - mozilla-release 26604 - mozilla-beta 26605 * - **browsertime-tp6-bytecode-firefox-google-slides** 26606 - ❌ 26607 - ❌ 26608 - ❌ 26609 - ❌ 26610 * - **browsertime-tp6-essential-firefox-google-slides** 26611 - ❌ 26612 - ❌ 26613 - ❌ 26614 - ❌ 26615 * - **browsertime-tp6-live-firefox-google-slides** 26616 - ❌ 26617 - ❌ 26618 - ❌ 26619 - ❌ 26620 26621 26622 .. list-table:: **test-linux1804-64-qr/opt** 26623 :widths: 30 15 15 15 15 26624 :header-rows: 1 26625 26626 * - **Test Name** 26627 - mozilla-central 26628 - autoland 26629 - mozilla-release 26630 - mozilla-beta 26631 * - **browsertime-tp6-bytecode-firefox-google-slides** 26632 - ❌ 26633 - ❌ 26634 - ❌ 26635 - ❌ 26636 * - **browsertime-tp6-essential-firefox-google-slides** 26637 - ❌ 26638 - ❌ 26639 - ❌ 26640 - ❌ 26641 * - **browsertime-tp6-live-firefox-google-slides** 26642 - ❌ 26643 - ❌ 26644 - ❌ 26645 - ❌ 26646 26647 26648 .. list-table:: **test-linux1804-64-shippable-qr/opt** 26649 :widths: 30 15 15 15 15 26650 :header-rows: 1 26651 26652 * - **Test Name** 26653 - mozilla-central 26654 - autoland 26655 - mozilla-release 26656 - mozilla-beta 26657 * - **browsertime-tp6-bytecode-firefox-google-slides** 26658 - ✅ 26659 - ✅ 26660 - ❌ 26661 - ❌ 26662 * - **browsertime-tp6-essential-chrome-google-slides** 26663 - ❌ 26664 - ❌ 26665 - ❌ 26666 - ❌ 26667 * - **browsertime-tp6-essential-custom-car-google-slides** 26668 - ❌ 26669 - ❌ 26670 - ❌ 26671 - ❌ 26672 * - **browsertime-tp6-essential-firefox-google-slides** 26673 - ✅ 26674 - ✅ 26675 - ❌ 26676 - ❌ 26677 * - **browsertime-tp6-live-chrome-google-slides** 26678 - ❌ 26679 - ❌ 26680 - ❌ 26681 - ❌ 26682 * - **browsertime-tp6-live-firefox-google-slides** 26683 - ❌ 26684 - ❌ 26685 - ❌ 26686 - ❌ 26687 26688 26689 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 26690 :widths: 30 15 15 15 15 26691 :header-rows: 1 26692 26693 * - **Test Name** 26694 - mozilla-central 26695 - autoland 26696 - mozilla-release 26697 - mozilla-beta 26698 * - **browsertime-tp6-bytecode-firefox-google-slides** 26699 - ❌ 26700 - ❌ 26701 - ❌ 26702 - ❌ 26703 * - **browsertime-tp6-essential-firefox-google-slides** 26704 - ❌ 26705 - ❌ 26706 - ❌ 26707 - ❌ 26708 * - **browsertime-tp6-live-firefox-google-slides** 26709 - ❌ 26710 - ❌ 26711 - ❌ 26712 - ❌ 26713 26714 26715 .. list-table:: **test-macosx1470-64-shippable/opt** 26716 :widths: 30 15 15 15 15 26717 :header-rows: 1 26718 26719 * - **Test Name** 26720 - mozilla-central 26721 - autoland 26722 - mozilla-release 26723 - mozilla-beta 26724 * - **browsertime-tp6-bytecode-firefox-google-slides** 26725 - ✅ 26726 - ✅ 26727 - ❌ 26728 - ❌ 26729 * - **browsertime-tp6-essential-chrome-google-slides** 26730 - ❌ 26731 - ❌ 26732 - ❌ 26733 - ❌ 26734 * - **browsertime-tp6-essential-custom-car-google-slides** 26735 - ❌ 26736 - ❌ 26737 - ❌ 26738 - ❌ 26739 * - **browsertime-tp6-essential-firefox-google-slides** 26740 - ✅ 26741 - ✅ 26742 - ❌ 26743 - ❌ 26744 * - **browsertime-tp6-live-chrome-google-slides** 26745 - ❌ 26746 - ❌ 26747 - ❌ 26748 - ❌ 26749 * - **browsertime-tp6-live-firefox-google-slides** 26750 - ❌ 26751 - ❌ 26752 - ❌ 26753 - ❌ 26754 * - **browsertime-tp6-live-safari-google-slides** 26755 - ❌ 26756 - ❌ 26757 - ❌ 26758 - ❌ 26759 26760 26761 .. list-table:: **test-macosx1470-64/opt** 26762 :widths: 30 15 15 15 15 26763 :header-rows: 1 26764 26765 * - **Test Name** 26766 - mozilla-central 26767 - autoland 26768 - mozilla-release 26769 - mozilla-beta 26770 * - **browsertime-tp6-bytecode-firefox-google-slides** 26771 - ❌ 26772 - ❌ 26773 - ❌ 26774 - ❌ 26775 * - **browsertime-tp6-essential-firefox-google-slides** 26776 - ❌ 26777 - ❌ 26778 - ❌ 26779 - ❌ 26780 * - **browsertime-tp6-live-firefox-google-slides** 26781 - ❌ 26782 - ❌ 26783 - ❌ 26784 - ❌ 26785 26786 26787 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 26788 :widths: 30 15 15 15 15 26789 :header-rows: 1 26790 26791 * - **Test Name** 26792 - mozilla-central 26793 - autoland 26794 - mozilla-release 26795 - mozilla-beta 26796 * - **browsertime-tp6-bytecode-firefox-google-slides** 26797 - ❌ 26798 - ❌ 26799 - ❌ 26800 - ❌ 26801 * - **browsertime-tp6-essential-firefox-google-slides** 26802 - ❌ 26803 - ❌ 26804 - ❌ 26805 - ❌ 26806 * - **browsertime-tp6-live-firefox-google-slides** 26807 - ❌ 26808 - ❌ 26809 - ❌ 26810 - ❌ 26811 26812 26813 .. list-table:: **test-windows11-64-24h2-shippable/opt** 26814 :widths: 30 15 15 15 15 26815 :header-rows: 1 26816 26817 * - **Test Name** 26818 - mozilla-central 26819 - autoland 26820 - mozilla-release 26821 - mozilla-beta 26822 * - **browsertime-tp6-bytecode-firefox-google-slides** 26823 - ✅ 26824 - ✅ 26825 - ❌ 26826 - ❌ 26827 * - **browsertime-tp6-essential-chrome-google-slides** 26828 - ❌ 26829 - ❌ 26830 - ❌ 26831 - ❌ 26832 * - **browsertime-tp6-essential-custom-car-google-slides** 26833 - ❌ 26834 - ❌ 26835 - ❌ 26836 - ❌ 26837 * - **browsertime-tp6-essential-firefox-google-slides** 26838 - ✅ 26839 - ✅ 26840 - ❌ 26841 - ❌ 26842 * - **browsertime-tp6-live-chrome-google-slides** 26843 - ❌ 26844 - ❌ 26845 - ❌ 26846 - ❌ 26847 * - **browsertime-tp6-live-firefox-google-slides** 26848 - ❌ 26849 - ❌ 26850 - ❌ 26851 - ❌ 26852 26853 26854 .. list-table:: **test-windows11-64-24h2/opt** 26855 :widths: 30 15 15 15 15 26856 :header-rows: 1 26857 26858 * - **Test Name** 26859 - mozilla-central 26860 - autoland 26861 - mozilla-release 26862 - mozilla-beta 26863 * - **browsertime-tp6-bytecode-firefox-google-slides** 26864 - ❌ 26865 - ❌ 26866 - ❌ 26867 - ❌ 26868 * - **browsertime-tp6-essential-firefox-google-slides** 26869 - ❌ 26870 - ❌ 26871 - ❌ 26872 - ❌ 26873 * - **browsertime-tp6-live-firefox-google-slides** 26874 - ❌ 26875 - ❌ 26876 - ❌ 26877 - ❌ 26878 26879 26880 26881 .. dropdown:: imdb 26882 :class-container: anchor-id-imdb-d 26883 26884 * Command to Run Locally 26885 26886 .. code-block:: 26887 26888 ./mach raptor -t imdb 26889 26890 **Owner**: PerfTest Team 26891 26892 * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__, `largestContentfulPaint <raptor-metrics.html#largest-contentful-paint>`__ 26893 * **alert threshold**: 2.0 26894 * **apps**: firefox, chrome, safari, custom-car 26895 * **benchmark page**: true 26896 * **browser cycles**: 25 26897 * **expected**: pass 26898 * **gecko profile interval**: 1 26899 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#100>`__ 26900 * **lower is better**: true 26901 * **page cycles**: 25 26902 * **page timeout**: 60000 26903 * **playback**: mitmproxy 26904 * **playback pageset manifest**: mitm11-windows-firefox-imdb.manifest 26905 * **playback pageset manifest backup**: mitm8-linux-firefox-imdb.manifest 26906 * **playback version**: 11.0.0 26907 * **secondary url**: `<https://www.imdb.com/title/tt0084967/episodes/?ref_=tt_ov_epl>`__ 26908 * **support class**: browsertime_pageload.py 26909 * **test url**: `<https://www.imdb.com/title/tt0084967/?ref_=nv_sr_2>`__ 26910 * **type**: pageload 26911 * **unit**: ms 26912 * **use live sites**: false 26913 * **Test Task**: 26914 26915 .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** 26916 :widths: 30 15 15 15 15 26917 :header-rows: 1 26918 26919 * - **Test Name** 26920 - mozilla-central 26921 - autoland 26922 - mozilla-release 26923 - mozilla-beta 26924 * - **browsertime-tp6-firefox-imdb** 26925 - ❌ 26926 - ❌ 26927 - ❌ 26928 - ❌ 26929 * - **browsertime-tp6-live-firefox-imdb** 26930 - ❌ 26931 - ❌ 26932 - ❌ 26933 - ❌ 26934 26935 26936 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 26937 :widths: 30 15 15 15 15 26938 :header-rows: 1 26939 26940 * - **Test Name** 26941 - mozilla-central 26942 - autoland 26943 - mozilla-release 26944 - mozilla-beta 26945 * - **browsertime-tp6-firefox-imdb** 26946 - ❌ 26947 - ❌ 26948 - ❌ 26949 - ❌ 26950 * - **browsertime-tp6-live-firefox-imdb** 26951 - ❌ 26952 - ❌ 26953 - ❌ 26954 - ❌ 26955 26956 26957 .. list-table:: **test-linux1804-64-qr/opt** 26958 :widths: 30 15 15 15 15 26959 :header-rows: 1 26960 26961 * - **Test Name** 26962 - mozilla-central 26963 - autoland 26964 - mozilla-release 26965 - mozilla-beta 26966 * - **browsertime-tp6-firefox-imdb** 26967 - ❌ 26968 - ❌ 26969 - ❌ 26970 - ❌ 26971 * - **browsertime-tp6-live-firefox-imdb** 26972 - ❌ 26973 - ❌ 26974 - ❌ 26975 - ❌ 26976 26977 26978 .. list-table:: **test-linux1804-64-shippable-qr/opt** 26979 :widths: 30 15 15 15 15 26980 :header-rows: 1 26981 26982 * - **Test Name** 26983 - mozilla-central 26984 - autoland 26985 - mozilla-release 26986 - mozilla-beta 26987 * - **browsertime-tp6-chrome-imdb** 26988 - ❌ 26989 - ❌ 26990 - ❌ 26991 - ❌ 26992 * - **browsertime-tp6-custom-car-imdb** 26993 - ❌ 26994 - ❌ 26995 - ❌ 26996 - ❌ 26997 * - **browsertime-tp6-firefox-imdb** 26998 - ✅ 26999 - ✅ 27000 - ❌ 27001 - ❌ 27002 * - **browsertime-tp6-live-chrome-imdb** 27003 - ❌ 27004 - ❌ 27005 - ❌ 27006 - ❌ 27007 * - **browsertime-tp6-live-firefox-imdb** 27008 - ❌ 27009 - ❌ 27010 - ❌ 27011 - ❌ 27012 27013 27014 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 27015 :widths: 30 15 15 15 15 27016 :header-rows: 1 27017 27018 * - **Test Name** 27019 - mozilla-central 27020 - autoland 27021 - mozilla-release 27022 - mozilla-beta 27023 * - **browsertime-tp6-firefox-imdb** 27024 - ❌ 27025 - ❌ 27026 - ❌ 27027 - ❌ 27028 * - **browsertime-tp6-live-firefox-imdb** 27029 - ❌ 27030 - ❌ 27031 - ❌ 27032 - ❌ 27033 27034 27035 .. list-table:: **test-macosx1470-64-shippable/opt** 27036 :widths: 30 15 15 15 15 27037 :header-rows: 1 27038 27039 * - **Test Name** 27040 - mozilla-central 27041 - autoland 27042 - mozilla-release 27043 - mozilla-beta 27044 * - **browsertime-tp6-chrome-imdb** 27045 - ❌ 27046 - ❌ 27047 - ❌ 27048 - ❌ 27049 * - **browsertime-tp6-custom-car-imdb** 27050 - ❌ 27051 - ❌ 27052 - ❌ 27053 - ❌ 27054 * - **browsertime-tp6-firefox-imdb** 27055 - ✅ 27056 - ✅ 27057 - ❌ 27058 - ❌ 27059 * - **browsertime-tp6-live-chrome-imdb** 27060 - ❌ 27061 - ❌ 27062 - ❌ 27063 - ❌ 27064 * - **browsertime-tp6-live-firefox-imdb** 27065 - ❌ 27066 - ❌ 27067 - ❌ 27068 - ❌ 27069 * - **browsertime-tp6-live-safari-imdb** 27070 - ❌ 27071 - ❌ 27072 - ❌ 27073 - ❌ 27074 27075 27076 .. list-table:: **test-macosx1470-64/opt** 27077 :widths: 30 15 15 15 15 27078 :header-rows: 1 27079 27080 * - **Test Name** 27081 - mozilla-central 27082 - autoland 27083 - mozilla-release 27084 - mozilla-beta 27085 * - **browsertime-tp6-firefox-imdb** 27086 - ❌ 27087 - ❌ 27088 - ❌ 27089 - ❌ 27090 * - **browsertime-tp6-live-firefox-imdb** 27091 - ❌ 27092 - ❌ 27093 - ❌ 27094 - ❌ 27095 27096 27097 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 27098 :widths: 30 15 15 15 15 27099 :header-rows: 1 27100 27101 * - **Test Name** 27102 - mozilla-central 27103 - autoland 27104 - mozilla-release 27105 - mozilla-beta 27106 * - **browsertime-tp6-firefox-imdb** 27107 - ❌ 27108 - ❌ 27109 - ❌ 27110 - ❌ 27111 * - **browsertime-tp6-live-firefox-imdb** 27112 - ❌ 27113 - ❌ 27114 - ❌ 27115 - ❌ 27116 27117 27118 .. list-table:: **test-windows11-64-24h2-shippable/opt** 27119 :widths: 30 15 15 15 15 27120 :header-rows: 1 27121 27122 * - **Test Name** 27123 - mozilla-central 27124 - autoland 27125 - mozilla-release 27126 - mozilla-beta 27127 * - **browsertime-tp6-chrome-imdb** 27128 - ❌ 27129 - ❌ 27130 - ❌ 27131 - ❌ 27132 * - **browsertime-tp6-custom-car-imdb** 27133 - ❌ 27134 - ❌ 27135 - ❌ 27136 - ❌ 27137 * - **browsertime-tp6-firefox-imdb** 27138 - ✅ 27139 - ✅ 27140 - ❌ 27141 - ❌ 27142 * - **browsertime-tp6-live-chrome-imdb** 27143 - ❌ 27144 - ❌ 27145 - ❌ 27146 - ❌ 27147 * - **browsertime-tp6-live-firefox-imdb** 27148 - ❌ 27149 - ❌ 27150 - ❌ 27151 - ❌ 27152 27153 27154 .. list-table:: **test-windows11-64-24h2/opt** 27155 :widths: 30 15 15 15 15 27156 :header-rows: 1 27157 27158 * - **Test Name** 27159 - mozilla-central 27160 - autoland 27161 - mozilla-release 27162 - mozilla-beta 27163 * - **browsertime-tp6-firefox-imdb** 27164 - ❌ 27165 - ❌ 27166 - ❌ 27167 - ❌ 27168 * - **browsertime-tp6-live-firefox-imdb** 27169 - ❌ 27170 - ❌ 27171 - ❌ 27172 - ❌ 27173 27174 27175 27176 .. dropdown:: imgur 27177 :class-container: anchor-id-imgur-d 27178 27179 * Command to Run Locally 27180 27181 .. code-block:: 27182 27183 ./mach raptor -t imgur 27184 27185 **Owner**: PerfTest Team 27186 27187 * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__, `largestContentfulPaint <raptor-metrics.html#largest-contentful-paint>`__ 27188 * **alert threshold**: 2.0 27189 * **apps**: firefox, chrome, safari, custom-car 27190 * **benchmark page**: false 27191 * **browser cycles**: 25 27192 * **expected**: pass 27193 * **gecko profile interval**: 1 27194 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#106>`__ 27195 * **lower is better**: true 27196 * **page cycles**: 25 27197 * **page timeout**: 60000 27198 * **playback**: mitmproxy 27199 * **playback pageset manifest**: mitm11-windows-firefox-imgur.manifest 27200 * **playback pageset manifest backup**: mitm8-linux-firefox-imgur.manifest 27201 * **playback version**: 11.0.0 27202 * **preferences**: media.autoplay.default=5 media.autoplay.ask-permission=true media.autoplay.blocking_policy=1 media.allowed-to-play.enabled=false media.block-autoplay-until-in-foreground=true 27203 * **secondary url**: `<https://imgur.com/gallery/firefox-logo-w8fgXyY>`__ 27204 * **support class**: browsertime_pageload.py 27205 * **test url**: `<https://imgur.com/gallery/mozilla-performance-testing-logo-sNUtC19>`__ 27206 * **type**: pageload 27207 * **unit**: ms 27208 * **use live sites**: false 27209 * **Test Task**: 27210 27211 .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** 27212 :widths: 30 15 15 15 15 27213 :header-rows: 1 27214 27215 * - **Test Name** 27216 - mozilla-central 27217 - autoland 27218 - mozilla-release 27219 - mozilla-beta 27220 * - **browsertime-tp6-firefox-imgur** 27221 - ❌ 27222 - ❌ 27223 - ❌ 27224 - ❌ 27225 * - **browsertime-tp6-live-firefox-imgur** 27226 - ❌ 27227 - ❌ 27228 - ❌ 27229 - ❌ 27230 27231 27232 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 27233 :widths: 30 15 15 15 15 27234 :header-rows: 1 27235 27236 * - **Test Name** 27237 - mozilla-central 27238 - autoland 27239 - mozilla-release 27240 - mozilla-beta 27241 * - **browsertime-tp6-firefox-imgur** 27242 - ❌ 27243 - ❌ 27244 - ❌ 27245 - ❌ 27246 * - **browsertime-tp6-live-firefox-imgur** 27247 - ❌ 27248 - ❌ 27249 - ❌ 27250 - ❌ 27251 27252 27253 .. list-table:: **test-linux1804-64-qr/opt** 27254 :widths: 30 15 15 15 15 27255 :header-rows: 1 27256 27257 * - **Test Name** 27258 - mozilla-central 27259 - autoland 27260 - mozilla-release 27261 - mozilla-beta 27262 * - **browsertime-tp6-firefox-imgur** 27263 - ❌ 27264 - ❌ 27265 - ❌ 27266 - ❌ 27267 * - **browsertime-tp6-live-firefox-imgur** 27268 - ❌ 27269 - ❌ 27270 - ❌ 27271 - ❌ 27272 27273 27274 .. list-table:: **test-linux1804-64-shippable-qr/opt** 27275 :widths: 30 15 15 15 15 27276 :header-rows: 1 27277 27278 * - **Test Name** 27279 - mozilla-central 27280 - autoland 27281 - mozilla-release 27282 - mozilla-beta 27283 * - **browsertime-tp6-chrome-imgur** 27284 - ❌ 27285 - ❌ 27286 - ❌ 27287 - ❌ 27288 * - **browsertime-tp6-custom-car-imgur** 27289 - ❌ 27290 - ❌ 27291 - ❌ 27292 - ❌ 27293 * - **browsertime-tp6-firefox-imgur** 27294 - ✅ 27295 - ✅ 27296 - ❌ 27297 - ❌ 27298 * - **browsertime-tp6-live-firefox-imgur** 27299 - ❌ 27300 - ❌ 27301 - ❌ 27302 - ❌ 27303 27304 27305 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 27306 :widths: 30 15 15 15 15 27307 :header-rows: 1 27308 27309 * - **Test Name** 27310 - mozilla-central 27311 - autoland 27312 - mozilla-release 27313 - mozilla-beta 27314 * - **browsertime-tp6-firefox-imgur** 27315 - ❌ 27316 - ❌ 27317 - ❌ 27318 - ❌ 27319 * - **browsertime-tp6-live-firefox-imgur** 27320 - ❌ 27321 - ❌ 27322 - ❌ 27323 - ❌ 27324 27325 27326 .. list-table:: **test-macosx1470-64-shippable/opt** 27327 :widths: 30 15 15 15 15 27328 :header-rows: 1 27329 27330 * - **Test Name** 27331 - mozilla-central 27332 - autoland 27333 - mozilla-release 27334 - mozilla-beta 27335 * - **browsertime-tp6-chrome-imgur** 27336 - ❌ 27337 - ❌ 27338 - ❌ 27339 - ❌ 27340 * - **browsertime-tp6-custom-car-imgur** 27341 - ❌ 27342 - ❌ 27343 - ❌ 27344 - ❌ 27345 * - **browsertime-tp6-firefox-imgur** 27346 - ✅ 27347 - ✅ 27348 - ❌ 27349 - ❌ 27350 * - **browsertime-tp6-live-firefox-imgur** 27351 - ❌ 27352 - ❌ 27353 - ❌ 27354 - ❌ 27355 * - **browsertime-tp6-live-safari-imgur** 27356 - ❌ 27357 - ❌ 27358 - ❌ 27359 - ❌ 27360 27361 27362 .. list-table:: **test-macosx1470-64/opt** 27363 :widths: 30 15 15 15 15 27364 :header-rows: 1 27365 27366 * - **Test Name** 27367 - mozilla-central 27368 - autoland 27369 - mozilla-release 27370 - mozilla-beta 27371 * - **browsertime-tp6-firefox-imgur** 27372 - ❌ 27373 - ❌ 27374 - ❌ 27375 - ❌ 27376 * - **browsertime-tp6-live-firefox-imgur** 27377 - ❌ 27378 - ❌ 27379 - ❌ 27380 - ❌ 27381 27382 27383 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 27384 :widths: 30 15 15 15 15 27385 :header-rows: 1 27386 27387 * - **Test Name** 27388 - mozilla-central 27389 - autoland 27390 - mozilla-release 27391 - mozilla-beta 27392 * - **browsertime-tp6-firefox-imgur** 27393 - ❌ 27394 - ❌ 27395 - ❌ 27396 - ❌ 27397 * - **browsertime-tp6-live-firefox-imgur** 27398 - ❌ 27399 - ❌ 27400 - ❌ 27401 - ❌ 27402 27403 27404 .. list-table:: **test-windows11-64-24h2-shippable/opt** 27405 :widths: 30 15 15 15 15 27406 :header-rows: 1 27407 27408 * - **Test Name** 27409 - mozilla-central 27410 - autoland 27411 - mozilla-release 27412 - mozilla-beta 27413 * - **browsertime-tp6-chrome-imgur** 27414 - ❌ 27415 - ❌ 27416 - ❌ 27417 - ❌ 27418 * - **browsertime-tp6-custom-car-imgur** 27419 - ❌ 27420 - ❌ 27421 - ❌ 27422 - ❌ 27423 * - **browsertime-tp6-firefox-imgur** 27424 - ✅ 27425 - ✅ 27426 - ❌ 27427 - ❌ 27428 * - **browsertime-tp6-live-firefox-imgur** 27429 - ❌ 27430 - ❌ 27431 - ❌ 27432 - ❌ 27433 27434 27435 .. list-table:: **test-windows11-64-24h2/opt** 27436 :widths: 30 15 15 15 15 27437 :header-rows: 1 27438 27439 * - **Test Name** 27440 - mozilla-central 27441 - autoland 27442 - mozilla-release 27443 - mozilla-beta 27444 * - **browsertime-tp6-firefox-imgur** 27445 - ❌ 27446 - ❌ 27447 - ❌ 27448 - ❌ 27449 * - **browsertime-tp6-live-firefox-imgur** 27450 - ❌ 27451 - ❌ 27452 - ❌ 27453 - ❌ 27454 27455 27456 27457 .. dropdown:: instagram 27458 :class-container: anchor-id-instagram-d 27459 27460 * Command to Run Locally 27461 27462 .. code-block:: 27463 27464 ./mach raptor -t instagram 27465 27466 **Owner**: PerfTest Team 27467 27468 * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__, `largestContentfulPaint <raptor-metrics.html#largest-contentful-paint>`__ 27469 * **alert threshold**: 2.0 27470 * **apps**: firefox, chrome, safari, custom-car 27471 * **benchmark page**: true 27472 * **browser cycles**: 25 27473 * **expected**: pass 27474 * **gecko profile interval**: 1 27475 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#119>`__ 27476 * **lower is better**: true 27477 * **page cycles**: 25 27478 * **page timeout**: 60000 27479 * **playback**: mitmproxy 27480 * **playback pageset manifest**: mitm8-darwin-firefox-instagram.manifest 27481 * **playback version**: 11.0.0 27482 * **secondary url**: `<https://www.instagram.com/nobelprize_org/>`__ 27483 * **support class**: browsertime_pageload.py 27484 * **test url**: `<https://www.instagram.com/>`__ 27485 * **type**: pageload 27486 * **unit**: ms 27487 * **use live sites**: false 27488 * **Test Task**: 27489 27490 .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** 27491 :widths: 30 15 15 15 15 27492 :header-rows: 1 27493 27494 * - **Test Name** 27495 - mozilla-central 27496 - autoland 27497 - mozilla-release 27498 - mozilla-beta 27499 * - **browsertime-tp6-bytecode-firefox-instagram** 27500 - ❌ 27501 - ❌ 27502 - ❌ 27503 - ❌ 27504 * - **browsertime-tp6-essential-firefox-instagram** 27505 - ❌ 27506 - ❌ 27507 - ❌ 27508 - ❌ 27509 * - **browsertime-tp6-live-firefox-instagram** 27510 - ❌ 27511 - ❌ 27512 - ❌ 27513 - ❌ 27514 27515 27516 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 27517 :widths: 30 15 15 15 15 27518 :header-rows: 1 27519 27520 * - **Test Name** 27521 - mozilla-central 27522 - autoland 27523 - mozilla-release 27524 - mozilla-beta 27525 * - **browsertime-tp6-bytecode-firefox-instagram** 27526 - ❌ 27527 - ❌ 27528 - ❌ 27529 - ❌ 27530 * - **browsertime-tp6-essential-firefox-instagram** 27531 - ❌ 27532 - ❌ 27533 - ❌ 27534 - ❌ 27535 * - **browsertime-tp6-live-firefox-instagram** 27536 - ❌ 27537 - ❌ 27538 - ❌ 27539 - ❌ 27540 27541 27542 .. list-table:: **test-linux1804-64-qr/opt** 27543 :widths: 30 15 15 15 15 27544 :header-rows: 1 27545 27546 * - **Test Name** 27547 - mozilla-central 27548 - autoland 27549 - mozilla-release 27550 - mozilla-beta 27551 * - **browsertime-tp6-bytecode-firefox-instagram** 27552 - ❌ 27553 - ❌ 27554 - ❌ 27555 - ❌ 27556 * - **browsertime-tp6-essential-firefox-instagram** 27557 - ❌ 27558 - ❌ 27559 - ❌ 27560 - ❌ 27561 * - **browsertime-tp6-live-firefox-instagram** 27562 - ❌ 27563 - ❌ 27564 - ❌ 27565 - ❌ 27566 27567 27568 .. list-table:: **test-linux1804-64-shippable-qr/opt** 27569 :widths: 30 15 15 15 15 27570 :header-rows: 1 27571 27572 * - **Test Name** 27573 - mozilla-central 27574 - autoland 27575 - mozilla-release 27576 - mozilla-beta 27577 * - **browsertime-tp6-bytecode-firefox-instagram** 27578 - ✅ 27579 - ✅ 27580 - ❌ 27581 - ❌ 27582 * - **browsertime-tp6-essential-chrome-instagram** 27583 - ❌ 27584 - ❌ 27585 - ❌ 27586 - ❌ 27587 * - **browsertime-tp6-essential-custom-car-instagram** 27588 - ❌ 27589 - ❌ 27590 - ❌ 27591 - ❌ 27592 * - **browsertime-tp6-essential-firefox-instagram** 27593 - ✅ 27594 - ✅ 27595 - ❌ 27596 - ❌ 27597 * - **browsertime-tp6-live-chrome-instagram** 27598 - ❌ 27599 - ❌ 27600 - ❌ 27601 - ❌ 27602 * - **browsertime-tp6-live-firefox-instagram** 27603 - ❌ 27604 - ❌ 27605 - ❌ 27606 - ❌ 27607 27608 27609 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 27610 :widths: 30 15 15 15 15 27611 :header-rows: 1 27612 27613 * - **Test Name** 27614 - mozilla-central 27615 - autoland 27616 - mozilla-release 27617 - mozilla-beta 27618 * - **browsertime-tp6-bytecode-firefox-instagram** 27619 - ❌ 27620 - ❌ 27621 - ❌ 27622 - ❌ 27623 * - **browsertime-tp6-essential-firefox-instagram** 27624 - ❌ 27625 - ❌ 27626 - ❌ 27627 - ❌ 27628 * - **browsertime-tp6-live-firefox-instagram** 27629 - ❌ 27630 - ❌ 27631 - ❌ 27632 - ❌ 27633 27634 27635 .. list-table:: **test-macosx1470-64-shippable/opt** 27636 :widths: 30 15 15 15 15 27637 :header-rows: 1 27638 27639 * - **Test Name** 27640 - mozilla-central 27641 - autoland 27642 - mozilla-release 27643 - mozilla-beta 27644 * - **browsertime-tp6-bytecode-firefox-instagram** 27645 - ✅ 27646 - ✅ 27647 - ❌ 27648 - ❌ 27649 * - **browsertime-tp6-essential-chrome-instagram** 27650 - ❌ 27651 - ❌ 27652 - ❌ 27653 - ❌ 27654 * - **browsertime-tp6-essential-custom-car-instagram** 27655 - ❌ 27656 - ❌ 27657 - ❌ 27658 - ❌ 27659 * - **browsertime-tp6-essential-firefox-instagram** 27660 - ✅ 27661 - ✅ 27662 - ❌ 27663 - ❌ 27664 * - **browsertime-tp6-live-chrome-instagram** 27665 - ❌ 27666 - ❌ 27667 - ❌ 27668 - ❌ 27669 * - **browsertime-tp6-live-firefox-instagram** 27670 - ❌ 27671 - ❌ 27672 - ❌ 27673 - ❌ 27674 27675 27676 .. list-table:: **test-macosx1470-64/opt** 27677 :widths: 30 15 15 15 15 27678 :header-rows: 1 27679 27680 * - **Test Name** 27681 - mozilla-central 27682 - autoland 27683 - mozilla-release 27684 - mozilla-beta 27685 * - **browsertime-tp6-bytecode-firefox-instagram** 27686 - ❌ 27687 - ❌ 27688 - ❌ 27689 - ❌ 27690 * - **browsertime-tp6-essential-firefox-instagram** 27691 - ❌ 27692 - ❌ 27693 - ❌ 27694 - ❌ 27695 * - **browsertime-tp6-live-firefox-instagram** 27696 - ❌ 27697 - ❌ 27698 - ❌ 27699 - ❌ 27700 27701 27702 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 27703 :widths: 30 15 15 15 15 27704 :header-rows: 1 27705 27706 * - **Test Name** 27707 - mozilla-central 27708 - autoland 27709 - mozilla-release 27710 - mozilla-beta 27711 * - **browsertime-tp6-bytecode-firefox-instagram** 27712 - ❌ 27713 - ❌ 27714 - ❌ 27715 - ❌ 27716 * - **browsertime-tp6-essential-firefox-instagram** 27717 - ❌ 27718 - ❌ 27719 - ❌ 27720 - ❌ 27721 * - **browsertime-tp6-live-firefox-instagram** 27722 - ❌ 27723 - ❌ 27724 - ❌ 27725 - ❌ 27726 27727 27728 .. list-table:: **test-windows11-64-24h2-shippable/opt** 27729 :widths: 30 15 15 15 15 27730 :header-rows: 1 27731 27732 * - **Test Name** 27733 - mozilla-central 27734 - autoland 27735 - mozilla-release 27736 - mozilla-beta 27737 * - **browsertime-tp6-bytecode-firefox-instagram** 27738 - ✅ 27739 - ✅ 27740 - ❌ 27741 - ❌ 27742 * - **browsertime-tp6-essential-chrome-instagram** 27743 - ❌ 27744 - ❌ 27745 - ❌ 27746 - ❌ 27747 * - **browsertime-tp6-essential-custom-car-instagram** 27748 - ❌ 27749 - ❌ 27750 - ❌ 27751 - ❌ 27752 * - **browsertime-tp6-essential-firefox-instagram** 27753 - ✅ 27754 - ✅ 27755 - ❌ 27756 - ❌ 27757 * - **browsertime-tp6-live-chrome-instagram** 27758 - ❌ 27759 - ❌ 27760 - ❌ 27761 - ❌ 27762 * - **browsertime-tp6-live-firefox-instagram** 27763 - ❌ 27764 - ❌ 27765 - ❌ 27766 - ❌ 27767 27768 27769 .. list-table:: **test-windows11-64-24h2/opt** 27770 :widths: 30 15 15 15 15 27771 :header-rows: 1 27772 27773 * - **Test Name** 27774 - mozilla-central 27775 - autoland 27776 - mozilla-release 27777 - mozilla-beta 27778 * - **browsertime-tp6-bytecode-firefox-instagram** 27779 - ❌ 27780 - ❌ 27781 - ❌ 27782 - ❌ 27783 * - **browsertime-tp6-essential-firefox-instagram** 27784 - ❌ 27785 - ❌ 27786 - ❌ 27787 - ❌ 27788 * - **browsertime-tp6-live-firefox-instagram** 27789 - ❌ 27790 - ❌ 27791 - ❌ 27792 - ❌ 27793 27794 27795 27796 .. dropdown:: linkedin 27797 :class-container: anchor-id-linkedin-d 27798 27799 * Command to Run Locally 27800 27801 .. code-block:: 27802 27803 ./mach raptor -t linkedin 27804 27805 **Owner**: PerfTest Team 27806 27807 * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__, `largestContentfulPaint <raptor-metrics.html#largest-contentful-paint>`__ 27808 * **alert threshold**: 2.0 27809 * **apps**: firefox, chrome, safari, custom-car 27810 * **benchmark page**: true 27811 * **browser cycles**: 25 27812 * **expected**: pass 27813 * **gecko profile interval**: 1 27814 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#124>`__ 27815 * **lower is better**: true 27816 * **page cycles**: 25 27817 * **page timeout**: 60000 27818 * **playback**: mitmproxy 27819 * **playback pageset manifest**: mitm6-linux-firefox-linkedin.manifest 27820 * **playback version**: 8.1.1 27821 * **secondary url**: `<https://www.linkedin.com/in/thommy-harris-hk-385723106/>`__ 27822 * **support class**: browsertime_pageload.py 27823 * **test url**: `<https://www.linkedin.com/feed/>`__ 27824 * **type**: pageload 27825 * **unit**: ms 27826 * **use live sites**: false 27827 * **Test Task**: 27828 27829 .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** 27830 :widths: 30 15 15 15 15 27831 :header-rows: 1 27832 27833 * - **Test Name** 27834 - mozilla-central 27835 - autoland 27836 - mozilla-release 27837 - mozilla-beta 27838 * - **browsertime-tp6-firefox-linkedin** 27839 - ❌ 27840 - ❌ 27841 - ❌ 27842 - ❌ 27843 * - **browsertime-tp6-live-firefox-linkedin** 27844 - ❌ 27845 - ❌ 27846 - ❌ 27847 - ❌ 27848 27849 27850 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 27851 :widths: 30 15 15 15 15 27852 :header-rows: 1 27853 27854 * - **Test Name** 27855 - mozilla-central 27856 - autoland 27857 - mozilla-release 27858 - mozilla-beta 27859 * - **browsertime-tp6-firefox-linkedin** 27860 - ❌ 27861 - ❌ 27862 - ❌ 27863 - ❌ 27864 * - **browsertime-tp6-live-firefox-linkedin** 27865 - ❌ 27866 - ❌ 27867 - ❌ 27868 - ❌ 27869 27870 27871 .. list-table:: **test-linux1804-64-qr/opt** 27872 :widths: 30 15 15 15 15 27873 :header-rows: 1 27874 27875 * - **Test Name** 27876 - mozilla-central 27877 - autoland 27878 - mozilla-release 27879 - mozilla-beta 27880 * - **browsertime-tp6-firefox-linkedin** 27881 - ❌ 27882 - ❌ 27883 - ❌ 27884 - ❌ 27885 * - **browsertime-tp6-live-firefox-linkedin** 27886 - ❌ 27887 - ❌ 27888 - ❌ 27889 - ❌ 27890 27891 27892 .. list-table:: **test-linux1804-64-shippable-qr/opt** 27893 :widths: 30 15 15 15 15 27894 :header-rows: 1 27895 27896 * - **Test Name** 27897 - mozilla-central 27898 - autoland 27899 - mozilla-release 27900 - mozilla-beta 27901 * - **browsertime-tp6-chrome-linkedin** 27902 - ❌ 27903 - ❌ 27904 - ❌ 27905 - ❌ 27906 * - **browsertime-tp6-custom-car-linkedin** 27907 - ❌ 27908 - ❌ 27909 - ❌ 27910 - ❌ 27911 * - **browsertime-tp6-firefox-linkedin** 27912 - ✅ 27913 - ✅ 27914 - ❌ 27915 - ❌ 27916 * - **browsertime-tp6-live-chrome-linkedin** 27917 - ❌ 27918 - ❌ 27919 - ❌ 27920 - ❌ 27921 * - **browsertime-tp6-live-firefox-linkedin** 27922 - ❌ 27923 - ❌ 27924 - ❌ 27925 - ❌ 27926 27927 27928 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 27929 :widths: 30 15 15 15 15 27930 :header-rows: 1 27931 27932 * - **Test Name** 27933 - mozilla-central 27934 - autoland 27935 - mozilla-release 27936 - mozilla-beta 27937 * - **browsertime-tp6-firefox-linkedin** 27938 - ❌ 27939 - ❌ 27940 - ❌ 27941 - ❌ 27942 * - **browsertime-tp6-live-firefox-linkedin** 27943 - ❌ 27944 - ❌ 27945 - ❌ 27946 - ❌ 27947 27948 27949 .. list-table:: **test-macosx1470-64-shippable/opt** 27950 :widths: 30 15 15 15 15 27951 :header-rows: 1 27952 27953 * - **Test Name** 27954 - mozilla-central 27955 - autoland 27956 - mozilla-release 27957 - mozilla-beta 27958 * - **browsertime-tp6-chrome-linkedin** 27959 - ❌ 27960 - ❌ 27961 - ❌ 27962 - ❌ 27963 * - **browsertime-tp6-custom-car-linkedin** 27964 - ❌ 27965 - ❌ 27966 - ❌ 27967 - ❌ 27968 * - **browsertime-tp6-firefox-linkedin** 27969 - ✅ 27970 - ✅ 27971 - ❌ 27972 - ❌ 27973 * - **browsertime-tp6-live-chrome-linkedin** 27974 - ❌ 27975 - ❌ 27976 - ❌ 27977 - ❌ 27978 * - **browsertime-tp6-live-firefox-linkedin** 27979 - ❌ 27980 - ❌ 27981 - ❌ 27982 - ❌ 27983 * - **browsertime-tp6-live-safari-linkedin** 27984 - ❌ 27985 - ❌ 27986 - ❌ 27987 - ❌ 27988 27989 27990 .. list-table:: **test-macosx1470-64/opt** 27991 :widths: 30 15 15 15 15 27992 :header-rows: 1 27993 27994 * - **Test Name** 27995 - mozilla-central 27996 - autoland 27997 - mozilla-release 27998 - mozilla-beta 27999 * - **browsertime-tp6-firefox-linkedin** 28000 - ❌ 28001 - ❌ 28002 - ❌ 28003 - ❌ 28004 * - **browsertime-tp6-live-firefox-linkedin** 28005 - ❌ 28006 - ❌ 28007 - ❌ 28008 - ❌ 28009 28010 28011 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 28012 :widths: 30 15 15 15 15 28013 :header-rows: 1 28014 28015 * - **Test Name** 28016 - mozilla-central 28017 - autoland 28018 - mozilla-release 28019 - mozilla-beta 28020 * - **browsertime-tp6-firefox-linkedin** 28021 - ❌ 28022 - ❌ 28023 - ❌ 28024 - ❌ 28025 * - **browsertime-tp6-live-firefox-linkedin** 28026 - ❌ 28027 - ❌ 28028 - ❌ 28029 - ❌ 28030 28031 28032 .. list-table:: **test-windows11-64-24h2-shippable/opt** 28033 :widths: 30 15 15 15 15 28034 :header-rows: 1 28035 28036 * - **Test Name** 28037 - mozilla-central 28038 - autoland 28039 - mozilla-release 28040 - mozilla-beta 28041 * - **browsertime-tp6-chrome-linkedin** 28042 - ❌ 28043 - ❌ 28044 - ❌ 28045 - ❌ 28046 * - **browsertime-tp6-custom-car-linkedin** 28047 - ❌ 28048 - ❌ 28049 - ❌ 28050 - ❌ 28051 * - **browsertime-tp6-firefox-linkedin** 28052 - ✅ 28053 - ✅ 28054 - ❌ 28055 - ❌ 28056 * - **browsertime-tp6-live-chrome-linkedin** 28057 - ❌ 28058 - ❌ 28059 - ❌ 28060 - ❌ 28061 * - **browsertime-tp6-live-firefox-linkedin** 28062 - ❌ 28063 - ❌ 28064 - ❌ 28065 - ❌ 28066 28067 28068 .. list-table:: **test-windows11-64-24h2/opt** 28069 :widths: 30 15 15 15 15 28070 :header-rows: 1 28071 28072 * - **Test Name** 28073 - mozilla-central 28074 - autoland 28075 - mozilla-release 28076 - mozilla-beta 28077 * - **browsertime-tp6-firefox-linkedin** 28078 - ❌ 28079 - ❌ 28080 - ❌ 28081 - ❌ 28082 * - **browsertime-tp6-live-firefox-linkedin** 28083 - ❌ 28084 - ❌ 28085 - ❌ 28086 - ❌ 28087 28088 28089 28090 .. dropdown:: microsoft 28091 :class-container: anchor-id-microsoft-d 28092 28093 * Command to Run Locally 28094 28095 .. code-block:: 28096 28097 ./mach raptor -t microsoft 28098 28099 **Owner**: PerfTest Team 28100 28101 * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__, `largestContentfulPaint <raptor-metrics.html#largest-contentful-paint>`__ 28102 * **alert threshold**: 2.0 28103 * **apps**: firefox, chrome, safari, custom-car 28104 * **benchmark page**: true 28105 * **browser cycles**: 25 28106 * **expected**: pass 28107 * **gecko profile interval**: 1 28108 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#130>`__ 28109 * **lower is better**: true 28110 * **page cycles**: 25 28111 * **page timeout**: 60000 28112 * **playback**: mitmproxy 28113 * **playback pageset manifest**: mitm8-linux-firefox-microsoft.manifest 28114 * **playback version**: 11.0.0 28115 * **secondary url**: `<https://support.microsoft.com/en-us>`__ 28116 * **support class**: browsertime_pageload.py 28117 * **test url**: `<https://www.microsoft.com/en-us/>`__ 28118 * **type**: pageload 28119 * **unit**: ms 28120 * **use live sites**: false 28121 * **Test Task**: 28122 28123 .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** 28124 :widths: 30 15 15 15 15 28125 :header-rows: 1 28126 28127 * - **Test Name** 28128 - mozilla-central 28129 - autoland 28130 - mozilla-release 28131 - mozilla-beta 28132 * - **browsertime-tp6-firefox-microsoft** 28133 - ❌ 28134 - ❌ 28135 - ❌ 28136 - ❌ 28137 * - **browsertime-tp6-live-firefox-microsoft** 28138 - ❌ 28139 - ❌ 28140 - ❌ 28141 - ❌ 28142 28143 28144 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 28145 :widths: 30 15 15 15 15 28146 :header-rows: 1 28147 28148 * - **Test Name** 28149 - mozilla-central 28150 - autoland 28151 - mozilla-release 28152 - mozilla-beta 28153 * - **browsertime-tp6-firefox-microsoft** 28154 - ❌ 28155 - ❌ 28156 - ❌ 28157 - ❌ 28158 * - **browsertime-tp6-live-firefox-microsoft** 28159 - ❌ 28160 - ❌ 28161 - ❌ 28162 - ❌ 28163 28164 28165 .. list-table:: **test-linux1804-64-qr/opt** 28166 :widths: 30 15 15 15 15 28167 :header-rows: 1 28168 28169 * - **Test Name** 28170 - mozilla-central 28171 - autoland 28172 - mozilla-release 28173 - mozilla-beta 28174 * - **browsertime-tp6-firefox-microsoft** 28175 - ❌ 28176 - ❌ 28177 - ❌ 28178 - ❌ 28179 * - **browsertime-tp6-live-firefox-microsoft** 28180 - ❌ 28181 - ❌ 28182 - ❌ 28183 - ❌ 28184 28185 28186 .. list-table:: **test-linux1804-64-shippable-qr/opt** 28187 :widths: 30 15 15 15 15 28188 :header-rows: 1 28189 28190 * - **Test Name** 28191 - mozilla-central 28192 - autoland 28193 - mozilla-release 28194 - mozilla-beta 28195 * - **browsertime-tp6-chrome-microsoft** 28196 - ❌ 28197 - ❌ 28198 - ❌ 28199 - ❌ 28200 * - **browsertime-tp6-custom-car-microsoft** 28201 - ❌ 28202 - ❌ 28203 - ❌ 28204 - ❌ 28205 * - **browsertime-tp6-firefox-microsoft** 28206 - ✅ 28207 - ✅ 28208 - ❌ 28209 - ❌ 28210 * - **browsertime-tp6-live-chrome-microsoft** 28211 - ❌ 28212 - ❌ 28213 - ❌ 28214 - ❌ 28215 * - **browsertime-tp6-live-firefox-microsoft** 28216 - ❌ 28217 - ❌ 28218 - ❌ 28219 - ❌ 28220 28221 28222 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 28223 :widths: 30 15 15 15 15 28224 :header-rows: 1 28225 28226 * - **Test Name** 28227 - mozilla-central 28228 - autoland 28229 - mozilla-release 28230 - mozilla-beta 28231 * - **browsertime-tp6-firefox-microsoft** 28232 - ❌ 28233 - ❌ 28234 - ❌ 28235 - ❌ 28236 * - **browsertime-tp6-live-firefox-microsoft** 28237 - ❌ 28238 - ❌ 28239 - ❌ 28240 - ❌ 28241 28242 28243 .. list-table:: **test-macosx1470-64-shippable/opt** 28244 :widths: 30 15 15 15 15 28245 :header-rows: 1 28246 28247 * - **Test Name** 28248 - mozilla-central 28249 - autoland 28250 - mozilla-release 28251 - mozilla-beta 28252 * - **browsertime-tp6-chrome-microsoft** 28253 - ❌ 28254 - ❌ 28255 - ❌ 28256 - ❌ 28257 * - **browsertime-tp6-custom-car-microsoft** 28258 - ❌ 28259 - ❌ 28260 - ❌ 28261 - ❌ 28262 * - **browsertime-tp6-firefox-microsoft** 28263 - ✅ 28264 - ✅ 28265 - ❌ 28266 - ❌ 28267 * - **browsertime-tp6-live-chrome-microsoft** 28268 - ❌ 28269 - ❌ 28270 - ❌ 28271 - ❌ 28272 * - **browsertime-tp6-live-firefox-microsoft** 28273 - ❌ 28274 - ❌ 28275 - ❌ 28276 - ❌ 28277 * - **browsertime-tp6-live-safari-microsoft** 28278 - ❌ 28279 - ❌ 28280 - ❌ 28281 - ❌ 28282 28283 28284 .. list-table:: **test-macosx1470-64/opt** 28285 :widths: 30 15 15 15 15 28286 :header-rows: 1 28287 28288 * - **Test Name** 28289 - mozilla-central 28290 - autoland 28291 - mozilla-release 28292 - mozilla-beta 28293 * - **browsertime-tp6-firefox-microsoft** 28294 - ❌ 28295 - ❌ 28296 - ❌ 28297 - ❌ 28298 * - **browsertime-tp6-live-firefox-microsoft** 28299 - ❌ 28300 - ❌ 28301 - ❌ 28302 - ❌ 28303 28304 28305 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 28306 :widths: 30 15 15 15 15 28307 :header-rows: 1 28308 28309 * - **Test Name** 28310 - mozilla-central 28311 - autoland 28312 - mozilla-release 28313 - mozilla-beta 28314 * - **browsertime-tp6-firefox-microsoft** 28315 - ❌ 28316 - ❌ 28317 - ❌ 28318 - ❌ 28319 * - **browsertime-tp6-live-firefox-microsoft** 28320 - ❌ 28321 - ❌ 28322 - ❌ 28323 - ❌ 28324 28325 28326 .. list-table:: **test-windows11-64-24h2-shippable/opt** 28327 :widths: 30 15 15 15 15 28328 :header-rows: 1 28329 28330 * - **Test Name** 28331 - mozilla-central 28332 - autoland 28333 - mozilla-release 28334 - mozilla-beta 28335 * - **browsertime-tp6-chrome-microsoft** 28336 - ❌ 28337 - ❌ 28338 - ❌ 28339 - ❌ 28340 * - **browsertime-tp6-custom-car-microsoft** 28341 - ❌ 28342 - ❌ 28343 - ❌ 28344 - ❌ 28345 * - **browsertime-tp6-firefox-microsoft** 28346 - ✅ 28347 - ✅ 28348 - ❌ 28349 - ❌ 28350 * - **browsertime-tp6-live-chrome-microsoft** 28351 - ❌ 28352 - ❌ 28353 - ❌ 28354 - ❌ 28355 * - **browsertime-tp6-live-firefox-microsoft** 28356 - ❌ 28357 - ❌ 28358 - ❌ 28359 - ❌ 28360 28361 28362 .. list-table:: **test-windows11-64-24h2/opt** 28363 :widths: 30 15 15 15 15 28364 :header-rows: 1 28365 28366 * - **Test Name** 28367 - mozilla-central 28368 - autoland 28369 - mozilla-release 28370 - mozilla-beta 28371 * - **browsertime-tp6-firefox-microsoft** 28372 - ❌ 28373 - ❌ 28374 - ❌ 28375 - ❌ 28376 * - **browsertime-tp6-live-firefox-microsoft** 28377 - ❌ 28378 - ❌ 28379 - ❌ 28380 - ❌ 28381 28382 28383 28384 .. dropdown:: netflix 28385 :class-container: anchor-id-netflix-d 28386 28387 * Command to Run Locally 28388 28389 .. code-block:: 28390 28391 ./mach raptor -t netflix 28392 28393 **Owner**: PerfTest Team 28394 28395 * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__, `largestContentfulPaint <raptor-metrics.html#largest-contentful-paint>`__ 28396 * **alert threshold**: 2.0 28397 * **apps**: firefox, chrome, safari, custom-car 28398 * **benchmark page**: true 28399 * **browser cycles**: 25 28400 * **expected**: pass 28401 * **gecko profile interval**: 1 28402 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#135>`__ 28403 * **lower is better**: true 28404 * **page cycles**: 25 28405 * **page timeout**: 60000 28406 * **playback**: mitmproxy 28407 * **playback pageset manifest**: mitm6-linux-firefox-netflix.manifest 28408 * **playback version**: 8.1.1 28409 * **secondary url**: `<https://www.netflix.com/title/699257>`__ 28410 * **support class**: browsertime_pageload.py 28411 * **test url**: `<https://www.netflix.com/title/80117263>`__ 28412 * **type**: pageload 28413 * **unit**: ms 28414 * **use live sites**: false 28415 * **Test Task**: 28416 28417 .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** 28418 :widths: 30 15 15 15 15 28419 :header-rows: 1 28420 28421 * - **Test Name** 28422 - mozilla-central 28423 - autoland 28424 - mozilla-release 28425 - mozilla-beta 28426 * - **browsertime-tp6-firefox-netflix** 28427 - ❌ 28428 - ❌ 28429 - ❌ 28430 - ❌ 28431 * - **browsertime-tp6-live-firefox-netflix** 28432 - ❌ 28433 - ❌ 28434 - ❌ 28435 - ❌ 28436 28437 28438 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 28439 :widths: 30 15 15 15 15 28440 :header-rows: 1 28441 28442 * - **Test Name** 28443 - mozilla-central 28444 - autoland 28445 - mozilla-release 28446 - mozilla-beta 28447 * - **browsertime-tp6-firefox-netflix** 28448 - ❌ 28449 - ❌ 28450 - ❌ 28451 - ❌ 28452 * - **browsertime-tp6-live-firefox-netflix** 28453 - ❌ 28454 - ❌ 28455 - ❌ 28456 - ❌ 28457 28458 28459 .. list-table:: **test-linux1804-64-qr/opt** 28460 :widths: 30 15 15 15 15 28461 :header-rows: 1 28462 28463 * - **Test Name** 28464 - mozilla-central 28465 - autoland 28466 - mozilla-release 28467 - mozilla-beta 28468 * - **browsertime-tp6-firefox-netflix** 28469 - ❌ 28470 - ❌ 28471 - ❌ 28472 - ❌ 28473 * - **browsertime-tp6-live-firefox-netflix** 28474 - ❌ 28475 - ❌ 28476 - ❌ 28477 - ❌ 28478 28479 28480 .. list-table:: **test-linux1804-64-shippable-qr/opt** 28481 :widths: 30 15 15 15 15 28482 :header-rows: 1 28483 28484 * - **Test Name** 28485 - mozilla-central 28486 - autoland 28487 - mozilla-release 28488 - mozilla-beta 28489 * - **browsertime-tp6-chrome-netflix** 28490 - ❌ 28491 - ❌ 28492 - ❌ 28493 - ❌ 28494 * - **browsertime-tp6-custom-car-netflix** 28495 - ❌ 28496 - ❌ 28497 - ❌ 28498 - ❌ 28499 * - **browsertime-tp6-firefox-netflix** 28500 - ✅ 28501 - ✅ 28502 - ❌ 28503 - ❌ 28504 * - **browsertime-tp6-live-chrome-netflix** 28505 - ❌ 28506 - ❌ 28507 - ❌ 28508 - ❌ 28509 * - **browsertime-tp6-live-firefox-netflix** 28510 - ❌ 28511 - ❌ 28512 - ❌ 28513 - ❌ 28514 28515 28516 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 28517 :widths: 30 15 15 15 15 28518 :header-rows: 1 28519 28520 * - **Test Name** 28521 - mozilla-central 28522 - autoland 28523 - mozilla-release 28524 - mozilla-beta 28525 * - **browsertime-tp6-firefox-netflix** 28526 - ❌ 28527 - ❌ 28528 - ❌ 28529 - ❌ 28530 * - **browsertime-tp6-live-firefox-netflix** 28531 - ❌ 28532 - ❌ 28533 - ❌ 28534 - ❌ 28535 28536 28537 .. list-table:: **test-macosx1470-64-shippable/opt** 28538 :widths: 30 15 15 15 15 28539 :header-rows: 1 28540 28541 * - **Test Name** 28542 - mozilla-central 28543 - autoland 28544 - mozilla-release 28545 - mozilla-beta 28546 * - **browsertime-tp6-chrome-netflix** 28547 - ❌ 28548 - ❌ 28549 - ❌ 28550 - ❌ 28551 * - **browsertime-tp6-custom-car-netflix** 28552 - ❌ 28553 - ❌ 28554 - ❌ 28555 - ❌ 28556 * - **browsertime-tp6-firefox-netflix** 28557 - ✅ 28558 - ✅ 28559 - ❌ 28560 - ❌ 28561 * - **browsertime-tp6-live-chrome-netflix** 28562 - ❌ 28563 - ❌ 28564 - ❌ 28565 - ❌ 28566 * - **browsertime-tp6-live-firefox-netflix** 28567 - ❌ 28568 - ❌ 28569 - ❌ 28570 - ❌ 28571 28572 28573 .. list-table:: **test-macosx1470-64/opt** 28574 :widths: 30 15 15 15 15 28575 :header-rows: 1 28576 28577 * - **Test Name** 28578 - mozilla-central 28579 - autoland 28580 - mozilla-release 28581 - mozilla-beta 28582 * - **browsertime-tp6-firefox-netflix** 28583 - ❌ 28584 - ❌ 28585 - ❌ 28586 - ❌ 28587 * - **browsertime-tp6-live-firefox-netflix** 28588 - ❌ 28589 - ❌ 28590 - ❌ 28591 - ❌ 28592 28593 28594 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 28595 :widths: 30 15 15 15 15 28596 :header-rows: 1 28597 28598 * - **Test Name** 28599 - mozilla-central 28600 - autoland 28601 - mozilla-release 28602 - mozilla-beta 28603 * - **browsertime-tp6-firefox-netflix** 28604 - ❌ 28605 - ❌ 28606 - ❌ 28607 - ❌ 28608 * - **browsertime-tp6-live-firefox-netflix** 28609 - ❌ 28610 - ❌ 28611 - ❌ 28612 - ❌ 28613 28614 28615 .. list-table:: **test-windows11-64-24h2-shippable/opt** 28616 :widths: 30 15 15 15 15 28617 :header-rows: 1 28618 28619 * - **Test Name** 28620 - mozilla-central 28621 - autoland 28622 - mozilla-release 28623 - mozilla-beta 28624 * - **browsertime-tp6-chrome-netflix** 28625 - ❌ 28626 - ❌ 28627 - ❌ 28628 - ❌ 28629 * - **browsertime-tp6-custom-car-netflix** 28630 - ❌ 28631 - ❌ 28632 - ❌ 28633 - ❌ 28634 * - **browsertime-tp6-firefox-netflix** 28635 - ✅ 28636 - ✅ 28637 - ❌ 28638 - ❌ 28639 * - **browsertime-tp6-live-chrome-netflix** 28640 - ❌ 28641 - ❌ 28642 - ❌ 28643 - ❌ 28644 * - **browsertime-tp6-live-firefox-netflix** 28645 - ❌ 28646 - ❌ 28647 - ❌ 28648 - ❌ 28649 28650 28651 .. list-table:: **test-windows11-64-24h2/opt** 28652 :widths: 30 15 15 15 15 28653 :header-rows: 1 28654 28655 * - **Test Name** 28656 - mozilla-central 28657 - autoland 28658 - mozilla-release 28659 - mozilla-beta 28660 * - **browsertime-tp6-firefox-netflix** 28661 - ❌ 28662 - ❌ 28663 - ❌ 28664 - ❌ 28665 * - **browsertime-tp6-live-firefox-netflix** 28666 - ❌ 28667 - ❌ 28668 - ❌ 28669 - ❌ 28670 28671 28672 28673 .. dropdown:: nytimes 28674 :class-container: anchor-id-nytimes-d 28675 28676 * Command to Run Locally 28677 28678 .. code-block:: 28679 28680 ./mach raptor -t nytimes 28681 28682 **Owner**: PerfTest Team 28683 28684 * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__, `largestContentfulPaint <raptor-metrics.html#largest-contentful-paint>`__ 28685 * **alert threshold**: 2.0 28686 * **apps**: firefox, chrome, safari, custom-car 28687 * **benchmark page**: true 28688 * **browser cycles**: 25 28689 * **expected**: pass 28690 * **gecko profile interval**: 1 28691 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#141>`__ 28692 * **lower is better**: true 28693 * **page cycles**: 25 28694 * **page timeout**: 60000 28695 * **playback**: mitmproxy 28696 * **playback pageset manifest**: mitm7-linux-firefox-nytimes.manifest 28697 * **playback version**: 11.0.0 28698 * **secondary url**: `<https://www.nytimes.com/section/opinion/columnists>`__ 28699 * **support class**: browsertime_pageload.py 28700 * **test url**: `<https://www.nytimes.com/2020/02/19/opinion/surprise-medical-bill.html>`__ 28701 * **type**: pageload 28702 * **unit**: ms 28703 * **use live sites**: false 28704 * **Test Task**: 28705 28706 .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** 28707 :widths: 30 15 15 15 15 28708 :header-rows: 1 28709 28710 * - **Test Name** 28711 - mozilla-central 28712 - autoland 28713 - mozilla-release 28714 - mozilla-beta 28715 * - **browsertime-tp6-firefox-nytimes** 28716 - ❌ 28717 - ❌ 28718 - ❌ 28719 - ❌ 28720 28721 28722 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 28723 :widths: 30 15 15 15 15 28724 :header-rows: 1 28725 28726 * - **Test Name** 28727 - mozilla-central 28728 - autoland 28729 - mozilla-release 28730 - mozilla-beta 28731 * - **browsertime-tp6-firefox-nytimes** 28732 - ❌ 28733 - ❌ 28734 - ❌ 28735 - ❌ 28736 28737 28738 .. list-table:: **test-linux1804-64-qr/opt** 28739 :widths: 30 15 15 15 15 28740 :header-rows: 1 28741 28742 * - **Test Name** 28743 - mozilla-central 28744 - autoland 28745 - mozilla-release 28746 - mozilla-beta 28747 * - **browsertime-tp6-firefox-nytimes** 28748 - ❌ 28749 - ❌ 28750 - ❌ 28751 - ❌ 28752 28753 28754 .. list-table:: **test-linux1804-64-shippable-qr/opt** 28755 :widths: 30 15 15 15 15 28756 :header-rows: 1 28757 28758 * - **Test Name** 28759 - mozilla-central 28760 - autoland 28761 - mozilla-release 28762 - mozilla-beta 28763 * - **browsertime-tp6-chrome-nytimes** 28764 - ❌ 28765 - ❌ 28766 - ❌ 28767 - ❌ 28768 * - **browsertime-tp6-custom-car-nytimes** 28769 - ❌ 28770 - ❌ 28771 - ❌ 28772 - ❌ 28773 * - **browsertime-tp6-firefox-nytimes** 28774 - ✅ 28775 - ✅ 28776 - ❌ 28777 - ❌ 28778 28779 28780 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 28781 :widths: 30 15 15 15 15 28782 :header-rows: 1 28783 28784 * - **Test Name** 28785 - mozilla-central 28786 - autoland 28787 - mozilla-release 28788 - mozilla-beta 28789 * - **browsertime-tp6-firefox-nytimes** 28790 - ❌ 28791 - ❌ 28792 - ❌ 28793 - ❌ 28794 28795 28796 .. list-table:: **test-macosx1470-64-shippable/opt** 28797 :widths: 30 15 15 15 15 28798 :header-rows: 1 28799 28800 * - **Test Name** 28801 - mozilla-central 28802 - autoland 28803 - mozilla-release 28804 - mozilla-beta 28805 * - **browsertime-tp6-chrome-nytimes** 28806 - ❌ 28807 - ❌ 28808 - ❌ 28809 - ❌ 28810 * - **browsertime-tp6-custom-car-nytimes** 28811 - ❌ 28812 - ❌ 28813 - ❌ 28814 - ❌ 28815 * - **browsertime-tp6-firefox-nytimes** 28816 - ✅ 28817 - ✅ 28818 - ❌ 28819 - ❌ 28820 28821 28822 .. list-table:: **test-macosx1470-64/opt** 28823 :widths: 30 15 15 15 15 28824 :header-rows: 1 28825 28826 * - **Test Name** 28827 - mozilla-central 28828 - autoland 28829 - mozilla-release 28830 - mozilla-beta 28831 * - **browsertime-tp6-firefox-nytimes** 28832 - ❌ 28833 - ❌ 28834 - ❌ 28835 - ❌ 28836 28837 28838 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 28839 :widths: 30 15 15 15 15 28840 :header-rows: 1 28841 28842 * - **Test Name** 28843 - mozilla-central 28844 - autoland 28845 - mozilla-release 28846 - mozilla-beta 28847 * - **browsertime-tp6-firefox-nytimes** 28848 - ❌ 28849 - ❌ 28850 - ❌ 28851 - ❌ 28852 28853 28854 .. list-table:: **test-windows11-64-24h2-shippable/opt** 28855 :widths: 30 15 15 15 15 28856 :header-rows: 1 28857 28858 * - **Test Name** 28859 - mozilla-central 28860 - autoland 28861 - mozilla-release 28862 - mozilla-beta 28863 * - **browsertime-tp6-chrome-nytimes** 28864 - ❌ 28865 - ❌ 28866 - ❌ 28867 - ❌ 28868 * - **browsertime-tp6-custom-car-nytimes** 28869 - ❌ 28870 - ❌ 28871 - ❌ 28872 - ❌ 28873 * - **browsertime-tp6-firefox-nytimes** 28874 - ✅ 28875 - ✅ 28876 - ❌ 28877 - ❌ 28878 28879 28880 .. list-table:: **test-windows11-64-24h2/opt** 28881 :widths: 30 15 15 15 15 28882 :header-rows: 1 28883 28884 * - **Test Name** 28885 - mozilla-central 28886 - autoland 28887 - mozilla-release 28888 - mozilla-beta 28889 * - **browsertime-tp6-firefox-nytimes** 28890 - ❌ 28891 - ❌ 28892 - ❌ 28893 - ❌ 28894 28895 28896 28897 .. dropdown:: office 28898 :class-container: anchor-id-office-d 28899 28900 * Command to Run Locally 28901 28902 .. code-block:: 28903 28904 ./mach raptor -t office 28905 28906 **Owner**: PerfTest Team 28907 28908 * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__, `largestContentfulPaint <raptor-metrics.html#largest-contentful-paint>`__ 28909 * **alert threshold**: 2.0 28910 * **apps**: firefox, chrome, safari, custom-car 28911 * **benchmark page**: true 28912 * **browser cycles**: 25 28913 * **expected**: pass 28914 * **gecko profile interval**: 1 28915 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#145>`__ 28916 * **lower is better**: true 28917 * **page cycles**: 25 28918 * **page timeout**: 60000 28919 * **playback**: mitmproxy 28920 * **playback pageset manifest**: mitm7-linux-firefox-office.manifest 28921 * **playback version**: 11.0.0 28922 * **secondary url**: `<https://www.office.com/>`__ 28923 * **support class**: browsertime_pageload.py 28924 * **test url**: `<https://www.office.com/launch/powerpoint?auth=1>`__ 28925 * **type**: pageload 28926 * **unit**: ms 28927 * **use live sites**: false 28928 * **Test Task**: 28929 28930 .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** 28931 :widths: 30 15 15 15 15 28932 :header-rows: 1 28933 28934 * - **Test Name** 28935 - mozilla-central 28936 - autoland 28937 - mozilla-release 28938 - mozilla-beta 28939 * - **browsertime-tp6-firefox-office** 28940 - ❌ 28941 - ❌ 28942 - ❌ 28943 - ❌ 28944 28945 28946 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 28947 :widths: 30 15 15 15 15 28948 :header-rows: 1 28949 28950 * - **Test Name** 28951 - mozilla-central 28952 - autoland 28953 - mozilla-release 28954 - mozilla-beta 28955 * - **browsertime-tp6-firefox-office** 28956 - ❌ 28957 - ❌ 28958 - ❌ 28959 - ❌ 28960 28961 28962 .. list-table:: **test-linux1804-64-qr/opt** 28963 :widths: 30 15 15 15 15 28964 :header-rows: 1 28965 28966 * - **Test Name** 28967 - mozilla-central 28968 - autoland 28969 - mozilla-release 28970 - mozilla-beta 28971 * - **browsertime-tp6-firefox-office** 28972 - ❌ 28973 - ❌ 28974 - ❌ 28975 - ❌ 28976 28977 28978 .. list-table:: **test-linux1804-64-shippable-qr/opt** 28979 :widths: 30 15 15 15 15 28980 :header-rows: 1 28981 28982 * - **Test Name** 28983 - mozilla-central 28984 - autoland 28985 - mozilla-release 28986 - mozilla-beta 28987 * - **browsertime-tp6-chrome-office** 28988 - ❌ 28989 - ❌ 28990 - ❌ 28991 - ❌ 28992 * - **browsertime-tp6-custom-car-office** 28993 - ❌ 28994 - ❌ 28995 - ❌ 28996 - ❌ 28997 * - **browsertime-tp6-firefox-office** 28998 - ✅ 28999 - ✅ 29000 - ❌ 29001 - ❌ 29002 29003 29004 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 29005 :widths: 30 15 15 15 15 29006 :header-rows: 1 29007 29008 * - **Test Name** 29009 - mozilla-central 29010 - autoland 29011 - mozilla-release 29012 - mozilla-beta 29013 * - **browsertime-tp6-firefox-office** 29014 - ❌ 29015 - ❌ 29016 - ❌ 29017 - ❌ 29018 29019 29020 .. list-table:: **test-macosx1470-64-shippable/opt** 29021 :widths: 30 15 15 15 15 29022 :header-rows: 1 29023 29024 * - **Test Name** 29025 - mozilla-central 29026 - autoland 29027 - mozilla-release 29028 - mozilla-beta 29029 * - **browsertime-tp6-chrome-office** 29030 - ❌ 29031 - ❌ 29032 - ❌ 29033 - ❌ 29034 * - **browsertime-tp6-custom-car-office** 29035 - ❌ 29036 - ❌ 29037 - ❌ 29038 - ❌ 29039 * - **browsertime-tp6-firefox-office** 29040 - ✅ 29041 - ✅ 29042 - ❌ 29043 - ❌ 29044 29045 29046 .. list-table:: **test-macosx1470-64/opt** 29047 :widths: 30 15 15 15 15 29048 :header-rows: 1 29049 29050 * - **Test Name** 29051 - mozilla-central 29052 - autoland 29053 - mozilla-release 29054 - mozilla-beta 29055 * - **browsertime-tp6-firefox-office** 29056 - ❌ 29057 - ❌ 29058 - ❌ 29059 - ❌ 29060 29061 29062 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 29063 :widths: 30 15 15 15 15 29064 :header-rows: 1 29065 29066 * - **Test Name** 29067 - mozilla-central 29068 - autoland 29069 - mozilla-release 29070 - mozilla-beta 29071 * - **browsertime-tp6-firefox-office** 29072 - ❌ 29073 - ❌ 29074 - ❌ 29075 - ❌ 29076 29077 29078 .. list-table:: **test-windows11-64-24h2-shippable/opt** 29079 :widths: 30 15 15 15 15 29080 :header-rows: 1 29081 29082 * - **Test Name** 29083 - mozilla-central 29084 - autoland 29085 - mozilla-release 29086 - mozilla-beta 29087 * - **browsertime-tp6-chrome-office** 29088 - ❌ 29089 - ❌ 29090 - ❌ 29091 - ❌ 29092 * - **browsertime-tp6-custom-car-office** 29093 - ❌ 29094 - ❌ 29095 - ❌ 29096 - ❌ 29097 * - **browsertime-tp6-firefox-office** 29098 - ✅ 29099 - ✅ 29100 - ❌ 29101 - ❌ 29102 29103 29104 .. list-table:: **test-windows11-64-24h2/opt** 29105 :widths: 30 15 15 15 15 29106 :header-rows: 1 29107 29108 * - **Test Name** 29109 - mozilla-central 29110 - autoland 29111 - mozilla-release 29112 - mozilla-beta 29113 * - **browsertime-tp6-firefox-office** 29114 - ❌ 29115 - ❌ 29116 - ❌ 29117 - ❌ 29118 29119 29120 29121 .. dropdown:: openai 29122 :class-container: anchor-id-openai-d 29123 29124 * Command to Run Locally 29125 29126 .. code-block:: 29127 29128 ./mach raptor -t openai 29129 29130 **Owner**: PerfTest Team 29131 29132 * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__, `largestContentfulPaint <raptor-metrics.html#largest-contentful-paint>`__ 29133 * **alert threshold**: 2.0 29134 * **apps**: firefox, chrome 29135 * **benchmark page**: false 29136 * **browser cycles**: 25 29137 * **expected**: pass 29138 * **gecko profile interval**: 1 29139 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp7/desktop/browsertime-tp7.toml#27>`__ 29140 * **lower is better**: true 29141 * **page cycles**: 25 29142 * **page timeout**: 60000 29143 * **playback**: mitmproxy 29144 * **playback pageset manifest**: mitm8-linux-firefox-openai.manifest 29145 * **playback version**: 11.0.0 29146 * **secondary url**: `<https://openai.com/blog>`__ 29147 * **support class**: browsertime_pageload.py 29148 * **test url**: `<https://openai.com/>`__ 29149 * **type**: pageload 29150 * **unit**: ms 29151 * **use live sites**: false 29152 * **Test Task**: 29153 29154 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 29155 :widths: 30 15 15 15 15 29156 :header-rows: 1 29157 29158 * - **Test Name** 29159 - mozilla-central 29160 - autoland 29161 - mozilla-release 29162 - mozilla-beta 29163 * - **browsertime-tp7-firefox-openai** 29164 - ❌ 29165 - ❌ 29166 - ❌ 29167 - ❌ 29168 29169 29170 .. list-table:: **test-linux1804-64-qr/opt** 29171 :widths: 30 15 15 15 15 29172 :header-rows: 1 29173 29174 * - **Test Name** 29175 - mozilla-central 29176 - autoland 29177 - mozilla-release 29178 - mozilla-beta 29179 * - **browsertime-tp7-firefox-openai** 29180 - ❌ 29181 - ❌ 29182 - ❌ 29183 - ❌ 29184 29185 29186 .. list-table:: **test-linux1804-64-shippable-qr/opt** 29187 :widths: 30 15 15 15 15 29188 :header-rows: 1 29189 29190 * - **Test Name** 29191 - mozilla-central 29192 - autoland 29193 - mozilla-release 29194 - mozilla-beta 29195 * - **browsertime-tp7-chrome-openai** 29196 - ❌ 29197 - ❌ 29198 - ❌ 29199 - ❌ 29200 * - **browsertime-tp7-firefox-openai** 29201 - ❌ 29202 - ❌ 29203 - ❌ 29204 - ❌ 29205 29206 29207 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 29208 :widths: 30 15 15 15 15 29209 :header-rows: 1 29210 29211 * - **Test Name** 29212 - mozilla-central 29213 - autoland 29214 - mozilla-release 29215 - mozilla-beta 29216 * - **browsertime-tp7-firefox-openai** 29217 - ❌ 29218 - ❌ 29219 - ❌ 29220 - ❌ 29221 29222 29223 .. list-table:: **test-macosx1470-64-shippable/opt** 29224 :widths: 30 15 15 15 15 29225 :header-rows: 1 29226 29227 * - **Test Name** 29228 - mozilla-central 29229 - autoland 29230 - mozilla-release 29231 - mozilla-beta 29232 * - **browsertime-tp7-chrome-openai** 29233 - ❌ 29234 - ❌ 29235 - ❌ 29236 - ❌ 29237 * - **browsertime-tp7-firefox-openai** 29238 - ❌ 29239 - ❌ 29240 - ❌ 29241 - ❌ 29242 29243 29244 .. list-table:: **test-macosx1470-64/opt** 29245 :widths: 30 15 15 15 15 29246 :header-rows: 1 29247 29248 * - **Test Name** 29249 - mozilla-central 29250 - autoland 29251 - mozilla-release 29252 - mozilla-beta 29253 * - **browsertime-tp7-firefox-openai** 29254 - ❌ 29255 - ❌ 29256 - ❌ 29257 - ❌ 29258 29259 29260 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 29261 :widths: 30 15 15 15 15 29262 :header-rows: 1 29263 29264 * - **Test Name** 29265 - mozilla-central 29266 - autoland 29267 - mozilla-release 29268 - mozilla-beta 29269 * - **browsertime-tp7-firefox-openai** 29270 - ❌ 29271 - ❌ 29272 - ❌ 29273 - ❌ 29274 29275 29276 .. list-table:: **test-windows11-64-24h2-shippable/opt** 29277 :widths: 30 15 15 15 15 29278 :header-rows: 1 29279 29280 * - **Test Name** 29281 - mozilla-central 29282 - autoland 29283 - mozilla-release 29284 - mozilla-beta 29285 * - **browsertime-tp7-chrome-openai** 29286 - ❌ 29287 - ❌ 29288 - ❌ 29289 - ❌ 29290 * - **browsertime-tp7-firefox-openai** 29291 - ❌ 29292 - ❌ 29293 - ❌ 29294 - ❌ 29295 29296 29297 .. list-table:: **test-windows11-64-24h2/opt** 29298 :widths: 30 15 15 15 15 29299 :header-rows: 1 29300 29301 * - **Test Name** 29302 - mozilla-central 29303 - autoland 29304 - mozilla-release 29305 - mozilla-beta 29306 * - **browsertime-tp7-firefox-openai** 29307 - ❌ 29308 - ❌ 29309 - ❌ 29310 - ❌ 29311 29312 29313 29314 .. dropdown:: outlook 29315 :class-container: anchor-id-outlook-d 29316 29317 * Command to Run Locally 29318 29319 .. code-block:: 29320 29321 ./mach raptor -t outlook 29322 29323 **Owner**: PerfTest Team 29324 29325 * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__, `largestContentfulPaint <raptor-metrics.html#largest-contentful-paint>`__ 29326 * **alert threshold**: 2.0 29327 * **apps**: firefox, chrome, safari, custom-car 29328 * **benchmark page**: true 29329 * **browser cycles**: 25 29330 * **expected**: pass 29331 * **gecko profile interval**: 1 29332 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#149>`__ 29333 * **lower is better**: true 29334 * **page cycles**: 25 29335 * **page timeout**: 60000 29336 * **playback**: mitmproxy 29337 * **playback pageset manifest**: mitm5-linux-firefox-live.manifest 29338 * **playback version**: 11.0.0 29339 * **support class**: browsertime_pageload.py 29340 * **test url**: `<https://outlook.live.com/mail/inbox>`__ 29341 * **type**: pageload 29342 * **unit**: ms 29343 * **use live sites**: false 29344 * **Test Task**: 29345 29346 .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** 29347 :widths: 30 15 15 15 15 29348 :header-rows: 1 29349 29350 * - **Test Name** 29351 - mozilla-central 29352 - autoland 29353 - mozilla-release 29354 - mozilla-beta 29355 * - **browsertime-tp6-firefox-outlook** 29356 - ❌ 29357 - ❌ 29358 - ❌ 29359 - ❌ 29360 * - **browsertime-tp6-live-firefox-outlook** 29361 - ❌ 29362 - ❌ 29363 - ❌ 29364 - ❌ 29365 29366 29367 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 29368 :widths: 30 15 15 15 15 29369 :header-rows: 1 29370 29371 * - **Test Name** 29372 - mozilla-central 29373 - autoland 29374 - mozilla-release 29375 - mozilla-beta 29376 * - **browsertime-tp6-firefox-outlook** 29377 - ❌ 29378 - ❌ 29379 - ❌ 29380 - ❌ 29381 * - **browsertime-tp6-live-firefox-outlook** 29382 - ❌ 29383 - ❌ 29384 - ❌ 29385 - ❌ 29386 29387 29388 .. list-table:: **test-linux1804-64-qr/opt** 29389 :widths: 30 15 15 15 15 29390 :header-rows: 1 29391 29392 * - **Test Name** 29393 - mozilla-central 29394 - autoland 29395 - mozilla-release 29396 - mozilla-beta 29397 * - **browsertime-tp6-firefox-outlook** 29398 - ❌ 29399 - ❌ 29400 - ❌ 29401 - ❌ 29402 * - **browsertime-tp6-live-firefox-outlook** 29403 - ❌ 29404 - ❌ 29405 - ❌ 29406 - ❌ 29407 29408 29409 .. list-table:: **test-linux1804-64-shippable-qr/opt** 29410 :widths: 30 15 15 15 15 29411 :header-rows: 1 29412 29413 * - **Test Name** 29414 - mozilla-central 29415 - autoland 29416 - mozilla-release 29417 - mozilla-beta 29418 * - **browsertime-tp6-chrome-outlook** 29419 - ❌ 29420 - ❌ 29421 - ❌ 29422 - ❌ 29423 * - **browsertime-tp6-custom-car-outlook** 29424 - ❌ 29425 - ❌ 29426 - ❌ 29427 - ❌ 29428 * - **browsertime-tp6-firefox-outlook** 29429 - ✅ 29430 - ✅ 29431 - ❌ 29432 - ❌ 29433 * - **browsertime-tp6-live-chrome-outlook** 29434 - ❌ 29435 - ❌ 29436 - ❌ 29437 - ❌ 29438 * - **browsertime-tp6-live-firefox-outlook** 29439 - ❌ 29440 - ❌ 29441 - ❌ 29442 - ❌ 29443 29444 29445 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 29446 :widths: 30 15 15 15 15 29447 :header-rows: 1 29448 29449 * - **Test Name** 29450 - mozilla-central 29451 - autoland 29452 - mozilla-release 29453 - mozilla-beta 29454 * - **browsertime-tp6-firefox-outlook** 29455 - ❌ 29456 - ❌ 29457 - ❌ 29458 - ❌ 29459 * - **browsertime-tp6-live-firefox-outlook** 29460 - ❌ 29461 - ❌ 29462 - ❌ 29463 - ❌ 29464 29465 29466 .. list-table:: **test-macosx1470-64-shippable/opt** 29467 :widths: 30 15 15 15 15 29468 :header-rows: 1 29469 29470 * - **Test Name** 29471 - mozilla-central 29472 - autoland 29473 - mozilla-release 29474 - mozilla-beta 29475 * - **browsertime-tp6-chrome-outlook** 29476 - ❌ 29477 - ❌ 29478 - ❌ 29479 - ❌ 29480 * - **browsertime-tp6-custom-car-outlook** 29481 - ❌ 29482 - ❌ 29483 - ❌ 29484 - ❌ 29485 * - **browsertime-tp6-firefox-outlook** 29486 - ✅ 29487 - ✅ 29488 - ❌ 29489 - ❌ 29490 * - **browsertime-tp6-live-chrome-outlook** 29491 - ❌ 29492 - ❌ 29493 - ❌ 29494 - ❌ 29495 * - **browsertime-tp6-live-firefox-outlook** 29496 - ❌ 29497 - ❌ 29498 - ❌ 29499 - ❌ 29500 29501 29502 .. list-table:: **test-macosx1470-64/opt** 29503 :widths: 30 15 15 15 15 29504 :header-rows: 1 29505 29506 * - **Test Name** 29507 - mozilla-central 29508 - autoland 29509 - mozilla-release 29510 - mozilla-beta 29511 * - **browsertime-tp6-firefox-outlook** 29512 - ❌ 29513 - ❌ 29514 - ❌ 29515 - ❌ 29516 * - **browsertime-tp6-live-firefox-outlook** 29517 - ❌ 29518 - ❌ 29519 - ❌ 29520 - ❌ 29521 29522 29523 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 29524 :widths: 30 15 15 15 15 29525 :header-rows: 1 29526 29527 * - **Test Name** 29528 - mozilla-central 29529 - autoland 29530 - mozilla-release 29531 - mozilla-beta 29532 * - **browsertime-tp6-firefox-outlook** 29533 - ❌ 29534 - ❌ 29535 - ❌ 29536 - ❌ 29537 * - **browsertime-tp6-live-firefox-outlook** 29538 - ❌ 29539 - ❌ 29540 - ❌ 29541 - ❌ 29542 29543 29544 .. list-table:: **test-windows11-64-24h2-shippable/opt** 29545 :widths: 30 15 15 15 15 29546 :header-rows: 1 29547 29548 * - **Test Name** 29549 - mozilla-central 29550 - autoland 29551 - mozilla-release 29552 - mozilla-beta 29553 * - **browsertime-tp6-chrome-outlook** 29554 - ❌ 29555 - ❌ 29556 - ❌ 29557 - ❌ 29558 * - **browsertime-tp6-custom-car-outlook** 29559 - ❌ 29560 - ❌ 29561 - ❌ 29562 - ❌ 29563 * - **browsertime-tp6-firefox-outlook** 29564 - ✅ 29565 - ✅ 29566 - ❌ 29567 - ❌ 29568 * - **browsertime-tp6-live-chrome-outlook** 29569 - ❌ 29570 - ❌ 29571 - ❌ 29572 - ❌ 29573 * - **browsertime-tp6-live-firefox-outlook** 29574 - ❌ 29575 - ❌ 29576 - ❌ 29577 - ❌ 29578 29579 29580 .. list-table:: **test-windows11-64-24h2/opt** 29581 :widths: 30 15 15 15 15 29582 :header-rows: 1 29583 29584 * - **Test Name** 29585 - mozilla-central 29586 - autoland 29587 - mozilla-release 29588 - mozilla-beta 29589 * - **browsertime-tp6-firefox-outlook** 29590 - ❌ 29591 - ❌ 29592 - ❌ 29593 - ❌ 29594 * - **browsertime-tp6-live-firefox-outlook** 29595 - ❌ 29596 - ❌ 29597 - ❌ 29598 - ❌ 29599 29600 29601 29602 .. dropdown:: paypal 29603 :class-container: anchor-id-paypal-d 29604 29605 * Command to Run Locally 29606 29607 .. code-block:: 29608 29609 ./mach raptor -t paypal 29610 29611 **Owner**: PerfTest Team 29612 29613 * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__, `largestContentfulPaint <raptor-metrics.html#largest-contentful-paint>`__ 29614 * **alert threshold**: 2.0 29615 * **apps**: firefox, chrome, safari, custom-car 29616 * **benchmark page**: true 29617 * **browser cycles**: 25 29618 * **expected**: pass 29619 * **gecko profile interval**: 1 29620 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#153>`__ 29621 * **lower is better**: true 29622 * **page cycles**: 25 29623 * **page timeout**: 60000 29624 * **playback**: mitmproxy 29625 * **playback pageset manifest**: mitm5-linux-firefox-paypal.manifest 29626 * **playback version**: 11.0.0 29627 * **support class**: browsertime_pageload.py 29628 * **test url**: `<https://www.paypal.com/myaccount/summary/>`__ 29629 * **type**: pageload 29630 * **unit**: ms 29631 * **use live sites**: false 29632 * **Test Task**: 29633 29634 .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** 29635 :widths: 30 15 15 15 15 29636 :header-rows: 1 29637 29638 * - **Test Name** 29639 - mozilla-central 29640 - autoland 29641 - mozilla-release 29642 - mozilla-beta 29643 * - **browsertime-tp6-firefox-paypal** 29644 - ❌ 29645 - ❌ 29646 - ❌ 29647 - ❌ 29648 * - **browsertime-tp6-live-firefox-paypal** 29649 - ❌ 29650 - ❌ 29651 - ❌ 29652 - ❌ 29653 29654 29655 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 29656 :widths: 30 15 15 15 15 29657 :header-rows: 1 29658 29659 * - **Test Name** 29660 - mozilla-central 29661 - autoland 29662 - mozilla-release 29663 - mozilla-beta 29664 * - **browsertime-tp6-firefox-paypal** 29665 - ❌ 29666 - ❌ 29667 - ❌ 29668 - ❌ 29669 * - **browsertime-tp6-live-firefox-paypal** 29670 - ❌ 29671 - ❌ 29672 - ❌ 29673 - ❌ 29674 29675 29676 .. list-table:: **test-linux1804-64-qr/opt** 29677 :widths: 30 15 15 15 15 29678 :header-rows: 1 29679 29680 * - **Test Name** 29681 - mozilla-central 29682 - autoland 29683 - mozilla-release 29684 - mozilla-beta 29685 * - **browsertime-tp6-firefox-paypal** 29686 - ❌ 29687 - ❌ 29688 - ❌ 29689 - ❌ 29690 * - **browsertime-tp6-live-firefox-paypal** 29691 - ❌ 29692 - ❌ 29693 - ❌ 29694 - ❌ 29695 29696 29697 .. list-table:: **test-linux1804-64-shippable-qr/opt** 29698 :widths: 30 15 15 15 15 29699 :header-rows: 1 29700 29701 * - **Test Name** 29702 - mozilla-central 29703 - autoland 29704 - mozilla-release 29705 - mozilla-beta 29706 * - **browsertime-tp6-chrome-paypal** 29707 - ❌ 29708 - ❌ 29709 - ❌ 29710 - ❌ 29711 * - **browsertime-tp6-custom-car-paypal** 29712 - ❌ 29713 - ❌ 29714 - ❌ 29715 - ❌ 29716 * - **browsertime-tp6-firefox-paypal** 29717 - ✅ 29718 - ✅ 29719 - ❌ 29720 - ❌ 29721 * - **browsertime-tp6-live-chrome-paypal** 29722 - ❌ 29723 - ❌ 29724 - ❌ 29725 - ❌ 29726 * - **browsertime-tp6-live-firefox-paypal** 29727 - ❌ 29728 - ❌ 29729 - ❌ 29730 - ❌ 29731 29732 29733 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 29734 :widths: 30 15 15 15 15 29735 :header-rows: 1 29736 29737 * - **Test Name** 29738 - mozilla-central 29739 - autoland 29740 - mozilla-release 29741 - mozilla-beta 29742 * - **browsertime-tp6-firefox-paypal** 29743 - ❌ 29744 - ❌ 29745 - ❌ 29746 - ❌ 29747 * - **browsertime-tp6-live-firefox-paypal** 29748 - ❌ 29749 - ❌ 29750 - ❌ 29751 - ❌ 29752 29753 29754 .. list-table:: **test-macosx1470-64-shippable/opt** 29755 :widths: 30 15 15 15 15 29756 :header-rows: 1 29757 29758 * - **Test Name** 29759 - mozilla-central 29760 - autoland 29761 - mozilla-release 29762 - mozilla-beta 29763 * - **browsertime-tp6-chrome-paypal** 29764 - ❌ 29765 - ❌ 29766 - ❌ 29767 - ❌ 29768 * - **browsertime-tp6-custom-car-paypal** 29769 - ❌ 29770 - ❌ 29771 - ❌ 29772 - ❌ 29773 * - **browsertime-tp6-firefox-paypal** 29774 - ✅ 29775 - ✅ 29776 - ❌ 29777 - ❌ 29778 * - **browsertime-tp6-live-chrome-paypal** 29779 - ❌ 29780 - ❌ 29781 - ❌ 29782 - ❌ 29783 * - **browsertime-tp6-live-firefox-paypal** 29784 - ❌ 29785 - ❌ 29786 - ❌ 29787 - ❌ 29788 * - **browsertime-tp6-live-safari-paypal** 29789 - ❌ 29790 - ❌ 29791 - ❌ 29792 - ❌ 29793 29794 29795 .. list-table:: **test-macosx1470-64/opt** 29796 :widths: 30 15 15 15 15 29797 :header-rows: 1 29798 29799 * - **Test Name** 29800 - mozilla-central 29801 - autoland 29802 - mozilla-release 29803 - mozilla-beta 29804 * - **browsertime-tp6-firefox-paypal** 29805 - ❌ 29806 - ❌ 29807 - ❌ 29808 - ❌ 29809 * - **browsertime-tp6-live-firefox-paypal** 29810 - ❌ 29811 - ❌ 29812 - ❌ 29813 - ❌ 29814 29815 29816 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 29817 :widths: 30 15 15 15 15 29818 :header-rows: 1 29819 29820 * - **Test Name** 29821 - mozilla-central 29822 - autoland 29823 - mozilla-release 29824 - mozilla-beta 29825 * - **browsertime-tp6-firefox-paypal** 29826 - ❌ 29827 - ❌ 29828 - ❌ 29829 - ❌ 29830 * - **browsertime-tp6-live-firefox-paypal** 29831 - ❌ 29832 - ❌ 29833 - ❌ 29834 - ❌ 29835 29836 29837 .. list-table:: **test-windows11-64-24h2-shippable/opt** 29838 :widths: 30 15 15 15 15 29839 :header-rows: 1 29840 29841 * - **Test Name** 29842 - mozilla-central 29843 - autoland 29844 - mozilla-release 29845 - mozilla-beta 29846 * - **browsertime-tp6-chrome-paypal** 29847 - ❌ 29848 - ❌ 29849 - ❌ 29850 - ❌ 29851 * - **browsertime-tp6-custom-car-paypal** 29852 - ❌ 29853 - ❌ 29854 - ❌ 29855 - ❌ 29856 * - **browsertime-tp6-firefox-paypal** 29857 - ✅ 29858 - ✅ 29859 - ❌ 29860 - ❌ 29861 * - **browsertime-tp6-live-chrome-paypal** 29862 - ❌ 29863 - ❌ 29864 - ❌ 29865 - ❌ 29866 * - **browsertime-tp6-live-firefox-paypal** 29867 - ❌ 29868 - ❌ 29869 - ❌ 29870 - ❌ 29871 29872 29873 .. list-table:: **test-windows11-64-24h2/opt** 29874 :widths: 30 15 15 15 15 29875 :header-rows: 1 29876 29877 * - **Test Name** 29878 - mozilla-central 29879 - autoland 29880 - mozilla-release 29881 - mozilla-beta 29882 * - **browsertime-tp6-firefox-paypal** 29883 - ❌ 29884 - ❌ 29885 - ❌ 29886 - ❌ 29887 * - **browsertime-tp6-live-firefox-paypal** 29888 - ❌ 29889 - ❌ 29890 - ❌ 29891 - ❌ 29892 29893 29894 29895 .. dropdown:: pinterest 29896 :class-container: anchor-id-pinterest-d 29897 29898 * Command to Run Locally 29899 29900 .. code-block:: 29901 29902 ./mach raptor -t pinterest 29903 29904 **Owner**: PerfTest Team 29905 29906 * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__, `largestContentfulPaint <raptor-metrics.html#largest-contentful-paint>`__ 29907 * **alert threshold**: 2.0 29908 * **apps**: firefox, chrome, safari, custom-car 29909 * **benchmark page**: false 29910 * **browser cycles**: 25 29911 * **expected**: pass 29912 * **gecko profile interval**: 1 29913 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#157>`__ 29914 * **lower is better**: true 29915 * **page cycles**: 25 29916 * **page timeout**: 60000 29917 * **playback**: mitmproxy 29918 * **playback pageset manifest**: mitm6-linux-firefox-pinterest.manifest 29919 * **playback version**: 8.1.1 29920 * **secondary url**: `<https://www.pinterest.com/today/best/halloween-costumes-for-your-furry-friends/75787/>`__ 29921 * **support class**: browsertime_pageload.py 29922 * **test url**: `<https://pinterest.com/>`__ 29923 * **type**: pageload 29924 * **unit**: ms 29925 * **use live sites**: false 29926 * **Test Task**: 29927 29928 .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** 29929 :widths: 30 15 15 15 15 29930 :header-rows: 1 29931 29932 * - **Test Name** 29933 - mozilla-central 29934 - autoland 29935 - mozilla-release 29936 - mozilla-beta 29937 * - **browsertime-tp6-firefox-pinterest** 29938 - ❌ 29939 - ❌ 29940 - ❌ 29941 - ❌ 29942 * - **browsertime-tp6-live-firefox-pinterest** 29943 - ❌ 29944 - ❌ 29945 - ❌ 29946 - ❌ 29947 29948 29949 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 29950 :widths: 30 15 15 15 15 29951 :header-rows: 1 29952 29953 * - **Test Name** 29954 - mozilla-central 29955 - autoland 29956 - mozilla-release 29957 - mozilla-beta 29958 * - **browsertime-tp6-firefox-pinterest** 29959 - ❌ 29960 - ❌ 29961 - ❌ 29962 - ❌ 29963 * - **browsertime-tp6-live-firefox-pinterest** 29964 - ❌ 29965 - ❌ 29966 - ❌ 29967 - ❌ 29968 29969 29970 .. list-table:: **test-linux1804-64-qr/opt** 29971 :widths: 30 15 15 15 15 29972 :header-rows: 1 29973 29974 * - **Test Name** 29975 - mozilla-central 29976 - autoland 29977 - mozilla-release 29978 - mozilla-beta 29979 * - **browsertime-tp6-firefox-pinterest** 29980 - ❌ 29981 - ❌ 29982 - ❌ 29983 - ❌ 29984 * - **browsertime-tp6-live-firefox-pinterest** 29985 - ❌ 29986 - ❌ 29987 - ❌ 29988 - ❌ 29989 29990 29991 .. list-table:: **test-linux1804-64-shippable-qr/opt** 29992 :widths: 30 15 15 15 15 29993 :header-rows: 1 29994 29995 * - **Test Name** 29996 - mozilla-central 29997 - autoland 29998 - mozilla-release 29999 - mozilla-beta 30000 * - **browsertime-tp6-chrome-pinterest** 30001 - ❌ 30002 - ❌ 30003 - ❌ 30004 - ❌ 30005 * - **browsertime-tp6-custom-car-pinterest** 30006 - ❌ 30007 - ❌ 30008 - ❌ 30009 - ❌ 30010 * - **browsertime-tp6-firefox-pinterest** 30011 - ✅ 30012 - ✅ 30013 - ❌ 30014 - ❌ 30015 * - **browsertime-tp6-live-chrome-pinterest** 30016 - ❌ 30017 - ❌ 30018 - ❌ 30019 - ❌ 30020 * - **browsertime-tp6-live-firefox-pinterest** 30021 - ❌ 30022 - ❌ 30023 - ❌ 30024 - ❌ 30025 30026 30027 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 30028 :widths: 30 15 15 15 15 30029 :header-rows: 1 30030 30031 * - **Test Name** 30032 - mozilla-central 30033 - autoland 30034 - mozilla-release 30035 - mozilla-beta 30036 * - **browsertime-tp6-firefox-pinterest** 30037 - ❌ 30038 - ❌ 30039 - ❌ 30040 - ❌ 30041 * - **browsertime-tp6-live-firefox-pinterest** 30042 - ❌ 30043 - ❌ 30044 - ❌ 30045 - ❌ 30046 30047 30048 .. list-table:: **test-macosx1470-64-shippable/opt** 30049 :widths: 30 15 15 15 15 30050 :header-rows: 1 30051 30052 * - **Test Name** 30053 - mozilla-central 30054 - autoland 30055 - mozilla-release 30056 - mozilla-beta 30057 * - **browsertime-tp6-chrome-pinterest** 30058 - ❌ 30059 - ❌ 30060 - ❌ 30061 - ❌ 30062 * - **browsertime-tp6-custom-car-pinterest** 30063 - ❌ 30064 - ❌ 30065 - ❌ 30066 - ❌ 30067 * - **browsertime-tp6-firefox-pinterest** 30068 - ✅ 30069 - ✅ 30070 - ❌ 30071 - ❌ 30072 * - **browsertime-tp6-live-chrome-pinterest** 30073 - ❌ 30074 - ❌ 30075 - ❌ 30076 - ❌ 30077 * - **browsertime-tp6-live-firefox-pinterest** 30078 - ❌ 30079 - ❌ 30080 - ❌ 30081 - ❌ 30082 * - **browsertime-tp6-live-safari-pinterest** 30083 - ❌ 30084 - ❌ 30085 - ❌ 30086 - ❌ 30087 30088 30089 .. list-table:: **test-macosx1470-64/opt** 30090 :widths: 30 15 15 15 15 30091 :header-rows: 1 30092 30093 * - **Test Name** 30094 - mozilla-central 30095 - autoland 30096 - mozilla-release 30097 - mozilla-beta 30098 * - **browsertime-tp6-firefox-pinterest** 30099 - ❌ 30100 - ❌ 30101 - ❌ 30102 - ❌ 30103 * - **browsertime-tp6-live-firefox-pinterest** 30104 - ❌ 30105 - ❌ 30106 - ❌ 30107 - ❌ 30108 30109 30110 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 30111 :widths: 30 15 15 15 15 30112 :header-rows: 1 30113 30114 * - **Test Name** 30115 - mozilla-central 30116 - autoland 30117 - mozilla-release 30118 - mozilla-beta 30119 * - **browsertime-tp6-firefox-pinterest** 30120 - ❌ 30121 - ❌ 30122 - ❌ 30123 - ❌ 30124 * - **browsertime-tp6-live-firefox-pinterest** 30125 - ❌ 30126 - ❌ 30127 - ❌ 30128 - ❌ 30129 30130 30131 .. list-table:: **test-windows11-64-24h2-shippable/opt** 30132 :widths: 30 15 15 15 15 30133 :header-rows: 1 30134 30135 * - **Test Name** 30136 - mozilla-central 30137 - autoland 30138 - mozilla-release 30139 - mozilla-beta 30140 * - **browsertime-tp6-chrome-pinterest** 30141 - ❌ 30142 - ❌ 30143 - ❌ 30144 - ❌ 30145 * - **browsertime-tp6-custom-car-pinterest** 30146 - ❌ 30147 - ❌ 30148 - ❌ 30149 - ❌ 30150 * - **browsertime-tp6-firefox-pinterest** 30151 - ✅ 30152 - ✅ 30153 - ❌ 30154 - ❌ 30155 * - **browsertime-tp6-live-chrome-pinterest** 30156 - ❌ 30157 - ❌ 30158 - ❌ 30159 - ❌ 30160 * - **browsertime-tp6-live-firefox-pinterest** 30161 - ❌ 30162 - ❌ 30163 - ❌ 30164 - ❌ 30165 30166 30167 .. list-table:: **test-windows11-64-24h2/opt** 30168 :widths: 30 15 15 15 15 30169 :header-rows: 1 30170 30171 * - **Test Name** 30172 - mozilla-central 30173 - autoland 30174 - mozilla-release 30175 - mozilla-beta 30176 * - **browsertime-tp6-firefox-pinterest** 30177 - ❌ 30178 - ❌ 30179 - ❌ 30180 - ❌ 30181 * - **browsertime-tp6-live-firefox-pinterest** 30182 - ❌ 30183 - ❌ 30184 - ❌ 30185 - ❌ 30186 30187 30188 30189 .. dropdown:: reddit 30190 :class-container: anchor-id-reddit-d 30191 30192 * Command to Run Locally 30193 30194 .. code-block:: 30195 30196 ./mach raptor -t reddit 30197 30198 **Owner**: PerfTest Team 30199 30200 * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__, `largestContentfulPaint <raptor-metrics.html#largest-contentful-paint>`__ 30201 * **alert threshold**: 2.0 30202 * **apps**: firefox, chrome, safari, custom-car 30203 * **benchmark page**: false 30204 * **browser cycles**: 25 30205 * **expected**: pass 30206 * **gecko profile interval**: 1 30207 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#164>`__ 30208 * **lower is better**: true 30209 * **page cycles**: 25 30210 * **page timeout**: 60000 30211 * **playback**: mitmproxy 30212 * **playback pageset manifest**: mitm11-windows-firefox-reddit.manifest 30213 * **playback pageset manifest backup**: mitm8-linux-firefox-reddit.manifest 30214 * **playback version**: 11.0.0 30215 * **secondary url**: `<https://www.reddit.com/r/technology/>`__ 30216 * **support class**: browsertime_pageload.py 30217 * **test url**: `<https://www.reddit.com/r/technology/comments/9sqwyh/we_posed_as_100_senators_to_run_ads_on_facebook/>`__ 30218 * **type**: pageload 30219 * **unit**: ms 30220 * **use live sites**: false 30221 * **Test Task**: 30222 30223 .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** 30224 :widths: 30 15 15 15 15 30225 :header-rows: 1 30226 30227 * - **Test Name** 30228 - mozilla-central 30229 - autoland 30230 - mozilla-release 30231 - mozilla-beta 30232 * - **browsertime-tp6-firefox-reddit** 30233 - ❌ 30234 - ❌ 30235 - ❌ 30236 - ❌ 30237 * - **browsertime-tp6-live-firefox-reddit** 30238 - ❌ 30239 - ❌ 30240 - ❌ 30241 - ❌ 30242 30243 30244 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 30245 :widths: 30 15 15 15 15 30246 :header-rows: 1 30247 30248 * - **Test Name** 30249 - mozilla-central 30250 - autoland 30251 - mozilla-release 30252 - mozilla-beta 30253 * - **browsertime-tp6-firefox-reddit** 30254 - ❌ 30255 - ❌ 30256 - ❌ 30257 - ❌ 30258 * - **browsertime-tp6-live-firefox-reddit** 30259 - ❌ 30260 - ❌ 30261 - ❌ 30262 - ❌ 30263 30264 30265 .. list-table:: **test-linux1804-64-qr/opt** 30266 :widths: 30 15 15 15 15 30267 :header-rows: 1 30268 30269 * - **Test Name** 30270 - mozilla-central 30271 - autoland 30272 - mozilla-release 30273 - mozilla-beta 30274 * - **browsertime-tp6-firefox-reddit** 30275 - ❌ 30276 - ❌ 30277 - ❌ 30278 - ❌ 30279 * - **browsertime-tp6-live-firefox-reddit** 30280 - ❌ 30281 - ❌ 30282 - ❌ 30283 - ❌ 30284 30285 30286 .. list-table:: **test-linux1804-64-shippable-qr/opt** 30287 :widths: 30 15 15 15 15 30288 :header-rows: 1 30289 30290 * - **Test Name** 30291 - mozilla-central 30292 - autoland 30293 - mozilla-release 30294 - mozilla-beta 30295 * - **browsertime-tp6-chrome-reddit** 30296 - ❌ 30297 - ❌ 30298 - ❌ 30299 - ❌ 30300 * - **browsertime-tp6-custom-car-reddit** 30301 - ❌ 30302 - ❌ 30303 - ❌ 30304 - ❌ 30305 * - **browsertime-tp6-firefox-reddit** 30306 - ✅ 30307 - ✅ 30308 - ❌ 30309 - ❌ 30310 * - **browsertime-tp6-live-chrome-reddit** 30311 - ❌ 30312 - ❌ 30313 - ❌ 30314 - ❌ 30315 * - **browsertime-tp6-live-firefox-reddit** 30316 - ❌ 30317 - ❌ 30318 - ❌ 30319 - ❌ 30320 30321 30322 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 30323 :widths: 30 15 15 15 15 30324 :header-rows: 1 30325 30326 * - **Test Name** 30327 - mozilla-central 30328 - autoland 30329 - mozilla-release 30330 - mozilla-beta 30331 * - **browsertime-tp6-firefox-reddit** 30332 - ❌ 30333 - ❌ 30334 - ❌ 30335 - ❌ 30336 * - **browsertime-tp6-live-firefox-reddit** 30337 - ❌ 30338 - ❌ 30339 - ❌ 30340 - ❌ 30341 30342 30343 .. list-table:: **test-macosx1470-64-shippable/opt** 30344 :widths: 30 15 15 15 15 30345 :header-rows: 1 30346 30347 * - **Test Name** 30348 - mozilla-central 30349 - autoland 30350 - mozilla-release 30351 - mozilla-beta 30352 * - **browsertime-tp6-chrome-reddit** 30353 - ❌ 30354 - ❌ 30355 - ❌ 30356 - ❌ 30357 * - **browsertime-tp6-custom-car-reddit** 30358 - ❌ 30359 - ❌ 30360 - ❌ 30361 - ❌ 30362 * - **browsertime-tp6-firefox-reddit** 30363 - ✅ 30364 - ✅ 30365 - ❌ 30366 - ❌ 30367 * - **browsertime-tp6-live-chrome-reddit** 30368 - ❌ 30369 - ❌ 30370 - ❌ 30371 - ❌ 30372 * - **browsertime-tp6-live-firefox-reddit** 30373 - ❌ 30374 - ❌ 30375 - ❌ 30376 - ❌ 30377 * - **browsertime-tp6-live-safari-reddit** 30378 - ❌ 30379 - ❌ 30380 - ❌ 30381 - ❌ 30382 30383 30384 .. list-table:: **test-macosx1470-64/opt** 30385 :widths: 30 15 15 15 15 30386 :header-rows: 1 30387 30388 * - **Test Name** 30389 - mozilla-central 30390 - autoland 30391 - mozilla-release 30392 - mozilla-beta 30393 * - **browsertime-tp6-firefox-reddit** 30394 - ❌ 30395 - ❌ 30396 - ❌ 30397 - ❌ 30398 * - **browsertime-tp6-live-firefox-reddit** 30399 - ❌ 30400 - ❌ 30401 - ❌ 30402 - ❌ 30403 30404 30405 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 30406 :widths: 30 15 15 15 15 30407 :header-rows: 1 30408 30409 * - **Test Name** 30410 - mozilla-central 30411 - autoland 30412 - mozilla-release 30413 - mozilla-beta 30414 * - **browsertime-tp6-firefox-reddit** 30415 - ❌ 30416 - ❌ 30417 - ❌ 30418 - ❌ 30419 * - **browsertime-tp6-live-firefox-reddit** 30420 - ❌ 30421 - ❌ 30422 - ❌ 30423 - ❌ 30424 30425 30426 .. list-table:: **test-windows11-64-24h2-shippable/opt** 30427 :widths: 30 15 15 15 15 30428 :header-rows: 1 30429 30430 * - **Test Name** 30431 - mozilla-central 30432 - autoland 30433 - mozilla-release 30434 - mozilla-beta 30435 * - **browsertime-tp6-chrome-reddit** 30436 - ❌ 30437 - ❌ 30438 - ❌ 30439 - ❌ 30440 * - **browsertime-tp6-custom-car-reddit** 30441 - ❌ 30442 - ❌ 30443 - ❌ 30444 - ❌ 30445 * - **browsertime-tp6-firefox-reddit** 30446 - ✅ 30447 - ✅ 30448 - ❌ 30449 - ❌ 30450 * - **browsertime-tp6-live-chrome-reddit** 30451 - ❌ 30452 - ❌ 30453 - ❌ 30454 - ❌ 30455 * - **browsertime-tp6-live-firefox-reddit** 30456 - ❌ 30457 - ❌ 30458 - ❌ 30459 - ❌ 30460 30461 30462 .. list-table:: **test-windows11-64-24h2/opt** 30463 :widths: 30 15 15 15 15 30464 :header-rows: 1 30465 30466 * - **Test Name** 30467 - mozilla-central 30468 - autoland 30469 - mozilla-release 30470 - mozilla-beta 30471 * - **browsertime-tp6-firefox-reddit** 30472 - ❌ 30473 - ❌ 30474 - ❌ 30475 - ❌ 30476 * - **browsertime-tp6-live-firefox-reddit** 30477 - ❌ 30478 - ❌ 30479 - ❌ 30480 - ❌ 30481 30482 30483 30484 .. dropdown:: samsung 30485 :class-container: anchor-id-samsung-d 30486 30487 * Command to Run Locally 30488 30489 .. code-block:: 30490 30491 ./mach raptor -t samsung 30492 30493 **Owner**: PerfTest Team 30494 30495 * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__, `largestContentfulPaint <raptor-metrics.html#largest-contentful-paint>`__ 30496 * **alert threshold**: 2.0 30497 * **apps**: firefox, chrome 30498 * **benchmark page**: false 30499 * **browser cycles**: 25 30500 * **expected**: pass 30501 * **gecko profile interval**: 1 30502 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp7/desktop/browsertime-tp7.toml#32>`__ 30503 * **lower is better**: true 30504 * **page cycles**: 25 30505 * **page timeout**: 60000 30506 * **playback**: mitmproxy 30507 * **playback pageset manifest**: mitm8-linux-firefox-samsung.manifest 30508 * **playback version**: 11.0.0 30509 * **secondary url**: `<https://www.samsung.com/us/mobile>`__ 30510 * **support class**: browsertime_pageload.py 30511 * **test url**: `<https://www.samsung.com/us>`__ 30512 * **type**: pageload 30513 * **unit**: ms 30514 * **use live sites**: false 30515 * **Test Task**: 30516 30517 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 30518 :widths: 30 15 15 15 15 30519 :header-rows: 1 30520 30521 * - **Test Name** 30522 - mozilla-central 30523 - autoland 30524 - mozilla-release 30525 - mozilla-beta 30526 * - **browsertime-tp7-firefox-samsung** 30527 - ❌ 30528 - ❌ 30529 - ❌ 30530 - ❌ 30531 30532 30533 .. list-table:: **test-linux1804-64-qr/opt** 30534 :widths: 30 15 15 15 15 30535 :header-rows: 1 30536 30537 * - **Test Name** 30538 - mozilla-central 30539 - autoland 30540 - mozilla-release 30541 - mozilla-beta 30542 * - **browsertime-tp7-firefox-samsung** 30543 - ❌ 30544 - ❌ 30545 - ❌ 30546 - ❌ 30547 30548 30549 .. list-table:: **test-linux1804-64-shippable-qr/opt** 30550 :widths: 30 15 15 15 15 30551 :header-rows: 1 30552 30553 * - **Test Name** 30554 - mozilla-central 30555 - autoland 30556 - mozilla-release 30557 - mozilla-beta 30558 * - **browsertime-tp7-chrome-samsung** 30559 - ❌ 30560 - ❌ 30561 - ❌ 30562 - ❌ 30563 * - **browsertime-tp7-firefox-samsung** 30564 - ❌ 30565 - ❌ 30566 - ❌ 30567 - ❌ 30568 30569 30570 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 30571 :widths: 30 15 15 15 15 30572 :header-rows: 1 30573 30574 * - **Test Name** 30575 - mozilla-central 30576 - autoland 30577 - mozilla-release 30578 - mozilla-beta 30579 * - **browsertime-tp7-firefox-samsung** 30580 - ❌ 30581 - ❌ 30582 - ❌ 30583 - ❌ 30584 30585 30586 .. list-table:: **test-macosx1470-64-shippable/opt** 30587 :widths: 30 15 15 15 15 30588 :header-rows: 1 30589 30590 * - **Test Name** 30591 - mozilla-central 30592 - autoland 30593 - mozilla-release 30594 - mozilla-beta 30595 * - **browsertime-tp7-chrome-samsung** 30596 - ❌ 30597 - ❌ 30598 - ❌ 30599 - ❌ 30600 * - **browsertime-tp7-firefox-samsung** 30601 - ❌ 30602 - ❌ 30603 - ❌ 30604 - ❌ 30605 30606 30607 .. list-table:: **test-macosx1470-64/opt** 30608 :widths: 30 15 15 15 15 30609 :header-rows: 1 30610 30611 * - **Test Name** 30612 - mozilla-central 30613 - autoland 30614 - mozilla-release 30615 - mozilla-beta 30616 * - **browsertime-tp7-firefox-samsung** 30617 - ❌ 30618 - ❌ 30619 - ❌ 30620 - ❌ 30621 30622 30623 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 30624 :widths: 30 15 15 15 15 30625 :header-rows: 1 30626 30627 * - **Test Name** 30628 - mozilla-central 30629 - autoland 30630 - mozilla-release 30631 - mozilla-beta 30632 * - **browsertime-tp7-firefox-samsung** 30633 - ❌ 30634 - ❌ 30635 - ❌ 30636 - ❌ 30637 30638 30639 .. list-table:: **test-windows11-64-24h2-shippable/opt** 30640 :widths: 30 15 15 15 15 30641 :header-rows: 1 30642 30643 * - **Test Name** 30644 - mozilla-central 30645 - autoland 30646 - mozilla-release 30647 - mozilla-beta 30648 * - **browsertime-tp7-chrome-samsung** 30649 - ❌ 30650 - ❌ 30651 - ❌ 30652 - ❌ 30653 * - **browsertime-tp7-firefox-samsung** 30654 - ❌ 30655 - ❌ 30656 - ❌ 30657 - ❌ 30658 30659 30660 .. list-table:: **test-windows11-64-24h2/opt** 30661 :widths: 30 15 15 15 15 30662 :header-rows: 1 30663 30664 * - **Test Name** 30665 - mozilla-central 30666 - autoland 30667 - mozilla-release 30668 - mozilla-beta 30669 * - **browsertime-tp7-firefox-samsung** 30670 - ❌ 30671 - ❌ 30672 - ❌ 30673 - ❌ 30674 30675 30676 30677 .. dropdown:: tiktok 30678 :class-container: anchor-id-tiktok-d 30679 30680 * Command to Run Locally 30681 30682 .. code-block:: 30683 30684 ./mach raptor -t tiktok 30685 30686 **Owner**: PerfTest Team 30687 30688 * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__, `largestContentfulPaint <raptor-metrics.html#largest-contentful-paint>`__ 30689 * **alert threshold**: 2.0 30690 * **apps**: firefox, chrome 30691 * **benchmark page**: false 30692 * **browser cycles**: 25 30693 * **expected**: pass 30694 * **gecko profile interval**: 1 30695 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp7/desktop/browsertime-tp7.toml#28>`__ 30696 * **lower is better**: true 30697 * **page cycles**: 25 30698 * **page timeout**: 60000 30699 * **playback**: mitmproxy 30700 * **playback pageset manifest**: mitm8-linux-firefox-tiktok.manifest 30701 * **playback version**: 11.0.0 30702 * **secondary url**: `<https://www.tiktok.com/explore>`__ 30703 * **support class**: browsertime_pageload.py 30704 * **test url**: `<https://www.tiktok.com/en>`__ 30705 * **type**: pageload 30706 * **unit**: ms 30707 * **use live sites**: false 30708 * **Test Task**: 30709 30710 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 30711 :widths: 30 15 15 15 15 30712 :header-rows: 1 30713 30714 * - **Test Name** 30715 - mozilla-central 30716 - autoland 30717 - mozilla-release 30718 - mozilla-beta 30719 * - **browsertime-tp7-firefox-tiktok** 30720 - ❌ 30721 - ❌ 30722 - ❌ 30723 - ❌ 30724 30725 30726 .. list-table:: **test-linux1804-64-qr/opt** 30727 :widths: 30 15 15 15 15 30728 :header-rows: 1 30729 30730 * - **Test Name** 30731 - mozilla-central 30732 - autoland 30733 - mozilla-release 30734 - mozilla-beta 30735 * - **browsertime-tp7-firefox-tiktok** 30736 - ❌ 30737 - ❌ 30738 - ❌ 30739 - ❌ 30740 30741 30742 .. list-table:: **test-linux1804-64-shippable-qr/opt** 30743 :widths: 30 15 15 15 15 30744 :header-rows: 1 30745 30746 * - **Test Name** 30747 - mozilla-central 30748 - autoland 30749 - mozilla-release 30750 - mozilla-beta 30751 * - **browsertime-tp7-chrome-tiktok** 30752 - ❌ 30753 - ❌ 30754 - ❌ 30755 - ❌ 30756 * - **browsertime-tp7-firefox-tiktok** 30757 - ❌ 30758 - ❌ 30759 - ❌ 30760 - ❌ 30761 30762 30763 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 30764 :widths: 30 15 15 15 15 30765 :header-rows: 1 30766 30767 * - **Test Name** 30768 - mozilla-central 30769 - autoland 30770 - mozilla-release 30771 - mozilla-beta 30772 * - **browsertime-tp7-firefox-tiktok** 30773 - ❌ 30774 - ❌ 30775 - ❌ 30776 - ❌ 30777 30778 30779 .. list-table:: **test-macosx1470-64-shippable/opt** 30780 :widths: 30 15 15 15 15 30781 :header-rows: 1 30782 30783 * - **Test Name** 30784 - mozilla-central 30785 - autoland 30786 - mozilla-release 30787 - mozilla-beta 30788 * - **browsertime-tp7-chrome-tiktok** 30789 - ❌ 30790 - ❌ 30791 - ❌ 30792 - ❌ 30793 * - **browsertime-tp7-firefox-tiktok** 30794 - ❌ 30795 - ❌ 30796 - ❌ 30797 - ❌ 30798 30799 30800 .. list-table:: **test-macosx1470-64/opt** 30801 :widths: 30 15 15 15 15 30802 :header-rows: 1 30803 30804 * - **Test Name** 30805 - mozilla-central 30806 - autoland 30807 - mozilla-release 30808 - mozilla-beta 30809 * - **browsertime-tp7-firefox-tiktok** 30810 - ❌ 30811 - ❌ 30812 - ❌ 30813 - ❌ 30814 30815 30816 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 30817 :widths: 30 15 15 15 15 30818 :header-rows: 1 30819 30820 * - **Test Name** 30821 - mozilla-central 30822 - autoland 30823 - mozilla-release 30824 - mozilla-beta 30825 * - **browsertime-tp7-firefox-tiktok** 30826 - ❌ 30827 - ❌ 30828 - ❌ 30829 - ❌ 30830 30831 30832 .. list-table:: **test-windows11-64-24h2-shippable/opt** 30833 :widths: 30 15 15 15 15 30834 :header-rows: 1 30835 30836 * - **Test Name** 30837 - mozilla-central 30838 - autoland 30839 - mozilla-release 30840 - mozilla-beta 30841 * - **browsertime-tp7-chrome-tiktok** 30842 - ❌ 30843 - ❌ 30844 - ❌ 30845 - ❌ 30846 * - **browsertime-tp7-firefox-tiktok** 30847 - ❌ 30848 - ❌ 30849 - ❌ 30850 - ❌ 30851 30852 30853 .. list-table:: **test-windows11-64-24h2/opt** 30854 :widths: 30 15 15 15 15 30855 :header-rows: 1 30856 30857 * - **Test Name** 30858 - mozilla-central 30859 - autoland 30860 - mozilla-release 30861 - mozilla-beta 30862 * - **browsertime-tp7-firefox-tiktok** 30863 - ❌ 30864 - ❌ 30865 - ❌ 30866 - ❌ 30867 30868 30869 30870 .. dropdown:: tumblr 30871 :class-container: anchor-id-tumblr-d 30872 30873 * Command to Run Locally 30874 30875 .. code-block:: 30876 30877 ./mach raptor -t tumblr 30878 30879 **Owner**: PerfTest Team 30880 30881 * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__, `largestContentfulPaint <raptor-metrics.html#largest-contentful-paint>`__ 30882 * **alert threshold**: 2.0 30883 * **apps**: firefox, chrome, safari, custom-car 30884 * **benchmark page**: true 30885 * **browser cycles**: 25 30886 * **expected**: pass 30887 * **gecko profile interval**: 1 30888 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#171>`__ 30889 * **lower is better**: true 30890 * **page cycles**: 25 30891 * **page timeout**: 60000 30892 * **playback**: mitmproxy 30893 * **playback pageset manifest**: mitm6-linux-firefox-tumblr.manifest 30894 * **playback version**: 8.1.1 30895 * **secondary url**: `<https://www.tumblr.com/tagged/funny+cats?sort=top>`__ 30896 * **support class**: browsertime_pageload.py 30897 * **test url**: `<https://www.tumblr.com/dashboard>`__ 30898 * **type**: pageload 30899 * **unit**: ms 30900 * **use live sites**: false 30901 * **Test Task**: 30902 30903 .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** 30904 :widths: 30 15 15 15 15 30905 :header-rows: 1 30906 30907 * - **Test Name** 30908 - mozilla-central 30909 - autoland 30910 - mozilla-release 30911 - mozilla-beta 30912 * - **browsertime-tp6-firefox-tumblr** 30913 - ❌ 30914 - ❌ 30915 - ❌ 30916 - ❌ 30917 * - **browsertime-tp6-live-firefox-tumblr** 30918 - ❌ 30919 - ❌ 30920 - ❌ 30921 - ❌ 30922 30923 30924 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 30925 :widths: 30 15 15 15 15 30926 :header-rows: 1 30927 30928 * - **Test Name** 30929 - mozilla-central 30930 - autoland 30931 - mozilla-release 30932 - mozilla-beta 30933 * - **browsertime-tp6-firefox-tumblr** 30934 - ❌ 30935 - ❌ 30936 - ❌ 30937 - ❌ 30938 * - **browsertime-tp6-live-firefox-tumblr** 30939 - ❌ 30940 - ❌ 30941 - ❌ 30942 - ❌ 30943 30944 30945 .. list-table:: **test-linux1804-64-qr/opt** 30946 :widths: 30 15 15 15 15 30947 :header-rows: 1 30948 30949 * - **Test Name** 30950 - mozilla-central 30951 - autoland 30952 - mozilla-release 30953 - mozilla-beta 30954 * - **browsertime-tp6-firefox-tumblr** 30955 - ❌ 30956 - ❌ 30957 - ❌ 30958 - ❌ 30959 * - **browsertime-tp6-live-firefox-tumblr** 30960 - ❌ 30961 - ❌ 30962 - ❌ 30963 - ❌ 30964 30965 30966 .. list-table:: **test-linux1804-64-shippable-qr/opt** 30967 :widths: 30 15 15 15 15 30968 :header-rows: 1 30969 30970 * - **Test Name** 30971 - mozilla-central 30972 - autoland 30973 - mozilla-release 30974 - mozilla-beta 30975 * - **browsertime-tp6-chrome-tumblr** 30976 - ❌ 30977 - ❌ 30978 - ❌ 30979 - ❌ 30980 * - **browsertime-tp6-custom-car-tumblr** 30981 - ❌ 30982 - ❌ 30983 - ❌ 30984 - ❌ 30985 * - **browsertime-tp6-firefox-tumblr** 30986 - ✅ 30987 - ✅ 30988 - ❌ 30989 - ❌ 30990 * - **browsertime-tp6-live-chrome-tumblr** 30991 - ❌ 30992 - ❌ 30993 - ❌ 30994 - ❌ 30995 * - **browsertime-tp6-live-firefox-tumblr** 30996 - ❌ 30997 - ❌ 30998 - ❌ 30999 - ❌ 31000 31001 31002 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 31003 :widths: 30 15 15 15 15 31004 :header-rows: 1 31005 31006 * - **Test Name** 31007 - mozilla-central 31008 - autoland 31009 - mozilla-release 31010 - mozilla-beta 31011 * - **browsertime-tp6-firefox-tumblr** 31012 - ❌ 31013 - ❌ 31014 - ❌ 31015 - ❌ 31016 * - **browsertime-tp6-live-firefox-tumblr** 31017 - ❌ 31018 - ❌ 31019 - ❌ 31020 - ❌ 31021 31022 31023 .. list-table:: **test-macosx1470-64-shippable/opt** 31024 :widths: 30 15 15 15 15 31025 :header-rows: 1 31026 31027 * - **Test Name** 31028 - mozilla-central 31029 - autoland 31030 - mozilla-release 31031 - mozilla-beta 31032 * - **browsertime-tp6-chrome-tumblr** 31033 - ❌ 31034 - ❌ 31035 - ❌ 31036 - ❌ 31037 * - **browsertime-tp6-custom-car-tumblr** 31038 - ❌ 31039 - ❌ 31040 - ❌ 31041 - ❌ 31042 * - **browsertime-tp6-firefox-tumblr** 31043 - ✅ 31044 - ✅ 31045 - ❌ 31046 - ❌ 31047 * - **browsertime-tp6-live-chrome-tumblr** 31048 - ❌ 31049 - ❌ 31050 - ❌ 31051 - ❌ 31052 * - **browsertime-tp6-live-firefox-tumblr** 31053 - ❌ 31054 - ❌ 31055 - ❌ 31056 - ❌ 31057 * - **browsertime-tp6-live-safari-tumblr** 31058 - ❌ 31059 - ❌ 31060 - ❌ 31061 - ❌ 31062 31063 31064 .. list-table:: **test-macosx1470-64/opt** 31065 :widths: 30 15 15 15 15 31066 :header-rows: 1 31067 31068 * - **Test Name** 31069 - mozilla-central 31070 - autoland 31071 - mozilla-release 31072 - mozilla-beta 31073 * - **browsertime-tp6-firefox-tumblr** 31074 - ❌ 31075 - ❌ 31076 - ❌ 31077 - ❌ 31078 * - **browsertime-tp6-live-firefox-tumblr** 31079 - ❌ 31080 - ❌ 31081 - ❌ 31082 - ❌ 31083 31084 31085 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 31086 :widths: 30 15 15 15 15 31087 :header-rows: 1 31088 31089 * - **Test Name** 31090 - mozilla-central 31091 - autoland 31092 - mozilla-release 31093 - mozilla-beta 31094 * - **browsertime-tp6-firefox-tumblr** 31095 - ❌ 31096 - ❌ 31097 - ❌ 31098 - ❌ 31099 * - **browsertime-tp6-live-firefox-tumblr** 31100 - ❌ 31101 - ❌ 31102 - ❌ 31103 - ❌ 31104 31105 31106 .. list-table:: **test-windows11-64-24h2-shippable/opt** 31107 :widths: 30 15 15 15 15 31108 :header-rows: 1 31109 31110 * - **Test Name** 31111 - mozilla-central 31112 - autoland 31113 - mozilla-release 31114 - mozilla-beta 31115 * - **browsertime-tp6-chrome-tumblr** 31116 - ❌ 31117 - ❌ 31118 - ❌ 31119 - ❌ 31120 * - **browsertime-tp6-custom-car-tumblr** 31121 - ❌ 31122 - ❌ 31123 - ❌ 31124 - ❌ 31125 * - **browsertime-tp6-firefox-tumblr** 31126 - ✅ 31127 - ✅ 31128 - ❌ 31129 - ❌ 31130 * - **browsertime-tp6-live-chrome-tumblr** 31131 - ❌ 31132 - ❌ 31133 - ❌ 31134 - ❌ 31135 * - **browsertime-tp6-live-firefox-tumblr** 31136 - ❌ 31137 - ❌ 31138 - ❌ 31139 - ❌ 31140 31141 31142 .. list-table:: **test-windows11-64-24h2/opt** 31143 :widths: 30 15 15 15 15 31144 :header-rows: 1 31145 31146 * - **Test Name** 31147 - mozilla-central 31148 - autoland 31149 - mozilla-release 31150 - mozilla-beta 31151 * - **browsertime-tp6-firefox-tumblr** 31152 - ❌ 31153 - ❌ 31154 - ❌ 31155 - ❌ 31156 * - **browsertime-tp6-live-firefox-tumblr** 31157 - ❌ 31158 - ❌ 31159 - ❌ 31160 - ❌ 31161 31162 31163 31164 .. dropdown:: twitch 31165 :class-container: anchor-id-twitch-d 31166 31167 * Command to Run Locally 31168 31169 .. code-block:: 31170 31171 ./mach raptor -t twitch 31172 31173 **Owner**: PerfTest Team 31174 31175 * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__ 31176 * **alert threshold**: 2.0 31177 * **apps**: firefox, chrome, safari, custom-car 31178 * **benchmark page**: true 31179 * **browser cycles**: 25 31180 * **expected**: pass 31181 * **gecko profile interval**: 1 31182 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#177>`__ 31183 * **lower is better**: true 31184 * **measure**: fcp, loadtime, ContentfulSpeedIndex, PerceptualSpeedIndex, SpeedIndex, FirstVisualChange, LastVisualChange 31185 * **page cycles**: 25 31186 * **page timeout**: 60000 31187 * **playback**: mitmproxy 31188 * **playback pageset manifest**: mitm8-linux-firefox-twitch.manifest 31189 * **playback version**: 11.0.0 31190 * **preferences**: media.autoplay.default=5 media.autoplay.ask-permission=true media.autoplay.blocking_policy=1 media.allowed-to-play.enabled=false media.block-autoplay-until-in-foreground=true 31191 * **secondary url**: `<https://www.twitch.tv/gmashley>`__ 31192 * **support class**: browsertime_pageload.py 31193 * **test url**: `<https://www.twitch.tv/videos/894226211>`__ 31194 * **type**: pageload 31195 * **unit**: ms 31196 * **use live sites**: false 31197 * **Test Task**: 31198 31199 .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** 31200 :widths: 30 15 15 15 15 31201 :header-rows: 1 31202 31203 * - **Test Name** 31204 - mozilla-central 31205 - autoland 31206 - mozilla-release 31207 - mozilla-beta 31208 * - **browsertime-tp6-firefox-twitch** 31209 - ❌ 31210 - ❌ 31211 - ❌ 31212 - ❌ 31213 * - **browsertime-tp6-live-firefox-twitch** 31214 - ❌ 31215 - ❌ 31216 - ❌ 31217 - ❌ 31218 31219 31220 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 31221 :widths: 30 15 15 15 15 31222 :header-rows: 1 31223 31224 * - **Test Name** 31225 - mozilla-central 31226 - autoland 31227 - mozilla-release 31228 - mozilla-beta 31229 * - **browsertime-tp6-firefox-twitch** 31230 - ❌ 31231 - ❌ 31232 - ❌ 31233 - ❌ 31234 * - **browsertime-tp6-live-firefox-twitch** 31235 - ❌ 31236 - ❌ 31237 - ❌ 31238 - ❌ 31239 31240 31241 .. list-table:: **test-linux1804-64-qr/opt** 31242 :widths: 30 15 15 15 15 31243 :header-rows: 1 31244 31245 * - **Test Name** 31246 - mozilla-central 31247 - autoland 31248 - mozilla-release 31249 - mozilla-beta 31250 * - **browsertime-tp6-firefox-twitch** 31251 - ❌ 31252 - ❌ 31253 - ❌ 31254 - ❌ 31255 * - **browsertime-tp6-live-firefox-twitch** 31256 - ❌ 31257 - ❌ 31258 - ❌ 31259 - ❌ 31260 31261 31262 .. list-table:: **test-linux1804-64-shippable-qr/opt** 31263 :widths: 30 15 15 15 15 31264 :header-rows: 1 31265 31266 * - **Test Name** 31267 - mozilla-central 31268 - autoland 31269 - mozilla-release 31270 - mozilla-beta 31271 * - **browsertime-tp6-chrome-twitch** 31272 - ❌ 31273 - ❌ 31274 - ❌ 31275 - ❌ 31276 * - **browsertime-tp6-custom-car-twitch** 31277 - ❌ 31278 - ❌ 31279 - ❌ 31280 - ❌ 31281 * - **browsertime-tp6-firefox-twitch** 31282 - ✅ 31283 - ✅ 31284 - ❌ 31285 - ❌ 31286 * - **browsertime-tp6-live-chrome-twitch** 31287 - ❌ 31288 - ❌ 31289 - ❌ 31290 - ❌ 31291 * - **browsertime-tp6-live-firefox-twitch** 31292 - ❌ 31293 - ❌ 31294 - ❌ 31295 - ❌ 31296 31297 31298 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 31299 :widths: 30 15 15 15 15 31300 :header-rows: 1 31301 31302 * - **Test Name** 31303 - mozilla-central 31304 - autoland 31305 - mozilla-release 31306 - mozilla-beta 31307 * - **browsertime-tp6-firefox-twitch** 31308 - ❌ 31309 - ❌ 31310 - ❌ 31311 - ❌ 31312 * - **browsertime-tp6-live-firefox-twitch** 31313 - ❌ 31314 - ❌ 31315 - ❌ 31316 - ❌ 31317 31318 31319 .. list-table:: **test-macosx1470-64-shippable/opt** 31320 :widths: 30 15 15 15 15 31321 :header-rows: 1 31322 31323 * - **Test Name** 31324 - mozilla-central 31325 - autoland 31326 - mozilla-release 31327 - mozilla-beta 31328 * - **browsertime-tp6-chrome-twitch** 31329 - ❌ 31330 - ❌ 31331 - ❌ 31332 - ❌ 31333 * - **browsertime-tp6-custom-car-twitch** 31334 - ❌ 31335 - ❌ 31336 - ❌ 31337 - ❌ 31338 * - **browsertime-tp6-firefox-twitch** 31339 - ✅ 31340 - ✅ 31341 - ❌ 31342 - ❌ 31343 * - **browsertime-tp6-live-chrome-twitch** 31344 - ❌ 31345 - ❌ 31346 - ❌ 31347 - ❌ 31348 * - **browsertime-tp6-live-firefox-twitch** 31349 - ❌ 31350 - ❌ 31351 - ❌ 31352 - ❌ 31353 * - **browsertime-tp6-live-safari-twitch** 31354 - ❌ 31355 - ❌ 31356 - ❌ 31357 - ❌ 31358 31359 31360 .. list-table:: **test-macosx1470-64/opt** 31361 :widths: 30 15 15 15 15 31362 :header-rows: 1 31363 31364 * - **Test Name** 31365 - mozilla-central 31366 - autoland 31367 - mozilla-release 31368 - mozilla-beta 31369 * - **browsertime-tp6-firefox-twitch** 31370 - ❌ 31371 - ❌ 31372 - ❌ 31373 - ❌ 31374 * - **browsertime-tp6-live-firefox-twitch** 31375 - ❌ 31376 - ❌ 31377 - ❌ 31378 - ❌ 31379 31380 31381 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 31382 :widths: 30 15 15 15 15 31383 :header-rows: 1 31384 31385 * - **Test Name** 31386 - mozilla-central 31387 - autoland 31388 - mozilla-release 31389 - mozilla-beta 31390 * - **browsertime-tp6-firefox-twitch** 31391 - ❌ 31392 - ❌ 31393 - ❌ 31394 - ❌ 31395 * - **browsertime-tp6-live-firefox-twitch** 31396 - ❌ 31397 - ❌ 31398 - ❌ 31399 - ❌ 31400 31401 31402 .. list-table:: **test-windows11-64-24h2-shippable/opt** 31403 :widths: 30 15 15 15 15 31404 :header-rows: 1 31405 31406 * - **Test Name** 31407 - mozilla-central 31408 - autoland 31409 - mozilla-release 31410 - mozilla-beta 31411 * - **browsertime-tp6-chrome-twitch** 31412 - ❌ 31413 - ❌ 31414 - ❌ 31415 - ❌ 31416 * - **browsertime-tp6-custom-car-twitch** 31417 - ❌ 31418 - ❌ 31419 - ❌ 31420 - ❌ 31421 * - **browsertime-tp6-firefox-twitch** 31422 - ✅ 31423 - ✅ 31424 - ❌ 31425 - ❌ 31426 * - **browsertime-tp6-live-chrome-twitch** 31427 - ❌ 31428 - ❌ 31429 - ❌ 31430 - ❌ 31431 * - **browsertime-tp6-live-firefox-twitch** 31432 - ❌ 31433 - ❌ 31434 - ❌ 31435 - ❌ 31436 31437 31438 .. list-table:: **test-windows11-64-24h2/opt** 31439 :widths: 30 15 15 15 15 31440 :header-rows: 1 31441 31442 * - **Test Name** 31443 - mozilla-central 31444 - autoland 31445 - mozilla-release 31446 - mozilla-beta 31447 * - **browsertime-tp6-firefox-twitch** 31448 - ❌ 31449 - ❌ 31450 - ❌ 31451 - ❌ 31452 * - **browsertime-tp6-live-firefox-twitch** 31453 - ❌ 31454 - ❌ 31455 - ❌ 31456 - ❌ 31457 31458 31459 31460 .. dropdown:: twitter 31461 :class-container: anchor-id-twitter-d 31462 31463 * Command to Run Locally 31464 31465 .. code-block:: 31466 31467 ./mach raptor -t twitter 31468 31469 **Owner**: PerfTest Team 31470 31471 * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__, `largestContentfulPaint <raptor-metrics.html#largest-contentful-paint>`__ 31472 * **alert threshold**: 2.0 31473 * **apps**: firefox, chrome, safari, custom-car 31474 * **benchmark page**: false 31475 * **browser cycles**: 25 31476 * **expected**: pass 31477 * **gecko profile interval**: 1 31478 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#190>`__ 31479 * **lower is better**: true 31480 * **page cycles**: 25 31481 * **page timeout**: 60000 31482 * **playback**: mitmproxy 31483 * **playback pageset manifest**: mitm5-linux-firefox-twitter.manifest 31484 * **playback version**: 11.0.0 31485 * **support class**: browsertime_pageload.py 31486 * **test url**: `<https://twitter.com/BarackObama>`__ 31487 * **type**: pageload 31488 * **unit**: ms 31489 * **use live sites**: false 31490 * **Test Task**: 31491 31492 .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** 31493 :widths: 30 15 15 15 15 31494 :header-rows: 1 31495 31496 * - **Test Name** 31497 - mozilla-central 31498 - autoland 31499 - mozilla-release 31500 - mozilla-beta 31501 * - **browsertime-tp6-bytecode-firefox-twitter** 31502 - ❌ 31503 - ❌ 31504 - ❌ 31505 - ❌ 31506 * - **browsertime-tp6-essential-firefox-twitter** 31507 - ❌ 31508 - ❌ 31509 - ❌ 31510 - ❌ 31511 * - **browsertime-tp6-live-firefox-twitter** 31512 - ❌ 31513 - ❌ 31514 - ❌ 31515 - ❌ 31516 31517 31518 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 31519 :widths: 30 15 15 15 15 31520 :header-rows: 1 31521 31522 * - **Test Name** 31523 - mozilla-central 31524 - autoland 31525 - mozilla-release 31526 - mozilla-beta 31527 * - **browsertime-tp6-bytecode-firefox-twitter** 31528 - ❌ 31529 - ❌ 31530 - ❌ 31531 - ❌ 31532 * - **browsertime-tp6-essential-firefox-twitter** 31533 - ❌ 31534 - ❌ 31535 - ❌ 31536 - ❌ 31537 * - **browsertime-tp6-live-firefox-twitter** 31538 - ❌ 31539 - ❌ 31540 - ❌ 31541 - ❌ 31542 31543 31544 .. list-table:: **test-linux1804-64-qr/opt** 31545 :widths: 30 15 15 15 15 31546 :header-rows: 1 31547 31548 * - **Test Name** 31549 - mozilla-central 31550 - autoland 31551 - mozilla-release 31552 - mozilla-beta 31553 * - **browsertime-tp6-bytecode-firefox-twitter** 31554 - ❌ 31555 - ❌ 31556 - ❌ 31557 - ❌ 31558 * - **browsertime-tp6-essential-firefox-twitter** 31559 - ❌ 31560 - ❌ 31561 - ❌ 31562 - ❌ 31563 * - **browsertime-tp6-live-firefox-twitter** 31564 - ❌ 31565 - ❌ 31566 - ❌ 31567 - ❌ 31568 31569 31570 .. list-table:: **test-linux1804-64-shippable-qr/opt** 31571 :widths: 30 15 15 15 15 31572 :header-rows: 1 31573 31574 * - **Test Name** 31575 - mozilla-central 31576 - autoland 31577 - mozilla-release 31578 - mozilla-beta 31579 * - **browsertime-tp6-bytecode-firefox-twitter** 31580 - ✅ 31581 - ✅ 31582 - ❌ 31583 - ❌ 31584 * - **browsertime-tp6-essential-chrome-twitter** 31585 - ❌ 31586 - ❌ 31587 - ❌ 31588 - ❌ 31589 * - **browsertime-tp6-essential-custom-car-twitter** 31590 - ❌ 31591 - ❌ 31592 - ❌ 31593 - ❌ 31594 * - **browsertime-tp6-essential-firefox-twitter** 31595 - ✅ 31596 - ✅ 31597 - ❌ 31598 - ❌ 31599 * - **browsertime-tp6-live-chrome-twitter** 31600 - ❌ 31601 - ❌ 31602 - ❌ 31603 - ❌ 31604 * - **browsertime-tp6-live-firefox-twitter** 31605 - ❌ 31606 - ❌ 31607 - ❌ 31608 - ❌ 31609 31610 31611 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 31612 :widths: 30 15 15 15 15 31613 :header-rows: 1 31614 31615 * - **Test Name** 31616 - mozilla-central 31617 - autoland 31618 - mozilla-release 31619 - mozilla-beta 31620 * - **browsertime-tp6-bytecode-firefox-twitter** 31621 - ❌ 31622 - ❌ 31623 - ❌ 31624 - ❌ 31625 * - **browsertime-tp6-essential-firefox-twitter** 31626 - ❌ 31627 - ❌ 31628 - ❌ 31629 - ❌ 31630 * - **browsertime-tp6-live-firefox-twitter** 31631 - ❌ 31632 - ❌ 31633 - ❌ 31634 - ❌ 31635 31636 31637 .. list-table:: **test-macosx1470-64-shippable/opt** 31638 :widths: 30 15 15 15 15 31639 :header-rows: 1 31640 31641 * - **Test Name** 31642 - mozilla-central 31643 - autoland 31644 - mozilla-release 31645 - mozilla-beta 31646 * - **browsertime-tp6-bytecode-firefox-twitter** 31647 - ✅ 31648 - ✅ 31649 - ❌ 31650 - ❌ 31651 * - **browsertime-tp6-essential-chrome-twitter** 31652 - ❌ 31653 - ❌ 31654 - ❌ 31655 - ❌ 31656 * - **browsertime-tp6-essential-custom-car-twitter** 31657 - ❌ 31658 - ❌ 31659 - ❌ 31660 - ❌ 31661 * - **browsertime-tp6-essential-firefox-twitter** 31662 - ✅ 31663 - ✅ 31664 - ❌ 31665 - ❌ 31666 * - **browsertime-tp6-live-chrome-twitter** 31667 - ❌ 31668 - ❌ 31669 - ❌ 31670 - ❌ 31671 * - **browsertime-tp6-live-firefox-twitter** 31672 - ❌ 31673 - ❌ 31674 - ❌ 31675 - ❌ 31676 31677 31678 .. list-table:: **test-macosx1470-64/opt** 31679 :widths: 30 15 15 15 15 31680 :header-rows: 1 31681 31682 * - **Test Name** 31683 - mozilla-central 31684 - autoland 31685 - mozilla-release 31686 - mozilla-beta 31687 * - **browsertime-tp6-bytecode-firefox-twitter** 31688 - ❌ 31689 - ❌ 31690 - ❌ 31691 - ❌ 31692 * - **browsertime-tp6-essential-firefox-twitter** 31693 - ❌ 31694 - ❌ 31695 - ❌ 31696 - ❌ 31697 * - **browsertime-tp6-live-firefox-twitter** 31698 - ❌ 31699 - ❌ 31700 - ❌ 31701 - ❌ 31702 31703 31704 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 31705 :widths: 30 15 15 15 15 31706 :header-rows: 1 31707 31708 * - **Test Name** 31709 - mozilla-central 31710 - autoland 31711 - mozilla-release 31712 - mozilla-beta 31713 * - **browsertime-tp6-bytecode-firefox-twitter** 31714 - ❌ 31715 - ❌ 31716 - ❌ 31717 - ❌ 31718 * - **browsertime-tp6-essential-firefox-twitter** 31719 - ❌ 31720 - ❌ 31721 - ❌ 31722 - ❌ 31723 * - **browsertime-tp6-live-firefox-twitter** 31724 - ❌ 31725 - ❌ 31726 - ❌ 31727 - ❌ 31728 31729 31730 .. list-table:: **test-windows11-64-24h2-shippable/opt** 31731 :widths: 30 15 15 15 15 31732 :header-rows: 1 31733 31734 * - **Test Name** 31735 - mozilla-central 31736 - autoland 31737 - mozilla-release 31738 - mozilla-beta 31739 * - **browsertime-tp6-bytecode-firefox-twitter** 31740 - ✅ 31741 - ✅ 31742 - ❌ 31743 - ❌ 31744 * - **browsertime-tp6-essential-chrome-twitter** 31745 - ❌ 31746 - ❌ 31747 - ❌ 31748 - ❌ 31749 * - **browsertime-tp6-essential-custom-car-twitter** 31750 - ❌ 31751 - ❌ 31752 - ❌ 31753 - ❌ 31754 * - **browsertime-tp6-essential-firefox-twitter** 31755 - ✅ 31756 - ✅ 31757 - ❌ 31758 - ❌ 31759 * - **browsertime-tp6-live-chrome-twitter** 31760 - ❌ 31761 - ❌ 31762 - ❌ 31763 - ❌ 31764 * - **browsertime-tp6-live-firefox-twitter** 31765 - ❌ 31766 - ❌ 31767 - ❌ 31768 - ❌ 31769 31770 31771 .. list-table:: **test-windows11-64-24h2/opt** 31772 :widths: 30 15 15 15 15 31773 :header-rows: 1 31774 31775 * - **Test Name** 31776 - mozilla-central 31777 - autoland 31778 - mozilla-release 31779 - mozilla-beta 31780 * - **browsertime-tp6-bytecode-firefox-twitter** 31781 - ❌ 31782 - ❌ 31783 - ❌ 31784 - ❌ 31785 * - **browsertime-tp6-essential-firefox-twitter** 31786 - ❌ 31787 - ❌ 31788 - ❌ 31789 - ❌ 31790 * - **browsertime-tp6-live-firefox-twitter** 31791 - ❌ 31792 - ❌ 31793 - ❌ 31794 - ❌ 31795 31796 31797 31798 .. dropdown:: weather 31799 :class-container: anchor-id-weather-d 31800 31801 * Command to Run Locally 31802 31803 .. code-block:: 31804 31805 ./mach raptor -t weather 31806 31807 **Owner**: PerfTest Team 31808 31809 * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__, `largestContentfulPaint <raptor-metrics.html#largest-contentful-paint>`__ 31810 * **alert threshold**: 2.0 31811 * **apps**: firefox, chrome 31812 * **benchmark page**: false 31813 * **browser cycles**: 25 31814 * **expected**: pass 31815 * **gecko profile interval**: 1 31816 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp7/desktop/browsertime-tp7.toml#41>`__ 31817 * **lower is better**: true 31818 * **page cycles**: 25 31819 * **page timeout**: 60000 31820 * **playback**: mitmproxy 31821 * **playback pageset manifest**: mitm8-linux-firefox-weather.manifest 31822 * **playback version**: 11.0.0 31823 * **secondary url**: `<https://weather.com/en-CA/weather/monthly/l/43.67%2C-79.42>`__ 31824 * **support class**: browsertime_pageload.py 31825 * **test url**: `<https://weather.com/en-CA/weather/today/l/43.67%2C-79.42>`__ 31826 * **type**: pageload 31827 * **unit**: ms 31828 * **use live sites**: false 31829 * **Test Task**: 31830 31831 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 31832 :widths: 30 15 15 15 15 31833 :header-rows: 1 31834 31835 * - **Test Name** 31836 - mozilla-central 31837 - autoland 31838 - mozilla-release 31839 - mozilla-beta 31840 * - **browsertime-tp7-firefox-weather** 31841 - ❌ 31842 - ❌ 31843 - ❌ 31844 - ❌ 31845 31846 31847 .. list-table:: **test-linux1804-64-qr/opt** 31848 :widths: 30 15 15 15 15 31849 :header-rows: 1 31850 31851 * - **Test Name** 31852 - mozilla-central 31853 - autoland 31854 - mozilla-release 31855 - mozilla-beta 31856 * - **browsertime-tp7-firefox-weather** 31857 - ❌ 31858 - ❌ 31859 - ❌ 31860 - ❌ 31861 31862 31863 .. list-table:: **test-linux1804-64-shippable-qr/opt** 31864 :widths: 30 15 15 15 15 31865 :header-rows: 1 31866 31867 * - **Test Name** 31868 - mozilla-central 31869 - autoland 31870 - mozilla-release 31871 - mozilla-beta 31872 * - **browsertime-tp7-chrome-weather** 31873 - ❌ 31874 - ❌ 31875 - ❌ 31876 - ❌ 31877 * - **browsertime-tp7-firefox-weather** 31878 - ❌ 31879 - ❌ 31880 - ❌ 31881 - ❌ 31882 31883 31884 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 31885 :widths: 30 15 15 15 15 31886 :header-rows: 1 31887 31888 * - **Test Name** 31889 - mozilla-central 31890 - autoland 31891 - mozilla-release 31892 - mozilla-beta 31893 * - **browsertime-tp7-firefox-weather** 31894 - ❌ 31895 - ❌ 31896 - ❌ 31897 - ❌ 31898 31899 31900 .. list-table:: **test-macosx1470-64-shippable/opt** 31901 :widths: 30 15 15 15 15 31902 :header-rows: 1 31903 31904 * - **Test Name** 31905 - mozilla-central 31906 - autoland 31907 - mozilla-release 31908 - mozilla-beta 31909 * - **browsertime-tp7-chrome-weather** 31910 - ❌ 31911 - ❌ 31912 - ❌ 31913 - ❌ 31914 * - **browsertime-tp7-firefox-weather** 31915 - ❌ 31916 - ❌ 31917 - ❌ 31918 - ❌ 31919 31920 31921 .. list-table:: **test-macosx1470-64/opt** 31922 :widths: 30 15 15 15 15 31923 :header-rows: 1 31924 31925 * - **Test Name** 31926 - mozilla-central 31927 - autoland 31928 - mozilla-release 31929 - mozilla-beta 31930 * - **browsertime-tp7-firefox-weather** 31931 - ❌ 31932 - ❌ 31933 - ❌ 31934 - ❌ 31935 31936 31937 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 31938 :widths: 30 15 15 15 15 31939 :header-rows: 1 31940 31941 * - **Test Name** 31942 - mozilla-central 31943 - autoland 31944 - mozilla-release 31945 - mozilla-beta 31946 * - **browsertime-tp7-firefox-weather** 31947 - ❌ 31948 - ❌ 31949 - ❌ 31950 - ❌ 31951 31952 31953 .. list-table:: **test-windows11-64-24h2-shippable/opt** 31954 :widths: 30 15 15 15 15 31955 :header-rows: 1 31956 31957 * - **Test Name** 31958 - mozilla-central 31959 - autoland 31960 - mozilla-release 31961 - mozilla-beta 31962 * - **browsertime-tp7-chrome-weather** 31963 - ❌ 31964 - ❌ 31965 - ❌ 31966 - ❌ 31967 * - **browsertime-tp7-firefox-weather** 31968 - ❌ 31969 - ❌ 31970 - ❌ 31971 - ❌ 31972 31973 31974 .. list-table:: **test-windows11-64-24h2/opt** 31975 :widths: 30 15 15 15 15 31976 :header-rows: 1 31977 31978 * - **Test Name** 31979 - mozilla-central 31980 - autoland 31981 - mozilla-release 31982 - mozilla-beta 31983 * - **browsertime-tp7-firefox-weather** 31984 - ❌ 31985 - ❌ 31986 - ❌ 31987 - ❌ 31988 31989 31990 31991 .. dropdown:: wikia 31992 :class-container: anchor-id-wikia-d 31993 31994 * Command to Run Locally 31995 31996 .. code-block:: 31997 31998 ./mach raptor -t wikia 31999 32000 **Owner**: PerfTest Team 32001 32002 * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__, `largestContentfulPaint <raptor-metrics.html#largest-contentful-paint>`__ 32003 * **alert threshold**: 2.0 32004 * **apps**: firefox, chrome, safari, custom-car 32005 * **benchmark page**: false 32006 * **browser cycles**: 25 32007 * **expected**: pass 32008 * **gecko profile interval**: 1 32009 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#195>`__ 32010 * **lower is better**: true 32011 * **page cycles**: 25 32012 * **page timeout**: 60000 32013 * **playback**: mitmproxy 32014 * **playback pageset manifest**: mitm7-linux-firefox-wikia.manifest 32015 * **playback version**: 11.0.0 32016 * **secondary url**: `<https://marvel.fandom.com/wiki/Celestials>`__ 32017 * **support class**: browsertime_pageload.py 32018 * **test url**: `<https://marvel.fandom.com/wiki/Black_Panther>`__ 32019 * **type**: pageload 32020 * **unit**: ms 32021 * **use live sites**: false 32022 * **Test Task**: 32023 32024 .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** 32025 :widths: 30 15 15 15 15 32026 :header-rows: 1 32027 32028 * - **Test Name** 32029 - mozilla-central 32030 - autoland 32031 - mozilla-release 32032 - mozilla-beta 32033 * - **browsertime-tp6-firefox-wikia** 32034 - ❌ 32035 - ❌ 32036 - ❌ 32037 - ❌ 32038 32039 32040 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 32041 :widths: 30 15 15 15 15 32042 :header-rows: 1 32043 32044 * - **Test Name** 32045 - mozilla-central 32046 - autoland 32047 - mozilla-release 32048 - mozilla-beta 32049 * - **browsertime-tp6-firefox-wikia** 32050 - ❌ 32051 - ❌ 32052 - ❌ 32053 - ❌ 32054 32055 32056 .. list-table:: **test-linux1804-64-qr/opt** 32057 :widths: 30 15 15 15 15 32058 :header-rows: 1 32059 32060 * - **Test Name** 32061 - mozilla-central 32062 - autoland 32063 - mozilla-release 32064 - mozilla-beta 32065 * - **browsertime-tp6-firefox-wikia** 32066 - ❌ 32067 - ❌ 32068 - ❌ 32069 - ❌ 32070 32071 32072 .. list-table:: **test-linux1804-64-shippable-qr/opt** 32073 :widths: 30 15 15 15 15 32074 :header-rows: 1 32075 32076 * - **Test Name** 32077 - mozilla-central 32078 - autoland 32079 - mozilla-release 32080 - mozilla-beta 32081 * - **browsertime-tp6-chrome-wikia** 32082 - ❌ 32083 - ❌ 32084 - ❌ 32085 - ❌ 32086 * - **browsertime-tp6-custom-car-wikia** 32087 - ❌ 32088 - ❌ 32089 - ❌ 32090 - ❌ 32091 * - **browsertime-tp6-firefox-wikia** 32092 - ✅ 32093 - ✅ 32094 - ❌ 32095 - ❌ 32096 32097 32098 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 32099 :widths: 30 15 15 15 15 32100 :header-rows: 1 32101 32102 * - **Test Name** 32103 - mozilla-central 32104 - autoland 32105 - mozilla-release 32106 - mozilla-beta 32107 * - **browsertime-tp6-firefox-wikia** 32108 - ❌ 32109 - ❌ 32110 - ❌ 32111 - ❌ 32112 32113 32114 .. list-table:: **test-macosx1470-64-shippable/opt** 32115 :widths: 30 15 15 15 15 32116 :header-rows: 1 32117 32118 * - **Test Name** 32119 - mozilla-central 32120 - autoland 32121 - mozilla-release 32122 - mozilla-beta 32123 * - **browsertime-tp6-chrome-wikia** 32124 - ❌ 32125 - ❌ 32126 - ❌ 32127 - ❌ 32128 * - **browsertime-tp6-custom-car-wikia** 32129 - ❌ 32130 - ❌ 32131 - ❌ 32132 - ❌ 32133 * - **browsertime-tp6-firefox-wikia** 32134 - ✅ 32135 - ✅ 32136 - ❌ 32137 - ❌ 32138 32139 32140 .. list-table:: **test-macosx1470-64/opt** 32141 :widths: 30 15 15 15 15 32142 :header-rows: 1 32143 32144 * - **Test Name** 32145 - mozilla-central 32146 - autoland 32147 - mozilla-release 32148 - mozilla-beta 32149 * - **browsertime-tp6-firefox-wikia** 32150 - ❌ 32151 - ❌ 32152 - ❌ 32153 - ❌ 32154 32155 32156 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 32157 :widths: 30 15 15 15 15 32158 :header-rows: 1 32159 32160 * - **Test Name** 32161 - mozilla-central 32162 - autoland 32163 - mozilla-release 32164 - mozilla-beta 32165 * - **browsertime-tp6-firefox-wikia** 32166 - ❌ 32167 - ❌ 32168 - ❌ 32169 - ❌ 32170 32171 32172 .. list-table:: **test-windows11-64-24h2-shippable/opt** 32173 :widths: 30 15 15 15 15 32174 :header-rows: 1 32175 32176 * - **Test Name** 32177 - mozilla-central 32178 - autoland 32179 - mozilla-release 32180 - mozilla-beta 32181 * - **browsertime-tp6-chrome-wikia** 32182 - ❌ 32183 - ❌ 32184 - ❌ 32185 - ❌ 32186 * - **browsertime-tp6-custom-car-wikia** 32187 - ❌ 32188 - ❌ 32189 - ❌ 32190 - ❌ 32191 * - **browsertime-tp6-firefox-wikia** 32192 - ✅ 32193 - ✅ 32194 - ❌ 32195 - ❌ 32196 32197 32198 .. list-table:: **test-windows11-64-24h2/opt** 32199 :widths: 30 15 15 15 15 32200 :header-rows: 1 32201 32202 * - **Test Name** 32203 - mozilla-central 32204 - autoland 32205 - mozilla-release 32206 - mozilla-beta 32207 * - **browsertime-tp6-firefox-wikia** 32208 - ❌ 32209 - ❌ 32210 - ❌ 32211 - ❌ 32212 32213 32214 32215 .. dropdown:: wikipedia 32216 :class-container: anchor-id-wikipedia-d 32217 32218 * Command to Run Locally 32219 32220 .. code-block:: 32221 32222 ./mach raptor -t wikipedia 32223 32224 **Owner**: PerfTest Team 32225 32226 * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__, `largestContentfulPaint <raptor-metrics.html#largest-contentful-paint>`__ 32227 * **alert threshold**: 2.0 32228 * **apps**: firefox, chrome, safari, custom-car 32229 * **benchmark page**: true 32230 * **browser cycles**: 25 32231 * **expected**: pass 32232 * **gecko profile interval**: 1 32233 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#200>`__ 32234 * **lower is better**: true 32235 * **page cycles**: 25 32236 * **page timeout**: 60000 32237 * **playback**: mitmproxy 32238 * **playback pageset manifest**: mitm11-windows-firefox-wikipedia.manifest 32239 * **playback pageset manifest backup**: mitm7-linux-firefox-wikipedia.manifest 32240 * **playback version**: 11.0.0 32241 * **secondary url**: `<https://en.wikipedia.org/wiki/Joe_Biden>`__ 32242 * **support class**: browsertime_pageload.py 32243 * **test url**: `<https://en.wikipedia.org/wiki/Barack_Obama>`__ 32244 * **type**: pageload 32245 * **unit**: ms 32246 * **use live sites**: false 32247 * **Test Task**: 32248 32249 .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** 32250 :widths: 30 15 15 15 15 32251 :header-rows: 1 32252 32253 * - **Test Name** 32254 - mozilla-central 32255 - autoland 32256 - mozilla-release 32257 - mozilla-beta 32258 * - **browsertime-tp6-bytecode-firefox-wikipedia** 32259 - ❌ 32260 - ❌ 32261 - ❌ 32262 - ❌ 32263 * - **browsertime-tp6-essential-firefox-wikipedia** 32264 - ❌ 32265 - ❌ 32266 - ❌ 32267 - ❌ 32268 * - **browsertime-tp6-live-firefox-wikipedia** 32269 - ❌ 32270 - ❌ 32271 - ❌ 32272 - ❌ 32273 32274 32275 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 32276 :widths: 30 15 15 15 15 32277 :header-rows: 1 32278 32279 * - **Test Name** 32280 - mozilla-central 32281 - autoland 32282 - mozilla-release 32283 - mozilla-beta 32284 * - **browsertime-tp6-bytecode-firefox-wikipedia** 32285 - ❌ 32286 - ❌ 32287 - ❌ 32288 - ❌ 32289 * - **browsertime-tp6-essential-firefox-wikipedia** 32290 - ❌ 32291 - ❌ 32292 - ❌ 32293 - ❌ 32294 * - **browsertime-tp6-live-firefox-wikipedia** 32295 - ❌ 32296 - ❌ 32297 - ❌ 32298 - ❌ 32299 32300 32301 .. list-table:: **test-linux1804-64-qr/opt** 32302 :widths: 30 15 15 15 15 32303 :header-rows: 1 32304 32305 * - **Test Name** 32306 - mozilla-central 32307 - autoland 32308 - mozilla-release 32309 - mozilla-beta 32310 * - **browsertime-tp6-bytecode-firefox-wikipedia** 32311 - ❌ 32312 - ❌ 32313 - ❌ 32314 - ❌ 32315 * - **browsertime-tp6-essential-firefox-wikipedia** 32316 - ❌ 32317 - ❌ 32318 - ❌ 32319 - ❌ 32320 * - **browsertime-tp6-live-firefox-wikipedia** 32321 - ❌ 32322 - ❌ 32323 - ❌ 32324 - ❌ 32325 32326 32327 .. list-table:: **test-linux1804-64-shippable-qr/opt** 32328 :widths: 30 15 15 15 15 32329 :header-rows: 1 32330 32331 * - **Test Name** 32332 - mozilla-central 32333 - autoland 32334 - mozilla-release 32335 - mozilla-beta 32336 * - **browsertime-tp6-bytecode-firefox-wikipedia** 32337 - ✅ 32338 - ✅ 32339 - ❌ 32340 - ❌ 32341 * - **browsertime-tp6-essential-chrome-wikipedia** 32342 - ❌ 32343 - ❌ 32344 - ❌ 32345 - ❌ 32346 * - **browsertime-tp6-essential-custom-car-wikipedia** 32347 - ❌ 32348 - ❌ 32349 - ❌ 32350 - ❌ 32351 * - **browsertime-tp6-essential-firefox-wikipedia** 32352 - ✅ 32353 - ✅ 32354 - ❌ 32355 - ❌ 32356 * - **browsertime-tp6-live-chrome-wikipedia** 32357 - ❌ 32358 - ❌ 32359 - ❌ 32360 - ❌ 32361 * - **browsertime-tp6-live-firefox-wikipedia** 32362 - ❌ 32363 - ❌ 32364 - ❌ 32365 - ❌ 32366 32367 32368 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 32369 :widths: 30 15 15 15 15 32370 :header-rows: 1 32371 32372 * - **Test Name** 32373 - mozilla-central 32374 - autoland 32375 - mozilla-release 32376 - mozilla-beta 32377 * - **browsertime-tp6-bytecode-firefox-wikipedia** 32378 - ❌ 32379 - ❌ 32380 - ❌ 32381 - ❌ 32382 * - **browsertime-tp6-essential-firefox-wikipedia** 32383 - ❌ 32384 - ❌ 32385 - ❌ 32386 - ❌ 32387 * - **browsertime-tp6-live-firefox-wikipedia** 32388 - ❌ 32389 - ❌ 32390 - ❌ 32391 - ❌ 32392 32393 32394 .. list-table:: **test-macosx1470-64-shippable/opt** 32395 :widths: 30 15 15 15 15 32396 :header-rows: 1 32397 32398 * - **Test Name** 32399 - mozilla-central 32400 - autoland 32401 - mozilla-release 32402 - mozilla-beta 32403 * - **browsertime-tp6-bytecode-firefox-wikipedia** 32404 - ✅ 32405 - ✅ 32406 - ❌ 32407 - ❌ 32408 * - **browsertime-tp6-essential-chrome-wikipedia** 32409 - ❌ 32410 - ❌ 32411 - ❌ 32412 - ❌ 32413 * - **browsertime-tp6-essential-custom-car-wikipedia** 32414 - ❌ 32415 - ❌ 32416 - ❌ 32417 - ❌ 32418 * - **browsertime-tp6-essential-firefox-wikipedia** 32419 - ✅ 32420 - ✅ 32421 - ❌ 32422 - ❌ 32423 * - **browsertime-tp6-live-chrome-wikipedia** 32424 - ❌ 32425 - ❌ 32426 - ❌ 32427 - ❌ 32428 * - **browsertime-tp6-live-firefox-wikipedia** 32429 - ❌ 32430 - ❌ 32431 - ❌ 32432 - ❌ 32433 * - **browsertime-tp6-live-safari-wikipedia** 32434 - ❌ 32435 - ❌ 32436 - ❌ 32437 - ❌ 32438 32439 32440 .. list-table:: **test-macosx1470-64/opt** 32441 :widths: 30 15 15 15 15 32442 :header-rows: 1 32443 32444 * - **Test Name** 32445 - mozilla-central 32446 - autoland 32447 - mozilla-release 32448 - mozilla-beta 32449 * - **browsertime-tp6-bytecode-firefox-wikipedia** 32450 - ❌ 32451 - ❌ 32452 - ❌ 32453 - ❌ 32454 * - **browsertime-tp6-essential-firefox-wikipedia** 32455 - ❌ 32456 - ❌ 32457 - ❌ 32458 - ❌ 32459 * - **browsertime-tp6-live-firefox-wikipedia** 32460 - ❌ 32461 - ❌ 32462 - ❌ 32463 - ❌ 32464 32465 32466 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 32467 :widths: 30 15 15 15 15 32468 :header-rows: 1 32469 32470 * - **Test Name** 32471 - mozilla-central 32472 - autoland 32473 - mozilla-release 32474 - mozilla-beta 32475 * - **browsertime-tp6-bytecode-firefox-wikipedia** 32476 - ❌ 32477 - ❌ 32478 - ❌ 32479 - ❌ 32480 * - **browsertime-tp6-essential-firefox-wikipedia** 32481 - ❌ 32482 - ❌ 32483 - ❌ 32484 - ❌ 32485 * - **browsertime-tp6-live-firefox-wikipedia** 32486 - ❌ 32487 - ❌ 32488 - ❌ 32489 - ❌ 32490 32491 32492 .. list-table:: **test-windows11-64-24h2-shippable/opt** 32493 :widths: 30 15 15 15 15 32494 :header-rows: 1 32495 32496 * - **Test Name** 32497 - mozilla-central 32498 - autoland 32499 - mozilla-release 32500 - mozilla-beta 32501 * - **browsertime-tp6-bytecode-firefox-wikipedia** 32502 - ✅ 32503 - ✅ 32504 - ❌ 32505 - ❌ 32506 * - **browsertime-tp6-essential-chrome-wikipedia** 32507 - ❌ 32508 - ❌ 32509 - ❌ 32510 - ❌ 32511 * - **browsertime-tp6-essential-custom-car-wikipedia** 32512 - ❌ 32513 - ❌ 32514 - ❌ 32515 - ❌ 32516 * - **browsertime-tp6-essential-firefox-wikipedia** 32517 - ✅ 32518 - ✅ 32519 - ❌ 32520 - ❌ 32521 * - **browsertime-tp6-live-chrome-wikipedia** 32522 - ❌ 32523 - ❌ 32524 - ❌ 32525 - ❌ 32526 * - **browsertime-tp6-live-firefox-wikipedia** 32527 - ❌ 32528 - ❌ 32529 - ❌ 32530 - ❌ 32531 32532 32533 .. list-table:: **test-windows11-64-24h2/opt** 32534 :widths: 30 15 15 15 15 32535 :header-rows: 1 32536 32537 * - **Test Name** 32538 - mozilla-central 32539 - autoland 32540 - mozilla-release 32541 - mozilla-beta 32542 * - **browsertime-tp6-bytecode-firefox-wikipedia** 32543 - ❌ 32544 - ❌ 32545 - ❌ 32546 - ❌ 32547 * - **browsertime-tp6-essential-firefox-wikipedia** 32548 - ❌ 32549 - ❌ 32550 - ❌ 32551 - ❌ 32552 * - **browsertime-tp6-live-firefox-wikipedia** 32553 - ❌ 32554 - ❌ 32555 - ❌ 32556 - ❌ 32557 32558 32559 32560 .. dropdown:: yahoo-mail 32561 :class-container: anchor-id-yahoo-mail-d 32562 32563 * Command to Run Locally 32564 32565 .. code-block:: 32566 32567 ./mach raptor -t yahoo-mail 32568 32569 **Owner**: PerfTest Team 32570 32571 * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__, `largestContentfulPaint <raptor-metrics.html#largest-contentful-paint>`__ 32572 * **alert threshold**: 2.0 32573 * **apps**: firefox, chrome, safari, custom-car 32574 * **benchmark page**: false 32575 * **browser cycles**: 25 32576 * **expected**: pass 32577 * **gecko profile interval**: 1 32578 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#206>`__ 32579 * **lower is better**: true 32580 * **page cycles**: 25 32581 * **page timeout**: 60000 32582 * **playback**: mitmproxy 32583 * **playback pageset manifest**: mitm5-linux-firefox-yahoo-mail.manifest 32584 * **playback version**: 11.0.0 32585 * **support class**: browsertime_pageload.py 32586 * **test url**: `<https://mail.yahoo.com/>`__ 32587 * **type**: pageload 32588 * **unit**: ms 32589 * **use live sites**: false 32590 * **Test Task**: 32591 32592 .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** 32593 :widths: 30 15 15 15 15 32594 :header-rows: 1 32595 32596 * - **Test Name** 32597 - mozilla-central 32598 - autoland 32599 - mozilla-release 32600 - mozilla-beta 32601 * - **browsertime-tp6-bytecode-firefox-yahoo-mail** 32602 - ❌ 32603 - ❌ 32604 - ❌ 32605 - ❌ 32606 * - **browsertime-tp6-essential-firefox-yahoo-mail** 32607 - ❌ 32608 - ❌ 32609 - ❌ 32610 - ❌ 32611 * - **browsertime-tp6-live-firefox-yahoo-mail** 32612 - ❌ 32613 - ❌ 32614 - ❌ 32615 - ❌ 32616 32617 32618 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 32619 :widths: 30 15 15 15 15 32620 :header-rows: 1 32621 32622 * - **Test Name** 32623 - mozilla-central 32624 - autoland 32625 - mozilla-release 32626 - mozilla-beta 32627 * - **browsertime-tp6-bytecode-firefox-yahoo-mail** 32628 - ❌ 32629 - ❌ 32630 - ❌ 32631 - ❌ 32632 * - **browsertime-tp6-essential-firefox-yahoo-mail** 32633 - ❌ 32634 - ❌ 32635 - ❌ 32636 - ❌ 32637 * - **browsertime-tp6-live-firefox-yahoo-mail** 32638 - ❌ 32639 - ❌ 32640 - ❌ 32641 - ❌ 32642 32643 32644 .. list-table:: **test-linux1804-64-qr/opt** 32645 :widths: 30 15 15 15 15 32646 :header-rows: 1 32647 32648 * - **Test Name** 32649 - mozilla-central 32650 - autoland 32651 - mozilla-release 32652 - mozilla-beta 32653 * - **browsertime-tp6-bytecode-firefox-yahoo-mail** 32654 - ❌ 32655 - ❌ 32656 - ❌ 32657 - ❌ 32658 * - **browsertime-tp6-essential-firefox-yahoo-mail** 32659 - ❌ 32660 - ❌ 32661 - ❌ 32662 - ❌ 32663 * - **browsertime-tp6-live-firefox-yahoo-mail** 32664 - ❌ 32665 - ❌ 32666 - ❌ 32667 - ❌ 32668 32669 32670 .. list-table:: **test-linux1804-64-shippable-qr/opt** 32671 :widths: 30 15 15 15 15 32672 :header-rows: 1 32673 32674 * - **Test Name** 32675 - mozilla-central 32676 - autoland 32677 - mozilla-release 32678 - mozilla-beta 32679 * - **browsertime-tp6-bytecode-firefox-yahoo-mail** 32680 - ✅ 32681 - ✅ 32682 - ❌ 32683 - ❌ 32684 * - **browsertime-tp6-essential-chrome-yahoo-mail** 32685 - ❌ 32686 - ❌ 32687 - ❌ 32688 - ❌ 32689 * - **browsertime-tp6-essential-custom-car-yahoo-mail** 32690 - ❌ 32691 - ❌ 32692 - ❌ 32693 - ❌ 32694 * - **browsertime-tp6-essential-firefox-yahoo-mail** 32695 - ✅ 32696 - ✅ 32697 - ❌ 32698 - ❌ 32699 * - **browsertime-tp6-live-chrome-yahoo-mail** 32700 - ❌ 32701 - ❌ 32702 - ❌ 32703 - ❌ 32704 * - **browsertime-tp6-live-firefox-yahoo-mail** 32705 - ❌ 32706 - ❌ 32707 - ❌ 32708 - ❌ 32709 32710 32711 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 32712 :widths: 30 15 15 15 15 32713 :header-rows: 1 32714 32715 * - **Test Name** 32716 - mozilla-central 32717 - autoland 32718 - mozilla-release 32719 - mozilla-beta 32720 * - **browsertime-tp6-bytecode-firefox-yahoo-mail** 32721 - ❌ 32722 - ❌ 32723 - ❌ 32724 - ❌ 32725 * - **browsertime-tp6-essential-firefox-yahoo-mail** 32726 - ❌ 32727 - ❌ 32728 - ❌ 32729 - ❌ 32730 * - **browsertime-tp6-live-firefox-yahoo-mail** 32731 - ❌ 32732 - ❌ 32733 - ❌ 32734 - ❌ 32735 32736 32737 .. list-table:: **test-macosx1470-64-shippable/opt** 32738 :widths: 30 15 15 15 15 32739 :header-rows: 1 32740 32741 * - **Test Name** 32742 - mozilla-central 32743 - autoland 32744 - mozilla-release 32745 - mozilla-beta 32746 * - **browsertime-tp6-bytecode-firefox-yahoo-mail** 32747 - ✅ 32748 - ✅ 32749 - ❌ 32750 - ❌ 32751 * - **browsertime-tp6-essential-chrome-yahoo-mail** 32752 - ❌ 32753 - ❌ 32754 - ❌ 32755 - ❌ 32756 * - **browsertime-tp6-essential-custom-car-yahoo-mail** 32757 - ❌ 32758 - ❌ 32759 - ❌ 32760 - ❌ 32761 * - **browsertime-tp6-essential-firefox-yahoo-mail** 32762 - ✅ 32763 - ✅ 32764 - ❌ 32765 - ❌ 32766 * - **browsertime-tp6-live-chrome-yahoo-mail** 32767 - ❌ 32768 - ❌ 32769 - ❌ 32770 - ❌ 32771 * - **browsertime-tp6-live-firefox-yahoo-mail** 32772 - ❌ 32773 - ❌ 32774 - ❌ 32775 - ❌ 32776 * - **browsertime-tp6-live-safari-yahoo-mail** 32777 - ❌ 32778 - ❌ 32779 - ❌ 32780 - ❌ 32781 32782 32783 .. list-table:: **test-macosx1470-64/opt** 32784 :widths: 30 15 15 15 15 32785 :header-rows: 1 32786 32787 * - **Test Name** 32788 - mozilla-central 32789 - autoland 32790 - mozilla-release 32791 - mozilla-beta 32792 * - **browsertime-tp6-bytecode-firefox-yahoo-mail** 32793 - ❌ 32794 - ❌ 32795 - ❌ 32796 - ❌ 32797 * - **browsertime-tp6-essential-firefox-yahoo-mail** 32798 - ❌ 32799 - ❌ 32800 - ❌ 32801 - ❌ 32802 * - **browsertime-tp6-live-firefox-yahoo-mail** 32803 - ❌ 32804 - ❌ 32805 - ❌ 32806 - ❌ 32807 32808 32809 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 32810 :widths: 30 15 15 15 15 32811 :header-rows: 1 32812 32813 * - **Test Name** 32814 - mozilla-central 32815 - autoland 32816 - mozilla-release 32817 - mozilla-beta 32818 * - **browsertime-tp6-bytecode-firefox-yahoo-mail** 32819 - ❌ 32820 - ❌ 32821 - ❌ 32822 - ❌ 32823 * - **browsertime-tp6-essential-firefox-yahoo-mail** 32824 - ❌ 32825 - ❌ 32826 - ❌ 32827 - ❌ 32828 * - **browsertime-tp6-live-firefox-yahoo-mail** 32829 - ❌ 32830 - ❌ 32831 - ❌ 32832 - ❌ 32833 32834 32835 .. list-table:: **test-windows11-64-24h2-shippable/opt** 32836 :widths: 30 15 15 15 15 32837 :header-rows: 1 32838 32839 * - **Test Name** 32840 - mozilla-central 32841 - autoland 32842 - mozilla-release 32843 - mozilla-beta 32844 * - **browsertime-tp6-bytecode-firefox-yahoo-mail** 32845 - ✅ 32846 - ✅ 32847 - ❌ 32848 - ❌ 32849 * - **browsertime-tp6-essential-chrome-yahoo-mail** 32850 - ❌ 32851 - ❌ 32852 - ❌ 32853 - ❌ 32854 * - **browsertime-tp6-essential-custom-car-yahoo-mail** 32855 - ❌ 32856 - ❌ 32857 - ❌ 32858 - ❌ 32859 * - **browsertime-tp6-essential-firefox-yahoo-mail** 32860 - ✅ 32861 - ✅ 32862 - ❌ 32863 - ❌ 32864 * - **browsertime-tp6-live-chrome-yahoo-mail** 32865 - ❌ 32866 - ❌ 32867 - ❌ 32868 - ❌ 32869 * - **browsertime-tp6-live-firefox-yahoo-mail** 32870 - ❌ 32871 - ❌ 32872 - ❌ 32873 - ❌ 32874 32875 32876 .. list-table:: **test-windows11-64-24h2/opt** 32877 :widths: 30 15 15 15 15 32878 :header-rows: 1 32879 32880 * - **Test Name** 32881 - mozilla-central 32882 - autoland 32883 - mozilla-release 32884 - mozilla-beta 32885 * - **browsertime-tp6-bytecode-firefox-yahoo-mail** 32886 - ❌ 32887 - ❌ 32888 - ❌ 32889 - ❌ 32890 * - **browsertime-tp6-essential-firefox-yahoo-mail** 32891 - ❌ 32892 - ❌ 32893 - ❌ 32894 - ❌ 32895 * - **browsertime-tp6-live-firefox-yahoo-mail** 32896 - ❌ 32897 - ❌ 32898 - ❌ 32899 - ❌ 32900 32901 32902 32903 .. dropdown:: youtube 32904 :class-container: anchor-id-youtube-d 32905 32906 * Command to Run Locally 32907 32908 .. code-block:: 32909 32910 ./mach raptor -t youtube 32911 32912 **Owner**: PerfTest Team 32913 32914 * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__, `largestContentfulPaint <raptor-metrics.html#largest-contentful-paint>`__ 32915 * **alert threshold**: 2.0 32916 * **apps**: firefox, chrome, safari, custom-car 32917 * **benchmark page**: true 32918 * **browser cycles**: 25 32919 * **expected**: pass 32920 * **gecko profile interval**: 1 32921 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/desktop/browsertime-tp6.toml#211>`__ 32922 * **lower is better**: true 32923 * **page cycles**: 25 32924 * **page timeout**: 60000 32925 * **playback**: mitmproxy 32926 * **playback pageset manifest**: mitm11-windows-firefox-youtube.manifest 32927 * **playback pageset manifest backup**: mitm7-linux-firefox-youtube.manifest 32928 * **playback version**: 11.0.0 32929 * **secondary url**: `<https://www.youtube.com/watch?v=JrdEMERq8MA>`__ 32930 * **support class**: browsertime_pageload.py 32931 * **test url**: `<https://www.youtube.com>`__ 32932 * **type**: pageload 32933 * **unit**: ms 32934 * **use live sites**: false 32935 * **Test Task**: 32936 32937 .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** 32938 :widths: 30 15 15 15 15 32939 :header-rows: 1 32940 32941 * - **Test Name** 32942 - mozilla-central 32943 - autoland 32944 - mozilla-release 32945 - mozilla-beta 32946 * - **browsertime-tp6-firefox-youtube** 32947 - ❌ 32948 - ❌ 32949 - ❌ 32950 - ❌ 32951 * - **browsertime-tp6-live-firefox-youtube** 32952 - ❌ 32953 - ❌ 32954 - ❌ 32955 - ❌ 32956 32957 32958 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 32959 :widths: 30 15 15 15 15 32960 :header-rows: 1 32961 32962 * - **Test Name** 32963 - mozilla-central 32964 - autoland 32965 - mozilla-release 32966 - mozilla-beta 32967 * - **browsertime-tp6-firefox-youtube** 32968 - ❌ 32969 - ❌ 32970 - ❌ 32971 - ❌ 32972 * - **browsertime-tp6-live-firefox-youtube** 32973 - ❌ 32974 - ❌ 32975 - ❌ 32976 - ❌ 32977 32978 32979 .. list-table:: **test-linux1804-64-qr/opt** 32980 :widths: 30 15 15 15 15 32981 :header-rows: 1 32982 32983 * - **Test Name** 32984 - mozilla-central 32985 - autoland 32986 - mozilla-release 32987 - mozilla-beta 32988 * - **browsertime-tp6-firefox-youtube** 32989 - ❌ 32990 - ❌ 32991 - ❌ 32992 - ❌ 32993 * - **browsertime-tp6-live-firefox-youtube** 32994 - ❌ 32995 - ❌ 32996 - ❌ 32997 - ❌ 32998 32999 33000 .. list-table:: **test-linux1804-64-shippable-qr/opt** 33001 :widths: 30 15 15 15 15 33002 :header-rows: 1 33003 33004 * - **Test Name** 33005 - mozilla-central 33006 - autoland 33007 - mozilla-release 33008 - mozilla-beta 33009 * - **browsertime-tp6-chrome-youtube** 33010 - ❌ 33011 - ❌ 33012 - ❌ 33013 - ❌ 33014 * - **browsertime-tp6-custom-car-youtube** 33015 - ❌ 33016 - ❌ 33017 - ❌ 33018 - ❌ 33019 * - **browsertime-tp6-firefox-youtube** 33020 - ✅ 33021 - ✅ 33022 - ❌ 33023 - ❌ 33024 * - **browsertime-tp6-live-chrome-youtube** 33025 - ❌ 33026 - ❌ 33027 - ❌ 33028 - ❌ 33029 * - **browsertime-tp6-live-firefox-youtube** 33030 - ❌ 33031 - ❌ 33032 - ❌ 33033 - ❌ 33034 33035 33036 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 33037 :widths: 30 15 15 15 15 33038 :header-rows: 1 33039 33040 * - **Test Name** 33041 - mozilla-central 33042 - autoland 33043 - mozilla-release 33044 - mozilla-beta 33045 * - **browsertime-tp6-firefox-youtube** 33046 - ❌ 33047 - ❌ 33048 - ❌ 33049 - ❌ 33050 * - **browsertime-tp6-live-firefox-youtube** 33051 - ❌ 33052 - ❌ 33053 - ❌ 33054 - ❌ 33055 33056 33057 .. list-table:: **test-macosx1470-64-shippable/opt** 33058 :widths: 30 15 15 15 15 33059 :header-rows: 1 33060 33061 * - **Test Name** 33062 - mozilla-central 33063 - autoland 33064 - mozilla-release 33065 - mozilla-beta 33066 * - **browsertime-tp6-chrome-youtube** 33067 - ❌ 33068 - ❌ 33069 - ❌ 33070 - ❌ 33071 * - **browsertime-tp6-custom-car-youtube** 33072 - ❌ 33073 - ❌ 33074 - ❌ 33075 - ❌ 33076 * - **browsertime-tp6-firefox-youtube** 33077 - ✅ 33078 - ✅ 33079 - ❌ 33080 - ❌ 33081 * - **browsertime-tp6-live-chrome-youtube** 33082 - ❌ 33083 - ❌ 33084 - ❌ 33085 - ❌ 33086 * - **browsertime-tp6-live-firefox-youtube** 33087 - ❌ 33088 - ❌ 33089 - ❌ 33090 - ❌ 33091 * - **browsertime-tp6-live-safari-youtube** 33092 - ❌ 33093 - ❌ 33094 - ❌ 33095 - ❌ 33096 33097 33098 .. list-table:: **test-macosx1470-64/opt** 33099 :widths: 30 15 15 15 15 33100 :header-rows: 1 33101 33102 * - **Test Name** 33103 - mozilla-central 33104 - autoland 33105 - mozilla-release 33106 - mozilla-beta 33107 * - **browsertime-tp6-firefox-youtube** 33108 - ❌ 33109 - ❌ 33110 - ❌ 33111 - ❌ 33112 * - **browsertime-tp6-live-firefox-youtube** 33113 - ❌ 33114 - ❌ 33115 - ❌ 33116 - ❌ 33117 33118 33119 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 33120 :widths: 30 15 15 15 15 33121 :header-rows: 1 33122 33123 * - **Test Name** 33124 - mozilla-central 33125 - autoland 33126 - mozilla-release 33127 - mozilla-beta 33128 * - **browsertime-tp6-firefox-youtube** 33129 - ❌ 33130 - ❌ 33131 - ❌ 33132 - ❌ 33133 * - **browsertime-tp6-live-firefox-youtube** 33134 - ❌ 33135 - ❌ 33136 - ❌ 33137 - ❌ 33138 33139 33140 .. list-table:: **test-windows11-64-24h2-shippable/opt** 33141 :widths: 30 15 15 15 15 33142 :header-rows: 1 33143 33144 * - **Test Name** 33145 - mozilla-central 33146 - autoland 33147 - mozilla-release 33148 - mozilla-beta 33149 * - **browsertime-tp6-chrome-youtube** 33150 - ❌ 33151 - ❌ 33152 - ❌ 33153 - ❌ 33154 * - **browsertime-tp6-custom-car-youtube** 33155 - ❌ 33156 - ❌ 33157 - ❌ 33158 - ❌ 33159 * - **browsertime-tp6-firefox-youtube** 33160 - ✅ 33161 - ✅ 33162 - ❌ 33163 - ❌ 33164 * - **browsertime-tp6-live-chrome-youtube** 33165 - ❌ 33166 - ❌ 33167 - ❌ 33168 - ❌ 33169 * - **browsertime-tp6-live-firefox-youtube** 33170 - ❌ 33171 - ❌ 33172 - ❌ 33173 - ❌ 33174 33175 33176 .. list-table:: **test-windows11-64-24h2/opt** 33177 :widths: 30 15 15 15 15 33178 :header-rows: 1 33179 33180 * - **Test Name** 33181 - mozilla-central 33182 - autoland 33183 - mozilla-release 33184 - mozilla-beta 33185 * - **browsertime-tp6-firefox-youtube** 33186 - ❌ 33187 - ❌ 33188 - ❌ 33189 - ❌ 33190 * - **browsertime-tp6-live-firefox-youtube** 33191 - ❌ 33192 - ❌ 33193 - ❌ 33194 - ❌ 33195 33196 33197 33198 33199 Interactive 33200 ----------- 33201 Browsertime tests that interact with the webpage. Includes responsiveness tests as they make use of this support for navigation. This type of test allows the specification of browsertime commands through the test manifest. 33202 33203 .. dropdown:: cnn-nav 33204 :class-container: anchor-id-cnn-nav-i 33205 33206 * Command to Run Locally 33207 33208 .. code-block:: 33209 33210 ./mach raptor -t cnn-nav 33211 33212 **Owner**: PerfTest Team 33213 33214 **Description**: Navigates to cnn main page, then to the world sub-page. 33215 33216 * **accept zero vismet**: true 33217 * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__ 33218 * **alert threshold**: 2.0 33219 * **apps**: firefox, chrome, safari 33220 * **browser cycles**: 10 33221 * **expected**: pass 33222 * **gecko profile interval**: 1 33223 * **interactive**: true 33224 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/interactive/browsertime-responsiveness.toml#25>`__ 33225 * **lower is better**: true 33226 * **page cycles**: 25 33227 * **page timeout**: 60000 33228 * **playback**: mitmproxy 33229 * **playback pageset manifest**: mitm7-linux-firefox-cnn-nav.manifest 33230 * **playback version**: 11.0.0 33231 * **support class**: browsertime_pageload.py 33232 * **test cmds**: ['measure.start', 'landing'] ['navigate', 'https://www.cnn.com'] ['wait.byTime', '4000'] ['measure.stop', ''] ['measure.start', 'world'] ['click.byXpathAndWait', '/html/body/div[5]/div/div/header/div/div[1]/div/div[2]/nav/ul/li[2]/a'] ['wait.byTime', '1000'] ['measure.stop', ''] 33233 * **test url**: `<https://www.cnn.com/>`__ 33234 * **type**: pageload 33235 * **unit**: ms 33236 * **use live sites**: false 33237 * **Test Task**: 33238 33239 .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** 33240 :widths: 30 15 15 15 15 33241 :header-rows: 1 33242 33243 * - **Test Name** 33244 - mozilla-central 33245 - autoland 33246 - mozilla-release 33247 - mozilla-beta 33248 * - **browsertime-responsiveness-firefox-cnn-nav** 33249 - ❌ 33250 - ❌ 33251 - ❌ 33252 - ❌ 33253 33254 33255 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 33256 :widths: 30 15 15 15 15 33257 :header-rows: 1 33258 33259 * - **Test Name** 33260 - mozilla-central 33261 - autoland 33262 - mozilla-release 33263 - mozilla-beta 33264 * - **browsertime-responsiveness-firefox-cnn-nav** 33265 - ❌ 33266 - ❌ 33267 - ❌ 33268 - ❌ 33269 33270 33271 .. list-table:: **test-linux1804-64-qr/opt** 33272 :widths: 30 15 15 15 15 33273 :header-rows: 1 33274 33275 * - **Test Name** 33276 - mozilla-central 33277 - autoland 33278 - mozilla-release 33279 - mozilla-beta 33280 * - **browsertime-responsiveness-firefox-cnn-nav** 33281 - ❌ 33282 - ❌ 33283 - ❌ 33284 - ❌ 33285 33286 33287 .. list-table:: **test-linux1804-64-shippable-qr/opt** 33288 :widths: 30 15 15 15 15 33289 :header-rows: 1 33290 33291 * - **Test Name** 33292 - mozilla-central 33293 - autoland 33294 - mozilla-release 33295 - mozilla-beta 33296 * - **browsertime-responsiveness-chrome-cnn-nav** 33297 - ❌ 33298 - ❌ 33299 - ❌ 33300 - ❌ 33301 * - **browsertime-responsiveness-firefox-cnn-nav** 33302 - ✅ 33303 - ✅ 33304 - ❌ 33305 - ❌ 33306 33307 33308 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 33309 :widths: 30 15 15 15 15 33310 :header-rows: 1 33311 33312 * - **Test Name** 33313 - mozilla-central 33314 - autoland 33315 - mozilla-release 33316 - mozilla-beta 33317 * - **browsertime-responsiveness-firefox-cnn-nav** 33318 - ❌ 33319 - ❌ 33320 - ❌ 33321 - ❌ 33322 33323 33324 .. list-table:: **test-macosx1470-64-shippable/opt** 33325 :widths: 30 15 15 15 15 33326 :header-rows: 1 33327 33328 * - **Test Name** 33329 - mozilla-central 33330 - autoland 33331 - mozilla-release 33332 - mozilla-beta 33333 * - **browsertime-responsiveness-chrome-cnn-nav** 33334 - ❌ 33335 - ❌ 33336 - ❌ 33337 - ❌ 33338 * - **browsertime-responsiveness-firefox-cnn-nav** 33339 - ✅ 33340 - ✅ 33341 - ❌ 33342 - ❌ 33343 33344 33345 .. list-table:: **test-macosx1470-64/opt** 33346 :widths: 30 15 15 15 15 33347 :header-rows: 1 33348 33349 * - **Test Name** 33350 - mozilla-central 33351 - autoland 33352 - mozilla-release 33353 - mozilla-beta 33354 * - **browsertime-responsiveness-firefox-cnn-nav** 33355 - ❌ 33356 - ❌ 33357 - ❌ 33358 - ❌ 33359 33360 33361 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 33362 :widths: 30 15 15 15 15 33363 :header-rows: 1 33364 33365 * - **Test Name** 33366 - mozilla-central 33367 - autoland 33368 - mozilla-release 33369 - mozilla-beta 33370 * - **browsertime-responsiveness-firefox-cnn-nav** 33371 - ❌ 33372 - ❌ 33373 - ❌ 33374 - ❌ 33375 33376 33377 .. list-table:: **test-windows11-64-24h2-shippable/opt** 33378 :widths: 30 15 15 15 15 33379 :header-rows: 1 33380 33381 * - **Test Name** 33382 - mozilla-central 33383 - autoland 33384 - mozilla-release 33385 - mozilla-beta 33386 * - **browsertime-responsiveness-chrome-cnn-nav** 33387 - ❌ 33388 - ❌ 33389 - ❌ 33390 - ❌ 33391 * - **browsertime-responsiveness-firefox-cnn-nav** 33392 - ✅ 33393 - ✅ 33394 - ❌ 33395 - ❌ 33396 33397 33398 .. list-table:: **test-windows11-64-24h2/opt** 33399 :widths: 30 15 15 15 15 33400 :header-rows: 1 33401 33402 * - **Test Name** 33403 - mozilla-central 33404 - autoland 33405 - mozilla-release 33406 - mozilla-beta 33407 * - **browsertime-responsiveness-firefox-cnn-nav** 33408 - ❌ 33409 - ❌ 33410 - ❌ 33411 - ❌ 33412 33413 33414 33415 .. dropdown:: facebook-nav 33416 :class-container: anchor-id-facebook-nav-i 33417 33418 * Command to Run Locally 33419 33420 .. code-block:: 33421 33422 ./mach raptor -t facebook-nav 33423 33424 **Owner**: PerfTest Team 33425 33426 **Description**: Navigates to facebook, then the sub-pages friends, marketplace, groups. 33427 33428 * **accept zero vismet**: true 33429 * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__ 33430 * **alert threshold**: 2.0 33431 * **apps**: firefox, chrome, safari 33432 * **browser cycles**: 10 33433 * **expected**: pass 33434 * **gecko profile interval**: 1 33435 * **interactive**: true 33436 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/interactive/browsertime-responsiveness.toml#40>`__ 33437 * **lower is better**: true 33438 * **page cycles**: 25 33439 * **page timeout**: 90000 33440 * **playback**: mitmproxy 33441 * **playback pageset manifest**: mitm11-windows-firefox-facebook-nav.manifest 33442 * **playback pageset manifest backup**: mitm6-windows-firefox-facebook-nav.manifest 33443 * **playback version**: 11.0.0 33444 * **support class**: browsertime_pageload.py 33445 * **test cmds**: ['measure.start', 'landing'] ['navigate', 'https://www.facebook.com/'] ['wait.byTime', '5000'] ['measure.stop', ''] ['measure.start', 'marketplace'] ['navigate', 'https://www.facebook.com/marketplace'] ['wait.byTime', '5000'] ['measure.stop', ''] ['measure.start', 'groups'] ['navigate', 'https://www.facebook.com/groups/discover/'] ['wait.byTime', '5000'] ['measure.stop', ''] ['measure.start', 'friends'] ['navigate', 'https://www.facebook.com/friends/'] ['wait.byTime', '5000'] ['measure.stop', ''] 33446 * **test url**: `<https://www.facebook.com>`__ 33447 * **type**: pageload 33448 * **unit**: ms 33449 * **use live sites**: false 33450 * **Test Task**: 33451 33452 .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** 33453 :widths: 30 15 15 15 15 33454 :header-rows: 1 33455 33456 * - **Test Name** 33457 - mozilla-central 33458 - autoland 33459 - mozilla-release 33460 - mozilla-beta 33461 * - **browsertime-responsiveness-firefox-facebook-nav** 33462 - ❌ 33463 - ❌ 33464 - ❌ 33465 - ❌ 33466 33467 33468 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 33469 :widths: 30 15 15 15 15 33470 :header-rows: 1 33471 33472 * - **Test Name** 33473 - mozilla-central 33474 - autoland 33475 - mozilla-release 33476 - mozilla-beta 33477 * - **browsertime-responsiveness-firefox-facebook-nav** 33478 - ❌ 33479 - ❌ 33480 - ❌ 33481 - ❌ 33482 33483 33484 .. list-table:: **test-linux1804-64-qr/opt** 33485 :widths: 30 15 15 15 15 33486 :header-rows: 1 33487 33488 * - **Test Name** 33489 - mozilla-central 33490 - autoland 33491 - mozilla-release 33492 - mozilla-beta 33493 * - **browsertime-responsiveness-firefox-facebook-nav** 33494 - ❌ 33495 - ❌ 33496 - ❌ 33497 - ❌ 33498 33499 33500 .. list-table:: **test-linux1804-64-shippable-qr/opt** 33501 :widths: 30 15 15 15 15 33502 :header-rows: 1 33503 33504 * - **Test Name** 33505 - mozilla-central 33506 - autoland 33507 - mozilla-release 33508 - mozilla-beta 33509 * - **browsertime-responsiveness-chrome-facebook-nav** 33510 - ❌ 33511 - ❌ 33512 - ❌ 33513 - ❌ 33514 * - **browsertime-responsiveness-firefox-facebook-nav** 33515 - ✅ 33516 - ✅ 33517 - ❌ 33518 - ❌ 33519 33520 33521 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 33522 :widths: 30 15 15 15 15 33523 :header-rows: 1 33524 33525 * - **Test Name** 33526 - mozilla-central 33527 - autoland 33528 - mozilla-release 33529 - mozilla-beta 33530 * - **browsertime-responsiveness-firefox-facebook-nav** 33531 - ❌ 33532 - ❌ 33533 - ❌ 33534 - ❌ 33535 33536 33537 .. list-table:: **test-macosx1470-64-shippable/opt** 33538 :widths: 30 15 15 15 15 33539 :header-rows: 1 33540 33541 * - **Test Name** 33542 - mozilla-central 33543 - autoland 33544 - mozilla-release 33545 - mozilla-beta 33546 * - **browsertime-responsiveness-chrome-facebook-nav** 33547 - ❌ 33548 - ❌ 33549 - ❌ 33550 - ❌ 33551 * - **browsertime-responsiveness-firefox-facebook-nav** 33552 - ✅ 33553 - ✅ 33554 - ❌ 33555 - ❌ 33556 33557 33558 .. list-table:: **test-macosx1470-64/opt** 33559 :widths: 30 15 15 15 15 33560 :header-rows: 1 33561 33562 * - **Test Name** 33563 - mozilla-central 33564 - autoland 33565 - mozilla-release 33566 - mozilla-beta 33567 * - **browsertime-responsiveness-firefox-facebook-nav** 33568 - ❌ 33569 - ❌ 33570 - ❌ 33571 - ❌ 33572 33573 33574 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 33575 :widths: 30 15 15 15 15 33576 :header-rows: 1 33577 33578 * - **Test Name** 33579 - mozilla-central 33580 - autoland 33581 - mozilla-release 33582 - mozilla-beta 33583 * - **browsertime-responsiveness-firefox-facebook-nav** 33584 - ❌ 33585 - ❌ 33586 - ❌ 33587 - ❌ 33588 33589 33590 .. list-table:: **test-windows11-64-24h2-shippable/opt** 33591 :widths: 30 15 15 15 15 33592 :header-rows: 1 33593 33594 * - **Test Name** 33595 - mozilla-central 33596 - autoland 33597 - mozilla-release 33598 - mozilla-beta 33599 * - **browsertime-responsiveness-chrome-facebook-nav** 33600 - ❌ 33601 - ❌ 33602 - ❌ 33603 - ❌ 33604 * - **browsertime-responsiveness-firefox-facebook-nav** 33605 - ✅ 33606 - ✅ 33607 - ❌ 33608 - ❌ 33609 33610 33611 .. list-table:: **test-windows11-64-24h2/opt** 33612 :widths: 30 15 15 15 15 33613 :header-rows: 1 33614 33615 * - **Test Name** 33616 - mozilla-central 33617 - autoland 33618 - mozilla-release 33619 - mozilla-beta 33620 * - **browsertime-responsiveness-firefox-facebook-nav** 33621 - ❌ 33622 - ❌ 33623 - ❌ 33624 - ❌ 33625 33626 33627 33628 .. dropdown:: reddit-billgates-ama 33629 :class-container: anchor-id-reddit-billgates-ama-i 33630 33631 * Command to Run Locally 33632 33633 .. code-block:: 33634 33635 ./mach raptor -t reddit-billgates-ama 33636 33637 **Owner**: PerfTest Team 33638 33639 **Description**: Navigates from the Bill Gates AMA to the Reddit members section. 33640 33641 * **accept zero vismet**: true 33642 * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__ 33643 * **alert threshold**: 2.0 33644 * **apps**: firefox, chrome, safari 33645 * **browser cycles**: 10 33646 * **expected**: pass 33647 * **gecko profile interval**: 1 33648 * **interactive**: true 33649 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/interactive/browsertime-responsiveness.toml#65>`__ 33650 * **lower is better**: true 33651 * **page cycles**: 25 33652 * **page timeout**: 240000 33653 * **playback**: mitmproxy 33654 * **playback pageset manifest**: mitm6-windows-firefox-reddit-billgates-ama.manifest 33655 * **playback version**: 8.1.1 33656 * **support class**: browsertime_pageload.py 33657 * **test cmds**: ['measure.start', 'billg-ama'] ['navigate', 'https://www.reddit.com/r/IAmA/comments/m8n4vt/im_bill_gates_cochair_of_the_bill_and_melinda/'] ['wait.byTime', '5000'] ['measure.stop', ''] ['measure.start', 'members'] ['click.byXpathAndWait', '/html/body/div[1]/div/div[2]/div[2]/div/div[3]/div[2]/div/div[1]/div/div[4]/div[1]/div'] ['wait.byTime', '1000'] ['measure.stop', ''] 33658 * **test url**: `<https://www.reddit.com/>`__ 33659 * **type**: pageload 33660 * **unit**: ms 33661 * **use live sites**: false 33662 * **Test Task**: 33663 33664 .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** 33665 :widths: 30 15 15 15 15 33666 :header-rows: 1 33667 33668 * - **Test Name** 33669 - mozilla-central 33670 - autoland 33671 - mozilla-release 33672 - mozilla-beta 33673 * - **browsertime-responsiveness-firefox-reddit-billgates-ama** 33674 - ❌ 33675 - ❌ 33676 - ❌ 33677 - ❌ 33678 33679 33680 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 33681 :widths: 30 15 15 15 15 33682 :header-rows: 1 33683 33684 * - **Test Name** 33685 - mozilla-central 33686 - autoland 33687 - mozilla-release 33688 - mozilla-beta 33689 * - **browsertime-responsiveness-firefox-reddit-billgates-ama** 33690 - ❌ 33691 - ❌ 33692 - ❌ 33693 - ❌ 33694 33695 33696 .. list-table:: **test-linux1804-64-qr/opt** 33697 :widths: 30 15 15 15 15 33698 :header-rows: 1 33699 33700 * - **Test Name** 33701 - mozilla-central 33702 - autoland 33703 - mozilla-release 33704 - mozilla-beta 33705 * - **browsertime-responsiveness-firefox-reddit-billgates-ama** 33706 - ❌ 33707 - ❌ 33708 - ❌ 33709 - ❌ 33710 33711 33712 .. list-table:: **test-linux1804-64-shippable-qr/opt** 33713 :widths: 30 15 15 15 15 33714 :header-rows: 1 33715 33716 * - **Test Name** 33717 - mozilla-central 33718 - autoland 33719 - mozilla-release 33720 - mozilla-beta 33721 * - **browsertime-responsiveness-chrome-reddit-billgates-ama** 33722 - ❌ 33723 - ❌ 33724 - ❌ 33725 - ❌ 33726 * - **browsertime-responsiveness-firefox-reddit-billgates-ama** 33727 - ✅ 33728 - ✅ 33729 - ❌ 33730 - ❌ 33731 33732 33733 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 33734 :widths: 30 15 15 15 15 33735 :header-rows: 1 33736 33737 * - **Test Name** 33738 - mozilla-central 33739 - autoland 33740 - mozilla-release 33741 - mozilla-beta 33742 * - **browsertime-responsiveness-firefox-reddit-billgates-ama** 33743 - ❌ 33744 - ❌ 33745 - ❌ 33746 - ❌ 33747 33748 33749 .. list-table:: **test-macosx1470-64-shippable/opt** 33750 :widths: 30 15 15 15 15 33751 :header-rows: 1 33752 33753 * - **Test Name** 33754 - mozilla-central 33755 - autoland 33756 - mozilla-release 33757 - mozilla-beta 33758 * - **browsertime-responsiveness-chrome-reddit-billgates-ama** 33759 - ❌ 33760 - ❌ 33761 - ❌ 33762 - ❌ 33763 * - **browsertime-responsiveness-firefox-reddit-billgates-ama** 33764 - ✅ 33765 - ✅ 33766 - ❌ 33767 - ❌ 33768 33769 33770 .. list-table:: **test-macosx1470-64/opt** 33771 :widths: 30 15 15 15 15 33772 :header-rows: 1 33773 33774 * - **Test Name** 33775 - mozilla-central 33776 - autoland 33777 - mozilla-release 33778 - mozilla-beta 33779 * - **browsertime-responsiveness-firefox-reddit-billgates-ama** 33780 - ❌ 33781 - ❌ 33782 - ❌ 33783 - ❌ 33784 33785 33786 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 33787 :widths: 30 15 15 15 15 33788 :header-rows: 1 33789 33790 * - **Test Name** 33791 - mozilla-central 33792 - autoland 33793 - mozilla-release 33794 - mozilla-beta 33795 * - **browsertime-responsiveness-firefox-reddit-billgates-ama** 33796 - ❌ 33797 - ❌ 33798 - ❌ 33799 - ❌ 33800 33801 33802 .. list-table:: **test-windows11-64-24h2-shippable/opt** 33803 :widths: 30 15 15 15 15 33804 :header-rows: 1 33805 33806 * - **Test Name** 33807 - mozilla-central 33808 - autoland 33809 - mozilla-release 33810 - mozilla-beta 33811 * - **browsertime-responsiveness-chrome-reddit-billgates-ama** 33812 - ❌ 33813 - ❌ 33814 - ❌ 33815 - ❌ 33816 * - **browsertime-responsiveness-firefox-reddit-billgates-ama** 33817 - ✅ 33818 - ✅ 33819 - ❌ 33820 - ❌ 33821 33822 33823 .. list-table:: **test-windows11-64-24h2/opt** 33824 :widths: 30 15 15 15 15 33825 :header-rows: 1 33826 33827 * - **Test Name** 33828 - mozilla-central 33829 - autoland 33830 - mozilla-release 33831 - mozilla-beta 33832 * - **browsertime-responsiveness-firefox-reddit-billgates-ama** 33833 - ❌ 33834 - ❌ 33835 - ❌ 33836 - ❌ 33837 33838 33839 33840 .. dropdown:: reddit-billgates-post-1 33841 :class-container: anchor-id-reddit-billgates-post-1-i 33842 33843 * Command to Run Locally 33844 33845 .. code-block:: 33846 33847 ./mach raptor -t reddit-billgates-post-1 33848 33849 **Owner**: PerfTest Team 33850 33851 **Description**: Navigates the `thisisbillgates` user starting at the main user page, then to the posts, comments, hot, and top sections. 33852 33853 * **accept zero vismet**: true 33854 * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__ 33855 * **alert threshold**: 2.0 33856 * **apps**: firefox, chrome, safari 33857 * **browser cycles**: 10 33858 * **expected**: pass 33859 * **gecko profile interval**: 1 33860 * **interactive**: true 33861 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/interactive/browsertime-responsiveness.toml#82>`__ 33862 * **lower is better**: true 33863 * **page cycles**: 25 33864 * **page timeout**: 90000 33865 * **playback**: mitmproxy 33866 * **playback pageset manifest**: mitm6-windows-firefox-reddit-billgates-post.manifest 33867 * **playback version**: 8.1.1 33868 * **support class**: browsertime_pageload.py 33869 * **test cmds**: ['measure.start', 'billg'] ['navigate', 'https://www.reddit.com/user/thisisbillgates/'] ['wait.byTime', '500'] ['measure.stop', ''] ['measure.start', 'posts'] ['click.byXpathAndWait', '/html/body/div[1]/div/div[2]/div[2]/div/div/div/div[2]/div[2]/div/div/div/a[2]'] ['wait.byTime', '500'] ['measure.stop', ''] ['measure.start', 'comments'] ['click.byXpathAndWait', '/html/body/div[1]/div/div[2]/div[2]/div/div/div/div[2]/div[2]/div/div/div/a[3]'] ['wait.byTime', '500'] ['measure.stop', ''] ['wait.byTime', '500'] 33870 * **test url**: `<https://www.reddit.com/user/thisisbillgates/>`__ 33871 * **type**: pageload 33872 * **unit**: ms 33873 * **use live sites**: false 33874 * **Test Task**: 33875 33876 .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** 33877 :widths: 30 15 15 15 15 33878 :header-rows: 1 33879 33880 * - **Test Name** 33881 - mozilla-central 33882 - autoland 33883 - mozilla-release 33884 - mozilla-beta 33885 * - **browsertime-responsiveness-firefox-reddit-billgates-post-1** 33886 - ❌ 33887 - ❌ 33888 - ❌ 33889 - ❌ 33890 33891 33892 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 33893 :widths: 30 15 15 15 15 33894 :header-rows: 1 33895 33896 * - **Test Name** 33897 - mozilla-central 33898 - autoland 33899 - mozilla-release 33900 - mozilla-beta 33901 * - **browsertime-responsiveness-firefox-reddit-billgates-post-1** 33902 - ❌ 33903 - ❌ 33904 - ❌ 33905 - ❌ 33906 33907 33908 .. list-table:: **test-linux1804-64-qr/opt** 33909 :widths: 30 15 15 15 15 33910 :header-rows: 1 33911 33912 * - **Test Name** 33913 - mozilla-central 33914 - autoland 33915 - mozilla-release 33916 - mozilla-beta 33917 * - **browsertime-responsiveness-firefox-reddit-billgates-post-1** 33918 - ❌ 33919 - ❌ 33920 - ❌ 33921 - ❌ 33922 33923 33924 .. list-table:: **test-linux1804-64-shippable-qr/opt** 33925 :widths: 30 15 15 15 15 33926 :header-rows: 1 33927 33928 * - **Test Name** 33929 - mozilla-central 33930 - autoland 33931 - mozilla-release 33932 - mozilla-beta 33933 * - **browsertime-responsiveness-chrome-reddit-billgates-post-1** 33934 - ❌ 33935 - ❌ 33936 - ❌ 33937 - ❌ 33938 * - **browsertime-responsiveness-firefox-reddit-billgates-post-1** 33939 - ✅ 33940 - ✅ 33941 - ❌ 33942 - ❌ 33943 33944 33945 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 33946 :widths: 30 15 15 15 15 33947 :header-rows: 1 33948 33949 * - **Test Name** 33950 - mozilla-central 33951 - autoland 33952 - mozilla-release 33953 - mozilla-beta 33954 * - **browsertime-responsiveness-firefox-reddit-billgates-post-1** 33955 - ❌ 33956 - ❌ 33957 - ❌ 33958 - ❌ 33959 33960 33961 .. list-table:: **test-macosx1470-64-shippable/opt** 33962 :widths: 30 15 15 15 15 33963 :header-rows: 1 33964 33965 * - **Test Name** 33966 - mozilla-central 33967 - autoland 33968 - mozilla-release 33969 - mozilla-beta 33970 * - **browsertime-responsiveness-chrome-reddit-billgates-post-1** 33971 - ❌ 33972 - ❌ 33973 - ❌ 33974 - ❌ 33975 * - **browsertime-responsiveness-firefox-reddit-billgates-post-1** 33976 - ✅ 33977 - ✅ 33978 - ❌ 33979 - ❌ 33980 33981 33982 .. list-table:: **test-macosx1470-64/opt** 33983 :widths: 30 15 15 15 15 33984 :header-rows: 1 33985 33986 * - **Test Name** 33987 - mozilla-central 33988 - autoland 33989 - mozilla-release 33990 - mozilla-beta 33991 * - **browsertime-responsiveness-firefox-reddit-billgates-post-1** 33992 - ❌ 33993 - ❌ 33994 - ❌ 33995 - ❌ 33996 33997 33998 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 33999 :widths: 30 15 15 15 15 34000 :header-rows: 1 34001 34002 * - **Test Name** 34003 - mozilla-central 34004 - autoland 34005 - mozilla-release 34006 - mozilla-beta 34007 * - **browsertime-responsiveness-firefox-reddit-billgates-post-1** 34008 - ❌ 34009 - ❌ 34010 - ❌ 34011 - ❌ 34012 34013 34014 .. list-table:: **test-windows11-64-24h2-shippable/opt** 34015 :widths: 30 15 15 15 15 34016 :header-rows: 1 34017 34018 * - **Test Name** 34019 - mozilla-central 34020 - autoland 34021 - mozilla-release 34022 - mozilla-beta 34023 * - **browsertime-responsiveness-chrome-reddit-billgates-post-1** 34024 - ❌ 34025 - ❌ 34026 - ❌ 34027 - ❌ 34028 * - **browsertime-responsiveness-firefox-reddit-billgates-post-1** 34029 - ✅ 34030 - ✅ 34031 - ❌ 34032 - ❌ 34033 34034 34035 .. list-table:: **test-windows11-64-24h2/opt** 34036 :widths: 30 15 15 15 15 34037 :header-rows: 1 34038 34039 * - **Test Name** 34040 - mozilla-central 34041 - autoland 34042 - mozilla-release 34043 - mozilla-beta 34044 * - **browsertime-responsiveness-firefox-reddit-billgates-post-1** 34045 - ❌ 34046 - ❌ 34047 - ❌ 34048 - ❌ 34049 34050 34051 34052 .. dropdown:: reddit-billgates-post-2 34053 :class-container: anchor-id-reddit-billgates-post-2-i 34054 34055 * Command to Run Locally 34056 34057 .. code-block:: 34058 34059 ./mach raptor -t reddit-billgates-post-2 34060 34061 **Owner**: PerfTest Team 34062 34063 **Description**: Navigates the `thisisbillgates` user starting at the main user page, then to the posts, comments, hot, and top sections. 34064 34065 * **accept zero vismet**: true 34066 * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__ 34067 * **alert threshold**: 2.0 34068 * **apps**: firefox, chrome, safari 34069 * **browser cycles**: 10 34070 * **expected**: pass 34071 * **gecko profile interval**: 1 34072 * **interactive**: true 34073 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/interactive/browsertime-responsiveness.toml#104>`__ 34074 * **lower is better**: true 34075 * **page cycles**: 25 34076 * **page timeout**: 90000 34077 * **playback**: mitmproxy 34078 * **playback pageset manifest**: mitm6-windows-firefox-reddit-billgates-post.manifest 34079 * **playback version**: 8.1.1 34080 * **support class**: browsertime_pageload.py 34081 * **test cmds**: ['measure.start', 'billg'] ['navigate', 'https://www.reddit.com/user/thisisbillgates/'] ['wait.byTime', '500'] ['measure.stop', ''] ['click.byXpathAndWait', '/html/body/div[1]/div/div[2]/div[2]/div/div/div/div[2]/div[2]/div/div/div/a[3]'] ['wait.byTime', '500'] ['measure.start', 'hot'] ['click.byXpathAndWait', '/html/body/div[1]/div/div[2]/div[2]/div/div/div/div[2]/div[4]/div[1]/div[1]/div[2]/a[2]'] ['wait.byTime', '500'] ['measure.stop', ''] ['measure.start', 'top'] ['click.byXpathAndWait', '/html/body/div[1]/div/div[2]/div[2]/div/div/div/div[2]/div[4]/div[1]/div[1]/div[2]/a[3]'] ['wait.byTime', '500'] ['measure.stop', ''] ['wait.byTime', '500'] 34082 * **test url**: `<https://www.reddit.com/user/thisisbillgates/>`__ 34083 * **type**: pageload 34084 * **unit**: ms 34085 * **use live sites**: false 34086 * **Test Task**: 34087 34088 .. list-table:: **test-linux1804-64-clang-trunk-qr/opt** 34089 :widths: 30 15 15 15 15 34090 :header-rows: 1 34091 34092 * - **Test Name** 34093 - mozilla-central 34094 - autoland 34095 - mozilla-release 34096 - mozilla-beta 34097 * - **browsertime-responsiveness-firefox-reddit-billgates-post-2** 34098 - ❌ 34099 - ❌ 34100 - ❌ 34101 - ❌ 34102 34103 34104 .. list-table:: **test-linux1804-64-nightlyasrelease-qr/opt** 34105 :widths: 30 15 15 15 15 34106 :header-rows: 1 34107 34108 * - **Test Name** 34109 - mozilla-central 34110 - autoland 34111 - mozilla-release 34112 - mozilla-beta 34113 * - **browsertime-responsiveness-firefox-reddit-billgates-post-2** 34114 - ❌ 34115 - ❌ 34116 - ❌ 34117 - ❌ 34118 34119 34120 .. list-table:: **test-linux1804-64-qr/opt** 34121 :widths: 30 15 15 15 15 34122 :header-rows: 1 34123 34124 * - **Test Name** 34125 - mozilla-central 34126 - autoland 34127 - mozilla-release 34128 - mozilla-beta 34129 * - **browsertime-responsiveness-firefox-reddit-billgates-post-2** 34130 - ❌ 34131 - ❌ 34132 - ❌ 34133 - ❌ 34134 34135 34136 .. list-table:: **test-linux1804-64-shippable-qr/opt** 34137 :widths: 30 15 15 15 15 34138 :header-rows: 1 34139 34140 * - **Test Name** 34141 - mozilla-central 34142 - autoland 34143 - mozilla-release 34144 - mozilla-beta 34145 * - **browsertime-responsiveness-chrome-reddit-billgates-post-2** 34146 - ❌ 34147 - ❌ 34148 - ❌ 34149 - ❌ 34150 * - **browsertime-responsiveness-firefox-reddit-billgates-post-2** 34151 - ✅ 34152 - ✅ 34153 - ❌ 34154 - ❌ 34155 34156 34157 .. list-table:: **test-macosx1470-64-nightlyasrelease/opt** 34158 :widths: 30 15 15 15 15 34159 :header-rows: 1 34160 34161 * - **Test Name** 34162 - mozilla-central 34163 - autoland 34164 - mozilla-release 34165 - mozilla-beta 34166 * - **browsertime-responsiveness-firefox-reddit-billgates-post-2** 34167 - ❌ 34168 - ❌ 34169 - ❌ 34170 - ❌ 34171 34172 34173 .. list-table:: **test-macosx1470-64-shippable/opt** 34174 :widths: 30 15 15 15 15 34175 :header-rows: 1 34176 34177 * - **Test Name** 34178 - mozilla-central 34179 - autoland 34180 - mozilla-release 34181 - mozilla-beta 34182 * - **browsertime-responsiveness-chrome-reddit-billgates-post-2** 34183 - ❌ 34184 - ❌ 34185 - ❌ 34186 - ❌ 34187 * - **browsertime-responsiveness-firefox-reddit-billgates-post-2** 34188 - ✅ 34189 - ✅ 34190 - ❌ 34191 - ❌ 34192 34193 34194 .. list-table:: **test-macosx1470-64/opt** 34195 :widths: 30 15 15 15 15 34196 :header-rows: 1 34197 34198 * - **Test Name** 34199 - mozilla-central 34200 - autoland 34201 - mozilla-release 34202 - mozilla-beta 34203 * - **browsertime-responsiveness-firefox-reddit-billgates-post-2** 34204 - ❌ 34205 - ❌ 34206 - ❌ 34207 - ❌ 34208 34209 34210 .. list-table:: **test-windows11-64-24h2-nightlyasrelease/opt** 34211 :widths: 30 15 15 15 15 34212 :header-rows: 1 34213 34214 * - **Test Name** 34215 - mozilla-central 34216 - autoland 34217 - mozilla-release 34218 - mozilla-beta 34219 * - **browsertime-responsiveness-firefox-reddit-billgates-post-2** 34220 - ❌ 34221 - ❌ 34222 - ❌ 34223 - ❌ 34224 34225 34226 .. list-table:: **test-windows11-64-24h2-shippable/opt** 34227 :widths: 30 15 15 15 15 34228 :header-rows: 1 34229 34230 * - **Test Name** 34231 - mozilla-central 34232 - autoland 34233 - mozilla-release 34234 - mozilla-beta 34235 * - **browsertime-responsiveness-chrome-reddit-billgates-post-2** 34236 - ❌ 34237 - ❌ 34238 - ❌ 34239 - ❌ 34240 * - **browsertime-responsiveness-firefox-reddit-billgates-post-2** 34241 - ✅ 34242 - ✅ 34243 - ❌ 34244 - ❌ 34245 34246 34247 .. list-table:: **test-windows11-64-24h2/opt** 34248 :widths: 30 15 15 15 15 34249 :header-rows: 1 34250 34251 * - **Test Name** 34252 - mozilla-central 34253 - autoland 34254 - mozilla-release 34255 - mozilla-beta 34256 * - **browsertime-responsiveness-firefox-reddit-billgates-post-2** 34257 - ❌ 34258 - ❌ 34259 - ❌ 34260 - ❌ 34261 34262 34263 34264 34265 Live 34266 ---- 34267 A set of test pages that are run as live sites instead of recorded versions. These tests are available on all browsers, on all platforms. 34268 34269 .. dropdown:: booking-sf 34270 :class-container: anchor-id-booking-sf-l 34271 34272 * Command to Run Locally 34273 34274 .. code-block:: 34275 34276 ./mach raptor -t booking-sf 34277 34278 **Owner**: PerfTest Team 34279 34280 * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__ 34281 * **alert threshold**: 2.0 34282 * **apps**: geckoview, fenix, refbrow, chrome-m, firefox, chrome 34283 * **browser cycles**: 15 34284 * **expected**: pass 34285 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/live/browsertime-live.toml#17>`__ 34286 * **lower is better**: true 34287 * **page cycles**: 25 34288 * **page timeout**: 60000 34289 * **support class**: browsertime_pageload.py 34290 * **test url**: `<https://www.booking.com/hotel/us/edwardian-san-francisco.html>`__ 34291 * **type**: pageload 34292 * **unit**: ms 34293 * **use live sites**: true 34294 * **Test Task**: 34295 34296 .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** 34297 :widths: 30 15 15 15 15 34298 :header-rows: 1 34299 34300 * - **Test Name** 34301 - mozilla-central 34302 - autoland 34303 - mozilla-release 34304 - mozilla-beta 34305 * - **browsertime-tp6m-live-chrome-m-booking-sf-nofis** 34306 - ❌ 34307 - ❌ 34308 - ❌ 34309 - ❌ 34310 * - **browsertime-tp6m-live-fenix-booking-sf** 34311 - ❌ 34312 - ❌ 34313 - ❌ 34314 - ❌ 34315 * - **browsertime-tp6m-live-fenix-booking-sf-nofis** 34316 - ❌ 34317 - ❌ 34318 - ❌ 34319 - ❌ 34320 * - **browsertime-tp6m-live-geckoview-booking-sf** 34321 - ❌ 34322 - ❌ 34323 - ❌ 34324 - ❌ 34325 * - **browsertime-tp6m-live-geckoview-booking-sf-nofis** 34326 - ❌ 34327 - ❌ 34328 - ❌ 34329 - ❌ 34330 34331 34332 .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** 34333 :widths: 30 15 15 15 15 34334 :header-rows: 1 34335 34336 * - **Test Name** 34337 - mozilla-central 34338 - autoland 34339 - mozilla-release 34340 - mozilla-beta 34341 * - **browsertime-tp6m-live-fenix-booking-sf** 34342 - ❌ 34343 - ❌ 34344 - ❌ 34345 - ❌ 34346 * - **browsertime-tp6m-live-fenix-booking-sf-nofis** 34347 - ❌ 34348 - ❌ 34349 - ❌ 34350 - ❌ 34351 * - **browsertime-tp6m-live-geckoview-booking-sf** 34352 - ❌ 34353 - ❌ 34354 - ❌ 34355 - ❌ 34356 * - **browsertime-tp6m-live-geckoview-booking-sf-nofis** 34357 - ❌ 34358 - ❌ 34359 - ❌ 34360 - ❌ 34361 34362 34363 34364 .. dropdown:: discord 34365 :class-container: anchor-id-discord-l 34366 34367 * Command to Run Locally 34368 34369 .. code-block:: 34370 34371 ./mach raptor -t discord 34372 34373 **Owner**: PerfTest Team 34374 34375 * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__ 34376 * **alert threshold**: 2.0 34377 * **apps**: geckoview, fenix, refbrow, chrome-m, firefox, chrome 34378 * **browser cycles**: 15 34379 * **expected**: pass 34380 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/live/browsertime-live.toml#20>`__ 34381 * **lower is better**: true 34382 * **page cycles**: 25 34383 * **page timeout**: 60000 34384 * **support class**: browsertime_pageload.py 34385 * **test url**: `<https://discordapp.com/>`__ 34386 * **type**: pageload 34387 * **unit**: ms 34388 * **use live sites**: true 34389 * **Test Task**: 34390 34391 .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** 34392 :widths: 30 15 15 15 15 34393 :header-rows: 1 34394 34395 * - **Test Name** 34396 - mozilla-central 34397 - autoland 34398 - mozilla-release 34399 - mozilla-beta 34400 * - **browsertime-tp6m-live-chrome-m-discord-nofis** 34401 - ❌ 34402 - ❌ 34403 - ❌ 34404 - ❌ 34405 * - **browsertime-tp6m-live-fenix-discord** 34406 - ❌ 34407 - ❌ 34408 - ❌ 34409 - ❌ 34410 * - **browsertime-tp6m-live-fenix-discord-nofis** 34411 - ❌ 34412 - ❌ 34413 - ❌ 34414 - ❌ 34415 * - **browsertime-tp6m-live-geckoview-discord** 34416 - ❌ 34417 - ❌ 34418 - ❌ 34419 - ❌ 34420 * - **browsertime-tp6m-live-geckoview-discord-nofis** 34421 - ❌ 34422 - ❌ 34423 - ❌ 34424 - ❌ 34425 34426 34427 .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** 34428 :widths: 30 15 15 15 15 34429 :header-rows: 1 34430 34431 * - **Test Name** 34432 - mozilla-central 34433 - autoland 34434 - mozilla-release 34435 - mozilla-beta 34436 * - **browsertime-tp6m-live-fenix-discord** 34437 - ❌ 34438 - ❌ 34439 - ❌ 34440 - ❌ 34441 * - **browsertime-tp6m-live-fenix-discord-nofis** 34442 - ❌ 34443 - ❌ 34444 - ❌ 34445 - ❌ 34446 * - **browsertime-tp6m-live-geckoview-discord** 34447 - ❌ 34448 - ❌ 34449 - ❌ 34450 - ❌ 34451 * - **browsertime-tp6m-live-geckoview-discord-nofis** 34452 - ❌ 34453 - ❌ 34454 - ❌ 34455 - ❌ 34456 34457 34458 34459 .. dropdown:: fashionbeans 34460 :class-container: anchor-id-fashionbeans-l 34461 34462 * Command to Run Locally 34463 34464 .. code-block:: 34465 34466 ./mach raptor -t fashionbeans 34467 34468 **Owner**: PerfTest Team 34469 34470 * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__ 34471 * **alert threshold**: 2.0 34472 * **apps**: geckoview, fenix, refbrow, chrome-m, firefox, chrome 34473 * **browser cycles**: 15 34474 * **expected**: pass 34475 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/live/browsertime-live.toml#23>`__ 34476 * **lower is better**: true 34477 * **page cycles**: 25 34478 * **page timeout**: 60000 34479 * **support class**: browsertime_pageload.py 34480 * **test url**: `<https://fashionbeans.com/article/coolest-menswear-stores-in-the-world>`__ 34481 * **type**: pageload 34482 * **unit**: ms 34483 * **use live sites**: true 34484 * **Test Task**: 34485 34486 .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** 34487 :widths: 30 15 15 15 15 34488 :header-rows: 1 34489 34490 * - **Test Name** 34491 - mozilla-central 34492 - autoland 34493 - mozilla-release 34494 - mozilla-beta 34495 * - **browsertime-tp6m-live-chrome-m-fashionbeans-nofis** 34496 - ❌ 34497 - ❌ 34498 - ❌ 34499 - ❌ 34500 * - **browsertime-tp6m-live-fenix-fashionbeans** 34501 - ❌ 34502 - ❌ 34503 - ❌ 34504 - ❌ 34505 * - **browsertime-tp6m-live-fenix-fashionbeans-nofis** 34506 - ❌ 34507 - ❌ 34508 - ❌ 34509 - ❌ 34510 * - **browsertime-tp6m-live-geckoview-fashionbeans** 34511 - ❌ 34512 - ❌ 34513 - ❌ 34514 - ❌ 34515 * - **browsertime-tp6m-live-geckoview-fashionbeans-nofis** 34516 - ❌ 34517 - ❌ 34518 - ❌ 34519 - ❌ 34520 34521 34522 .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** 34523 :widths: 30 15 15 15 15 34524 :header-rows: 1 34525 34526 * - **Test Name** 34527 - mozilla-central 34528 - autoland 34529 - mozilla-release 34530 - mozilla-beta 34531 * - **browsertime-tp6m-live-fenix-fashionbeans** 34532 - ❌ 34533 - ❌ 34534 - ❌ 34535 - ❌ 34536 * - **browsertime-tp6m-live-fenix-fashionbeans-nofis** 34537 - ❌ 34538 - ❌ 34539 - ❌ 34540 - ❌ 34541 * - **browsertime-tp6m-live-geckoview-fashionbeans** 34542 - ❌ 34543 - ❌ 34544 - ❌ 34545 - ❌ 34546 * - **browsertime-tp6m-live-geckoview-fashionbeans-nofis** 34547 - ❌ 34548 - ❌ 34549 - ❌ 34550 - ❌ 34551 34552 34553 34554 .. dropdown:: google-accounts 34555 :class-container: anchor-id-google-accounts-l 34556 34557 * Command to Run Locally 34558 34559 .. code-block:: 34560 34561 ./mach raptor -t google-accounts 34562 34563 **Owner**: PerfTest Team 34564 34565 * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__ 34566 * **alert threshold**: 2.0 34567 * **apps**: geckoview, fenix, refbrow, chrome-m, firefox, chrome 34568 * **browser cycles**: 15 34569 * **expected**: pass 34570 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/live/browsertime-live.toml#26>`__ 34571 * **lower is better**: true 34572 * **page cycles**: 25 34573 * **page timeout**: 60000 34574 * **support class**: browsertime_pageload.py 34575 * **test url**: `<https://accounts.google.com>`__ 34576 * **type**: pageload 34577 * **unit**: ms 34578 * **use live sites**: true 34579 * **Test Task**: 34580 34581 .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** 34582 :widths: 30 15 15 15 15 34583 :header-rows: 1 34584 34585 * - **Test Name** 34586 - mozilla-central 34587 - autoland 34588 - mozilla-release 34589 - mozilla-beta 34590 * - **browsertime-tp6m-live-chrome-m-google-accounts-nofis** 34591 - ❌ 34592 - ❌ 34593 - ❌ 34594 - ❌ 34595 * - **browsertime-tp6m-live-fenix-google-accounts** 34596 - ❌ 34597 - ❌ 34598 - ❌ 34599 - ❌ 34600 * - **browsertime-tp6m-live-fenix-google-accounts-nofis** 34601 - ❌ 34602 - ❌ 34603 - ❌ 34604 - ❌ 34605 * - **browsertime-tp6m-live-geckoview-google-accounts** 34606 - ❌ 34607 - ❌ 34608 - ❌ 34609 - ❌ 34610 * - **browsertime-tp6m-live-geckoview-google-accounts-nofis** 34611 - ❌ 34612 - ❌ 34613 - ❌ 34614 - ❌ 34615 34616 34617 .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** 34618 :widths: 30 15 15 15 15 34619 :header-rows: 1 34620 34621 * - **Test Name** 34622 - mozilla-central 34623 - autoland 34624 - mozilla-release 34625 - mozilla-beta 34626 * - **browsertime-tp6m-live-fenix-google-accounts** 34627 - ❌ 34628 - ❌ 34629 - ❌ 34630 - ❌ 34631 * - **browsertime-tp6m-live-fenix-google-accounts-nofis** 34632 - ❌ 34633 - ❌ 34634 - ❌ 34635 - ❌ 34636 * - **browsertime-tp6m-live-geckoview-google-accounts** 34637 - ❌ 34638 - ❌ 34639 - ❌ 34640 - ❌ 34641 * - **browsertime-tp6m-live-geckoview-google-accounts-nofis** 34642 - ❌ 34643 - ❌ 34644 - ❌ 34645 - ❌ 34646 34647 34648 34649 .. dropdown:: imdb-firefox 34650 :class-container: anchor-id-imdb-firefox-l 34651 34652 * Command to Run Locally 34653 34654 .. code-block:: 34655 34656 ./mach raptor -t imdb-firefox 34657 34658 **Owner**: PerfTest Team 34659 34660 * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__ 34661 * **alert threshold**: 2.0 34662 * **apps**: geckoview, fenix, refbrow, chrome-m, firefox, chrome 34663 * **browser cycles**: 15 34664 * **expected**: pass 34665 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/live/browsertime-live.toml#29>`__ 34666 * **lower is better**: true 34667 * **page cycles**: 25 34668 * **page timeout**: 60000 34669 * **support class**: browsertime_pageload.py 34670 * **test url**: `<https://m.imdb.com/title/tt0083943/>`__ 34671 * **type**: pageload 34672 * **unit**: ms 34673 * **use live sites**: true 34674 * **Test Task**: 34675 34676 .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** 34677 :widths: 30 15 15 15 15 34678 :header-rows: 1 34679 34680 * - **Test Name** 34681 - mozilla-central 34682 - autoland 34683 - mozilla-release 34684 - mozilla-beta 34685 * - **browsertime-tp6m-live-chrome-m-imdb-firefox-nofis** 34686 - ❌ 34687 - ❌ 34688 - ❌ 34689 - ❌ 34690 * - **browsertime-tp6m-live-fenix-imdb-firefox** 34691 - ❌ 34692 - ❌ 34693 - ❌ 34694 - ❌ 34695 * - **browsertime-tp6m-live-fenix-imdb-firefox-nofis** 34696 - ❌ 34697 - ❌ 34698 - ❌ 34699 - ❌ 34700 * - **browsertime-tp6m-live-geckoview-imdb-firefox** 34701 - ❌ 34702 - ❌ 34703 - ❌ 34704 - ❌ 34705 * - **browsertime-tp6m-live-geckoview-imdb-firefox-nofis** 34706 - ❌ 34707 - ❌ 34708 - ❌ 34709 - ❌ 34710 34711 34712 .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** 34713 :widths: 30 15 15 15 15 34714 :header-rows: 1 34715 34716 * - **Test Name** 34717 - mozilla-central 34718 - autoland 34719 - mozilla-release 34720 - mozilla-beta 34721 * - **browsertime-tp6m-live-fenix-imdb-firefox** 34722 - ❌ 34723 - ❌ 34724 - ❌ 34725 - ❌ 34726 * - **browsertime-tp6m-live-fenix-imdb-firefox-nofis** 34727 - ❌ 34728 - ❌ 34729 - ❌ 34730 - ❌ 34731 * - **browsertime-tp6m-live-geckoview-imdb-firefox** 34732 - ❌ 34733 - ❌ 34734 - ❌ 34735 - ❌ 34736 * - **browsertime-tp6m-live-geckoview-imdb-firefox-nofis** 34737 - ❌ 34738 - ❌ 34739 - ❌ 34740 - ❌ 34741 34742 34743 34744 .. dropdown:: medium-article 34745 :class-container: anchor-id-medium-article-l 34746 34747 * Command to Run Locally 34748 34749 .. code-block:: 34750 34751 ./mach raptor -t medium-article 34752 34753 **Owner**: PerfTest Team 34754 34755 * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__ 34756 * **alert threshold**: 2.0 34757 * **apps**: geckoview, fenix, refbrow, chrome-m, firefox, chrome 34758 * **browser cycles**: 15 34759 * **expected**: pass 34760 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/live/browsertime-live.toml#32>`__ 34761 * **lower is better**: true 34762 * **page cycles**: 25 34763 * **page timeout**: 60000 34764 * **support class**: browsertime_pageload.py 34765 * **test url**: `<https://medium.com/s/coincidences-are-a-lie/could-america-have-also-been-the-birthplace-of-impressionism-cb3d31a2e22d>`__ 34766 * **type**: pageload 34767 * **unit**: ms 34768 * **use live sites**: true 34769 * **Test Task**: 34770 34771 .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** 34772 :widths: 30 15 15 15 15 34773 :header-rows: 1 34774 34775 * - **Test Name** 34776 - mozilla-central 34777 - autoland 34778 - mozilla-release 34779 - mozilla-beta 34780 * - **browsertime-tp6m-live-chrome-m-medium-article-nofis** 34781 - ❌ 34782 - ❌ 34783 - ❌ 34784 - ❌ 34785 * - **browsertime-tp6m-live-fenix-medium-article** 34786 - ❌ 34787 - ❌ 34788 - ❌ 34789 - ❌ 34790 * - **browsertime-tp6m-live-fenix-medium-article-nofis** 34791 - ❌ 34792 - ❌ 34793 - ❌ 34794 - ❌ 34795 * - **browsertime-tp6m-live-geckoview-medium-article** 34796 - ❌ 34797 - ❌ 34798 - ❌ 34799 - ❌ 34800 * - **browsertime-tp6m-live-geckoview-medium-article-nofis** 34801 - ❌ 34802 - ❌ 34803 - ❌ 34804 - ❌ 34805 34806 34807 .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** 34808 :widths: 30 15 15 15 15 34809 :header-rows: 1 34810 34811 * - **Test Name** 34812 - mozilla-central 34813 - autoland 34814 - mozilla-release 34815 - mozilla-beta 34816 * - **browsertime-tp6m-live-fenix-medium-article** 34817 - ❌ 34818 - ❌ 34819 - ❌ 34820 - ❌ 34821 * - **browsertime-tp6m-live-fenix-medium-article-nofis** 34822 - ❌ 34823 - ❌ 34824 - ❌ 34825 - ❌ 34826 * - **browsertime-tp6m-live-geckoview-medium-article** 34827 - ❌ 34828 - ❌ 34829 - ❌ 34830 - ❌ 34831 * - **browsertime-tp6m-live-geckoview-medium-article-nofis** 34832 - ❌ 34833 - ❌ 34834 - ❌ 34835 - ❌ 34836 34837 34838 34839 .. dropdown:: people-article 34840 :class-container: anchor-id-people-article-l 34841 34842 * Command to Run Locally 34843 34844 .. code-block:: 34845 34846 ./mach raptor -t people-article 34847 34848 **Owner**: PerfTest Team 34849 34850 * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__ 34851 * **alert threshold**: 2.0 34852 * **apps**: geckoview, fenix, refbrow, chrome-m, firefox, chrome 34853 * **browser cycles**: 15 34854 * **expected**: pass 34855 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/live/browsertime-live.toml#35>`__ 34856 * **lower is better**: true 34857 * **page cycles**: 25 34858 * **page timeout**: 60000 34859 * **support class**: browsertime_pageload.py 34860 * **test url**: `<https://people.com/amp-stories/royal-a-to-z/>`__ 34861 * **type**: pageload 34862 * **unit**: ms 34863 * **use live sites**: true 34864 * **Test Task**: 34865 34866 .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** 34867 :widths: 30 15 15 15 15 34868 :header-rows: 1 34869 34870 * - **Test Name** 34871 - mozilla-central 34872 - autoland 34873 - mozilla-release 34874 - mozilla-beta 34875 * - **browsertime-tp6m-live-chrome-m-people-article-nofis** 34876 - ❌ 34877 - ❌ 34878 - ❌ 34879 - ❌ 34880 * - **browsertime-tp6m-live-fenix-people-article** 34881 - ❌ 34882 - ❌ 34883 - ❌ 34884 - ❌ 34885 * - **browsertime-tp6m-live-fenix-people-article-nofis** 34886 - ❌ 34887 - ❌ 34888 - ❌ 34889 - ❌ 34890 * - **browsertime-tp6m-live-geckoview-people-article** 34891 - ❌ 34892 - ❌ 34893 - ❌ 34894 - ❌ 34895 * - **browsertime-tp6m-live-geckoview-people-article-nofis** 34896 - ❌ 34897 - ❌ 34898 - ❌ 34899 - ❌ 34900 34901 34902 .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** 34903 :widths: 30 15 15 15 15 34904 :header-rows: 1 34905 34906 * - **Test Name** 34907 - mozilla-central 34908 - autoland 34909 - mozilla-release 34910 - mozilla-beta 34911 * - **browsertime-tp6m-live-fenix-people-article** 34912 - ❌ 34913 - ❌ 34914 - ❌ 34915 - ❌ 34916 * - **browsertime-tp6m-live-fenix-people-article-nofis** 34917 - ❌ 34918 - ❌ 34919 - ❌ 34920 - ❌ 34921 * - **browsertime-tp6m-live-geckoview-people-article** 34922 - ❌ 34923 - ❌ 34924 - ❌ 34925 - ❌ 34926 * - **browsertime-tp6m-live-geckoview-people-article-nofis** 34927 - ❌ 34928 - ❌ 34929 - ❌ 34930 - ❌ 34931 34932 34933 34934 .. dropdown:: reddit-thread 34935 :class-container: anchor-id-reddit-thread-l 34936 34937 * Command to Run Locally 34938 34939 .. code-block:: 34940 34941 ./mach raptor -t reddit-thread 34942 34943 **Owner**: PerfTest Team 34944 34945 * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__ 34946 * **alert threshold**: 2.0 34947 * **apps**: geckoview, fenix, refbrow, chrome-m, firefox, chrome 34948 * **browser cycles**: 15 34949 * **expected**: pass 34950 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/live/browsertime-live.toml#38>`__ 34951 * **lower is better**: true 34952 * **page cycles**: 25 34953 * **page timeout**: 60000 34954 * **support class**: browsertime_pageload.py 34955 * **test url**: `<https://www.reddit.com/r/firefox/comments/7dkq03/its_been_a_while/>`__ 34956 * **type**: pageload 34957 * **unit**: ms 34958 * **use live sites**: true 34959 * **Test Task**: 34960 34961 .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** 34962 :widths: 30 15 15 15 15 34963 :header-rows: 1 34964 34965 * - **Test Name** 34966 - mozilla-central 34967 - autoland 34968 - mozilla-release 34969 - mozilla-beta 34970 * - **browsertime-tp6m-live-chrome-m-reddit-thread-nofis** 34971 - ❌ 34972 - ❌ 34973 - ❌ 34974 - ❌ 34975 * - **browsertime-tp6m-live-fenix-reddit-thread** 34976 - ❌ 34977 - ❌ 34978 - ❌ 34979 - ❌ 34980 * - **browsertime-tp6m-live-fenix-reddit-thread-nofis** 34981 - ❌ 34982 - ❌ 34983 - ❌ 34984 - ❌ 34985 * - **browsertime-tp6m-live-geckoview-reddit-thread** 34986 - ❌ 34987 - ❌ 34988 - ❌ 34989 - ❌ 34990 * - **browsertime-tp6m-live-geckoview-reddit-thread-nofis** 34991 - ❌ 34992 - ❌ 34993 - ❌ 34994 - ❌ 34995 34996 34997 .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** 34998 :widths: 30 15 15 15 15 34999 :header-rows: 1 35000 35001 * - **Test Name** 35002 - mozilla-central 35003 - autoland 35004 - mozilla-release 35005 - mozilla-beta 35006 * - **browsertime-tp6m-live-fenix-reddit-thread** 35007 - ❌ 35008 - ❌ 35009 - ❌ 35010 - ❌ 35011 * - **browsertime-tp6m-live-fenix-reddit-thread-nofis** 35012 - ❌ 35013 - ❌ 35014 - ❌ 35015 - ❌ 35016 * - **browsertime-tp6m-live-geckoview-reddit-thread** 35017 - ❌ 35018 - ❌ 35019 - ❌ 35020 - ❌ 35021 * - **browsertime-tp6m-live-geckoview-reddit-thread-nofis** 35022 - ❌ 35023 - ❌ 35024 - ❌ 35025 - ❌ 35026 35027 35028 35029 .. dropdown:: rumble-fox 35030 :class-container: anchor-id-rumble-fox-l 35031 35032 * Command to Run Locally 35033 35034 .. code-block:: 35035 35036 ./mach raptor -t rumble-fox 35037 35038 **Owner**: PerfTest Team 35039 35040 * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__ 35041 * **alert threshold**: 2.0 35042 * **apps**: geckoview, fenix, refbrow, chrome-m, firefox, chrome 35043 * **browser cycles**: 15 35044 * **expected**: pass 35045 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/live/browsertime-live.toml#41>`__ 35046 * **lower is better**: true 35047 * **page cycles**: 25 35048 * **page timeout**: 60000 35049 * **support class**: browsertime_pageload.py 35050 * **test url**: `<https://rumble.com/v3c44t-foxes-jumping-on-my-trampoline.html>`__ 35051 * **type**: pageload 35052 * **unit**: ms 35053 * **use live sites**: true 35054 * **Test Task**: 35055 35056 .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** 35057 :widths: 30 15 15 15 15 35058 :header-rows: 1 35059 35060 * - **Test Name** 35061 - mozilla-central 35062 - autoland 35063 - mozilla-release 35064 - mozilla-beta 35065 * - **browsertime-tp6m-live-chrome-m-rumble-fox-nofis** 35066 - ❌ 35067 - ❌ 35068 - ❌ 35069 - ❌ 35070 * - **browsertime-tp6m-live-fenix-rumble-fox** 35071 - ❌ 35072 - ❌ 35073 - ❌ 35074 - ❌ 35075 * - **browsertime-tp6m-live-fenix-rumble-fox-nofis** 35076 - ❌ 35077 - ❌ 35078 - ❌ 35079 - ❌ 35080 * - **browsertime-tp6m-live-geckoview-rumble-fox** 35081 - ❌ 35082 - ❌ 35083 - ❌ 35084 - ❌ 35085 * - **browsertime-tp6m-live-geckoview-rumble-fox-nofis** 35086 - ❌ 35087 - ❌ 35088 - ❌ 35089 - ❌ 35090 35091 35092 .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** 35093 :widths: 30 15 15 15 15 35094 :header-rows: 1 35095 35096 * - **Test Name** 35097 - mozilla-central 35098 - autoland 35099 - mozilla-release 35100 - mozilla-beta 35101 * - **browsertime-tp6m-live-fenix-rumble-fox** 35102 - ❌ 35103 - ❌ 35104 - ❌ 35105 - ❌ 35106 * - **browsertime-tp6m-live-fenix-rumble-fox-nofis** 35107 - ❌ 35108 - ❌ 35109 - ❌ 35110 - ❌ 35111 * - **browsertime-tp6m-live-geckoview-rumble-fox** 35112 - ❌ 35113 - ❌ 35114 - ❌ 35115 - ❌ 35116 * - **browsertime-tp6m-live-geckoview-rumble-fox-nofis** 35117 - ❌ 35118 - ❌ 35119 - ❌ 35120 - ❌ 35121 35122 35123 35124 .. dropdown:: stackoverflow-question 35125 :class-container: anchor-id-stackoverflow-question-l 35126 35127 * Command to Run Locally 35128 35129 .. code-block:: 35130 35131 ./mach raptor -t stackoverflow-question 35132 35133 **Owner**: PerfTest Team 35134 35135 * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__ 35136 * **alert threshold**: 2.0 35137 * **apps**: geckoview, fenix, refbrow, chrome-m, firefox, chrome 35138 * **browser cycles**: 15 35139 * **expected**: pass 35140 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/live/browsertime-live.toml#44>`__ 35141 * **lower is better**: true 35142 * **page cycles**: 25 35143 * **page timeout**: 60000 35144 * **support class**: browsertime_pageload.py 35145 * **test url**: `<https://stackoverflow.com/questions/927358/how-do-i-undo-the-most-recent-commits-in-git>`__ 35146 * **type**: pageload 35147 * **unit**: ms 35148 * **use live sites**: true 35149 * **Test Task**: 35150 35151 .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** 35152 :widths: 30 15 15 15 15 35153 :header-rows: 1 35154 35155 * - **Test Name** 35156 - mozilla-central 35157 - autoland 35158 - mozilla-release 35159 - mozilla-beta 35160 * - **browsertime-tp6m-live-chrome-m-stackoverflow-question-nofis** 35161 - ❌ 35162 - ❌ 35163 - ❌ 35164 - ❌ 35165 * - **browsertime-tp6m-live-fenix-stackoverflow-question** 35166 - ❌ 35167 - ❌ 35168 - ❌ 35169 - ❌ 35170 * - **browsertime-tp6m-live-fenix-stackoverflow-question-nofis** 35171 - ❌ 35172 - ❌ 35173 - ❌ 35174 - ❌ 35175 * - **browsertime-tp6m-live-geckoview-stackoverflow-question** 35176 - ❌ 35177 - ❌ 35178 - ❌ 35179 - ❌ 35180 * - **browsertime-tp6m-live-geckoview-stackoverflow-question-nofis** 35181 - ❌ 35182 - ❌ 35183 - ❌ 35184 - ❌ 35185 35186 35187 .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** 35188 :widths: 30 15 15 15 15 35189 :header-rows: 1 35190 35191 * - **Test Name** 35192 - mozilla-central 35193 - autoland 35194 - mozilla-release 35195 - mozilla-beta 35196 * - **browsertime-tp6m-live-fenix-stackoverflow-question** 35197 - ❌ 35198 - ❌ 35199 - ❌ 35200 - ❌ 35201 * - **browsertime-tp6m-live-fenix-stackoverflow-question-nofis** 35202 - ❌ 35203 - ❌ 35204 - ❌ 35205 - ❌ 35206 * - **browsertime-tp6m-live-geckoview-stackoverflow-question** 35207 - ❌ 35208 - ❌ 35209 - ❌ 35210 - ❌ 35211 * - **browsertime-tp6m-live-geckoview-stackoverflow-question-nofis** 35212 - ❌ 35213 - ❌ 35214 - ❌ 35215 - ❌ 35216 35217 35218 35219 .. dropdown:: urbandictionary-define 35220 :class-container: anchor-id-urbandictionary-define-l 35221 35222 * Command to Run Locally 35223 35224 .. code-block:: 35225 35226 ./mach raptor -t urbandictionary-define 35227 35228 **Owner**: PerfTest Team 35229 35230 * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__ 35231 * **alert threshold**: 2.0 35232 * **apps**: geckoview, fenix, refbrow, chrome-m, firefox, chrome 35233 * **browser cycles**: 15 35234 * **expected**: pass 35235 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/live/browsertime-live.toml#47>`__ 35236 * **lower is better**: true 35237 * **page cycles**: 25 35238 * **page timeout**: 60000 35239 * **support class**: browsertime_pageload.py 35240 * **test url**: `<https://urbandictionary.com/define.php?term=awesome%20sauce>`__ 35241 * **type**: pageload 35242 * **unit**: ms 35243 * **use live sites**: true 35244 * **Test Task**: 35245 35246 .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** 35247 :widths: 30 15 15 15 15 35248 :header-rows: 1 35249 35250 * - **Test Name** 35251 - mozilla-central 35252 - autoland 35253 - mozilla-release 35254 - mozilla-beta 35255 * - **browsertime-tp6m-live-chrome-m-urbandictionary-define-nofis** 35256 - ❌ 35257 - ❌ 35258 - ❌ 35259 - ❌ 35260 * - **browsertime-tp6m-live-fenix-urbandictionary-define** 35261 - ❌ 35262 - ❌ 35263 - ❌ 35264 - ❌ 35265 * - **browsertime-tp6m-live-fenix-urbandictionary-define-nofis** 35266 - ❌ 35267 - ❌ 35268 - ❌ 35269 - ❌ 35270 * - **browsertime-tp6m-live-geckoview-urbandictionary-define** 35271 - ❌ 35272 - ❌ 35273 - ❌ 35274 - ❌ 35275 * - **browsertime-tp6m-live-geckoview-urbandictionary-define-nofis** 35276 - ❌ 35277 - ❌ 35278 - ❌ 35279 - ❌ 35280 35281 35282 .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** 35283 :widths: 30 15 15 15 15 35284 :header-rows: 1 35285 35286 * - **Test Name** 35287 - mozilla-central 35288 - autoland 35289 - mozilla-release 35290 - mozilla-beta 35291 * - **browsertime-tp6m-live-fenix-urbandictionary-define** 35292 - ❌ 35293 - ❌ 35294 - ❌ 35295 - ❌ 35296 * - **browsertime-tp6m-live-fenix-urbandictionary-define-nofis** 35297 - ❌ 35298 - ❌ 35299 - ❌ 35300 - ❌ 35301 * - **browsertime-tp6m-live-geckoview-urbandictionary-define** 35302 - ❌ 35303 - ❌ 35304 - ❌ 35305 - ❌ 35306 * - **browsertime-tp6m-live-geckoview-urbandictionary-define-nofis** 35307 - ❌ 35308 - ❌ 35309 - ❌ 35310 - ❌ 35311 35312 35313 35314 .. dropdown:: wikia-marvel 35315 :class-container: anchor-id-wikia-marvel-l 35316 35317 * Command to Run Locally 35318 35319 .. code-block:: 35320 35321 ./mach raptor -t wikia-marvel 35322 35323 **Owner**: PerfTest Team 35324 35325 * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__ 35326 * **alert threshold**: 2.0 35327 * **apps**: geckoview, fenix, refbrow, chrome-m, firefox, chrome 35328 * **browser cycles**: 15 35329 * **expected**: pass 35330 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/live/browsertime-live.toml#50>`__ 35331 * **lower is better**: true 35332 * **page cycles**: 25 35333 * **page timeout**: 60000 35334 * **support class**: browsertime_pageload.py 35335 * **test url**: `<https://marvel.wikia.com/wiki/Black_Panther>`__ 35336 * **type**: pageload 35337 * **unit**: ms 35338 * **use live sites**: true 35339 * **Test Task**: 35340 35341 .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** 35342 :widths: 30 15 15 15 15 35343 :header-rows: 1 35344 35345 * - **Test Name** 35346 - mozilla-central 35347 - autoland 35348 - mozilla-release 35349 - mozilla-beta 35350 * - **browsertime-tp6m-live-chrome-m-wikia-marvel-nofis** 35351 - ❌ 35352 - ❌ 35353 - ❌ 35354 - ❌ 35355 * - **browsertime-tp6m-live-fenix-wikia-marvel** 35356 - ❌ 35357 - ❌ 35358 - ❌ 35359 - ❌ 35360 * - **browsertime-tp6m-live-fenix-wikia-marvel-nofis** 35361 - ❌ 35362 - ❌ 35363 - ❌ 35364 - ❌ 35365 * - **browsertime-tp6m-live-geckoview-wikia-marvel** 35366 - ❌ 35367 - ❌ 35368 - ❌ 35369 - ❌ 35370 * - **browsertime-tp6m-live-geckoview-wikia-marvel-nofis** 35371 - ❌ 35372 - ❌ 35373 - ❌ 35374 - ❌ 35375 35376 35377 .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** 35378 :widths: 30 15 15 15 15 35379 :header-rows: 1 35380 35381 * - **Test Name** 35382 - mozilla-central 35383 - autoland 35384 - mozilla-release 35385 - mozilla-beta 35386 * - **browsertime-tp6m-live-fenix-wikia-marvel** 35387 - ❌ 35388 - ❌ 35389 - ❌ 35390 - ❌ 35391 * - **browsertime-tp6m-live-fenix-wikia-marvel-nofis** 35392 - ❌ 35393 - ❌ 35394 - ❌ 35395 - ❌ 35396 * - **browsertime-tp6m-live-geckoview-wikia-marvel** 35397 - ❌ 35398 - ❌ 35399 - ❌ 35400 - ❌ 35401 * - **browsertime-tp6m-live-geckoview-wikia-marvel-nofis** 35402 - ❌ 35403 - ❌ 35404 - ❌ 35405 - ❌ 35406 35407 35408 35409 35410 Mobile 35411 ------ 35412 Page-load performance test suite on Android. The links direct to the actual websites that are being tested. 35413 35414 .. dropdown:: allrecipes 35415 :class-container: anchor-id-allrecipes-m 35416 35417 * Command to Run Locally 35418 35419 .. code-block:: 35420 35421 ./mach raptor -t allrecipes 35422 35423 **Owner**: PerfTest Team 35424 35425 * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__, `largestContentfulPaint <raptor-metrics.html#largest-contentful-paint>`__ 35426 * **alert threshold**: 2.0 35427 * **apps**: geckoview, fenix, refbrow, chrome-m, cstm-car-m 35428 * **benchmark page**: true 35429 * **browser cycles**: 15 35430 * **expected**: pass 35431 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#22>`__ 35432 * **lower is better**: true 35433 * **page cycles**: 25 35434 * **page timeout**: 60000 35435 * **playback**: mitmproxy-android 35436 * **playback pageset manifest**: mitm8-android-gve-allrecipes.manifest 35437 * **playback version**: 11.0.0 35438 * **support class**: browsertime_pageload.py 35439 * **test url**: `<https://www.allrecipes.com/>`__ 35440 * **type**: pageload 35441 * **unit**: ms 35442 * **use live sites**: false 35443 * **Test Task**: 35444 35445 .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** 35446 :widths: 30 15 15 15 15 35447 :header-rows: 1 35448 35449 * - **Test Name** 35450 - mozilla-central 35451 - autoland 35452 - mozilla-release 35453 - mozilla-beta 35454 * - **browsertime-tp6m-essential-chrome-m-allrecipes-nofis** 35455 - ❌ 35456 - ❌ 35457 - ❌ 35458 - ❌ 35459 * - **browsertime-tp6m-essential-cstm-car-m-allrecipes-nofis** 35460 - ❌ 35461 - ❌ 35462 - ❌ 35463 - ❌ 35464 * - **browsertime-tp6m-essential-fenix-allrecipes** 35465 - ✅ 35466 - ✅ 35467 - ❌ 35468 - ❌ 35469 * - **browsertime-tp6m-essential-fenix-allrecipes-nofis** 35470 - ✅ 35471 - ✅ 35472 - ❌ 35473 - ❌ 35474 * - **browsertime-tp6m-essential-geckoview-allrecipes** 35475 - ❌ 35476 - ❌ 35477 - ❌ 35478 - ❌ 35479 * - **browsertime-tp6m-essential-geckoview-allrecipes-nofis** 35480 - ❌ 35481 - ❌ 35482 - ❌ 35483 - ❌ 35484 * - **browsertime-tp6m-essential-refbrow-allrecipes** 35485 - ❌ 35486 - ❌ 35487 - ❌ 35488 - ❌ 35489 * - **browsertime-tp6m-live-chrome-m-allrecipes-nofis** 35490 - ❌ 35491 - ❌ 35492 - ❌ 35493 - ❌ 35494 * - **browsertime-tp6m-live-fenix-allrecipes** 35495 - ❌ 35496 - ❌ 35497 - ❌ 35498 - ❌ 35499 * - **browsertime-tp6m-live-fenix-allrecipes-nofis** 35500 - ❌ 35501 - ❌ 35502 - ❌ 35503 - ❌ 35504 * - **browsertime-tp6m-live-geckoview-allrecipes** 35505 - ❌ 35506 - ❌ 35507 - ❌ 35508 - ❌ 35509 * - **browsertime-tp6m-live-geckoview-allrecipes-nofis** 35510 - ❌ 35511 - ❌ 35512 - ❌ 35513 - ❌ 35514 35515 35516 .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** 35517 :widths: 30 15 15 15 15 35518 :header-rows: 1 35519 35520 * - **Test Name** 35521 - mozilla-central 35522 - autoland 35523 - mozilla-release 35524 - mozilla-beta 35525 * - **browsertime-tp6m-essential-fenix-allrecipes** 35526 - ❌ 35527 - ❌ 35528 - ❌ 35529 - ❌ 35530 * - **browsertime-tp6m-essential-fenix-allrecipes-nofis** 35531 - ❌ 35532 - ❌ 35533 - ❌ 35534 - ❌ 35535 * - **browsertime-tp6m-essential-geckoview-allrecipes** 35536 - ❌ 35537 - ❌ 35538 - ❌ 35539 - ❌ 35540 * - **browsertime-tp6m-essential-geckoview-allrecipes-nofis** 35541 - ❌ 35542 - ❌ 35543 - ❌ 35544 - ❌ 35545 * - **browsertime-tp6m-essential-refbrow-allrecipes** 35546 - ❌ 35547 - ❌ 35548 - ❌ 35549 - ❌ 35550 * - **browsertime-tp6m-live-fenix-allrecipes** 35551 - ❌ 35552 - ❌ 35553 - ❌ 35554 - ❌ 35555 * - **browsertime-tp6m-live-fenix-allrecipes-nofis** 35556 - ❌ 35557 - ❌ 35558 - ❌ 35559 - ❌ 35560 * - **browsertime-tp6m-live-geckoview-allrecipes** 35561 - ❌ 35562 - ❌ 35563 - ❌ 35564 - ❌ 35565 * - **browsertime-tp6m-live-geckoview-allrecipes-nofis** 35566 - ❌ 35567 - ❌ 35568 - ❌ 35569 - ❌ 35570 35571 35572 35573 .. dropdown:: amazon 35574 :class-container: anchor-id-amazon-m 35575 35576 * Command to Run Locally 35577 35578 .. code-block:: 35579 35580 ./mach raptor -t amazon 35581 35582 **Owner**: PerfTest Team 35583 35584 * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__, `largestContentfulPaint <raptor-metrics.html#largest-contentful-paint>`__ 35585 * **alert threshold**: 2.0 35586 * **apps**: geckoview, fenix, refbrow, chrome-m, cstm-car-m 35587 * **benchmark page**: true 35588 * **browser cycles**: 15 35589 * **expected**: pass 35590 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#27>`__ 35591 * **lower is better**: true 35592 * **page cycles**: 25 35593 * **page timeout**: 60000 35594 * **playback**: mitmproxy-android 35595 * **playback pageset manifest**: mitm6-android-fenix-amazon.manifest 35596 * **playback version**: 8.1.1 35597 * **support class**: browsertime_pageload.py 35598 * **test url**: `<https://www.amazon.com>`__ 35599 * **type**: pageload 35600 * **unit**: ms 35601 * **use live sites**: false 35602 * **Test Task**: 35603 35604 .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** 35605 :widths: 30 15 15 15 15 35606 :header-rows: 1 35607 35608 * - **Test Name** 35609 - mozilla-central 35610 - autoland 35611 - mozilla-release 35612 - mozilla-beta 35613 * - **browsertime-tp6m-chrome-m-amazon-nofis** 35614 - ❌ 35615 - ❌ 35616 - ❌ 35617 - ❌ 35618 * - **browsertime-tp6m-cstm-car-m-amazon-nofis** 35619 - ❌ 35620 - ❌ 35621 - ❌ 35622 - ❌ 35623 * - **browsertime-tp6m-fenix-amazon** 35624 - ✅ 35625 - ❌ 35626 - ❌ 35627 - ❌ 35628 * - **browsertime-tp6m-fenix-amazon-nofis** 35629 - ✅ 35630 - ✅ 35631 - ❌ 35632 - ❌ 35633 * - **browsertime-tp6m-geckoview-amazon** 35634 - ❌ 35635 - ❌ 35636 - ❌ 35637 - ❌ 35638 * - **browsertime-tp6m-geckoview-amazon-nofis** 35639 - ❌ 35640 - ❌ 35641 - ❌ 35642 - ❌ 35643 * - **browsertime-tp6m-live-chrome-m-amazon-nofis** 35644 - ❌ 35645 - ❌ 35646 - ❌ 35647 - ❌ 35648 * - **browsertime-tp6m-live-fenix-amazon** 35649 - ❌ 35650 - ❌ 35651 - ❌ 35652 - ❌ 35653 * - **browsertime-tp6m-live-fenix-amazon-nofis** 35654 - ❌ 35655 - ❌ 35656 - ❌ 35657 - ❌ 35658 * - **browsertime-tp6m-live-geckoview-amazon** 35659 - ❌ 35660 - ❌ 35661 - ❌ 35662 - ❌ 35663 * - **browsertime-tp6m-live-geckoview-amazon-nofis** 35664 - ❌ 35665 - ❌ 35666 - ❌ 35667 - ❌ 35668 * - **browsertime-tp6m-refbrow-amazon** 35669 - ❌ 35670 - ❌ 35671 - ❌ 35672 - ❌ 35673 35674 35675 .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** 35676 :widths: 30 15 15 15 15 35677 :header-rows: 1 35678 35679 * - **Test Name** 35680 - mozilla-central 35681 - autoland 35682 - mozilla-release 35683 - mozilla-beta 35684 * - **browsertime-tp6m-fenix-amazon** 35685 - ✅ 35686 - ❌ 35687 - ❌ 35688 - ❌ 35689 * - **browsertime-tp6m-fenix-amazon-nofis** 35690 - ❌ 35691 - ❌ 35692 - ❌ 35693 - ❌ 35694 * - **browsertime-tp6m-geckoview-amazon** 35695 - ❌ 35696 - ❌ 35697 - ❌ 35698 - ❌ 35699 * - **browsertime-tp6m-geckoview-amazon-nofis** 35700 - ❌ 35701 - ❌ 35702 - ❌ 35703 - ❌ 35704 * - **browsertime-tp6m-live-fenix-amazon** 35705 - ❌ 35706 - ❌ 35707 - ❌ 35708 - ❌ 35709 * - **browsertime-tp6m-live-fenix-amazon-nofis** 35710 - ❌ 35711 - ❌ 35712 - ❌ 35713 - ❌ 35714 * - **browsertime-tp6m-live-geckoview-amazon** 35715 - ❌ 35716 - ❌ 35717 - ❌ 35718 - ❌ 35719 * - **browsertime-tp6m-live-geckoview-amazon-nofis** 35720 - ❌ 35721 - ❌ 35722 - ❌ 35723 - ❌ 35724 * - **browsertime-tp6m-refbrow-amazon** 35725 - ❌ 35726 - ❌ 35727 - ❌ 35728 - ❌ 35729 35730 35731 35732 .. dropdown:: amazon-search 35733 :class-container: anchor-id-amazon-search-m 35734 35735 * Command to Run Locally 35736 35737 .. code-block:: 35738 35739 ./mach raptor -t amazon-search 35740 35741 **Owner**: PerfTest Team 35742 35743 * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__, `largestContentfulPaint <raptor-metrics.html#largest-contentful-paint>`__ 35744 * **alert threshold**: 2.0 35745 * **apps**: geckoview, fenix, refbrow, chrome-m, cstm-car-m 35746 * **benchmark page**: true 35747 * **browser cycles**: 15 35748 * **expected**: pass 35749 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#30>`__ 35750 * **lower is better**: true 35751 * **page cycles**: 25 35752 * **page timeout**: 60000 35753 * **playback**: mitmproxy-android 35754 * **playback pageset manifest**: mitm6-android-fenix-amazon-search.manifest 35755 * **playback version**: 8.1.1 35756 * **support class**: browsertime_pageload.py 35757 * **test url**: `<https://www.amazon.com/s/ref=nb_sb_noss_2/139-6317191-5622045?url=search-alias%3Daps&field-keywords=mobile+phone>`__ 35758 * **type**: pageload 35759 * **unit**: ms 35760 * **use live sites**: false 35761 * **Test Task**: 35762 35763 .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** 35764 :widths: 30 15 15 15 15 35765 :header-rows: 1 35766 35767 * - **Test Name** 35768 - mozilla-central 35769 - autoland 35770 - mozilla-release 35771 - mozilla-beta 35772 * - **browsertime-tp6m-essential-chrome-m-amazon-search-nofis** 35773 - ❌ 35774 - ❌ 35775 - ❌ 35776 - ❌ 35777 * - **browsertime-tp6m-essential-cstm-car-m-amazon-search-nofis** 35778 - ❌ 35779 - ❌ 35780 - ❌ 35781 - ❌ 35782 * - **browsertime-tp6m-essential-fenix-amazon-search** 35783 - ✅ 35784 - ✅ 35785 - ❌ 35786 - ❌ 35787 * - **browsertime-tp6m-essential-fenix-amazon-search-nofis** 35788 - ✅ 35789 - ✅ 35790 - ❌ 35791 - ❌ 35792 * - **browsertime-tp6m-essential-geckoview-amazon-search** 35793 - ❌ 35794 - ❌ 35795 - ❌ 35796 - ❌ 35797 * - **browsertime-tp6m-essential-geckoview-amazon-search-nofis** 35798 - ❌ 35799 - ❌ 35800 - ❌ 35801 - ❌ 35802 * - **browsertime-tp6m-essential-refbrow-amazon-search** 35803 - ❌ 35804 - ❌ 35805 - ❌ 35806 - ❌ 35807 * - **browsertime-tp6m-live-chrome-m-amazon-search-nofis** 35808 - ❌ 35809 - ❌ 35810 - ❌ 35811 - ❌ 35812 * - **browsertime-tp6m-live-fenix-amazon-search** 35813 - ❌ 35814 - ❌ 35815 - ❌ 35816 - ❌ 35817 * - **browsertime-tp6m-live-fenix-amazon-search-nofis** 35818 - ❌ 35819 - ❌ 35820 - ❌ 35821 - ❌ 35822 * - **browsertime-tp6m-live-geckoview-amazon-search** 35823 - ❌ 35824 - ❌ 35825 - ❌ 35826 - ❌ 35827 * - **browsertime-tp6m-live-geckoview-amazon-search-nofis** 35828 - ❌ 35829 - ❌ 35830 - ❌ 35831 - ❌ 35832 * - **browsertime-tp6m-webextensions-fenix-amazon-search** 35833 - ✅ 35834 - ❌ 35835 - ❌ 35836 - ❌ 35837 * - **browsertime-tp6m-webextensions-fenix-amazon-search-nofis** 35838 - ✅ 35839 - ❌ 35840 - ❌ 35841 - ❌ 35842 35843 35844 .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** 35845 :widths: 30 15 15 15 15 35846 :header-rows: 1 35847 35848 * - **Test Name** 35849 - mozilla-central 35850 - autoland 35851 - mozilla-release 35852 - mozilla-beta 35853 * - **browsertime-tp6m-essential-fenix-amazon-search** 35854 - ❌ 35855 - ❌ 35856 - ❌ 35857 - ❌ 35858 * - **browsertime-tp6m-essential-fenix-amazon-search-nofis** 35859 - ❌ 35860 - ❌ 35861 - ❌ 35862 - ❌ 35863 * - **browsertime-tp6m-essential-geckoview-amazon-search** 35864 - ❌ 35865 - ❌ 35866 - ❌ 35867 - ❌ 35868 * - **browsertime-tp6m-essential-geckoview-amazon-search-nofis** 35869 - ❌ 35870 - ❌ 35871 - ❌ 35872 - ❌ 35873 * - **browsertime-tp6m-essential-refbrow-amazon-search** 35874 - ❌ 35875 - ❌ 35876 - ❌ 35877 - ❌ 35878 * - **browsertime-tp6m-live-fenix-amazon-search** 35879 - ❌ 35880 - ❌ 35881 - ❌ 35882 - ❌ 35883 * - **browsertime-tp6m-live-fenix-amazon-search-nofis** 35884 - ❌ 35885 - ❌ 35886 - ❌ 35887 - ❌ 35888 * - **browsertime-tp6m-live-geckoview-amazon-search** 35889 - ❌ 35890 - ❌ 35891 - ❌ 35892 - ❌ 35893 * - **browsertime-tp6m-live-geckoview-amazon-search-nofis** 35894 - ❌ 35895 - ❌ 35896 - ❌ 35897 - ❌ 35898 * - **browsertime-tp6m-webextensions-fenix-amazon-search** 35899 - ❌ 35900 - ❌ 35901 - ❌ 35902 - ❌ 35903 * - **browsertime-tp6m-webextensions-fenix-amazon-search-nofis** 35904 - ❌ 35905 - ❌ 35906 - ❌ 35907 - ❌ 35908 35909 35910 35911 .. dropdown:: bild-de 35912 :class-container: anchor-id-bild-de-m 35913 35914 * Command to Run Locally 35915 35916 .. code-block:: 35917 35918 ./mach raptor -t bild-de 35919 35920 **Owner**: PerfTest Team 35921 35922 * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__, `largestContentfulPaint <raptor-metrics.html#largest-contentful-paint>`__ 35923 * **alert threshold**: 2.0 35924 * **apps**: geckoview, fenix, refbrow, chrome-m, cstm-car-m 35925 * **benchmark page**: true 35926 * **browser cycles**: 15 35927 * **expected**: pass 35928 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#33>`__ 35929 * **lower is better**: true 35930 * **page cycles**: 25 35931 * **page timeout**: 60000 35932 * **playback**: mitmproxy-android 35933 * **playback pageset manifest**: mitm8-android-fenix-bild-de.manifest 35934 * **playback version**: 11.0.0 35935 * **support class**: browsertime_pageload.py 35936 * **test url**: `<https://www.bild.de/sport/american-football/nfl/super-bowl-rekordquote-fuer-die-nfl-87139668.bild.html>`__ 35937 * **type**: pageload 35938 * **unit**: ms 35939 * **use live sites**: false 35940 * **Test Task**: 35941 35942 .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** 35943 :widths: 30 15 15 15 15 35944 :header-rows: 1 35945 35946 * - **Test Name** 35947 - mozilla-central 35948 - autoland 35949 - mozilla-release 35950 - mozilla-beta 35951 * - **browsertime-tp6m-chrome-m-bild-de-nofis** 35952 - ❌ 35953 - ❌ 35954 - ❌ 35955 - ❌ 35956 * - **browsertime-tp6m-cstm-car-m-bild-de-nofis** 35957 - ❌ 35958 - ❌ 35959 - ❌ 35960 - ❌ 35961 * - **browsertime-tp6m-fenix-bild-de** 35962 - ✅ 35963 - ❌ 35964 - ❌ 35965 - ❌ 35966 * - **browsertime-tp6m-fenix-bild-de-nofis** 35967 - ✅ 35968 - ✅ 35969 - ❌ 35970 - ❌ 35971 * - **browsertime-tp6m-geckoview-bild-de** 35972 - ❌ 35973 - ❌ 35974 - ❌ 35975 - ❌ 35976 * - **browsertime-tp6m-geckoview-bild-de-nofis** 35977 - ❌ 35978 - ❌ 35979 - ❌ 35980 - ❌ 35981 * - **browsertime-tp6m-live-chrome-m-bild-de-nofis** 35982 - ❌ 35983 - ❌ 35984 - ❌ 35985 - ❌ 35986 * - **browsertime-tp6m-live-fenix-bild-de** 35987 - ❌ 35988 - ❌ 35989 - ❌ 35990 - ❌ 35991 * - **browsertime-tp6m-live-fenix-bild-de-nofis** 35992 - ❌ 35993 - ❌ 35994 - ❌ 35995 - ❌ 35996 * - **browsertime-tp6m-live-geckoview-bild-de** 35997 - ❌ 35998 - ❌ 35999 - ❌ 36000 - ❌ 36001 * - **browsertime-tp6m-live-geckoview-bild-de-nofis** 36002 - ❌ 36003 - ❌ 36004 - ❌ 36005 - ❌ 36006 * - **browsertime-tp6m-refbrow-bild-de** 36007 - ❌ 36008 - ❌ 36009 - ❌ 36010 - ❌ 36011 36012 36013 .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** 36014 :widths: 30 15 15 15 15 36015 :header-rows: 1 36016 36017 * - **Test Name** 36018 - mozilla-central 36019 - autoland 36020 - mozilla-release 36021 - mozilla-beta 36022 * - **browsertime-tp6m-fenix-bild-de** 36023 - ✅ 36024 - ❌ 36025 - ❌ 36026 - ❌ 36027 * - **browsertime-tp6m-fenix-bild-de-nofis** 36028 - ❌ 36029 - ❌ 36030 - ❌ 36031 - ❌ 36032 * - **browsertime-tp6m-geckoview-bild-de** 36033 - ❌ 36034 - ❌ 36035 - ❌ 36036 - ❌ 36037 * - **browsertime-tp6m-geckoview-bild-de-nofis** 36038 - ❌ 36039 - ❌ 36040 - ❌ 36041 - ❌ 36042 * - **browsertime-tp6m-live-fenix-bild-de** 36043 - ❌ 36044 - ❌ 36045 - ❌ 36046 - ❌ 36047 * - **browsertime-tp6m-live-fenix-bild-de-nofis** 36048 - ❌ 36049 - ❌ 36050 - ❌ 36051 - ❌ 36052 * - **browsertime-tp6m-live-geckoview-bild-de** 36053 - ❌ 36054 - ❌ 36055 - ❌ 36056 - ❌ 36057 * - **browsertime-tp6m-live-geckoview-bild-de-nofis** 36058 - ❌ 36059 - ❌ 36060 - ❌ 36061 - ❌ 36062 * - **browsertime-tp6m-refbrow-bild-de** 36063 - ❌ 36064 - ❌ 36065 - ❌ 36066 - ❌ 36067 36068 36069 36070 .. dropdown:: bing 36071 :class-container: anchor-id-bing-m 36072 36073 * Command to Run Locally 36074 36075 .. code-block:: 36076 36077 ./mach raptor -t bing 36078 36079 **Owner**: PerfTest Team 36080 36081 * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__, `largestContentfulPaint <raptor-metrics.html#largest-contentful-paint>`__ 36082 * **alert threshold**: 2.0 36083 * **apps**: geckoview, fenix, refbrow, chrome-m, cstm-car-m 36084 * **benchmark page**: true 36085 * **browser cycles**: 15 36086 * **expected**: pass 36087 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#38>`__ 36088 * **lower is better**: true 36089 * **page cycles**: 25 36090 * **page timeout**: 60000 36091 * **playback**: mitmproxy-android 36092 * **playback pageset manifest**: mitm6-android-fenix-bing.manifest 36093 * **playback version**: 8.1.1 36094 * **support class**: browsertime_pageload.py 36095 * **test url**: `<https://www.bing.com/>`__ 36096 * **type**: pageload 36097 * **unit**: ms 36098 * **use live sites**: false 36099 * **Test Task**: 36100 36101 .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** 36102 :widths: 30 15 15 15 15 36103 :header-rows: 1 36104 36105 * - **Test Name** 36106 - mozilla-central 36107 - autoland 36108 - mozilla-release 36109 - mozilla-beta 36110 * - **browsertime-tp6m-chrome-m-bing-nofis** 36111 - ❌ 36112 - ❌ 36113 - ❌ 36114 - ❌ 36115 * - **browsertime-tp6m-cstm-car-m-bing-nofis** 36116 - ❌ 36117 - ❌ 36118 - ❌ 36119 - ❌ 36120 * - **browsertime-tp6m-fenix-bing** 36121 - ✅ 36122 - ❌ 36123 - ❌ 36124 - ❌ 36125 * - **browsertime-tp6m-fenix-bing-nofis** 36126 - ✅ 36127 - ✅ 36128 - ❌ 36129 - ❌ 36130 * - **browsertime-tp6m-geckoview-bing** 36131 - ❌ 36132 - ❌ 36133 - ❌ 36134 - ❌ 36135 * - **browsertime-tp6m-geckoview-bing-nofis** 36136 - ❌ 36137 - ❌ 36138 - ❌ 36139 - ❌ 36140 * - **browsertime-tp6m-live-chrome-m-bing-nofis** 36141 - ❌ 36142 - ❌ 36143 - ❌ 36144 - ❌ 36145 * - **browsertime-tp6m-live-fenix-bing** 36146 - ❌ 36147 - ❌ 36148 - ❌ 36149 - ❌ 36150 * - **browsertime-tp6m-live-fenix-bing-nofis** 36151 - ❌ 36152 - ❌ 36153 - ❌ 36154 - ❌ 36155 * - **browsertime-tp6m-live-geckoview-bing** 36156 - ❌ 36157 - ❌ 36158 - ❌ 36159 - ❌ 36160 * - **browsertime-tp6m-live-geckoview-bing-nofis** 36161 - ❌ 36162 - ❌ 36163 - ❌ 36164 - ❌ 36165 * - **browsertime-tp6m-refbrow-bing** 36166 - ❌ 36167 - ❌ 36168 - ❌ 36169 - ❌ 36170 36171 36172 .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** 36173 :widths: 30 15 15 15 15 36174 :header-rows: 1 36175 36176 * - **Test Name** 36177 - mozilla-central 36178 - autoland 36179 - mozilla-release 36180 - mozilla-beta 36181 * - **browsertime-tp6m-fenix-bing** 36182 - ✅ 36183 - ❌ 36184 - ❌ 36185 - ❌ 36186 * - **browsertime-tp6m-fenix-bing-nofis** 36187 - ❌ 36188 - ❌ 36189 - ❌ 36190 - ❌ 36191 * - **browsertime-tp6m-geckoview-bing** 36192 - ❌ 36193 - ❌ 36194 - ❌ 36195 - ❌ 36196 * - **browsertime-tp6m-geckoview-bing-nofis** 36197 - ❌ 36198 - ❌ 36199 - ❌ 36200 - ❌ 36201 * - **browsertime-tp6m-live-fenix-bing** 36202 - ❌ 36203 - ❌ 36204 - ❌ 36205 - ❌ 36206 * - **browsertime-tp6m-live-fenix-bing-nofis** 36207 - ❌ 36208 - ❌ 36209 - ❌ 36210 - ❌ 36211 * - **browsertime-tp6m-live-geckoview-bing** 36212 - ❌ 36213 - ❌ 36214 - ❌ 36215 - ❌ 36216 * - **browsertime-tp6m-live-geckoview-bing-nofis** 36217 - ❌ 36218 - ❌ 36219 - ❌ 36220 - ❌ 36221 * - **browsertime-tp6m-refbrow-bing** 36222 - ❌ 36223 - ❌ 36224 - ❌ 36225 - ❌ 36226 36227 36228 36229 .. dropdown:: bing-search-restaurants 36230 :class-container: anchor-id-bing-search-restaurants-m 36231 36232 * Command to Run Locally 36233 36234 .. code-block:: 36235 36236 ./mach raptor -t bing-search-restaurants 36237 36238 **Owner**: PerfTest Team 36239 36240 * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__, `largestContentfulPaint <raptor-metrics.html#largest-contentful-paint>`__ 36241 * **alert threshold**: 2.0 36242 * **apps**: geckoview, fenix, refbrow, chrome-m, cstm-car-m 36243 * **benchmark page**: true 36244 * **browser cycles**: 15 36245 * **expected**: pass 36246 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#41>`__ 36247 * **lower is better**: true 36248 * **page cycles**: 25 36249 * **page timeout**: 60000 36250 * **playback**: mitmproxy-android 36251 * **playback pageset manifest**: mitm6-android-fenix-bing-search-restaurants.manifest 36252 * **playback version**: 8.1.1 36253 * **support class**: browsertime_pageload.py 36254 * **test url**: `<https://www.bing.com/search?q=restaurants+in+exton+pa+19341>`__ 36255 * **type**: pageload 36256 * **unit**: ms 36257 * **use live sites**: false 36258 * **Test Task**: 36259 36260 .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** 36261 :widths: 30 15 15 15 15 36262 :header-rows: 1 36263 36264 * - **Test Name** 36265 - mozilla-central 36266 - autoland 36267 - mozilla-release 36268 - mozilla-beta 36269 * - **browsertime-tp6m-chrome-m-bing-search-restaurants-nofis** 36270 - ❌ 36271 - ❌ 36272 - ❌ 36273 - ❌ 36274 * - **browsertime-tp6m-cstm-car-m-bing-search-restaurants-nofis** 36275 - ❌ 36276 - ❌ 36277 - ❌ 36278 - ❌ 36279 * - **browsertime-tp6m-fenix-bing-search-restaurants** 36280 - ✅ 36281 - ❌ 36282 - ❌ 36283 - ❌ 36284 * - **browsertime-tp6m-fenix-bing-search-restaurants-nofis** 36285 - ✅ 36286 - ✅ 36287 - ❌ 36288 - ❌ 36289 * - **browsertime-tp6m-geckoview-bing-search-restaurants** 36290 - ❌ 36291 - ❌ 36292 - ❌ 36293 - ❌ 36294 * - **browsertime-tp6m-geckoview-bing-search-restaurants-nofis** 36295 - ❌ 36296 - ❌ 36297 - ❌ 36298 - ❌ 36299 * - **browsertime-tp6m-live-chrome-m-bing-search-restaurants-nofis** 36300 - ❌ 36301 - ❌ 36302 - ❌ 36303 - ❌ 36304 * - **browsertime-tp6m-live-fenix-bing-search-restaurants** 36305 - ❌ 36306 - ❌ 36307 - ❌ 36308 - ❌ 36309 * - **browsertime-tp6m-live-fenix-bing-search-restaurants-nofis** 36310 - ❌ 36311 - ❌ 36312 - ❌ 36313 - ❌ 36314 * - **browsertime-tp6m-live-geckoview-bing-search-restaurants** 36315 - ❌ 36316 - ❌ 36317 - ❌ 36318 - ❌ 36319 * - **browsertime-tp6m-live-geckoview-bing-search-restaurants-nofis** 36320 - ❌ 36321 - ❌ 36322 - ❌ 36323 - ❌ 36324 * - **browsertime-tp6m-refbrow-bing-search-restaurants** 36325 - ❌ 36326 - ❌ 36327 - ❌ 36328 - ❌ 36329 36330 36331 .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** 36332 :widths: 30 15 15 15 15 36333 :header-rows: 1 36334 36335 * - **Test Name** 36336 - mozilla-central 36337 - autoland 36338 - mozilla-release 36339 - mozilla-beta 36340 * - **browsertime-tp6m-fenix-bing-search-restaurants** 36341 - ✅ 36342 - ❌ 36343 - ❌ 36344 - ❌ 36345 * - **browsertime-tp6m-fenix-bing-search-restaurants-nofis** 36346 - ❌ 36347 - ❌ 36348 - ❌ 36349 - ❌ 36350 * - **browsertime-tp6m-geckoview-bing-search-restaurants** 36351 - ❌ 36352 - ❌ 36353 - ❌ 36354 - ❌ 36355 * - **browsertime-tp6m-geckoview-bing-search-restaurants-nofis** 36356 - ❌ 36357 - ❌ 36358 - ❌ 36359 - ❌ 36360 * - **browsertime-tp6m-live-fenix-bing-search-restaurants** 36361 - ❌ 36362 - ❌ 36363 - ❌ 36364 - ❌ 36365 * - **browsertime-tp6m-live-fenix-bing-search-restaurants-nofis** 36366 - ❌ 36367 - ❌ 36368 - ❌ 36369 - ❌ 36370 * - **browsertime-tp6m-live-geckoview-bing-search-restaurants** 36371 - ❌ 36372 - ❌ 36373 - ❌ 36374 - ❌ 36375 * - **browsertime-tp6m-live-geckoview-bing-search-restaurants-nofis** 36376 - ❌ 36377 - ❌ 36378 - ❌ 36379 - ❌ 36380 * - **browsertime-tp6m-refbrow-bing-search-restaurants** 36381 - ❌ 36382 - ❌ 36383 - ❌ 36384 - ❌ 36385 36386 36387 36388 .. dropdown:: booking 36389 :class-container: anchor-id-booking-m 36390 36391 * Command to Run Locally 36392 36393 .. code-block:: 36394 36395 ./mach raptor -t booking 36396 36397 **Owner**: PerfTest Team 36398 36399 * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__, `largestContentfulPaint <raptor-metrics.html#largest-contentful-paint>`__ 36400 * **alert threshold**: 2.0 36401 * **apps**: geckoview, fenix, refbrow, chrome-m, cstm-car-m 36402 * **benchmark page**: true 36403 * **browser cycles**: 15 36404 * **expected**: pass 36405 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#44>`__ 36406 * **lower is better**: true 36407 * **page cycles**: 25 36408 * **page timeout**: 60000 36409 * **playback**: mitmproxy-android 36410 * **playback pageset manifest**: mitm6-android-fenix-booking.manifest 36411 * **playback version**: 8.1.1 36412 * **support class**: browsertime_pageload.py 36413 * **test url**: `<https://www.booking.com/>`__ 36414 * **type**: pageload 36415 * **unit**: ms 36416 * **use live sites**: false 36417 * **Test Task**: 36418 36419 .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** 36420 :widths: 30 15 15 15 15 36421 :header-rows: 1 36422 36423 * - **Test Name** 36424 - mozilla-central 36425 - autoland 36426 - mozilla-release 36427 - mozilla-beta 36428 * - **browsertime-tp6m-chrome-m-booking-nofis** 36429 - ❌ 36430 - ❌ 36431 - ❌ 36432 - ❌ 36433 * - **browsertime-tp6m-cstm-car-m-booking-nofis** 36434 - ❌ 36435 - ❌ 36436 - ❌ 36437 - ❌ 36438 * - **browsertime-tp6m-fenix-booking** 36439 - ✅ 36440 - ❌ 36441 - ❌ 36442 - ❌ 36443 * - **browsertime-tp6m-fenix-booking-nofis** 36444 - ✅ 36445 - ✅ 36446 - ❌ 36447 - ❌ 36448 * - **browsertime-tp6m-geckoview-booking** 36449 - ❌ 36450 - ❌ 36451 - ❌ 36452 - ❌ 36453 * - **browsertime-tp6m-geckoview-booking-nofis** 36454 - ❌ 36455 - ❌ 36456 - ❌ 36457 - ❌ 36458 * - **browsertime-tp6m-live-chrome-m-booking-nofis** 36459 - ❌ 36460 - ❌ 36461 - ❌ 36462 - ❌ 36463 * - **browsertime-tp6m-live-fenix-booking** 36464 - ❌ 36465 - ❌ 36466 - ❌ 36467 - ❌ 36468 * - **browsertime-tp6m-live-fenix-booking-nofis** 36469 - ❌ 36470 - ❌ 36471 - ❌ 36472 - ❌ 36473 * - **browsertime-tp6m-live-geckoview-booking** 36474 - ❌ 36475 - ❌ 36476 - ❌ 36477 - ❌ 36478 * - **browsertime-tp6m-live-geckoview-booking-nofis** 36479 - ❌ 36480 - ❌ 36481 - ❌ 36482 - ❌ 36483 * - **browsertime-tp6m-refbrow-booking** 36484 - ❌ 36485 - ❌ 36486 - ❌ 36487 - ❌ 36488 36489 36490 .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** 36491 :widths: 30 15 15 15 15 36492 :header-rows: 1 36493 36494 * - **Test Name** 36495 - mozilla-central 36496 - autoland 36497 - mozilla-release 36498 - mozilla-beta 36499 * - **browsertime-tp6m-fenix-booking** 36500 - ✅ 36501 - ❌ 36502 - ❌ 36503 - ❌ 36504 * - **browsertime-tp6m-fenix-booking-nofis** 36505 - ❌ 36506 - ❌ 36507 - ❌ 36508 - ❌ 36509 * - **browsertime-tp6m-geckoview-booking** 36510 - ❌ 36511 - ❌ 36512 - ❌ 36513 - ❌ 36514 * - **browsertime-tp6m-geckoview-booking-nofis** 36515 - ❌ 36516 - ❌ 36517 - ❌ 36518 - ❌ 36519 * - **browsertime-tp6m-live-fenix-booking** 36520 - ❌ 36521 - ❌ 36522 - ❌ 36523 - ❌ 36524 * - **browsertime-tp6m-live-fenix-booking-nofis** 36525 - ❌ 36526 - ❌ 36527 - ❌ 36528 - ❌ 36529 * - **browsertime-tp6m-live-geckoview-booking** 36530 - ❌ 36531 - ❌ 36532 - ❌ 36533 - ❌ 36534 * - **browsertime-tp6m-live-geckoview-booking-nofis** 36535 - ❌ 36536 - ❌ 36537 - ❌ 36538 - ❌ 36539 * - **browsertime-tp6m-refbrow-booking** 36540 - ❌ 36541 - ❌ 36542 - ❌ 36543 - ❌ 36544 36545 36546 36547 .. dropdown:: cnn 36548 :class-container: anchor-id-cnn-m 36549 36550 * Command to Run Locally 36551 36552 .. code-block:: 36553 36554 ./mach raptor -t cnn 36555 36556 **Owner**: PerfTest Team 36557 36558 * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__, `largestContentfulPaint <raptor-metrics.html#largest-contentful-paint>`__ 36559 * **alert threshold**: 2.0 36560 * **apps**: geckoview, fenix, refbrow, chrome-m, cstm-car-m 36561 * **benchmark page**: true 36562 * **browser cycles**: 15 36563 * **expected**: pass 36564 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#47>`__ 36565 * **lower is better**: true 36566 * **page cycles**: 25 36567 * **page timeout**: 60000 36568 * **playback**: mitmproxy-android 36569 * **playback pageset manifest**: mitm6-android-fenix-cnn.manifest 36570 * **playback version**: 8.1.1 36571 * **support class**: browsertime_pageload.py 36572 * **test url**: `<https://cnn.com>`__ 36573 * **type**: pageload 36574 * **unit**: ms 36575 * **use live sites**: false 36576 * **Test Task**: 36577 36578 .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** 36579 :widths: 30 15 15 15 15 36580 :header-rows: 1 36581 36582 * - **Test Name** 36583 - mozilla-central 36584 - autoland 36585 - mozilla-release 36586 - mozilla-beta 36587 * - **browsertime-tp6m-chrome-m-cnn-nofis** 36588 - ❌ 36589 - ❌ 36590 - ❌ 36591 - ❌ 36592 * - **browsertime-tp6m-cstm-car-m-cnn-nofis** 36593 - ❌ 36594 - ❌ 36595 - ❌ 36596 - ❌ 36597 * - **browsertime-tp6m-fenix-cnn** 36598 - ✅ 36599 - ❌ 36600 - ❌ 36601 - ❌ 36602 * - **browsertime-tp6m-fenix-cnn-nofis** 36603 - ✅ 36604 - ✅ 36605 - ❌ 36606 - ❌ 36607 * - **browsertime-tp6m-geckoview-cnn** 36608 - ❌ 36609 - ❌ 36610 - ❌ 36611 - ❌ 36612 * - **browsertime-tp6m-geckoview-cnn-nofis** 36613 - ❌ 36614 - ❌ 36615 - ❌ 36616 - ❌ 36617 * - **browsertime-tp6m-live-chrome-m-cnn-nofis** 36618 - ❌ 36619 - ❌ 36620 - ❌ 36621 - ❌ 36622 * - **browsertime-tp6m-live-fenix-cnn** 36623 - ❌ 36624 - ❌ 36625 - ❌ 36626 - ❌ 36627 * - **browsertime-tp6m-live-fenix-cnn-nofis** 36628 - ❌ 36629 - ❌ 36630 - ❌ 36631 - ❌ 36632 * - **browsertime-tp6m-live-geckoview-cnn** 36633 - ❌ 36634 - ❌ 36635 - ❌ 36636 - ❌ 36637 * - **browsertime-tp6m-live-geckoview-cnn-nofis** 36638 - ❌ 36639 - ❌ 36640 - ❌ 36641 - ❌ 36642 * - **browsertime-tp6m-refbrow-cnn** 36643 - ❌ 36644 - ❌ 36645 - ❌ 36646 - ❌ 36647 36648 36649 .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** 36650 :widths: 30 15 15 15 15 36651 :header-rows: 1 36652 36653 * - **Test Name** 36654 - mozilla-central 36655 - autoland 36656 - mozilla-release 36657 - mozilla-beta 36658 * - **browsertime-tp6m-fenix-cnn** 36659 - ✅ 36660 - ❌ 36661 - ❌ 36662 - ❌ 36663 * - **browsertime-tp6m-fenix-cnn-nofis** 36664 - ❌ 36665 - ❌ 36666 - ❌ 36667 - ❌ 36668 * - **browsertime-tp6m-geckoview-cnn** 36669 - ❌ 36670 - ❌ 36671 - ❌ 36672 - ❌ 36673 * - **browsertime-tp6m-geckoview-cnn-nofis** 36674 - ❌ 36675 - ❌ 36676 - ❌ 36677 - ❌ 36678 * - **browsertime-tp6m-live-fenix-cnn** 36679 - ❌ 36680 - ❌ 36681 - ❌ 36682 - ❌ 36683 * - **browsertime-tp6m-live-fenix-cnn-nofis** 36684 - ❌ 36685 - ❌ 36686 - ❌ 36687 - ❌ 36688 * - **browsertime-tp6m-live-geckoview-cnn** 36689 - ❌ 36690 - ❌ 36691 - ❌ 36692 - ❌ 36693 * - **browsertime-tp6m-live-geckoview-cnn-nofis** 36694 - ❌ 36695 - ❌ 36696 - ❌ 36697 - ❌ 36698 * - **browsertime-tp6m-refbrow-cnn** 36699 - ❌ 36700 - ❌ 36701 - ❌ 36702 - ❌ 36703 36704 36705 36706 .. dropdown:: cnn-ampstories 36707 :class-container: anchor-id-cnn-ampstories-m 36708 36709 * Command to Run Locally 36710 36711 .. code-block:: 36712 36713 ./mach raptor -t cnn-ampstories 36714 36715 **Owner**: PerfTest Team 36716 36717 * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__, `largestContentfulPaint <raptor-metrics.html#largest-contentful-paint>`__ 36718 * **alert threshold**: 2.0 36719 * **apps**: geckoview, fenix, refbrow, chrome-m, cstm-car-m 36720 * **benchmark page**: true 36721 * **browser cycles**: 15 36722 * **expected**: pass 36723 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#50>`__ 36724 * **lower is better**: true 36725 * **page cycles**: 25 36726 * **page timeout**: 60000 36727 * **playback**: mitmproxy-android 36728 * **playback pageset manifest**: mitm6-android-fenix-cnn-ampstories.manifest 36729 * **playback version**: 8.1.1 36730 * **support class**: browsertime_pageload.py 36731 * **test url**: `<https://cnn.com/ampstories/us/why-hurricane-michael-is-a-monster-unlike-any-other>`__ 36732 * **type**: pageload 36733 * **unit**: ms 36734 * **use live sites**: false 36735 * **Test Task**: 36736 36737 .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** 36738 :widths: 30 15 15 15 15 36739 :header-rows: 1 36740 36741 * - **Test Name** 36742 - mozilla-central 36743 - autoland 36744 - mozilla-release 36745 - mozilla-beta 36746 * - **browsertime-tp6m-chrome-m-cnn-ampstories-nofis** 36747 - ❌ 36748 - ❌ 36749 - ❌ 36750 - ❌ 36751 * - **browsertime-tp6m-cstm-car-m-cnn-ampstories-nofis** 36752 - ❌ 36753 - ❌ 36754 - ❌ 36755 - ❌ 36756 * - **browsertime-tp6m-fenix-cnn-ampstories** 36757 - ✅ 36758 - ❌ 36759 - ❌ 36760 - ❌ 36761 * - **browsertime-tp6m-fenix-cnn-ampstories-nofis** 36762 - ✅ 36763 - ✅ 36764 - ❌ 36765 - ❌ 36766 * - **browsertime-tp6m-geckoview-cnn-ampstories** 36767 - ❌ 36768 - ❌ 36769 - ❌ 36770 - ❌ 36771 * - **browsertime-tp6m-geckoview-cnn-ampstories-nofis** 36772 - ❌ 36773 - ❌ 36774 - ❌ 36775 - ❌ 36776 * - **browsertime-tp6m-live-chrome-m-cnn-ampstories-nofis** 36777 - ❌ 36778 - ❌ 36779 - ❌ 36780 - ❌ 36781 * - **browsertime-tp6m-live-fenix-cnn-ampstories** 36782 - ❌ 36783 - ❌ 36784 - ❌ 36785 - ❌ 36786 * - **browsertime-tp6m-live-fenix-cnn-ampstories-nofis** 36787 - ❌ 36788 - ❌ 36789 - ❌ 36790 - ❌ 36791 * - **browsertime-tp6m-live-geckoview-cnn-ampstories** 36792 - ❌ 36793 - ❌ 36794 - ❌ 36795 - ❌ 36796 * - **browsertime-tp6m-live-geckoview-cnn-ampstories-nofis** 36797 - ❌ 36798 - ❌ 36799 - ❌ 36800 - ❌ 36801 * - **browsertime-tp6m-refbrow-cnn-ampstories** 36802 - ❌ 36803 - ❌ 36804 - ❌ 36805 - ❌ 36806 36807 36808 .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** 36809 :widths: 30 15 15 15 15 36810 :header-rows: 1 36811 36812 * - **Test Name** 36813 - mozilla-central 36814 - autoland 36815 - mozilla-release 36816 - mozilla-beta 36817 * - **browsertime-tp6m-fenix-cnn-ampstories** 36818 - ✅ 36819 - ❌ 36820 - ❌ 36821 - ❌ 36822 * - **browsertime-tp6m-fenix-cnn-ampstories-nofis** 36823 - ❌ 36824 - ❌ 36825 - ❌ 36826 - ❌ 36827 * - **browsertime-tp6m-geckoview-cnn-ampstories** 36828 - ❌ 36829 - ❌ 36830 - ❌ 36831 - ❌ 36832 * - **browsertime-tp6m-geckoview-cnn-ampstories-nofis** 36833 - ❌ 36834 - ❌ 36835 - ❌ 36836 - ❌ 36837 * - **browsertime-tp6m-live-fenix-cnn-ampstories** 36838 - ❌ 36839 - ❌ 36840 - ❌ 36841 - ❌ 36842 * - **browsertime-tp6m-live-fenix-cnn-ampstories-nofis** 36843 - ❌ 36844 - ❌ 36845 - ❌ 36846 - ❌ 36847 * - **browsertime-tp6m-live-geckoview-cnn-ampstories** 36848 - ❌ 36849 - ❌ 36850 - ❌ 36851 - ❌ 36852 * - **browsertime-tp6m-live-geckoview-cnn-ampstories-nofis** 36853 - ❌ 36854 - ❌ 36855 - ❌ 36856 - ❌ 36857 * - **browsertime-tp6m-refbrow-cnn-ampstories** 36858 - ❌ 36859 - ❌ 36860 - ❌ 36861 - ❌ 36862 36863 36864 36865 .. dropdown:: dailymail 36866 :class-container: anchor-id-dailymail-m 36867 36868 * Command to Run Locally 36869 36870 .. code-block:: 36871 36872 ./mach raptor -t dailymail 36873 36874 **Owner**: PerfTest Team 36875 36876 * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__, `largestContentfulPaint <raptor-metrics.html#largest-contentful-paint>`__ 36877 * **alert threshold**: 2.0 36878 * **apps**: geckoview, fenix, refbrow, chrome-m, cstm-car-m 36879 * **benchmark page**: true 36880 * **browser cycles**: 15 36881 * **expected**: pass 36882 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#53>`__ 36883 * **lower is better**: true 36884 * **page cycles**: 25 36885 * **page timeout**: 60000 36886 * **playback**: mitmproxy-android 36887 * **playback pageset manifest**: mitm6-android-fenix-dailymail.manifest 36888 * **playback version**: 8.1.1 36889 * **support class**: browsertime_pageload.py 36890 * **test url**: `<https://www.dailymail.co.uk/sciencetech/article-9749081/Experts-say-Hubble-repair-despite-NASA-insisting-multiple-options-fix.html>`__ 36891 * **type**: pageload 36892 * **unit**: ms 36893 * **use live sites**: false 36894 * **Test Task**: 36895 36896 .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** 36897 :widths: 30 15 15 15 15 36898 :header-rows: 1 36899 36900 * - **Test Name** 36901 - mozilla-central 36902 - autoland 36903 - mozilla-release 36904 - mozilla-beta 36905 * - **browsertime-tp6m-chrome-m-dailymail-nofis** 36906 - ❌ 36907 - ❌ 36908 - ❌ 36909 - ❌ 36910 * - **browsertime-tp6m-cstm-car-m-dailymail-nofis** 36911 - ❌ 36912 - ❌ 36913 - ❌ 36914 - ❌ 36915 * - **browsertime-tp6m-fenix-dailymail** 36916 - ✅ 36917 - ❌ 36918 - ❌ 36919 - ❌ 36920 * - **browsertime-tp6m-fenix-dailymail-nofis** 36921 - ✅ 36922 - ✅ 36923 - ❌ 36924 - ❌ 36925 * - **browsertime-tp6m-geckoview-dailymail** 36926 - ❌ 36927 - ❌ 36928 - ❌ 36929 - ❌ 36930 * - **browsertime-tp6m-geckoview-dailymail-nofis** 36931 - ❌ 36932 - ❌ 36933 - ❌ 36934 - ❌ 36935 * - **browsertime-tp6m-live-chrome-m-dailymail-nofis** 36936 - ❌ 36937 - ❌ 36938 - ❌ 36939 - ❌ 36940 * - **browsertime-tp6m-live-fenix-dailymail** 36941 - ❌ 36942 - ❌ 36943 - ❌ 36944 - ❌ 36945 * - **browsertime-tp6m-live-fenix-dailymail-nofis** 36946 - ❌ 36947 - ❌ 36948 - ❌ 36949 - ❌ 36950 * - **browsertime-tp6m-live-geckoview-dailymail** 36951 - ❌ 36952 - ❌ 36953 - ❌ 36954 - ❌ 36955 * - **browsertime-tp6m-live-geckoview-dailymail-nofis** 36956 - ❌ 36957 - ❌ 36958 - ❌ 36959 - ❌ 36960 * - **browsertime-tp6m-refbrow-dailymail** 36961 - ❌ 36962 - ❌ 36963 - ❌ 36964 - ❌ 36965 36966 36967 .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** 36968 :widths: 30 15 15 15 15 36969 :header-rows: 1 36970 36971 * - **Test Name** 36972 - mozilla-central 36973 - autoland 36974 - mozilla-release 36975 - mozilla-beta 36976 * - **browsertime-tp6m-fenix-dailymail** 36977 - ✅ 36978 - ❌ 36979 - ❌ 36980 - ❌ 36981 * - **browsertime-tp6m-fenix-dailymail-nofis** 36982 - ❌ 36983 - ❌ 36984 - ❌ 36985 - ❌ 36986 * - **browsertime-tp6m-geckoview-dailymail** 36987 - ❌ 36988 - ❌ 36989 - ❌ 36990 - ❌ 36991 * - **browsertime-tp6m-geckoview-dailymail-nofis** 36992 - ❌ 36993 - ❌ 36994 - ❌ 36995 - ❌ 36996 * - **browsertime-tp6m-live-fenix-dailymail** 36997 - ❌ 36998 - ❌ 36999 - ❌ 37000 - ❌ 37001 * - **browsertime-tp6m-live-fenix-dailymail-nofis** 37002 - ❌ 37003 - ❌ 37004 - ❌ 37005 - ❌ 37006 * - **browsertime-tp6m-live-geckoview-dailymail** 37007 - ❌ 37008 - ❌ 37009 - ❌ 37010 - ❌ 37011 * - **browsertime-tp6m-live-geckoview-dailymail-nofis** 37012 - ❌ 37013 - ❌ 37014 - ❌ 37015 - ❌ 37016 * - **browsertime-tp6m-refbrow-dailymail** 37017 - ❌ 37018 - ❌ 37019 - ❌ 37020 - ❌ 37021 37022 37023 37024 .. dropdown:: ebay-kleinanzeigen 37025 :class-container: anchor-id-ebay-kleinanzeigen-m 37026 37027 * Command to Run Locally 37028 37029 .. code-block:: 37030 37031 ./mach raptor -t ebay-kleinanzeigen 37032 37033 **Owner**: PerfTest Team 37034 37035 * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__, `largestContentfulPaint <raptor-metrics.html#largest-contentful-paint>`__ 37036 * **alert threshold**: 2.0 37037 * **apps**: geckoview, fenix, refbrow, chrome-m, cstm-car-m 37038 * **benchmark page**: true 37039 * **browser cycles**: 15 37040 * **expected**: pass 37041 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#56>`__ 37042 * **lower is better**: true 37043 * **page cycles**: 25 37044 * **page timeout**: 60000 37045 * **playback**: mitmproxy-android 37046 * **playback pageset manifest**: mitm6-android-fenix-ebay-kleinanzeigen.manifest 37047 * **playback version**: 8.1.1 37048 * **support class**: browsertime_pageload.py 37049 * **test url**: `<https://m.ebay-kleinanzeigen.de>`__ 37050 * **type**: pageload 37051 * **unit**: ms 37052 * **use live sites**: false 37053 * **Test Task**: 37054 37055 .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** 37056 :widths: 30 15 15 15 15 37057 :header-rows: 1 37058 37059 * - **Test Name** 37060 - mozilla-central 37061 - autoland 37062 - mozilla-release 37063 - mozilla-beta 37064 * - **browsertime-tp6m-chrome-m-ebay-kleinanzeigen-nofis** 37065 - ❌ 37066 - ❌ 37067 - ❌ 37068 - ❌ 37069 * - **browsertime-tp6m-cstm-car-m-ebay-kleinanzeigen-nofis** 37070 - ❌ 37071 - ❌ 37072 - ❌ 37073 - ❌ 37074 * - **browsertime-tp6m-fenix-ebay-kleinanzeigen** 37075 - ✅ 37076 - ❌ 37077 - ❌ 37078 - ❌ 37079 * - **browsertime-tp6m-fenix-ebay-kleinanzeigen-nofis** 37080 - ✅ 37081 - ✅ 37082 - ❌ 37083 - ❌ 37084 * - **browsertime-tp6m-geckoview-ebay-kleinanzeigen** 37085 - ❌ 37086 - ❌ 37087 - ❌ 37088 - ❌ 37089 * - **browsertime-tp6m-geckoview-ebay-kleinanzeigen-nofis** 37090 - ❌ 37091 - ❌ 37092 - ❌ 37093 - ❌ 37094 * - **browsertime-tp6m-live-chrome-m-ebay-kleinanzeigen-nofis** 37095 - ❌ 37096 - ❌ 37097 - ❌ 37098 - ❌ 37099 * - **browsertime-tp6m-live-fenix-ebay-kleinanzeigen** 37100 - ❌ 37101 - ❌ 37102 - ❌ 37103 - ❌ 37104 * - **browsertime-tp6m-live-fenix-ebay-kleinanzeigen-nofis** 37105 - ❌ 37106 - ❌ 37107 - ❌ 37108 - ❌ 37109 * - **browsertime-tp6m-live-geckoview-ebay-kleinanzeigen** 37110 - ❌ 37111 - ❌ 37112 - ❌ 37113 - ❌ 37114 * - **browsertime-tp6m-live-geckoview-ebay-kleinanzeigen-nofis** 37115 - ❌ 37116 - ❌ 37117 - ❌ 37118 - ❌ 37119 * - **browsertime-tp6m-refbrow-ebay-kleinanzeigen** 37120 - ❌ 37121 - ❌ 37122 - ❌ 37123 - ❌ 37124 37125 37126 .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** 37127 :widths: 30 15 15 15 15 37128 :header-rows: 1 37129 37130 * - **Test Name** 37131 - mozilla-central 37132 - autoland 37133 - mozilla-release 37134 - mozilla-beta 37135 * - **browsertime-tp6m-fenix-ebay-kleinanzeigen** 37136 - ✅ 37137 - ❌ 37138 - ❌ 37139 - ❌ 37140 * - **browsertime-tp6m-fenix-ebay-kleinanzeigen-nofis** 37141 - ❌ 37142 - ❌ 37143 - ❌ 37144 - ❌ 37145 * - **browsertime-tp6m-geckoview-ebay-kleinanzeigen** 37146 - ❌ 37147 - ❌ 37148 - ❌ 37149 - ❌ 37150 * - **browsertime-tp6m-geckoview-ebay-kleinanzeigen-nofis** 37151 - ❌ 37152 - ❌ 37153 - ❌ 37154 - ❌ 37155 * - **browsertime-tp6m-live-fenix-ebay-kleinanzeigen** 37156 - ❌ 37157 - ❌ 37158 - ❌ 37159 - ❌ 37160 * - **browsertime-tp6m-live-fenix-ebay-kleinanzeigen-nofis** 37161 - ❌ 37162 - ❌ 37163 - ❌ 37164 - ❌ 37165 * - **browsertime-tp6m-live-geckoview-ebay-kleinanzeigen** 37166 - ❌ 37167 - ❌ 37168 - ❌ 37169 - ❌ 37170 * - **browsertime-tp6m-live-geckoview-ebay-kleinanzeigen-nofis** 37171 - ❌ 37172 - ❌ 37173 - ❌ 37174 - ❌ 37175 * - **browsertime-tp6m-refbrow-ebay-kleinanzeigen** 37176 - ❌ 37177 - ❌ 37178 - ❌ 37179 - ❌ 37180 37181 37182 37183 .. dropdown:: ebay-kleinanzeigen-search 37184 :class-container: anchor-id-ebay-kleinanzeigen-search-m 37185 37186 * Command to Run Locally 37187 37188 .. code-block:: 37189 37190 ./mach raptor -t ebay-kleinanzeigen-search 37191 37192 **Owner**: PerfTest Team 37193 37194 * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__, `largestContentfulPaint <raptor-metrics.html#largest-contentful-paint>`__ 37195 * **alert threshold**: 2.0 37196 * **apps**: geckoview, fenix, refbrow, chrome-m, cstm-car-m 37197 * **benchmark page**: true 37198 * **browser cycles**: 15 37199 * **expected**: pass 37200 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#59>`__ 37201 * **lower is better**: true 37202 * **page cycles**: 25 37203 * **page timeout**: 60000 37204 * **playback**: mitmproxy-android 37205 * **playback pageset manifest**: mitm6-android-fenix-ebay-kleinanzeigen-search.manifest 37206 * **playback version**: 8.1.1 37207 * **support class**: browsertime_pageload.py 37208 * **test url**: `<https://m.ebay-kleinanzeigen.de/s-anzeigen/auf-zeit-wg-berlin/zimmer/c199-l3331>`__ 37209 * **type**: pageload 37210 * **unit**: ms 37211 * **use live sites**: false 37212 * **Test Task**: 37213 37214 .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** 37215 :widths: 30 15 15 15 15 37216 :header-rows: 1 37217 37218 * - **Test Name** 37219 - mozilla-central 37220 - autoland 37221 - mozilla-release 37222 - mozilla-beta 37223 * - **browsertime-tp6m-chrome-m-ebay-kleinanzeigen-search-nofis** 37224 - ❌ 37225 - ❌ 37226 - ❌ 37227 - ❌ 37228 * - **browsertime-tp6m-cstm-car-m-ebay-kleinanzeigen-search-nofis** 37229 - ❌ 37230 - ❌ 37231 - ❌ 37232 - ❌ 37233 * - **browsertime-tp6m-fenix-ebay-kleinanzeigen-search** 37234 - ✅ 37235 - ❌ 37236 - ❌ 37237 - ❌ 37238 * - **browsertime-tp6m-fenix-ebay-kleinanzeigen-search-nofis** 37239 - ✅ 37240 - ✅ 37241 - ❌ 37242 - ❌ 37243 * - **browsertime-tp6m-geckoview-ebay-kleinanzeigen-search** 37244 - ❌ 37245 - ❌ 37246 - ❌ 37247 - ❌ 37248 * - **browsertime-tp6m-geckoview-ebay-kleinanzeigen-search-nofis** 37249 - ❌ 37250 - ❌ 37251 - ❌ 37252 - ❌ 37253 * - **browsertime-tp6m-live-chrome-m-ebay-kleinanzeigen-search-nofis** 37254 - ❌ 37255 - ❌ 37256 - ❌ 37257 - ❌ 37258 * - **browsertime-tp6m-live-fenix-ebay-kleinanzeigen-search** 37259 - ❌ 37260 - ❌ 37261 - ❌ 37262 - ❌ 37263 * - **browsertime-tp6m-live-fenix-ebay-kleinanzeigen-search-nofis** 37264 - ❌ 37265 - ❌ 37266 - ❌ 37267 - ❌ 37268 * - **browsertime-tp6m-live-geckoview-ebay-kleinanzeigen-search** 37269 - ❌ 37270 - ❌ 37271 - ❌ 37272 - ❌ 37273 * - **browsertime-tp6m-live-geckoview-ebay-kleinanzeigen-search-nofis** 37274 - ❌ 37275 - ❌ 37276 - ❌ 37277 - ❌ 37278 * - **browsertime-tp6m-refbrow-ebay-kleinanzeigen-search** 37279 - ❌ 37280 - ❌ 37281 - ❌ 37282 - ❌ 37283 37284 37285 .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** 37286 :widths: 30 15 15 15 15 37287 :header-rows: 1 37288 37289 * - **Test Name** 37290 - mozilla-central 37291 - autoland 37292 - mozilla-release 37293 - mozilla-beta 37294 * - **browsertime-tp6m-fenix-ebay-kleinanzeigen-search** 37295 - ✅ 37296 - ❌ 37297 - ❌ 37298 - ❌ 37299 * - **browsertime-tp6m-fenix-ebay-kleinanzeigen-search-nofis** 37300 - ❌ 37301 - ❌ 37302 - ❌ 37303 - ❌ 37304 * - **browsertime-tp6m-geckoview-ebay-kleinanzeigen-search** 37305 - ❌ 37306 - ❌ 37307 - ❌ 37308 - ❌ 37309 * - **browsertime-tp6m-geckoview-ebay-kleinanzeigen-search-nofis** 37310 - ❌ 37311 - ❌ 37312 - ❌ 37313 - ❌ 37314 * - **browsertime-tp6m-live-fenix-ebay-kleinanzeigen-search** 37315 - ❌ 37316 - ❌ 37317 - ❌ 37318 - ❌ 37319 * - **browsertime-tp6m-live-fenix-ebay-kleinanzeigen-search-nofis** 37320 - ❌ 37321 - ❌ 37322 - ❌ 37323 - ❌ 37324 * - **browsertime-tp6m-live-geckoview-ebay-kleinanzeigen-search** 37325 - ❌ 37326 - ❌ 37327 - ❌ 37328 - ❌ 37329 * - **browsertime-tp6m-live-geckoview-ebay-kleinanzeigen-search-nofis** 37330 - ❌ 37331 - ❌ 37332 - ❌ 37333 - ❌ 37334 * - **browsertime-tp6m-refbrow-ebay-kleinanzeigen-search** 37335 - ❌ 37336 - ❌ 37337 - ❌ 37338 - ❌ 37339 37340 37341 37342 .. dropdown:: espn 37343 :class-container: anchor-id-espn-m 37344 37345 * Command to Run Locally 37346 37347 .. code-block:: 37348 37349 ./mach raptor -t espn 37350 37351 **Owner**: PerfTest Team 37352 37353 * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__, `largestContentfulPaint <raptor-metrics.html#largest-contentful-paint>`__ 37354 * **alert threshold**: 2.0 37355 * **apps**: geckoview, fenix, refbrow, chrome-m, cstm-car-m 37356 * **benchmark page**: true 37357 * **browser cycles**: 15 37358 * **expected**: pass 37359 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#62>`__ 37360 * **lower is better**: true 37361 * **page cycles**: 25 37362 * **page timeout**: 60000 37363 * **playback**: mitmproxy-android 37364 * **playback pageset manifest**: mitm6-android-fenix-espn.manifest 37365 * **playback version**: 8.1.1 37366 * **support class**: browsertime_pageload.py 37367 * **test url**: `<http://www.espn.com/nba/story/_/page/allstarweekend25788027/the-comparison-lebron-james-michael-jordan-their-own-words>`__ 37368 * **type**: pageload 37369 * **unit**: ms 37370 * **use live sites**: false 37371 * **Test Task**: 37372 37373 .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** 37374 :widths: 30 15 15 15 15 37375 :header-rows: 1 37376 37377 * - **Test Name** 37378 - mozilla-central 37379 - autoland 37380 - mozilla-release 37381 - mozilla-beta 37382 * - **browsertime-tp6m-essential-chrome-m-espn-nofis** 37383 - ❌ 37384 - ❌ 37385 - ❌ 37386 - ❌ 37387 * - **browsertime-tp6m-essential-cstm-car-m-espn-nofis** 37388 - ❌ 37389 - ❌ 37390 - ❌ 37391 - ❌ 37392 * - **browsertime-tp6m-essential-fenix-espn** 37393 - ✅ 37394 - ✅ 37395 - ❌ 37396 - ❌ 37397 * - **browsertime-tp6m-essential-fenix-espn-nofis** 37398 - ✅ 37399 - ✅ 37400 - ❌ 37401 - ❌ 37402 * - **browsertime-tp6m-essential-geckoview-espn** 37403 - ❌ 37404 - ❌ 37405 - ❌ 37406 - ❌ 37407 * - **browsertime-tp6m-essential-geckoview-espn-nofis** 37408 - ❌ 37409 - ❌ 37410 - ❌ 37411 - ❌ 37412 * - **browsertime-tp6m-essential-refbrow-espn** 37413 - ❌ 37414 - ❌ 37415 - ❌ 37416 - ❌ 37417 * - **browsertime-tp6m-live-chrome-m-espn-nofis** 37418 - ❌ 37419 - ❌ 37420 - ❌ 37421 - ❌ 37422 * - **browsertime-tp6m-live-fenix-espn** 37423 - ❌ 37424 - ❌ 37425 - ❌ 37426 - ❌ 37427 * - **browsertime-tp6m-live-fenix-espn-nofis** 37428 - ❌ 37429 - ❌ 37430 - ❌ 37431 - ❌ 37432 * - **browsertime-tp6m-live-geckoview-espn** 37433 - ❌ 37434 - ❌ 37435 - ❌ 37436 - ❌ 37437 * - **browsertime-tp6m-live-geckoview-espn-nofis** 37438 - ❌ 37439 - ❌ 37440 - ❌ 37441 - ❌ 37442 37443 37444 .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** 37445 :widths: 30 15 15 15 15 37446 :header-rows: 1 37447 37448 * - **Test Name** 37449 - mozilla-central 37450 - autoland 37451 - mozilla-release 37452 - mozilla-beta 37453 * - **browsertime-tp6m-essential-fenix-espn** 37454 - ❌ 37455 - ❌ 37456 - ❌ 37457 - ❌ 37458 * - **browsertime-tp6m-essential-fenix-espn-nofis** 37459 - ❌ 37460 - ❌ 37461 - ❌ 37462 - ❌ 37463 * - **browsertime-tp6m-essential-geckoview-espn** 37464 - ❌ 37465 - ❌ 37466 - ❌ 37467 - ❌ 37468 * - **browsertime-tp6m-essential-geckoview-espn-nofis** 37469 - ❌ 37470 - ❌ 37471 - ❌ 37472 - ❌ 37473 * - **browsertime-tp6m-essential-refbrow-espn** 37474 - ❌ 37475 - ❌ 37476 - ❌ 37477 - ❌ 37478 * - **browsertime-tp6m-live-fenix-espn** 37479 - ❌ 37480 - ❌ 37481 - ❌ 37482 - ❌ 37483 * - **browsertime-tp6m-live-fenix-espn-nofis** 37484 - ❌ 37485 - ❌ 37486 - ❌ 37487 - ❌ 37488 * - **browsertime-tp6m-live-geckoview-espn** 37489 - ❌ 37490 - ❌ 37491 - ❌ 37492 - ❌ 37493 * - **browsertime-tp6m-live-geckoview-espn-nofis** 37494 - ❌ 37495 - ❌ 37496 - ❌ 37497 - ❌ 37498 37499 37500 37501 .. dropdown:: facebook 37502 :class-container: anchor-id-facebook-m 37503 37504 * Command to Run Locally 37505 37506 .. code-block:: 37507 37508 ./mach raptor -t facebook 37509 37510 **Owner**: PerfTest Team 37511 37512 * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__, `largestContentfulPaint <raptor-metrics.html#largest-contentful-paint>`__ 37513 * **alert threshold**: 2.0 37514 * **apps**: geckoview, fenix, refbrow, chrome-m, cstm-car-m 37515 * **benchmark page**: true 37516 * **browser cycles**: 15 37517 * **expected**: pass 37518 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#65>`__ 37519 * **login**: true 37520 * **lower is better**: true 37521 * **page cycles**: 25 37522 * **page timeout**: 60000 37523 * **playback**: mitmproxy-android 37524 * **playback pageset manifest**: mitm6-g5-fenix-facebook.manifest 37525 * **playback version**: 8.1.1 37526 * **support class**: browsertime_pageload.py 37527 * **test url**: `<https://m.facebook.com>`__ 37528 * **type**: pageload 37529 * **unit**: ms 37530 * **use live sites**: false 37531 * **Test Task**: 37532 37533 .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** 37534 :widths: 30 15 15 15 15 37535 :header-rows: 1 37536 37537 * - **Test Name** 37538 - mozilla-central 37539 - autoland 37540 - mozilla-release 37541 - mozilla-beta 37542 * - **browsertime-tp6m-live-chrome-m-facebook-nofis** 37543 - ❌ 37544 - ❌ 37545 - ❌ 37546 - ❌ 37547 * - **browsertime-tp6m-live-fenix-facebook** 37548 - ❌ 37549 - ❌ 37550 - ❌ 37551 - ❌ 37552 * - **browsertime-tp6m-live-fenix-facebook-nofis** 37553 - ❌ 37554 - ❌ 37555 - ❌ 37556 - ❌ 37557 * - **browsertime-tp6m-live-geckoview-facebook** 37558 - ❌ 37559 - ❌ 37560 - ❌ 37561 - ❌ 37562 * - **browsertime-tp6m-live-geckoview-facebook-nofis** 37563 - ❌ 37564 - ❌ 37565 - ❌ 37566 - ❌ 37567 37568 37569 .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** 37570 :widths: 30 15 15 15 15 37571 :header-rows: 1 37572 37573 * - **Test Name** 37574 - mozilla-central 37575 - autoland 37576 - mozilla-release 37577 - mozilla-beta 37578 * - **browsertime-tp6m-live-fenix-facebook** 37579 - ❌ 37580 - ❌ 37581 - ❌ 37582 - ❌ 37583 * - **browsertime-tp6m-live-fenix-facebook-nofis** 37584 - ❌ 37585 - ❌ 37586 - ❌ 37587 - ❌ 37588 * - **browsertime-tp6m-live-geckoview-facebook** 37589 - ❌ 37590 - ❌ 37591 - ❌ 37592 - ❌ 37593 * - **browsertime-tp6m-live-geckoview-facebook-nofis** 37594 - ❌ 37595 - ❌ 37596 - ❌ 37597 - ❌ 37598 37599 37600 37601 .. dropdown:: facebook-cristiano 37602 :class-container: anchor-id-facebook-cristiano-m 37603 37604 * Command to Run Locally 37605 37606 .. code-block:: 37607 37608 ./mach raptor -t facebook-cristiano 37609 37610 **Owner**: PerfTest Team 37611 37612 * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__, `largestContentfulPaint <raptor-metrics.html#largest-contentful-paint>`__ 37613 * **alert threshold**: 2.0 37614 * **apps**: geckoview, fenix, refbrow, chrome-m, cstm-car-m 37615 * **benchmark page**: true 37616 * **browser cycles**: 15 37617 * **expected**: pass 37618 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#70>`__ 37619 * **lower is better**: true 37620 * **page cycles**: 25 37621 * **page timeout**: 60000 37622 * **playback**: mitmproxy-android 37623 * **playback pageset manifest**: mitm6-android-fenix-facebook-cristiano.manifest 37624 * **playback version**: 8.1.1 37625 * **support class**: browsertime_pageload.py 37626 * **test url**: `<https://m.facebook.com/Cristiano>`__ 37627 * **type**: pageload 37628 * **unit**: ms 37629 * **use live sites**: false 37630 * **Test Task**: 37631 37632 .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** 37633 :widths: 30 15 15 15 15 37634 :header-rows: 1 37635 37636 * - **Test Name** 37637 - mozilla-central 37638 - autoland 37639 - mozilla-release 37640 - mozilla-beta 37641 * - **browsertime-tp6m-chrome-m-facebook-cristiano-nofis** 37642 - ❌ 37643 - ❌ 37644 - ❌ 37645 - ❌ 37646 * - **browsertime-tp6m-cstm-car-m-facebook-cristiano-nofis** 37647 - ❌ 37648 - ❌ 37649 - ❌ 37650 - ❌ 37651 * - **browsertime-tp6m-fenix-facebook-cristiano** 37652 - ✅ 37653 - ❌ 37654 - ❌ 37655 - ❌ 37656 * - **browsertime-tp6m-fenix-facebook-cristiano-nofis** 37657 - ✅ 37658 - ✅ 37659 - ❌ 37660 - ❌ 37661 * - **browsertime-tp6m-geckoview-facebook-cristiano** 37662 - ❌ 37663 - ❌ 37664 - ❌ 37665 - ❌ 37666 * - **browsertime-tp6m-geckoview-facebook-cristiano-nofis** 37667 - ❌ 37668 - ❌ 37669 - ❌ 37670 - ❌ 37671 * - **browsertime-tp6m-live-chrome-m-facebook-cristiano-nofis** 37672 - ❌ 37673 - ❌ 37674 - ❌ 37675 - ❌ 37676 * - **browsertime-tp6m-live-fenix-facebook-cristiano** 37677 - ❌ 37678 - ❌ 37679 - ❌ 37680 - ❌ 37681 * - **browsertime-tp6m-live-fenix-facebook-cristiano-nofis** 37682 - ❌ 37683 - ❌ 37684 - ❌ 37685 - ❌ 37686 * - **browsertime-tp6m-live-geckoview-facebook-cristiano** 37687 - ❌ 37688 - ❌ 37689 - ❌ 37690 - ❌ 37691 * - **browsertime-tp6m-live-geckoview-facebook-cristiano-nofis** 37692 - ❌ 37693 - ❌ 37694 - ❌ 37695 - ❌ 37696 * - **browsertime-tp6m-refbrow-facebook-cristiano** 37697 - ❌ 37698 - ❌ 37699 - ❌ 37700 - ❌ 37701 37702 37703 .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** 37704 :widths: 30 15 15 15 15 37705 :header-rows: 1 37706 37707 * - **Test Name** 37708 - mozilla-central 37709 - autoland 37710 - mozilla-release 37711 - mozilla-beta 37712 * - **browsertime-tp6m-fenix-facebook-cristiano** 37713 - ✅ 37714 - ❌ 37715 - ❌ 37716 - ❌ 37717 * - **browsertime-tp6m-fenix-facebook-cristiano-nofis** 37718 - ❌ 37719 - ❌ 37720 - ❌ 37721 - ❌ 37722 * - **browsertime-tp6m-geckoview-facebook-cristiano** 37723 - ❌ 37724 - ❌ 37725 - ❌ 37726 - ❌ 37727 * - **browsertime-tp6m-geckoview-facebook-cristiano-nofis** 37728 - ❌ 37729 - ❌ 37730 - ❌ 37731 - ❌ 37732 * - **browsertime-tp6m-live-fenix-facebook-cristiano** 37733 - ❌ 37734 - ❌ 37735 - ❌ 37736 - ❌ 37737 * - **browsertime-tp6m-live-fenix-facebook-cristiano-nofis** 37738 - ❌ 37739 - ❌ 37740 - ❌ 37741 - ❌ 37742 * - **browsertime-tp6m-live-geckoview-facebook-cristiano** 37743 - ❌ 37744 - ❌ 37745 - ❌ 37746 - ❌ 37747 * - **browsertime-tp6m-live-geckoview-facebook-cristiano-nofis** 37748 - ❌ 37749 - ❌ 37750 - ❌ 37751 - ❌ 37752 * - **browsertime-tp6m-refbrow-facebook-cristiano** 37753 - ❌ 37754 - ❌ 37755 - ❌ 37756 - ❌ 37757 37758 37759 37760 .. dropdown:: google 37761 :class-container: anchor-id-google-m 37762 37763 * Command to Run Locally 37764 37765 .. code-block:: 37766 37767 ./mach raptor -t google 37768 37769 **Owner**: PerfTest Team 37770 37771 * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__, `largestContentfulPaint <raptor-metrics.html#largest-contentful-paint>`__ 37772 * **alert threshold**: 2.0 37773 * **apps**: geckoview, fenix, refbrow, chrome-m, cstm-car-m 37774 * **benchmark page**: true 37775 * **browser cycles**: 15 37776 * **expected**: pass 37777 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#73>`__ 37778 * **login**: true 37779 * **lower is better**: true 37780 * **page cycles**: 25 37781 * **page timeout**: 60000 37782 * **playback**: mitmproxy-android 37783 * **playback pageset manifest**: mitm6-g5-fenix-google.manifest 37784 * **playback version**: 8.1.1 37785 * **support class**: browsertime_pageload.py 37786 * **test url**: `<https://www.google.com>`__ 37787 * **type**: pageload 37788 * **unit**: ms 37789 * **use live sites**: false 37790 * **Test Task**: 37791 37792 .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** 37793 :widths: 30 15 15 15 15 37794 :header-rows: 1 37795 37796 * - **Test Name** 37797 - mozilla-central 37798 - autoland 37799 - mozilla-release 37800 - mozilla-beta 37801 * - **browsertime-tp6m-essential-chrome-m-google-nofis** 37802 - ❌ 37803 - ❌ 37804 - ❌ 37805 - ❌ 37806 * - **browsertime-tp6m-essential-cstm-car-m-google-nofis** 37807 - ❌ 37808 - ❌ 37809 - ❌ 37810 - ❌ 37811 * - **browsertime-tp6m-essential-fenix-google** 37812 - ✅ 37813 - ✅ 37814 - ❌ 37815 - ❌ 37816 * - **browsertime-tp6m-essential-fenix-google-nofis** 37817 - ✅ 37818 - ✅ 37819 - ❌ 37820 - ❌ 37821 * - **browsertime-tp6m-essential-geckoview-google** 37822 - ❌ 37823 - ❌ 37824 - ❌ 37825 - ❌ 37826 * - **browsertime-tp6m-essential-geckoview-google-nofis** 37827 - ❌ 37828 - ❌ 37829 - ❌ 37830 - ❌ 37831 * - **browsertime-tp6m-essential-refbrow-google** 37832 - ❌ 37833 - ❌ 37834 - ❌ 37835 - ❌ 37836 * - **browsertime-tp6m-live-chrome-m-google-nofis** 37837 - ❌ 37838 - ❌ 37839 - ❌ 37840 - ❌ 37841 * - **browsertime-tp6m-live-fenix-google** 37842 - ❌ 37843 - ❌ 37844 - ❌ 37845 - ❌ 37846 * - **browsertime-tp6m-live-fenix-google-nofis** 37847 - ❌ 37848 - ❌ 37849 - ❌ 37850 - ❌ 37851 * - **browsertime-tp6m-live-geckoview-google** 37852 - ❌ 37853 - ❌ 37854 - ❌ 37855 - ❌ 37856 * - **browsertime-tp6m-live-geckoview-google-nofis** 37857 - ❌ 37858 - ❌ 37859 - ❌ 37860 - ❌ 37861 37862 37863 .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** 37864 :widths: 30 15 15 15 15 37865 :header-rows: 1 37866 37867 * - **Test Name** 37868 - mozilla-central 37869 - autoland 37870 - mozilla-release 37871 - mozilla-beta 37872 * - **browsertime-tp6m-essential-fenix-google** 37873 - ❌ 37874 - ❌ 37875 - ❌ 37876 - ❌ 37877 * - **browsertime-tp6m-essential-fenix-google-nofis** 37878 - ❌ 37879 - ❌ 37880 - ❌ 37881 - ❌ 37882 * - **browsertime-tp6m-essential-geckoview-google** 37883 - ❌ 37884 - ❌ 37885 - ❌ 37886 - ❌ 37887 * - **browsertime-tp6m-essential-geckoview-google-nofis** 37888 - ❌ 37889 - ❌ 37890 - ❌ 37891 - ❌ 37892 * - **browsertime-tp6m-essential-refbrow-google** 37893 - ❌ 37894 - ❌ 37895 - ❌ 37896 - ❌ 37897 * - **browsertime-tp6m-live-fenix-google** 37898 - ❌ 37899 - ❌ 37900 - ❌ 37901 - ❌ 37902 * - **browsertime-tp6m-live-fenix-google-nofis** 37903 - ❌ 37904 - ❌ 37905 - ❌ 37906 - ❌ 37907 * - **browsertime-tp6m-live-geckoview-google** 37908 - ❌ 37909 - ❌ 37910 - ❌ 37911 - ❌ 37912 * - **browsertime-tp6m-live-geckoview-google-nofis** 37913 - ❌ 37914 - ❌ 37915 - ❌ 37916 - ❌ 37917 37918 37919 37920 .. dropdown:: google-maps 37921 :class-container: anchor-id-google-maps-m 37922 37923 * Command to Run Locally 37924 37925 .. code-block:: 37926 37927 ./mach raptor -t google-maps 37928 37929 **Owner**: PerfTest Team 37930 37931 * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__, `largestContentfulPaint <raptor-metrics.html#largest-contentful-paint>`__ 37932 * **alert threshold**: 2.0 37933 * **apps**: geckoview, fenix, refbrow, chrome-m, cstm-car-m 37934 * **benchmark page**: true 37935 * **browser cycles**: 15 37936 * **expected**: pass 37937 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#78>`__ 37938 * **lower is better**: true 37939 * **page cycles**: 25 37940 * **page timeout**: 60000 37941 * **playback**: mitmproxy-android 37942 * **playback pageset manifest**: mitm6-android-fenix-google-maps.manifest 37943 * **playback version**: 8.1.1 37944 * **support class**: browsertime_pageload.py 37945 * **test url**: `<https://www.google.com/maps?force=pwa>`__ 37946 * **type**: pageload 37947 * **unit**: ms 37948 * **use live sites**: false 37949 * **Test Task**: 37950 37951 .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** 37952 :widths: 30 15 15 15 15 37953 :header-rows: 1 37954 37955 * - **Test Name** 37956 - mozilla-central 37957 - autoland 37958 - mozilla-release 37959 - mozilla-beta 37960 * - **browsertime-tp6m-chrome-m-google-maps-nofis** 37961 - ❌ 37962 - ❌ 37963 - ❌ 37964 - ❌ 37965 * - **browsertime-tp6m-cstm-car-m-google-maps-nofis** 37966 - ❌ 37967 - ❌ 37968 - ❌ 37969 - ❌ 37970 * - **browsertime-tp6m-fenix-google-maps** 37971 - ✅ 37972 - ❌ 37973 - ❌ 37974 - ❌ 37975 * - **browsertime-tp6m-fenix-google-maps-nofis** 37976 - ✅ 37977 - ✅ 37978 - ❌ 37979 - ❌ 37980 * - **browsertime-tp6m-geckoview-google-maps** 37981 - ❌ 37982 - ❌ 37983 - ❌ 37984 - ❌ 37985 * - **browsertime-tp6m-geckoview-google-maps-nofis** 37986 - ❌ 37987 - ❌ 37988 - ❌ 37989 - ❌ 37990 * - **browsertime-tp6m-live-chrome-m-google-maps-nofis** 37991 - ❌ 37992 - ❌ 37993 - ❌ 37994 - ❌ 37995 * - **browsertime-tp6m-live-fenix-google-maps** 37996 - ❌ 37997 - ❌ 37998 - ❌ 37999 - ❌ 38000 * - **browsertime-tp6m-live-fenix-google-maps-nofis** 38001 - ❌ 38002 - ❌ 38003 - ❌ 38004 - ❌ 38005 * - **browsertime-tp6m-live-geckoview-google-maps** 38006 - ❌ 38007 - ❌ 38008 - ❌ 38009 - ❌ 38010 * - **browsertime-tp6m-live-geckoview-google-maps-nofis** 38011 - ❌ 38012 - ❌ 38013 - ❌ 38014 - ❌ 38015 * - **browsertime-tp6m-refbrow-google-maps** 38016 - ❌ 38017 - ❌ 38018 - ❌ 38019 - ❌ 38020 38021 38022 .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** 38023 :widths: 30 15 15 15 15 38024 :header-rows: 1 38025 38026 * - **Test Name** 38027 - mozilla-central 38028 - autoland 38029 - mozilla-release 38030 - mozilla-beta 38031 * - **browsertime-tp6m-fenix-google-maps** 38032 - ✅ 38033 - ❌ 38034 - ❌ 38035 - ❌ 38036 * - **browsertime-tp6m-fenix-google-maps-nofis** 38037 - ❌ 38038 - ❌ 38039 - ❌ 38040 - ❌ 38041 * - **browsertime-tp6m-geckoview-google-maps** 38042 - ❌ 38043 - ❌ 38044 - ❌ 38045 - ❌ 38046 * - **browsertime-tp6m-geckoview-google-maps-nofis** 38047 - ❌ 38048 - ❌ 38049 - ❌ 38050 - ❌ 38051 * - **browsertime-tp6m-live-fenix-google-maps** 38052 - ❌ 38053 - ❌ 38054 - ❌ 38055 - ❌ 38056 * - **browsertime-tp6m-live-fenix-google-maps-nofis** 38057 - ❌ 38058 - ❌ 38059 - ❌ 38060 - ❌ 38061 * - **browsertime-tp6m-live-geckoview-google-maps** 38062 - ❌ 38063 - ❌ 38064 - ❌ 38065 - ❌ 38066 * - **browsertime-tp6m-live-geckoview-google-maps-nofis** 38067 - ❌ 38068 - ❌ 38069 - ❌ 38070 - ❌ 38071 * - **browsertime-tp6m-refbrow-google-maps** 38072 - ❌ 38073 - ❌ 38074 - ❌ 38075 - ❌ 38076 38077 38078 38079 .. dropdown:: google-search-restaurants 38080 :class-container: anchor-id-google-search-restaurants-m 38081 38082 * Command to Run Locally 38083 38084 .. code-block:: 38085 38086 ./mach raptor -t google-search-restaurants 38087 38088 **Owner**: PerfTest Team 38089 38090 * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__, `largestContentfulPaint <raptor-metrics.html#largest-contentful-paint>`__ 38091 * **alert threshold**: 2.0 38092 * **apps**: geckoview, fenix, refbrow, chrome-m, cstm-car-m 38093 * **benchmark page**: true 38094 * **browser cycles**: 15 38095 * **expected**: pass 38096 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#81>`__ 38097 * **login**: true 38098 * **lower is better**: true 38099 * **page cycles**: 25 38100 * **page timeout**: 60000 38101 * **playback**: mitmproxy-android 38102 * **playback pageset manifest**: mitm6-g5-fenix-google-search-restaurants.manifest 38103 * **playback version**: 8.1.1 38104 * **support class**: browsertime_pageload.py 38105 * **test url**: `<https://www.google.com/search?q=restaurants+near+me>`__ 38106 * **type**: pageload 38107 * **unit**: ms 38108 * **use live sites**: false 38109 * **Test Task**: 38110 38111 .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** 38112 :widths: 30 15 15 15 15 38113 :header-rows: 1 38114 38115 * - **Test Name** 38116 - mozilla-central 38117 - autoland 38118 - mozilla-release 38119 - mozilla-beta 38120 * - **browsertime-tp6m-chrome-m-google-search-restaurants-nofis** 38121 - ❌ 38122 - ❌ 38123 - ❌ 38124 - ❌ 38125 * - **browsertime-tp6m-cstm-car-m-google-search-restaurants-nofis** 38126 - ❌ 38127 - ❌ 38128 - ❌ 38129 - ❌ 38130 * - **browsertime-tp6m-fenix-google-search-restaurants** 38131 - ✅ 38132 - ❌ 38133 - ❌ 38134 - ❌ 38135 * - **browsertime-tp6m-fenix-google-search-restaurants-nofis** 38136 - ✅ 38137 - ✅ 38138 - ❌ 38139 - ❌ 38140 * - **browsertime-tp6m-geckoview-google-search-restaurants** 38141 - ❌ 38142 - ❌ 38143 - ❌ 38144 - ❌ 38145 * - **browsertime-tp6m-geckoview-google-search-restaurants-nofis** 38146 - ❌ 38147 - ❌ 38148 - ❌ 38149 - ❌ 38150 * - **browsertime-tp6m-live-chrome-m-google-search-restaurants-nofis** 38151 - ❌ 38152 - ❌ 38153 - ❌ 38154 - ❌ 38155 * - **browsertime-tp6m-live-fenix-google-search-restaurants** 38156 - ❌ 38157 - ❌ 38158 - ❌ 38159 - ❌ 38160 * - **browsertime-tp6m-live-fenix-google-search-restaurants-nofis** 38161 - ❌ 38162 - ❌ 38163 - ❌ 38164 - ❌ 38165 * - **browsertime-tp6m-live-geckoview-google-search-restaurants** 38166 - ❌ 38167 - ❌ 38168 - ❌ 38169 - ❌ 38170 * - **browsertime-tp6m-live-geckoview-google-search-restaurants-nofis** 38171 - ❌ 38172 - ❌ 38173 - ❌ 38174 - ❌ 38175 * - **browsertime-tp6m-refbrow-google-search-restaurants** 38176 - ❌ 38177 - ❌ 38178 - ❌ 38179 - ❌ 38180 38181 38182 .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** 38183 :widths: 30 15 15 15 15 38184 :header-rows: 1 38185 38186 * - **Test Name** 38187 - mozilla-central 38188 - autoland 38189 - mozilla-release 38190 - mozilla-beta 38191 * - **browsertime-tp6m-fenix-google-search-restaurants** 38192 - ✅ 38193 - ❌ 38194 - ❌ 38195 - ❌ 38196 * - **browsertime-tp6m-fenix-google-search-restaurants-nofis** 38197 - ❌ 38198 - ❌ 38199 - ❌ 38200 - ❌ 38201 * - **browsertime-tp6m-geckoview-google-search-restaurants** 38202 - ❌ 38203 - ❌ 38204 - ❌ 38205 - ❌ 38206 * - **browsertime-tp6m-geckoview-google-search-restaurants-nofis** 38207 - ❌ 38208 - ❌ 38209 - ❌ 38210 - ❌ 38211 * - **browsertime-tp6m-live-fenix-google-search-restaurants** 38212 - ❌ 38213 - ❌ 38214 - ❌ 38215 - ❌ 38216 * - **browsertime-tp6m-live-fenix-google-search-restaurants-nofis** 38217 - ❌ 38218 - ❌ 38219 - ❌ 38220 - ❌ 38221 * - **browsertime-tp6m-live-geckoview-google-search-restaurants** 38222 - ❌ 38223 - ❌ 38224 - ❌ 38225 - ❌ 38226 * - **browsertime-tp6m-live-geckoview-google-search-restaurants-nofis** 38227 - ❌ 38228 - ❌ 38229 - ❌ 38230 - ❌ 38231 * - **browsertime-tp6m-refbrow-google-search-restaurants** 38232 - ❌ 38233 - ❌ 38234 - ❌ 38235 - ❌ 38236 38237 38238 38239 .. dropdown:: imdb 38240 :class-container: anchor-id-imdb-m 38241 38242 * Command to Run Locally 38243 38244 .. code-block:: 38245 38246 ./mach raptor -t imdb 38247 38248 **Owner**: PerfTest Team 38249 38250 * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__, `largestContentfulPaint <raptor-metrics.html#largest-contentful-paint>`__ 38251 * **alert threshold**: 2.0 38252 * **apps**: geckoview, fenix, refbrow, chrome-m, cstm-car-m 38253 * **benchmark page**: true 38254 * **browser cycles**: 15 38255 * **expected**: pass 38256 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#86>`__ 38257 * **lower is better**: true 38258 * **page cycles**: 25 38259 * **page timeout**: 60000 38260 * **playback**: mitmproxy-android 38261 * **playback pageset manifest**: mitm6-android-fenix-imdb.manifest 38262 * **playback version**: 8.1.1 38263 * **support class**: browsertime_pageload.py 38264 * **test url**: `<https://m.imdb.com/>`__ 38265 * **type**: pageload 38266 * **unit**: ms 38267 * **use live sites**: false 38268 * **Test Task**: 38269 38270 .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** 38271 :widths: 30 15 15 15 15 38272 :header-rows: 1 38273 38274 * - **Test Name** 38275 - mozilla-central 38276 - autoland 38277 - mozilla-release 38278 - mozilla-beta 38279 * - **browsertime-tp6m-chrome-m-imdb-nofis** 38280 - ❌ 38281 - ❌ 38282 - ❌ 38283 - ❌ 38284 * - **browsertime-tp6m-cstm-car-m-imdb-nofis** 38285 - ❌ 38286 - ❌ 38287 - ❌ 38288 - ❌ 38289 * - **browsertime-tp6m-fenix-imdb** 38290 - ✅ 38291 - ❌ 38292 - ❌ 38293 - ❌ 38294 * - **browsertime-tp6m-fenix-imdb-nofis** 38295 - ✅ 38296 - ✅ 38297 - ❌ 38298 - ❌ 38299 * - **browsertime-tp6m-geckoview-imdb** 38300 - ❌ 38301 - ❌ 38302 - ❌ 38303 - ❌ 38304 * - **browsertime-tp6m-geckoview-imdb-nofis** 38305 - ❌ 38306 - ❌ 38307 - ❌ 38308 - ❌ 38309 * - **browsertime-tp6m-live-chrome-m-imdb-nofis** 38310 - ❌ 38311 - ❌ 38312 - ❌ 38313 - ❌ 38314 * - **browsertime-tp6m-live-fenix-imdb** 38315 - ❌ 38316 - ❌ 38317 - ❌ 38318 - ❌ 38319 * - **browsertime-tp6m-live-fenix-imdb-nofis** 38320 - ❌ 38321 - ❌ 38322 - ❌ 38323 - ❌ 38324 * - **browsertime-tp6m-live-geckoview-imdb** 38325 - ❌ 38326 - ❌ 38327 - ❌ 38328 - ❌ 38329 * - **browsertime-tp6m-live-geckoview-imdb-nofis** 38330 - ❌ 38331 - ❌ 38332 - ❌ 38333 - ❌ 38334 * - **browsertime-tp6m-refbrow-imdb** 38335 - ❌ 38336 - ❌ 38337 - ❌ 38338 - ❌ 38339 38340 38341 .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** 38342 :widths: 30 15 15 15 15 38343 :header-rows: 1 38344 38345 * - **Test Name** 38346 - mozilla-central 38347 - autoland 38348 - mozilla-release 38349 - mozilla-beta 38350 * - **browsertime-tp6m-fenix-imdb** 38351 - ✅ 38352 - ❌ 38353 - ❌ 38354 - ❌ 38355 * - **browsertime-tp6m-fenix-imdb-nofis** 38356 - ❌ 38357 - ❌ 38358 - ❌ 38359 - ❌ 38360 * - **browsertime-tp6m-geckoview-imdb** 38361 - ❌ 38362 - ❌ 38363 - ❌ 38364 - ❌ 38365 * - **browsertime-tp6m-geckoview-imdb-nofis** 38366 - ❌ 38367 - ❌ 38368 - ❌ 38369 - ❌ 38370 * - **browsertime-tp6m-live-fenix-imdb** 38371 - ❌ 38372 - ❌ 38373 - ❌ 38374 - ❌ 38375 * - **browsertime-tp6m-live-fenix-imdb-nofis** 38376 - ❌ 38377 - ❌ 38378 - ❌ 38379 - ❌ 38380 * - **browsertime-tp6m-live-geckoview-imdb** 38381 - ❌ 38382 - ❌ 38383 - ❌ 38384 - ❌ 38385 * - **browsertime-tp6m-live-geckoview-imdb-nofis** 38386 - ❌ 38387 - ❌ 38388 - ❌ 38389 - ❌ 38390 * - **browsertime-tp6m-refbrow-imdb** 38391 - ❌ 38392 - ❌ 38393 - ❌ 38394 - ❌ 38395 38396 38397 38398 .. dropdown:: instagram 38399 :class-container: anchor-id-instagram-m 38400 38401 * Command to Run Locally 38402 38403 .. code-block:: 38404 38405 ./mach raptor -t instagram 38406 38407 **Owner**: PerfTest Team 38408 38409 * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__, `largestContentfulPaint <raptor-metrics.html#largest-contentful-paint>`__ 38410 * **alert threshold**: 2.0 38411 * **apps**: geckoview, fenix, refbrow, chrome-m, cstm-car-m 38412 * **benchmark page**: true 38413 * **browser cycles**: 15 38414 * **expected**: pass 38415 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#89>`__ 38416 * **login**: true 38417 * **lower is better**: true 38418 * **page cycles**: 25 38419 * **page timeout**: 60000 38420 * **playback**: mitmproxy-android 38421 * **playback pageset manifest**: mitm8-android-gve-instagram.manifest 38422 * **playback version**: 11.0.0 38423 * **support class**: browsertime_pageload.py 38424 * **test url**: `<https://www.instagram.com>`__ 38425 * **type**: pageload 38426 * **unit**: ms 38427 * **use live sites**: false 38428 * **Test Task**: 38429 38430 .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** 38431 :widths: 30 15 15 15 15 38432 :header-rows: 1 38433 38434 * - **Test Name** 38435 - mozilla-central 38436 - autoland 38437 - mozilla-release 38438 - mozilla-beta 38439 * - **browsertime-tp6m-chrome-m-instagram-nofis** 38440 - ❌ 38441 - ❌ 38442 - ❌ 38443 - ❌ 38444 * - **browsertime-tp6m-cstm-car-m-instagram-nofis** 38445 - ❌ 38446 - ❌ 38447 - ❌ 38448 - ❌ 38449 * - **browsertime-tp6m-fenix-instagram** 38450 - ✅ 38451 - ❌ 38452 - ❌ 38453 - ❌ 38454 * - **browsertime-tp6m-fenix-instagram-nofis** 38455 - ✅ 38456 - ✅ 38457 - ❌ 38458 - ❌ 38459 * - **browsertime-tp6m-geckoview-instagram** 38460 - ❌ 38461 - ❌ 38462 - ❌ 38463 - ❌ 38464 * - **browsertime-tp6m-geckoview-instagram-nofis** 38465 - ❌ 38466 - ❌ 38467 - ❌ 38468 - ❌ 38469 * - **browsertime-tp6m-live-chrome-m-instagram-nofis** 38470 - ❌ 38471 - ❌ 38472 - ❌ 38473 - ❌ 38474 * - **browsertime-tp6m-live-fenix-instagram** 38475 - ❌ 38476 - ❌ 38477 - ❌ 38478 - ❌ 38479 * - **browsertime-tp6m-live-fenix-instagram-nofis** 38480 - ❌ 38481 - ❌ 38482 - ❌ 38483 - ❌ 38484 * - **browsertime-tp6m-live-geckoview-instagram** 38485 - ❌ 38486 - ❌ 38487 - ❌ 38488 - ❌ 38489 * - **browsertime-tp6m-live-geckoview-instagram-nofis** 38490 - ❌ 38491 - ❌ 38492 - ❌ 38493 - ❌ 38494 * - **browsertime-tp6m-refbrow-instagram** 38495 - ❌ 38496 - ❌ 38497 - ❌ 38498 - ❌ 38499 38500 38501 .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** 38502 :widths: 30 15 15 15 15 38503 :header-rows: 1 38504 38505 * - **Test Name** 38506 - mozilla-central 38507 - autoland 38508 - mozilla-release 38509 - mozilla-beta 38510 * - **browsertime-tp6m-fenix-instagram** 38511 - ✅ 38512 - ❌ 38513 - ❌ 38514 - ❌ 38515 * - **browsertime-tp6m-fenix-instagram-nofis** 38516 - ❌ 38517 - ❌ 38518 - ❌ 38519 - ❌ 38520 * - **browsertime-tp6m-geckoview-instagram** 38521 - ❌ 38522 - ❌ 38523 - ❌ 38524 - ❌ 38525 * - **browsertime-tp6m-geckoview-instagram-nofis** 38526 - ❌ 38527 - ❌ 38528 - ❌ 38529 - ❌ 38530 * - **browsertime-tp6m-live-fenix-instagram** 38531 - ❌ 38532 - ❌ 38533 - ❌ 38534 - ❌ 38535 * - **browsertime-tp6m-live-fenix-instagram-nofis** 38536 - ❌ 38537 - ❌ 38538 - ❌ 38539 - ❌ 38540 * - **browsertime-tp6m-live-geckoview-instagram** 38541 - ❌ 38542 - ❌ 38543 - ❌ 38544 - ❌ 38545 * - **browsertime-tp6m-live-geckoview-instagram-nofis** 38546 - ❌ 38547 - ❌ 38548 - ❌ 38549 - ❌ 38550 * - **browsertime-tp6m-refbrow-instagram** 38551 - ❌ 38552 - ❌ 38553 - ❌ 38554 - ❌ 38555 38556 38557 38558 .. dropdown:: microsoft-support 38559 :class-container: anchor-id-microsoft-support-m 38560 38561 * Command to Run Locally 38562 38563 .. code-block:: 38564 38565 ./mach raptor -t microsoft-support 38566 38567 **Owner**: PerfTest Team 38568 38569 * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__, `largestContentfulPaint <raptor-metrics.html#largest-contentful-paint>`__ 38570 * **alert threshold**: 2.0 38571 * **apps**: geckoview, fenix, refbrow, chrome-m, cstm-car-m 38572 * **benchmark page**: true 38573 * **browser cycles**: 15 38574 * **expected**: pass 38575 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#95>`__ 38576 * **lower is better**: true 38577 * **page cycles**: 25 38578 * **page timeout**: 60000 38579 * **playback**: mitmproxy-android 38580 * **playback pageset manifest**: mitm6-android-fenix-microsoft-support.manifest 38581 * **playback version**: 8.1.1 38582 * **support class**: browsertime_pageload.py 38583 * **test url**: `<https://support.microsoft.com/en-us>`__ 38584 * **type**: pageload 38585 * **unit**: ms 38586 * **use live sites**: false 38587 * **Test Task**: 38588 38589 .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** 38590 :widths: 30 15 15 15 15 38591 :header-rows: 1 38592 38593 * - **Test Name** 38594 - mozilla-central 38595 - autoland 38596 - mozilla-release 38597 - mozilla-beta 38598 * - **browsertime-tp6m-essential-chrome-m-microsoft-support-nofis** 38599 - ❌ 38600 - ❌ 38601 - ❌ 38602 - ❌ 38603 * - **browsertime-tp6m-essential-cstm-car-m-microsoft-support-nofis** 38604 - ❌ 38605 - ❌ 38606 - ❌ 38607 - ❌ 38608 * - **browsertime-tp6m-essential-fenix-microsoft-support** 38609 - ✅ 38610 - ✅ 38611 - ❌ 38612 - ❌ 38613 * - **browsertime-tp6m-essential-fenix-microsoft-support-nofis** 38614 - ✅ 38615 - ✅ 38616 - ❌ 38617 - ❌ 38618 * - **browsertime-tp6m-essential-geckoview-microsoft-support** 38619 - ❌ 38620 - ❌ 38621 - ❌ 38622 - ❌ 38623 * - **browsertime-tp6m-essential-geckoview-microsoft-support-nofis** 38624 - ❌ 38625 - ❌ 38626 - ❌ 38627 - ❌ 38628 * - **browsertime-tp6m-essential-refbrow-microsoft-support** 38629 - ❌ 38630 - ❌ 38631 - ❌ 38632 - ❌ 38633 * - **browsertime-tp6m-live-chrome-m-microsoft-support-nofis** 38634 - ❌ 38635 - ❌ 38636 - ❌ 38637 - ❌ 38638 * - **browsertime-tp6m-live-fenix-microsoft-support** 38639 - ❌ 38640 - ❌ 38641 - ❌ 38642 - ❌ 38643 * - **browsertime-tp6m-live-fenix-microsoft-support-nofis** 38644 - ❌ 38645 - ❌ 38646 - ❌ 38647 - ❌ 38648 * - **browsertime-tp6m-live-geckoview-microsoft-support** 38649 - ❌ 38650 - ❌ 38651 - ❌ 38652 - ❌ 38653 * - **browsertime-tp6m-live-geckoview-microsoft-support-nofis** 38654 - ❌ 38655 - ❌ 38656 - ❌ 38657 - ❌ 38658 38659 38660 .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** 38661 :widths: 30 15 15 15 15 38662 :header-rows: 1 38663 38664 * - **Test Name** 38665 - mozilla-central 38666 - autoland 38667 - mozilla-release 38668 - mozilla-beta 38669 * - **browsertime-tp6m-essential-fenix-microsoft-support** 38670 - ❌ 38671 - ❌ 38672 - ❌ 38673 - ❌ 38674 * - **browsertime-tp6m-essential-fenix-microsoft-support-nofis** 38675 - ❌ 38676 - ❌ 38677 - ❌ 38678 - ❌ 38679 * - **browsertime-tp6m-essential-geckoview-microsoft-support** 38680 - ❌ 38681 - ❌ 38682 - ❌ 38683 - ❌ 38684 * - **browsertime-tp6m-essential-geckoview-microsoft-support-nofis** 38685 - ❌ 38686 - ❌ 38687 - ❌ 38688 - ❌ 38689 * - **browsertime-tp6m-essential-refbrow-microsoft-support** 38690 - ❌ 38691 - ❌ 38692 - ❌ 38693 - ❌ 38694 * - **browsertime-tp6m-live-fenix-microsoft-support** 38695 - ❌ 38696 - ❌ 38697 - ❌ 38698 - ❌ 38699 * - **browsertime-tp6m-live-fenix-microsoft-support-nofis** 38700 - ❌ 38701 - ❌ 38702 - ❌ 38703 - ❌ 38704 * - **browsertime-tp6m-live-geckoview-microsoft-support** 38705 - ❌ 38706 - ❌ 38707 - ❌ 38708 - ❌ 38709 * - **browsertime-tp6m-live-geckoview-microsoft-support-nofis** 38710 - ❌ 38711 - ❌ 38712 - ❌ 38713 - ❌ 38714 38715 38716 38717 .. dropdown:: reddit 38718 :class-container: anchor-id-reddit-m 38719 38720 * Command to Run Locally 38721 38722 .. code-block:: 38723 38724 ./mach raptor -t reddit 38725 38726 **Owner**: PerfTest Team 38727 38728 * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__, `largestContentfulPaint <raptor-metrics.html#largest-contentful-paint>`__ 38729 * **alert threshold**: 2.0 38730 * **apps**: geckoview, fenix, refbrow, chrome-m, cstm-car-m 38731 * **benchmark page**: true 38732 * **browser cycles**: 15 38733 * **expected**: pass 38734 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#98>`__ 38735 * **lower is better**: true 38736 * **page cycles**: 25 38737 * **page timeout**: 60000 38738 * **playback**: mitmproxy-android 38739 * **playback pageset manifest**: mitm6-android-fenix-reddit.manifest 38740 * **playback version**: 8.1.1 38741 * **support class**: browsertime_pageload.py 38742 * **test url**: `<https://www.reddit.com>`__ 38743 * **type**: pageload 38744 * **unit**: ms 38745 * **use live sites**: false 38746 * **Test Task**: 38747 38748 .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** 38749 :widths: 30 15 15 15 15 38750 :header-rows: 1 38751 38752 * - **Test Name** 38753 - mozilla-central 38754 - autoland 38755 - mozilla-release 38756 - mozilla-beta 38757 * - **browsertime-tp6m-chrome-m-reddit-nofis** 38758 - ❌ 38759 - ❌ 38760 - ❌ 38761 - ❌ 38762 * - **browsertime-tp6m-cstm-car-m-reddit-nofis** 38763 - ❌ 38764 - ❌ 38765 - ❌ 38766 - ❌ 38767 * - **browsertime-tp6m-fenix-reddit** 38768 - ✅ 38769 - ❌ 38770 - ❌ 38771 - ❌ 38772 * - **browsertime-tp6m-fenix-reddit-nofis** 38773 - ✅ 38774 - ✅ 38775 - ❌ 38776 - ❌ 38777 * - **browsertime-tp6m-geckoview-reddit** 38778 - ❌ 38779 - ❌ 38780 - ❌ 38781 - ❌ 38782 * - **browsertime-tp6m-geckoview-reddit-nofis** 38783 - ❌ 38784 - ❌ 38785 - ❌ 38786 - ❌ 38787 * - **browsertime-tp6m-live-chrome-m-reddit-nofis** 38788 - ❌ 38789 - ❌ 38790 - ❌ 38791 - ❌ 38792 * - **browsertime-tp6m-live-fenix-reddit** 38793 - ❌ 38794 - ❌ 38795 - ❌ 38796 - ❌ 38797 * - **browsertime-tp6m-live-fenix-reddit-nofis** 38798 - ❌ 38799 - ❌ 38800 - ❌ 38801 - ❌ 38802 * - **browsertime-tp6m-live-geckoview-reddit** 38803 - ❌ 38804 - ❌ 38805 - ❌ 38806 - ❌ 38807 * - **browsertime-tp6m-live-geckoview-reddit-nofis** 38808 - ❌ 38809 - ❌ 38810 - ❌ 38811 - ❌ 38812 * - **browsertime-tp6m-refbrow-reddit** 38813 - ❌ 38814 - ❌ 38815 - ❌ 38816 - ❌ 38817 38818 38819 .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** 38820 :widths: 30 15 15 15 15 38821 :header-rows: 1 38822 38823 * - **Test Name** 38824 - mozilla-central 38825 - autoland 38826 - mozilla-release 38827 - mozilla-beta 38828 * - **browsertime-tp6m-fenix-reddit** 38829 - ✅ 38830 - ❌ 38831 - ❌ 38832 - ❌ 38833 * - **browsertime-tp6m-fenix-reddit-nofis** 38834 - ❌ 38835 - ❌ 38836 - ❌ 38837 - ❌ 38838 * - **browsertime-tp6m-geckoview-reddit** 38839 - ❌ 38840 - ❌ 38841 - ❌ 38842 - ❌ 38843 * - **browsertime-tp6m-geckoview-reddit-nofis** 38844 - ❌ 38845 - ❌ 38846 - ❌ 38847 - ❌ 38848 * - **browsertime-tp6m-live-fenix-reddit** 38849 - ❌ 38850 - ❌ 38851 - ❌ 38852 - ❌ 38853 * - **browsertime-tp6m-live-fenix-reddit-nofis** 38854 - ❌ 38855 - ❌ 38856 - ❌ 38857 - ❌ 38858 * - **browsertime-tp6m-live-geckoview-reddit** 38859 - ❌ 38860 - ❌ 38861 - ❌ 38862 - ❌ 38863 * - **browsertime-tp6m-live-geckoview-reddit-nofis** 38864 - ❌ 38865 - ❌ 38866 - ❌ 38867 - ❌ 38868 * - **browsertime-tp6m-refbrow-reddit** 38869 - ❌ 38870 - ❌ 38871 - ❌ 38872 - ❌ 38873 38874 38875 38876 .. dropdown:: sina 38877 :class-container: anchor-id-sina-m 38878 38879 * Command to Run Locally 38880 38881 .. code-block:: 38882 38883 ./mach raptor -t sina 38884 38885 **Owner**: PerfTest Team 38886 38887 * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__, `largestContentfulPaint <raptor-metrics.html#largest-contentful-paint>`__ 38888 * **alert threshold**: 2.0 38889 * **apps**: geckoview, fenix, refbrow, chrome-m, cstm-car-m 38890 * **benchmark page**: true 38891 * **browser cycles**: 15 38892 * **expected**: pass 38893 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#101>`__ 38894 * **lower is better**: true 38895 * **page cycles**: 25 38896 * **page timeout**: 60000 38897 * **playback**: mitmproxy-android 38898 * **playback pageset manifest**: mitm8-android-fenix-sina.manifest 38899 * **playback version**: 11.0.0 38900 * **support class**: browsertime_pageload.py 38901 * **test url**: `<https://www.sina.com.cn/>`__ 38902 * **type**: pageload 38903 * **unit**: ms 38904 * **use live sites**: false 38905 * **Test Task**: 38906 38907 .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** 38908 :widths: 30 15 15 15 15 38909 :header-rows: 1 38910 38911 * - **Test Name** 38912 - mozilla-central 38913 - autoland 38914 - mozilla-release 38915 - mozilla-beta 38916 * - **browsertime-tp6m-chrome-m-sina-nofis** 38917 - ❌ 38918 - ❌ 38919 - ❌ 38920 - ❌ 38921 * - **browsertime-tp6m-cstm-car-m-sina-nofis** 38922 - ❌ 38923 - ❌ 38924 - ❌ 38925 - ❌ 38926 * - **browsertime-tp6m-fenix-sina** 38927 - ✅ 38928 - ❌ 38929 - ❌ 38930 - ❌ 38931 * - **browsertime-tp6m-fenix-sina-nofis** 38932 - ✅ 38933 - ✅ 38934 - ❌ 38935 - ❌ 38936 * - **browsertime-tp6m-geckoview-sina** 38937 - ❌ 38938 - ❌ 38939 - ❌ 38940 - ❌ 38941 * - **browsertime-tp6m-geckoview-sina-nofis** 38942 - ❌ 38943 - ❌ 38944 - ❌ 38945 - ❌ 38946 * - **browsertime-tp6m-refbrow-sina** 38947 - ❌ 38948 - ❌ 38949 - ❌ 38950 - ❌ 38951 38952 38953 .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** 38954 :widths: 30 15 15 15 15 38955 :header-rows: 1 38956 38957 * - **Test Name** 38958 - mozilla-central 38959 - autoland 38960 - mozilla-release 38961 - mozilla-beta 38962 * - **browsertime-tp6m-fenix-sina** 38963 - ✅ 38964 - ❌ 38965 - ❌ 38966 - ❌ 38967 * - **browsertime-tp6m-fenix-sina-nofis** 38968 - ❌ 38969 - ❌ 38970 - ❌ 38971 - ❌ 38972 * - **browsertime-tp6m-geckoview-sina** 38973 - ❌ 38974 - ❌ 38975 - ❌ 38976 - ❌ 38977 * - **browsertime-tp6m-geckoview-sina-nofis** 38978 - ❌ 38979 - ❌ 38980 - ❌ 38981 - ❌ 38982 * - **browsertime-tp6m-refbrow-sina** 38983 - ❌ 38984 - ❌ 38985 - ❌ 38986 - ❌ 38987 38988 38989 38990 .. dropdown:: stackoverflow 38991 :class-container: anchor-id-stackoverflow-m 38992 38993 * Command to Run Locally 38994 38995 .. code-block:: 38996 38997 ./mach raptor -t stackoverflow 38998 38999 **Owner**: PerfTest Team 39000 39001 * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__, `largestContentfulPaint <raptor-metrics.html#largest-contentful-paint>`__ 39002 * **alert threshold**: 2.0 39003 * **apps**: geckoview, fenix, refbrow, chrome-m, cstm-car-m 39004 * **benchmark page**: true 39005 * **browser cycles**: 15 39006 * **expected**: pass 39007 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#106>`__ 39008 * **lower is better**: true 39009 * **page cycles**: 25 39010 * **page timeout**: 60000 39011 * **playback**: mitmproxy-android 39012 * **playback pageset manifest**: mitm6-android-fenix-stackoverflow.manifest 39013 * **playback version**: 8.1.1 39014 * **support class**: browsertime_pageload.py 39015 * **test url**: `<https://stackoverflow.com/>`__ 39016 * **type**: pageload 39017 * **unit**: ms 39018 * **use live sites**: false 39019 * **Test Task**: 39020 39021 .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** 39022 :widths: 30 15 15 15 15 39023 :header-rows: 1 39024 39025 * - **Test Name** 39026 - mozilla-central 39027 - autoland 39028 - mozilla-release 39029 - mozilla-beta 39030 * - **browsertime-tp6m-chrome-m-stackoverflow-nofis** 39031 - ❌ 39032 - ❌ 39033 - ❌ 39034 - ❌ 39035 * - **browsertime-tp6m-cstm-car-m-stackoverflow-nofis** 39036 - ❌ 39037 - ❌ 39038 - ❌ 39039 - ❌ 39040 * - **browsertime-tp6m-fenix-stackoverflow** 39041 - ✅ 39042 - ❌ 39043 - ❌ 39044 - ❌ 39045 * - **browsertime-tp6m-fenix-stackoverflow-nofis** 39046 - ✅ 39047 - ✅ 39048 - ❌ 39049 - ❌ 39050 * - **browsertime-tp6m-geckoview-stackoverflow** 39051 - ❌ 39052 - ❌ 39053 - ❌ 39054 - ❌ 39055 * - **browsertime-tp6m-geckoview-stackoverflow-nofis** 39056 - ❌ 39057 - ❌ 39058 - ❌ 39059 - ❌ 39060 * - **browsertime-tp6m-live-chrome-m-stackoverflow-nofis** 39061 - ❌ 39062 - ❌ 39063 - ❌ 39064 - ❌ 39065 * - **browsertime-tp6m-live-fenix-stackoverflow** 39066 - ❌ 39067 - ❌ 39068 - ❌ 39069 - ❌ 39070 * - **browsertime-tp6m-live-fenix-stackoverflow-nofis** 39071 - ❌ 39072 - ❌ 39073 - ❌ 39074 - ❌ 39075 * - **browsertime-tp6m-live-geckoview-stackoverflow** 39076 - ❌ 39077 - ❌ 39078 - ❌ 39079 - ❌ 39080 * - **browsertime-tp6m-live-geckoview-stackoverflow-nofis** 39081 - ❌ 39082 - ❌ 39083 - ❌ 39084 - ❌ 39085 * - **browsertime-tp6m-refbrow-stackoverflow** 39086 - ❌ 39087 - ❌ 39088 - ❌ 39089 - ❌ 39090 39091 39092 .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** 39093 :widths: 30 15 15 15 15 39094 :header-rows: 1 39095 39096 * - **Test Name** 39097 - mozilla-central 39098 - autoland 39099 - mozilla-release 39100 - mozilla-beta 39101 * - **browsertime-tp6m-fenix-stackoverflow** 39102 - ✅ 39103 - ❌ 39104 - ❌ 39105 - ❌ 39106 * - **browsertime-tp6m-fenix-stackoverflow-nofis** 39107 - ❌ 39108 - ❌ 39109 - ❌ 39110 - ❌ 39111 * - **browsertime-tp6m-geckoview-stackoverflow** 39112 - ❌ 39113 - ❌ 39114 - ❌ 39115 - ❌ 39116 * - **browsertime-tp6m-geckoview-stackoverflow-nofis** 39117 - ❌ 39118 - ❌ 39119 - ❌ 39120 - ❌ 39121 * - **browsertime-tp6m-live-fenix-stackoverflow** 39122 - ❌ 39123 - ❌ 39124 - ❌ 39125 - ❌ 39126 * - **browsertime-tp6m-live-fenix-stackoverflow-nofis** 39127 - ❌ 39128 - ❌ 39129 - ❌ 39130 - ❌ 39131 * - **browsertime-tp6m-live-geckoview-stackoverflow** 39132 - ❌ 39133 - ❌ 39134 - ❌ 39135 - ❌ 39136 * - **browsertime-tp6m-live-geckoview-stackoverflow-nofis** 39137 - ❌ 39138 - ❌ 39139 - ❌ 39140 - ❌ 39141 * - **browsertime-tp6m-refbrow-stackoverflow** 39142 - ❌ 39143 - ❌ 39144 - ❌ 39145 - ❌ 39146 39147 39148 39149 .. dropdown:: wikipedia 39150 :class-container: anchor-id-wikipedia-m 39151 39152 * Command to Run Locally 39153 39154 .. code-block:: 39155 39156 ./mach raptor -t wikipedia 39157 39158 **Owner**: PerfTest Team 39159 39160 * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__, `largestContentfulPaint <raptor-metrics.html#largest-contentful-paint>`__ 39161 * **alert threshold**: 2.0 39162 * **apps**: geckoview, fenix, refbrow, chrome-m, cstm-car-m 39163 * **benchmark page**: true 39164 * **browser cycles**: 15 39165 * **expected**: pass 39166 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#109>`__ 39167 * **lower is better**: true 39168 * **page cycles**: 25 39169 * **page timeout**: 60000 39170 * **playback**: mitmproxy-android 39171 * **playback pageset manifest**: mitm6-android-fenix-wikipedia.manifest 39172 * **playback version**: 8.1.1 39173 * **support class**: browsertime_pageload.py 39174 * **test url**: `<https://en.m.wikipedia.org/wiki/Main_Page>`__ 39175 * **type**: pageload 39176 * **unit**: ms 39177 * **use live sites**: false 39178 * **Test Task**: 39179 39180 .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** 39181 :widths: 30 15 15 15 15 39182 :header-rows: 1 39183 39184 * - **Test Name** 39185 - mozilla-central 39186 - autoland 39187 - mozilla-release 39188 - mozilla-beta 39189 * - **browsertime-tp6m-chrome-m-wikipedia-nofis** 39190 - ❌ 39191 - ❌ 39192 - ❌ 39193 - ❌ 39194 * - **browsertime-tp6m-cstm-car-m-wikipedia-nofis** 39195 - ❌ 39196 - ❌ 39197 - ❌ 39198 - ❌ 39199 * - **browsertime-tp6m-fenix-wikipedia** 39200 - ✅ 39201 - ❌ 39202 - ❌ 39203 - ❌ 39204 * - **browsertime-tp6m-fenix-wikipedia-nofis** 39205 - ✅ 39206 - ✅ 39207 - ❌ 39208 - ❌ 39209 * - **browsertime-tp6m-geckoview-wikipedia** 39210 - ❌ 39211 - ❌ 39212 - ❌ 39213 - ❌ 39214 * - **browsertime-tp6m-geckoview-wikipedia-nofis** 39215 - ❌ 39216 - ❌ 39217 - ❌ 39218 - ❌ 39219 * - **browsertime-tp6m-live-chrome-m-wikipedia-nofis** 39220 - ❌ 39221 - ❌ 39222 - ❌ 39223 - ❌ 39224 * - **browsertime-tp6m-live-fenix-wikipedia** 39225 - ❌ 39226 - ❌ 39227 - ❌ 39228 - ❌ 39229 * - **browsertime-tp6m-live-fenix-wikipedia-nofis** 39230 - ❌ 39231 - ❌ 39232 - ❌ 39233 - ❌ 39234 * - **browsertime-tp6m-live-geckoview-wikipedia** 39235 - ❌ 39236 - ❌ 39237 - ❌ 39238 - ❌ 39239 * - **browsertime-tp6m-live-geckoview-wikipedia-nofis** 39240 - ❌ 39241 - ❌ 39242 - ❌ 39243 - ❌ 39244 * - **browsertime-tp6m-refbrow-wikipedia** 39245 - ❌ 39246 - ❌ 39247 - ❌ 39248 - ❌ 39249 39250 39251 .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** 39252 :widths: 30 15 15 15 15 39253 :header-rows: 1 39254 39255 * - **Test Name** 39256 - mozilla-central 39257 - autoland 39258 - mozilla-release 39259 - mozilla-beta 39260 * - **browsertime-tp6m-fenix-wikipedia** 39261 - ✅ 39262 - ❌ 39263 - ❌ 39264 - ❌ 39265 * - **browsertime-tp6m-fenix-wikipedia-nofis** 39266 - ❌ 39267 - ❌ 39268 - ❌ 39269 - ❌ 39270 * - **browsertime-tp6m-geckoview-wikipedia** 39271 - ❌ 39272 - ❌ 39273 - ❌ 39274 - ❌ 39275 * - **browsertime-tp6m-geckoview-wikipedia-nofis** 39276 - ❌ 39277 - ❌ 39278 - ❌ 39279 - ❌ 39280 * - **browsertime-tp6m-live-fenix-wikipedia** 39281 - ❌ 39282 - ❌ 39283 - ❌ 39284 - ❌ 39285 * - **browsertime-tp6m-live-fenix-wikipedia-nofis** 39286 - ❌ 39287 - ❌ 39288 - ❌ 39289 - ❌ 39290 * - **browsertime-tp6m-live-geckoview-wikipedia** 39291 - ❌ 39292 - ❌ 39293 - ❌ 39294 - ❌ 39295 * - **browsertime-tp6m-live-geckoview-wikipedia-nofis** 39296 - ❌ 39297 - ❌ 39298 - ❌ 39299 - ❌ 39300 * - **browsertime-tp6m-refbrow-wikipedia** 39301 - ❌ 39302 - ❌ 39303 - ❌ 39304 - ❌ 39305 39306 39307 39308 .. dropdown:: youtube 39309 :class-container: anchor-id-youtube-m 39310 39311 * Command to Run Locally 39312 39313 .. code-block:: 39314 39315 ./mach raptor -t youtube 39316 39317 **Owner**: PerfTest Team 39318 39319 * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__, `largestContentfulPaint <raptor-metrics.html#largest-contentful-paint>`__ 39320 * **alert threshold**: 2.0 39321 * **apps**: geckoview, fenix, refbrow, chrome-m, cstm-car-m 39322 * **benchmark page**: true 39323 * **browser cycles**: 15 39324 * **expected**: pass 39325 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#112>`__ 39326 * **lower is better**: true 39327 * **page cycles**: 25 39328 * **page timeout**: 60000 39329 * **playback**: mitmproxy-android 39330 * **playback pageset manifest**: mitm6-android-fenix-youtube.manifest 39331 * **playback version**: 8.1.1 39332 * **support class**: browsertime_pageload.py 39333 * **test url**: `<https://m.youtube.com>`__ 39334 * **type**: pageload 39335 * **unit**: ms 39336 * **use live sites**: false 39337 * **Test Task**: 39338 39339 .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** 39340 :widths: 30 15 15 15 15 39341 :header-rows: 1 39342 39343 * - **Test Name** 39344 - mozilla-central 39345 - autoland 39346 - mozilla-release 39347 - mozilla-beta 39348 * - **browsertime-tp6m-chrome-m-youtube-nofis** 39349 - ❌ 39350 - ❌ 39351 - ❌ 39352 - ❌ 39353 * - **browsertime-tp6m-cstm-car-m-youtube-nofis** 39354 - ❌ 39355 - ❌ 39356 - ❌ 39357 - ❌ 39358 * - **browsertime-tp6m-fenix-youtube** 39359 - ✅ 39360 - ❌ 39361 - ❌ 39362 - ❌ 39363 * - **browsertime-tp6m-fenix-youtube-nofis** 39364 - ✅ 39365 - ✅ 39366 - ❌ 39367 - ❌ 39368 * - **browsertime-tp6m-geckoview-youtube** 39369 - ❌ 39370 - ❌ 39371 - ❌ 39372 - ❌ 39373 * - **browsertime-tp6m-geckoview-youtube-nofis** 39374 - ❌ 39375 - ❌ 39376 - ❌ 39377 - ❌ 39378 * - **browsertime-tp6m-live-chrome-m-youtube-nofis** 39379 - ❌ 39380 - ❌ 39381 - ❌ 39382 - ❌ 39383 * - **browsertime-tp6m-live-fenix-youtube** 39384 - ❌ 39385 - ❌ 39386 - ❌ 39387 - ❌ 39388 * - **browsertime-tp6m-live-fenix-youtube-nofis** 39389 - ❌ 39390 - ❌ 39391 - ❌ 39392 - ❌ 39393 * - **browsertime-tp6m-live-geckoview-youtube** 39394 - ❌ 39395 - ❌ 39396 - ❌ 39397 - ❌ 39398 * - **browsertime-tp6m-live-geckoview-youtube-nofis** 39399 - ❌ 39400 - ❌ 39401 - ❌ 39402 - ❌ 39403 * - **browsertime-tp6m-refbrow-youtube** 39404 - ❌ 39405 - ❌ 39406 - ❌ 39407 - ❌ 39408 39409 39410 .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** 39411 :widths: 30 15 15 15 15 39412 :header-rows: 1 39413 39414 * - **Test Name** 39415 - mozilla-central 39416 - autoland 39417 - mozilla-release 39418 - mozilla-beta 39419 * - **browsertime-tp6m-fenix-youtube** 39420 - ✅ 39421 - ❌ 39422 - ❌ 39423 - ❌ 39424 * - **browsertime-tp6m-fenix-youtube-nofis** 39425 - ❌ 39426 - ❌ 39427 - ❌ 39428 - ❌ 39429 * - **browsertime-tp6m-geckoview-youtube** 39430 - ❌ 39431 - ❌ 39432 - ❌ 39433 - ❌ 39434 * - **browsertime-tp6m-geckoview-youtube-nofis** 39435 - ❌ 39436 - ❌ 39437 - ❌ 39438 - ❌ 39439 * - **browsertime-tp6m-live-fenix-youtube** 39440 - ❌ 39441 - ❌ 39442 - ❌ 39443 - ❌ 39444 * - **browsertime-tp6m-live-fenix-youtube-nofis** 39445 - ❌ 39446 - ❌ 39447 - ❌ 39448 - ❌ 39449 * - **browsertime-tp6m-live-geckoview-youtube** 39450 - ❌ 39451 - ❌ 39452 - ❌ 39453 - ❌ 39454 * - **browsertime-tp6m-live-geckoview-youtube-nofis** 39455 - ❌ 39456 - ❌ 39457 - ❌ 39458 - ❌ 39459 * - **browsertime-tp6m-refbrow-youtube** 39460 - ❌ 39461 - ❌ 39462 - ❌ 39463 - ❌ 39464 39465 39466 39467 .. dropdown:: youtube-watch 39468 :class-container: anchor-id-youtube-watch-m 39469 39470 * Command to Run Locally 39471 39472 .. code-block:: 39473 39474 ./mach raptor -t youtube-watch 39475 39476 **Owner**: PerfTest Team 39477 39478 * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__, `ContentfulSpeedIndex <raptor-metrics.html#contentful-speed-index>`__, `PerceptualSpeedIndex <raptor-metrics.html#perceptual-speed-index>`__, `SpeedIndex <raptor-metrics.html#speed-index>`__, `FirstVisualChange <raptor-metrics.html#first-visual-change>`__, `LastVisualChange <raptor-metrics.html#last-visual-change>`__, `largestContentfulPaint <raptor-metrics.html#largest-contentful-paint>`__ 39479 * **alert threshold**: 2.0 39480 * **apps**: geckoview, fenix, refbrow, chrome-m, cstm-car-m 39481 * **benchmark page**: true 39482 * **browser cycles**: 15 39483 * **expected**: pass 39484 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/tp6/mobile/browsertime-tp6m.toml#115>`__ 39485 * **lower is better**: true 39486 * **page cycles**: 25 39487 * **page timeout**: 60000 39488 * **playback**: mitmproxy-android 39489 * **playback pageset manifest**: mitm6-android-fenix-youtube-watch.manifest 39490 * **playback version**: 8.1.1 39491 * **support class**: browsertime_pageload.py 39492 * **test url**: `<https://www.youtube.com/watch?v=COU5T-Wafa4>`__ 39493 * **type**: pageload 39494 * **unit**: ms 39495 * **use live sites**: false 39496 * **Test Task**: 39497 39498 .. list-table:: **test-android-hw-a55-14-0-aarch64-shippable/opt** 39499 :widths: 30 15 15 15 15 39500 :header-rows: 1 39501 39502 * - **Test Name** 39503 - mozilla-central 39504 - autoland 39505 - mozilla-release 39506 - mozilla-beta 39507 * - **browsertime-tp6m-essential-chrome-m-youtube-watch-nofis** 39508 - ❌ 39509 - ❌ 39510 - ❌ 39511 - ❌ 39512 * - **browsertime-tp6m-essential-cstm-car-m-youtube-watch-nofis** 39513 - ❌ 39514 - ❌ 39515 - ❌ 39516 - ❌ 39517 * - **browsertime-tp6m-essential-fenix-youtube-watch** 39518 - ✅ 39519 - ✅ 39520 - ❌ 39521 - ❌ 39522 * - **browsertime-tp6m-essential-fenix-youtube-watch-nofis** 39523 - ✅ 39524 - ✅ 39525 - ❌ 39526 - ❌ 39527 * - **browsertime-tp6m-essential-geckoview-youtube-watch** 39528 - ❌ 39529 - ❌ 39530 - ❌ 39531 - ❌ 39532 * - **browsertime-tp6m-essential-geckoview-youtube-watch-nofis** 39533 - ❌ 39534 - ❌ 39535 - ❌ 39536 - ❌ 39537 * - **browsertime-tp6m-essential-refbrow-youtube-watch** 39538 - ❌ 39539 - ❌ 39540 - ❌ 39541 - ❌ 39542 * - **browsertime-tp6m-live-chrome-m-youtube-watch-nofis** 39543 - ❌ 39544 - ❌ 39545 - ❌ 39546 - ❌ 39547 * - **browsertime-tp6m-live-fenix-youtube-watch** 39548 - ❌ 39549 - ❌ 39550 - ❌ 39551 - ❌ 39552 * - **browsertime-tp6m-live-fenix-youtube-watch-nofis** 39553 - ❌ 39554 - ❌ 39555 - ❌ 39556 - ❌ 39557 * - **browsertime-tp6m-live-geckoview-youtube-watch** 39558 - ❌ 39559 - ❌ 39560 - ❌ 39561 - ❌ 39562 * - **browsertime-tp6m-live-geckoview-youtube-watch-nofis** 39563 - ❌ 39564 - ❌ 39565 - ❌ 39566 - ❌ 39567 39568 39569 .. list-table:: **test-android-hw-a55-14-0-aarch64/opt** 39570 :widths: 30 15 15 15 15 39571 :header-rows: 1 39572 39573 * - **Test Name** 39574 - mozilla-central 39575 - autoland 39576 - mozilla-release 39577 - mozilla-beta 39578 * - **browsertime-tp6m-essential-fenix-youtube-watch** 39579 - ❌ 39580 - ❌ 39581 - ❌ 39582 - ❌ 39583 * - **browsertime-tp6m-essential-fenix-youtube-watch-nofis** 39584 - ❌ 39585 - ❌ 39586 - ❌ 39587 - ❌ 39588 * - **browsertime-tp6m-essential-geckoview-youtube-watch** 39589 - ❌ 39590 - ❌ 39591 - ❌ 39592 - ❌ 39593 * - **browsertime-tp6m-essential-geckoview-youtube-watch-nofis** 39594 - ❌ 39595 - ❌ 39596 - ❌ 39597 - ❌ 39598 * - **browsertime-tp6m-essential-refbrow-youtube-watch** 39599 - ❌ 39600 - ❌ 39601 - ❌ 39602 - ❌ 39603 * - **browsertime-tp6m-live-fenix-youtube-watch** 39604 - ❌ 39605 - ❌ 39606 - ❌ 39607 - ❌ 39608 * - **browsertime-tp6m-live-fenix-youtube-watch-nofis** 39609 - ❌ 39610 - ❌ 39611 - ❌ 39612 - ❌ 39613 * - **browsertime-tp6m-live-geckoview-youtube-watch** 39614 - ❌ 39615 - ❌ 39616 - ❌ 39617 - ❌ 39618 * - **browsertime-tp6m-live-geckoview-youtube-watch-nofis** 39619 - ❌ 39620 - ❌ 39621 - ❌ 39622 - ❌ 39623 39624 39625 39626 39627 Scenario 39628 -------- 39629 Tests that perform a specific action (a scenario), i.e. idle application, idle application in background, etc. 39630 39631 .. dropdown:: idle 39632 :class-container: anchor-id-idle-s 39633 39634 * Command to Run Locally 39635 39636 .. code-block:: 39637 39638 ./mach raptor -t idle 39639 39640 **Owner**: PerfTest Team 39641 39642 * **alert threshold**: 2.0 39643 * **apps**: fenix, geckoview, refbrow 39644 * **expected**: pass 39645 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/scenario/idle.toml#15>`__ 39646 * **lower is better**: true 39647 * **measure**: fakeMeasure 39648 * **page cycles**: 1 39649 * **page timeout**: 1320000 39650 * **scenario time**: 1200000 39651 * **support class**: browsertime_pageload.py 39652 * **test url**: `<about:blank>`__ 39653 * **type**: scenario 39654 * **unit**: scenarioComplete 39655 39656 .. dropdown:: idle-bg 39657 :class-container: anchor-id-idle-bg-s 39658 39659 * Command to Run Locally 39660 39661 .. code-block:: 39662 39663 ./mach raptor -t idle-bg 39664 39665 **Owner**: PerfTest Team 39666 39667 * **alert threshold**: 2.0 39668 * **apps**: fenix, geckoview, refbrow 39669 * **browsertime args**: --browsertime.scenario_time=60000 --browsertime.background_app=false 39670 * **expected**: pass 39671 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/scenario/idle.toml#17>`__ 39672 * **lower is better**: true 39673 * **measure**: fakeMeasure 39674 * **page cycles**: 1 39675 * **page timeout**: 1320000 39676 * **scenario time**: 1200000 39677 * **support class**: browsertime_pageload.py 39678 * **test url**: `<about:blank>`__ 39679 * **type**: scenario 39680 * **unit**: scenarioComplete 39681 39682 39683 Unittests 39684 --------- 39685 These tests aren't used in standard testing, they are only used in the Raptor unit tests (they are similar to raptor-tp6 tests). 39686 39687 .. dropdown:: test-page-1 39688 :class-container: anchor-id-test-page-1-u 39689 39690 * Command to Run Locally 39691 39692 .. code-block:: 39693 39694 ./mach raptor -t test-page-1 39695 39696 **Owner**: PerfTest Team 39697 39698 * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__ 39699 * **alert threshold**: 2.0 39700 * **apps**: firefox 39701 * **expected**: pass 39702 * **gecko profile entries**: 14000000 39703 * **gecko profile interval**: 1 39704 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/unittests/browsertime-tp6-unittest.toml#17>`__ 39705 * **lower is better**: true 39706 * **page cycles**: 25 39707 * **page timeout**: 60000 39708 * **playback**: mitmproxy 39709 * **playback pageset manifest**: mitm7-linux-firefox-test-page-1.manifest 39710 * **playback version**: 11.0.0 39711 * **test url**: `<https://www.amazon.com/s?k=laptop&ref=nb_sb_noss_1>`__ 39712 * **type**: pageload 39713 * **unit**: ms 39714 39715 .. dropdown:: test-page-2 39716 :class-container: anchor-id-test-page-2-u 39717 39718 * Command to Run Locally 39719 39720 .. code-block:: 39721 39722 ./mach raptor -t test-page-2 39723 39724 **Owner**: PerfTest Team 39725 39726 * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__ 39727 * **alert threshold**: 2.0 39728 * **apps**: firefox 39729 * **expected**: pass 39730 * **gecko profile entries**: 14000000 39731 * **gecko profile interval**: 1 39732 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/unittests/browsertime-tp6-unittest.toml#20>`__ 39733 * **lower is better**: true 39734 * **page cycles**: 25 39735 * **page timeout**: 60000 39736 * **playback**: mitmproxy 39737 * **playback pageset manifest**: mitm7-linux-firefox-test-page-2.manifest 39738 * **playback version**: 11.0.0 39739 * **test url**: `<https://www.facebook.com>`__ 39740 * **type**: pageload 39741 * **unit**: ms 39742 39743 .. dropdown:: test-page-3 39744 :class-container: anchor-id-test-page-3-u 39745 39746 * Command to Run Locally 39747 39748 .. code-block:: 39749 39750 ./mach raptor -t test-page-3 39751 39752 **Owner**: PerfTest Team 39753 39754 * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__ 39755 * **alert threshold**: 2.0 39756 * **apps**: firefox 39757 * **expected**: pass 39758 * **gecko profile entries**: 14000000 39759 * **gecko profile interval**: 1 39760 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/unittests/browsertime-tp6-unittest.toml#23>`__ 39761 * **lower is better**: true 39762 * **page cycles**: 25 39763 * **page timeout**: 60000 39764 * **playback**: mitmproxy 39765 * **playback pageset manifest**: mitm7-linux-firefox-test-page-3.manifest 39766 * **playback version**: 11.0.0 39767 * **test url**: `<https://www.google.com/search?hl=en&q=barack+obama&cad=h>`__ 39768 * **type**: pageload 39769 * **unit**: ms 39770 39771 .. dropdown:: test-page-4 39772 :class-container: anchor-id-test-page-4-u 39773 39774 * Command to Run Locally 39775 39776 .. code-block:: 39777 39778 ./mach raptor -t test-page-4 39779 39780 **Owner**: PerfTest Team 39781 39782 * **alert on**: `fcp <raptor-metrics.html#first-paint>`__, `loadtime <raptor-metrics.html#load-time>`__ 39783 * **alert threshold**: 2.0 39784 * **apps**: firefox 39785 * **expected**: pass 39786 * **gecko profile entries**: 14000000 39787 * **gecko profile interval**: 1 39788 * **link searchfox**: `<https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/unittests/browsertime-tp6-unittest.toml#26>`__ 39789 * **lower is better**: true 39790 * **page cycles**: 25 39791 * **page timeout**: 60000 39792 * **playback**: mitmproxy 39793 * **playback pageset manifest**: mitm7-linux-firefox-test-page-4.manifest 39794 * **playback version**: 11.0.0 39795 * **test url**: `<https://www.youtube.com>`__ 39796 * **type**: pageload 39797 * **unit**: ms