Fix typo #2677
ui-tests.yml
on: pull_request
Build
4m 4s
Matrix: Visual Regression
Annotations
10 errors, 4 warnings, and 3 notices
[chromium] βΊ test/embed.test.ts:27:7 βΊ Embed the REPL app βΊ Page:
ui-tests/test/embed.test.ts#L29
1) [chromium] βΊ test/embed.test.ts:27:7 βΊ Embed the REPL app βΊ Page ββββββββββββββββββββββββββββββ
Error: Screenshot comparison failed:
54 pixels (ratio 0.01 of all image pixels) are different.
Expected: /home/runner/work/jupyterlite/jupyterlite/ui-tests/test/embed.test.ts-snapshots/embed-repl-chromium-linux.png
Received: /home/runner/work/jupyterlite/jupyterlite/ui-tests/test-results/test-embed-Embed-the-REPL-app-Page-chromium/embed-repl-actual.png
Diff: /home/runner/work/jupyterlite/jupyterlite/ui-tests/test-results/test-embed-Embed-the-REPL-app-Page-chromium/embed-repl-diff.png
27 | test("Page", async ({ page }) => {
28 | const imageName = "embed-repl.png";
> 29 | expect(await page.screenshot()).toMatchSnapshot(imageName.toLowerCase());
| ^
30 | });
31 | });
32 |
at /home/runner/work/jupyterlite/jupyterlite/ui-tests/test/embed.test.ts:29:37
|
[chromium] βΊ test/embed.test.ts:27:7 βΊ Embed the REPL app βΊ Page:
ui-tests/test/embed.test.ts#L29
1) [chromium] βΊ test/embed.test.ts:27:7 βΊ Embed the REPL app βΊ Page ββββββββββββββββββββββββββββββ
Retry #1 βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
Error: Screenshot comparison failed:
54 pixels (ratio 0.01 of all image pixels) are different.
Expected: /home/runner/work/jupyterlite/jupyterlite/ui-tests/test/embed.test.ts-snapshots/embed-repl-chromium-linux.png
Received: /home/runner/work/jupyterlite/jupyterlite/ui-tests/test-results/test-embed-Embed-the-REPL-app-Page-chromium-retry1/embed-repl-actual.png
Diff: /home/runner/work/jupyterlite/jupyterlite/ui-tests/test-results/test-embed-Embed-the-REPL-app-Page-chromium-retry1/embed-repl-diff.png
27 | test("Page", async ({ page }) => {
28 | const imageName = "embed-repl.png";
> 29 | expect(await page.screenshot()).toMatchSnapshot(imageName.toLowerCase());
| ^
30 | });
31 | });
32 |
at /home/runner/work/jupyterlite/jupyterlite/ui-tests/test/embed.test.ts:29:37
|
[chromium] βΊ test/general.test.ts:20:7 βΊ General Tests βΊ Launch Screen:
ui-tests/test/general.test.ts#L22
2) [chromium] βΊ test/general.test.ts:20:7 βΊ General Tests βΊ Launch Screen ββββββββββββββββββββββββ
Error: Screenshot comparison failed:
383 pixels (ratio 0.01 of all image pixels) are different.
Expected: /home/runner/work/jupyterlite/jupyterlite/ui-tests/test/general.test.ts-snapshots/launch-chromium-linux.png
Received: /home/runner/work/jupyterlite/jupyterlite/ui-tests/test-results/test-general-General-Tests-Launch-Screen-chromium/launch-actual.png
Diff: /home/runner/work/jupyterlite/jupyterlite/ui-tests/test-results/test-general-General-Tests-Launch-Screen-chromium/launch-diff.png
20 | test("Launch Screen", async ({ page }) => {
21 | const imageName = "launch.png";
> 22 | expect(await page.screenshot()).toMatchSnapshot(imageName.toLowerCase());
| ^
23 | });
24 |
25 | test("Enter Simple Mode", async ({ page }) => {
at /home/runner/work/jupyterlite/jupyterlite/ui-tests/test/general.test.ts:22:37
|
[chromium] βΊ test/general.test.ts:20:7 βΊ General Tests βΊ Launch Screen:
ui-tests/test/general.test.ts#L22
2) [chromium] βΊ test/general.test.ts:20:7 βΊ General Tests βΊ Launch Screen ββββββββββββββββββββββββ
Retry #1 βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
Error: Screenshot comparison failed:
383 pixels (ratio 0.01 of all image pixels) are different.
Expected: /home/runner/work/jupyterlite/jupyterlite/ui-tests/test/general.test.ts-snapshots/launch-chromium-linux.png
Received: /home/runner/work/jupyterlite/jupyterlite/ui-tests/test-results/test-general-General-Tests-Launch-Screen-chromium-retry1/launch-actual.png
Diff: /home/runner/work/jupyterlite/jupyterlite/ui-tests/test-results/test-general-General-Tests-Launch-Screen-chromium-retry1/launch-diff.png
20 | test("Launch Screen", async ({ page }) => {
21 | const imageName = "launch.png";
> 22 | expect(await page.screenshot()).toMatchSnapshot(imageName.toLowerCase());
| ^
23 | });
24 |
25 | test("Enter Simple Mode", async ({ page }) => {
at /home/runner/work/jupyterlite/jupyterlite/ui-tests/test/general.test.ts:22:37
|
[chromium] βΊ test/general.test.ts:25:7 βΊ General Tests βΊ Enter Simple Mode:
ui-tests/test/general.test.ts#L30
3) [chromium] βΊ test/general.test.ts:25:7 βΊ General Tests βΊ Enter Simple Mode ββββββββββββββββββββ
Error: Screenshot comparison failed:
482 pixels (ratio 0.01 of all image pixels) are different.
Expected: /home/runner/work/jupyterlite/jupyterlite/ui-tests/test/general.test.ts-snapshots/simple-mode-chromium-linux.png
Received: /home/runner/work/jupyterlite/jupyterlite/ui-tests/test-results/test-general-General-Tests-Enter-Simple-Mode-chromium/simple-mode-actual.png
Diff: /home/runner/work/jupyterlite/jupyterlite/ui-tests/test-results/test-general-General-Tests-Enter-Simple-Mode-chromium/simple-mode-diff.png
28 |
29 | const imageName = "simple-mode.png";
> 30 | expect(await page.screenshot()).toMatchSnapshot(imageName);
| ^
31 | });
32 |
33 | test("Toggle Dark theme", async ({ page }) => {
at /home/runner/work/jupyterlite/jupyterlite/ui-tests/test/general.test.ts:30:37
|
[chromium] βΊ test/general.test.ts:25:7 βΊ General Tests βΊ Enter Simple Mode:
ui-tests/test/general.test.ts#L30
3) [chromium] βΊ test/general.test.ts:25:7 βΊ General Tests βΊ Enter Simple Mode ββββββββββββββββββββ
Retry #1 βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
Error: Screenshot comparison failed:
482 pixels (ratio 0.01 of all image pixels) are different.
Expected: /home/runner/work/jupyterlite/jupyterlite/ui-tests/test/general.test.ts-snapshots/simple-mode-chromium-linux.png
Received: /home/runner/work/jupyterlite/jupyterlite/ui-tests/test-results/test-general-General-Tests-Enter-Simple-Mode-chromium-retry1/simple-mode-actual.png
Diff: /home/runner/work/jupyterlite/jupyterlite/ui-tests/test-results/test-general-General-Tests-Enter-Simple-Mode-chromium-retry1/simple-mode-diff.png
28 |
29 | const imageName = "simple-mode.png";
> 30 | expect(await page.screenshot()).toMatchSnapshot(imageName);
| ^
31 | });
32 |
33 | test("Toggle Dark theme", async ({ page }) => {
at /home/runner/work/jupyterlite/jupyterlite/ui-tests/test/general.test.ts:30:37
|
[chromium] βΊ test/general.test.ts:33:7 βΊ General Tests βΊ Toggle Dark theme:
ui-tests/test/general.test.ts#L41
4) [chromium] βΊ test/general.test.ts:33:7 βΊ General Tests βΊ Toggle Dark theme ββββββββββββββββββββ
Error: Screenshot comparison failed:
157 pixels (ratio 0.01 of all image pixels) are different.
Expected: /home/runner/work/jupyterlite/jupyterlite/ui-tests/test/general.test.ts-snapshots/dark-theme-chromium-linux.png
Received: /home/runner/work/jupyterlite/jupyterlite/ui-tests/test-results/test-general-General-Tests-Toggle-Dark-theme-chromium/dark-theme-actual.png
Diff: /home/runner/work/jupyterlite/jupyterlite/ui-tests/test-results/test-general-General-Tests-Toggle-Dark-theme-chromium/dark-theme-diff.png
39 |
40 | const imageName = "dark-theme.png";
> 41 | expect(await page.screenshot()).toMatchSnapshot(imageName.toLowerCase());
| ^
42 | });
43 |
44 | test("Toggle Light theme", async ({ page }) => {
at /home/runner/work/jupyterlite/jupyterlite/ui-tests/test/general.test.ts:41:37
|
[chromium] βΊ test/general.test.ts:33:7 βΊ General Tests βΊ Toggle Dark theme:
ui-tests/test/general.test.ts#L41
4) [chromium] βΊ test/general.test.ts:33:7 βΊ General Tests βΊ Toggle Dark theme ββββββββββββββββββββ
Retry #1 βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
Error: Screenshot comparison failed:
157 pixels (ratio 0.01 of all image pixels) are different.
Expected: /home/runner/work/jupyterlite/jupyterlite/ui-tests/test/general.test.ts-snapshots/dark-theme-chromium-linux.png
Received: /home/runner/work/jupyterlite/jupyterlite/ui-tests/test-results/test-general-General-Tests-Toggle-Dark-theme-chromium-retry1/dark-theme-actual.png
Diff: /home/runner/work/jupyterlite/jupyterlite/ui-tests/test-results/test-general-General-Tests-Toggle-Dark-theme-chromium-retry1/dark-theme-diff.png
39 |
40 | const imageName = "dark-theme.png";
> 41 | expect(await page.screenshot()).toMatchSnapshot(imageName.toLowerCase());
| ^
42 | });
43 |
44 | test("Toggle Light theme", async ({ page }) => {
at /home/runner/work/jupyterlite/jupyterlite/ui-tests/test/general.test.ts:41:37
|
[chromium] βΊ test/kernels.spec.ts:26:7 βΊ Kernels βΊ Default kernel name:
ui-tests/test/kernels.spec.ts#L45
5) [chromium] βΊ test/kernels.spec.ts:26:7 βΊ Kernels βΊ Default kernel name ββββββββββββββββββββββββ
Error: Screenshot comparison failed:
403 pixels (ratio 0.01 of all image pixels) are different.
Expected: /home/runner/work/jupyterlite/jupyterlite/ui-tests/test/kernels.spec.ts-snapshots/default-kernel-name-chromium-linux.png
Received: /home/runner/work/jupyterlite/jupyterlite/ui-tests/test-results/test-kernels-Kernels-Default-kernel-name-chromium/default-kernel-name-actual.png
Diff: /home/runner/work/jupyterlite/jupyterlite/ui-tests/test-results/test-kernels-Kernels-Default-kernel-name-chromium/default-kernel-name-diff.png
43 |
44 | const imageName = "default-kernel-name.png";
> 45 | expect(await page.screenshot()).toMatchSnapshot(imageName.toLowerCase());
| ^
46 | });
47 |
48 | // check it is possible to open a notebook, shut down its kernel and open it again
at /home/runner/work/jupyterlite/jupyterlite/ui-tests/test/kernels.spec.ts:45:37
|
[chromium] βΊ test/kernels.spec.ts:26:7 βΊ Kernels βΊ Default kernel name:
ui-tests/test/kernels.spec.ts#L45
5) [chromium] βΊ test/kernels.spec.ts:26:7 βΊ Kernels βΊ Default kernel name ββββββββββββββββββββββββ
Retry #1 βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
Error: Screenshot comparison failed:
403 pixels (ratio 0.01 of all image pixels) are different.
Expected: /home/runner/work/jupyterlite/jupyterlite/ui-tests/test/kernels.spec.ts-snapshots/default-kernel-name-chromium-linux.png
Received: /home/runner/work/jupyterlite/jupyterlite/ui-tests/test-results/test-kernels-Kernels-Default-kernel-name-chromium-retry1/default-kernel-name-actual.png
Diff: /home/runner/work/jupyterlite/jupyterlite/ui-tests/test-results/test-kernels-Kernels-Default-kernel-name-chromium-retry1/default-kernel-name-diff.png
43 |
44 | const imageName = "default-kernel-name.png";
> 45 | expect(await page.screenshot()).toMatchSnapshot(imageName.toLowerCase());
| ^
46 | });
47 |
48 | // check it is possible to open a notebook, shut down its kernel and open it again
at /home/runner/work/jupyterlite/jupyterlite/ui-tests/test/kernels.spec.ts:45:37
|
Build
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
Visual Regression (firefox)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
Visual Regression (firefox)
No files were found with the provided path: ui-tests/test-results. No artifacts will be uploaded.
|
Visual Regression (chromium)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
π Playwright Run Summary
4 skipped
34 passed (3.7m)
|
π Playwright Run Summary
14 failed
[chromium] βΊ test/embed.test.ts:27:7 βΊ Embed the REPL app βΊ Page βββββββββββββββββββββββββββββββ
[chromium] βΊ test/general.test.ts:20:7 βΊ General Tests βΊ Launch Screen βββββββββββββββββββββββββ
[chromium] βΊ test/general.test.ts:25:7 βΊ General Tests βΊ Enter Simple Mode βββββββββββββββββββββ
[chromium] βΊ test/general.test.ts:33:7 βΊ General Tests βΊ Toggle Dark theme βββββββββββββββββββββ
[chromium] βΊ test/kernels.spec.ts:26:7 βΊ Kernels βΊ Default kernel name βββββββββββββββββββββββββ
[chromium] βΊ test/notebook.test.ts:27:7 βΊ Notebook Tests βΊ Tree Screen βββββββββββββββββββββββββ
[chromium] βΊ test/notebook.test.ts:32:7 βΊ Notebook Tests βΊ Toggle Dark theme βββββββββββββββββββ
[chromium] βΊ test/notebook.test.ts:73:9 βΊ Notebook file opener βΊ Open intro.ipynb with the JSON factory
[chromium] βΊ test/notebook.test.ts:73:9 βΊ Notebook file opener βΊ Open matplotlib.png with the Image factory
[chromium] βΊ test/notebook.test.ts:73:9 βΊ Notebook file opener βΊ Open iris.csv with the CSV Viewer factory
[chromium] βΊ test/renderers.test.ts:19:7 βΊ Renderers βΊ MathJax βββββββββββββββββββββββββββββββββ
[chromium] βΊ test/repl.test.ts:23:3 βΊ Basic REPL Tests βΊ Page ββββββββββββββββββββββββββββββββββ
[chromium] βΊ test/repl.test.ts:28:3 βΊ Basic REPL Tests βΊ Toggle Dark theme βββββββββββββββββββββ
[chromium] βΊ test/repl.test.ts:49:3 βΊ Populate REPL prompt βΊ Populate prompt without executing β
1 skipped
23 passed (3.6m)
|
π Playwright Run Summary
1 skipped
37 passed (2.4m)
|
Artifacts
Produced during runtime
Name | Size | |
---|---|---|
jupyterlite-chromium-test-assets
|
31.7 MB |
|
jupyterlite-chromium-test-report
|
31.4 MB |
|
jupyterlite-chromium-updated-snapshots
|
352 KB |
|
jupyterlite-firefox-test-report
|
318 KB |
|
jupyterlite-ui-tests-app-2677
|
16.1 MB |
|