Skip to content

Fix typo

Fix typo #2677

Re-run triggered January 10, 2025 08:41
Status Failure
Total duration 11m 21s
Artifacts 5

ui-tests.yml

on: pull_request
Matrix: Visual Regression
Fit to window
Zoom out
Zoom in

Annotations

10 errors, 4 warnings, and 3 notices
[chromium] β€Ί test/embed.test.ts:27:7 β€Ί Embed the REPL app β€Ί Page: ui-tests/test/embed.test.ts#L29
1) [chromium] β€Ί test/embed.test.ts:27:7 β€Ί Embed the REPL app β€Ί Page ────────────────────────────── Error: Screenshot comparison failed: 54 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/jupyterlite/jupyterlite/ui-tests/test/embed.test.ts-snapshots/embed-repl-chromium-linux.png Received: /home/runner/work/jupyterlite/jupyterlite/ui-tests/test-results/test-embed-Embed-the-REPL-app-Page-chromium/embed-repl-actual.png Diff: /home/runner/work/jupyterlite/jupyterlite/ui-tests/test-results/test-embed-Embed-the-REPL-app-Page-chromium/embed-repl-diff.png 27 | test("Page", async ({ page }) => { 28 | const imageName = "embed-repl.png"; > 29 | expect(await page.screenshot()).toMatchSnapshot(imageName.toLowerCase()); | ^ 30 | }); 31 | }); 32 | at /home/runner/work/jupyterlite/jupyterlite/ui-tests/test/embed.test.ts:29:37
[chromium] β€Ί test/embed.test.ts:27:7 β€Ί Embed the REPL app β€Ί Page: ui-tests/test/embed.test.ts#L29
1) [chromium] β€Ί test/embed.test.ts:27:7 β€Ί Embed the REPL app β€Ί Page ────────────────────────────── Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 54 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/jupyterlite/jupyterlite/ui-tests/test/embed.test.ts-snapshots/embed-repl-chromium-linux.png Received: /home/runner/work/jupyterlite/jupyterlite/ui-tests/test-results/test-embed-Embed-the-REPL-app-Page-chromium-retry1/embed-repl-actual.png Diff: /home/runner/work/jupyterlite/jupyterlite/ui-tests/test-results/test-embed-Embed-the-REPL-app-Page-chromium-retry1/embed-repl-diff.png 27 | test("Page", async ({ page }) => { 28 | const imageName = "embed-repl.png"; > 29 | expect(await page.screenshot()).toMatchSnapshot(imageName.toLowerCase()); | ^ 30 | }); 31 | }); 32 | at /home/runner/work/jupyterlite/jupyterlite/ui-tests/test/embed.test.ts:29:37
[chromium] β€Ί test/general.test.ts:20:7 β€Ί General Tests β€Ί Launch Screen: ui-tests/test/general.test.ts#L22
2) [chromium] β€Ί test/general.test.ts:20:7 β€Ί General Tests β€Ί Launch Screen ──────────────────────── Error: Screenshot comparison failed: 383 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/jupyterlite/jupyterlite/ui-tests/test/general.test.ts-snapshots/launch-chromium-linux.png Received: /home/runner/work/jupyterlite/jupyterlite/ui-tests/test-results/test-general-General-Tests-Launch-Screen-chromium/launch-actual.png Diff: /home/runner/work/jupyterlite/jupyterlite/ui-tests/test-results/test-general-General-Tests-Launch-Screen-chromium/launch-diff.png 20 | test("Launch Screen", async ({ page }) => { 21 | const imageName = "launch.png"; > 22 | expect(await page.screenshot()).toMatchSnapshot(imageName.toLowerCase()); | ^ 23 | }); 24 | 25 | test("Enter Simple Mode", async ({ page }) => { at /home/runner/work/jupyterlite/jupyterlite/ui-tests/test/general.test.ts:22:37
[chromium] β€Ί test/general.test.ts:20:7 β€Ί General Tests β€Ί Launch Screen: ui-tests/test/general.test.ts#L22
2) [chromium] β€Ί test/general.test.ts:20:7 β€Ί General Tests β€Ί Launch Screen ──────────────────────── Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 383 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/jupyterlite/jupyterlite/ui-tests/test/general.test.ts-snapshots/launch-chromium-linux.png Received: /home/runner/work/jupyterlite/jupyterlite/ui-tests/test-results/test-general-General-Tests-Launch-Screen-chromium-retry1/launch-actual.png Diff: /home/runner/work/jupyterlite/jupyterlite/ui-tests/test-results/test-general-General-Tests-Launch-Screen-chromium-retry1/launch-diff.png 20 | test("Launch Screen", async ({ page }) => { 21 | const imageName = "launch.png"; > 22 | expect(await page.screenshot()).toMatchSnapshot(imageName.toLowerCase()); | ^ 23 | }); 24 | 25 | test("Enter Simple Mode", async ({ page }) => { at /home/runner/work/jupyterlite/jupyterlite/ui-tests/test/general.test.ts:22:37
[chromium] β€Ί test/general.test.ts:25:7 β€Ί General Tests β€Ί Enter Simple Mode: ui-tests/test/general.test.ts#L30
3) [chromium] β€Ί test/general.test.ts:25:7 β€Ί General Tests β€Ί Enter Simple Mode ──────────────────── Error: Screenshot comparison failed: 482 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/jupyterlite/jupyterlite/ui-tests/test/general.test.ts-snapshots/simple-mode-chromium-linux.png Received: /home/runner/work/jupyterlite/jupyterlite/ui-tests/test-results/test-general-General-Tests-Enter-Simple-Mode-chromium/simple-mode-actual.png Diff: /home/runner/work/jupyterlite/jupyterlite/ui-tests/test-results/test-general-General-Tests-Enter-Simple-Mode-chromium/simple-mode-diff.png 28 | 29 | const imageName = "simple-mode.png"; > 30 | expect(await page.screenshot()).toMatchSnapshot(imageName); | ^ 31 | }); 32 | 33 | test("Toggle Dark theme", async ({ page }) => { at /home/runner/work/jupyterlite/jupyterlite/ui-tests/test/general.test.ts:30:37
[chromium] β€Ί test/general.test.ts:25:7 β€Ί General Tests β€Ί Enter Simple Mode: ui-tests/test/general.test.ts#L30
3) [chromium] β€Ί test/general.test.ts:25:7 β€Ί General Tests β€Ί Enter Simple Mode ──────────────────── Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 482 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/jupyterlite/jupyterlite/ui-tests/test/general.test.ts-snapshots/simple-mode-chromium-linux.png Received: /home/runner/work/jupyterlite/jupyterlite/ui-tests/test-results/test-general-General-Tests-Enter-Simple-Mode-chromium-retry1/simple-mode-actual.png Diff: /home/runner/work/jupyterlite/jupyterlite/ui-tests/test-results/test-general-General-Tests-Enter-Simple-Mode-chromium-retry1/simple-mode-diff.png 28 | 29 | const imageName = "simple-mode.png"; > 30 | expect(await page.screenshot()).toMatchSnapshot(imageName); | ^ 31 | }); 32 | 33 | test("Toggle Dark theme", async ({ page }) => { at /home/runner/work/jupyterlite/jupyterlite/ui-tests/test/general.test.ts:30:37
[chromium] β€Ί test/general.test.ts:33:7 β€Ί General Tests β€Ί Toggle Dark theme: ui-tests/test/general.test.ts#L41
4) [chromium] β€Ί test/general.test.ts:33:7 β€Ί General Tests β€Ί Toggle Dark theme ──────────────────── Error: Screenshot comparison failed: 157 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/jupyterlite/jupyterlite/ui-tests/test/general.test.ts-snapshots/dark-theme-chromium-linux.png Received: /home/runner/work/jupyterlite/jupyterlite/ui-tests/test-results/test-general-General-Tests-Toggle-Dark-theme-chromium/dark-theme-actual.png Diff: /home/runner/work/jupyterlite/jupyterlite/ui-tests/test-results/test-general-General-Tests-Toggle-Dark-theme-chromium/dark-theme-diff.png 39 | 40 | const imageName = "dark-theme.png"; > 41 | expect(await page.screenshot()).toMatchSnapshot(imageName.toLowerCase()); | ^ 42 | }); 43 | 44 | test("Toggle Light theme", async ({ page }) => { at /home/runner/work/jupyterlite/jupyterlite/ui-tests/test/general.test.ts:41:37
[chromium] β€Ί test/general.test.ts:33:7 β€Ί General Tests β€Ί Toggle Dark theme: ui-tests/test/general.test.ts#L41
4) [chromium] β€Ί test/general.test.ts:33:7 β€Ί General Tests β€Ί Toggle Dark theme ──────────────────── Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 157 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/jupyterlite/jupyterlite/ui-tests/test/general.test.ts-snapshots/dark-theme-chromium-linux.png Received: /home/runner/work/jupyterlite/jupyterlite/ui-tests/test-results/test-general-General-Tests-Toggle-Dark-theme-chromium-retry1/dark-theme-actual.png Diff: /home/runner/work/jupyterlite/jupyterlite/ui-tests/test-results/test-general-General-Tests-Toggle-Dark-theme-chromium-retry1/dark-theme-diff.png 39 | 40 | const imageName = "dark-theme.png"; > 41 | expect(await page.screenshot()).toMatchSnapshot(imageName.toLowerCase()); | ^ 42 | }); 43 | 44 | test("Toggle Light theme", async ({ page }) => { at /home/runner/work/jupyterlite/jupyterlite/ui-tests/test/general.test.ts:41:37
[chromium] β€Ί test/kernels.spec.ts:26:7 β€Ί Kernels β€Ί Default kernel name: ui-tests/test/kernels.spec.ts#L45
5) [chromium] β€Ί test/kernels.spec.ts:26:7 β€Ί Kernels β€Ί Default kernel name ──────────────────────── Error: Screenshot comparison failed: 403 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/jupyterlite/jupyterlite/ui-tests/test/kernels.spec.ts-snapshots/default-kernel-name-chromium-linux.png Received: /home/runner/work/jupyterlite/jupyterlite/ui-tests/test-results/test-kernels-Kernels-Default-kernel-name-chromium/default-kernel-name-actual.png Diff: /home/runner/work/jupyterlite/jupyterlite/ui-tests/test-results/test-kernels-Kernels-Default-kernel-name-chromium/default-kernel-name-diff.png 43 | 44 | const imageName = "default-kernel-name.png"; > 45 | expect(await page.screenshot()).toMatchSnapshot(imageName.toLowerCase()); | ^ 46 | }); 47 | 48 | // check it is possible to open a notebook, shut down its kernel and open it again at /home/runner/work/jupyterlite/jupyterlite/ui-tests/test/kernels.spec.ts:45:37
[chromium] β€Ί test/kernels.spec.ts:26:7 β€Ί Kernels β€Ί Default kernel name: ui-tests/test/kernels.spec.ts#L45
5) [chromium] β€Ί test/kernels.spec.ts:26:7 β€Ί Kernels β€Ί Default kernel name ──────────────────────── Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Screenshot comparison failed: 403 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/jupyterlite/jupyterlite/ui-tests/test/kernels.spec.ts-snapshots/default-kernel-name-chromium-linux.png Received: /home/runner/work/jupyterlite/jupyterlite/ui-tests/test-results/test-kernels-Kernels-Default-kernel-name-chromium-retry1/default-kernel-name-actual.png Diff: /home/runner/work/jupyterlite/jupyterlite/ui-tests/test-results/test-kernels-Kernels-Default-kernel-name-chromium-retry1/default-kernel-name-diff.png 43 | 44 | const imageName = "default-kernel-name.png"; > 45 | expect(await page.screenshot()).toMatchSnapshot(imageName.toLowerCase()); | ^ 46 | }); 47 | 48 | // check it is possible to open a notebook, shut down its kernel and open it again at /home/runner/work/jupyterlite/jupyterlite/ui-tests/test/kernels.spec.ts:45:37
Build
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Visual Regression (firefox)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Visual Regression (firefox)
No files were found with the provided path: ui-tests/test-results. No artifacts will be uploaded.
Visual Regression (chromium)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
🎭 Playwright Run Summary
4 skipped 34 passed (3.7m)
🎭 Playwright Run Summary
14 failed [chromium] β€Ί test/embed.test.ts:27:7 β€Ί Embed the REPL app β€Ί Page ─────────────────────────────── [chromium] β€Ί test/general.test.ts:20:7 β€Ί General Tests β€Ί Launch Screen ───────────────────────── [chromium] β€Ί test/general.test.ts:25:7 β€Ί General Tests β€Ί Enter Simple Mode ───────────────────── [chromium] β€Ί test/general.test.ts:33:7 β€Ί General Tests β€Ί Toggle Dark theme ───────────────────── [chromium] β€Ί test/kernels.spec.ts:26:7 β€Ί Kernels β€Ί Default kernel name ───────────────────────── [chromium] β€Ί test/notebook.test.ts:27:7 β€Ί Notebook Tests β€Ί Tree Screen ───────────────────────── [chromium] β€Ί test/notebook.test.ts:32:7 β€Ί Notebook Tests β€Ί Toggle Dark theme ─────────────────── [chromium] β€Ί test/notebook.test.ts:73:9 β€Ί Notebook file opener β€Ί Open intro.ipynb with the JSON factory [chromium] β€Ί test/notebook.test.ts:73:9 β€Ί Notebook file opener β€Ί Open matplotlib.png with the Image factory [chromium] β€Ί test/notebook.test.ts:73:9 β€Ί Notebook file opener β€Ί Open iris.csv with the CSV Viewer factory [chromium] β€Ί test/renderers.test.ts:19:7 β€Ί Renderers β€Ί MathJax ───────────────────────────────── [chromium] β€Ί test/repl.test.ts:23:3 β€Ί Basic REPL Tests β€Ί Page ────────────────────────────────── [chromium] β€Ί test/repl.test.ts:28:3 β€Ί Basic REPL Tests β€Ί Toggle Dark theme ───────────────────── [chromium] β€Ί test/repl.test.ts:49:3 β€Ί Populate REPL prompt β€Ί Populate prompt without executing ─ 1 skipped 23 passed (3.6m)
🎭 Playwright Run Summary
1 skipped 37 passed (2.4m)

Artifacts

Produced during runtime
Name Size
jupyterlite-chromium-test-assets
31.7 MB
jupyterlite-chromium-test-report
31.4 MB
jupyterlite-chromium-updated-snapshots
352 KB
jupyterlite-firefox-test-report
318 KB
jupyterlite-ui-tests-app-2677
16.1 MB