Home - News ( United States | United Kingdom | Italy | Germany ) - Football scores

Showing content from https://github.com/grafana/k6-jslib-testing below:

grafana/k6-jslib-testing: Playwright-compatible functional testing library for k6

A seamless way to write functional tests in k6 with Playwright-compatible assertions.

⚠️ Note: This project is under active development. While it is functional, it is not yet ready for production use, expect bugs, and potential breaking changes.

• ✨ Write once, run anywhere: Copy-paste your Playwright test assertions directly into k6 - they'll work out of the box
• 🎯 Fail fast: Tests interrupt immediately when assertions fail, giving you quick, clear feedback
• 🎭 Familiar API: Familiar API for anyone coming from Playwright, Deno, or Vite ecosystem
• 🔍 Clear error messages: Get detailed, actionable feedback when tests fail

k6-testing is available as a k6 jslib. It can be directly imported as a dependency in your k6 script.

import { expect } from "https://jslib.k6.io/k6-testing/0.3.0/index.js";

The following example demonstrates how to use k6-testing in a k6 script.

The module exposes the expect function, which behaves in a similar way to Playwright's expect function.

To make an assertion, call expect(value) and choose a matcher that reflects the expectation.

import { browser } from "k6/browser";
import http from "k6/http";

import { expect } from "https://jslib.k6.io/k6-testing/0.3.0/index.js";

export const options = {
  scenarios: {
    // Protocol tests
    protocol: {
      executor: "shared-iterations",
      vus: 1,
      iterations: 1,
      exec: "protocol",
    },

    // Browser tests
    ui: {
      executor: "shared-iterations",
      options: {
        browser: {
          type: "chromium",
        },
      },
      exec: "ui",
    },
  },
};

export function protocol() {
  // Get the home page of k6's Quick Pizza app
  const response = http.get("https://quickpizza.grafana.com/");

  // Simple assertions
  expect(response.status).toBe(200);
}

export async function ui() {
  const page = await browser.newPage();

  try {
    await page.goto("https://quickpizza.grafana.com/");
    await page.waitForLoadState("networkidle"); // waits until the `networkidle` event

    // Assert the "Pizza Please" button is visible
    await expect(page.locator("button[name=pizza-please]")).toBeVisible();
  } finally {
    await page.close();
  }
}

For functional testing, metrics and performance are most likely irrelevant, and we recommend executing k6 functional tests in headless mode:

# Run k6 in headless mode
k6 run --no-summary --quiet examples/browser.js

# If any assertion/expectation fail, a non-zero exit code will be returned
echo $status

Use the same assertions you know from Playwright:

// These Playwright assertions work exactly the same in k6
await expect(page.locator(".button")).toBeVisible();
await expect(page.locator("input")).toHaveValue("test");

Perfect for UI testing, these assertions will retry until the assertion passes, or the assertion timeout is reached. Note that retrying assertions are async, so you must await them.

By default, the timeout for assertions is set to 5 seconds, and the polling interval is set to 100 milliseconds.

You can customize these values by passing an options object as the second argument to the assertion function:

await expect(page.locator(".button")).toBeVisible({
  timeout: 10000,
  interval: 500,
});

These assertions allow to test any conditions, but do not auto-retry.

You can negate any matcher by adding .not before the matcher method. This inverts the assertion, checking that the condition is false rather than true:

// Standard assertions
expect(response.status).not.toBe(404); // Assert status is NOT 404
expect(response.json().items).not.toBeEmpty(); // Assert items array is not empty
expect(user.permissions).not.toContain("admin"); // Assert user doesn't have admin permission

// Retrying assertions (must be awaited)
await expect(page.locator(".error-message")).not.toBeVisible(); // Assert error is not shown
await expect(page.locator('button[type="submit"]')).not.toBeDisabled(); // Assert button is not disabled

Negation is particularly useful in k6 testing scenarios such as:

• Verifying error conditions aren't present: await expect(page.locator('.error')).not.toBeVisible()
• Ensuring unauthorized access is blocked: expect(response.status).not.toBe(200)
• Confirming elements are removed after an action: await expect(page.locator('#item-1')).not.toBeVisible()

Note: When using negated retrying assertions, the assertion will keep retrying until the condition becomes false or the timeout is reached. For example, await expect(locator).not.toBeVisible() will pass immediately if the element is hidden, but will retry until timeout if the element is visible, hoping it will disappear.

By default, failed assertions will terminate the test execution. The k6 testing library also supports soft assertions: failed soft assertions do not terminate the test execution, but mark the test as failed, leading k6 to eventually exit with code 110.

import exec from "k6/execution";
import { expect } from "https://jslib.k6.io/k6-testing/0.4.0/index.js";

export const options = {
  vus: 2,
  iterations: 10,
};

export default function () {
  // Iteration 3 will mark the test as failed, but the test execution
  // will keep going until its end condition, and eventually exit with
  // code 110.
  if (exec.scenario.iterationInInstance === 3) {
    expect.soft(false).toBeTruthy();
  }
}

Note that soft assertions can be configured to throw an exception, and effectively failing the iteration where it happens instead.

When writing tests, clear and informative error messages can significantly speed up debugging. You can specify a custom error message as the second argument to the expect function. This message will be displayed whenever the assertion fails, providing additional context about the failure.

Example:

expect(value, "Custom message").toHaveProperty("a.b[0]", 43);

If this assertion fails, the error message will clearly indicate the issue along with your custom message:

                     Error: Custom message
                        At: /Users/me/myProject/expectNonRetrying.ts:555:15

             Property path: a.b[0]
Expected property to equal: 43
           Received object: {"a":{"b":[42]},"c":true}

                  Filename: expectNonRetrying.ts
                      Line: 555

You can create a new expect instance with the .configure method. This will allow you to configure the behavior of the assertions. The configuration is applied to all assertions made using the expect instance.

The available configuration options are:

export default function () {
  // Create a new expect instance with the default configuration
  const myExpect = expect.configure({
    // Display assertions using an inline format, aimed towards making them more readable in logs
    display: "inline",

    // Disable colorization of the output of the expect function
    colorize: false,
  });

  // Use myExpect instead of expect, and it will use the configured display format and colorization
  await myExpect(true).toBe(false);

  // Note that you're still free to use the default expect instance, and it will not be affected by the configuration
  expect(true).toBe(false);
}

You can configure the default timeout and polling interval for assertions by instantiating a new expect instance with the .configure method.

export default function () {
  const myExpect = new expect.configure({ timeout: 10000, interval: 500 });

  // Use myExpect instead of expect, and it will use the configured timeout and interval
  // for all assertions.
  //
  // In this specific case, the assertion will retry until the button is visible, or the timeout is reached: every
  // 500ms, for a maximum of 10 seconds.
  await myExpect(page.locator(".button")).toBeVisible();
}

import { expect } from "https://jslib.k6.io/k6-testing/0.3.0/index.js";
import http from "k6/http";

export function setup() {
  // Ensure the API is up and running before running the tests
  // If the response is not 200, the test will fail immediately with
  // a non-zero exit code, display a user-friendly message, and stop the test.
  const response = http.get("https://api.example.com/health");
  expect(response.status).toBe(200);
}

export default function () {
  const response = http.get("https://api.example.com/users");
  expect(response.status).toBe(200);

  const json = response.json();
  expect(json.users).toBeDefined();
  expect(json.users).toBeInstanceOf(Array);
  expect(json.users[0].id).toBeGreaterThan(0);
}

import { expect } from "https://jslib.k6.io/k6-testing/0.3.0/index.js";
import { browser } from "k6/browser";

export const options = {
  scenarios: {
    ui: {
      executor: "shared-iterations",
      options: {
        browser: {
          type: "chromium",
        },
      },
    },
  },
};

export default async function () {
  const page = await browser.newPage();

  try {
    // Navigate to the page
    await page.goto("https://test.k6.io/my_messages.php");

    // Type into the login input field: 'testlogin'
    const loc = await page.locator('input[name="login"]');
    await loc.type("testlogin");

    // Assert that the login input field is visible
    await expect(page.locator('input[name="login"]')).toBeVisible();

    // Expecting this to fail as we have typed 'testlogin' into the input instead of 'foo'
    await expect(page.locator('input[name="login"]')).toHaveValue("foo");
  } finally {
    await page.close();
  }
}

We welcome contributions! Here's how you can help:

1. Report Issues: File bugs or feature requests on our GitHub issues page
2. Submit PRs: Code contributions are welcome
3. Improve Docs: Documentation improvements are always valuable

The project supports development using Dev Containers, which provides a consistent, pre-configured development environment with all necessary tools installed. This is the recommended way to develop k6-testing.

To use the Dev Container:

1. Ensure you have Docker installed
2. Use a Dev Containers compatible editor:
   • VS Code with the "Remote - Containers" extension
   • JetBrains IDEs with the "Remote Development" plugin
   • Any other editor that supports Dev Containers
3. Open the project in your editor - it should automatically detect the Dev Container configuration and prompt you to reopen in container

The Dev Container comes with:

• Deno
• k6
• chromium (for browser testing)

k6-testing is built with Deno, and esbuild. Deno is used for the development of the library itself, as well as unit testing, and the output distributable files are built with esbuild.

The following commands are used throughout the development process:

• deno task build - Build the distributable files
• deno task release - Build the distributable files in release mode
• deno test - Run unit tests
• deno task test - Run integration tests
• deno lint *.ts - Report linting errors
• deno fmt *.ts - Format the code

The following files are must known when working on the project:

• mod.ts - The main entry point for the expect library, defines the public API
• expect.ts - The main entry point for the expect library
• expectNonRetrying.ts - Contains the non-retrying assertions definition and implementation
• expectRetrying.ts - Contains the retrying assertions definition and implementation
• The tests/ directory contains the integration tests for the expect library

During development, a typical workflow would consist in the following steps:

1. Make changes to the code
2. Run deno fmt *.ts to format the code
3. Run deno lint *.ts to report linting errors
4. Run deno task build to (verify) build the code
5. Run deno test to run unit tests
6. Run deno task test to run integration tests
7. (optional) import dist/index.js in a k6 script and run it with k6 run --no-summary --quiet <script>.js to verify that the library works as expected

Apache 2.0 License

RetroSearch is an open source project built by @garambo | Open a GitHub Issue

Search and Browse the WWW like it's 1997 | Search results from DuckDuckGo

HTML: 3.2 | Encoding: UTF-8 | Version: 0.7.4