Continuous Integration

3 steps to get your tests running on CI:

  1. Ensure CI agent can run browsers: Use our Docker image in Linux agents. Windows and macOS agents do not require any additional dependencies.
  2. Install Playwright: In most projects, this would be done with (or npm install). Playwright would install the relevant browsers automatically.
  3. Run your tests: Use npm test or equivalent to execute your tests.

The can be used to run Playwright tests on GitHub Actions.

We run our tests on GitHub Actions, across a matrix of 3 platforms (Windows, Linux, macOS) and 3 browsers (Chromium, Firefox, WebKit).

Docker

We have a pre-built Docker image which can either be used directly, or as a reference to update your existing Docker definitions.

Suggested configuration

  1. By default, Docker runs a container with a /dev/shm shared memory space 64MB. This is for Chromium and will cause Chromium to crash when rendering large pages. To fix, run the container with docker run --shm-size=1gb to increase the size of /dev/shm. Since Chromium 65, this is no longer necessary. Instead, launch the browser with the --disable-dev-shm-usage flag:

    1. const browser = await playwright.chromium.launch({
    2.   args: ['--disable-dev-shm-usage']
    3. });

    This will write shared memory files into /tmp instead of /dev/shm. See crbug.com/736452 for more details.

  2. Using --ipc=host is also recommended when using Chromium—without it Chromium can run out of memory and crash. Learn more about this option in .

  3. Seeing other weird errors when launching Chromium? Try running your container with docker run --cap-add=SYS_ADMIN when developing locally. Since the Dockerfile adds a pwuser user as a non-privileged user, it may not have all the necessary privileges.

  4. dumb-init is worth checking out if you’re experiencing a lot of zombies Chromium processes sticking around. There’s special treatment for processes with PID=1, which makes it hard to terminate Chromium properly in some cases (e.g. in Docker).

For Linux agents, you can use with Azure Pipelines support for running containerized jobs. Alternatively, you can refer to the to see additional dependencies that need to be installed on a Ubuntu agent.

  1. pool:
  2.   vmImage: 'ubuntu-18.04'
  4. container: mcr.microsoft.com/playwright:bionic
  5. steps:
  6. - script: npm install
  7. - script: npm run test

Travis CI

We run our tests on Travis CI over a Linux agent (Ubuntu 18.04). Use our to see list of additional dependencies to be installed.

Suggested configuration

  1. User namespace cloning should be enabled to support proper sandboxing
  2. should be launched in order to run Chromium in non-headless mode (e.g. to test Chrome Extensions)
  3. If your project does not have package-lock.json, Travis would be auto-caching node_modules directory. If you run npm install (instead of npm ci), it is possible that the browser binaries are not downloaded. Fix this with these steps outlined below.

To sum up, your .travis.yml might look like this:

  1. language: node_js
  2. dist: bionic
  3. addons:
  4.   apt:
  5.     packages:
  7.     - libgbm1
  8.     # These are required to run webkit
  9.     - libwoff1
  10.     - libopus0
  11.     - libwebp6
  12.     - libwebpdemux2
  13.     - libenchant1c2a
  14.     - libgudev-1.0-0
  15.     - libsecret-1-0
  16.     - libhyphen0
  17.     - libgdk-pixbuf2.0-0
  18.     - libegl1
  19.     - libgles2
  20.     - libevent-2.1-6
  21.     - libnotify4
  22.     - libxslt1.1
  23.     - libvpx5
  24.     - xvfb
  26. # allow headful tests
  27. before_install:
  28.   # Enable user namespace cloning
  29.   - "sysctl kernel.unprivileged_userns_clone=1"
  30.   # Launch XVFB
  31.   - "export DISPLAY=:99.0"
  32.   - "sh -e /etc/init.d/xvfb start"

We run our tests on CircleCI, with our . Use our CircleCI configuration to create your own. Running Playwright smoothly on CircleCI requires the following steps:

  1. Use the pre-built in your config like so:

  2. If you’re using Playwright through Jest, then you may encounter an error spawning child processes:

    1. [00:00.0]  jest args: --e2e --spec --max-workers=36
    2. Error: spawn ENOMEM
    3.    at ChildProcess.spawn (internal/child_process.js:394:11)

    This is likely caused by Jest autodetecting the number of processes on the entire machine (36) rather than the number allowed to your container (2). To fix this, set in your test command.

AppVeyor

We run our tests on Windows agents in AppVeyor. Use our to create your own.

Bitbucket Pipelines can use public Docker images as build environments. To run Playwright tests on Bitbucket, use our public Docker image ().

  1. image: mcr.microsoft.com/playwright:bionic
  1. const { chromium } = require('playwright');
  2. const browser = await chromium.launch({ args: ['--no-sandbox'] });

GitLab CI

To run Playwright tests on GitLab, use our public Docker image ().

By default, Playwright downloads browser binaries when the Playwright NPM package is installed. The NPM packages have a postinstall hook that downloads the browser binaries. This behavior can be customized with environment variables.

Caching browsers on CI is strictly optional: The postinstall hooks should execute and download the browser binaries on every run.

Exception: node_modules are cached

Most CI providers cache the npm-cache directory (located at $HOME/.npm). If your CI pipelines caches the node_modules directory and you run npm install (instead of npm ci), the default configuration will not work. This is because the npm install step will find the Playwright NPM package on disk and not execute the postinstall step.

This behavior can be fixed with one of the following approaches:

  1. Move to caching $HOME/.npm or the npm-cache directory. (This is the default behavior in most CI providers.)
  2. Set PLAYWRIGHT_BROWSERS_PATH=0 as the environment variable before running npm install. This will download the browser binaries in the node_modules directory and cache them with the package code. See .
  3. Use npm ci (instead of npm install) which forces a clean install: by removing the existing node_modules directory. See npm docs.
  4. Cache the browser binaries, with the steps below.

Directories to cache

With the default behavior, Playwright downloads the browser binaries in the following directories:

  • %USERPROFILE%\AppData\Local\ms-playwright on Windows
  • ~/Library/Caches/ms-playwright on MacOS
  • ~/.cache/ms-playwright on Linux

To cache the browser downloads between CI runs, cache this location in your CI configuration, against a hash of the Playwright version.

Playwright supports the DEBUG environment variable to output debug logs during execution. Setting it to pw:browser* is helpful while debugging Error: Failed to launch browser errors.

  1. DEBUG=pw:browser* npm run test

By default, Playwright launches browsers in headless mode. This can be changed by passing a flag when the browser is launched.

  1. // Works across chromium, firefox and webkit
  2. const { chromium } = require('playwright');
  3. const browser = await chromium.launch({ headless: false });