Skip to content
This repository has been archived by the owner on Apr 3, 2020. It is now read-only.
Fan, Yugang edited this page Mar 18, 2016 · 13 revisions

Web Testing Service

How well does your browser or web runtime support web standard?

In the recent years, more and more universal browser benchmark test tools are developed for browsers, especially to test browser with following approaches: HTML5 supports, loading speeds, DOM performances, graphic performances and JavaScript benchmarks. But how well does your browser or web runtime support web standard on cross platforms like PC, smartphone or tablet, even on IoT devices? What's the detailed web API your browser doesn't support align to specification? Any visualized test cases for CSS? Is there any other web API test cases besides W3C specifications?

Web Testing Service, your best choice today!

The Web Testing Service hosts comprehensive web test suites and supports users to run them online through browsers or web runtimes. It also provides web socket server and some test media content in the backend. What you can feel directly in your tests is a friendly web page to customize tests, control testing, and show test results.

WTS ARCH

Get Started

  • Visit http://wts.crosswalk-project.org/ on your web browser or web runtime on target devices
  • Click "Select Specifications" button to select specifications
  • Click "Run" button to run the tests
  • The "Download JSON results" button will appear when the tests are completed, you can download the test results with JSON format

Download

Download the latest release at Web Test Client Releases

Features

  • Based on W3C Web Testing Service runner
  • Python backend HTTP/HTTPS/Web Socket/WebSocket Secure server and test streams
  • Tests specifications selection
  • Tests specifications searching
  • Run tests in new window or "iframe"
  • Testing timeout configuration
  • JS(AUTO)/Manual/Reference tests selection
  • Progress bar to show testing status
  • Test pause/resume/stop/rerun
  • Test result summary and dumping
  • UI Optimization for cross platforms
  • Simple to deploy
  • "Share Mode" web test client application to run as application to test Crosswalk runtime library.

More Options

Tests Selection

tests selection image

Tests Searching

tests searching image

Three Test Types

three test types

  • JavaScript Tests: JavaScript tests use W3C's test framework known as testharness.js
  • Reference Tests: A refer test is a test that compares the visual output of one file (the test case) with the output of one or more other files (the references)
  • Manual Tests: All tests which need check the result manually

Advanced Options

advanced options

  • Run Tests in "iframe": Selected default, the test will be tested in frame. User can unselect 'Run tests in iframe', then test will be tested on the new open window
  • Timeout Multiplier: The case will be marked as "BLOCK" if test time of the case over the "timeout multiplier" x 20000 ms
  • Dump JSON(debug): The bottom of page will show the raw results json if it be selected

Others

  • "About" section shows the information of service, tests version and help details.
  • URL "http://wts.crosswalk-project.org/tests/" will show the tests repository, the user can click the tests file directly to run single test case
  • Clicking "Run"/"Rerun" button to run all tests selected. The "Progress" bar and "Details" table will show the status dynamically. The "Stop" button will show once the runner start to run the tests

execution steps

  • "Pause" button will pause the testing, the user also can resume the testing after click the "Resume" button
  • In particular, after running all auto tests, the runner will start to run refer tests, and a reference test harness will appear, the user can click the buttons to show test file or refer test file, and input the test result by clicking "Pass"/"Fail"/"Block" buttons after comparing the test file and reference test file
  • The manual tests will be loaded at the last, the manual harness will popup just like the reference test harness

execution steps

Clone this wiki locally