[Allure plugin] Add/update to allure2

[patrjam]

Hi,

we want to use this attachments api for screen-diff-plugin with turn on overlay diff for every step:

allure.attachment('screen diff', screenDiffJson, {
   contentType: 'application/vnd.allure.image.diff',
   fileExtension: 'json' 
})

(PR with added API here: allure-framework/allure-js#221)

In codeceptjs repository is actually used very old package version from this repo: https://github.com/allure-framework/allure-js-commons with version

"allure-js-commons": "^1.3.2",

which should be deprecated and code is moved here to another repo: https://github.com/allure-framework/allure-js (latest version 2.0.0-beta.9)

I got info from Allure site, reports actually looks like this:
imagediff.zip
(Just unzip, go to folder and run allure serve .)

[Elverslane]

+1

[Vorobeyko]

use enableScreenshotDiffPlugin
https://codecept.io/plugins/#allure

[Elverslane]

@Vorobeyko no way. Error for code above
Error processing suite.after event: Error: attribute value for name 'type' should be a primitive (string, number, boolean, null, or undefined)

[Vorobeyko]

Can you send your config file please?

[Elverslane]

exports.config = {
    tests: './user-scenario/**/*.test.ts',
    output: '../../.codeceptjs-output',
    plugins: {
        screenshotOnFail: {
            enabled: true,
            fullPageScreenshots: true,
        },
        allure: {
            enableScreenshotDiffPlugin: true,
            enabled: true,
            outputDir: '.codeceptjs-output/allure-report',
        },
    },
    helpers: {
        Playwright: {
            url: 'http://localhost:9999',
            waitForTimeout: 8000,
            waitForAction: 200,
            show: !!process.env.VISUAL,
            keepCookies: false,
            restart: true,
            windowSize: '1650x1080',
            browser: 'chromium',
            chromium: {
                args: [
                    '--window-size=1650,1080',
                    '--disable-dev-shm-usage',
                ],
                defaultViewport: {
                    width: 1650,
                    height: 1080,
                },
                executablePath: process.env.CHROMIUM_PATH,
            },
        },
        FileSystem: {},
    },
    include: {
        I: './settings/steps.ts',
    },
    bootstrap: null,
    mocha: {},
    name: 'e2e-tests',
    require: ['ts-node/register', 'tsconfig-paths/register'],
};

[Trawais]

Hi everybody.
I'm talking behalf of patrjam.
We definitely using the flag in the config for the enableScreenshotDiffPlugin option. The problem is it simply does not work. It seems to us the codeceptjs allure plugin is still using allure v1 format for the report. But the screenshot diff plugin in allure dashboard (at least according to the code) seems to consume the allure v2 report. I guess as patrjam mentioned in the description the whole report system must be upgraded from the allure v1 to allure v2. Otherwise the screenshot diff plugin will not work as expected anymore.
If you compare the report placed in the imagediff.zip archive file, you can see the generated report for the allure framework looks completely different (because it's the v2). The codeceptjs allure plugin generates still reports in the v1.
Let me know if we should provide more clarification.

[patrjam]

For completely information, allure1 has different approach and also different type of format than allure2. Old format for allure1 was xml and for new allure2 is json

[xyngfei]

@patrjam, do you think based on the current codeceptjs v3.0.6 with allure-commandline v2.13.8, possible to generate the json raw test result?

[kobenguyent]

allure plugin is now maintained by allure team https://github.com/allure-framework/allure-js/tree/master/packages/allure-codeceptjs