Rework how the IDEs from Plugin Verification are resolved. #1784 #2879
164 passed, 0 failed and 16 skipped
✅ build/test-results/test/TEST-org.jetbrains.intellij.platform.gradle.executableResolver.JbrResolverTest.xml
9 tests were completed in 4ms with 0 passed, 0 failed and 9 skipped.
Test suite | Passed | Failed | Skipped | Time |
---|---|---|---|---|
org.jetbrains.intellij.platform.gradle.executableResolver.JbrResolverTest | 9⚪ | 4ms |
✅ org.jetbrains.intellij.platform.gradle.executableResolver.JbrResolverTest
⚪ resolve 11_0_11b1536_2
⚪ resolve jbr_fd-11_0_13b1751_16
⚪ resolve jbr_nomod-11_0_13b1751_16
⚪ resolve 21_0_2b341_4
⚪ resolve 21_0_2b346_3
⚪ resolve 17_0_10b1087_17
⚪ resolve jbr_dcevm-11_0_13b1751_16
⚪ resolve 11_0_13b1751_16 in fd variant
⚪ resolve jbrsdk-11_0_13b1751_16
✅ build/test-results/test/TEST-org.jetbrains.intellij.platform.gradle.performanceTest.parsers.IdeaLogParserTest.xml
2 tests were completed in 8ms with 2 passed, 0 failed and 0 skipped.
Test suite | Passed | Failed | Skipped | Time |
---|---|---|---|---|
org.jetbrains.intellij.platform.gradle.performanceTest.parsers.IdeaLogParserTest | 2✅ | 8ms |
✅ org.jetbrains.intellij.platform.gradle.performanceTest.parsers.IdeaLogParserTest
✅ total time absent test
✅ simple parser test
✅ build/test-results/test/TEST-org.jetbrains.intellij.platform.gradle.performanceTest.parsers.SimpleIJPerfParserTest.xml
2 tests were completed in 8ms with 2 passed, 0 failed and 0 skipped.
Test suite | Passed | Failed | Skipped | Time |
---|---|---|---|---|
org.jetbrains.intellij.platform.gradle.performanceTest.parsers.SimpleIJPerfParserTest | 2✅ | 8ms |
✅ org.jetbrains.intellij.platform.gradle.performanceTest.parsers.SimpleIJPerfParserTest
✅ simple parser test
✅ assertTimeout is null
✅ build/test-results/test/TEST-org.jetbrains.intellij.platform.gradle.providers.AndroidStudioDownloadLinkValueSourceTest.xml
1 tests were completed in 41s with 1 passed, 0 failed and 0 skipped.
Test suite | Passed | Failed | Skipped | Time |
---|---|---|---|---|
org.jetbrains.intellij.platform.gradle.providers.AndroidStudioDownloadLinkValueSourceTest | 1✅ | 41s |
✅ org.jetbrains.intellij.platform.gradle.providers.AndroidStudioDownloadLinkValueSourceTest
✅ resolve the Android Studio link for the specific version and current OS
✅ build/test-results/test/TEST-org.jetbrains.intellij.platform.gradle.providers.CurrentPluginVersionValueSourceTest.xml
1 tests were completed in 1s with 1 passed, 0 failed and 0 skipped.
Test suite | Passed | Failed | Skipped | Time |
---|---|---|---|---|
org.jetbrains.intellij.platform.gradle.providers.CurrentPluginVersionValueSourceTest | 1✅ | 1s |
✅ org.jetbrains.intellij.platform.gradle.providers.CurrentPluginVersionValueSourceTest
✅ resolve the default plugin version when run from tests
✅ build/test-results/test/TEST-org.jetbrains.intellij.platform.gradle.providers.JavaRuntimeMetadataValueSourceTest.xml
1 tests were completed in 1s with 1 passed, 0 failed and 0 skipped.
Test suite | Passed | Failed | Skipped | Time |
---|---|---|---|---|
org.jetbrains.intellij.platform.gradle.providers.JavaRuntimeMetadataValueSourceTest | 1✅ | 1s |
✅ org.jetbrains.intellij.platform.gradle.providers.JavaRuntimeMetadataValueSourceTest
✅ resolve the architecture of the provided JVM
✅ build/test-results/test/TEST-org.jetbrains.intellij.platform.gradle.providers.ModuleDescriptorsValueSourceTest.xml
1 tests were completed in 31s with 1 passed, 0 failed and 0 skipped.
Test suite | Passed | Failed | Skipped | Time |
---|---|---|---|---|
org.jetbrains.intellij.platform.gradle.providers.ModuleDescriptorsValueSourceTest | 1✅ | 31s |
✅ org.jetbrains.intellij.platform.gradle.providers.ModuleDescriptorsValueSourceTest
✅ convert module-descriptors file into a set of coordinates
✅ build/test-results/test/TEST-org.jetbrains.intellij.platform.gradle.providers.ProductReleasesValueSourceTest.xml
3 tests were completed in 5s with 3 passed, 0 failed and 0 skipped.
Test suite | Passed | Failed | Skipped | Time |
---|---|---|---|---|
org.jetbrains.intellij.platform.gradle.providers.ProductReleasesValueSourceTest | 3✅ | 5s |
✅ org.jetbrains.intellij.platform.gradle.providers.ProductReleasesValueSourceTest
✅ list no releases for 231-230 range
✅ list EAP releases for RR in 232-233 range
✅ list RELEASE, EAP releases for IC, AS in 223-233 range
✅ build/test-results/test/TEST-org.jetbrains.intellij.platform.gradle.resolvers.path.IntelliJPluginVerifierPathResolverTest.xml
4 tests were completed in 9s with 4 passed, 0 failed and 0 skipped.
Test suite | Passed | Failed | Skipped | Time |
---|---|---|---|---|
org.jetbrains.intellij.platform.gradle.resolvers.path.IntelliJPluginVerifierPathResolverTest | 4✅ | 9s |
✅ org.jetbrains.intellij.platform.gradle.resolvers.path.IntelliJPluginVerifierPathResolverTest
✅ fail on a missing file provided with localPath
✅ use an existing file provided with localPath
✅ resolve latest Plugin Verifier
✅ resolve Plugin Verifier with fixed version
✅ build/test-results/test/TEST-org.jetbrains.intellij.platform.gradle.resolvers.path.JavaRuntimePathResolverTest.xml
4 tests were completed in 27s with 4 passed, 0 failed and 0 skipped.
Test suite | Passed | Failed | Skipped | Time |
---|---|---|---|---|
org.jetbrains.intellij.platform.gradle.resolvers.path.JavaRuntimePathResolverTest | 4✅ | 27s |
✅ org.jetbrains.intellij.platform.gradle.resolvers.path.JavaRuntimePathResolverTest
✅ resolve remote JetBrains Runtime path, macOS distribution
✅ resolve remote JetBrains Runtime path, Windows distribution
✅ resolve remote JetBrains Runtime path, Linux distribution
✅ resolve current JVM by default
✅ build/test-results/test/TEST-org.jetbrains.intellij.platform.gradle.resolvers.path.MarketplaceZipSignerPathResolverTest.xml
4 tests were completed in 8s with 4 passed, 0 failed and 0 skipped.
Test suite | Passed | Failed | Skipped | Time |
---|---|---|---|---|
org.jetbrains.intellij.platform.gradle.resolvers.path.MarketplaceZipSignerPathResolverTest | 4✅ | 8s |
✅ org.jetbrains.intellij.platform.gradle.resolvers.path.MarketplaceZipSignerPathResolverTest
✅ resolve latest Marketplace Zip Signer
✅ resolve Marketplace Zip Signer with fixed version
✅ fail on a missing file provided with localPath
✅ use an existing file provided with localPath
✅ build/test-results/test/TEST-org.jetbrains.intellij.platform.gradle.resolvers.path.ModuleDescriptorsPathResolverTest.xml
3 tests were completed in 878ms with 3 passed, 0 failed and 0 skipped.
Test suite | Passed | Failed | Skipped | Time |
---|---|---|---|---|
org.jetbrains.intellij.platform.gradle.resolvers.path.ModuleDescriptorsPathResolverTest | 3✅ | 878ms |
✅ org.jetbrains.intellij.platform.gradle.resolvers.path.ModuleDescriptorsPathResolverTest
✅ pass on a present file in provided platformPath
✅ resolve module-descriptors file using the current IntelliJ Platform
✅ fail on a missing file in provided platformPath
✅ build/test-results/test/TEST-org.jetbrains.intellij.platform.gradle.resolvers.path.PathResolverTest.xml
4 tests were completed in 10ms with 4 passed, 0 failed and 0 skipped.
Test suite | Passed | Failed | Skipped | Time |
---|---|---|---|---|
org.jetbrains.intellij.platform.gradle.resolvers.path.PathResolverTest | 4✅ | 10ms |
✅ org.jetbrains.intellij.platform.gradle.resolvers.path.PathResolverTest
✅ fail on first prediction
✅ fail as cannot be resolved with any prediction
✅ resolve path with the second prediction
✅ don't resolve path with the second prediction
✅ build/test-results/test/TEST-org.jetbrains.intellij.platform.gradle.resolvers.path.ProductInfoPathResolverTest.xml
5 tests were completed in 1s with 5 passed, 0 failed and 0 skipped.
Test suite | Passed | Failed | Skipped | Time |
---|---|---|---|---|
org.jetbrains.intellij.platform.gradle.resolvers.path.ProductInfoPathResolverTest | 5✅ | 1s |
✅ org.jetbrains.intellij.platform.gradle.resolvers.path.ProductInfoPathResolverTest
✅ pass with a file located in Resources within the provided directory to the resolver
✅ pass with a file located in provided directory to the resolver
✅ resolve product-info file using the current IntelliJ Platform
✅ pass with a file provided directly to the resolver
✅ fail on a missing file in provided platformPath
✅ build/test-results/test/TEST-org.jetbrains.intellij.platform.gradle.tasks.BuildPluginTaskTest.xml
9 tests were completed in 218s with 9 passed, 0 failed and 0 skipped.
Test suite | Passed | Failed | Skipped | Time |
---|---|---|---|---|
org.jetbrains.intellij.platform.gradle.tasks.BuildPluginTaskTest | 9✅ | 218s |
✅ org.jetbrains.intellij.platform.gradle.tasks.BuildPluginTaskTest
✅ provide MANIFEST_MF with build details
✅ build plugin distribution
✅ can compile classes that depends on external plugins
✅ include only relevant searchableOptions_jar
✅ build plugin distribution with Kotlin
✅ use gradle project name for distribution if plugin name is not defined
✅ can compile classes that depend on external plugin with classes directory
✅ use custom sandbox for distribution
✅ build plugin without sources
✅ build/test-results/test/TEST-org.jetbrains.intellij.platform.gradle.tasks.BuildSearchableOptionsTaskTest.xml
4 tests were completed in 32s with 4 passed, 0 failed and 0 skipped.
Test suite | Passed | Failed | Skipped | Time |
---|---|---|---|---|
org.jetbrains.intellij.platform.gradle.tasks.BuildSearchableOptionsTaskTest | 4✅ | 32s |
✅ org.jetbrains.intellij.platform.gradle.tasks.BuildSearchableOptionsTaskTest
✅ build searchable options produces XML if enabled via property and explicitly configured
✅ skip build searchable options if disabled via extension
✅ build searchable options produces XML
✅ skip build searchable options if disabled via property and explicitly configured
✅ build/test-results/test/TEST-org.jetbrains.intellij.platform.gradle.tasks.InitializeIntelliJPlatformPluginTaskTest.xml
5 tests were completed in 3s with 5 passed, 0 failed and 0 skipped.
Test suite | Passed | Failed | Skipped | Time |
---|---|---|---|---|
org.jetbrains.intellij.platform.gradle.tasks.InitializeIntelliJPlatformPluginTaskTest | 5✅ | 3s |
✅ org.jetbrains.intellij.platform.gradle.tasks.InitializeIntelliJPlatformPluginTaskTest
✅ report outdated plugin
✅ skip version check is disabled with existing lock file
✅ skip version check when offline
✅ skip version check is disabled with BuildFeature
✅ creates coroutines-javaagent file
✅ build/test-results/test/TEST-org.jetbrains.intellij.platform.gradle.tasks.IntelliJInstrumentCodeTaskTest.xml
6 tests were completed in 10s with 6 passed, 0 failed and 0 skipped.
Test suite | Passed | Failed | Skipped | Time |
---|---|---|---|---|
org.jetbrains.intellij.platform.gradle.tasks.IntelliJInstrumentCodeTaskTest | 6✅ | 10s |
✅ org.jetbrains.intellij.platform.gradle.tasks.IntelliJInstrumentCodeTaskTest
✅ instrument code with nullability annotations
✅ do not instrument code on empty source sets
✅ instrumentation does not invalidate compile tasks
✅ instrument kotlin forms
✅ do not instrument code if option is set to false
✅ instrument tests with nullability annotations
✅ build/test-results/test/TEST-org.jetbrains.intellij.platform.gradle.tasks.JarSearchableOptionsTaskTest.xml
3 tests were completed in 30s with 3 passed, 0 failed and 0 skipped.
Test suite | Passed | Failed | Skipped | Time |
---|---|---|---|---|
org.jetbrains.intellij.platform.gradle.tasks.JarSearchableOptionsTaskTest | 3✅ | 30s |
✅ org.jetbrains.intellij.platform.gradle.tasks.JarSearchableOptionsTaskTest
✅ jar searchable options disabled via property and explicitly configured
✅ jar searchable options produces archive if enabled via property and explicitly configured
✅ jar searchable options produces archive
✅ build/test-results/test/TEST-org.jetbrains.intellij.platform.gradle.tasks.PatchPluginXmlTaskTest.xml
14 tests were completed in 8s with 14 passed, 0 failed and 0 skipped.
Test suite | Passed | Failed | Skipped | Time |
---|---|---|---|---|
org.jetbrains.intellij.platform.gradle.tasks.PatchPluginXmlTaskTest | 14✅ | 8s |
✅ org.jetbrains.intellij.platform.gradle.tasks.PatchPluginXmlTaskTest
✅ unset the until-build attribute with null-provider passed to extension
✅ add version tags in the beginning of file
✅ do not update version tag if project_version is undefined
✅ patch change notes
✅ override version and since until builds
✅ unset the until-build attribute with null-provider passed to task
✅ patch version and since until builds
✅ patch patching preserves UTF-8 characters
✅ patch description
✅ patch id
✅ ignore unsetting the until-build with null passed to extension
✅ do not update id if pluginId is undefined
✅ override the description specified in the XML file
✅ skip patch task if intellij version did not changed
✅ build/test-results/test/TEST-org.jetbrains.intellij.platform.gradle.tasks.PrepareSandboxTaskTest.xml
25 tests were completed in 27s with 22 passed, 0 failed and 3 skipped.
Test suite | Passed | Failed | Skipped | Time |
---|---|---|---|---|
org.jetbrains.intellij.platform.gradle.tasks.PrepareSandboxTaskTest | 22✅ | 3⚪ | 27s |
✅ org.jetbrains.intellij.platform.gradle.tasks.PrepareSandboxTaskTest
⚪ prepare sandbox for two plugins
✅ create sandbox in a custom location
✅ disable ide update with updates_xml empty
✅ prepare sandbox with external zip-type plugin
✅ create test sandbox in a custom location with custom suffix
✅ use gradle project name if plugin name is not defined
✅ prepare sandbox with external jar-type plugin
⚪ prepare sandbox for two plugins with evaluated project
✅ replace jar on version changing
✅ create test sandbox in a custom location
✅ disable ide update without value attribute
✅ prepare sandbox for splitMode with plugin installed on backend and frontend
✅ disable ide update without check_needed option
✅ rename jars with same names
✅ prepare custom sandbox task
✅ disable ide update with complex updates_xml
✅ disable ide update without updates_xml
✅ prepare sandbox task without plugin_xml
✅ prepare sandbox for splitMode with plugin installed on backend
✅ disable ide update without updates component
⚪ prepare sandbox with plugin dependency with classes directory
✅ prepareTestingSandbox runs before test
✅ prepare sandbox task
✅ prepare sandbox for splitMode with plugin installed on frontend
✅ disable ide update
✅ build/test-results/test/TEST-org.jetbrains.intellij.platform.gradle.tasks.PrintBundledPluginsTaskTest.xml
1 tests were completed in 206ms with 1 passed, 0 failed and 0 skipped.
Test suite | Passed | Failed | Skipped | Time |
---|---|---|---|---|
org.jetbrains.intellij.platform.gradle.tasks.PrintBundledPluginsTaskTest | 1✅ | 206ms |
✅ org.jetbrains.intellij.platform.gradle.tasks.PrintBundledPluginsTaskTest
✅ print bundled plugins
✅ build/test-results/test/TEST-org.jetbrains.intellij.platform.gradle.tasks.PrintProductsReleasesTaskTest.xml
1 tests were completed in 2s with 1 passed, 0 failed and 0 skipped.
Test suite | Passed | Failed | Skipped | Time |
---|---|---|---|---|
org.jetbrains.intellij.platform.gradle.tasks.PrintProductsReleasesTaskTest | 1✅ | 2s |
✅ org.jetbrains.intellij.platform.gradle.tasks.PrintProductsReleasesTaskTest
✅ print product releases
✅ build/test-results/test/TEST-org.jetbrains.intellij.platform.gradle.tasks.ProcessResourcesTaskTest.xml
3 tests were completed in 1s with 3 passed, 0 failed and 0 skipped.
Test suite | Passed | Failed | Skipped | Time |
---|---|---|---|---|
org.jetbrains.intellij.platform.gradle.tasks.ProcessResourcesTaskTest | 3✅ | 1s |
✅ org.jetbrains.intellij.platform.gradle.tasks.ProcessResourcesTaskTest
✅ do not break incremental processing
✅ use patched plugin xml files
✅ update resources on updated patched xml files
✅ build/test-results/test/TEST-org.jetbrains.intellij.platform.gradle.tasks.PublishPluginTaskTest.xml
4 tests were completed in 5s with 4 passed, 0 failed and 0 skipped.
Test suite | Passed | Failed | Skipped | Time |
---|---|---|---|---|
org.jetbrains.intellij.platform.gradle.tasks.PublishPluginTaskTest | 4✅ | 5s |
✅ org.jetbrains.intellij.platform.gradle.tasks.PublishPluginTaskTest
✅ fail publishing if token is missing
✅ use unsigned artifact for publication if no signing is configured
✅ use signed artifact for publication
✅ fail publishing when token is not valid
✅ build/test-results/test/TEST-org.jetbrains.intellij.platform.gradle.tasks.SignPluginTaskTest.xml
10 tests were completed in 18s with 10 passed, 0 failed and 0 skipped.
Test suite | Passed | Failed | Skipped | Time |
---|---|---|---|---|
org.jetbrains.intellij.platform.gradle.tasks.SignPluginTaskTest | 10✅ | 18s |
✅ org.jetbrains.intellij.platform.gradle.tasks.SignPluginTaskTest
✅ fail on signing with incorrect password provided
✅ sign plugin with password provided
✅ run Marketplace ZIP Signer in specified version using certificateChain and privateKey
✅ run Marketplace ZIP Signer in the latest version
✅ skip Marketplace ZIP Signer task if no key and certificateChain were provided
✅ fail on signing without password provided
✅ run Marketplace ZIP Signer and fail on invalid version
✅ run Marketplace ZIP Signer and fail on invalid CLI path
✅ run Marketplace ZIP Signer in specified version using certificateChainFile and privateKeyFile
✅ output file contains version when specified in build file
✅ build/test-results/test/TEST-org.jetbrains.intellij.platform.gradle.tasks.VerifyPluginProjectConfigurationTaskTest.xml
13 tests were completed in 11s with 13 passed, 0 failed and 0 skipped.
Test suite | Passed | Failed | Skipped | Time |
---|---|---|---|---|
org.jetbrains.intellij.platform.gradle.tasks.VerifyPluginProjectConfigurationTaskTest | 13✅ | 11s |
✅ org.jetbrains.intellij.platform.gradle.tasks.VerifyPluginProjectConfigurationTaskTest
✅ report too high Kotlin jvmTarget
✅ report IntelliJ Platform cache missing in gitignore
✅ report Kotlin stdlib bundling
✅ report too low Kotlin languageVersion
✅ report too high Java targetCompatibility
✅ do not show errors when configuration is valid
✅ report invalid sinceBuild if contains wildcard
✅ do not report too high patch number in Kotlin apiVersion
✅ report too low Java sourceCompatibility
✅ report too low since-build
✅ report too high Kotlin apiVersion
✅ do not report too low patch number in Kotlin languageVersion
✅ report kotlinx-coroutines dependency
✅ build/test-results/test/TEST-org.jetbrains.intellij.platform.gradle.tasks.VerifyPluginSignatureTaskTest.xml
5 tests were completed in 4s with 5 passed, 0 failed and 0 skipped.
Test suite | Passed | Failed | Skipped | Time |
---|---|---|---|---|
org.jetbrains.intellij.platform.gradle.tasks.VerifyPluginSignatureTaskTest | 5✅ | 4s |
✅ org.jetbrains.intellij.platform.gradle.tasks.VerifyPluginSignatureTaskTest
✅ verify plugin signature with certificateChain
✅ verify plugin signed with password provided
✅ skip plugin signature verification task if plugin signing is not configured
✅ verify plugin signature with certificateChainFile
✅ verify unsigned plugin archive
✅ build/test-results/test/TEST-org.jetbrains.intellij.platform.gradle.tasks.VerifyPluginStructureTaskTest.xml
9 tests were completed in 7s with 9 passed, 0 failed and 0 skipped.
Test suite | Passed | Failed | Skipped | Time |
---|---|---|---|---|
org.jetbrains.intellij.platform.gradle.tasks.VerifyPluginStructureTaskTest | 9✅ | 7s |
✅ org.jetbrains.intellij.platform.gradle.tasks.VerifyPluginStructureTaskTest
✅ do not fail on errors if option is enabled
✅ fail on errors by default
✅ fail on errors if ignore unacceptable warnings option is enabled
✅ do not fail if there are no errors and warnings
✅ do not fail on unacceptable warnings if ignoreFailures option is enabled
✅ do not fail on unacceptable warnings if option is enabled
✅ do not fail on warning by default
✅ fail on warning if option is disabled
✅ fail on unacceptable warnings by default
✅ build/test-results/test/TEST-org.jetbrains.intellij.platform.gradle.tasks.VerifyPluginTaskTest.xml
22 tests were completed in 151s with 18 passed, 0 failed and 4 skipped.
Test suite | Passed | Failed | Skipped | Time |
---|---|---|---|---|
org.jetbrains.intellij.platform.gradle.tasks.VerifyPluginTaskTest | 18✅ | 4⚪ | 151s |
✅ org.jetbrains.intellij.platform.gradle.tasks.VerifyPluginTaskTest
✅ pass on recommended ides
✅ pass on any failureLevel
✅ run plugin verifier in specified version
✅ run plugin verifier fails on old version lower than 1_255
✅ set verification reports directory
⚪ test plugin against two IDEs
✅ run plugin verifier in the latest version
✅ set verification reports with default settings
⚪ run plugin verifier in offline mode
✅ set ignored problems file
✅ pass on CLI arguments the internal API usage mode as a free arg
✅ pass on Deprecated API usages
✅ fail on incorrect ide version
✅ set verification reports output formats
✅ run plugin verifier and fail on invalid CLI path
✅ fail on any failureLevel
✅ fail on Deprecated API usages
⚪ pass on CLI arguments passed as free args
✅ fail on verifyPlugin task
✅ set verification reports with empty set of output formats
✅ warn about no IDE picked for verification
⚪ test plugin against Android Studio
✅ build/test-results/test/TEST-org.jetbrains.intellij.platform.gradle.VersionTest.xml
2 tests were completed in 41ms with 2 passed, 0 failed and 0 skipped.
Test suite | Passed | Failed | Skipped | Time |
---|---|---|---|---|
org.jetbrains.intellij.platform.gradle.VersionTest | 2✅ | 41ms |
✅ org.jetbrains.intellij.platform.gradle.VersionTest
✅ version parsing
✅ version comparison