Home - News ( United States | United Kingdom | Italy | Germany ) - Football scores

Showing content from https://github.com/pmd/pmd/issues/2693 below:

[ci] Add integration tests with real open-source projects · Issue #2693 · pmd/pmd · GitHub

Is your feature request related to a problem? Please describe.
In order to find problems like #2663 earlier, we should have a way to run the latest PMD on real projects.
We already have pmd-regression-tester, but that does have some limitations (e.g. typeresolution) and has (maybe?) a slightly different goal (fine grained rule violation comparisons).

At least, we should see, when the real open-source projects fail to build (like smoke test), but better even would be to see, which rules behave different now and cause the builds to fail (or which stacktraces).

Describe the solution you'd like

• Improve and use directly pmd-regression-tester
  • Add the following projects to https://github.com/pmd/pmd/blob/master/.travis/project-list.xml
  • Implement Support auxclasspath / typeresolution pmd-regression-tester#48
  • Enhance project list configuration to have a flexible way to configure a script snippet, that tells the tool, how to
    • modify the project to use the latest PMD snapshot
    • execute PMD on the projects as the projects themselves do
    • where to find the pmd report files for diffing
    • see also reproducible builds "buildinfo" file for ideas
  • Add also non-java projects, e.g. apex
• Consider running not all projects on pull-request, but only for pushes, or maybe we could even split this into a completely separate build task? So that it appears as a second commit verification in github.
  • we could also use github-action maybe?

Projects that can be used:

• java
  • https://github.com/huxi/sulky
    • reproduce: change pmdVersion in build.gradle to 6.26.0 and run ./gradlew pmdMain pmdTest
    • > java.lang.NoClassDefFoundError: ch/qos/logback/core/joran/spi/JoranException
  • https://github.com/neowu/core-ng-project
    • Use openjdk14
    • reproduce: change pmdVersion in gradle/check.gradle to 6.26.0 and run `./gradlew pmdMain pmdTest
    • > java.lang.NoClassDefFoundError: javassist/CannotCompileException
• apex
  • https://github.com/SalesforceLabs/Schedul-o-matic-9000
    • from https://github.com/pmd/pmd/pull/2791/files#r490452799
  • https://github.com/apex-enterprise-patterns/fflib-apex-common
    • from Detect single rules with auto-gen-config pmd-regression-tester#69 (comment)
  • https://github.com/nawforce/apex-link/tree/master/samples
  • Github Search: https://github.com/search?l=Apex&o=desc&q=apex&s=stars&type=Repositories

Describe alternatives you've considered
Have a separate project, e.g. pmd/pmd-it .

• Add there some scripts to
  • clone one or more projects
  • modify the project to use the latest PMD snapshot
  • execute PMD on the projects as the projects themselves do
• Configure travis to build this
• Trigger the travis build after building the main repo pmd/pmd (e.g. via https://docs.travis-ci.com/user/triggering-builds/)
• That would give us a smoke test at least - but nothing to analyze directly.

Additional context

RetroSearch is an open source project built by @garambo | Open a GitHub Issue

Search and Browse the WWW like it's 1997 | Search results from DuckDuckGo

HTML: 3.2 | Encoding: UTF-8 | Version: 0.7.4