Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SPARK][JAR-VERIFIER] verify major java version of compiled classes #2859

Merged
merged 1 commit into from
Jul 17, 2024

Conversation

pawel-big-lebowski
Copy link
Collaborator

@pawel-big-lebowski pawel-big-lebowski commented Jul 17, 2024

In order to support Spark 4.0, we want to be able to run gradle tests with Java 17 and be able to compile openlineage-spark with Java 17 and target compatibility set to Java 8. It's reasonable to make sure and verify if all the classes compiled have bytecode version corresponding to Java 8.

This PR extends JarVerifier plugin to check majorJavaVersion of each class from within a packed jar. It makes sure if all the versions are below a configured value. If no configured value found, then 52 is the default (which represents Java 8).

@pawel-big-lebowski pawel-big-lebowski force-pushed the jar-verifier/verify-class-compiler branch from 2e74dc6 to 4e0712d Compare July 17, 2024 10:40
@boring-cyborg boring-cyborg bot added the area:documentation Improvements or additions to documentation label Jul 17, 2024
@pawel-big-lebowski pawel-big-lebowski force-pushed the jar-verifier/verify-class-compiler branch from 4e0712d to 56f0de6 Compare July 17, 2024 10:52
@pawel-big-lebowski pawel-big-lebowski force-pushed the jar-verifier/verify-class-compiler branch from 56f0de6 to 811c803 Compare July 17, 2024 10:54
@pawel-big-lebowski pawel-big-lebowski marked this pull request as ready for review July 17, 2024 11:27
@pawel-big-lebowski pawel-big-lebowski requested a review from a team as a code owner July 17, 2024 11:27
@mobuchowski mobuchowski merged commit 094ce0f into main Jul 17, 2024
33 checks passed
@mobuchowski mobuchowski deleted the jar-verifier/verify-class-compiler branch July 17, 2024 12:59
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area:documentation Improvements or additions to documentation area:integration/spark
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants