Commits on Jul 23, 2024

1. Add support for Log4j2 for Spark …

   This changes allows users to introduce log configuration using spark log4j2. This is important because Spark 3.3 onwards migrate from Log4j 1.x, and that Log4j 1.x has reached end of life.
   
   Below a snippet from [Spark core migration guide](https://spark.apache.org/docs/latest/core-migration-guide.html#upgrading-from-core-32-to-33):
   
   > Since Spark 3.3, Spark migrates its log4j dependency from 1.x to 2.x because log4j 1.x has reached end of life and is no longer supported by the community. Vulnerabilities reported after August 2015 against log4j 1.x were not checked and will not be fixed. Users should rewrite original log4j properties files using log4j2 syntax (XML, JSON, YAML, or properties format). Spark rewrites the conf/log4j.properties.template which is included in Spark distribution, to conf/log4j2.properties.template with log4j2 properties format.

   

   mohamed-ali authored Jul 23, 2024
   Configuration menu

   • View commit details
   • Copy full SHA for 38b0f25
   • Browse repository at this point

   Copy the full SHA

   38b0f25 View commit details

   Browse the repository at this point in the history