Skip to content

Commit

Permalink
[SPARK-20664][CORE] Delete stale application data from SHS.
Browse files Browse the repository at this point in the history 
Detect the deletion of event log files from storage, and remove
data about the related application attempt in the SHS.

Also contains code to fix SPARK-21571 based on code by ericvandenbergfb.

Author: Marcelo Vanzin <[email protected]>

Closes #20138 from vanzin/SPARK-20664.

(cherry picked from commit fed2139)
Signed-off-by: Imran Rashid <[email protected]>
  • Loading branch information
@squito
Marcelo Vanzin authored and squito committed Jan 19, 2018
1 parent ffe4591 commit 4b79514
Show file tree
Hide file tree
Showing 3 changed files with 306 additions and 112 deletions.
Loading

0 comments on commit 4b79514

Please sign in to comment.