Based on the discussion in MDL-45714:

A Backup/Restore should only try to delete it's own directory.
Cron should cleanup old (stale) directories
Cron should have some way of discerning if a directory is still in use (timestamp, locks, etc)