Intermittent I/O errors and SPDE data deletion occur when you write to HDFS in SAS® 9.4M8 (TS1M8)


In SAS 9.4M8, when jobs write SPDE datasets to an HDFS-backed file system, intermittent I/O errors might occur. Under certain failure conditions, the job leaves a corrupted SPDE table on HDFS. 
 
If you subsequently access the corrupted SPDE table or re-run the job, SAS might delete the associated SPDE data directory on HDFS, which results in the loss of your SPDE data.
 
SPDE-related messages might be displayed in the SAS log when this issue occurs:
 
TKESPTK- pread rc: 136 TKESPTK- dafddel: Deleting <SPDE data path> TKESPTK- unlink rc: 0