Overview: A caching system management used in SparkSQL/Apache Spark and HDFS Requirements: SparkSQL, ApacheSpark, HDFS, Data caching algorithm and English skills. Motivation: We are now using the HDFS to store and manage the data. And we do also the data analytics using SparkSQL in Apache Spark. Normally, the Application Driver […]