A Stream-Oriented Real-Time Fault Tolerant Strategy for Monitoring Big Data of Power Distribution Network Based on Spark

Abstract

Aiming at the existing problem of monitoring data volume blowout and lack of valid real-time distributed fault tolerant strategy in power distribution network, a new fault tolerant strategy based on Spark micro batch computing model is proposed. Depending on the design technique of resilient distributed data set renewal and lineage mechanism, the lineage chain retrospection in fault tolerance of distributed data is realized. This strategy can meet the real-time fault tolerant performance requirements of monitoring big data, and it is of evident practical value for improving the fault tolerant performance of dispatching system in intelligent power distribution network.