Multi-agent Cooperative Evolution Analysis For Spatial Detection System

Advances in intelligent satellite technology and inter-satellite networking technology will make spatial detection systems more flexible and resilient.However,the spatial detection system will encounter the dilemma of cooperation,which affects the improvement of system performance.First of all,on the supply side,the uneven distribution of mission targets leads to the inefficient use of satellites in orbit.These satellites don’t pay the cost of observation tasks,but they share the benefits of completing the mission and became free riders in the system.Secondly,the selfishness makes individuals on ground segment wanna occupy more satellite resources,but this can lead to uneven distribution of resources,which is not conducive to the improvement of users’ overall revenue.Based on the evolutionary game theory,this paper analyzes the conditions conducive to cooperative behavior from both the supply side and the user side of observation resources.So that the spatial distribution of satellites in orbit will develop in a direction that meets the needs of the mission.And the strategy of sharing limited observation resources among users will develop in a direction that is conducive to the improvement of overall revenue.The main work and contributions are divided into the following three parts:(1)Building a cooperative evolution dynamics model for satellites in orbit.First,after analyzing the composition and running characteristics of the satellites in orbit,we model the interaction between effectively used satellites and the unused satellites as a public goods game,and the satellites are modeled as agents.Then,based on the evolutionary game theory,we build an evolutionary dynamics model for the process of satellite replacement.Finally,we analyze the conditions that are conducive to the evolution of satellites’ spatial distribution.(2)Proposing an adaptive investment strategy to balance cooperative flexibility and cooperative stability.In the process of evolution in confrontational environment,effectively used satellites not only have strong cooperative stability against the competition of satellites not being used effectively,but also possess strong flexibility of cooperation to resist the threat of anti-satellite weapons.First,we analyze the correlation between cooperative flexibility and cooperative stability.Then,we study the influence of individual investment on the flexibility and stability of cooperation.Finally,we propose an adaptive investment strategy to solve the problem that strong cooperative flexibility and cooperative stability will not coexist.(3)Proposing an improved policy update rule to promote cooperative behavior in the network.On the ground segment,the competition between users for satellite resources constitute a network.First,we model a user as an agent,and model the interaction between users as a prisoner’s dilemma game.Then,we analyze the impact of network structure on cooperation.Finally,aiming at the problem that the level of cooperation on the network decreases with the increase of betrayal revenue,we propose an improved policy update rule to promote cooperative behavior in the network.