Design And Research Of Workflow Framework For Seismic Data Processing

Seismic exploration technology is the development of petroleum energy,especially the important technical means for exploration under complex geological conditions.Seismic exploration firstly uses artificial means to excite seismic waves.It uses seismic waves to encounter the characteristics of reflection and refraction in the interface of rock layers with different media properties,and infers the specific structural properties of underground rock formations by analyzing and processing the received seismic wave data.To achieve the purpose of oil exploration.With the continuous application of new exploration technologies and the transformation of China's petroleum seismic exploration from conventional oil and gas reservoirs to unconventional oil and gas reservoirs such as lithology and fractures,data calculation and processing algorithms are moving from simple “sound wave media” algorithms to complex“elastic wave media” algorithms.The scale of exploration data is spanning from TB to PB.The huge amount of data and complicated processing flow make the conventional computing environment and traditional working methods unable to meet the needs of current exploration technologies.In response to the above issues,this paper attempts to use the Restful development framework Django to build a Web-based cluster front end,integrate the petroleum exploration industry processing software using scientific workflow related technologies,and standardize the data processing flow to establish the interface between exploration personnel and high-performance computing infrastructures allowing exploration personnel to make full use of our high-performance computing resources to process seismic exploration data.This article focuses on the following two aspects of workflow technology to build a Web-based cluster front end:1.process design and composition: The user adds the required software and various required parameters of the process through the form of text or graphic interface and defines the dependencies between various softwares to form an abstract workflow.2.workflow expression : since the abstract workflow cannot be parsed by the high-performance resource manager.This requires the workflow description language to describe the abstract workflow as a document that the high-performance resource manager can parse through the flow representation phase.The platform utilizes the Jsplumb component to provide users with a friendly workflow editing interface,allowing users to use the industry software integrated into the platform to edit the work process flow that meets their needs in the form of DAG diagrams,and store the edited abstract workflow into the database.Most of the petroleum seismic processing software belongs to human-computer interactive software and cannot be directly submitted to high-performance clusters as a batch software.This paper proposes a software remote visual access integration mechanism based on vncserver+openbox+novnc,which allows users to edit Workflows interact remotely with related software.The platform design is based on the business process submission scheme in XML format.It represents the abstract workflow edited by the user as an XML file conforming to the format of the high-performance resource manager,and provides a loose coupling mechanism with the high-performance resource manager to facilitate the platform's later maintenance and upgrades.The platform also provides job execution monitoring capabilities that use javascript components to graphically and intuitively display the process and status of job execution.The work of this article is based on the key national key technology and application demonstration project-petroleum seismic exploration industry application platform based on independent innovation.It integrates and manages "conventional processing-velocity modeling-offset imaging-Construction interpretation" and other conventional processes in the petroleum seismic exploration industry through scientific workflow methods.Through the industry software integration,process modeling,process interpretation,submit implementation to standardized data processing processes,makeing full use of China's increasingly powerful high-performance computing resources,improving the efficiency of China's petroleum seismic exploration industry.