Turn off MathJax
Article Contents
MA Fuli, JI Zhen, YANG Xiaoyan, YU Qinsi, LI Bing, LUO Wentian, TONG Jizhou. Design of the EP Satellite Data Preprocessing and Distribution Service Platform (in Chinese). Chinese Journal of Space Science, 2025, 45(4): 1-16 doi: 10.11728/cjss2025.04.2024-0092
Citation: MA Fuli, JI Zhen, YANG Xiaoyan, YU Qinsi, LI Bing, LUO Wentian, TONG Jizhou. Design of the EP Satellite Data Preprocessing and Distribution Service Platform (in Chinese). Chinese Journal of Space Science, 2025, 45(4): 1-16 doi: 10.11728/cjss2025.04.2024-0092

Design of the EP Satellite Data Preprocessing and Distribution Service Platform

doi: 10.11728/cjss2025.04.2024-0092 cstr: 32142.14.cjss.2024-0092
  • Received Date: 2024-07-02
  • Rev Recd Date: 2024-12-05
  • Available Online: 2024-12-09
  • Along with the development of space exploration technology and the communication methods between satellite and the Earth, the requirements for the efficiency of data transmission and processing in astronomical missions are increasing day by day. The article introduces the design and implementation of a data preprocessing and distribution platform, which focuses on the processing and distribution requirements of various types of data in the Einstein Probe (EP) mission. The EP mission downlinks data via four different channels, including X-band, S-band, VHF channel, and Beidou channel. For each data channel, the data processing methods and efficiency requirements are different, such as the VHF and Beidou data needs to be processed in real-time, the X-band data needs to be processed comprehensively by different types of data packets. During the development process, the key technologies of the EP satellite data preprocessing and analysis platform have been studied. At the meanwhile, several key algorithms have been designed, such as the level 0 data processing method, level 1 data processing method and data product integrity interpretation based on observation organization. Especially, regarding the high timeliness requirements for the release of astronomical alert information in VHF data and Beidou short messages, different priority data preprocessing and distribution workflows were designed. The EP mission data preprocessing and distribution service platform adopts a hierarchical architecture design. The application results indicate that the platform has the ability to preprocess, manage and distribute various types of data in EP mission automatically, efficiently, and accurately. The operational process of the platform supports the different processing flows for different data products and simultaneous data distribution and acquisition for multiple users. The platform has good scalability and efficiency. The various levels and types of scientific data products processed by the platform have high accuracy, can satisfy the application requirements of EP scientific teams.

     

  • loading
  • [1]
    National Research Council. New Worlds, New Horizons in Astronomy and Astrophysics[M]. Washington: The National Academies Press, 2010
    [2]
    ABBOTT B P, ABBOTT R, ABBOTT T D, et al. GW151226: observation of gravitational waves from a 22-solar-mass binary black hole coalescence[J]. Physical Review Letters, 2016, 116(24): 241103 doi: 10.1103/PhysRevLett.116.241103
    [3]
    袁为民, 张臣, 陈勇, 等. 爱因斯坦探针: 探索变幻多姿的X射线宇宙[J]. 中国科学: 物理学 力学 天文学, 2018, 48(3): 039502

    YUAN Weimin, ZHANG Chen, CHEN Yong, et al. Einstein probe: exploring the ever-changing X-ray universe[J]. Scientia Sinica Physica, Mechanica & Astronomica, 2018, 48(3): 039502
    [4]
    ZHANG Z, BARBARY K, NOTHAFT F A, et al. Kira: processing astronomy imagery using big data technology[J]. IEEE Transactions on Big Data, 2020, 6(2): 369-381 doi: 10.1109/TBDATA.2016.2599926
    [5]
    高立京, 陈志敏, 王春梅, 等. 基于Flink的空间科学卫星数据实时处理方法[J]. 计算机仿真, 2023, 40(7): 26-31,290 doi: 10.3969/j.issn.1006-9348.2023.07.005

    GAO Lijing, CHEN Zhimin, WANG Chunmei, et al. Real-time processing method of space science satellite downlink data based on streaming computing[J]. Computer Simulation, 2023, 40(7): 26-31,290 doi: 10.3969/j.issn.1006-9348.2023.07.005
    [6]
    王静, 王春梅, 智佳, 等. 面向有效载荷高速数据流的数据处理方法[J]. 计算机工程与设计, 2017, 38(4): 941-945

    WANG Jing, WANG Chunmei, ZHI Jia, et al. Technology of data processing for high speed data stream of payload[J]. Computer Engineering and Design, 2017, 38(4): 941-945
    [7]
    张文彬, 王春梅, 王静, 等. 基于Spark的有效载荷参数解析处理方法[J]. 计算机工程与设计, 2020, 41(2): 587-591

    ZHANG Wenbin, WANG Chunmei, WANG Jing, et al. Processing method of parameter analysis of payload based on spark[J]. Computer Engineering and Design, 2020, 41(2): 587-591
    [8]
    戚红雨. 流式处理框架发展综述[J]. 信息化研究, 2019, 45(6): 1-8

    QI Hongyu. Survey of distributed data flow processing framework[J]. Informatization Research, 2019, 45(6): 1-8
    [9]
    KARAKAYA Z, YAZICI A, ALAYYOUB M. A comparison of stream processing frameworks[C]//Proceedings of 2017 International Conference on Computer and Applications (ICCA). Doha, Qatar, 2017: 1-12
    [10]
    ALMEIDA A, BRÁS S, SARGENTO S, et al. Time series big data: a survey on data stream frameworks, analysis and algorithms[J]. Journal of Big Data, 2023, 10(1): 83 doi: 10.1186/s40537-023-00760-1
    [11]
    ALKHANAK E N, LEE S P. A hyper-heuristic cost optimisation approach for Scientific Workflow Scheduling in cloud computing[J]. Future Generation Computer Systems, 2018, 86: 480-506 doi: 10.1016/j.future.2018.03.055
    [12]
    冯阳, 张国强. 基于工作流技术的遥感卫星数据接收调度系统的设计与实现[J]. 无线电工程, 2018, 48(11): 1004-1008 doi: 10.3969/j.issn.1003-3106.2018.11.18

    FENG Yang, ZHANG Guoqiang. Design and implementation of earth observation satellite data receiving scheduling system based on workflow technology[J]. Radio Engineering, 2018, 48(11): 1004-1008 doi: 10.3969/j.issn.1003-3106.2018.11.18
    [13]
    马福利, 陈玲, 李冰, 等. GECAM卫星快速预处理流程设计与实现[J]. 天文研究与技术, 2022, 19(3): 274-282

    MA Fuli, CHEN Ling, LI Bing, et al. Design and implementation of GECAM preprocessing pipeline[J]. Astronomical Research :Times New Roman;">& Technology, 2022, 19(3): 274-282
    [14]
    陈亚杰, 王锋, 邓辉, 等. ElasticSearch分布式搜索引擎在天文大数据检索中的应用研究[J]. 天文学报, 2016, 57(2): 241-251

    CHEN Yajie, WANG Feng, DEGN Hui, et al. The application of elastic search in the massive astronomical data retrieval[J]. Acta Astronomica Sinica, 2016, 57(2): 241-251
  • 加载中

Catalog

    通讯作者: 陈斌, bchen63@163.com
    • 1. 

      沈阳化工大学材料科学与工程学院 沈阳 110142

    1. 本站搜索
    2. 百度学术搜索
    3. 万方数据库搜索
    4. CNKI搜索

    Figures(10)  / Tables(4)

    Article Metrics

    Article Views(246) PDF Downloads(17) Cited by()
    Proportional views
    Related

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return