收藏切换
Design and Upgrade Practice of Urban Rail Big Data Platform Based on “Data Lakehouse” Technology
收藏切换
PDF
Yanjun WU, Zhirui GUANG, Minghua LI, Jianhua CHEN
Urban Rapid Rail Transit | 2024, 37(1) : 54 - 62
Less
收藏切换
Urban Rapid Rail Transit | 2024, 37(1): 54-62
Upgrading of Existing Lines of Urban Rail Transit: A Featured Topic
Design and Upgrade Practice of Urban Rail Big Data Platform Based on “Data Lakehouse” Technology
Full
Yanjun WU, Zhirui GUANG, Minghua LI, Jianhua CHEN
Affiliations
  • Beijing Mass Transit Railway Operation Corp., Ltd., Technology Innovation Research Institute Branch, Beijing Key Laboratory of Subway Operation Safety Technology Beijing 100082
doi: 10.3969/j.issn.1672-6073.2024.01.009
Outline
收藏切换

To explore the optimal scheme for the construction and upgrading of the big data platform in the urban rail transit industry, this study takes the urban rail big data platform as the research object. Our study starts from the development process of the urban rail big data platform, sorts out the three stages of the development of the urban rail big data platform and analyzes the technology and advantages and disadvantages of the big data platform at each stage. Then it focuses on summarizing the advantages of "Data lake and Warehouse integration, stream processing and batch processing integration, OLTP+OLAP, multiple loads" and other advantages of the "Data Lakehouse" big data technology in the current stage, and studies the key points of the architecture upgrade and transformation design of the big data platform based on this technology. The technology was verified in the upgradation and transformation of the big data platform of the Beijing Metro Data Center. The application shows that the "Data lakehouse" big data platform technology combines the advantages of low cost of data lake and high performance of data warehouse, solves the shortcomings of the original big data platform in performance, capacity and multipurpose support, and provides new solutions for the construction and upgradation of big data platforms in the urban rail industry.

urban rail transit  /  big data platform  /  upgrading  /  data Lakehouse  /  stream processing and batch processing integration  /  data warehouse  /  data lake
Yanjun WU, Zhirui GUANG, Minghua LI, Jianhua CHEN. Design and Upgrade Practice of Urban Rail Big Data Platform Based on “Data Lakehouse” Technology[J]. Urban Rapid Rail Transit, 2024 , 37 (1) : 54 -62 . DOI: 10.3969/j.issn.1672-6073.2024.01.009
Year 2024 volume 37 Issue 1
PDF
341
133
Cite this Article
BibTeX
Article Info
doi: 10.3969/j.issn.1672-6073.2024.01.009
  • Receive Date:2023-10-18
  • Online Date:2025-07-09
Article Data
Affiliations
History
  • Received:2023-10-18
  • Revised:2023-11-10
Affiliations
    Beijing Mass Transit Railway Operation Corp., Ltd., Technology Innovation Research Institute Branch, Beijing Key Laboratory of Subway Operation Safety Technology Beijing 100082
References
Share
https://castjournals.cast.org.cn/joweb/dskgjt/EN/10.3969/j.issn.1672-6073.2024.01.009
Share to
QR

Scan QR to access full text

Cite this article
BibTeX
Citations
表12种不同金属材料的力学参数

Family
属数
Number of
genus
种数
Number of
species
占总种数比例
Percentage of
total species (%)

Genus
种数
Number of
species
占总种数比例
Percentage of total
species (%)
鹅膏菌科Amanitaceae 2 11 5.26 鹅膏菌属 Amanita 10 4.78
小菇科 Mycenaceae 2 12 5.74 丝盖伞属 Inocybe 5 2.39
多孔菌科 Polyporaceae 8 14 6.70 蜡蘑属 Laccaria 5 2.39
红菇科 Russulaceae 3 23 11.00 小皮伞属 Marasmius 6 2.87
小菇属 Mycena 11 5.26
光柄菇属 Pluteus 5 2.39
红菇属 Russula 17 8.13
栓菌属 Trametes 5 2.39
关闭全屏
  • BibTeX
  • EndNote
  • RefWorks
  • TxT