On October 13th, 2023 financial database technology conference was successfully held in Beijing. In the afternoon financial database technology innovation and development sub-forum, Huang Tao, president of Huawei flash memory storage, delivered a keynote speech entitled "helping financial database to achieve innovation and development with the architecture of storage power and separation of storage and calculation, starting from many challenges faced by the application of Chinese databases in the core scenarios of the financial industry, this paper makes an in-depth exposition of the development trend of China's database architecture.
Huang Tao said that the current progress in the core application of Chinese databases in China's financial industry is slow, mainly due to the shortcomings in reliability, performance, operation and maintenance and many other aspects of databases adopting the integrated storage and computing architecture, as a result, the transformation risks and costs are very high, which makes it difficult to meet the demands of financial core applications. On the other hand, China's data infrastructure technology is mature, and NVMe technology has more than doubled the overall storage performance, noF + technology reduces the storage network latency to 50us, eliminating all bottlenecks of Data Inventory separation and deployment. At this time, the advantages of professional storage data sharing, unified management and high reliability have begun to emerge, and they have long-term stable operation experience in financial core systems, it has become an important reason why China's database industry is gradually moving towards the architecture of separation of storage and computing.
Huang Tao introduced that Huawei currently provides three data inventory separation solutions based on the leading Flash memory storage:
one is the LUN docking solution, that is, to share enterprise-level storage resources with databases through high-speed networks, and to sink hard disk health management, disaster recovery, and other functions into flash memory storage, provides high reliability and efficient O & M for businesses without affecting performance;
the second is the multi-replica normalization solution, that is, multiple primary and secondary nodes share the same data in the same storage, which ensures strong consistent read between primary and secondary nodes, removes primary and secondary log replication overhead, and improves performance by 50 +%, hard disk utilization increased by 70 +%;
third, multi-master architecture, that is, by using the global distributed cache technology of the Cantian engine and the distributed MVCC technology, the consistency of cross-node cache data is guaranteed, the MVCC transaction submission performance is greatly improved, and the real global node is multi-read and multi-write, the system performance can be improved by up to 10 times, and Failover can be completed within 30 seconds after node failure, helping customers implement database transformation without Database Sharding and table sharding. Huawei has successfully implemented the three solutions with customers and database partners.
At the meeting, Huang Tao also cooperated with the Institute of Financial informatization, Alibaba Cloud, OceanBase, Dameng Database, Nanda general, Tianyi Cloud, Wanli database, Yunhe enmo, youxuan software and leaders of Yashan Science and Technology jointly took the stage to launch the China Financial multi-master database application action plan, and formally established the Financial multi-master database application promotion working group. Promoting the upgrading of China's database industry is not only the responsibility of database practitioners, but also the mission of IT infrastructure practitioners in China as a whole.
Huawei believes that based on the separation of storage and computing architecture, fully combining the technical advantages of database and industry-leading professional storage infrastructure will become the only way for China to build its core competitiveness. Huawei storage will continue to assist customers to improve database reliability and performance through separation and transformation of storage and computing, and greatly reduce TCO and energy consumption. Huawei will also continue to cooperate with database industry partners in depth, build high-performance, highly reliable, and high-efficiency multi-master Architecture databases to jointly promote the upgrading of China's database industry.