Home > News content

Trillions! Tencent Big Data Component TubeMQ Official Open Source

via:博客园     time:2019/9/17 22:42:53     readed:115

Recently, the annual International Open Source Summit ApacheCon 2019 was held in the United States, marking the 20th anniversary of the founding of the Apache Software Foundation (Apache Software Foundation,ASF. Tencent, as the only Chinese company invited to the conference, delivered a keynotes speech by ApacheCon.

At the meeting, Tencent Open Source Management Committee member, Tencent Open Source Alliance Chairman, Apache Software Foundation Member Junping introduced Tencent's open source road map to global open source ecological partners, announced that Tencent's 100 billion distributed message middleware TubeMQ is officially open source to the outside world, and plans to donate to the Apache Foundation. This will be after joining the Apache Foundation Platinum member, Tencent and Apache Foundation once again close hand in hand.

orgsrc=//img2018.cnblogs.com/news/34358/201909/34358-20190917183045140-610482681.jpg

orgsrc=//img2018.cnblogs.com/news/34358/201909/34358-20190917183045037-2133620220.jpg

Tencent Open Source Road Map

profit by

In recent years, Tencent in the open source pace continues to accelerate. As of September, Tencent has 84 open source projects, with more than 240000 Star. The focus areas include IaaS, container and cloud native, database, big data and AI, middleware, IoT/ edge computing, Mini Programs ecology and so on. In addition to continuously contributing to high-quality projects, Tencent also actively contributes to the open source community. In addition to joining the platinum members of many of the top open source foundations of the Apache Foundation, Linux Foundation, LFAI Foundation, OpenStack Foundation and MariaDB Foundation, many Tencent business teams and technicians are also actively involved in open source contributions and have been widely involved in the construction of dozens of communities and projects.

Tencent Cloud also helps open source technology land in many business scenarios, feedback open source through innovation. Typical includes Linux,KVM,MySQL,PostgreSQL,Kubernetes,Hadoop,Spark,TensorFlow and so on. Take KVM as an example, with the number of patch contributed to KVM, Tencent Cloud has been on the list of KVM open source contributions for two years in a row, becoming the public cloud manufacturer with the highest contribution in China.

Behind the rapid development of Tencent open source, it can not be separated from

orgsrc=//img2018.cnblogs.com/news/34358/201909/34358-20190917183046627-843167198.jpg

Block Junping said that these principles provide a good guide to Tencent's open source work. Tencent from

From the real production environment, Tencent self-research TubeMQ officially released

TubeMQ is Tencent's latest self-research open source project on ApacheCon. Its prototype is a self-developed distributed message middleware system (MQ) developed by Tencent Data Platform Department in 2013, which focuses on high-performance storage and transmission of massive data in large data scenarios, long-term service for Wechat payment, Tencent video, Wide Point and other products.

orgsrc=//img2018.cnblogs.com/news/34358/201909/34358-20190917183045164-701580254.jpg

Introduction to TubeMQ Project

As one of China's largest Internet companies, Tencent handles amazing amounts of data every day. To support massive business, Tencent has set up a data Lake Collaboration Scheme with three layers: storage layer, data management layer and analysis layer. It manages a variety of data engines downward and supports a variety of data application requirements upward. TubeMQ is a message middleware system from Tencent's data Lake storage layer, which supports the inflow and operation of massive data.

orgsrc=//img2018.cnblogs.com/news/34358/201909/34358-20190917183045103-346852349.jpg

Tencent data Lake Scheme, the vast majority of its components are made up of Apache's open source projects

After nearly seven years of massive data precipitation on a trillion scale, TubeMQ currently receives more than 25 trillion messages a day. Compared with other open source MQ components, TubeMQ has been used in real production environment for a long time and has core advantages in stability, performance and cost.

It is understood that the Apache Foundation has supported more than 350 open source projects, especially in the field of big data and cloud computing, with many star open source projects.

As the Apache Foundation's first platinum sponsor in China, Tencent plans to donate TubeMQ to the Apache Foundation, and has started the incubation process, Du said. We hope to take TubeMQ as an important milestone and continue to contribute outstanding projects in the field of big data to feed back the open source community.

China IT News APP

Download China IT News APP

Please rate this news

The average score will be displayed after you score.

Post comment

Do not see clearly? Click for a new code.

User comments