1. Pafka 0.3.0 Introduction Pafka GitHub: https://github.com/4paradigm/pafka Based on the hierarchical storage methodology, Pafka optimizes the popular open-source message queue system Apache Kafka based on the modern storage architecture. It uses the first-level high-speed storage devices (e.g. persistent memory, SSD, etc.) to store hot data. Combined with the automatic migration strategy…

About the Author Dr. Yang Jun has more than 10 years of rich research and practical experience in database and storage system; He is now working in the 4Paradigm (https://en.4paradigm.com/) as a system architect and is also a core member of a hierarchical storage technology community, MemArk (https://memark.io/en ). Recently…

1. Release Notes Pafka 0.2.0 has been released（ https://github.com/4paradigm/pafka ). Pafka is an optimized version of the popular open source stream-processing platform Apache Kafka. It enhances Kafka by introducing tiered storage architecture awareness. Compared with the previous version Pafka 0.1.1, the major features introduced are as follows: It introduces tiered storage architecture aware…

In-Depth Interpretation of the Latest VLDB 2021 Paper: Artificial Intelligence Driven Real-Time Decision System Database and Optimization Based on Persistent Memory This acticle is published by MemArk Tech Community (https://memark.io/en/). All rights reserved. Background One of the most reputable database academic conference VLDB 2021 ( https://vldb.org/2021/ ) is held this…

*This acticle is published by MemArk Tech Community (https://memark.io/en/). All rights reserved. You may have heard of some confusing technical terms in different channels, such as Non-Volatile Memory, Persistent Memory, Optane Persistent Memory, PMem, DCPMM, AEP, etc… what are these terms? What’s the connection? What’s the use? This article will…