StoneDB is a MySQL-compatible high-performance hybrid transaction/analytical processing (HTAP) database. It provides analytical processing (AP) abilities to MySQL. The running systems can be seamlessly migrated to StoneDB without any code changed. Compared to InnoDB, StoneDB provides 10 times the query performance as well as 10 times the load performance. StoneDB also provides 10:1 to 40:1 compression ratio.
Overview
Architecture 2.0
For more information about StoneDB, see stonedb.io.
Getting Started
The Getting Started part provides information about StoneDB supported platforms, installation (including creating your first table), and migrating from the running MySQL databases to StoneDB.
Supported Platform
The officially supported subsets of platforms are:
CentOS 7.x or higher
Ubuntu 20.04 or higher
Red Hat Enterprise Linux 7 (RHEL 7.x)
Compiler toolsets we verify our builds with:
GCC 7.3 or higher
The following packages we verify our builds with:
Make 3.82 or later
CMake 3.7.2 or later
marisa 0.77
RocksDB 6.12.6
Boost 1.66
Build StoneDB from Source Code in a Docker Container
After StoneDB is installed, you need to configure at least the following parameters in the my.cnf file:
#the stonedb configuration options are listed as following.
#for an example.
[mysqld]
# For version 5.7 or later, the engine should be set to tianmu
default-storage-engine=tianmu
# For version 5.6, the engine should be set to stonedb
# default-storage-engine=stonedb
default-tmp-storage-engine=MyISAM
binlog-format=STATEMENT
Initialize the Database
# For version 5.6
cd /path/to/your/path/bin && ./mysql_install_db --basedir=/stonedb/install/ --datadir=/stonedb/install/data/ --user=mysql
# For version 5.7 or later
cd /path/to/your/path/bin && ./mysqld --initialize --basedir=/stonedb/install/ --datadir=/stonedb/install/data/ --user=mysql
--The example code for creating a table with 'tianmu' engine.(For version 5.7 or later)
CREATE TABLE `example_table` (
`id1` bigint(20) NOT NULL DEFAULT '0',
`id1_type` int(10) NOT NULL DEFAULT '0',
`id2` bigint(20) NOT NULL DEFAULT '0',
`id2_type` int(10) NOT NULL DEFAULT '0',
`data` varchar(255) NOT NULL DEFAULT '',
`time` bigint(20) NOT NULL DEFAULT '0',
`version` int(11) NOT NULL DEFAULT '0',
) ENGINE=tianmu;
-- For version 5.6, the engine should be set to 'stonedb'
The example shows some important features and limitations in StoneDB. For more information about limitations, please see StoneDB Limitations.
StoneDB data is stored in Column format and persist to RocksDB. All data is compressed, and the compression ratio can be 10:1 to 40:1.
StoneDB can achieve a competitive performance when processing ad-hoc queries, even without any indexes created. For more details, click here.
Now, let's exprience your StoneDB
Switch from MySQL to StoneDB in Production
If you want to use both InnoDB and StoneDB within the same instance to run a join query, set stonedb_ini_allowmysqlquerypath to 1 in file my.cnf.
Online migration tools to move data between storage engines are not currently developed, but you obviously want this to happen without downtime, data loss, or inaccurate results. To achieve this, you need to move data logically from the source MySQL server that uses the InnoDB engine and load it into StoneDB to do analytical processing. The detailed procedure is as follows:
Create a StoneDB instance and tables.
Copy all the database and table schemas from the source to the destination.
Dump each table to a file by executing SELECT … INTO OUTFILE.
Send the files to the destination and load them using LOAD DATA … INFILE.
Documentation
Documentation can be found online at https://stonedb.io. The documentation provides you with StoneDB basics, extensive examples of using StoneDB, as well as other information that you may need during your usage of StoneDB.
Contribution
StoneDB welcomes all kinds of contributions, such as contributing code to the code base, sharing your experience on how to use StoneDB, and providing insights in the community on the Forums, or contributing to projects that make StoneDB a better project. For more specifics, see the contributing guide for more specifics.
Discussion
The GitHub Discussions is the home for most discussions and communications about the StoneDB project. We welcome your participation. Every single opinion or suggestion of yours is welcomed and valued. We anticipate StoneDB to be an open and influential project.
Join StoneDB Wechat Group
You can add our little assistant’s WeChat and join StoneDB’s user group:
Code of Conduct
When participating in the StoneDB project, please ensure all your behavior complies with the Code of Conduct.
关于
StoneDB 是一个兼容 MySQL 的高性能混合事务/分析处理(HTAP)数据库。它为MySQL提供了分析处理(AP)能力。运行中的系统可以无缝地迁移到 StoneDB,而无需更改任何代码。与 InnoDB 相比,StoneDB 提供了10倍的查询性能和加载性能。
An One-Stop Real-Time HTAP database
English | 中文
What is StoneDB
StoneDB is a MySQL-compatible high-performance hybrid transaction/analytical processing (HTAP) database. It provides analytical processing (AP) abilities to MySQL. The running systems can be seamlessly migrated to StoneDB without any code changed. Compared to InnoDB, StoneDB provides 10 times the query performance as well as 10 times the load performance. StoneDB also provides 10:1 to 40:1 compression ratio.
Overview
Architecture 2.0
For more information about StoneDB, see stonedb.io.
Getting Started
The Getting Started part provides information about StoneDB supported platforms, installation (including creating your first table), and migrating from the running MySQL databases to StoneDB.
Supported Platform
The officially supported subsets of platforms are:
Compiler toolsets we verify our builds with:
The following packages we verify our builds with:
Build StoneDB from Source Code in a Docker Container
For more information, see Compile StoneDB in a Docker Container.
Of course, you can also quickly install and deploy StoneDB directly from Dockershub in just two minutes. See our documentation for details.
Build StoneDB from the Source Code
On Ubuntu 20.04
For more information, see Compile StoneDB on Ubuntu 20.04.
On CentOS 7.X
For more information, see Compile StoneDB on CentOS 7.x.
On RedHat 7.X
For more information, see Compile StoneDB on RedHat 7.x.
Configure StoneDB
After StoneDB is installed, you need to configure at least the following parameters in the my.cnf file:
Initialize the Database
Start the Database Instance
Create a StoneDB Table
The example shows some important features and limitations in StoneDB. For more information about limitations, please see StoneDB Limitations.
Now, let's exprience your StoneDB
Switch from MySQL to StoneDB in Production
If you want to use both InnoDB and StoneDB within the same instance to run a join query, set stonedb_ini_allowmysqlquerypath to 1 in file my.cnf.
Online migration tools to move data between storage engines are not currently developed, but you obviously want this to happen without downtime, data loss, or inaccurate results. To achieve this, you need to move data logically from the source MySQL server that uses the InnoDB engine and load it into StoneDB to do analytical processing. The detailed procedure is as follows:
SELECT … INTO OUTFILE
.LOAD DATA … INFILE
.Documentation
Documentation can be found online at https://stonedb.io. The documentation provides you with StoneDB basics, extensive examples of using StoneDB, as well as other information that you may need during your usage of StoneDB.
Contribution
StoneDB welcomes all kinds of contributions, such as contributing code to the code base, sharing your experience on how to use StoneDB, and providing insights in the community on the Forums, or contributing to projects that make StoneDB a better project. For more specifics, see the contributing guide for more specifics.
Discussion
The GitHub Discussions is the home for most discussions and communications about the StoneDB project. We welcome your participation. Every single opinion or suggestion of yours is welcomed and valued. We anticipate StoneDB to be an open and influential project.
Join StoneDB Wechat Group
You can add our little assistant’s WeChat and join StoneDB’s user group:
Code of Conduct
When participating in the StoneDB project, please ensure all your behavior complies with the Code of Conduct.