mirror of
https://github.com/supabase/supabase.git
synced 2026-10-06 09:55:06 +03:00
> [!IMPORTANT] > Don't merge until the OrioleDB public beta launches. Docs deploy on merge. ## What Updates the OrioleDB guide (`guides/database/orioledb`) for the public beta: - States that OrioleDB is in public beta and that OrioleDB projects have access to the same paid features as other Supabase projects. - Replaces the outdated "choose `OrioleDB Public Alpha` Postgres version" instruction and its screenshot with text steps that match the current project creation form (**Advanced Configuration** → **Postgres Type** → **Postgres with OrioleDB**). It also notes that OrioleDB can't be added to or removed from an existing project. A new screenshot will follow once the dashboard shows the beta labels. - Corrects the `orioledb.default_compress` range to `-1` to `22`. Values outside that range are rejected. - Updates the `EXPLAIN` output for the primary key lookup to match what OrioleDB returns (`Custom Scan (o_scan)`). - Replaces the benchmark chart's alt text with a description of the chart. Headings, frontmatter, and navigation are unchanged, so existing links to this page and its sections still work. ## Checked against upstream OrioleDB Checked the page's claims against the [OrioleDB docs](https://github.com/orioledb/orioledb/tree/main/doc/usage) and codebase on `main`: - The concepts section, the `orioledb.serializable` values, and the compression settings match. - The limitations link still resolves (`#current-limitations`). - Doc changes on `main` since beta17 (collations, sparse files, concurrent unique bridged indexes) don't affect claims on this page. ## Verification (`/test-the-docs`) | Snippet / step | Class | Sandbox | Result | Notes | | --- | --- | --- | --- | --- | | `create table blog_post …` | runnable-local | DinD + runner, `supabase/postgres:17.9.0.028-orioledb` | pass | Table created with the `orioledb` access method (default) | | `create index …` (2 indexes) | runnable-with-setup | same | pass | | | `insert …` + `select …` | runnable-with-setup | same | pass | Timestamp differs, as expected | | `explain` (3 statements) | runnable-with-setup | same | pass | Primary key lookup output updated in this PR to match | | `select … from pg_settings where name like 'orioledb.%'` | runnable-local | same | pass | All 10 automatically tuned settings present | | `alter database … default_compress to 1` | runnable-local | same | pass | | | Compression range `-1`–`22` | claim check | same | pass | `23` rejected: "outside the valid range (-1 .. 22)" | | User-configurable settings have `user` context | claim check | same | pass | `serializable` values match the page | | Hidden `ctid` key when no primary key is defined | claim check | same | pass | | | HNSW index via index bridging | claim check | same | fail (product bug) | Index misses rows inserted after it's created. Known upstream as orioledb/orioledb#1118, fixed after beta17. The tested image bundles an earlier OrioleDB release. Re-test on an image with beta18 before merging. | | Dashboard project creation steps | deferred | — | deferred | Needs a hosted project; labels checked against Studio source | **Tier A path:** every SQL block on the page, run in page order against the Supabase OrioleDB image. **Environment:** Docker 29.4.0 (linux/aarch64); compose sandbox from `test-the-docs`; all SQL run inside the runner container. **Build:** `pnpm build:guides-markdown` passes; the generated markdown for this page includes all changes. ## Self-review **Blockers:** none. **Before merging:** - [ ] Re-run the HNSW check on an image with OrioleDB beta18. - [ ] Re-check the page against the `beta18` tag once it's published. **Nits left for a follow-up (existing text, outside this PR's scope):** - The page spells `pg_vector`; the extension is `pgvector`. - Index support is described twice, in the top note and again under "Creating indexes". - The markdown export (`internals/markdown-schema/Admonition.ts`) drops admonition titles on every page. This PR avoids relying on a title for the beta status. Linear: DOCS-1399 🤖 Generated with [Claude Code](https://claude.com/claude-code) <!-- This is an auto-generated comment: release notes by coderabbit.ai --> ## Summary by CodeRabbit * **Documentation** * Updated the OrioleDB guide with benchmark results for an 8xlarge instance, including a 1.8x speedup and throughput data across 32–256 connections. * Clarified that OrioleDB projects have access to the same paid features as other Supabase projects, and added guidance to review its limitations. * Updated project setup instructions, noting that OrioleDB must be selected when creating a project and cannot be added later or removed. * Revised the query plan example and documented compression levels from `0` through `22`. * **Product Updates** * Updated OrioleDB’s availability stage to public beta. <!-- end of auto-generated comment: release notes by coderabbit.ai --> --------- Co-authored-by: Artur Zakirov <zaartur@gmail.com>
184 lines
11 KiB
Plaintext
184 lines
11 KiB
Plaintext
---
|
|
id: 'orioledb'
|
|
title: 'OrioleDB Overview'
|
|
description: "A storage extension for Postgres which uses Postgres's pluggable storage system"
|
|
---
|
|
|
|
The [OrioleDB](https://www.orioledb.com/) Postgres extension provides a drop-in replacement storage engine for the default heap storage method. It is designed to improve Postgres' scalability and performance.
|
|
|
|
OrioleDB addresses Postgres's scalability limitations by removing bottlenecks in the shared memory cache under high concurrency. It also optimizes write-ahead-log (WAL) insertion through row-level WAL logging. These changes lead to significant improvements in the industry standard TPC-C benchmark, which approximates a real-world transactional workload. The following benchmark was performed on a 8xlarge instance and shows OrioleDB's performance outperforming the default Postgres heap method with a 1.8x speedup.
|
|
|
|
<Image
|
|
alt="Line chart of TPC-C throughput at 5120 warehouses, in transactions per minute (tpmC), from 32 to 256 connections. OrioleDB rises to about 112,800 tpmC by 128 connections and holds between about 110,000 and 112,000 from 128 connections onward. Heap stays between about 37,000 and 65,000 across the whole range."
|
|
src="/docs/img/database/orioledb-tpc-c-5120-warehouse.png"
|
|
className="max-w-[550px] mx-auto! border rounded-md"
|
|
width={1000}
|
|
height={609}
|
|
/>
|
|
|
|
<Admonition type="note">
|
|
|
|
OrioleDB is in public beta, and projects that use it have access to the same paid features as other Supabase projects. OrioleDB has [some limitations](https://www.orioledb.com/docs/usage/getting-started#current-limitations) compared to the default heap storage engine, so review them before you choose it for a project. Native B-tree indexes give the best performance, and an Index Access Method bridge provides experimental support for other index types built for heap storage, including pg_vector's HNSW indexes. In the Supabase OrioleDB image the default storage method has been updated to use OrioleDB, granting better performance out of the box.
|
|
|
|
</Admonition>
|
|
|
|
## Concepts
|
|
|
|
### Index-organized tables
|
|
|
|
OrioleDB uses index-organized tables, where table data is stored in the index structure. This design eliminates the need for separate heap storage, reduces overhead and improves lookup performance for primary key queries.
|
|
|
|
### No buffer mapping
|
|
|
|
In-memory pages are connected to the storage pages using direct links. This allows OrioleDB to bypass Postgres's shared buffer pool and eliminate the associated complexity and contention in buffer mapping.
|
|
|
|
### Undo log
|
|
|
|
Multi-Version Concurrency Control (MVCC) is implemented using an undo log. The undo log stores previous row versions and transaction information, which enables consistent reads while removing the need for table vacuuming completely.
|
|
|
|
### Copy-on-write checkpoints
|
|
|
|
OrioleDB implements copy-on-write checkpoints to persist data efficiently. This approach writes only modified data during a checkpoint, reducing the I/O overhead compared to traditional Postgres checkpointing and allowing row-level WAL logging.
|
|
|
|
## Usage
|
|
|
|
### Creating OrioleDB project
|
|
|
|
You choose OrioleDB when you create a project. You can't add OrioleDB to an existing project or remove it later.
|
|
|
|
1. [Create a new Supabase project](/dashboard/new/_).
|
|
1. Expand **Advanced Configuration**.
|
|
1. Under **Postgres Type**, select **Postgres with OrioleDB**.
|
|
1. Finish creating the project.
|
|
|
|
### Creating tables
|
|
|
|
To create a table using the OrioleDB storage engine, execute the standard `CREATE TABLE` statement. By default it will create a table using OrioleDB storage engine. For example:
|
|
|
|
```sql
|
|
-- Create a table
|
|
create table blog_post (
|
|
id int8 not null,
|
|
title text not null,
|
|
body text not null,
|
|
author text not null,
|
|
published_at timestamptz not null default CURRENT_TIMESTAMP,
|
|
views bigint not null,
|
|
primary key (id)
|
|
);
|
|
```
|
|
|
|
### Creating indexes
|
|
|
|
OrioleDB tables always have a primary key. If it wasn't defined explicitly, a hidden primary key is created using the `ctid` column.
|
|
Additionally you can create secondary indexes.
|
|
|
|
<Admonition type="note">
|
|
|
|
OrioleDB tables use native B-tree indexes by default. Other index types built for heap storage, such as pg_vector's HNSW indexes, have experimental support through an Index Access Method bridge.
|
|
|
|
</Admonition>
|
|
|
|
```sql
|
|
-- Create an index
|
|
create index blog_post_published_at on blog_post (published_at);
|
|
|
|
create index blog_post_views on blog_post (views) where (views > 1000);
|
|
```
|
|
|
|
### Data manipulation
|
|
|
|
You can query and modify data in OrioleDB tables using standard SQL statements, including `SELECT`, `INSERT`, `UPDATE`, `DELETE` and `INSERT ... ON CONFLICT`.
|
|
|
|
```sql
|
|
insert into blog_post (id, title, body, author, views)
|
|
values (1, 'Hello, World!', 'This is my first blog post.', 'John Doe', 1000);
|
|
|
|
select * from blog_post order by published_at desc limit 10;
|
|
id │ title │ body │ author │ published_at │ views
|
|
────┼───────────────┼─────────────────────────────┼──────────┼───────────────────────────────┼───────
|
|
1 │ Hello, World! │ This is my first blog post. │ John Doe │ 2024-11-15 12:04:18.756824+01 │ 1000
|
|
```
|
|
|
|
### Viewing query plans
|
|
|
|
You can see the execution plan using standard `EXPLAIN` statement.
|
|
|
|
```sql
|
|
explain select * from blog_post order by published_at desc limit 10;
|
|
QUERY PLAN
|
|
────────────────────────────────────────────────────────────────────────────────────────────────────────────
|
|
Limit (cost=0.15..1.67 rows=10 width=120)
|
|
-> Index Scan Backward using blog_post_published_at on blog_post (cost=0.15..48.95 rows=320 width=120)
|
|
|
|
explain select * from blog_post where id = 1;
|
|
QUERY PLAN
|
|
───────────────────────────────────────────────────────────────────────
|
|
Custom Scan (o_scan) on blog_post (cost=0.15..8.17 rows=1 width=120)
|
|
Forward index scan of: blog_post_pkey
|
|
Conds: (id = 1)
|
|
|
|
explain (analyze, buffers) select * from blog_post order by published_at desc limit 10;
|
|
QUERY PLAN
|
|
──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────
|
|
Limit (cost=0.15..1.67 rows=10 width=120) (actual time=0.052..0.054 rows=1 loops=1)
|
|
-> Index Scan Backward using blog_post_published_at on blog_post (cost=0.15..48.95 rows=320 width=120) (actual time=0.050..0.052 rows=1 loops=1)
|
|
Planning Time: 0.186 ms
|
|
Execution Time: 0.088 ms
|
|
```
|
|
|
|
## Configuration
|
|
|
|
### Automatic tuning by compute size
|
|
|
|
Supabase automatically sizes OrioleDB's memory and worker settings based on your project's [compute add-on](/docs/guides/platform/compute-and-disk). These settings control the memory OrioleDB allocates for its internal page pools, undo log, and recovery workers, replacing the role that `shared_buffers` plays for the default heap storage engine. Supabase also reduces `shared_buffers` on OrioleDB projects, since OrioleDB tables use their own buffer pools instead.
|
|
|
|
The following settings are tuned automatically and aren't configurable:
|
|
|
|
- `orioledb.main_buffers`
|
|
- `orioledb.free_tree_buffers`
|
|
- `orioledb.catalog_buffers`
|
|
- `orioledb.undo_buffers`
|
|
- `orioledb.xid_buffers`
|
|
- `orioledb.logical_xid_buffers`
|
|
- `orioledb.recovery_queue_size`
|
|
- `orioledb.recovery_pool_size`
|
|
- `orioledb.recovery_idx_pool_size`
|
|
- `orioledb.bgwriter_num_workers`
|
|
|
|
To get larger pools and more recovery workers, [upgrade your project's compute add-on](/docs/guides/platform/compute-and-disk#upgrades). To see the values currently applied to your project, query `pg_settings`:
|
|
|
|
```sql
|
|
select name, setting
|
|
from pg_settings
|
|
where name like 'orioledb.%';
|
|
```
|
|
|
|
### User-configurable settings
|
|
|
|
A smaller set of OrioleDB settings has a `user` [context](/docs/guides/database/custom-postgres-config#user-context-settings) and can be changed at the database or role level with SQL, the same way as other [customizable Postgres settings](/docs/guides/database/custom-postgres-config).
|
|
|
|
| Setting | Description | Default |
|
|
| ----------------------------------- | -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | ------------ |
|
|
| `orioledb.default_compress` | Default compression level for OrioleDB tables. Set to `-1` to disable compression, or `0` to `22` to trade write speed for a smaller table on disk. | `-1` |
|
|
| `orioledb.default_primary_compress` | Default compression level for the primary index. Accepts the same values as `orioledb.default_compress`. | `-1` |
|
|
| `orioledb.default_toast_compress` | Default compression level for TOASTed values. Accepts the same values as `orioledb.default_compress`. | `-1` |
|
|
| `orioledb.serializable` | How OrioleDB handles `SERIALIZABLE` transactions. `table_lock` acquires a coarse lock per touched table, `repeatable_read` silently downgrades the isolation level, and `error` rejects `SERIALIZABLE` transactions. | `table_lock` |
|
|
|
|
For example, to enable compression for new OrioleDB tables in a database:
|
|
|
|
```sql
|
|
alter database "postgres" set "orioledb.default_compress" to 1;
|
|
```
|
|
|
|
<Admonition type="note">
|
|
|
|
Compression settings only affect tables and indexes created after you change the setting. Existing tables keep the compression level they were created with.
|
|
|
|
</Admonition>
|
|
|
|
## Resources
|
|
|
|
- [Official OrioleDB documentation](https://www.orioledb.com/docs)
|
|
- [OrioleDB GitHub repository](https://github.com/orioledb/orioledb)
|