mirror of
https://github.com/supabase/supabase.git
synced 2026-10-06 09:55:06 +03:00
## I have read the [CONTRIBUTING.md](https://github.com/supabase/supabase/blob/master/CONTRIBUTING.md) file. YES ## What kind of change does this PR introduce? Docs update. ## What is the current behavior? Linear: [CLI-1618](https://linear.app/supabase/issue/CLI-1618/update-cli-workflow-docs-for-pg-delta-default-diffing) Four docs pages lag the shipped CLI behavior now that `pg-delta` is the default diff engine for projects created by a recent `supabase init`: - **CLI workflows** claims `db diff` compares `supabase/schemas/` against migrations. Under `pg-delta`, declarative files are never the `db diff` baseline (and `[db.migrations].schema_paths` no longer changes it) — the declarative flow goes through `supabase db schema declarative sync`. The cleanup guidance describes `migra`-era output. - **Declarative database schemas** teaches the old `db diff -f` + `schema_paths` flow throughout, and its known-caveats list is the `migra` issue list. - **Managing environments** still presents `--use-migra` as an "experimental flag" for a "more concise" diff — inverted now. - **Backup and restore (migrating within Supabase)** and the CLI workflows guide both steer users to `db diff`/`db pull` with `--schema auth,storage`. Under `pg-delta`, `--schema` layers an extra exclude policy on top of the Supabase profile: it can only narrow a diff, never re-include managed schemas, and managed-schema selections can even fail closed (e.g. `--schema auth` when a trigger function lives in `public`). Unfiltered diffs are the supported path. ## What is the new behavior? All claims verified against the CLI source at current `develop` — including supabase/cli#6300, which upgraded the engine to `@supabase/pg-delta` 1.0.0-alpha.46 — against the pinned pg-delta package source (profile rules, format defaults, coverage doc), and against a live dogfood run of the documented workflows on `develop` `38f31b4` (two OSS corpus projects, warm shadow cache). - **`cli-workflows.mdx`**: adds a "Which diff engine you're on" note (`pg-delta` for new `supabase init` projects, `migra` for existing ones until they opt in by adding `[experimental.pgdelta] enabled = true`; per-run fallbacks `--use-migra` on `db diff` / `--diff-engine migra` on `db pull`); corrects `db pull` and `db diff` mechanics (shadow built from migrations vs. live database; the baseline history record is offered, not unconditional); switches the declarative flow to `supabase db schema declarative sync`; reworks the cleanup section around pg-delta output (uppercase keywords at max width 180, `format_options`, per-unit migration files with numeric segment suffixes, the `-- pg-delta: transaction=false` directive on genuinely non-transactional files, engine-neutral grant/revoke review guidance, coverage warnings + `--strict-coverage`); documents what pg-delta captures in managed schemas (user triggers, RLS policies on `auth` tables and on `storage.objects`/`storage.buckets`/`realtime.messages`) versus what it doesn't; adds key-command rows for the declarative commands and troubleshooting entries (`db pull` non-zero exit when in sync, the `schema_paths` warning, `PGDELTA_DEBUG=1` bundles under `supabase/.temp/pgdelta/v2/debug/`). - **`declarative-database-schemas.mdx`**: swaps `db diff -f` for `db schema declarative sync -f` throughout; replaces lexicographic/`schema_paths` ordering guidance with automatic dependency ordering and the `generate` export layout (`_cluster/`, reserved `_custom/`); bootstraps from production via `db schema declarative generate --linked` (explicit target + `--overwrite` in scripts) and refreshes via `db pull --declarative`; rewrites known caveats for pg-delta (DML including storage buckets, untracked object kinds + the `_custom/` escape hatch, managed schemas, extension-managed objects, and the two gates when adopting an existing schema tree: `[experimental.webhooks]` for `pg_net` migrations and declaring the tree's extensions) keeping the `migra` workflow and issue list under a legacy section for projects that haven't enabled it. - **`managing-environments.mdx`**: frames the verbose grant sample as legacy-engine output, notes that generated migrations can include grant statements on any engine, describes `--use-migra` as a single-run fallback, and adds a `db diff --strict-coverage` CI step. - **`backup-restore.mdx`**: replaces `db diff --linked --schema auth,storage` with a plain `db diff --linked` on `pg-delta` (keeping the `--schema auth,storage` form for the legacy engine) and explains what the engine includes (user triggers on managed tables, user RLS policies on `auth`, `storage.objects`/`storage.buckets`/`realtime.messages`) and what must be recreated manually. - **New `diff-engines.mdx` page** (from #49889): the single home for how the engine is selected, a behavior matrix for `pg-delta` versus `migra`, the per-command fallback flags, a procedure for switching an existing project (the first `db pull` after enabling may write a catch-up migration), and how to go back with `enabled = false`. Registered in navigation. A shared `diff_engine_check` partial replaces the inline engine parentheticals across seven pages, and a `managed_schemas_diff_capture` partial carries the managed-schema capture rules. - **CLI reference (`cli_v1_commands.yaml`, `cli_v1_config.yaml`)**: `db pull`, `db schema declarative sync`/`generate` flags and descriptions, `experimental.pgdelta.*` and `db.migrations.schema_paths` config keys, and the `db diff` description updated to describe both engines. Note that `cli_v1_commands.yaml` is generated from the CLI repo; [supabase/cli#6557](https://github.com/supabase/cli/pull/6557) carries the matching `db pull` example and overlay text so the next publish keeps it. - **`examples/prompts/declarative-database-schema.md`**: rewritten for the `db schema declarative sync` flow, with the `[experimental.pgdelta]` prerequisite. ## Additional context The first draft was written against pg-delta 1.0.0-alpha.42. supabase/cli#6300 (engine upgrade to alpha.46) then changed two documented behaviors, both reflected here: generated SQL now defaults to uppercase pretty-printed keywords, and user RLS policies on `storage.objects`/`storage.buckets`/`realtime.messages` are included via the engine's `SUPABASE_USER_POLICY_SURFACES` allowlist. A follow-up dogfood run on `develop` `38f31b4` then falsified three more claims (pg-delta emits no grant noise, `_schema_changes`/`_after_enum_values` multi-file names, directive on every split file), all corrected in the last commit. **Update (Sep 14 to 17):** [#49889](https://github.com/supabase/supabase/pull/49889) and [#50220](https://github.com/supabase/supabase/pull/50220) were merged into this branch, so this PR now carries the full stack. #50220 corrected the `schema_paths` warning wording (the CLI warns only when the setting lists paths), added `auth` RLS policies to the managed-schema partial, and described the migra initial pull accurately (the `pg_dump` skips managed schemas and the migra diff pass that follows appends the trigger and policy changes). It also reframed `pg-delta` as the default for every project ahead of supabase/cli#6391. That plan changed: no breaking default flip before Select, so [#50332](https://github.com/supabase/supabase/pull/50332) restores the opt-in framing (`pg-delta` requires `[experimental.pgdelta] enabled = true`, which `supabase init` writes for new projects) and also resolves the four CodeRabbit findings from the latest review round. Two claims are pending confirmation from the owning teams: that branching runs every migration in a transaction and ignores the `-- pg-delta: transaction=false` directive, and the `--db-url` pooler-versus-direct connection advice, which currently disagrees with the CLI's own `db pull` docs. Stale spots found in the CLI repo's own docs while verifying (out of scope here, worth follow-ups): four `SIDE_EFFECTS.md` files still claim lowercase output, `docs/supabase/db/diff.md` still lists `migra`-era "known failure cases" that alpha.46 fully models, the `supabase init` template's commented `format_options` example shows `maxWidth: 80` against an actual default of 180, and the CLI upgrade recipe appends `--experimental` even when the config already enables pg-delta. 🤖 Generated with [Claude Code](https://claude.com/claude-code) https://claude.ai/code/session_01SUuaVmXLRbV6tZjzhka3cp <!-- This is an auto-generated comment: release notes by coderabbit.ai --> ## Summary by CodeRabbit * **Documentation** * Clarified `pg-delta` and legacy `migra` behavior, configuration, and switching guidance. * Expanded declarative schema workflows, including synchronization, migration generation, baselines, deployment, and legacy-engine support. * Documented managed schemas, permissions, extensions, transaction handling, dependency ordering, and troubleshooting. * Added guidance for strict coverage checks, output directories, non-interactive workflows, and declarative pull modes. * Added a dedicated diff engines guide and updated CLI navigation, backup and restore, branching, deployment, and CI documentation. <!-- end of auto-generated comment: release notes by coderabbit.ai --> --------- Co-authored-by: Claude <noreply@anthropic.com> Co-authored-by: Wen Bo Xie <wenbox323@gmail.com>
357 lines
12 KiB
Plaintext
357 lines
12 KiB
Plaintext
---
|
|
id: 'database-migrations'
|
|
title: 'Database migrations'
|
|
description: 'Track and version your database schema changes with migrations.'
|
|
subtitle: 'Track and version your database schema changes with migrations.'
|
|
video: 'https://www.youtube-nocookie.com/v/vyHyYpvjaks'
|
|
tocVideo: 'vyHyYpvjaks'
|
|
---
|
|
|
|
Supabase is a flexible platform that lets you decide how you want to build your projects. You can use the Dashboard directly to get up and running, or use a proper local setup. We suggest you work locally and deploy your changes to a linked project on the [Supabase Platform](https://app.supabase.io/).
|
|
|
|
Develop locally using the CLI to run a local Supabase stack. You can use the integrated Studio Dashboard to make changes, then capture your changes in schema migration files, which can be saved in version control.
|
|
|
|
Alternatively, if you're comfortable with migration files and SQL, you can write your own migrations and push them to the local database for testing before sharing your changes.
|
|
|
|
<Admonition type="note" label="Looking for the full end-to-end workflow?">
|
|
|
|
This page is a focused tutorial on migrations. If you want to move an existing platform project to local development, or set up a reproducible project from scratch and take it all the way to a remote deploy, see the [Local development workflow](/docs/guides/local-development/cli-workflows) guide. It covers both starting points, the daily development loop, pushing to production, cleaning up generated migrations, and troubleshooting.
|
|
|
|
</Admonition>
|
|
|
|
## Database migrations
|
|
|
|
Database changes are managed through "migrations." Database migrations are a common way of tracking changes to your database over time.
|
|
|
|
<YouTube id="Kx5nHBmIxyQ" title="Managing database migrations with the Supabase CLI" />
|
|
|
|
For this guide, we'll create a table called `employees` and see how we can make changes to it.
|
|
|
|
<StepHikeCompact>
|
|
|
|
<StepHikeCompact.Step step={1}>
|
|
<StepHikeCompact.Details title="Create your first migration file">
|
|
|
|
To get started, generate a [new migration](/docs/reference/cli/supabase-migration-new) to store the SQL needed to create our `employees` table
|
|
|
|
</StepHikeCompact.Details>
|
|
|
|
<StepHikeCompact.Code>
|
|
|
|
```bash name=Terminal
|
|
supabase migration new create_employees_table
|
|
```
|
|
|
|
</StepHikeCompact.Code>
|
|
|
|
</StepHikeCompact.Step>
|
|
</StepHikeCompact>
|
|
|
|
<StepHikeCompact>
|
|
|
|
<StepHikeCompact.Step step={2}>
|
|
<StepHikeCompact.Details title="Add the SQL to your migration file">
|
|
This creates a new migration: supabase/migrations/\<timestamp\>
|
|
_create_employees_table.sql.
|
|
|
|
To that file, add the SQL to create this `employees` table
|
|
</StepHikeCompact.Details>
|
|
|
|
<StepHikeCompact.Code>
|
|
|
|
```sql name=20250101000000_create_employees_table.sql
|
|
create table employees (
|
|
id bigint primary key generated always as identity,
|
|
name text,
|
|
email text,
|
|
created_at timestamptz default now()
|
|
);
|
|
```
|
|
|
|
</StepHikeCompact.Code>
|
|
|
|
</StepHikeCompact.Step>
|
|
</StepHikeCompact>
|
|
|
|
<StepHikeCompact>
|
|
|
|
<StepHikeCompact.Step step={3}>
|
|
<StepHikeCompact.Details title="Apply your migration">
|
|
Now that you have a migration file, you can run this migration and create the `employees` table.
|
|
|
|
Use the `reset` command here to reset the database to the current migrations
|
|
</StepHikeCompact.Details>
|
|
|
|
<StepHikeCompact.Code>
|
|
|
|
```bash name=Terminal
|
|
supabase db reset
|
|
```
|
|
|
|
</StepHikeCompact.Code>
|
|
|
|
</StepHikeCompact.Step>
|
|
</StepHikeCompact>
|
|
|
|
<StepHikeCompact>
|
|
|
|
<StepHikeCompact.Step step={4}>
|
|
<StepHikeCompact.Details title="Modify your employees table">
|
|
Now you can visit your new `employees` table in the Dashboard.
|
|
|
|
Next, modify your `employees` table by adding a column for department. Create a new migration file for that.
|
|
</StepHikeCompact.Details>
|
|
|
|
<StepHikeCompact.Code>
|
|
|
|
```bash name=Terminal
|
|
supabase migration new add_department_to_employees_table
|
|
```
|
|
|
|
</StepHikeCompact.Code>
|
|
|
|
</StepHikeCompact.Step>
|
|
</StepHikeCompact>
|
|
|
|
<StepHikeCompact>
|
|
|
|
<StepHikeCompact.Step step={5}>
|
|
<StepHikeCompact.Details title="Add a new column to your table">
|
|
This creates a new migration file: supabase/migrations/\<timestamp\>
|
|
_add_department_to_employees_table.sql.
|
|
|
|
To that file, add the SQL to create a new department column
|
|
</StepHikeCompact.Details>
|
|
|
|
<StepHikeCompact.Code>
|
|
|
|
```sql name=20250101000001_add_department_to_employees_table.sql
|
|
alter table if exists public.employees
|
|
add department text default 'Hooli';
|
|
```
|
|
|
|
</StepHikeCompact.Code>
|
|
|
|
</StepHikeCompact.Step>
|
|
</StepHikeCompact>
|
|
|
|
### Add sample data
|
|
|
|
Now that you are managing your database with migrations scripts, it would be great have some seed data to use every time you reset the database.
|
|
|
|
For this, you can create a seed script in `supabase/seed.sql`.
|
|
|
|
<StepHikeCompact>
|
|
|
|
<StepHikeCompact.Step step={1}>
|
|
<StepHikeCompact.Details title="Populate your table">
|
|
Insert data into your `employees` table with your `supabase/seed.sql` file.
|
|
</StepHikeCompact.Details>
|
|
|
|
<StepHikeCompact.Code>
|
|
|
|
```sql name=supabase/seed.sql
|
|
insert into public.employees
|
|
(name)
|
|
values
|
|
('Erlich Bachman'),
|
|
('Richard Hendricks'),
|
|
('Monica Hall');
|
|
```
|
|
|
|
</StepHikeCompact.Code>
|
|
|
|
</StepHikeCompact.Step>
|
|
</StepHikeCompact>
|
|
|
|
<StepHikeCompact>
|
|
|
|
<StepHikeCompact.Step step={2}>
|
|
<StepHikeCompact.Details title="Reset your database">
|
|
Reset your database (apply current migrations), and populate with seed data
|
|
</StepHikeCompact.Details>
|
|
|
|
<StepHikeCompact.Code>
|
|
|
|
```bash name=Terminal
|
|
supabase db reset
|
|
```
|
|
|
|
</StepHikeCompact.Code>
|
|
|
|
</StepHikeCompact.Step>
|
|
</StepHikeCompact>
|
|
|
|
You should now see the `employees` table, along with your seed data in the Dashboard! All of your database changes are captured in code, and you can reset to a known state at any time, complete with seed data.
|
|
|
|
### Diffing changes
|
|
|
|
This workflow is great if you know SQL and are comfortable creating tables and columns. If not, you can still use the Dashboard to create tables and columns, and then use the CLI to diff your changes and create migrations.
|
|
|
|
Create a new table called `cities`, with columns `id`, `name` and `population`. To see the corresponding SQL for this, you can use the `supabase db diff --schema public` command. This will show you the SQL that will be run to create the table and columns. The output of `supabase db diff` will look something like this:
|
|
|
|
```
|
|
Diffing schemas: public
|
|
Finished supabase db diff on branch main.
|
|
|
|
create table "public"."cities" (
|
|
"id" bigint primary key generated always as identity,
|
|
"name" text,
|
|
"population" bigint
|
|
);
|
|
|
|
```
|
|
|
|
Alternately, you can view your table definitions directly from the Table Editor:
|
|
|
|

|
|
|
|
You can then copy this SQL into a new migration file, and run `supabase db reset` to apply the changes.
|
|
|
|
The last step is deploying these changes to a live Supabase project.
|
|
|
|
## Deploy your project
|
|
|
|
You've been developing your project locally, making changes to your tables via migrations. It's time to deploy your project to the Supabase Platform and start scaling up to millions of users! Head over to [Supabase](/dashboard) and create a new project to deploy to.
|
|
|
|
### Sign in to the Supabase CLI
|
|
|
|
<$CodeTabs>
|
|
|
|
```bash name=Terminal
|
|
supabase login
|
|
```
|
|
|
|
```bash name=npx
|
|
npx supabase login
|
|
```
|
|
|
|
</$CodeTabs>
|
|
|
|
### Link your project
|
|
|
|
Associate your local project with your remote project using [`supabase link`](/docs/reference/cli/usage#supabase-link).
|
|
|
|
```bash
|
|
supabase link --project-ref <project-id>
|
|
# You can get <project-id> from your project's dashboard URL: https://supabase.com/dashboard/project/<project-id>
|
|
```
|
|
|
|
<Admonition type="note">
|
|
|
|
If your remote database already has schema changes that aren't in your local migrations (for example, tables you created directly in the Dashboard), capture them before you push:
|
|
|
|
```bash
|
|
supabase db pull
|
|
supabase db reset
|
|
```
|
|
|
|
`db pull` writes those changes to a `<timestamp>_remote_schema.sql` migration so your local and remote histories line up, and `db reset` re-applies your migrations locally to confirm they're consistent. For a brand-new remote project with nothing in it yet, skip this step.
|
|
|
|
</Admonition>
|
|
|
|
### Deploy database changes
|
|
|
|
Deploy any local database migrations using [`db push`](/docs/reference/cli/usage#supabase-db-push):
|
|
|
|
```sh
|
|
supabase db push
|
|
```
|
|
|
|
Visiting your live project on [Supabase](/dashboard), you'll see a new `employees` table, complete with the `department` column you added in the second migration above.
|
|
|
|
### Deploy Edge Functions
|
|
|
|
If your project uses Edge Functions, you can deploy these using [`functions deploy`](/docs/reference/cli/usage#supabase-functions-deploy):
|
|
|
|
```sh
|
|
supabase functions deploy <function_name>
|
|
```
|
|
|
|
### Use Auth locally
|
|
|
|
To use Auth locally, update your project's `supabase/config.toml` file that gets created after running `supabase init`. Add any providers you want, and set enabled to `true`.
|
|
|
|
```bash supabase/config.toml
|
|
[auth.external.github]
|
|
enabled = true
|
|
client_id = "env(SUPABASE_AUTH_GITHUB_CLIENT_ID)"
|
|
secret = "env(SUPABASE_AUTH_GITHUB_SECRET)"
|
|
redirect_uri = "http://localhost:54321/auth/v1/callback"
|
|
```
|
|
|
|
As a best practice, any secret values should be loaded from environment variables. You can add them to `.env` file in your project's root directory for the CLI to automatically substitute them.
|
|
|
|
```bash .env
|
|
SUPABASE_AUTH_GITHUB_CLIENT_ID="redacted"
|
|
SUPABASE_AUTH_GITHUB_SECRET="redacted"
|
|
```
|
|
|
|
For these changes to take effect, you need to run `supabase stop` and `supabase start` again.
|
|
|
|
If you have additional triggers or RLS policies defined on your `auth` schema, how you pull them locally depends on your project's diff engine.
|
|
|
|
<$Partial path="diff_engine_check.mdx" />
|
|
|
|
On `pg-delta`, a plain `supabase db pull` captures your customizations automatically. Triggers on managed tables (such as a trigger on `auth.users` calling a function in `public`) and RLS policies on `auth` tables are included in the diff.
|
|
|
|
On the legacy `migra` engine, the initial pull's `pg_dump` skips the `auth` schema, but the diff pass that follows appends your triggers and RLS policies there to the same migration. Older CLI versions excluded the `auth` schema entirely and printed a message saying so. If you see that message, capture existing customizations once with an explicit pull:
|
|
|
|
```bash
|
|
supabase db pull --schema auth
|
|
```
|
|
|
|
### Sync storage buckets
|
|
|
|
On the `pg-delta` engine, your RLS policies on `storage.objects` and `storage.buckets` are also captured automatically by a plain `supabase db pull`. On the legacy `migra` engine, the diff pass that follows the initial `pg_dump` appends them to the same migration. If an older CLI prints a message that the `storage` schema was excluded, capture existing policies once with an explicit pull:
|
|
|
|
```bash
|
|
supabase db pull --schema storage
|
|
```
|
|
|
|
The buckets and objects themselves are rows in the storage tables so they won't appear in your schema. You can instead define them via `supabase/config.toml` file. For example,
|
|
|
|
```bash supabase/config.toml
|
|
[storage.buckets.images]
|
|
public = false
|
|
file_size_limit = "50MiB"
|
|
allowed_mime_types = ["image/png", "image/jpeg"]
|
|
objects_path = "./images"
|
|
```
|
|
|
|
This will upload files from `supabase/images` directory to a bucket named `images` in your project with one command.
|
|
|
|
```bash
|
|
supabase seed buckets
|
|
```
|
|
|
|
### Sync any schema with `--schema`
|
|
|
|
You can synchronize your database with a specific schema using the `--schema` option as follows:
|
|
|
|
```bash
|
|
supabase db pull --schema <schema_name>
|
|
```
|
|
|
|
<Admonition type="caution">
|
|
|
|
Using `--schema`
|
|
|
|
If the local `supabase/migrations` directory is empty, the `db pull` command will ignore the `--schema` parameter.
|
|
|
|
To fix this, you can pull twice:
|
|
|
|
```bash
|
|
supabase db pull
|
|
supabase db pull --schema <schema_name>
|
|
```
|
|
|
|
</Admonition>
|
|
|
|
## Limitations and considerations
|
|
|
|
The local development environment is not as feature-complete as the Supabase Platform. Here are some of the differences:
|
|
|
|
- You cannot update your project settings in the Dashboard. This must be done using the local config file.
|
|
- The CLI version determines the local version of Studio used, so make sure you keep your local [Supabase CLI up to date](https://github.com/supabase/cli#getting-started). We're constantly adding new features and bug fixes.
|