Commit Graph
132 Commits
Author SHA1 Message Date
Francesco Sansalvadore dfecff7629 fix(ui-patterns): responsive with_icon spacing (#40841) 2025-11-27 15:38:10 +00:00
Saxon FletcherandJoshen Lim 9d66964b62 table create performance (#40857)
* table create performance

* test

* Clean up + refactor

* Nit housekeeping

* Minor housekeeping again

* Fix

* Fixy

---------

Co-authored-by: Joshen Lim <joshenlimek@gmail.com>
2025-11-27 20:27:19 +08:00
784f77d398 Add example code for Vector buckets (#40440)
* Add examples.

* Move the button for creating a vector bucket outside of the dialog.

* Install the wrappers extension if missing when creating a vector bucket.

* Refactor the quick start code for vector buckets.

* Fix a type error.

* chore(studio): vector tables UI improvements (#40598)

* Add examples.

* clearer examples

* clearer dimension samples

* quick start as sheet

* improve structure

* cleanup

* icons and text size

* improve snippet code

* icons

* sql editor link

* cleanup

---------

Co-authored-by: Ivan Vasilov <vasilov.ivan@gmail.com>

* Minor naming fix.

* Fix the link to the Table Editor.

* Smol fix + refactor and clean up

* Nit

* Nit improvement

* Make the SQL option default.

* fix docs link

* fix example code

* remove redundant card

* Check if the project has secret keys or service role keys. Remove the NEXT_PUBLIC from the env vars to avoid exposing them to the FE.

---------

Co-authored-by: Danny White <3104761+dnywh@users.noreply.github.com>
Co-authored-by: Joshen Lim <joshenlimek@gmail.com>
2025-11-27 11:26:25 +01:00
Danny WhiteandJoshen Lim 46ac132051 chore(studio): empty state improvements (#40807)
* migrations

* clearer value prop

* consistent verb

* migration input

* triggers

* extract trigger buttons

* database backups

* schema title

* unrelated nit

* fix

* shared component

* ui-patterns

* rename

* improve docs

* remove redundant overrides

* remove old file

* prettier fix

* fix type error

---------

Co-authored-by: Joshen Lim <joshenlimek@gmail.com>
2025-11-27 17:26:20 +08:00
Riccardo BusettiandJoshen Lim 09cda344a1 ref(etl): Add better badges (#40828)
* ref(etl): Add better badges

* Fix

* Update apps/studio/components/layouts/DatabaseLayout/DatabaseMenu.utils.tsx

Co-authored-by: Joshen Lim <joshenlimek@gmail.com>

* UI nudges

---------

Co-authored-by: Joshen Lim <joshenlimek@gmail.com>
2025-11-27 11:42:27 +08:00
Joshen Lim 8f096b5d7c Chore/fix storage upload sanitize duplicate name (#40813)
* Fix URL when cmd/ctrl clicking files and vector bucket row

* Fix storage upload sanitize duplicate name
2025-11-27 00:39:22 +08:00
Timothy Lim 26630dee0e Fix link to Vector docs (#40819)
* Fix link to Vector docs

* Use DOCS_URL
2025-11-26 17:11:14 +08:00
Joshen Lim 79022cabc0 Update GH discussion for vector buckets (#40816) 2025-11-26 16:34:51 +08:00
Joshen Lim b52739f452 Analytics and Vector buckets should not be visible for CLI or self host dashboard (#40814)
* Analytics and Vector buckets should not be visible for CLI or self host dashboard

* Clean
2025-11-26 16:29:19 +08:00
Danny WhiteandAli Waseem 74fa49d4bd fix(studio): keyboard focus on button (#40458)
* add necessary prop to main button component

* remove redundant props

* docs

* docs improvements

* typo

* tabbable sidebar items

* aria-label and aria-hidden

* update docs

* clarification

* fix link

---------

Co-authored-by: Ali Waseem <waseema393@gmail.com>
2025-11-25 23:48:58 +00:00
Joshen Lim 494d87c032 Update docs link for analytics buckets (#40732) 2025-11-25 22:30:36 +08:00
Riccardo Busetti 1a3ba9f15a ref(etl): Rename ETL Replication to Replication and update docs (#40769)
* ref(etl): Rename ETL Replication to Replication and update docs

* Fix

* Fix

* Fix

* Fix

* Fix
2025-11-25 20:45:50 +08:00
Danny White 552522c16f chore(studio): improve vector storage UI (#40596)
* improve table sheet

* improve metadata keys

* fix styling of foreign schema

* reset radio group

* docs

* resize sheet
2025-11-25 21:37:30 +11:00
Danny WhiteandJoshen Lim 0631444d37 feat(studio): fancy bucket icons (#40766)
* swap icons

* docs improvements

* better upgrade icons

* add sentry

* Nit

---------

Co-authored-by: Joshen Lim <joshenlimek@gmail.com>
2025-11-25 16:41:32 +08:00
Joshen Lim 31a026e6f0 Joshen/depr 253 tighten field validation for bucket name and table name (#40739)
* Update validation for analytics bucket name

* Update comment

* Update bucket name validation for vector buckets
2025-11-25 12:34:07 +08:00
ba16b2c189 docs: vector and analytics storage (#39716)
* Docs skeleton

* Create strcuture

* Revert "Docs skeleton"

This reverts commit 1788972dd2.

* Add analytics

* basic updates

* Fix docs reference

* Apply suggestions from code review

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>

* docs(storage): analytics buckets

* Apply suggestions from code review

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>

* Apply suggestions from code review

* format

---------

Co-authored-by: Danny White <3104761+dnywh@users.noreply.github.com>
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: fenos <fabri.feno@gmail.com>
Co-authored-by: Charis <26616127+charislam@users.noreply.github.com>
2025-11-24 20:57:52 +00:00
Danny WhiteandJoshen Lim d653617cdd chore(studio): improve inline code styling (#40724)
* sweep language

* update class docs

* additional

* basic docs

* sweep relevant instances

* replace text-code

* additional in sweep

* Tiny fix

* prettier

---------

Co-authored-by: Joshen Lim <joshenlimek@gmail.com>
2025-11-24 16:34:30 +08:00
Danny White d990ae840e fix(studio): bucket naming (#40722)
fix: bucket naming
2025-11-24 12:00:57 +08:00
Joshen Lim b374628216 Chore/small fix vectors (#40693)
* Flip vectors enabled features to true

* Fix enabled logic
2025-11-22 02:19:04 +08:00
Ivan Vasilov 8ce41157a3 fix: Generate temp API keys when doing mutations for Analytics buckets (#40680)
* Refactor the iceberg queries and mutations to use getOrRefreshTemporaryApiKey.

* Fix the uses of the mutations.

* Hardcode the temp api keys queries at 60 seconds.
2025-11-21 21:47:29 +08:00
2209d72990 Update UI to de-couple ETL replication context from Analytics Buckets (#40645)
* Update UI to de-couple ETL replication context from Analytics Buckets

* Nit

* Nit

* nit

* Address all feedback

* Address feedback

* Add enabled feature check for analytics and vector buckets

* FIXX

* Update apps/studio/components/interfaces/Storage/AnalyticsBuckets/AnalyticsBucketDetails/NamespaceWithTables/TableRowComponent.tsx

Co-authored-by: Charis <26616127+charislam@users.noreply.github.com>

---------

Co-authored-by: Alaister Young <alaister@users.noreply.github.com>
Co-authored-by: Charis <26616127+charislam@users.noreply.github.com>
2025-11-21 16:28:31 +08:00
Ivan Vasilov 43cc61818c chore: Migrate all isPending uses in react-query (#40642)
* Bump react-query. Minor type and logic fixes.

* Migrate all use of isLoading to isPending in mutations.

* Fix type errors.
2025-11-20 16:44:53 +01:00
Ivan Vasilov a40ccc4b45 chore: Clean onSuccess and onError props on useQuery (#40641)
* Remove all onSuccess and onErrors from useQuery.

* Minor fixes to all refetchInterval.

* Fix smaller type issues.
2025-11-20 14:08:56 +01:00
Francesco SansalvadoreandAli Waseem b3706fcc14 param routing: storage buckets (#40559)
* param routing: storage buckets
* update CreateBucketModal test to work with nuqs

---------

Co-authored-by: Ali Waseem <waseema393@gmail.com>
2025-11-20 09:43:31 +01:00
Ali WaseemandIvan Vasilov 3f6f8aa906 Fix: Use storage API for downloading files in the Dashboard (#40592)
* added ability to download files from storage api directly

* updated to rechange size

* updated test methods

* updated test suite

* updated tests

* updated to remove loops

* removed AI slop

* Updated to use single API key in mem

* Fix the memoization of the getOrRefreshTempApiKey function.

* updated imports

* updated imports

* updated to use import meta

---------

Co-authored-by: Ivan Vasilov <vasilov.ivan@gmail.com>
2025-11-19 11:56:04 -07:00
CharisandAli Waseem 044a575552 test: parallelize table editor tests (#40404)
Table editor tests were being run serially because they would otherwise
stomp all over each other in setup. But this made them really slow. This
PR changes them to run in parallel, and makes sure the setup step runs
only once by using a file lock.

Also cleans up miscellaneous other sources of flakiness in tests.

Co-authored-by: Ali Waseem <waseema393@gmail.com>
2025-11-19 07:14:13 -07:00
Joshen Lim 11107a4781 Update API types (#40609) 2025-11-19 22:13:28 +08:00
Joshen Lim 7d0d9c95fd Shift view replication action to table level and enable search via URL params in ETL pipeline status page (#40547)
* Shift view replication action to table level and enable search via URL params in ETL pipeline status page

* Fix

* Small fixes
2025-11-19 17:41:16 +08:00
b164da4392 Improve time to FCP for storage files explorer (#40514)
* Improve time to FCP for storage files explorer

* fix: useEffect stale closures

---------

Co-authored-by: Ali Waseem <waseema393@gmail.com>
Co-authored-by: Charis Lam <26616127+charislam@users.noreply.github.com>
2025-11-19 16:51:00 +08:00
Joshen Lim 53396f84d8 Client side plan check for analytics and vector buckets (#40549)
* Client side plan check for analytics and vector buckets

* Add upgrade callout for ETL too
2025-11-18 18:14:37 +08:00
Joshen Lim d78f6a1678 Set up feature for ETL + Analytics Buckets private alpha (#40523)
* Set up feature for ETL + Analytics Buckets private alpha

* Nit

* Add override

* Remove console log

* Update feature flag logic
2025-11-18 17:49:46 +08:00
Charis 719ff96801 fix(bucket table): a11y (#40471)
Fix a11y so screen readers can navigate to bucket details from the
bucket overview table
2025-11-17 08:36:26 -07:00
Joshen Lim 975986f33f Finalize clean up logic for deleting analytics buckets (#40461) 2025-11-17 08:16:59 -07:00
Joshen Lim 51e2f10ba7 Chore/add missing error handler for buckets (#40521)
* Add missing error handler for file buckets

* Add missing error handler for analytics buckets

* Add missing error handler for vector buckets
2025-11-17 22:47:56 +08:00
Charis a5e2c62ef4 fix: check for api key permissions before requesting (#40452)
To prevent sending unnecessary requests for API keys when the user can't
view them (Read-Only Role), first check the permissions.
2025-11-14 09:43:34 -05:00
Danny WhiteandJoshen Lim eaf35c14c6 chore(studio): filter policies by bucket name (#40456)
* filter buckets

* Simplify

* General refactors

* Smol

* Add missing empty state for search

* Clean up 😬

---------

Co-authored-by: Joshen Lim <joshenlimek@gmail.com>
2025-11-14 17:47:16 +08:00
Joshen LimandAlaister Young 8b5a087eb7 Joshen/depr 262 bucketid route needs to handle if a bucket doesnt exist (#40430)
* Handle landing on a bucket id that doesnt exist in project

* Standardize re routing behaviour for files bucket

* refactor

---------

Co-authored-by: Alaister Young <a@alaisteryoung.com>
2025-11-14 15:25:59 +08:00
Danny WhiteandJoshen Lim 1dd3ea1eae fix(studio): table row focus and hover (#40454)
* fix table row focus and hover

* add basic tabIndex

* fix buttons

* other table types

* Minor clean up

---------

Co-authored-by: Joshen Lim <joshenlimek@gmail.com>
2025-11-14 12:39:09 +08:00
Joshen Lim dbbae988a9 Only show analytics and vector buckets for hosted (#40418)
* Only show analytics and vector buckets for hosted

* Nit

* nit
2025-11-13 18:09:42 +08:00
Ivan VasilovandJoshen Lim 1032d13930 fix: Small fixes in Analytics and Vector Buckets (#40386)
* When creating a s3 vectors fdw, add the target schema as a server option.

* Fix a bug in the row link, it didn't work when you middle click.

* Refactor the protected schema logic to include schemas from all fdws.

* Refactor the protected schema logic to include fdw type and name. Change the ProtectedSchemaWarning to show different messages for the 2 fdw types.

---------

Co-authored-by: Joshen Lim <joshenlimek@gmail.com>
2025-11-13 11:02:41 +01:00
Danny WhiteandJoshen Lim 849c29f824 chore(studio): improve Storage UI (#40367)
* clarify breadcrumbs

* tiny badge variant

* improve admonition

* indicate max buckets limit

* nit

* Minor nits

* badge fix

---------

Co-authored-by: Joshen Lim <joshenlimek@gmail.com>
2025-11-13 20:30:49 +11:00
Joshen Lim e36ae95eb7 Refactor polling logic for Analytics Buckets while syncing with namespace (#40381)
* Refactor long polling logic for analytics bucket to automatically long poll when landing back on page and data has yet to be synced

* Nit clean up refactor

* Clean up

* Nit
2025-11-13 17:17:36 +08:00
Joshen Lim d8fcab2433 Joshen/depr 250 analytics buckets use temporary api key instead of projects (#40342)
* Retrieve temporary API key within iceberg-namespace-tables-query

* Retrieve temporary API key within iceberg-namespace-table-delete-mutation

* Retrieve temporary API key within iceberg-namespaces-query

* Fix

* Retrieve temporary API key within iceberg-namespace-create-mutation

* Update based on comments
2025-11-13 16:04:21 +08:00
Joshen Lim d8678921c0 Improve granularity of replication status (#40329)
* Improve granularity of replication status

* Minor copy improvements

* Update toast message copy

* Decouple pipeline status from table replication status
2025-11-13 15:13:03 +08:00
Ivan Vasilov c5bf65b0b4 feat: Create FDW for S3 Vectors buckets (#40206)
* Fix childProps in Admonition so that they're added as a prop to the main div.

* Replace the admonition with Alert in Wrapper tab page to add a gap between childs.

* Add s3 vectors fdw.

* Minor fix to FormSection.

* Update the fdw mutations to support passing in options.

* Refactor the vector flow to create fdws.

* Revert cron description change.

* If the bucket can't be created, don't create a fdw.

* Update/delete the fdw when deleting a table or a bucket.

* Minor fixes.

* Clean up the delete modal.

* Handle edge cases when missing a wrapper.

* Remove the admonition in the create bucket modal.

* Fix the loading state when creating a bucket.

* Fix the createWrapper sheet to work with s3 vectors.

* Fix undefined wrapperMeta issue.

* Create the schema when installing a wrapper.

* Tiny cleanup.

* Clean up unneeded useState. Create a wrapper only if the all conditions are met.

* Fix all comments.

* Add s3 vectors for docs.

* Add a link and fix the file name for S3 Vectors in docs.

* Hide the table editor button if the wrapper instance is missing.

* Small fixes.
2025-11-12 11:00:38 +01:00
Joshen Lim cf18948dcf Only update FDW when removing namespace table if table is in FDW instance tables (#40331)
Only update FDW when removing namespace table if table is in FDW instance
2025-11-11 18:33:38 +08:00
Danny WhiteandCharis Lam 1d54b9d72b studio(chore): improve storage bucket presentation (#40230)
* badge and admonition updates

* whole file row tappable

* file bucket improvements

* match tables across all storage types

* keyboard focussable rows

* share function

* other bucket types

* fix: a11y of table rows

* clean up focus state on rows

* accessibility

* address review comments

* move accessibility

---------

Co-authored-by: Charis Lam <26616127+charislam@users.noreply.github.com>
2025-11-11 16:30:57 +11:00
Joshen Lim 7b7eb3b690 Only show replication action if publication has been created (#40295) 2025-11-10 17:20:34 +08:00
Joshen Lim eabfebf0f7 Refactor/use text confirm modal for delete buckets (#40291)
* Refactor DeleteBucketModal to use TextConfirmModal

* Refactor DeleteAnalyticsBucket to use TextConfirmModal

* Update TextConfirmModal to disable button until text match

* Refactor DeleteVectorBucketModal to use TextConfirmModal

* Remove test case - no longer valid
2025-11-10 15:28:08 +08:00
Joshen Lim 5291fe3de9 Set up removing tables from namespaces in analytics buckets (#40244)
* Set up removing tables from namespaces in analytics buckets

* Nit

* Clean up based on comments
2025-11-10 11:32:13 +08:00