LakehouseStore.
The value of the parameter the address of the lakehouse's store: the folder of files, the catalogue's database address without a password, and the prefix of the lakehouse catalogue's schemas, one for each plane
Figure 1LakehouseStorespecified
- kind
- value
- scope
- none
- key
- none
- store
- none
- family
- record
Fields#
| field | type | required | note |
|---|---|---|---|
folder | text | yes | a folder on a laptop, a bucket on the three machines |
catalogue | address | yes | the database that holds the lakehouse catalogue; the password comes from the secrets manager, never from here |
catalogue_prefix | text | yes | one schema of the lakehouse catalogue for each plane under this prefix |
scratch | text | no | the folder the engine spills to when a read exceeds its memory; a folder named tmp beside the store’s folder when absent, never the working folder of the process (read 27 September: 24 GB of spill in the platform’s own tree made a release dirty) |
Routes that use it#
No route takes or returns LakehouseStore directly. The record holds it, and the objects that point at it reach it.