You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
* add PR ids to readme links and expand a little step about check the temporary branch
* Update iterate_snowflake/README.md
fix typos
Co-authored-by: alrocar <alrocar@users.noreply.github.com>
* some more specific changes
* deleted
---------
Co-authored-by: alrocar <alrocar@users.noreply.github.com>
Copy file name to clipboardExpand all lines: iterate_snowflake/README.md
+30-11Lines changed: 30 additions & 11 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -8,28 +8,47 @@ First of all, you must connect your Tinybird workspace with your Git repository
8
8
- Create a new git branch
9
9
- Create a new Snowflake .datasource data file in the branch, as in the example PR. You shouldn't need fixtures as the Data Source will be populated from the connection, but you can add fixtures and/or tests if needed.
10
10
- For information about Snowflake options read the [connector documentation](https://www.tinybird.co/docs/ingest/snowflake)
11
-
- Commit your code and create a new PR/MR from the branch to `main`
12
-
- Wait for CI. You can check in the temporary workspace branch (automatically created and named like `tmp_ci_*`) that everything works as expected.
13
-
- Merge and wait for CD. Now you should have your Data Source in the main workspace, using the connection, and the temporary CI branch will be deleted.
- Commit your code and create a new PR/MR from the branch to `main`
12
+
- Wait for CI to finish.
13
+
- Check that everything is working as expected in the temporary branch, CI will automatically create it and name it like `tmp_ci_{PRid}`).
14
+
- Move to the test branch and try to sync the new Data Source:
15
+
```commandline
16
+
tb auth
17
+
tb branch use tmp_ci_{id}
18
+
tb datasource sync {data_source_name} --yes
19
+
```
20
+
For Snowflake Data Sources, the scheduler services must be provisioned before the first sync. This can take a while and you'll receive an error during this time:
21
+
```commandline
22
+
tb datasource sync {data_source_name} --yes
23
+
Error:
24
+
** Failed syncing Data Source {data_source_name}: The service is being provisioned. It might take a while, please retry in a few seconds.
25
+
```
26
+
- You can travel to the branch through UI and check that the Data Source is working (also you'll need to wait until the service is provisioned).
27
+
- If everything is fine, merge and wait for CD. Now you should have your Data Source in the main workspace, using the connection, and the temporary CI branch will be deleted.
### Update Snowflake Data Source with a new column, with same connection
19
33
20
34
- Create another git branch
21
35
- Add the new column to the schema and query
22
-
- Commit your code and create an ew PR from the branch to `main`
23
-
- Wait for CI to finish. You can check in the temporary workspace branch (automatically created and named like `tmp_ci_*`) that everything works as expected.
36
+
- Commit your code and create an new PR from the branch to `main`
37
+
- Wait for CI to finish.
38
+
- Check that everything is working as expected in the temporary branch, CI will automatically create it and name it like `tmp_ci_{PRid}`).
39
+
- You can travel to the branch through UI and check that the Data Source has the changes and is working (you'll need to wait until the service is provisioned).
24
40
- Merge and wait for CD. Now you should have your Data Source updated in the main workspace, using the connection, and the temporary CI branch will be deleted.
- Commit your code and create an ew PR from the branch to `main`
33
-
- Wait for CI to finish. You can check in the temporary workspace branch (automatically created and named like `tmp_ci_*`) that everything works as expected.
34
-
- Merge and wait for CD. Now you should have your Data Source updated in the main workspace, using the connection, and the temporary CI branch will be deleted.
48
+
- If the Data Source has dependencies they must be deleted too, to the workflow to work
49
+
- Commit your code and create a new PR from the branch to `main`
50
+
- Wait for CI to finish.
51
+
- Check that everything is working as expected in the temporary branch, CI will automatically create it and name it like `tmp_ci_{PRid}`).
52
+
- Merge and wait for CD. Now you should have your Data Source deleted in the main workspace, using the connection, and the temporary CI branch will be deleted.
53
+
- If the connection isn't being used by any other Data Sources, you can remove it directly using CLI.
0 commit comments