You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: iterate_dynamodb/README.md
+10-14Lines changed: 10 additions & 14 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -4,16 +4,14 @@ First of all, you must connect your Tinybird Workspace with your Git repository
4
4
5
5
### Create a DynamoDB Data Source
6
6
7
-
- Create the DynamoDB Connection in your main Tinybird Workspace using Tinybird CLI, as explain in the [iteration documentation](https://www.tinybird.co/docs/ingest/dynamodb). Connections reside always in the main Branch.
7
+
- Create the DynamoDB Connection in your main Tinybird Workspace using Tinybird CLI, as explained in the [iteration section](https://www.tinybird.co/docs/ingest/dynamodb). Connections reside always in the main Tinybird Branch.
8
8
- Create a new git branch
9
-
- Create a new DynamoDB .datasource data file in the branch, as in the example PR. You shouldn't need fixtures as the Data Source will be populated from the Connection, but you can add fixtures and/or tests if needed.
10
-
- For information about DynamoDB options read the [connector documentation](https://www.tinybird.co/docs/ingest/dynamodb)
9
+
- Create a new DynamoDB .datasource Datafile in the git branch, as in the example PR. You can use fixtures and tests as the Data Source won't be populated from the Connection.
10
+
- For information about DynamoDB options and recommendations read the [connector documentation](https://www.tinybird.co/docs/ingest/dynamodb)
11
11
- Commit your code and create a new PR/MR from the branch to `main`
12
12
- Wait for CI to finish.
13
-
- Check that everything is working as expected in the temporary Tinybird Branch, CI will automatically create it and name it like `tmp_ci_{PRid}`).
14
-
- You can travel to this Branch through UI and check that the Data Source is working
15
-
- You'll need wait for the initial synchronization job to end, check the job status in the dashboard and the logs in the Data Source `log` tab
16
-
- You can add/update/delete items in your DynamoDB table and check that the changes reproduce in the Data Source.
13
+
- Check that everything is created as expected in the temporary Tinybird Branch, CI will automatically create it and name it like `tmp_ci_{PRid}`).
14
+
- You can travel to this Branch through UI and check that the Data Source is created and Schema is correct.
17
15
- If everything is fine, merge and wait for CD. Now you should have your Data Source in the main Workspace, using the Connection, and the temporary CI Branch will be deleted.
@@ -22,24 +20,22 @@ First of all, you must connect your Tinybird Workspace with your Git repository
22
20
### Update DynamoDB Data Source with a new column, with same Connection
23
21
24
22
- Create another git branch
25
-
- Add the new column to the schema and query
23
+
- Add the new column to the schema and query in the Datafile
26
24
- Commit your code and create a new PR from the branch to `main`
27
25
- Wait for CI to finish.
28
-
- Check that everything is working as expected in the temporary branch, CI will automatically create it and name it like `tmp_ci_{PRid}`).
29
-
- You can travel to the Branch through UI and check that the Data Source has the changes applied
30
-
- You can add/update/delete items in your DynamoDB table and check that the changes reproduce in the Data Source.
26
+
- Check that everything is updated as expected in the temporary branch, CI will automatically create it and name it like `tmp_ci_{PRid}`).
31
27
- Merge and wait for CD. Now you should have your Data Source updated in the main Workspace, using the Connection, and the temporary CI Branch will be deleted.
- If the Data Source has dependencies they must be deleted too, to the workflow to work
40
36
- Commit your code and create a new PR from the branch to `main`
41
37
- Wait for CI to finish.
42
-
- Check that everything is working as expected in the temporary Branch, CI will automatically create it and name it like `tmp_ci_{PRid}`).
43
-
- Merge and wait for CD. Now you should have your Data Source deleted in the main Workspace, using the Connection, and the temporary CI Branch will be deleted.
38
+
- Check that the Data Source has been deleted in the temporary Branch, CI will automatically create it and name it like `tmp_ci_{PRid}`).
39
+
- Merge and wait for CD. Now you should have your Data Source deleted in the main Workspace, and the temporary CI Branch will be deleted.
44
40
- If the Connection isn't being used by any other Data Sources, you can remove it directly using CLI.
0 commit comments