You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: docs/data/sensitive-data/sd-billing-units.md
+98-48Lines changed: 98 additions & 48 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,76 +1,113 @@
1
1
# Resource planning for your CSC Project
2
2
3
-
Both the CSC project manager and project members are responsible for monitoring the resources consumed by their CSC project: Billing Units (BUs) and storage quota. When creating a project, you can apply for the default amount of resources, which will be granted immediately. However, it’s important to plan ahead for the next six months of usage and apply for additional resources twice a year.
3
+
**Both the CSC project manager and project members are responsible for monitoring the resources consumed by their CSC project: Billing Units (BUs) and storage quota**. When creating a project, you can apply for the default amount of resources, which will be granted immediately. However, **it’s important to plan ahead for the next six months of usage and apply for additional resources twice a year**.
4
4
5
-
Please note that after each Billing Units application, there is a two week period during which you cannot submit another request, thus make sure to apply for resources in advance. You will be notified via email when your project’s Billing Units are running low, so you can apply for more in time and avoid service interruptions.
5
+
!!! Note
6
+
Please note that after each Billing Units application, **there is a two week period during which you cannot submit another request**, thus make sure to apply for resources in advance. You will be notified via email when your project’s Billing Units are running low, so you can apply for more in time and avoid service interruptions.
6
7
7
8
8
9
9
-
!!! default "Billing Units and quota"
10
+
In the following section, you will learn:
10
11
11
-
**Every active CSC project consumes both Billing Units (BUs) and storage quota.**
12
+
-[What are Cloud and Storage Billing Units and quota](#what-are-cloud-and-storage-billing-units-and-quota)
13
+
14
+
-[What happens if your project runs out of Billing Units](#what-happens-if-your-project-runs-out-of-billing-units)
15
+
16
+
-[Step 1: Determine the appropriate Billing Units Package](#determine-the-appropriate-billing-units-package)
17
+
18
+
-[Step 2: Apply for more billing units in the MyCSC portal](#apply-for-more-billing-units-in-the-mycsc-portal)
19
+
20
+
21
+
22
+
## What are Cloud and Storage Billing Units and quota
23
+
24
+
1.**Every active CSC project consumes both Billing Units (BUs) and storage quota.**
12
25
13
-
**Billing Units (BUs)** are used to track how much computing power and processing time your project consumes. CSC uses different types of Billing Units to measure resource usage based on the service:
26
+
-**Billing Units (BUs)** are used to track how much computing power and processing time your project consumes. CSC uses different types of Billing Units to measure resource usage based on the service:
14
27
15
-
- **SD Desktop** consumes **Cloud Billing Units** type, which reflect the use of virtual desktops and compute resources
16
-
- **SD Connect** consumes **Storage Billing Units** type, which reflect the amount of data stored in CSC’s cloud infrastructure.
28
+
-**SD Desktop** consumes **Cloud Billing Units** type, which reflect the use of virtual desktops and compute resources
29
+
30
+
-**SD Connect** consumes **Storage Billing Units** type, which reflect the amount of data stored in CSC’s cloud infrastructure.
17
31
18
-
- 30 000 Cloud and Storage BUs is usually enough for initial testing. Next, you should estimate your project’s resource and storage needs for the next six months and apply for the required amount using the MyCSC portal. The instructions below will guide you through the process.
32
+
- 30 000 Cloud and Storage BUs is usually enough for initial testing. Next, you should estimate your project’s resource and storage needs for the next six months and apply for the required amount using the MyCSC portal. The instructions below will guide you through the process.
19
33
20
-
**The storage quota** limits the amount of storage space available:
34
+
2.**The storage quota** limits the amount of storage space available:
21
35
22
-
- Default quota (or storage space) for each CSC project with for SD Connect enabled is 10 TB, which you can expand up to 200 TB as needed by contacting service desk (subject: Increase Allas quota).
23
-
- Default volume quota for each virtual desktop is up to 200 GB. This is the storage space used to import files from SD Connect to SD Desktop for the analysis phase. You can expand the volume, before any data has been imported to it, by writing to servicedesk@csc.fi (subject: SD Desktop).
36
+
- Default quota (or storage space) for each CSC project with for **SD Connect enabled is 10 TB**, which you can expand up to 200 TB as needed by contacting service desk (subject: Increase Allas quota).
24
37
38
+
- Default **volume quota for each virtual desktop is up to 200 GB**. This is the storage space used to import files from SD Connect to SD Desktop for the analysis phase. You can expand the volume, before any data has been imported to it, by writing to servicedesk@csc.fi (subject: SD Desktop).
25
39
26
-
1.[SD Connect BU consumption](#sd-connect-bu-consumption)
27
-
2.[SD Desktop BU consumption](#sd-desktop-bu-consumption)
28
-
3.[What happens if your project runs out of Billing Units?](#what-happens-if-your-project-runs-out-of-billing-units)
29
-
4.[Apply for more billing units ](#apply-for-more-billing-units)
30
-
5.[Log into SD Services](#log-into-sd-services)
31
40
32
41
42
+
## What happens if your project runs out of Billing Units?
33
43
34
-
#### SD Connect BU consumption
44
+
1. Once all the Cloud Billing Units for your CSC project have been used up, **access to the SD Desktop service will be restricted**. This means that:
35
45
36
-
SD Connect stores data into CSC's infrastructure Allas and provides additional automated encryption and encryption key management. SD Connect consumes Billing Units at a rate of **1.3 Storage BUs per TB per hour**.
46
+
- All virtual desktops currently running will automatically be paused.
47
+
- You will not be able to access the virtual desktops content's or unpause them, until you have applied for more resources.
48
+
- Your data remains unaffected and will not be deleted, even in cases where the total Billing Units reach zero or enter negative values.
37
49
38
-
Here’s a table summarizing the Storage Billing Units required for storing data in **SD Connect** over **6 months** and **1 year** for various storage sizes:
50
+
!!! Note
51
+
Each project member will receive a notification via email from the MyCSC portal when the Billing Units for your CSC project are about to end.
52
+
53
+
54
+
2. Once all quota (or storage space) has been used:
55
+
56
+
- Data upload to SD Connect will no longer be possible
57
+
58
+
- Data import to SD Desktop will no loner be possible
59
+
60
+
61
+
## Determine the appropriate Billing Units Package
62
+
63
+
Estimate the Billing Units your project will consume over the next six months for SD Desktop (Cloud BUs Type) and SD Connect (Storag Bus typee) using the examples provided below. This will help you determine which package to apply for in the MY.csc.fi portal. Before you begin, please note:
64
+
65
+
- Unused Billing Units expire every six months, so request only what you need.
66
+
67
+
- The Basic, Small and Medium packages have fixed Billing Unit (BU) allocations, while the Large package is flexible and can be defined by you, up to a maximum of 3,000,000 BUs.
68
+
69
+
- If your virtual desktop has been paused because all billing Units have been already consumed, apply for the Small Package (30,000 BUs). It will be assigned immediately so you can resume work. After two weeks, review if more units are needed.
70
+
71
+
- after each Billing Units application, **there is a two week period during which you cannot submit another request**. If you are unsure what billing units package you need to apply for, pelase contact us at servicedesk@csc.fi
39
72
40
-
| Storage Size | Storage Billing Units (6 Months) | Storage Billing Units (1 Year) |
Analysing data in SD Desktop consumes **Cloud Billing Units** based on the type of virtual desktop used. Each virtual desktop can also have a volume (also called disk space), where files can be imported from SD Connect/SD Apply. The volume can be added only during desktop creation (up to 200 GB). If you need larger volume please contact service desk _(subject: Sensitive data)_.
50
78
51
79
Here’s a table summarizing the Cloud Billing Units required for using **SD desktop** over **6 months** and **1 year** for various desktop options:
52
80
53
-
| Desktop Option | Cloud Billing Rate (units/hour) | Cloud Billing Units (6 Months) |Cloud Billing Units (1 Year)|
81
+
| Desktop Option | Cloud Billing Rate (units/hour) | Cloud Billing Units ( consumed in 6 months) |Select the correct BU Package in My.csc.fi and application frequency|
| Small Computation | 5.2 | 22,464 |Small package, 2 times a year: 30.000 BUs assigned immediately|
84
+
| Medium Computation | 10.4 | 44,928 |Small package, 3 times a year: 30.000 BUs assigned immediately |
85
+
| Heavy Computation | 65 | 280,800 |Medium package, 2 times a year: 300.000 BUs Processed on average within 1-3 days by a Resource Officer|
86
+
| Small GPU Computation | 78 | 341,640 |Medium package, 3 times a year: 300.000 BUs Processed on average within 1-3 days by a Resource Officer|
87
+
| Big Picture project | 195 | 854,100 |Large package, 2 times a year: 900.00 Bus Generally processed every three weeks by the CSC's Resource Allocation Group|
60
88
61
-
#### What happens if your project runs out of Billing Units?
62
89
63
-
Once all the Cloud Billing Units for your CSC project have been used up, **access to the SD Desktop service will be restricted**. This means that:
64
90
65
-
- All virtual desktops currently running will automatically be paused.
66
-
- You will not be able to access the virtual desktops content's or unpause them, until you have applied for more resources.
67
-
- Your data remains unaffected and will not be deleted, even in cases where the total Billing Units reach zero or enter negative values.
68
91
69
-
!!! Note
70
-
Each project member will receive a notification via email from the MyCSC portal when the Billing Units for your CSC project are about to end.
92
+
#### SD Connect: storage type billing units
93
+
94
+
SD Connect stores data into CSC's infrastructure Allas and provides additional automated encryption and encryption key management. SD Connect consumes Billing Units at a rate of **1.3 Storage BUs per TB per hour**.
95
+
96
+
Here’s a table summarizing the Storage Billing Units required for storing data in **SD Connect** over **6 months** and **1 year** for various storage sizes:
97
+
98
+
| Storage Size | Storage Billing Units (consumed in 6 months) | Select the correct BU Package in My.csc.fi and application frequency |
| 500 GB (0.5 TB) | 2,847 units | Basic package, 3 times a year: 2.500 BUs assigned immediately |
101
+
| 1 TB | 5,694 units | Small package, 2 times a year: 30.000 BUs assigned immediately |
102
+
| 10 TB | 56,940 units | Small package, 3 times a year: 30.000 BUs assigned immediately |
103
+
| 100 TB | 569,400 units | Medium package, 3 times a year: 300.000 BUs Processed on average within 1-3 days by a Resource Officer |
104
+
105
+
106
+
107
+
108
+
109
+
## Apply for more billing units in the MyCSC portal
71
110
72
-
73
-
### Apply for more billing units
74
111
75
112
You can apply for more BUs for your CSC project in MyCSC portal. Please note that after each application, there is a two week period during which you cannot submit another Billing units (BUs) request, thus make sure to apply for resources in advance.
76
113
@@ -81,15 +118,28 @@ You can apply for more BUs for your CSC project in MyCSC portal. Please note tha
81
118
82
119
5. In the new window you will see the services you have active in the project (in gray). Press **Next**.
83
120
84
-
6. In the second view, click on the Billing Units package you need (e.g. M) for:
121
+
122
+
6. In the second view, click on the Billing Units package you need for
123
+
85
124
- Cloud Billing Unit type (used by SD Desktop)
125
+
86
126
- Storage Billing Units type (for SD Connect)
87
-
- Click **Next**.
88
-
7. In the next view, click **Add publications**. In the new window, you can search or add publications manually. If you don't have publications directly related to this work yet, any past publication from your research group will be fine. Click **Add**.
89
-
- Next, you will be asked to add keywords. These will become tags that will help you search for the project. Add a keyword (e.g. research) and press **Add**.
90
-
- Next, you need to fill in two more fields: Short overview of (expected) results and Program, software, methods used.
91
-
- Click **Next**.
92
-
9. In the last view, you can review the project description and field of science. Finally, you can click **Submit**.
127
+
128
+
Click **Next**.
129
+
130
+
7. In the next view, click **Add publications**. In the new window, you can search or add publications manually. **Note: Undestandably, if you don't have publications related to this work yet, you can add here any past publication from your research group, even if the project is not directly related**
131
+
132
+
Click **Add**.
133
+
134
+
8. Next, you will be asked to add keywords. These will become tags that will help you search for the project. Add a keyword (e.g. research) and press **Add**.
135
+
136
+
9. Next, you need to fill in two more fields: Short overview of (expected) results and Program, software, methods used.
137
+
138
+
Click **Next**.
139
+
140
+
10. In the last view, you can review the project description and field of science. Finally, you can click **Submit**.
141
+
142
+
When the Biling Units will be assigned to the CSC Project you will receive an email notification.
Copy file name to clipboardExpand all lines: docs/data/sensitive-data/sd-use-case-new-user-project-manager.md
+10-5Lines changed: 10 additions & 5 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -105,11 +105,16 @@ You need access to SD services for processing research data. Whether you are the
105
105
106
106
---
107
107
108
-
#### 2.5 Confirmation
108
+
#### 2.5 Terms of Use and Data Processing Agreement
109
109
110
-
- Under Terms of Use, ensure you meet the **Prerequisites and Responsibilities** to be a CSC Project Manager. For research projects, the Project Manager should be an experienced researcher (e.g., postdoc, group leader, professor, or doctoral researcher employed by a research organization). **Note for Students:** If you are a student, please have your supervisor create the CSC project or [contact CSC Service Desk](../../support/contact.md) (subject: sensitive data) for assistance. It is not possible to access SD Services with a student account.
111
-
- Read and accept the terms of use.
112
-
- Click **Submit**.
110
+
In the next view, under Terms of Use for the project:
111
+
112
+
1. ensure you meet the **Prerequisites and Responsibilities** to be a CSC Project Manager. For research projects, the Project Manager should be an experienced researcher (e.g., postdoc, group leader, professor, or doctoral researcher employed by a research organization). **Note for Students:** If you are a student, please have your supervisor create the CSC project or [contact CSC Service Desk](../../support/contact.md) (subject: sensitive data) for assistance. It is not possible to access SD Services with a student account.
113
+
114
+
2. Read and accept the General Terms of use for CSC's Sevices for Research. Note: this will include the [CSC’s Personal Data Processing Agreement (DPA)](https://research.csc.fi/terms-of-use/data-processing-agreement/)
115
+
116
+
- Click **Submit**.
117
+
113
118
- Wait for your project is being created. When project is ready, you'll be redirected to project page.
114
119
115
120
---
@@ -173,7 +178,7 @@ The default lifetime of a CSC project is one year, after which it will be automa
173
178
174
179
### 6. Planning for resources consumption and login
175
180
176
-
Now that your CSC project is ready, you can start planning how many resources (Billing Units) and how much storage (quota) your project will need. You can learn more in the next [section](./sd-billing-units.md). You can also delegate this task to one of the CSC project members and you can start directly using the services (links to related user guides):
181
+
Now that your CSC project is ready, you can start planning how many resources (Billing Units) and how much storage (quota) your project will need for the next six months. You can learn more in the next [section](./sd-billing-units.md). You can also delegate this task to one of the CSC project members and you can start directly using the services (links to related user guides):
0 commit comments