You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: docs/hpc/ranch-migration-2025.md
+39-4Lines changed: 39 additions & 4 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,8 +1,40 @@
1
+
<!--
2
+
Heo
3
+
Recursive cp or rsync is reasonable way to transfer. The key here is that user should partition the batch in reasonable sizes, e.g. 10TB-100TB range. We see a user who already copied 100TB last week from old projects to new ones. In general, it will be a slow process for most users. One thing we should warn users against is futile attempt to parallelize multiple batches in the hope to speed things up, which will bog down finite number of tape drives available on both source and target side, ultimately blocking all other resources. This can easily happen, and we will have to terminate those processes and clean up.
4
+
5
+
6
+
David
7
+
Could you also add something about du to the migration guide? On the Quantum Ranch system, data that had been migrated to tape wasn't reflected in du output, which is why we had the HSM_usage file, but on the ScoutFS filesystem, the du output actually includes the data on tape usage, so is a lot more useful to the users.
8
+
9
+
add Globus as a means of transfer
10
+
11
+
12
+
13
+
heo
14
+
Junseong Heo
15
+
4:54 PM
16
+
/qranch/{users,projects} are ReadOnly re-export of the old ranch data. For every project that was on the old ranch, one can find the new one in /scoutfs/{users,projects} on new machines. Each directory in the new one has a symbolic link to the old one called "OldRanchData". The copy in /qranch will go away in 12 months or so. User guide states that users need to review and copy wanted data to new ranch.
17
+
:+1:
18
+
2
19
+
20
+
-->
21
+
22
+
23
+
24
+
25
+
26
+
27
+
28
+
1
29
# Ranch System Replacement<br>Data Migration Instructions for all Users
2
-
*Last update: September 24, 2025*
30
+
*Last update: October 8, 2025*
31
+
32
+
## Notices
3
33
4
-
!!! warning
5
-
**September 24, 2025** Over the next year, [TACC's archival data system, Ranch,][TACCRANCHUG], will undergo a complete system replacement, requiring all current Ranch users to curate, then migrate, all their Ranch data from the old to the new system.
34
+
* 10/08/2025 **VSCode users: Accessing Ranch and managing transfers via VSCode is prohibited.** Ranch is an archival file system, not a computational resource. Please use a terminal application to manage your Ranch data.
35
+
36
+
37
+
09/24/2025 Over the next year, [TACC's archival data system, Ranch,][TACCRANCHUG], will undergo a complete system replacement, requiring all current Ranch users to curate, then migrate, all their Ranch data from the old to the new system.
6
38
7
39
Since this is a total system replacement, and not an upgrade to existing hardware, all data on the current (Old) Ranch must be MANUALLY COPIED OVER to the New Ranch system, by the respective data's owner, in order to save it permanently. Data on Old Ranch will NOT automatically transfer to New Ranch. You are responsible for migrating your own data that is stored on Old Ranch, either in your personal directory, or in a designated Project space, prior to the end of November, 2026.
8
40
@@ -38,6 +70,8 @@ Fri Sep 19 04:32:01 2025 /stornext/ranch_01/ranch/users/01158/slindsey total sto
38
70
ranch$ ls
39
71
```
40
72
73
+
74
+
41
75
### Important Dates
42
76
43
77
<tableborder="1">
@@ -61,7 +95,8 @@ ranch$ ls
61
95
62
96
## Data Migration Directions
63
97
64
-
Since Old Ranch is a read-only file system, you must use either the `cp` and/or the `rsync` UNIX commands to copy over your data.
98
+
Since Old Ranch is a read-only file system, you must use either the `cp` and/or the `rsync` UNIX commands to copy over your data. **Do not use VSCode to access or manage data on Ranch.**<!-- **VSCode users: Accessing Ranch and managing transfers via VSCode is prohibited.** Ranch is an archival file system, not a computational resource. Please use a terminal application to manage your Ranch data.-->
0 commit comments