File storage and transfer

All TU Delft installed computers have direct access to the TU Delft home, group and bulk storage. You can access your files from both your personal computer, the Bastion and the Linux servers.

1. Types of storage

1.1. Home folder(s)

Using ...your Linux home folder location is ...
Linux/home/<NetID> or /home/nfs/<NetID> 
Windows only available using an SCP/SFTP client
webdatanot available
Using ...your Windows home folder location is ...
Linux/winhome/<NetID>
Windows H: or \\tudelft.net\staff-homes\[a-z]\<NetID>
webdatahttps://webdata.tudelft.nl/staff-homes/[a-z]/<NetID> 

This is the folder that is used by default by your programs. This folder is private and is primarily meant to store files personally created by you.

On desktops and servers this is a network share, and a backup service protects your files from both hardware defects and user error (you can restore files from as far as twelve days back), therefore quota limit the available space. On laptops home directories are stored locally (so they are also available away from the TU Delft campus) and need to be backed up separately.

You actually have two (separate) home folders: one for Linux and one for Windows. Linux and Windows store program settings differently in your home folder differently making shared use tricky. In Linux you can however use files in for example your Windows 'My Documents' folder without problems (under '/winhome/<NetID>/My Documents').

It's possible to access the backups yourself. In Linux the backups are located under the (hidden, read-only) ~/.snapshot/ folder. In Windows you can right-click the H: drive and choose Restore previous versions.

Disk usage and quota

On most Linux machines, you can see your disk usage and quota for your home folder by running quota -ms (look at the line for ../staff-homes/.. or ../student-homes/..).

1.2. Group share

Using ...your Group share location is ...
Linux/tudelft.net/staff-groups/ewi/insy/<Group>/<Project>
Windows K: or M: or \\tudelft.net\staff-groups\ewi\insy\<Group>\<Project>
webdatahttps://webdata.tudelft.nl/staff-groups/ewi/insy/<Group>/<Project> 

This network share is primarily meant to share important files (documents, code, ...) with group members. You can create your own Project folders inside your Group's folder. There is a backup service to protect the files. There are no quota, but the available space is limited, so leave enough space for other users.

1.3. Bulk share

Using ...your Bulk share location is ...
Linux/tudelft.net/staff-bulk/ewi/insy/<Group>/<NetID>
Windows L: or \\tudelft.net\staff-bulk\ewi\insy\<Group>\<NetID>
webdatahttps://webdata.tudelft.nl/staff-bulk/ewi/insy/<Group>/<NetID> 

This network share is primarily meant for large files and folders (datasets, results, download files and programs, ...) that are either to big to backup or can be recreated from another source. You can create your own personal folder inside your Group's folder. There is no backup service nor quota. The available space is large but still limited, so leave enough space for other users.

1.4. Local storage

Using ...your local storage location is ...
Linux/tmp/<NetID>
Windows D:\<NetID>
webdatanot available

Local storage is meant for temporary storage of large amounts of data with fast access on a single computer. You can create your own personal folder inside the local storage share. Unlike the network storage above, local storage is only accessible on that computer, not on other computers or through network file servers or webdata. There is no backup service nor quota. The available space is large but fixed, so leave enough space for other users. Files under /tmp that have not been accessed for 10 days are automatically removed.

1.5. Memory storage

Using ...your memory storage location is ... 
Linux/dev/shm/<NetID>
Windows not available
webdatanot available

Memory storage is meant for short-term storage of limited amounts of data with very fast access on a single computer. You can create your own personal folder inside the memory storage location. Memory storage is only accessible on that computer, and there is no backup service nor quota. The available space is limited and shared with programs, so leave enough space (the computer will likely crash when you don't!). Files that have not been accessed for 1 day are automatically removed.

Use this only when using other storage makes your job or the whole computer slow.

2. Transfer files

2.1. Between TU Delft installed machines

Your Windows home folder and the Bulk and Group shares are available on all TU Delft installed machines including the compute servers. If possible use one of these shares for files that you want to access on both your personal computer and the compute servers.

For files that you want to transfer to or from your Linux home folder or local storage, first transfer them to the Bulk share and from there to the final destination.

2.2. Using webdata

Your Windows home folder and the Bulk and Group shares are also available world-wide through the TU Delft webdata service. See the webdata page for manuals on using the service with your personal computer.

For files that you want to transfer to or from your Linux home folder or local storage, first transfer them to the Bulk share and from there to the final destination.

2.3. Using SCP/SFTP

Both your Linux and Windows home folder and the Bulk and Group shares are also available world-wide via an SCP/SFTP client. See the SSH clients page for instructions on using the service with your personal computer.

2.4. To or from local storage

For files that you want to transfer to or from local storage, first transfer them to the Bulk share and from there to the final destination, using one of the options above and the Linux mv (move) command.