DAIC Experimental
— Documentation for the experimental environment.
(Go to stable docs)
Data Transfer
Transfer data to and from DAIC.
less than a minute
Copy files to DAIC
scp myfile.tar.gz <netid>@daic01.hpc.tudelft.nl:/tudelft.net/staff-umbrella/<project>/
Copy folders to DAIC
rsync -avz mydata/ <netid>@daic01.hpc.tudelft.nl:/tudelft.net/staff-umbrella/<project>/mydata/
Copy from DAIC
rsync -avz <netid>@daic01.hpc.tudelft.nl:/tudelft.net/staff-umbrella/<project>/results/ ./results/
Direct SFTP to storage
Transfer directly to project storage (faster for large files):
sftp sftp.tudelft.nl
sftp> cd staff-umbrella/<project>
sftp> put -r mydata/
sftp> get -r results/
Clone git repos on DAIC
git clone git@gitlab.tudelft.nl:mygroup/myrepo.git
Storage
Store data in/tudelft.net/staff-umbrella/<project>/, not your home directory.Next steps
- See Data Transfer for rclone and advanced options
- Read about Storage locations