User Tools
copying_data_to_the_nodes
Differences
This shows you the differences between two versions of the page.
| Both sides previous revision Previous revision Next revision | Previous revision | ||
|
copying_data_to_the_nodes [2014/04/24 13:34] root |
copying_data_to_the_nodes [2014/11/04 17:44] (current) root |
||
|---|---|---|---|
| Line 9: | Line 9: | ||
| If what your program does is read a file strictly sequentially just once, this copy is unlikely to help. | If what your program does is read a file strictly sequentially just once, this copy is unlikely to help. | ||
| - | There is a couple of options | + | There is a couple of options |
| 1) Do it directly in your script.. | 1) Do it directly in your script.. | ||
| Line 20: | Line 20: | ||
| (Really you would use mktemp to get a unique name to avoid clashes.) | (Really you would use mktemp to get a unique name to avoid clashes.) | ||
| + | |||
| + | Should be careful if you have multiple copies of your script running on a node: you could be copying the data multiple times. | ||
| 2) Copy to all nodes allocated to your task using sbcast. | 2) Copy to all nodes allocated to your task using sbcast. | ||
copying_data_to_the_nodes.1398360892.txt.gz ยท Last modified: 2014/04/24 13:34 by root
Page Tools
Except where otherwise noted, content on this wiki is licensed under the following license: Public Domain
