xgrid and R: Parallel Distributed Processing Using Heterogeneous Groups of Apple Computers

The Apple Xgrid system provides access to groups (or grids) of computers that can be used to facilitate parallel processing. We describe the xgrid package which facilitates access to this system to undertake independent simulations or other long-running jobs that can be divided into replicate runs within R. Detailed examples are provided to demonstrate the interface, along with results from a simulation study of the performance gains using a variety of grids. Use of the grid for “embarassingly parallel” independent jobs has the potential for major speedups in time to completion. Appendices provide guidance on setting up the workflow, utilizing add-on packages, and constructing grids using existing machines.

Sarah C. Anoke , Yuting Zhao , Rafael Jaeger , Nicholas J. Horton
2012-6-01

CRAN packages used

GridR, Rmpi, snow, multicore, xgrid, runjags, poLCA

CRAN Task Views implied by cited packages

HighPerformanceComputing, Bayesian, Cluster, Multivariate, Psychometrics

Reuse

Text and figures are licensed under Creative Commons Attribution CC BY 4.0. The figures that have been reused from other sources don't fall under this license and can be recognized by a note in their caption: "Figure from ...".

Citation

For attribution, please cite this work as

Anoke, et al., "xgrid and R: Parallel Distributed Processing Using Heterogeneous Groups of Apple Computers", The R Journal, 2012

BibTeX citation

@article{RJ-2012-006,
  author = {Anoke, Sarah C. and Zhao, Yuting and Jaeger, Rafael and Horton, Nicholas J.},
  title = {xgrid and R: Parallel Distributed Processing Using Heterogeneous Groups of Apple Computers},
  journal = {The R Journal},
  year = {2012},
  note = {https://doi.org/10.32614/RJ-2012-006},
  doi = {10.32614/RJ-2012-006},
  volume = {4},
  issue = {1},
  issn = {2073-4859},
  pages = {45-55}
}