© Systems Research Group, Department of Computer Science, The University of Hong Kong.

Main ** People ** Research ** Publications ** Facilities ** Links

Cluster Computing Web Links:

IEEE Task Force on Cluster Computing:

• Grid Computing Research at HKU
• Hong Kong Grid Initiative: Building a Joint Universities Grid Testbed in Hong Kong
• The China National Grid
• The HKU Grid Computing Research Portal
• Homepage of the HKU SRG's Gideon Cluster

IEEE Task Force on Cluster Computing:

• IEEE Task Force on Cluster Computing: http://www.dgs.monash.edu.au/~rajkumar/tfcc/

• Cluster Computing White Paper: http://www.dcs.port.ac.uk/~mab/tfcc/WhitePaper/

• TFCC in Taiwan: http://www.cs.nthu.edu.tw/~king/tfcc/

Commercial Cluster Software:

• Sun HPC ClusterTools: http://www.sun.com/hpc/communitysource

• Sun Cluster White paper: http://www.sun.com/software/white-papers/wp-sunclusters/

• Compaq's Tru64 Unix cluster system (formerly Digital Unix clustering): http://www.digital.com/info/LIW0HF/

• Novell's InterNetWare: http://www.novell.com/

• IBM's Tivoli Enteprise Management: http://www.tivoli.com/

• Window2000 Clustering: http://www.microsoft.com/windows2000/library/howitworks/default.asp (The Cluster service technology built into Windows 2000 Advanced Server allows two servers to be connected into a cluster for higher availability and easier manageability of server resources. The two servers do not have to be the same size or have the same configuration.)

• Microsoft Cluster Server: http://www.microsoft.com/ntserver/ntserverenterprise/exec/overview/clustering.asp?RLD=36

• SGI Linux Advanced Cluster Environment 1.0  (ACE): http://www.sgi.com/software/ace/linux.html

• Sun HPC ClusterTools 3.1 (With Sun HPC ClusterTools 3.1 software, users can now use up to 1,024 processors for a single application running across a cluster of Sun hardware.): http://www.sun.com/software/hpc/

• SCO UnixWare NonStop Clusters: http://www.x.co.uk/products/clustering/nscwhtpaper/

• Solaris MC: http://www.sunlabs.com/research/solaris-mc/

• TurboLinux: http://www.turbolinux.com/

• TurboCluster: http://www.turbocluster.com/support/tcs40ug.pdf

• Linux Virtual Server Project: http://www.linuxvirtualserver.org/

Top 500 Clusters:

• TOP500 Cluster: http://www.top500clusters.org/

• Sandia National Lab CPlant: http://www.cs.sandia.gov/cplant/(Linux/Alpha, Myrinet)  

• LANL AVALON: http://cnls.lanl.gov/avalon/ (Linux/Alpha, Fast Ethernet)  

• Parnass2: http://wwwwissrech.iam.uni-bonn.de/research/projects/parnass2/ (Linux, Myrinet, Pentium II)  

• TheHIVE Cluster (64 nodes): http://newton.gsfc.nasa.gov/thehive/  

• HPCLine: http://www.hpcline.com/ (New Updated)  

• http://www.hoise.com/primeur/99/articles/monthly/UH-PR-04-99-1.html  

• Texas Tech Tornado Project: http://hpcl.cs.ttu.edu/t3c/  

• ICE Box: (84+3 machines, Linux)  http://www.chpc.utah.edu/ice/  

• Cornell AC3 Velocity Cluster: http://www.tc.cornell.edu/UserDoc/Cluster/

Academic Cluster Projects:

• HKU JESSICA Project: http://www.srg.csis.hku.hk/jessica.htm  

• Berkeley NOW: http://now.cs.berkeley.edu/

• OpenNCS: http://cluster.lanl.gov/ONCS/index.html

• Parma2 project: http://www.ce.unipr.it/pardis/parma2/index.html

• GAMMA Project: http://www.disi.unige.it/project/gamma/  

• Linux Parallel Computing at the University of Mannheim: http://suparum.rz.uni-mannheim.de/Linux/  

• Comyc: IWR - RUM Co operation Myrinet PentiumPro Cluster: http://suparum.rz.uni-mannheim.de/Comyc/  

• RUM Pentium Farm: trumpf -- http://suparum.rz.uni-mannheim.de/Pentium_Farm/  

• OSCAR (Open Scalable Cluster ARchitecture): using Dolphin's SCI for networking: http://www.tu-chemnitz.de/informatik/RA/projects/oscar/oscar.html

• Snowflake Distributed System (Dartmouth College): http://www.cs.dartmouth.edu/~jonh/

• Hive OS (Stanford University): http://www-flash.stanford.edu/OS/

• GLUnix (NOW project) (UC Berkeley): http://now.cs.berkeley.edu/Glunix/glunix.html

• Mosix (The Hebrew University of Jerusalem): http://www.cs.huji.ac.il/labs/distrib/index.html

• Tornado (University of Toronto): http://www.eecg.toronto.edu/parallel/tornado.html

• DIPC Project: http://wallybox.cei.net/dipc/

Academic Cluster Projects – Beowulf Clusters:

• Stone Project: http://www.esd.ornl.gov/facilities/beowulf/

• Beowulf Tutorial (Caltech): http://www.csis.hku.hk/Research/tutorial/  

• NASA Goddard: http://cesdis.gsfc.nasa.gov/linux/beowulf/beowulf.html

• DAISy: http://rocs-pc.ca.sandia.gov/DAISy/DAISy.html

• Loki: http://loki-www.lanl.gov/

• CACR: http://www.cacr.caltech.edu/beowulf/

• Drexel Beowulf Supercomputer: http://einstein.drexel.edu/beowulf/Beowulf.html

• The Clemson Beowulf Cluster "Grendl": http://ece.clemson.edu/parl/grendel.htm

• The Aenas Project at UC Irvine: http://aeneas.ps.uci.edu/aeneas/

• Topcat at University of Southern Queensland: http://www.sci.usq.edu.au/staff/jacek/topcat/

• Megalon at Sandia Natl. Labs: http://megalon.ca.sandia.gov/

Academic Cluster Projects – Myrinet-based Clusters:

• RWCP Cluster Project: http://www.rwcp.or.jp/lab/pdslab/

• BIP Project (Basic Interface for Parallelism), LHPC France: http://www-bip.univ-lyon1.fr/

• Illinois HPVM: http://www.pgroup.com/clustercookbook/L3.HPVM.html

• Duke University Trapeze: http://www.cs.duke.edu/ari/manic/trapeze/paper.html

• Avalanche project at University of Utah: http://www.cs.utah.edu/projects/avalanche/

Academic Cluster Projects – SMP Clusters:

• Lawrence Livermore National Laboratory: http://www.llnl.gov/liv_comp/clstr/  

• Berkeley CLUMPS: Multi-Protocol Active Messages on a Cluster of SMP's: http://now.cs.berkeley.edu/clumps/sc97/

• SIMPLE Model: http://www.umiacs.umd.edu/research/EXPAR/

• RWCP's  COMPaS - http://pdplab.trc.rwcp.or.jp/pdperf/COMPaS/COMPaS-overview.html  

• The SParROW Cluster: http://www.vuse.vanderbilt.edu/~gravesm/papers/MPI/MPI.html

High Speed Networking:

• Active Messages (Berkeley): http://now.cs.berkeley.edu/AM/active_messages.html  

• Fast Messages and HPVM: UCSD Concurrent Systems Architecture Group (CSAG): http://www-csag.ucsd.edu/  

• U-Net (Matt Welsh, et al, Cornell: http://www2.cs.cornell.edu/U-Net/  

• GAMMA: Genoa Active Message Machine: http://www.disi.unige.it/project/gamma/

• PUMA/SUNMOS: http://www.cs.sandia.gov/~rolf/puma/puma.html  

• Fbufs: Operating System Support for High-Speed Communication, CACM, Vol. 39, No. 9, Sept. 1996. By Peter Druschel. (Thesis) http://www.cs.rice.edu/~druschel/  

• HKU Directed Point: http://www.srg.csis.hku.hk/homepage/dp.htm  

• Berkeley CLUMPS: Multi-Protocol Active Messages on a Cluster of SMP's: http://now.cs.berkeley.edu/clumps/sc97/ (Myrinet-based)  

• PM (RWCP Cluster Project) http://www.rwcp.or.jp/lab/pdslab/ (Myrinet, Gigabit Ethernet. also read RWCP's  COMPaS - http://pdplab.trc.rwcp.or.jp/pdperf/COMPaS/COMPaS-overview.html  

• Beowulf Project (US): http://cesdis.gsfc.nasa.gov/beowulf/ (Channel Bounding: multiple network cards supported)

Gigabit Networking:

• Packet Engines GNIC-II "Hamachi" Gigabit Ethernet driver source code: http://cesdis.gsfc.nasa.gov/linux/drivers/hamachi.html

• VI Architecture: http://www.viarch.org/  

• Giganet's cLAN (VIA NICs): http://www.giganet.com/  

• M-VIA (for Linux): http://www.nersc.gov/research/FTG/via/  

• GigaE PM II: http://pdswww.rwcp.or.jp/papers.html

Single System Image:

• Zheiwei Xu, Cho-Li Wang, and Kai Hwang, "Viable Approaches to Realizing Single System Image in Multicomputer Clusters," by (Technical Report: PDF)  

• cJVM: http://www.haifa.il.ibm.com/projects/systech/cjvm.html, cJVM is a Java Virtual Machine (JVM), which provides a Single system image(SSI) of a traditional JVM, while executing in a distributed fashion on the nodes of a cluster.

• JavaParty Project: http://wwwipd.ira.uka.de/JavaParty/

• IBM Jalapeno: http://www.research.ibm.com/jalapeno/

• ObjectSpace Voyager: http://www.objectspace.com/products/prodVoyager.asp

Software DSM:

• HKU JUMP: http://www.srg.csis.hku.hk/homepage/jump.htm

• JiaJia: http://www.ict.ac.cn/chpc/dsm/index.html

• TreadMarks: http://www.cs.rice.edu/~willy/TreadMarks/overview.html

• Distributed Shared Memory Home Pages: http://www.cs.umd.edu/~keleher/dsm.html

• Quarks: http://www.cs.utah.edu/flux/quarks.html

• Millipede: http://www.cs.technion.ac.il/Labs/Millipede/

• Brazos (Rice) http://www-brazos.rice.edu/brazos/

• Illinois Concert Project: http://www-csag.ucsd.edu/projects/concert.html

• DOSMOS: http://www.ens-lyon.fr/~llefevre/DOSMOS/Dosmos.html

• MIDWAY: http://www-cgi.cs.cmu.edu/afs/cs.cmu.edu/project/midway/WWW/HomePage.html

• WSDSM Conference: http://www.cs.umd.edu/~keleher/wsdsm99/

Cluster I/O Systems:

• Parallel I/O main page: http://www.cs.dartmouth.edu/pario/  

• Scalable I/O Initiative: http://www.cacr.caltech.edu/SIO/

• InfiniBand (the joining of NGIO and FIO): http://www.infinibandta.org/

• "System I/O" -- the joint Intel/IBM/HP/Sun/Compaq/Dell/Cisco/... spec for an industry-standard SAN: http://www.sysio.org/

• CMU RAID Papers: http://auchentoshan.pdl.cs.cmu.edu/Publications/

• Argonne National Laboratory, R. Stevens, E. Lusk, W. Gropp, G. Pieper: http://www.mcs.anl.gov/scalable/scalable.html

• California Institute of Technology, P. Messina, J. Pool, T. Pauna: http://www.cacr.caltech.edu/SIO/

• Carnegie-Mellon University, G. Gibson: http://www.cs.cmu.edu/afs/cs/project/pdl/WWW/SIO.html

• Princeton University, K. Li: http://www.cs.princeton.edu/sio/

• Rice University, K. Kennedy, C. Koelbel, K. El-Messidi: http://www.cs.rice.edu/~mpal/SIO/index.html

• Syracuse University, A. Choudhary, R. Bordawekar: http://www.cat.syr.edu/passion.html

• University of Arizona, L. Peterson: http://www.cs.arizona.edu/xkernel/www/

• University of Illinois at Urbana/Champaign, D. Reed, A. Chien, R. Aydt: http://www-pablo.cs.uiuc.edu/Projects/IO/sio.html

• University of Maryland, J. Saltz: http://www.cs.umd.edu/projects/hpsl/io/io.html

• University of Washington, B. Bershad, A. Wolman: http://www.cs.washington.edu/homes/wolman/sio-net.html

Checkpointing:

• CLIP: A Checkpointing Library for Intel Paragon (Kai Li): http://pluto.iecs.fcu.edu.tw/~alex/MPICkpt/CLIP.html

• CoCheck is an environment that provides checkpointing and process migration for parallel programming environments such as PVM and MPI. http://wwwbode.informatik.tu-muenchen.de/~cocheck/

• MpPVM is designed and implemented to support efficient process migration for PVM application programs. (SNOW Project): http://bit.csc.lsu.edu/~scs/SNOW/

Parallel File Systems:

• PPFS (UI): http://www-pablo.cs.uiuc.edu/Project/PPFS/PPFSII/PPFSIIOverview.htm

• Sun NFS: http://www.sun.com/software/white-papers/wp-nfs/

• CMU Andrew File System: paper 1990 (PDF)  

• Berkeley xFS (Serverless File System): http://now.cs.berkeley.edu/Xfs/xfs.html

Cluster Computing – Operating Systems Support:

• Amoeba: http://www.cs.vu.nl/pub/amoeba/  

• Chorus: http://www.chorus.com/.  

• Choices: http://choices.cs.uiuc.edu/choices/index.html.  

• Spring: http://www.sun.com/tech/projects/ spring/papers.html.  

• Solaris MC: http://www.sunlabs.com/research/solaris-mc/

• MOSIX: http://www.mosix.cs.huji.ac.il/

• GLUnix: http://now.cs.berkeley.edu/Glunix/glunix.html

• Peace - Distributed Operating System (Germany): ftp://ftp.gmd.de/gmd/peace/

• Plan 9 - Distributed OS from the AT&T research lab. (USA): ftp://ftp.cse.ucsc.edu/pub/plan-9/

• RelaX - Reliable Distributed OS  (Germany): ftp://ftp.gmd.de/gmd/RelaX/

• SLIC (Berkeley) Extensible OS: http://now.cs.berkeley.edu/Slic/;

• Also see http://www.eecs.harvard.edu/~vino/vino/papers/acm-96.ps

• Microsoft: Project Millennium -- http://research.microsoft.com/sn/Millennium/

• Lucent Technologies: Inferno -- http://www.lucent-inferno.com/Pages/Developers/

• IBM: T Spaces (based on the Linda tuple-spaces): http://www.almaden.ibm.com/cs/TSpaces/

• Oak Ridge National Lab.: Parallel Virtual Machine project. http://www.epm.ornl.gov/pvm/

• Sun: JINI (agent-based distributed system), Internet Jan-Feb. 1999, p.91: http://java.sun.com/products/jini/whitepapers/architectureoverview.pdf

Job Scheduling Systems:

• Condor - Distributed Batch System (U. Wisconsin CS, USA): ftp://ftp.cs.wisc.edu/condor/

• DNQS - Distributed NQS (SCRI, Florida State U., USA): ftp://ftp.scri.fsu.edu/pub/DNQS/

• DQS - Distributed Queuing System (SCRI, Florida State U., USA): ftp://ftp.scri.fsu.edu/pub/DQS/

• QBATCH - Queued Batch processing system (USA): ftp://ftp.uu.net/usenet/comp.sources.misc/volume25/QBATCH/

• SHIFT  (CERN, Swiss): ftp://shift.cern.ch/pub/

• LSF: http://www.platform.com/

• A Comparison of Queuing, Cluster and Distributed Computing Systems (technical report, USA): ftp://techreports.larc.nasa.gov/pub/techreports/larc/94/tm109025.ps.Z

Cluster Management Tools:

• NetSaint: Linux Network Monitoring Tool, http://www.netsaint.org/

• Scalable Unix Commands for Parallel Computers (Ptools Project): http://www-unix.mcs.anl.gov/sut/

• The Parallel Tools Consortium: http://www.ptools.org/

• Portable Timing Routines project: http://www.cs.orst.edu/~pancake/ptools/ptr/

• Message Queue Manager (MQM): provides a graphical user interface (GUI) for examining a parallel application's message passing state. See http://www.cs.orst.edu/~pancake/ptools/mqm/flyer.html

• Cluster Computing: A Survey and Tutorial (by Victor Hazlewood): http://www.sdsc.edu/~victor/Projects/NQE/SysAdmin/SysAdmin_Batch.html

• NHSE Review (1996) Cluster Management Software http://nhse.cs.rice.edu/NHSEreview/CMS/index.html

• Cluster Management Software Packages Review: http://www.npac.syr.edu/techreports/hypertext/sccs-748/index.html

Commercial and Public Domain Cluster Management Tools:

• AutoSys: http://www.platinum.com/products/sysman/autosys/prodinfo.htm

• Batch Queueing Systems: http://www.cmpharm.ucsf.edu/~srp/batch/systems.html

• Codine (Auf Deutsch): http://www.cmpharm.ucsf.edu/~srp/batch/systems.html

• Condor: http://www.cs.wisc.edu/condor/

• Control-M: http://www.ddddf.com/xncypp/software/pcs.html

• DJM (Distributed Job Manager): http://s1.arc.umn.edu/html/cm-software/djm.html

• DNS Load Balancing: http://www.cisco.com/warp/public/787/38.html

• DQS (Distributed Queueing System): http://www.scri.fsu.edu/~pasko/dqs.html

• The EASY Scheduler: http://info.mcs.anl.gov/Projects/sp/scheduler/scheduler.html

• The EASY-LL Scheduler: http://www.tc.cornell.edu/UserDoc/SP/LL12/Easy/index.html

• Enterprise wide job scheduling system: http://www.i-s-e.com/ent_sch.htm

• Job Scheduling Option (NT): http://www.argent-nt.com/product/product.html

• Job Scheduling Server (NT): http://www.cris.com/~Microwrk/

• Job Scheduling and Workload Management Products for NT: http://www.cybermation.com/

• Load Blancer (Maestro): http://www.unison.com/Unison.html

• IBM LoadLeveler: http://www.rs6000.ibm.com/software/sp_products/loadlev.html

• IBM OS/390 WorkLoad Manager: http://www.s390.ibm.com/products/mvs/wlm/

• LSF (Load Sharing Facility): http://www.platform.com/

• NavNet: http://inetbsystems.us.com/CUTTERNET/NavNet.html

• NetShare: http://www.aggregate.com/

• NightShift Products (NT): http://www.nshift.com/

• NQE (Network Queueing Environment): ftp://draco.nova.edu/pub/sunflash/www/sunflash/1994/69.sep/69.05.CraySoft.txt

• NQE (Cray): http://www.cray.com/craysoft/

• NQS (Network Queueing System): ftp://shift.cern.ch/pub/NQS/

• PBS (Portable Batch System): http://www.nas.nasa.gov/NAS/PBS/

• PCS (Production Control System): http://www.llnl.gov/liv_comp/pcs.html

• PRM (The Prospero Resource Manager): http://nii-server.isi.edu/gost-group/products/prm/

• SCH: Schedule: http://http://www.sch.com/schsc001.html

• SuperScheduler: http://www.supersolution.com/home_page/ssched.html

• Task Broker: http://www.triteal.com/TaskBroker.html

High Availability:

• SCO releases UnixWare 7 Nonstop Clusters: http://www.data.com/story/TWB19990817S0002/

Performance Evaluation and Benchmarking:

• Cluster Benchmark: http://www.di.unito.it/~mino/cluster/benchmarks/

• Top500 Report: Table of the sites that have the 500 fastest supercomputers worldwide: http://www.netlib.org/benchmark/top500.html

• Linpack Benchmark: How to get the report Click here for the postscript version of the report: http://www.netlib.org/benchmark/to-get-lp-benchmark/

• PDS: The Performance Database Server: http://performance.netlib.org/performance/html/PDStop.html

• BenchWeb: BenchWeb is a starting point for finding information about computer system performance benchmarks, benchmark results, and benchmark code: http://www.netlib.org/benchweb/

• Linpack Benchmark in Java: http://www.netlib.org/benchmark/linpackjava/

• Parkbench: parallel benchmark working group, click here to mail the authors: http://www.netlib.org/parkbench/

• Journal of Performance Evaluation and Modeling for Computer Systems (PEMCS): http://www.netlib.org/utk/papers/PEMCS/

• Gunter's List: A list of the world’s most powerful computers according to Gunter Ahrendt, based on the NAS parallel benchmarks. Also includes machine specific information and pictures: http://www.cnct.com/home/gunter/

• Al Aburto's benchmarks: ftp://marlin.nosc.mil:/pub/aburto/

• TOP500 List of Supercomputers: http://www.top500.org/

• NAS Parallel Benchmark: http://www.nas.nasa.gov/NAS/NPB/

• Performance Data Base server; A number of benchmarks from netlib: http://performance.netlib.org/performance/html/PDStop.html

• SPEC (Standard Performance Evaluation Corporation): http://www.specbench.org/

• NETLIB (ftp://netlib.att.com/netlib/) (including LINPACK: ftp://netlib.att.com/netlib/benchmark/performance.ps.Z): includes a lot of benchmarking material (ftp://netlib.att.com/netlib/benchmark/) including papers, code etc. This paper (ftp://netlib.att.com/netlib/benchmark/mp-computers.ps) by van der Steen is worth a look at. The Dongara Linpack document is updated here: ftp://netlib.att.com/netlib/benchmark/perf-upd.Z

• The STREAM Home Page: The STREAM benchmark program measures the sustainable memory bandwidth of a computer doing simple long vector operations. http://perelandra.cms.udel.edu/hpc/stream/

• BYTE Benchmarks: http://www.byte.com/bmark/bmark.htm

• nbench (Linux/Unix): Linux/Unix version of release 2 of BYTE Magazine's BYTEmark benchmark program (previously known as BYTE's Native Mode Benchmarks): http://atlas.math.vanderbilt.edu/~mayer/linux/bmark.html

• NAS Parallel Benchmark (NPB): http://science.nas.nasa.gov/Software/NPB/

• Nbench: http://www.csis.hku.hk/~clwang/nbench.html

Performance Tools:

• Pablo (University of Illinois): http://www-pablo.cs.uiuc.edu/

• Paradyn (University of Wisconsin): http://www.cs.wisc.edu/~paradyn/

• Tau (University of Oregon): http://www.cs.uoregon.edu/research/paracomp/proj/tau/

• Falcon (Georgia Tech): http://www.cc.gatech.edu/systems/projects/FALCON/falcon_home.html

• AIMS (NASA Ames Research Center): http://science.nas.nasa.gov/Groups/Tools/Projects/AIMS/

Other Useful Links:

• Prof. Kai Hwang Book Weblist : http://www.csis.hku.hk/~kaihwang/book98.html

• Resonate: http://www.resonate.com/

• Penguin Computing: http://www.penguincomputing.com/

• LinuxWorld Conference and Expo: http://linuxworld.com/linuxworld/linuxworldtoday/home.html

• Extreme Linux Workshop: http://www.extremelinux.org/activities/usenix99/docs/

• Cluster Papers: http://www.coe.uncc.edu/~abw/parallel/links.html

Technical News:

• HPCwire: http://www.tgc.com/hpcwire.html

• CNET: http://www.cnet.com/

• internet.com: http://www.internet.com/ (WWW and Internet technology)  

• ZDNet: http://www.zdnet.com/

• TechWeb: http://www.techweb.com/

• CMPNet: http://www.cmpnet.com/

• INTERNET WEEK: http://www.internetwk.com/

• tel.com: http://www.teledotcom.com/

• Windows Magazine: http://www.winmag.com/

• Data Communications: http://www.data.com/

• Planet IT: http://www.planetit.com/

• Byte: http://www.byte.com/

Main ** People ** Research ** Publications ** Facilities ** Links