tpar: simple, parallel job scheduling
tpar
is a simple job scheduling and dispatch service for distributing and
monitoring tasks across machines. It was written to serve as a simple and
easy-to-administer substitute for systems like Grid Engine.
Configuring a tpar
instance is simply a matter of running tpar server
on
a designated server machine,
$ # We'll need to know the hostname of the server $ hostname my-server $ # Start a server also running 8 local workers $ tpar server -Hmy-server -N8
Submitting a job is then similarly easy,
$ tpar enqueue -Hhostname
-- long-process arg1 arg2
One can then enqueue jobs easily
$ tpar enqueue -Hmy-server -- bash -c "primes 10000000000 | head -n1" $ tpar status -v 0 unnamed-job finished priority: 0 queued: 1 seconds ago command: bash arguments: -c primes 10000000000 | head -n1 logging: stdout: none stderr: none status: finished with 0 (at 1 seconds ago) started at 1 seconds ago ran on nid://localhost:5757:0
One can add more workers to help churn through the work queue using the
tpar worker
command,
$ # Add 16 more workers running on another machine $ ssh my-workers -- tpar worker -Hmy-server -N16
Finally, the output of running jobs can be monitored using the tpar watch
command,
$ tpar watch id=0
Downloads
- tpar-0.1.0.0.tar.gz [browse] (Cabal source package)
- Package description (as included in the package)
Maintainer's Corner
For package maintainers and hackage trustees
Candidates
- No Candidates
Versions [RSS] | 0.1.0.0 |
---|---|
Dependencies | aeson (>=0.11 && <0.12), ansi-wl-pprint (>=0.6 && <0.7), async (>=2.0 && <2.2), base (>=4.5 && <4.10), binary (>=0.7 && <0.9), bytestring (>=0.10 && <0.11), containers (>=0.5 && <0.6), distributed-process (>=0.6 && <0.7), errors (>=2.0 && <2.2), exceptions (>=0.8 && <0.9), friendly-time (>=0.4 && <0.5), ghc-prim, heaps (>=0.3 && <0.4), network (>=2.4 && <2.7), network-transport-tcp (>=0.4), optparse-applicative (>=0.10 && <0.13), parsers (>=0.12 && <0.13), pipes (>=4.0 && <4.3), pipes-bytestring (>=2.0 && <2.2), pipes-concurrency, pipes-safe (>=2.2 && <2.3), process (>=1.1 && <1.5), stm (>=2.4 && <2.5), time (>=1.6 && <1.7), transformers (>=0.3 && <0.6), trifecta (>=1.5 && <1.7) [details] |
License | BSD-3-Clause |
Copyright | (c) 2014-2016 Ben Gamari <bgamari@gmail.com> |
Author | Ben Gamari |
Maintainer | bgamari@gmail.com |
Category | System |
Home page | http://github.com/bgamari/tpar/ |
Bug tracker | http://github.com/bgamari/tpar/issues |
Source repo | head: git clone git://github.com/bgamari/tpar |
Uploaded | by BenGamari at 2016-08-01T09:59:04Z |
Distributions | |
Reverse Dependencies | 1 direct, 0 indirect [details] |
Executables | tpar |
Downloads | 953 total (0 in the last 30 days) |
Rating | (no votes yet) [estimated by Bayesian average] |
Your Rating | |
Status | Docs not available [build log] Last success reported on 2016-11-21 [all 3 reports] |