qcg-pilotjobs
Differences
This shows you the differences between two versions of the page.
| Both sides previous revision Previous revision | |||
|
qcg-pilotjobs [2019/01/24 13:01] bbosak@man.poznan.pl [Static QCG PilotJob] |
qcg-pilotjobs [2019/01/31 11:47] (current) bbosak@man.poznan.pl |
||
|---|---|---|---|
| Line 6: | Line 6: | ||
| ===== What is QCG PilotJob? ===== | ===== What is QCG PilotJob? ===== | ||
| - | QCG PilotJob is a computing job playing a role of a container over a number of subordinate computing jobs. It allows to execute many subordinate jobs in a single scheduling system allocation. Direct submission of a large group of jobs to a scheduling system can result in long aggregated time to finish as each single job is scheduled independently and waits in a queue. On the other hand the submission of a group of jobs can be restricted or even forbidden by administrative policies defined on clusters. One can argue that there are available job array mechanisms in many systems, however the traditional job array mechanism allows to run only bunch of jobs having the same resource requirements while jobs being parts of a multiscale simulation by nature vary in requirements and therefore need more flexible solutions. On a technical level QCG PilotJob is exposed as a lightweight service - QCG PilotJob Manager. | + | QCG PilotJob is a computing job playing a role of a container over a number of subordinate computing jobs. It allows to execute many subordinate jobs in a single scheduling system allocation. Direct submission of a number separate jobs to a scheduling system can result in long aggregated time to finish as each single job is scheduled independently and waits in a queue. Moreover the submission of a numerous of jobs can be restricted or even forbidden by administrative policies defined on clusters. One can argue that there are available job array mechanisms in many systems, however the traditional job array mechanism allows to run only bunch of jobs having the same resource requirements while jobs being parts of a multiscale simulation by nature vary in requirements and therefore need more flexible solutions. On a technical level QCG PilotJob is exposed as a lightweight service - QCG PilotJob Manager. |
| ===== How to use QCG PilotJob ? ===== | ===== How to use QCG PilotJob ? ===== | ||
qcg-pilotjobs.txt ยท Last modified: 2019/01/31 11:47 by bbosak@man.poznan.pl
Page Tools
Except where otherwise noted, content on this wiki is licensed under the following license: CC Attribution-Share Alike 4.0 International
