Trace number 3381260

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
claspmt 2.0-R4095-patched (fixed)? (TO) 40000.3 5010.65

General information on the benchmark

NameSAT05/crafted/sabharwal05/counting/php/unsat/
harder/php-020-019.shuffled-as.sat05-1190.cnf
MD5SUM81bbeaaf9f0ca3bfc36d743097777052
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark1.58376
Satisfiable
(Un)Satisfiability was proved
Number of variables380
Number of clauses3630
Sum of the clauses size7600
Maximum clause length19
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 23610
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 520

Solver Data 

0.00/0.00	c clasp version 2.0.0-RC2
0.00/0.00	c Reading from ...510891/instance-3381260-1305510891.cnf
0.00/0.01	c Solving...
40000.24/5010.62	
40000.24/5010.62	*** INTERRUPTED! ***
40000.24/5010.62	*** Shutting down threads...
40000.24/5010.64	s UNKNOWN
40000.24/5010.64	
40000.24/5010.64	c INTERRUPTED   : 1
40000.24/5010.64	c Models        : 0+    
40000.24/5010.64	c Time          : 5010.617s (Solving: 5010.61s 1st Model: 0.00s Unsat: 0.00s)
40000.24/5010.64	c CPU Time      : 40000.280s

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3381260-1305510891/watcher-3381260-1305510891 -o /tmp/evaluation-result-3381260-1305510891/solver-3381260-1305510891 -C 40000 -W 5100 -M 31000 HOME/claspmt -t8 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3381260-1305510891.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.49 7.92 7.96 1/392 27120
/proc/meminfo: memFree=12248464/32951124 swapFree=56316160/67111528
[pid=27120] ppid=27118 vsize=119272 CPUtime=0 cores=0-7
/proc/27120/stat : 27120 (claspmt) R 27118 27120 26691 0 -1 4202496 874 0 0 0 0 0 0 0 25 0 8 0 662691415 122134528 791 33554432000 4194304 4964800 140734097753984 18446744073709551615 4467677 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/27120/statm: 29818 799 444 189 0 24167 0
[pid=27120/tid=27121] ppid=27118 vsize=119272 CPUtime=0 cores=0-7
/proc/27120/task/27121/stat : 27121 (claspmt) S 27118 27120 26691 0 -1 4202560 16 0 0 0 0 0 0 0 25 0 8 0 662691416 122134528 799 33554432000 4194304 4964800 140734097753984 18446744073709551615 212447832985 0 0 4096 18946 18446604453935135616 0 0 -1 2 0 0 0
[pid=27120/tid=27122] ppid=27118 vsize=119272 CPUtime=0 cores=0-7
/proc/27120/task/27122/stat : 27122 (claspmt) R 27118 27120 26691 0 -1 4202560 14 0 0 0 0 0 0 0 25 0 8 0 662691416 122134528 800 33554432000 4194304 4964800 140734097753984 18446744073709551615 212447832985 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=27120/tid=27123] ppid=27118 vsize=119272 CPUtime=0 cores=0-7
/proc/27120/task/27123/stat : 27123 (claspmt) R 27118 27120 26691 0 -1 4202560 43 0 0 0 0 0 0 0 25 0 8 0 662691416 122134528 803 33554432000 4194304 4964800 140734097753984 18446744073709551615 4689992 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=27120/tid=27124] ppid=27118 vsize=119272 CPUtime=0 cores=0-7
/proc/27120/task/27124/stat : 27124 (claspmt) S 27118 27120 26691 0 -1 4202560 12 0 0 0 0 0 0 0 25 0 8 0 662691416 122134528 805 33554432000 4194304 4964800 140734097753984 18446744073709551615 212447832985 0 0 4096 18946 18446604453935135616 0 0 -1 1 0 0 0
[pid=27120/tid=27125] ppid=27118 vsize=119272 CPUtime=0 cores=0-7
/proc/27120/task/27125/stat : 27125 (claspmt) S 27118 27120 26691 0 -1 4202560 21 0 0 0 0 0 0 0 25 0 8 0 662691416 122134528 806 33554432000 4194304 4964800 140734097753984 18446744073709551615 212447832985 0 0 4096 18946 18446604453935135616 0 0 -1 1 0 0 0
[pid=27120/tid=27126] ppid=27118 vsize=119272 CPUtime=0 cores=0-7
/proc/27120/task/27126/stat : 27126 (claspmt) S 27118 27120 26691 0 -1 4202560 20 0 0 0 0 0 0 0 25 0 8 0 662691416 122134528 806 33554432000 4194304 4964800 140734097753984 18446744073709551615 212447832985 0 0 4096 18946 18446604453935135616 0 0 -1 1 0 0 0
[pid=27120/tid=27127] ppid=27118 vsize=119272 CPUtime=0 cores=0-7
/proc/27120/task/27127/stat : 27127 (claspmt) S 27118 27120 26691 0 -1 4202560 27 0 0 0 0 0 0 0 25 0 8 0 662691416 122134528 807 33554432000 4194304 4964800 140734097753984 18446744073709551615 212447832985 0 0 4096 18946 18446604453935135616 0 0 -1 1 0 0 0

[startup+0.0796729 s]
/proc/loadavg: 7.49 7.92 7.96 1/392 27120
/proc/meminfo: memFree=12248464/32951124 swapFree=56316160/67111528
[pid=27120] ppid=27118 vsize=382604 CPUtime=1.02 cores=0-7
/proc/27120/stat : 27120 (claspmt) R 27118 27120 26691 0 -1 4202496 2914 0 0 0 101 1 0 0 18 0 8 0 662691415 391786496 2825 33554432000 4194304 4964800 140734097753984 18446744073709551615 4320924 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/27120/statm: 95790 3634 464 189 0 90139 0
[pid=27120/tid=27121] ppid=27118 vsize=383160 CPUtime=0.22 cores=0-7
/proc/27120/task/27121/stat : 27121 (claspmt) R 27118 27120 26691 0 -1 4202560 274 0 0 0 22 0 0 0 18 0 8 0 662691416 392355840 3634 33554432000 4194304 4964800 140734097753984 18446744073709551615 4364587 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=27120/tid=27122] ppid=27118 vsize=383840 CPUtime=0.36 cores=0-7
/proc/27120/task/27122/stat : 27122 (claspmt) S 27118 27120 26691 0 -1 4202560 651 0 0 0 36 0 0 0 18 0 8 0 662691416 393052160 4283 33554432000 4194304 4964800 140734097753984 18446744073709551615 212436122094 0 0 4096 18946 18446604453935135616 0 0 -1 7 0 0 0
[pid=27120/tid=27123] ppid=27118 vsize=384764 CPUtime=0.5 cores=0-7
/proc/27120/task/27123/stat : 27123 (claspmt) R 27118 27120 26691 0 -1 4202560 641 0 0 0 50 0 0 0 18 0 8 0 662691416 393998336 5535 33554432000 4194304 4964800 140734097753984 18446744073709551615 4320955 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=27120/tid=27124] ppid=27118 vsize=384948 CPUtime=0.52 cores=0-7
/proc/27120/task/27124/stat : 27124 (claspmt) R 27118 27120 26691 0 -1 4202560 598 0 0 0 52 0 0 0 18 0 8 0 662691416 394186752 5661 33554432000 4194304 4964800 140734097753984 18446744073709551615 212436122143 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=27120/tid=27125] ppid=27118 vsize=384948 CPUtime=0.52 cores=0-7
/proc/27120/task/27125/stat : 27125 (claspmt) R 27118 27120 26691 0 -1 4202560 534 0 0 0 52 0 0 0 18 0 8 0 662691416 394186752 5661 33554432000 4194304 4964800 140734097753984 18446744073709551615 212436122143 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=27120/tid=27126] ppid=27118 vsize=384948 CPUtime=0.52 cores=0-7
/proc/27120/task/27126/stat : 27126 (claspmt) R 27118 27120 26691 0 -1 4202560 651 0 0 0 52 0 0 0 18 0 8 0 662691416 394186752 5661 33554432000 4194304 4964800 140734097753984 18446744073709551615 4658589 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=27120/tid=27127] ppid=27118 vsize=384948 CPUtime=0.48 cores=0-7
/proc/27120/task/27127/stat : 27127 (claspmt) R 27118 27120 26691 0 -1 4202560 659 0 0 0 48 0 0 0 25 0 8 0 662691416 394186752 5661 33554432000 4194304 4964800 140734097753984 18446744073709551615 212436122143 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 1.02
Current children cumulated vsize (KiB) 382604

[startup+0.865807 s]
/proc/loadavg: 7.49 7.92 7.96 1/392 27120
/proc/meminfo: memFree=12248464/32951124 swapFree=56316160/67111528
[pid=27120] ppid=27118 vsize=386536 CPUtime=7.32 cores=0-7
/proc/27120/stat : 27120 (claspmt) R 27118 27120 26691 0 -1 4202496 7384 0 0 0 728 4 0 0 19 0 8 0 662691415 395812864 7295 33554432000 4194304 4964800 140734097753984 18446744073709551615 4684125 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/27120/statm: 96634 7295 464 189 0 90983 0
[pid=27120/tid=27121] ppid=27118 vsize=386536 CPUtime=0.91 cores=0-7
/proc/27120/task/27121/stat : 27121 (claspmt) R 27118 27120 26691 0 -1 4202560 643 0 0 0 91 0 0 0 19 0 8 0 662691416 395812864 7295 33554432000 4194304 4964800 140734097753984 18446744073709551615 4670499 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=27120/tid=27122] ppid=27118 vsize=386536 CPUtime=0.91 cores=0-7
/proc/27120/task/27122/stat : 27122 (claspmt) R 27118 27120 26691 0 -1 4202560 1313 0 0 0 91 0 0 0 19 0 8 0 662691416 395812864 7295 33554432000 4194304 4964800 140734097753984 18446744073709551615 212435675892 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=27120/tid=27123] ppid=27118 vsize=386536 CPUtime=0.91 cores=0-7
/proc/27120/task/27123/stat : 27123 (claspmt) R 27118 27120 26691 0 -1 4202560 842 0 0 0 91 0 0 0 19 0 8 0 662691416 395812864 7295 33554432000 4194304 4964800 140734097753984 18446744073709551615 4668984 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=27120/tid=27124] ppid=27118 vsize=386536 CPUtime=0.91 cores=0-7
/proc/27120/task/27124/stat : 27124 (claspmt) R 27118 27120 26691 0 -1 4202560 754 0 0 0 91 0 0 0 18 0 8 0 662691416 395812864 7295 33554432000 4194304 4964800 140734097753984 18446744073709551615 4338784 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=27120/tid=27125] ppid=27118 vsize=386536 CPUtime=0.91 cores=0-7
/proc/27120/task/27125/stat : 27125 (claspmt) R 27118 27120 26691 0 -1 4202560 713 0 0 0 91 0 0 0 19 0 8 0 662691416 395812864 7295 33554432000 4194304 4964800 140734097753984 18446744073709551615 4653172 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=27120/tid=27126] ppid=27118 vsize=386536 CPUtime=0.91 cores=0-7
/proc/27120/task/27126/stat : 27126 (claspmt) R 27118 27120 26691 0 -1 4202560 881 0 0 0 91 0 0 0 19 0 8 0 662691416 395812864 7295 33554432000 4194304 4964800 140734097753984 18446744073709551615 212436122143 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=27120/tid=27127] ppid=27118 vsize=386536 CPUtime=0.86 cores=0-7
/proc/27120/task/27127/stat : 27127 (claspmt) S 27118 27120 26691 0 -1 4202560 827 0 0 0 86 0 0 0 25 0 8 0 662691416 395812864 7295 33554432000 4194304 4964800 140734097753984 18446744073709551615 212436122094 0 0 4096 18946 18446604453935135616 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 7.32
Current children cumulated vsize (KiB) 386536

[startup+0.999826 s]
/proc/loadavg: 7.49 7.92 7.96 1/392 27120
/proc/meminfo: memFree=12248464/32951124 swapFree=56316160/67111528
[pid=27120] ppid=27118 vsize=386536 CPUtime=7.81 cores=0-7
/proc/27120/stat : 27120 (claspmt) R 27118 27120 26691 0 -1 4202496 7492 0 0 0 777 4 0 0 19 0 8 0 662691415 395812864 7403 33554432000 4194304 4964800 140734097753984 18446744073709551615 212436122143 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/27120/statm: 96634 7403 464 189 0 90983 0
[pid=27120/tid=27121] ppid=27118 vsize=386536 CPUtime=0.97 cores=0-7
/proc/27120/task/27121/stat : 27121 (claspmt) R 27118 27120 26691 0 -1 4202560 654 0 0 0 97 0 0 0 19 0 8 0 662691416 395812864 7403 33554432000 4194304 4964800 140734097753984 18446744073709551615 212436122143 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=27120/tid=27122] ppid=27118 vsize=386536 CPUtime=0.97 cores=0-7
/proc/27120/task/27122/stat : 27122 (claspmt) S 27118 27120 26691 0 -1 4202560 1341 0 0 0 97 0 0 0 19 0 8 0 662691416 395812864 7403 33554432000 4194304 4964800 140734097753984 18446744073709551615 212436122094 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=27120/tid=27123] ppid=27118 vsize=386536 CPUtime=0.97 cores=0-7
/proc/27120/task/27123/stat : 27123 (claspmt) R 27118 27120 26691 0 -1 4202560 842 0 0 0 97 0 0 0 19 0 8 0 662691416 395812864 7403 33554432000 4194304 4964800 140734097753984 18446744073709551615 212436122143 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=27120/tid=27124] ppid=27118 vsize=386536 CPUtime=0.97 cores=0-7
/proc/27120/task/27124/stat : 27124 (claspmt) R 27118 27120 26691 0 -1 4202560 764 0 0 0 97 0 0 0 18 0 8 0 662691416 395812864 7403 33554432000 4194304 4964800 140734097753984 18446744073709551615 212436122143 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=27120/tid=27125] ppid=27118 vsize=386536 CPUtime=0.97 cores=0-7
/proc/27120/task/27125/stat : 27125 (claspmt) R 27118 27120 26691 0 -1 4202560 735 0 0 0 97 0 0 0 19 0 8 0 662691416 395812864 7403 33554432000 4194304 4964800 140734097753984 18446744073709551615 4320970 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=27120/tid=27126] ppid=27118 vsize=386536 CPUtime=0.97 cores=0-7
/proc/27120/task/27126/stat : 27126 (claspmt) R 27118 27120 26691 0 -1 4202560 911 0 0 0 97 0 0 0 19 0 8 0 662691416 395812864 7403 33554432000 4194304 4964800 140734097753984 18446744073709551615 4321029 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=27120/tid=27127] ppid=27118 vsize=386536 CPUtime=0.97 cores=0-7
/proc/27120/task/27127/stat : 27127 (claspmt) R 27118 27120 26691 0 -1 4202560 834 0 0 0 97 0 0 0 25 0 8 0 662691416 395812864 7403 33554432000 4194304 4964800 140734097753984 18446744073709551615 4320981 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 7.81
Current children cumulated vsize (KiB) 386536

[startup+1.13988 s]
/proc/loadavg: 7.49 7.92 7.96 1/392 27120
/proc/meminfo: memFree=12248464/32951124 swapFree=56316160/67111528
[pid=27120] ppid=27118 vsize=386536 CPUtime=8.92 cores=0-7
/proc/27120/stat : 27120 (claspmt) R 27118 27120 26691 0 -1 4202496 7573 0 0 0 888 4 0 0 19 0 8 0 662691415 395812864 7484 33554432000 4194304 4964800 140734097753984 18446744073709551615 4653477 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/27120/statm: 96634 7484 464 189 0 90983 0
[pid=27120/tid=27121] ppid=27118 vsize=386536 CPUtime=1.11 cores=0-7
/proc/27120/task/27121/stat : 27121 (claspmt) R 27118 27120 26691 0 -1 4202560 661 0 0 0 111 0 0 0 19 0 8 0 662691416 395812864 7484 33554432000 4194304 4964800 140734097753984 18446744073709551615 4320961 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=27120/tid=27122] ppid=27118 vsize=386536 CPUtime=1.11 cores=0-7
/proc/27120/task/27122/stat : 27122 (claspmt) R 27118 27120 26691 0 -1 4202560 1351 0 0 0 111 0 0 0 19 0 8 0 662691416 395812864 7484 33554432000 4194304 4964800 140734097753984 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=27120/tid=27123] ppid=27118 vsize=386536 CPUtime=1.11 cores=0-7
/proc/27120/task/27123/stat : 27123 (claspmt) R 27118 27120 26691 0 -1 4202560 872 0 0 0 111 0 0 0 19 0 8 0 662691416 395812864 7484 33554432000 4194304 4964800 140734097753984 18446744073709551615 4653547 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=27120/tid=27124] ppid=27118 vsize=386536 CPUtime=1.11 cores=0-7
/proc/27120/task/27124/stat : 27124 (claspmt) R 27118 27120 26691 0 -1 4202560 785 0 0 0 111 0 0 0 18 0 8 0 662691416 395812864 7484 33554432000 4194304 4964800 140734097753984 18446744073709551615 4338784 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=27120/tid=27125] ppid=27118 vsize=386536 CPUtime=1.11 cores=0-7
/proc/27120/task/27125/stat : 27125 (claspmt) R 27118 27120 26691 0 -1 4202560 735 0 0 0 111 0 0 0 19 0 8 0 662691416 395812864 7484 33554432000 4194304 4964800 140734097753984 18446744073709551615 4320955 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=27120/tid=27126] ppid=27118 vsize=386536 CPUtime=1.11 cores=0-7
/proc/27120/task/27126/stat : 27126 (claspmt) R 27118 27120 26691 0 -1 4202560 911 0 0 0 111 0 0 0 19 0 8 0 662691416 395812864 7484 33554432000 4194304 4964800 140734097753984 18446744073709551615 4332351 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=27120/tid=27127] ppid=27118 vsize=386536 CPUtime=1.06 cores=0-7
/proc/27120/task/27127/stat : 27127 (claspmt) R 27118 27120 26691 0 -1 4202560 835 0 0 0 106 0 0 0 25 0 8 0 662691416 395812864 7484 33554432000 4194304 4964800 140734097753984 18446744073709551615 4365711 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 8.92
Current children cumulated vsize (KiB) 386536

[startup+1.50845 s]
/proc/loadavg: 7.49 7.92 7.96 1/392 27120
/proc/meminfo: memFree=12248464/32951124 swapFree=56316160/67111528
[pid=27120] ppid=27118 vsize=387196 CPUtime=11.87 cores=0-7
/proc/27120/stat : 27120 (claspmt) D 27118 27120 26691 0 -1 4202496 9258 0 0 0 1182 5 0 0 20 0 8 0 662691415 396488704 9169 33554432000 4194304 4964800 140734097753984 18446744073709551615 212436060343 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/27120/statm: 96799 9169 464 189 0 91148 0
[pid=27120/tid=27121] ppid=27118 vsize=387196 CPUtime=1.48 cores=0-7
/proc/27120/task/27121/stat : 27121 (claspmt) D 27118 27120 26691 0 -1 4202560 863 0 0 0 148 0 0 0 20 0 8 0 662691416 396488704 9169 33554432000 4194304 4964800 140734097753984 18446744073709551615 212436060250 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=27120/tid=27122] ppid=27118 vsize=387196 CPUtime=1.48 cores=0-7
/proc/27120/task/27122/stat : 27122 (claspmt) R 27118 27120 26691 0 -1 4202560 1609 0 0 0 148 0 0 0 20 0 8 0 662691416 396488704 9169 33554432000 4194304 4964800 140734097753984 18446744073709551615 212436060343 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=27120/tid=27123] ppid=27118 vsize=387196 CPUtime=1.47 cores=0-7
/proc/27120/task/27123/stat : 27123 (claspmt) D 27118 27120 26691 0 -1 4202560 1132 0 0 0 147 0 0 0 20 0 8 0 662691416 396488704 9169 33554432000 4194304 4964800 140734097753984 18446744073709551615 212435678241 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=27120/tid=27124] ppid=27118 vsize=387196 CPUtime=1.48 cores=0-7
/proc/27120/task/27124/stat : 27124 (claspmt) D 27118 27120 26691 0 -1 4202560 900 0 0 0 148 0 0 0 19 0 8 0 662691416 396488704 9169 33554432000 4194304 4964800 140734097753984 18446744073709551615 212435677893 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=27120/tid=27125] ppid=27118 vsize=387196 CPUtime=1.47 cores=0-7
/proc/27120/task/27125/stat : 27125 (claspmt) S 27118 27120 26691 0 -1 4202560 972 0 0 0 147 0 0 0 20 0 8 0 662691416 396488704 9169 33554432000 4194304 4964800 140734097753984 18446744073709551615 212436122094 0 0 4096 18946 18446604453935135616 0 0 -1 1 0 0 0
[pid=27120/tid=27126] ppid=27118 vsize=387196 CPUtime=1.48 cores=0-7
/proc/27120/task/27126/stat : 27126 (claspmt) D 27118 27120 26691 0 -1 4202560 1230 0 0 0 148 0 0 0 20 0 8 0 662691416 396488704 9169 33554432000 4194304 4964800 140734097753984 18446744073709551615 212436060343 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=27120/tid=27127] ppid=27118 vsize=387196 CPUtime=1.43 cores=0-7
/proc/27120/task/27127/stat : 27127 (claspmt) R 27118 27120 26691 0 -1 4202560 964 0 0 0 143 0 0 0 25 0 8 0 662691416 396488704 9169 33554432000 4194304 4964800 140734097753984 18446744073709551615 4320944 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 11.87
Current children cumulated vsize (KiB) 387196

[startup+3.10051 s]
/proc/loadavg: 7.49 7.92 7.96 9/400 27128
/proc/meminfo: memFree=12203040/32951124 swapFree=56316160/67111528
[pid=27120] ppid=27118 vsize=518812 CPUtime=24.55 cores=0-7
/proc/27120/stat : 27120 (claspmt) R 27118 27120 26691 0 -1 4202496 12146 0 0 0 2448 7 0 0 25 0 8 0 662691415 531263488 12057 33554432000 4194304 4964800 140734097753984 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/27120/statm: 129703 12057 464 189 0 124052 0
[pid=27120/tid=27121] ppid=27118 vsize=518812 CPUtime=3.07 cores=0-7
/proc/27120/task/27121/stat : 27121 (claspmt) R 27118 27120 26691 0 -1 4202560 1091 0 0 0 306 1 0 0 25 0 8 0 662691416 531263488 12057 33554432000 4194304 4964800 140734097753984 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=27120/tid=27122] ppid=27118 vsize=518812 CPUtime=3.06 cores=0-7
/proc/27120/task/27122/stat : 27122 (claspmt) R 27118 27120 26691 0 -1 4202560 1853 0 0 0 306 0 0 0 25 0 8 0 662691416 531263488 12057 33554432000 4194304 4964800 140734097753984 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=27120/tid=27123] ppid=27118 vsize=518812 CPUtime=3.07 cores=0-7
/proc/27120/task/27123/stat : 27123 (claspmt) R 27118 27120 26691 0 -1 4202560 1754 0 0 0 306 1 0 0 25 0 8 0 662691416 531263488 12057 33554432000 4194304 4964800 140734097753984 18446744073709551615 4332418 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=27120/tid=27124] ppid=27118 vsize=518812 CPUtime=3.07 cores=0-7
/proc/27120/task/27124/stat : 27124 (claspmt) R 27118 27120 26691 0 -1 4202560 1119 0 0 0 307 0 0 0 23 0 8 0 662691416 531263488 12057 33554432000 4194304 4964800 140734097753984 18446744073709551615 4320970 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=27120/tid=27125] ppid=27118 vsize=518812 CPUtime=3.07 cores=0-7
/proc/27120/task/27125/stat : 27125 (claspmt) R 27118 27120 26691 0 -1 4202560 1375 0 0 0 306 1 0 0 20 0 8 0 662691416 531263488 12057 33554432000 4194304 4964800 140734097753984 18446744073709551615 4654449 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=27120/tid=27126] ppid=27118 vsize=518812 CPUtime=3.04 cores=0-7
/proc/27120/task/27126/stat : 27126 (claspmt) R 27118 27120 26691 0 -1 4202560 1620 0 0 0 303 1 0 0 20 0 8 0 662691416 531263488 12057 33554432000 4194304 4964800 140734097753984 18446744073709551615 4320970 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=27120/tid=27127] ppid=27118 vsize=518812 CPUtime=3.02 cores=0-7
/proc/27120/task/27127/stat : 27127 (claspmt) R 27118 27120 26691 0 -1 4202560 1243 0 0 0 302 0 0 0 25 0 8 0 662691416 531263488 12057 33554432000 4194304 4964800 140734097753984 18446744073709551615 4346000 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 24.55
Current children cumulated vsize (KiB) 518812

[startup+6.3149 s]
/proc/loadavg: 7.53 7.92 7.96 9/400 27128
/proc/meminfo: memFree=12193024/32951124 swapFree=56316160/67111528
[pid=27120] ppid=27118 vsize=519096 CPUtime=50.21 cores=0-7
/proc/27120/stat : 27120 (claspmt) R 27118 27120 26691 0 -1 4202496 14531 0 0 0 5011 10 0 0 21 0 8 0 662691415 531554304 14442 33554432000 4194304 4964800 140734097753984 18446744073709551615 4660126 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/27120/statm: 129774 14442 464 189 0 124123 0
[pid=27120/tid=27121] ppid=27118 vsize=519096 CPUtime=6.28 cores=0-7
/proc/27120/task/27121/stat : 27121 (claspmt) R 27118 27120 26691 0 -1 4202560 1268 0 0 0 627 1 0 0 25 0 8 0 662691416 531554304 14442 33554432000 4194304 4964800 140734097753984 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=27120/tid=27122] ppid=27118 vsize=519096 CPUtime=6.28 cores=0-7
/proc/27120/task/27122/stat : 27122 (claspmt) R 27118 27120 26691 0 -1 4202560 2261 0 0 0 627 1 0 0 19 0 8 0 662691416 531554304 14442 33554432000 4194304 4964800 140734097753984 18446744073709551615 4660139 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=27120/tid=27123] ppid=27118 vsize=519096 CPUtime=6.28 cores=0-7
/proc/27120/task/27123/stat : 27123 (claspmt) R 27118 27120 26691 0 -1 4202560 2027 0 0 0 627 1 0 0 25 0 8 0 662691416 531554304 14442 33554432000 4194304 4964800 140734097753984 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=27120/tid=27124] ppid=27118 vsize=519096 CPUtime=6.28 cores=0-7
/proc/27120/task/27124/stat : 27124 (claspmt) R 27118 27120 26691 0 -1 4202560 1522 0 0 0 628 0 0 0 25 0 8 0 662691416 531554304 14442 33554432000 4194304 4964800 140734097753984 18446744073709551615 4320981 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=27120/tid=27125] ppid=27118 vsize=519096 CPUtime=6.28 cores=0-7
/proc/27120/task/27125/stat : 27125 (claspmt) R 27118 27120 26691 0 -1 4202560 1609 0 0 0 627 1 0 0 25 0 8 0 662691416 531554304 14442 33554432000 4194304 4964800 140734097753984 18446744073709551615 4332052 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=27120/tid=27126] ppid=27118 vsize=519096 CPUtime=6.21 cores=0-7
/proc/27120/task/27126/stat : 27126 (claspmt) R 27118 27120 26691 0 -1 4202560 2079 0 0 0 620 1 0 0 25 0 8 0 662691416 531554304 14442 33554432000 4194304 4964800 140734097753984 18446744073709551615 4660123 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=27120/tid=27127] ppid=27118 vsize=519096 CPUtime=6.23 cores=0-7
/proc/27120/task/27127/stat : 27127 (claspmt) R 27118 27120 26691 0 -1 4202560 1413 0 0 0 623 0 0 0 23 0 8 0 662691416 531554304 14442 33554432000 4194304 4964800 140734097753984 18446744073709551615 4670310 0 0 4096 18946 0 0 0 -1 6 0 0 0

################
# More data... #
################


[startup+4662.3 s]
/proc/loadavg: 8.05 8.07 8.08 9/400 27748
/proc/meminfo: memFree=11937184/32951124 swapFree=56316160/67111528
[pid=27120] ppid=27118 vsize=546248 CPUtime=37219.3 cores=0-7
/proc/27120/stat : 27120 (claspmt) R 27118 27120 26691 0 -1 4202496 166657 0 0 0 3720681 1250 0 0 25 0 8 0 662691415 559357952 68035 33554432000 4194304 4964800 140734097753984 18446744073709551615 4320981 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/27120/statm: 136562 68035 464 189 0 130911 0
[pid=27120/tid=27121] ppid=27118 vsize=546248 CPUtime=4657.05 cores=0-7
/proc/27120/task/27121/stat : 27121 (claspmt) R 27118 27120 26691 0 -1 4202560 17448 0 0 0 465487 218 0 0 18 0 8 0 662691416 559357952 68035 33554432000 4194304 4964800 140734097753984 18446744073709551615 4670273 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=27120/tid=27122] ppid=27118 vsize=546248 CPUtime=4652.66 cores=0-7
/proc/27120/task/27122/stat : 27122 (claspmt) R 27118 27120 26691 0 -1 4202560 33826 0 0 0 465120 146 0 0 25 0 8 0 662691416 559357952 68035 33554432000 4194304 4964800 140734097753984 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=27120/tid=27123] ppid=27118 vsize=546248 CPUtime=4647.39 cores=0-7
/proc/27120/task/27123/stat : 27123 (claspmt) R 27118 27120 26691 0 -1 4202560 31036 0 0 0 464579 160 0 0 25 0 8 0 662691416 559357952 68035 33554432000 4194304 4964800 140734097753984 18446744073709551615 4320944 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=27120/tid=27124] ppid=27118 vsize=546248 CPUtime=4647.98 cores=0-7
/proc/27120/task/27124/stat : 27124 (claspmt) R 27118 27120 26691 0 -1 4202560 15780 0 0 0 464645 153 0 0 25 0 8 0 662691416 559357952 68035 33554432000 4194304 4964800 140734097753984 18446744073709551615 4320944 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=27120/tid=27125] ppid=27118 vsize=546248 CPUtime=4651.41 cores=0-7
/proc/27120/task/27125/stat : 27125 (claspmt) R 27118 27120 26691 0 -1 4202560 12226 0 0 0 464997 144 0 0 25 0 8 0 662691416 559357952 68035 33554432000 4194304 4964800 140734097753984 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=27120/tid=27126] ppid=27118 vsize=546248 CPUtime=4645.05 cores=0-7
/proc/27120/task/27126/stat : 27126 (claspmt) R 27118 27120 26691 0 -1 4202560 25959 0 0 0 464350 155 0 0 25 0 8 0 662691416 559357952 68035 33554432000 4194304 4964800 140734097753984 18446744073709551615 4670332 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=27120/tid=27127] ppid=27118 vsize=546248 CPUtime=4659.77 cores=0-7
/proc/27120/task/27127/stat : 27127 (claspmt) R 27118 27120 26691 0 -1 4202560 14222 0 0 0 465846 131 0 0 25 0 8 0 662691416 559357952 68035 33554432000 4194304 4964800 140734097753984 18446744073709551615 4670361 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 37219.3
Current children cumulated vsize (KiB) 546248

[startup+4722.3 s]
/proc/loadavg: 8.05 8.07 8.08 9/400 27750
/proc/meminfo: memFree=11934596/32951124 swapFree=56316160/67111528
[pid=27120] ppid=27118 vsize=546232 CPUtime=37698.3 cores=0-7
/proc/27120/stat : 27120 (claspmt) R 27118 27120 26691 0 -1 4202496 168519 0 0 0 3768570 1263 0 0 25 0 8 0 662691415 559341568 68407 33554432000 4194304 4964800 140734097753984 18446744073709551615 4332664 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/27120/statm: 136558 68407 464 189 0 130907 0
[pid=27120/tid=27121] ppid=27118 vsize=546232 CPUtime=4717.01 cores=0-7
/proc/27120/task/27121/stat : 27121 (claspmt) R 27118 27120 26691 0 -1 4202560 18005 0 0 0 471480 221 0 0 25 0 8 0 662691416 559341568 68407 33554432000 4194304 4964800 140734097753984 18446744073709551615 4683996 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=27120/tid=27122] ppid=27118 vsize=546232 CPUtime=4712.65 cores=0-7
/proc/27120/task/27122/stat : 27122 (claspmt) R 27118 27120 26691 0 -1 4202560 33848 0 0 0 471117 148 0 0 25 0 8 0 662691416 559341568 68407 33554432000 4194304 4964800 140734097753984 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=27120/tid=27123] ppid=27118 vsize=546232 CPUtime=4707.38 cores=0-7
/proc/27120/task/27123/stat : 27123 (claspmt) R 27118 27120 26691 0 -1 4202560 31428 0 0 0 470576 162 0 0 20 0 8 0 662691416 559341568 68407 33554432000 4194304 4964800 140734097753984 18446744073709551615 4320976 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=27120/tid=27124] ppid=27118 vsize=546232 CPUtime=4707.18 cores=0-7
/proc/27120/task/27124/stat : 27124 (claspmt) R 27118 27120 26691 0 -1 4202560 16156 0 0 0 470564 154 0 0 25 0 8 0 662691416 559341568 68407 33554432000 4194304 4964800 140734097753984 18446744073709551615 4321016 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=27120/tid=27125] ppid=27118 vsize=546232 CPUtime=4711.37 cores=0-7
/proc/27120/task/27125/stat : 27125 (claspmt) R 27118 27120 26691 0 -1 4202560 12235 0 0 0 470992 145 0 0 25 0 8 0 662691416 559341568 68407 33554432000 4194304 4964800 140734097753984 18446744073709551615 4320976 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=27120/tid=27126] ppid=27118 vsize=546232 CPUtime=4705.04 cores=0-7
/proc/27120/task/27126/stat : 27126 (claspmt) R 27118 27120 26691 0 -1 4202560 26407 0 0 0 470347 157 0 0 25 0 8 0 662691416 559341568 68407 33554432000 4194304 4964800 140734097753984 18446744073709551615 4320944 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=27120/tid=27127] ppid=27118 vsize=546232 CPUtime=4719.73 cores=0-7
/proc/27120/task/27127/stat : 27127 (claspmt) R 27118 27120 26691 0 -1 4202560 14223 0 0 0 471841 132 0 0 18 0 8 0 662691416 559341568 68407 33554432000 4194304 4964800 140734097753984 18446744073709551615 4320951 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 37698.3
Current children cumulated vsize (KiB) 546232

[startup+4782.3 s]
/proc/loadavg: 8.13 8.09 8.08 9/400 27751
/proc/meminfo: memFree=11934676/32951124 swapFree=56316160/67111528
[pid=27120] ppid=27118 vsize=546232 CPUtime=38177.4 cores=0-7
/proc/27120/stat : 27120 (claspmt) R 27118 27120 26691 0 -1 4202496 171266 0 0 0 3816457 1280 0 0 25 0 8 0 662691415 559341568 68590 33554432000 4194304 4964800 140734097753984 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/27120/statm: 136558 68590 464 189 0 130907 0
[pid=27120/tid=27121] ppid=27118 vsize=546232 CPUtime=4776.94 cores=0-7
/proc/27120/task/27121/stat : 27121 (claspmt) R 27118 27120 26691 0 -1 4202560 18248 0 0 0 477470 224 0 0 20 0 8 0 662691416 559341568 68590 33554432000 4194304 4964800 140734097753984 18446744073709551615 4320970 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=27120/tid=27122] ppid=27118 vsize=546232 CPUtime=4772.63 cores=0-7
/proc/27120/task/27122/stat : 27122 (claspmt) R 27118 27120 26691 0 -1 4202560 34395 0 0 0 477113 150 0 0 25 0 8 0 662691416 559341568 68590 33554432000 4194304 4964800 140734097753984 18446744073709551615 4320966 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=27120/tid=27123] ppid=27118 vsize=546232 CPUtime=4767.37 cores=0-7
/proc/27120/task/27123/stat : 27123 (claspmt) R 27118 27120 26691 0 -1 4202560 31722 0 0 0 476573 164 0 0 25 0 8 0 662691416 559341568 68590 33554432000 4194304 4964800 140734097753984 18446744073709551615 4670330 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=27120/tid=27124] ppid=27118 vsize=546232 CPUtime=4766.42 cores=0-7
/proc/27120/task/27124/stat : 27124 (claspmt) R 27118 27120 26691 0 -1 4202560 16451 0 0 0 476486 156 0 0 25 0 8 0 662691416 559341568 68590 33554432000 4194304 4964800 140734097753984 18446744073709551615 4670273 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=27120/tid=27125] ppid=27118 vsize=546232 CPUtime=4771.33 cores=0-7
/proc/27120/task/27125/stat : 27125 (claspmt) R 27118 27120 26691 0 -1 4202560 12505 0 0 0 476987 146 0 0 25 0 8 0 662691416 559341568 68590 33554432000 4194304 4964800 140734097753984 18446744073709551615 4670349 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=27120/tid=27126] ppid=27118 vsize=546232 CPUtime=4765.01 cores=0-7
/proc/27120/task/27126/stat : 27126 (claspmt) R 27118 27120 26691 0 -1 4202560 26889 0 0 0 476341 160 0 0 24 0 8 0 662691416 559341568 68590 33554432000 4194304 4964800 140734097753984 18446744073709551615 4320955 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=27120/tid=27127] ppid=27118 vsize=546232 CPUtime=4779.72 cores=0-7
/proc/27120/task/27127/stat : 27127 (claspmt) R 27118 27120 26691 0 -1 4202560 14774 0 0 0 477837 135 0 0 25 0 8 0 662691416 559341568 68590 33554432000 4194304 4964800 140734097753984 18446744073709551615 4320955 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 38177.4
Current children cumulated vsize (KiB) 546232

[startup+4842.3 s]
/proc/loadavg: 8.11 8.09 8.08 9/400 27753
/proc/meminfo: memFree=11933040/32951124 swapFree=56316160/67111528
[pid=27120] ppid=27118 vsize=546232 CPUtime=38656.4 cores=0-7
/proc/27120/stat : 27120 (claspmt) R 27118 27120 26691 0 -1 4202496 173310 0 0 0 3864342 1296 0 0 22 0 8 0 662691415 559341568 68919 33554432000 4194304 4964800 140734097753984 18446744073709551615 4321020 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/27120/statm: 136558 68919 464 189 0 130907 0
[pid=27120/tid=27121] ppid=27118 vsize=546232 CPUtime=4836.89 cores=0-7
/proc/27120/task/27121/stat : 27121 (claspmt) R 27118 27120 26691 0 -1 4202560 18679 0 0 0 483462 227 0 0 23 0 8 0 662691416 559341568 68919 33554432000 4194304 4964800 140734097753984 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=27120/tid=27122] ppid=27118 vsize=546232 CPUtime=4832.6 cores=0-7
/proc/27120/task/27122/stat : 27122 (claspmt) R 27118 27120 26691 0 -1 4202560 35059 0 0 0 483108 152 0 0 25 0 8 0 662691416 559341568 68919 33554432000 4194304 4964800 140734097753984 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=27120/tid=27123] ppid=27118 vsize=546232 CPUtime=4827.34 cores=0-7
/proc/27120/task/27123/stat : 27123 (claspmt) R 27118 27120 26691 0 -1 4202560 31885 0 0 0 482569 165 0 0 25 0 8 0 662691416 559341568 68919 33554432000 4194304 4964800 140734097753984 18446744073709551615 4320966 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=27120/tid=27124] ppid=27118 vsize=546232 CPUtime=4825.63 cores=0-7
/proc/27120/task/27124/stat : 27124 (claspmt) R 27118 27120 26691 0 -1 4202560 16598 0 0 0 482405 158 0 0 25 0 8 0 662691416 559341568 68919 33554432000 4194304 4964800 140734097753984 18446744073709551615 4320981 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=27120/tid=27125] ppid=27118 vsize=546232 CPUtime=4831.29 cores=0-7
/proc/27120/task/27125/stat : 27125 (claspmt) R 27118 27120 26691 0 -1 4202560 12664 0 0 0 482981 148 0 0 25 0 8 0 662691416 559341568 68919 33554432000 4194304 4964800 140734097753984 18446744073709551615 4320981 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=27120/tid=27126] ppid=27118 vsize=546232 CPUtime=4824.99 cores=0-7
/proc/27120/task/27126/stat : 27126 (claspmt) R 27118 27120 26691 0 -1 4202560 27315 0 0 0 482337 162 0 0 25 0 8 0 662691416 559341568 68919 33554432000 4194304 4964800 140734097753984 18446744073709551615 4684054 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=27120/tid=27127] ppid=27118 vsize=546232 CPUtime=4839.7 cores=0-7
/proc/27120/task/27127/stat : 27127 (claspmt) R 27118 27120 26691 0 -1 4202560 14804 0 0 0 483834 136 0 0 21 0 8 0 662691416 559341568 68919 33554432000 4194304 4964800 140734097753984 18446744073709551615 4321016 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 38656.4
Current children cumulated vsize (KiB) 546232

[startup+4902.3 s]
/proc/loadavg: 8.04 8.07 8.07 9/400 27754
/proc/meminfo: memFree=11931552/32951124 swapFree=56316160/67111528
[pid=27120] ppid=27118 vsize=546232 CPUtime=39135.5 cores=0-7
/proc/27120/stat : 27120 (claspmt) R 27118 27120 26691 0 -1 4202496 175004 0 0 0 3912244 1310 0 0 25 0 8 0 662691415 559341568 69477 33554432000 4194304 4964800 140734097753984 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/27120/statm: 136558 69477 464 189 0 130907 0
[pid=27120/tid=27121] ppid=27118 vsize=546232 CPUtime=4896.86 cores=0-7
/proc/27120/task/27121/stat : 27121 (claspmt) R 27118 27120 26691 0 -1 4202560 18756 0 0 0 489457 229 0 0 25 0 8 0 662691416 559341568 69477 33554432000 4194304 4964800 140734097753984 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=27120/tid=27122] ppid=27118 vsize=546232 CPUtime=4892.61 cores=0-7
/proc/27120/task/27122/stat : 27122 (claspmt) R 27118 27120 26691 0 -1 4202560 35173 0 0 0 489107 154 0 0 25 0 8 0 662691416 559341568 69477 33554432000 4194304 4964800 140734097753984 18446744073709551615 4320966 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=27120/tid=27123] ppid=27118 vsize=546232 CPUtime=4887.34 cores=0-7
/proc/27120/task/27123/stat : 27123 (claspmt) R 27118 27120 26691 0 -1 4202560 32405 0 0 0 488566 168 0 0 25 0 8 0 662691416 559341568 69477 33554432000 4194304 4964800 140734097753984 18446744073709551615 4320944 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=27120/tid=27124] ppid=27118 vsize=546232 CPUtime=4884.86 cores=0-7
/proc/27120/task/27124/stat : 27124 (claspmt) R 27118 27120 26691 0 -1 4202560 16653 0 0 0 488326 160 0 0 25 0 8 0 662691416 559341568 69477 33554432000 4194304 4964800 140734097753984 18446744073709551615 4683952 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=27120/tid=27125] ppid=27118 vsize=546232 CPUtime=4891.26 cores=0-7
/proc/27120/task/27125/stat : 27125 (claspmt) R 27118 27120 26691 0 -1 4202560 12721 0 0 0 488977 149 0 0 25 0 8 0 662691416 559341568 69477 33554432000 4194304 4964800 140734097753984 18446744073709551615 4320976 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=27120/tid=27126] ppid=27118 vsize=546232 CPUtime=4884.99 cores=0-7
/proc/27120/task/27126/stat : 27126 (claspmt) R 27118 27120 26691 0 -1 4202560 28070 0 0 0 488335 164 0 0 25 0 8 0 662691416 559341568 69477 33554432000 4194304 4964800 140734097753984 18446744073709551615 4320944 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=27120/tid=27127] ppid=27118 vsize=546232 CPUtime=4899.69 cores=0-7
/proc/27120/task/27127/stat : 27127 (claspmt) R 27118 27120 26691 0 -1 4202560 14863 0 0 0 489832 137 0 0 25 0 8 0 662691416 559341568 69477 33554432000 4194304 4964800 140734097753984 18446744073709551615 4321042 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 39135.5
Current children cumulated vsize (KiB) 546232

[startup+4962.3 s]
/proc/loadavg: 8.15 8.09 8.08 9/400 27756
/proc/meminfo: memFree=11932628/32951124 swapFree=56316160/67111528
[pid=27120] ppid=27118 vsize=546232 CPUtime=39614.5 cores=0-7
/proc/27120/stat : 27120 (claspmt) R 27118 27120 26691 0 -1 4202496 176077 0 0 0 3960126 1323 0 0 25 0 8 0 662691415 559341568 69287 33554432000 4194304 4964800 140734097753984 18446744073709551615 4321042 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/27120/statm: 136558 69287 464 189 0 130907 0
[pid=27120/tid=27121] ppid=27118 vsize=546232 CPUtime=4956.8 cores=0-7
/proc/27120/task/27121/stat : 27121 (claspmt) R 27118 27120 26691 0 -1 4202560 18998 0 0 0 495448 232 0 0 19 0 8 0 662691416 559341568 69287 33554432000 4194304 4964800 140734097753984 18446744073709551615 4312169 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=27120/tid=27122] ppid=27118 vsize=546232 CPUtime=4952.58 cores=0-7
/proc/27120/task/27122/stat : 27122 (claspmt) R 27118 27120 26691 0 -1 4202560 35349 0 0 0 495103 155 0 0 25 0 8 0 662691416 559341568 69287 33554432000 4194304 4964800 140734097753984 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=27120/tid=27123] ppid=27118 vsize=546232 CPUtime=4947.3 cores=0-7
/proc/27120/task/27123/stat : 27123 (claspmt) R 27118 27120 26691 0 -1 4202560 32629 0 0 0 494561 169 0 0 25 0 8 0 662691416 559341568 69287 33554432000 4194304 4964800 140734097753984 18446744073709551615 4670321 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=27120/tid=27124] ppid=27118 vsize=546232 CPUtime=4944.06 cores=0-7
/proc/27120/task/27124/stat : 27124 (claspmt) R 27118 27120 26691 0 -1 4202560 16653 0 0 0 494244 162 0 0 25 0 8 0 662691416 559341568 69287 33554432000 4194304 4964800 140734097753984 18446744073709551615 212435675892 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=27120/tid=27125] ppid=27118 vsize=546232 CPUtime=4951.22 cores=0-7
/proc/27120/task/27125/stat : 27125 (claspmt) R 27118 27120 26691 0 -1 4202560 12742 0 0 0 494971 151 0 0 25 0 8 0 662691416 559341568 69287 33554432000 4194304 4964800 140734097753984 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=27120/tid=27126] ppid=27118 vsize=546232 CPUtime=4944.96 cores=0-7
/proc/27120/task/27126/stat : 27126 (claspmt) R 27118 27120 26691 0 -1 4202560 28092 0 0 0 494331 165 0 0 25 0 8 0 662691416 559341568 69287 33554432000 4194304 4964800 140734097753984 18446744073709551615 4670357 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=27120/tid=27127] ppid=27118 vsize=546232 CPUtime=4959.67 cores=0-7
/proc/27120/task/27127/stat : 27127 (claspmt) R 27118 27120 26691 0 -1 4202560 14941 0 0 0 495828 139 0 0 25 0 8 0 662691416 559341568 69287 33554432000 4194304 4964800 140734097753984 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 39614.5
Current children cumulated vsize (KiB) 546232



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5010.6 s]
/proc/loadavg: 8.06 8.07 8.07 9/400 27757
/proc/meminfo: memFree=11932312/32951124 swapFree=56316160/67111528
[pid=27120] ppid=27118 vsize=546232 CPUtime=40000.2 cores=0-7
/proc/27120/stat : 27120 (claspmt) R 27118 27120 26691 0 -1 4202496 176382 0 0 0 3998685 1339 0 0 19 0 8 0 662691415 559341568 69179 33554432000 4194304 4964800 140734097753984 18446744073709551615 4670328 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/27120/statm: 136558 69179 464 189 0 130907 0
[pid=27120/tid=27121] ppid=27118 vsize=546232 CPUtime=5005.09 cores=0-7
/proc/27120/task/27121/stat : 27121 (claspmt) R 27118 27120 26691 0 -1 4202560 19027 0 0 0 500274 235 0 0 25 0 8 0 662691416 559341568 69179 33554432000 4194304 4964800 140734097753984 18446744073709551615 4362251 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=27120/tid=27122] ppid=27118 vsize=546232 CPUtime=5000.89 cores=0-7
/proc/27120/task/27122/stat : 27122 (claspmt) R 27118 27120 26691 0 -1 4202560 35510 0 0 0 499932 157 0 0 25 0 8 0 662691416 559341568 69179 33554432000 4194304 4964800 140734097753984 18446744073709551615 212436122143 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=27120/tid=27123] ppid=27118 vsize=546232 CPUtime=4995.6 cores=0-7
/proc/27120/task/27123/stat : 27123 (claspmt) R 27118 27120 26691 0 -1 4202560 32629 0 0 0 499389 171 0 0 25 0 8 0 662691416 559341568 69179 33554432000 4194304 4964800 140734097753984 18446744073709551615 4320951 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=27120/tid=27124] ppid=27118 vsize=546232 CPUtime=4991.72 cores=0-7
/proc/27120/task/27124/stat : 27124 (claspmt) R 27118 27120 26691 0 -1 4202560 16653 0 0 0 499009 163 0 0 18 0 8 0 662691416 559341568 69179 33554432000 4194304 4964800 140734097753984 18446744073709551615 4663368 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=27120/tid=27125] ppid=27118 vsize=546232 CPUtime=4999.5 cores=0-7
/proc/27120/task/27125/stat : 27125 (claspmt) R 27118 27120 26691 0 -1 4202560 12742 0 0 0 499797 153 0 0 21 0 8 0 662691416 559341568 69179 33554432000 4194304 4964800 140734097753984 18446744073709551615 4642509 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=27120/tid=27126] ppid=27118 vsize=546232 CPUtime=4993.26 cores=0-7
/proc/27120/task/27126/stat : 27126 (claspmt) R 27118 27120 26691 0 -1 4202560 28092 0 0 0 499159 167 0 0 25 0 8 0 662691416 559341568 69179 33554432000 4194304 4964800 140734097753984 18446744073709551615 4320951 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=27120/tid=27127] ppid=27118 vsize=546232 CPUtime=5007.97 cores=0-7
/proc/27120/task/27127/stat : 27127 (claspmt) R 27118 27120 26691 0 -1 4202560 15055 0 0 0 500656 141 0 0 25 0 8 0 662691416 559341568 69179 33554432000 4194304 4964800 140734097753984 18446744073709551615 4660219 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 40000.2
Current children cumulated vsize (KiB) 546232

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child status: 0
Real time (s): 5010.65
CPU time (s): 40000.3
CPU user time (s): 39986.9
CPU system time (s): 13.407
CPU usage (%): 798.306
Max. virtual memory (cumulated for all children) (KiB): 547068

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39986.9
system time used= 13.407
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 176394
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2501081
involuntary context switches= 201140

runsolver used 18.6382 second user time and 45.1621 second system time

The end

Launcher Data 

Begin job on node102 at 2011-05-16 03:54:51
IDJOB=3381260
IDBENCH=85459
IDSOLVER=1865
FILE ID=node102/3381260-1305510891
RUNJOBID= node102-1305505285-26705
PBS_JOBID= 13325497
Free space on /tmp= 73604 MiB

SOLVER NAME= claspmt 2.0-R4095-patched (fixed)
BENCH NAME= SAT05/crafted/sabharwal05/counting/php/unsat/harder/php-020-019.shuffled-as.sat05-1190.cnf
COMMAND LINE= HOME/claspmt -tNBCORE -p HOME/sat11-port.txt --distribute=all,2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3381260-1305510891/watcher-3381260-1305510891 -o /tmp/evaluation-result-3381260-1305510891/solver-3381260-1305510891 -C 40000 -W 5100 -M 31000  HOME/claspmt -t8 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3381260-1305510891.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 81bbeaaf9f0ca3bfc36d743097777052
RANDOM SEED=2118578422

node102.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      12248992 kB
Buffers:         82844 kB
Cached:         814084 kB
SwapCached:      33148 kB
Active:       12035228 kB
Inactive:      8448788 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      12248992 kB
SwapTotal:    67111528 kB
SwapFree:     56316160 kB
Dirty:             820 kB
Writeback:           0 kB
AnonPages:    19564548 kB
Mapped:          20420 kB
Slab:            64136 kB
PageTables:      86116 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 102326476 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73684 MiB
End job on node102 at 2011-05-16 05:18:23