Trace number 3373258

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
claspmt 2.0-R4095-patched (fixed)? (TO) 4800.43 1204.17

General information on the benchmark

NameCRAFTED/rbsat/random/
forced/rbsat-v1820c171155gyes3.cnf
MD5SUMcd19d9eb9be97e183fa1a1d47d679d01
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables1820
Number of clauses171155
Sum of the clauses size344000
Maximum clause length28
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 2171090
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 565

Solver Data 

0.00/0.00	c clasp version 2.0.0-RC2
0.00/0.00	c Reading from ...419510/instance-3373258-1305419510.cnf
0.69/0.71	c Solving...
4800.23/1204.01	
4800.23/1204.01	*** INTERRUPTED! ***
4800.23/1204.01	*** Shutting down threads...
4800.37/1204.17	s UNKNOWN
4800.37/1204.17	
4800.37/1204.17	c INTERRUPTED   : 1
4800.37/1204.17	c Models        : 0+    
4800.37/1204.17	c Time          : 1204.018s (Solving: 1203.30s 1st Model: 0.00s Unsat: 0.00s)
4800.37/1204.17	c CPU Time      : 4800.270s

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3373258-1305419510/watcher-3373258-1305419510 -o /tmp/evaluation-result-3373258-1305419510/solver-3373258-1305419510 -C 4800 -W 1300 -M 15500 HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3373258-1305419510.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.93 8.03 7.73 6/358 19446
/proc/meminfo: memFree=23649084/32951124 swapFree=65980216/67111528
[pid=19446] ppid=19444 vsize=21704 CPUtime=0 cores=0,2,4,6
/proc/19446/stat : 19446 (claspmt) R 19444 19446 18548 0 -1 4202496 712 0 0 0 0 0 0 0 25 0 1 0 634366481 22224896 630 33554432000 4194304 4964800 140733728710352 18446744073709551615 4599599 0 0 4096 18946 0 0 0 17 2 0 0 0
/proc/19446/statm: 5426 630 385 189 0 300 0

[startup+0.059169 s]
/proc/loadavg: 7.93 8.03 7.73 6/358 19446
/proc/meminfo: memFree=23649084/32951124 swapFree=65980216/67111528
[pid=19446] ppid=19444 vsize=31976 CPUtime=0.05 cores=0,2,4,6
/proc/19446/stat : 19446 (claspmt) R 19444 19446 18548 0 -1 4202496 3936 0 0 0 5 0 0 0 25 0 1 0 634366481 32743424 3093 33554432000 4194304 4964800 140733728710352 18446744073709551615 4618467 0 0 4096 18946 0 0 0 17 2 0 0 0
/proc/19446/statm: 7994 3094 396 189 0 2868 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 31976

[startup+0.10116 s]
/proc/loadavg: 7.93 8.03 7.73 6/358 19446
/proc/meminfo: memFree=23649084/32951124 swapFree=65980216/67111528
[pid=19446] ppid=19444 vsize=31976 CPUtime=0.09 cores=0,2,4,6
/proc/19446/stat : 19446 (claspmt) R 19444 19446 18548 0 -1 4202496 3951 0 0 0 9 0 0 0 25 0 1 0 634366481 32743424 3108 33554432000 4194304 4964800 140733728710352 18446744073709551615 4607590 0 0 4096 18946 0 0 0 17 2 0 0 0
/proc/19446/statm: 7994 3108 398 189 0 2868 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 31976

[startup+0.301123 s]
/proc/loadavg: 7.93 8.03 7.73 6/358 19446
/proc/meminfo: memFree=23649084/32951124 swapFree=65980216/67111528
[pid=19446] ppid=19444 vsize=31976 CPUtime=0.29 cores=0,2,4,6
/proc/19446/stat : 19446 (claspmt) R 19444 19446 18548 0 -1 4202496 3951 0 0 0 29 0 0 0 25 0 1 0 634366481 32743424 3108 33554432000 4194304 4964800 140733728710352 18446744073709551615 4607641 0 0 4096 18946 0 0 0 17 2 0 0 0
/proc/19446/statm: 7994 3108 398 189 0 2868 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 31976

[startup+0.701049 s]
/proc/loadavg: 7.93 8.03 7.73 6/358 19446
/proc/meminfo: memFree=23649084/32951124 swapFree=65980216/67111528
[pid=19446] ppid=19444 vsize=33984 CPUtime=0.69 cores=0,2,4,6
/proc/19446/stat : 19446 (claspmt) R 19444 19446 18548 0 -1 4202496 4470 0 0 0 69 0 0 0 25 0 1 0 634366481 34799616 3627 33554432000 4194304 4964800 140733728710352 18446744073709551615 4327781 0 0 4096 18946 0 0 0 17 2 0 0 0
/proc/19446/statm: 8496 3627 401 189 0 3370 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 33984

[startup+1.50086 s]
/proc/loadavg: 7.93 8.03 7.73 9/362 19450
/proc/meminfo: memFree=23628956/32951124 swapFree=65980216/67111528
[pid=19446] ppid=19444 vsize=179608 CPUtime=3.8 cores=0,2,4,6
/proc/19446/stat : 19446 (claspmt) R 19444 19446 18548 0 -1 4202496 8019 0 0 0 379 1 0 0 25 0 4 0 634366481 183918592 6838 33554432000 4194304 4964800 140733728710352 18446744073709551615 4670273 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/19446/statm: 44902 6838 458 189 0 39251 0
[pid=19446/tid=19448] ppid=19444 vsize=179608 CPUtime=0.77 cores=0,2,4,6
/proc/19446/task/19448/stat : 19448 (claspmt) R 19444 19446 18548 0 -1 4202560 720 0 0 0 77 0 0 0 25 0 4 0 634366553 183918592 6838 33554432000 4194304 4964800 140733728710352 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=19446/tid=19449] ppid=19444 vsize=179608 CPUtime=0.77 cores=0,2,4,6
/proc/19446/task/19449/stat : 19449 (claspmt) R 19444 19446 18548 0 -1 4202560 925 0 0 0 77 0 0 0 18 0 4 0 634366553 183918592 6838 33554432000 4194304 4964800 140733728710352 18446744073709551615 4670264 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=19446/tid=19450] ppid=19444 vsize=179608 CPUtime=0.76 cores=0,2,4,6
/proc/19446/task/19450/stat : 19450 (claspmt) R 19444 19446 18548 0 -1 4202560 1019 0 0 0 76 0 0 0 25 0 4 0 634366553 183918592 6838 33554432000 4194304 4964800 140733728710352 18446744073709551615 4627257 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3.8
Current children cumulated vsize (KiB) 179608

[startup+3.10057 s]
/proc/loadavg: 7.93 8.03 7.73 10/362 19450
/proc/meminfo: memFree=23613580/32951124 swapFree=65980216/67111528
[pid=19446] ppid=19444 vsize=184436 CPUtime=10.18 cores=0,2,4,6
/proc/19446/stat : 19446 (claspmt) R 19444 19446 18548 0 -1 4202496 11847 0 0 0 1016 2 0 0 25 0 4 0 634366481 188862464 10666 33554432000 4194304 4964800 140733728710352 18446744073709551615 4670346 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/19446/statm: 46109 10666 458 189 0 40458 0
[pid=19446/tid=19448] ppid=19444 vsize=184436 CPUtime=2.36 cores=0,2,4,6
/proc/19446/task/19448/stat : 19448 (claspmt) R 19444 19446 18548 0 -1 4202560 1670 0 0 0 236 0 0 0 25 0 4 0 634366553 188862464 10667 33554432000 4194304 4964800 140733728710352 18446744073709551615 228095111877 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=19446/tid=19449] ppid=19444 vsize=184436 CPUtime=2.37 cores=0,2,4,6
/proc/19446/task/19449/stat : 19449 (claspmt) R 19444 19446 18548 0 -1 4202560 1868 0 0 0 237 0 0 0 21 0 4 0 634366553 188862464 10667 33554432000 4194304 4964800 140733728710352 18446744073709551615 228095112225 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=19446/tid=19450] ppid=19444 vsize=184436 CPUtime=2.36 cores=0,2,4,6
/proc/19446/task/19450/stat : 19450 (claspmt) R 19444 19446 18548 0 -1 4202560 1954 0 0 0 236 0 0 0 25 0 4 0 634366553 188862464 10667 33554432000 4194304 4964800 140733728710352 18446744073709551615 4670346 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 10.18
Current children cumulated vsize (KiB) 184436

[startup+6.30098 s]
/proc/loadavg: 8.01 8.05 7.74 9/362 19450
/proc/meminfo: memFree=23577248/32951124 swapFree=65980216/67111528
[pid=19446] ppid=19444 vsize=194100 CPUtime=22.94 cores=0,2,4,6
/proc/19446/stat : 19446 (claspmt) R 19444 19446 18548 0 -1 4202496 18034 0 0 0 2290 4 0 0 25 0 4 0 634366481 198758400 16853 33554432000 4194304 4964800 140733728710352 18446744073709551615 4673291 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/19446/statm: 48525 16853 460 189 0 42874 0
[pid=19446/tid=19448] ppid=19444 vsize=194100 CPUtime=5.57 cores=0,2,4,6
/proc/19446/task/19448/stat : 19448 (claspmt) R 19444 19446 18548 0 -1 4202560 3311 0 0 0 556 1 0 0 25 0 4 0 634366553 198758400 16853 33554432000 4194304 4964800 140733728710352 18446744073709551615 4627338 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=19446/tid=19449] ppid=19444 vsize=194100 CPUtime=5.57 cores=0,2,4,6
/proc/19446/task/19449/stat : 19449 (claspmt) R 19444 19446 18548 0 -1 4202560 3724 0 0 0 557 0 0 0 25 0 4 0 634366553 198758400 16853 33554432000 4194304 4964800 140733728710352 18446744073709551615 4627204 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=19446/tid=19450] ppid=19444 vsize=194100 CPUtime=5.57 cores=0,2,4,6
/proc/19446/task/19450/stat : 19450 (claspmt) R 19444 19446 18548 0 -1 4202560 3445 0 0 0 556 1 0 0 25 0 4 0 634366553 198758400 16853 33554432000 4194304 4964800 140733728710352 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 22.94
Current children cumulated vsize (KiB) 194100

[startup+12.7008 s]
/proc/loadavg: 8.01 8.05 7.74 10/362 19450
/proc/meminfo: memFree=23534316/32951124 swapFree=65980216/67111528
[pid=19446] ppid=19444 vsize=201504 CPUtime=48.47 cores=0,2,4,6
/proc/19446/stat : 19446 (claspmt) R 19444 19446 18548 0 -1 4202496 23770 0 0 0 4841 6 0 0 25 0 4 0 634366481 206340096 22589 33554432000 4194304 4964800 140733728710352 18446744073709551615 4669011 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/19446/statm: 50376 22589 460 189 0 44725 0
[pid=19446/tid=19448] ppid=19444 vsize=201504 CPUtime=11.96 cores=0,2,4,6
/proc/19446/task/19448/stat : 19448 (claspmt) R 19444 19446 18548 0 -1 4202560 5128 0 0 0 1195 1 0 0 25 0 4 0 634366553 206340096 22589 33554432000 4194304 4964800 140733728710352 18446744073709551615 4627540 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=19446/tid=19449] ppid=19444 vsize=201504 CPUtime=11.97 cores=0,2,4,6
/proc/19446/task/19449/stat : 19449 (claspmt) R 19444 19446 18548 0 -1 4202560 5610 0 0 0 1196 1 0 0 25 0 4 0 634366553 206340096 22589 33554432000 4194304 4964800 140733728710352 18446744073709551615 4378499 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=19446/tid=19450] ppid=19444 vsize=201504 CPUtime=11.96 cores=0,2,4,6
/proc/19446/task/19450/stat : 19450 (claspmt) R 19444 19446 18548 0 -1 4202560 4447 0 0 0 1195 1 0 0 25 0 4 0 634366553 206340096 22589 33554432000 4194304 4964800 140733728710352 18446744073709551615 4627204 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 48.47
Current children cumulated vsize (KiB) 201504

[startup+25.5004 s]
/proc/loadavg: 8.01 8.05 7.74 9/362 19450
/proc/meminfo: memFree=23500084/32951124 swapFree=65980216/67111528
[pid=19446] ppid=19444 vsize=211496 CPUtime=99.51 cores=0,2,4,6
/proc/19446/stat : 19446 (claspmt) R 19444 19446 18548 0 -1 4202496 31791 0 0 0 9940 11 0 0 25 0 4 0 634366481 216571904 30610 33554432000 4194304 4964800 140733728710352 18446744073709551615 4670299 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/19446/statm: 52874 30610 460 189 0 47223 0
[pid=19446/tid=19448] ppid=19444 vsize=211496 CPUtime=24.76 cores=0,2,4,6
/proc/19446/task/19448/stat : 19448 (claspmt) R 19444 19446 18548 0 -1 4202560 8588 0 0 0 2473 3 0 0 25 0 4 0 634366553 216571904 30610 33554432000 4194304 4964800 140733728710352 18446744073709551615 4627803 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=19446/tid=19449] ppid=19444 vsize=211496 CPUtime=24.77 cores=0,2,4,6
/proc/19446/task/19449/stat : 19449 (claspmt) R 19444 19446 18548 0 -1 4202560 7179 0 0 0 2475 2 0 0 25 0 4 0 634366553 216571904 30610 33554432000 4194304 4964800 140733728710352 18446744073709551615 4670394 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=19446/tid=19450] ppid=19444 vsize=211496 CPUtime=24.76 cores=0,2,4,6
/proc/19446/task/19450/stat : 19450 (claspmt) R 19444 19446 18548 0 -1 4202560 5963 0 0 0 2474 2 0 0 25 0 4 0 634366553 216571904 30610 33554432000 4194304 4964800 140733728710352 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 99.51
Current children cumulated vsize (KiB) 211496

[startup+51.1007 s]
/proc/loadavg: 8.08 8.06 7.75 9/362 19451
/proc/meminfo: memFree=23440360/32951124 swapFree=65980216/67111528
[pid=19446] ppid=19444 vsize=288196 CPUtime=201.63 cores=0,2,4,6
/proc/19446/stat : 19446 (claspmt) R 19444 19446 18548 0 -1 4202496 45027 0 0 0 20144 19 0 0 25 0 4 0 634366481 295112704 43835 33554432000 4194304 4964800 140733728710352 18446744073709551615 4684110 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/19446/statm: 72049 43835 460 189 0 66398 0
[pid=19446/tid=19448] ppid=19444 vsize=288196 CPUtime=50.36 cores=0,2,4,6
/proc/19446/task/19448/stat : 19448 (claspmt) R 19444 19446 18548 0 -1 4202560 13365 0 0 0 5030 6 0 0 25 0 4 0 634366553 295112704 43835 33554432000 4194304 4964800 140733728710352 18446744073709551615 4628021 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=19446/tid=19449] ppid=19444 vsize=288196 CPUtime=50.36 cores=0,2,4,6
/proc/19446/task/19449/stat : 19449 (claspmt) R 19444 19446 18548 0 -1 4202560 10522 0 0 0 5033 3 0 0 25 0 4 0 634366553 295112704 43835 33554432000 4194304 4964800 140733728710352 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=19446/tid=19450] ppid=19444 vsize=288196 CPUtime=50.36 cores=0,2,4,6
/proc/19446/task/19450/stat : 19450 (claspmt) R 19444 19446 18548 0 -1 4202560 6793 0 0 0 5034 2 0 0 25 0 4 0 634366553 295112704 43835 33554432000 4194304 4964800 140733728710352 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 201.63
Current children cumulated vsize (KiB) 288196

[startup+102.313 s]
/proc/loadavg: 8.08 8.06 7.77 9/362 19452
/proc/meminfo: memFree=23276900/32951124 swapFree=65980216/67111528
[pid=19446] ppid=19444 vsize=312536 CPUtime=405.91 cores=0,2,4,6
/proc/19446/stat : 19446 (claspmt) R 19444 19446 18548 0 -1 4202496 60924 0 0 0 40561 30 0 0 25 0 4 0 634366481 320036864 59732 33554432000 4194304 4964800 140733728710352 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/19446/statm: 78134 59732 460 189 0 72483 0
[pid=19446/tid=19448] ppid=19444 vsize=312536 CPUtime=101.56 cores=0,2,4,6
/proc/19446/task/19448/stat : 19448 (claspmt) R 19444 19446 18548 0 -1 4202560 16785 0 0 0 10148 8 0 0 25 0 4 0 634366553 320036864 59732 33554432000 4194304 4964800 140733728710352 18446744073709551615 4670328 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=19446/tid=19449] ppid=19444 vsize=312536 CPUtime=101.58 cores=0,2,4,6
/proc/19446/task/19449/stat : 19449 (claspmt) R 19444 19446 18548 0 -1 4202560 15514 0 0 0 10151 7 0 0 25 0 4 0 634366553 320036864 59732 33554432000 4194304 4964800 140733728710352 18446744073709551615 4670273 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=19446/tid=19450] ppid=19444 vsize=312536 CPUtime=101.57 cores=0,2,4,6
/proc/19446/task/19450/stat : 19450 (claspmt) R 19444 19446 18548 0 -1 4202560 9816 0 0 0 10153 4 0 0 25 0 4 0 634366553 320036864 59732 33554432000 4194304 4964800 140733728710352 18446744073709551615 4627204 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 405.91
Current children cumulated vsize (KiB) 312536

[startup+162.3 s]
/proc/loadavg: 8.10 8.08 7.79 9/362 19454
/proc/meminfo: memFree=23144060/32951124 swapFree=65980216/67111528
[pid=19446] ppid=19444 vsize=479228 CPUtime=645.2 cores=0,2,4,6
/proc/19446/stat : 19446 (claspmt) R 19444 19446 18548 0 -1 4202496 83149 0 0 0 64474 46 0 0 25 0 4 0 634366481 490729472 81349 33554432000 4194304 4964800 140733728710352 18446744073709551615 4321082 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/19446/statm: 119807 81349 460 189 0 114156 0
[pid=19446/tid=19448] ppid=19444 vsize=479228 CPUtime=161.54 cores=0,2,4,6
/proc/19446/task/19448/stat : 19448 (claspmt) R 19444 19446 18548 0 -1 4202560 23529 0 0 0 16140 14 0 0 25 0 4 0 634366553 490729472 81349 33554432000 4194304 4964800 140733728710352 18446744073709551615 4321079 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=19446/tid=19449] ppid=19444 vsize=479228 CPUtime=161.57 cores=0,2,4,6
/proc/19446/task/19449/stat : 19449 (claspmt) R 19444 19446 18548 0 -1 4202560 25026 0 0 0 16145 12 0 0 25 0 4 0 634366553 490729472 81349 33554432000 4194304 4964800 140733728710352 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=19446/tid=19450] ppid=19444 vsize=479228 CPUtime=161.56 cores=0,2,4,6
/proc/19446/task/19450/stat : 19450 (claspmt) R 19444 19446 18548 0 -1 4202560 13987 0 0 0 16149 7 0 0 25 0 4 0 634366553 490729472 81349 33554432000 4194304 4964800 140733728710352 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 645.2
Current children cumulated vsize (KiB) 479228

[startup+222.301 s]
/proc/loadavg: 8.07 8.07 7.81 9/362 19455
/proc/meminfo: memFree=23070988/32951124 swapFree=65980216/67111528
[pid=19446] ppid=19444 vsize=484672 CPUtime=884.49 cores=0,2,4,6
/proc/19446/stat : 19446 (claspmt) R 19444 19446 18548 0 -1 4202496 88692 0 0 0 88398 51 0 0 25 0 4 0 634366481 496304128 86892 33554432000 4194304 4964800 140733728710352 18446744073709551615 4627982 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/19446/statm: 121168 86892 460 189 0 115517 0
[pid=19446/tid=19448] ppid=19444 vsize=484672 CPUtime=221.55 cores=0,2,4,6
/proc/19446/task/19448/stat : 19448 (claspmt) R 19444 19446 18548 0 -1 4202560 24864 0 0 0 22140 15 0 0 25 0 4 0 634366553 496304128 86892 33554432000 4194304 4964800 140733728710352 18446744073709551615 4627299 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=19446/tid=19449] ppid=19444 vsize=484672 CPUtime=221.57 cores=0,2,4,6
/proc/19446/task/19449/stat : 19449 (claspmt) R 19444 19446 18548 0 -1 4202560 27243 0 0 0 22144 13 0 0 25 0 4 0 634366553 496304128 86892 33554432000 4194304 4964800 140733728710352 18446744073709551615 4321054 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=19446/tid=19450] ppid=19444 vsize=484672 CPUtime=221.57 cores=0,2,4,6
/proc/19446/task/19450/stat : 19450 (claspmt) R 19444 19446 18548 0 -1 4202560 14887 0 0 0 22148 9 0 0 25 0 4 0 634366553 496304128 86892 33554432000 4194304 4964800 140733728710352 18446744073709551615 4320951 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 884.49
Current children cumulated vsize (KiB) 484672

[startup+282.301 s]

################
# More data... #
################

Current children cumulated CPU time (s) 2559.69
Current children cumulated vsize (KiB) 703292

[startup+702.301 s]
/proc/loadavg: 8.17 8.12 7.92 10/362 19468
/proc/meminfo: memFree=22634384/32951124 swapFree=65980216/67111528
[pid=19446] ppid=19444 vsize=735824 CPUtime=2798.98 cores=0,2,4,6
/proc/19446/stat : 19446 (claspmt) R 19444 19446 18548 0 -1 4202496 151885 0 0 0 279785 113 0 0 25 0 4 0 634366481 753483776 148471 33554432000 4194304 4964800 140733728710352 18446744073709551615 4627204 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/19446/statm: 183956 148471 460 189 0 178305 0
[pid=19446/tid=19448] ppid=19444 vsize=735824 CPUtime=701.53 cores=0,2,4,6
/proc/19446/task/19448/stat : 19448 (claspmt) R 19444 19446 18548 0 -1 4202560 52847 0 0 0 70113 40 0 0 25 0 4 0 634366553 753483776 148471 33554432000 4194304 4964800 140733728710352 18446744073709551615 4670328 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=19446/tid=19449] ppid=19444 vsize=735824 CPUtime=701.58 cores=0,2,4,6
/proc/19446/task/19449/stat : 19449 (claspmt) R 19444 19446 18548 0 -1 4202560 45413 0 0 0 70129 29 0 0 25 0 4 0 634366553 753483776 148471 33554432000 4194304 4964800 140733728710352 18446744073709551615 228095556127 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=19446/tid=19450] ppid=19444 vsize=735824 CPUtime=701.58 cores=0,2,4,6
/proc/19446/task/19450/stat : 19450 (claspmt) R 19444 19446 18548 0 -1 4202560 23869 0 0 0 70138 20 0 0 25 0 4 0 634366553 753483776 148471 33554432000 4194304 4964800 140733728710352 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2798.98
Current children cumulated vsize (KiB) 735824

[startup+762.313 s]
/proc/loadavg: 8.16 8.12 7.93 9/362 19470
/proc/meminfo: memFree=22600904/32951124 swapFree=65980216/67111528
[pid=19446] ppid=19444 vsize=735824 CPUtime=3038.32 cores=0,2,4,6
/proc/19446/stat : 19446 (claspmt) R 19444 19446 18548 0 -1 4202496 152563 0 0 0 303718 114 0 0 25 0 4 0 634366481 753483776 149149 33554432000 4194304 4964800 140733728710352 18446744073709551615 4321102 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/19446/statm: 183956 149149 460 189 0 178305 0
[pid=19446/tid=19448] ppid=19444 vsize=735824 CPUtime=761.53 cores=0,2,4,6
/proc/19446/task/19448/stat : 19448 (claspmt) R 19444 19446 18548 0 -1 4202560 53513 0 0 0 76113 40 0 0 25 0 4 0 634366553 753483776 149149 33554432000 4194304 4964800 140733728710352 18446744073709551615 4670538 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=19446/tid=19449] ppid=19444 vsize=735824 CPUtime=761.59 cores=0,2,4,6
/proc/19446/task/19449/stat : 19449 (claspmt) R 19444 19446 18548 0 -1 4202560 45423 0 0 0 76130 29 0 0 25 0 4 0 634366553 753483776 149149 33554432000 4194304 4964800 140733728710352 18446744073709551615 4627204 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=19446/tid=19450] ppid=19444 vsize=735824 CPUtime=761.59 cores=0,2,4,6
/proc/19446/task/19450/stat : 19450 (claspmt) R 19444 19446 18548 0 -1 4202560 23869 0 0 0 76139 20 0 0 25 0 4 0 634366553 753483776 149149 33554432000 4194304 4964800 140733728710352 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3038.32
Current children cumulated vsize (KiB) 735824

[startup+822.3 s]
/proc/loadavg: 6.69 7.78 7.82 5/353 19489
/proc/meminfo: memFree=23538676/32951124 swapFree=65980216/67111528
[pid=19446] ppid=19444 vsize=736648 CPUtime=3277.6 cores=0,2,4,6
/proc/19446/stat : 19446 (claspmt) R 19444 19446 18548 0 -1 4202496 158531 0 0 0 327638 122 0 0 25 0 4 0 634366481 754327552 155117 33554432000 4194304 4964800 140733728710352 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/19446/statm: 184162 155117 460 189 0 178511 0
[pid=19446/tid=19448] ppid=19444 vsize=736648 CPUtime=821.52 cores=0,2,4,6
/proc/19446/task/19448/stat : 19448 (claspmt) R 19444 19446 18548 0 -1 4202560 53520 0 0 0 82112 40 0 0 25 0 4 0 634366553 754327552 155117 33554432000 4194304 4964800 140733728710352 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=19446/tid=19449] ppid=19444 vsize=736648 CPUtime=821.58 cores=0,2,4,6
/proc/19446/task/19449/stat : 19449 (claspmt) R 19444 19446 18548 0 -1 4202560 48523 0 0 0 82125 33 0 0 25 0 4 0 634366553 754327552 155117 33554432000 4194304 4964800 140733728710352 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=19446/tid=19450] ppid=19444 vsize=736648 CPUtime=821.57 cores=0,2,4,6
/proc/19446/task/19450/stat : 19450 (claspmt) R 19444 19446 18548 0 -1 4202560 23871 0 0 0 82137 20 0 0 25 0 4 0 634366553 754327552 155117 33554432000 4194304 4964800 140733728710352 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3277.6
Current children cumulated vsize (KiB) 736648

[startup+882.3 s]
/proc/loadavg: 5.03 7.10 7.59 5/353 19491
/proc/meminfo: memFree=23525628/32951124 swapFree=65980216/67111528
[pid=19446] ppid=19444 vsize=749828 CPUtime=3516.94 cores=0,2,4,6
/proc/19446/stat : 19446 (claspmt) R 19444 19446 18548 0 -1 4202496 161826 0 0 0 351571 123 0 0 25 0 4 0 634366481 767823872 158412 33554432000 4194304 4964800 140733728710352 18446744073709551615 4627338 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/19446/statm: 187457 158412 460 189 0 181806 0
[pid=19446/tid=19448] ppid=19444 vsize=749828 CPUtime=881.52 cores=0,2,4,6
/proc/19446/task/19448/stat : 19448 (claspmt) R 19444 19446 18548 0 -1 4202560 56580 0 0 0 88111 41 0 0 25 0 4 0 634366553 767823872 158412 33554432000 4194304 4964800 140733728710352 18446744073709551615 4627259 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=19446/tid=19449] ppid=19444 vsize=749828 CPUtime=881.58 cores=0,2,4,6
/proc/19446/task/19449/stat : 19449 (claspmt) R 19444 19446 18548 0 -1 4202560 48757 0 0 0 88125 33 0 0 25 0 4 0 634366553 767823872 158413 33554432000 4194304 4964800 140733728710352 18446744073709551615 4631209 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=19446/tid=19450] ppid=19444 vsize=749828 CPUtime=881.57 cores=0,2,4,6
/proc/19446/task/19450/stat : 19450 (claspmt) R 19444 19446 18548 0 -1 4202560 23871 0 0 0 88137 20 0 0 25 0 4 0 634366553 767823872 158413 33554432000 4194304 4964800 140733728710352 18446744073709551615 4321029 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3516.94
Current children cumulated vsize (KiB) 749828

[startup+942.3 s]
/proc/loadavg: 4.38 6.54 7.36 5/353 19493
/proc/meminfo: memFree=23511956/32951124 swapFree=65980216/67111528
[pid=19446] ppid=19444 vsize=754572 CPUtime=3756.27 cores=0,2,4,6
/proc/19446/stat : 19446 (claspmt) R 19444 19446 18548 0 -1 4202496 165267 0 0 0 375491 136 0 0 25 0 4 0 634366481 772681728 161853 33554432000 4194304 4964800 140733728710352 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/19446/statm: 188643 161853 460 189 0 182992 0
[pid=19446/tid=19448] ppid=19444 vsize=754572 CPUtime=941.51 cores=0,2,4,6
/proc/19446/task/19448/stat : 19448 (claspmt) R 19444 19446 18548 0 -1 4202560 57773 0 0 0 94109 42 0 0 25 0 4 0 634366553 772681728 161853 33554432000 4194304 4964800 140733728710352 18446744073709551615 4320944 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=19446/tid=19449] ppid=19444 vsize=754572 CPUtime=941.57 cores=0,2,4,6
/proc/19446/task/19449/stat : 19449 (claspmt) R 19444 19446 18548 0 -1 4202560 49808 0 0 0 94119 38 0 0 25 0 4 0 634366553 772681728 161853 33554432000 4194304 4964800 140733728710352 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=19446/tid=19450] ppid=19444 vsize=754572 CPUtime=941.58 cores=0,2,4,6
/proc/19446/task/19450/stat : 19450 (claspmt) R 19444 19446 18548 0 -1 4202560 23919 0 0 0 94137 21 0 0 25 0 4 0 634366553 772681728 161853 33554432000 4194304 4964800 140733728710352 18446744073709551615 4670273 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3756.27
Current children cumulated vsize (KiB) 754572

[startup+1002.3 s]
/proc/loadavg: 4.14 6.07 7.15 5/353 19494
/proc/meminfo: memFree=23504112/32951124 swapFree=65980216/67111528
[pid=19446] ppid=19444 vsize=820108 CPUtime=3995.63 cores=0,2,4,6
/proc/19446/stat : 19446 (claspmt) R 19444 19446 18548 0 -1 4202496 167279 0 0 0 399415 148 0 0 25 0 4 0 634366481 839790592 163865 33554432000 4194304 4964800 140733728710352 18446744073709551615 4670357 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/19446/statm: 205027 163865 460 189 0 199376 0
[pid=19446/tid=19448] ppid=19444 vsize=820108 CPUtime=1001.51 cores=0,2,4,6
/proc/19446/task/19448/stat : 19448 (claspmt) R 19444 19446 18548 0 -1 4202560 57845 0 0 0 100109 42 0 0 25 0 4 0 634366553 839790592 163865 33554432000 4194304 4964800 140733728710352 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=19446/tid=19449] ppid=19444 vsize=820108 CPUtime=1001.57 cores=0,2,4,6
/proc/19446/task/19449/stat : 19449 (claspmt) R 19444 19446 18548 0 -1 4202560 51748 0 0 0 100108 49 0 0 25 0 4 0 634366553 839790592 163865 33554432000 4194304 4964800 140733728710352 18446744073709551615 4670335 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=19446/tid=19450] ppid=19444 vsize=820108 CPUtime=1001.59 cores=0,2,4,6
/proc/19446/task/19450/stat : 19450 (claspmt) R 19444 19446 18548 0 -1 4202560 23919 0 0 0 100138 21 0 0 25 0 4 0 634366553 839790592 163865 33554432000 4194304 4964800 140733728710352 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3995.63
Current children cumulated vsize (KiB) 820108

[startup+1062.3 s]
/proc/loadavg: 4.05 5.69 6.95 5/353 19496
/proc/meminfo: memFree=23489080/32951124 swapFree=65980216/67111528
[pid=19446] ppid=19444 vsize=820108 CPUtime=4234.98 cores=0,2,4,6
/proc/19446/stat : 19446 (claspmt) R 19444 19446 18548 0 -1 4202496 171113 0 0 0 423343 155 0 0 25 0 4 0 634366481 839790592 167699 33554432000 4194304 4964800 140733728710352 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/19446/statm: 205027 167699 460 189 0 199376 0
[pid=19446/tid=19448] ppid=19444 vsize=820108 CPUtime=1061.51 cores=0,2,4,6
/proc/19446/task/19448/stat : 19448 (claspmt) R 19444 19446 18548 0 -1 4202560 57989 0 0 0 106109 42 0 0 25 0 4 0 634366553 839790592 167699 33554432000 4194304 4964800 140733728710352 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=19446/tid=19449] ppid=19444 vsize=820108 CPUtime=1061.57 cores=0,2,4,6
/proc/19446/task/19449/stat : 19449 (claspmt) R 19444 19446 18548 0 -1 4202560 51832 0 0 0 106107 50 0 0 25 0 4 0 634366553 839790592 167699 33554432000 4194304 4964800 140733728710352 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=19446/tid=19450] ppid=19444 vsize=820108 CPUtime=1061.58 cores=0,2,4,6
/proc/19446/task/19450/stat : 19450 (claspmt) R 19444 19446 18548 0 -1 4202560 27522 0 0 0 106131 27 0 0 25 0 4 0 634366553 839790592 167699 33554432000 4194304 4964800 140733728710352 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4234.98
Current children cumulated vsize (KiB) 820108

[startup+1122.3 s]
/proc/loadavg: 4.02 5.38 6.76 5/353 19497
/proc/meminfo: memFree=23435476/32951124 swapFree=65980216/67111528
[pid=19446] ppid=19444 vsize=820108 CPUtime=4474.32 cores=0,2,4,6
/proc/19446/stat : 19446 (claspmt) R 19444 19446 18548 0 -1 4202496 184541 0 0 0 447228 204 0 0 25 0 4 0 634366481 839790592 181127 33554432000 4194304 4964800 140733728710352 18446744073709551615 4670343 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/19446/statm: 205027 181127 460 189 0 199376 0
[pid=19446/tid=19448] ppid=19444 vsize=820108 CPUtime=1121.51 cores=0,2,4,6
/proc/19446/task/19448/stat : 19448 (claspmt) R 19444 19446 18548 0 -1 4202560 63942 0 0 0 112079 72 0 0 25 0 4 0 634366553 839790592 181127 33554432000 4194304 4964800 140733728710352 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=19446/tid=19449] ppid=19444 vsize=820108 CPUtime=1121.58 cores=0,2,4,6
/proc/19446/task/19449/stat : 19449 (claspmt) R 19444 19446 18548 0 -1 4202560 56094 0 0 0 112093 65 0 0 25 0 4 0 634366553 839790592 181127 33554432000 4194304 4964800 140733728710352 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=19446/tid=19450] ppid=19444 vsize=820108 CPUtime=1121.58 cores=0,2,4,6
/proc/19446/task/19450/stat : 19450 (claspmt) R 19444 19446 18548 0 -1 4202560 30693 0 0 0 112128 30 0 0 25 0 4 0 634366553 839790592 181127 33554432000 4194304 4964800 140733728710352 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4474.32
Current children cumulated vsize (KiB) 820108

[startup+1182.3 s]
/proc/loadavg: 4.00 5.13 6.58 5/353 19499
/proc/meminfo: memFree=23419076/32951124 swapFree=65980216/67111528
[pid=19446] ppid=19444 vsize=820108 CPUtime=4713.65 cores=0,2,4,6
/proc/19446/stat : 19446 (claspmt) R 19444 19446 18548 0 -1 4202496 188656 0 0 0 471147 218 0 0 25 0 4 0 634366481 839790592 184904 33554432000 4194304 4964800 140733728710352 18446744073709551615 4670403 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/19446/statm: 205027 184904 460 189 0 199376 0
[pid=19446/tid=19448] ppid=19444 vsize=820108 CPUtime=1181.48 cores=0,2,4,6
/proc/19446/task/19448/stat : 19448 (claspmt) R 19444 19446 18548 0 -1 4202560 64342 0 0 0 118076 72 0 0 25 0 4 0 634366553 839790592 184904 33554432000 4194304 4964800 140733728710352 18446744073709551615 4670328 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=19446/tid=19449] ppid=19444 vsize=820108 CPUtime=1181.58 cores=0,2,4,6
/proc/19446/task/19449/stat : 19449 (claspmt) R 19444 19446 18548 0 -1 4202560 59320 0 0 0 118080 78 0 0 25 0 4 0 634366553 839790592 184904 33554432000 4194304 4964800 140733728710352 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=19446/tid=19450] ppid=19444 vsize=820108 CPUtime=1181.58 cores=0,2,4,6
/proc/19446/task/19450/stat : 19450 (claspmt) R 19444 19446 18548 0 -1 4202560 31175 0 0 0 118127 31 0 0 25 0 4 0 634366553 839790592 184904 33554432000 4194304 4964800 140733728710352 18446744073709551615 4361293 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4713.65
Current children cumulated vsize (KiB) 820108



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1204 s]
/proc/loadavg: 4.00 5.04 6.51 5/353 19500
/proc/meminfo: memFree=23419064/32951124 swapFree=65980216/67111528
[pid=19446] ppid=19444 vsize=820108 CPUtime=4800.23 cores=0,2,4,6
/proc/19446/stat : 19446 (claspmt) R 19444 19446 18548 0 -1 4202496 188658 0 0 0 479805 218 0 0 25 0 4 0 634366481 839790592 184906 33554432000 4194304 4964800 140733728710352 18446744073709551615 4321097 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/19446/statm: 205027 184906 460 189 0 199376 0
[pid=19446/tid=19448] ppid=19444 vsize=820108 CPUtime=1203.19 cores=0,2,4,6
/proc/19446/task/19448/stat : 19448 (claspmt) R 19444 19446 18548 0 -1 4202560 64343 0 0 0 120247 72 0 0 25 0 4 0 634366553 839790592 184906 33554432000 4194304 4964800 140733728710352 18446744073709551615 4670321 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=19446/tid=19449] ppid=19444 vsize=820108 CPUtime=1203.29 cores=0,2,4,6
/proc/19446/task/19449/stat : 19449 (claspmt) R 19444 19446 18548 0 -1 4202560 59320 0 0 0 120251 78 0 0 25 0 4 0 634366553 839790592 184906 33554432000 4194304 4964800 140733728710352 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=19446/tid=19450] ppid=19444 vsize=820108 CPUtime=1203.3 cores=0,2,4,6
/proc/19446/task/19450/stat : 19450 (claspmt) R 19444 19446 18548 0 -1 4202560 31176 0 0 0 120299 31 0 0 25 0 4 0 634366553 839790592 184906 33554432000 4194304 4964800 140733728710352 18446744073709551615 4320951 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4800.23
Current children cumulated vsize (KiB) 820108

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1204.12 s]
/proc/loadavg: 4.00 5.04 6.51 5/353 19500
/proc/meminfo: memFree=23419064/32951124 swapFree=65980216/67111528
[pid=19446] ppid=19444 vsize=814408 CPUtime=4800.37 cores=0,2,4,6
/proc/19446/stat : 19446 (claspmt) R 19444 19446 18548 0 -1 4202496 188668 0 0 0 479819 218 0 0 25 0 1 0 634366481 833953792 181564 33554432000 4194304 4964800 140733728710352 18446744073709551615 228095107633 0 0 4096 18946 0 0 0 17 6 0 0 0
/proc/19446/statm: 203602 181564 470 189 0 197951 0
Current children cumulated CPU time (s) 4800.37
Current children cumulated vsize (KiB) 814408

Child status: 0
Real time (s): 1204.17
CPU time (s): 4800.43
CPU user time (s): 4798.21
CPU system time (s): 2.21766
CPU usage (%): 398.649
Max. virtual memory (cumulated for all children) (KiB): 820108

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4798.21
system time used= 2.21766
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 188670
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 5792
involuntary context switches= 19788

runsolver used 4.17136 second user time and 9.42857 second system time

The end

Launcher Data 

Begin job on node142 at 2011-05-15 02:31:50
IDJOB=3373258
IDBENCH=71409
IDSOLVER=1853
FILE ID=node142/3373258-1305419510
RUNJOBID= node142-1305418255-19191
PBS_JOBID= 13324550
Free space on /tmp= 73440 MiB

SOLVER NAME= claspmt 2.0-R4095-patched (fixed)
BENCH NAME= SAT09/CRAFTED/rbsat/random/forced/rbsat-v1820c171155gyes3.cnf
COMMAND LINE= HOME/claspmt -tNBCORE -p HOME/sat11-port.txt --distribute=all,2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3373258-1305419510/watcher-3373258-1305419510 -o /tmp/evaluation-result-3373258-1305419510/solver-3373258-1305419510 -C 4800 -W 1300 -M 15500  HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3373258-1305419510.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= cd19d9eb9be97e183fa1a1d47d679d01
RANDOM SEED=240231967

node142.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5131.95
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.81
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      23649240 kB
Buffers:        321948 kB
Cached:        3929448 kB
SwapCached:      11520 kB
Active:        6556736 kB
Inactive:      2413488 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      23649240 kB
SwapTotal:    67111528 kB
SwapFree:     65980216 kB
Dirty:            3140 kB
Writeback:          28 kB
AnonPages:     4715700 kB
Mapped:          21084 kB
Slab:           234252 kB
PageTables:      32968 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 77561632 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73440 MiB
End job on node142 at 2011-05-15 02:51:56