Trace number 3373556

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
claspmt 2.0-R4095-patched (fixed)? (TO) 4800.33 1203.35

General information on the benchmark

Nameapplication/fuhs/slp-synthesis-AES/
slp-synthesis-aes-bottom20.cnf
MD5SUM9851f8e63efc4505343bf50c1cf30646
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables44362
Number of clauses148436
Sum of the clauses size378642
Maximum clause length1419
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 276003
Number of clauses of size 371663
Number of clauses of size 4209
Number of clauses of size 518
Number of clauses of size over 5542

Solver Data 

0.00/0.00	c clasp version 2.0.0-RC2
0.00/0.00	c Reading from ...422115/instance-3373556-1305422115.cnf
0.39/0.40	c Solving...
4800.15/1203.21	
4800.15/1203.21	*** INTERRUPTED! ***
4800.15/1203.21	*** Shutting down threads...
4800.29/1203.35	s UNKNOWN
4800.29/1203.35	
4800.29/1203.35	c INTERRUPTED   : 1
4800.29/1203.35	c Models        : 0+    
4800.29/1203.35	c Time          : 1203.214s (Solving: 1202.82s 1st Model: 0.00s Unsat: 0.00s)
4800.29/1203.35	c CPU Time      : 4800.180s

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3373556-1305422115/watcher-3373556-1305422115 -o /tmp/evaluation-result-3373556-1305422115/solver-3373556-1305422115 -C 4800 -W 1300 -M 15500 HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3373556-1305422115.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.17 8.14 8.13 6/304 18792
/proc/meminfo: memFree=11468008/32951124 swapFree=66050672/67111528
[pid=18792] ppid=18790 vsize=29176 CPUtime=0 cores=0,2,4,6
/proc/18792/stat : 18792 (claspmt) R 18790 18792 18486 0 -1 4202496 2611 0 0 0 0 0 0 0 25 0 1 0 653809350 29876224 2317 33554432000 4194304 4964800 140735337961184 18446744073709551615 4679094 0 0 4096 18946 0 0 0 17 2 0 0 0
/proc/18792/statm: 7294 2322 376 189 0 2168 0

[startup+0.076936 s]
/proc/loadavg: 8.17 8.14 8.13 6/304 18792
/proc/meminfo: memFree=11468008/32951124 swapFree=66050672/67111528
[pid=18792] ppid=18790 vsize=42492 CPUtime=0.06 cores=0,2,4,6
/proc/18792/stat : 18792 (claspmt) R 18790 18792 18486 0 -1 4202496 7192 0 0 0 6 0 0 0 25 0 1 0 653809350 43511808 5600 33554432000 4194304 4964800 140735337961184 18446744073709551615 4617330 0 0 4096 18946 0 0 0 17 2 0 0 0
/proc/18792/statm: 10623 5600 398 189 0 5497 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 42492

[startup+0.100935 s]
/proc/loadavg: 8.17 8.14 8.13 6/304 18792
/proc/meminfo: memFree=11468008/32951124 swapFree=66050672/67111528
[pid=18792] ppid=18790 vsize=44316 CPUtime=0.09 cores=0,2,4,6
/proc/18792/stat : 18792 (claspmt) R 18790 18792 18486 0 -1 4202496 7611 0 0 0 9 0 0 0 25 0 1 0 653809350 45379584 6019 33554432000 4194304 4964800 140735337961184 18446744073709551615 4607616 0 0 4096 18946 0 0 0 17 2 0 0 0
/proc/18792/statm: 11079 6019 402 189 0 5953 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 44316

[startup+0.300863 s]
/proc/loadavg: 8.17 8.14 8.13 6/304 18792
/proc/meminfo: memFree=11468008/32951124 swapFree=66050672/67111528
[pid=18792] ppid=18790 vsize=49200 CPUtime=0.29 cores=0,2,4,6
/proc/18792/stat : 18792 (claspmt) R 18790 18792 18486 0 -1 4202496 8833 0 0 0 28 1 0 0 25 0 1 0 653809350 50380800 7241 33554432000 4194304 4964800 140735337961184 18446744073709551615 4601734 0 0 4096 18946 0 0 0 17 2 0 0 0
/proc/18792/statm: 12300 7241 403 189 0 7174 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 49200

[startup+0.700752 s]
/proc/loadavg: 8.17 8.14 8.13 6/304 18792
/proc/meminfo: memFree=11468008/32951124 swapFree=66050672/67111528
[pid=18792] ppid=18790 vsize=203468 CPUtime=1.55 cores=0,2,4,6
/proc/18792/stat : 18792 (claspmt) R 18790 18792 18486 0 -1 4202496 14967 0 0 0 153 2 0 0 25 0 4 0 653809350 208351232 11622 33554432000 4194304 4964800 140735337961184 18446744073709551615 4660444 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/18792/statm: 50867 11622 458 189 0 45216 0
Current children cumulated CPU time (s) 1.55
Current children cumulated vsize (KiB) 203468

[startup+1.5006 s]
/proc/loadavg: 8.17 8.14 8.13 11/308 18796
/proc/meminfo: memFree=11420364/32951124 swapFree=66050672/67111528
[pid=18792] ppid=18790 vsize=203600 CPUtime=4.74 cores=0,2,4,6
/proc/18792/stat : 18792 (claspmt) R 18790 18792 18486 0 -1 4202496 16211 0 0 0 471 3 0 0 25 0 4 0 653809350 208486400 12866 33554432000 4194304 4964800 140735337961184 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/18792/statm: 50900 12866 458 189 0 45249 0
[pid=18792/tid=18794] ppid=18790 vsize=203600 CPUtime=1.08 cores=0,2,4,6
/proc/18792/task/18794/stat : 18794 (claspmt) R 18790 18792 18486 0 -1 4202560 1879 0 0 0 108 0 0 0 19 0 4 0 653809391 208486400 12866 33554432000 4194304 4964800 140735337961184 18446744073709551615 4668753 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=18792/tid=18795] ppid=18790 vsize=203600 CPUtime=1.08 cores=0,2,4,6
/proc/18792/task/18795/stat : 18795 (claspmt) R 18790 18792 18486 0 -1 4202560 2709 0 0 0 108 0 0 0 19 0 4 0 653809391 208486400 12866 33554432000 4194304 4964800 140735337961184 18446744073709551615 4363605 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=18792/tid=18796] ppid=18790 vsize=203600 CPUtime=1.08 cores=0,2,4,6
/proc/18792/task/18796/stat : 18796 (claspmt) R 18790 18792 18486 0 -1 4202560 2131 0 0 0 108 0 0 0 19 0 4 0 653809391 208486400 12866 33554432000 4194304 4964800 140735337961184 18446744073709551615 4668987 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4.74
Current children cumulated vsize (KiB) 203600

[startup+3.1003 s]
/proc/loadavg: 8.16 8.14 8.12 9/308 18796
/proc/meminfo: memFree=11412056/32951124 swapFree=66050672/67111528
[pid=18792] ppid=18790 vsize=207256 CPUtime=11.13 cores=0,2,4,6
/proc/18792/stat : 18792 (claspmt) R 18790 18792 18486 0 -1 4202496 18991 0 0 0 1109 4 0 0 25 0 4 0 653809350 212230144 15646 33554432000 4194304 4964800 140735337961184 18446744073709551615 4668712 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/18792/statm: 51814 15646 458 189 0 46163 0
[pid=18792/tid=18794] ppid=18790 vsize=207256 CPUtime=2.68 cores=0,2,4,6
/proc/18792/task/18794/stat : 18794 (claspmt) R 18790 18792 18486 0 -1 4202560 2373 0 0 0 267 1 0 0 22 0 4 0 653809391 212230144 15646 33554432000 4194304 4964800 140735337961184 18446744073709551615 4670180 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=18792/tid=18795] ppid=18790 vsize=207256 CPUtime=2.68 cores=0,2,4,6
/proc/18792/task/18795/stat : 18795 (claspmt) R 18790 18792 18486 0 -1 4202560 3797 0 0 0 268 0 0 0 23 0 4 0 653809391 212230144 15646 33554432000 4194304 4964800 140735337961184 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=18792/tid=18796] ppid=18790 vsize=207256 CPUtime=2.68 cores=0,2,4,6
/proc/18792/task/18796/stat : 18796 (claspmt) R 18790 18792 18486 0 -1 4202560 2761 0 0 0 268 0 0 0 23 0 4 0 653809391 212230144 15646 33554432000 4194304 4964800 140735337961184 18446744073709551615 4669140 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 11.13
Current children cumulated vsize (KiB) 207256

[startup+6.30071 s]
/proc/loadavg: 8.16 8.14 8.12 9/308 18796
/proc/meminfo: memFree=11391220/32951124 swapFree=66050672/67111528
[pid=18792] ppid=18790 vsize=210828 CPUtime=23.9 cores=0,2,4,6
/proc/18792/stat : 18792 (claspmt) R 18790 18792 18486 0 -1 4202496 21952 0 0 0 2384 6 0 0 25 0 4 0 653809350 215887872 18607 33554432000 4194304 4964800 140735337961184 18446744073709551615 4653547 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/18792/statm: 52707 18607 458 189 0 47056 0
[pid=18792/tid=18794] ppid=18790 vsize=210828 CPUtime=5.88 cores=0,2,4,6
/proc/18792/task/18794/stat : 18794 (claspmt) R 18790 18792 18486 0 -1 4202560 2862 0 0 0 587 1 0 0 25 0 4 0 653809391 215887872 18607 33554432000 4194304 4964800 140735337961184 18446744073709551615 4320951 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=18792/tid=18795] ppid=18790 vsize=210828 CPUtime=5.88 cores=0,2,4,6
/proc/18792/task/18795/stat : 18795 (claspmt) R 18790 18792 18486 0 -1 4202560 4955 0 0 0 587 1 0 0 25 0 4 0 653809391 215887872 18607 33554432000 4194304 4964800 140735337961184 18446744073709551615 4668794 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=18792/tid=18796] ppid=18790 vsize=210828 CPUtime=5.89 cores=0,2,4,6
/proc/18792/task/18796/stat : 18796 (claspmt) R 18790 18792 18486 0 -1 4202560 3419 0 0 0 588 1 0 0 25 0 4 0 653809391 215887872 18607 33554432000 4194304 4964800 140735337961184 18446744073709551615 4653584 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 23.9
Current children cumulated vsize (KiB) 210828

[startup+12.7005 s]
/proc/loadavg: 8.13 8.13 8.12 9/308 18796
/proc/meminfo: memFree=11366872/32951124 swapFree=66050672/67111528
[pid=18792] ppid=18790 vsize=216864 CPUtime=49.43 cores=0,2,4,6
/proc/18792/stat : 18792 (claspmt) R 18790 18792 18486 0 -1 4202496 24993 0 0 0 4936 7 0 0 25 0 4 0 653809350 222068736 21648 33554432000 4194304 4964800 140735337961184 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/18792/statm: 54216 21648 460 189 0 48565 0
[pid=18792/tid=18794] ppid=18790 vsize=216864 CPUtime=12.28 cores=0,2,4,6
/proc/18792/task/18794/stat : 18794 (claspmt) R 18790 18792 18486 0 -1 4202560 3408 0 0 0 1227 1 0 0 25 0 4 0 653809391 222068736 21648 33554432000 4194304 4964800 140735337961184 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=18792/tid=18795] ppid=18790 vsize=216864 CPUtime=12.29 cores=0,2,4,6
/proc/18792/task/18795/stat : 18795 (claspmt) R 18790 18792 18486 0 -1 4202560 6134 0 0 0 1227 2 0 0 25 0 4 0 653809391 222068736 21648 33554432000 4194304 4964800 140735337961184 18446744073709551615 4669350 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=18792/tid=18796] ppid=18790 vsize=216864 CPUtime=12.29 cores=0,2,4,6
/proc/18792/task/18796/stat : 18796 (claspmt) R 18790 18792 18486 0 -1 4202560 4145 0 0 0 1228 1 0 0 25 0 4 0 653809391 222068736 21648 33554432000 4194304 4964800 140735337961184 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 49.43
Current children cumulated vsize (KiB) 216864

[startup+25.5012 s]
/proc/loadavg: 8.11 8.13 8.12 9/308 18796
/proc/meminfo: memFree=11320744/32951124 swapFree=66050672/67111528
[pid=18792] ppid=18790 vsize=230924 CPUtime=100.52 cores=0,2,4,6
/proc/18792/stat : 18792 (claspmt) R 18790 18792 18486 0 -1 4202496 35251 0 0 0 10040 12 0 0 25 0 4 0 653809350 236466176 31906 33554432000 4194304 4964800 140735337961184 18446744073709551615 4370310 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/18792/statm: 57731 31906 460 189 0 52080 0
[pid=18792/tid=18794] ppid=18790 vsize=230924 CPUtime=25.08 cores=0,2,4,6
/proc/18792/task/18794/stat : 18794 (claspmt) R 18790 18792 18486 0 -1 4202560 5329 0 0 0 2506 2 0 0 25 0 4 0 653809391 236466176 31906 33554432000 4194304 4964800 140735337961184 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=18792/tid=18795] ppid=18790 vsize=230924 CPUtime=25.08 cores=0,2,4,6
/proc/18792/task/18795/stat : 18795 (claspmt) R 18790 18792 18486 0 -1 4202560 9700 0 0 0 2505 3 0 0 25 0 4 0 653809391 236466176 31906 33554432000 4194304 4964800 140735337961184 18446744073709551615 4668698 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=18792/tid=18796] ppid=18790 vsize=230924 CPUtime=25.08 cores=0,2,4,6
/proc/18792/task/18796/stat : 18796 (claspmt) R 18790 18792 18486 0 -1 4202560 6448 0 0 0 2507 1 0 0 25 0 4 0 653809391 236466176 31906 33554432000 4194304 4964800 140735337961184 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 100.52
Current children cumulated vsize (KiB) 230924

[startup+51.1004 s]
/proc/loadavg: 8.14 8.13 8.12 9/308 18797
/proc/meminfo: memFree=11263392/32951124 swapFree=66050672/67111528
[pid=18792] ppid=18790 vsize=243120 CPUtime=202.67 cores=0,2,4,6
/proc/18792/stat : 18792 (claspmt) R 18790 18792 18486 0 -1 4202496 43071 0 0 0 20251 16 0 0 25 0 4 0 653809350 248954880 39726 33554432000 4194304 4964800 140735337961184 18446744073709551615 4320951 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/18792/statm: 60780 39726 460 189 0 55129 0
[pid=18792/tid=18794] ppid=18790 vsize=243120 CPUtime=50.67 cores=0,2,4,6
/proc/18792/task/18794/stat : 18794 (claspmt) R 18790 18792 18486 0 -1 4202560 6814 0 0 0 5065 2 0 0 25 0 4 0 653809391 248954880 39726 33554432000 4194304 4964800 140735337961184 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=18792/tid=18795] ppid=18790 vsize=243120 CPUtime=50.68 cores=0,2,4,6
/proc/18792/task/18795/stat : 18795 (claspmt) R 18790 18792 18486 0 -1 4202560 12132 0 0 0 5064 4 0 0 25 0 4 0 653809391 248954880 39726 33554432000 4194304 4964800 140735337961184 18446744073709551615 4670273 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=18792/tid=18796] ppid=18790 vsize=243120 CPUtime=50.68 cores=0,2,4,6
/proc/18792/task/18796/stat : 18796 (claspmt) R 18790 18792 18486 0 -1 4202560 8456 0 0 0 5065 3 0 0 25 0 4 0 653809391 248954880 39726 33554432000 4194304 4964800 140735337961184 18446744073709551615 4660835 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 202.67
Current children cumulated vsize (KiB) 243120

[startup+102.311 s]
/proc/loadavg: 8.24 8.16 8.13 10/308 18799
/proc/meminfo: memFree=11161836/32951124 swapFree=66050672/67111528
[pid=18792] ppid=18790 vsize=329312 CPUtime=407.02 cores=0,2,4,6
/proc/18792/stat : 18792 (claspmt) R 18790 18792 18486 0 -1 4202496 59396 0 0 0 40674 28 0 0 25 0 4 0 653809350 337215488 56035 33554432000 4194304 4964800 140735337961184 18446744073709551615 4321102 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/18792/statm: 82328 56035 460 189 0 76677 0
[pid=18792/tid=18794] ppid=18790 vsize=329312 CPUtime=101.87 cores=0,2,4,6
/proc/18792/task/18794/stat : 18794 (claspmt) R 18790 18792 18486 0 -1 4202560 10156 0 0 0 10182 5 0 0 25 0 4 0 653809391 337215488 56035 33554432000 4194304 4964800 140735337961184 18446744073709551615 4670328 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=18792/tid=18795] ppid=18790 vsize=329312 CPUtime=101.89 cores=0,2,4,6
/proc/18792/task/18795/stat : 18795 (claspmt) R 18790 18792 18486 0 -1 4202560 17911 0 0 0 10180 9 0 0 25 0 4 0 653809391 337215488 56035 33554432000 4194304 4964800 140735337961184 18446744073709551615 4660419 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=18792/tid=18796] ppid=18790 vsize=329312 CPUtime=101.89 cores=0,2,4,6
/proc/18792/task/18796/stat : 18796 (claspmt) R 18790 18792 18486 0 -1 4202560 11787 0 0 0 10184 5 0 0 25 0 4 0 653809391 337215488 56035 33554432000 4194304 4964800 140735337961184 18446744073709551615 4668568 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 407.02
Current children cumulated vsize (KiB) 329312

[startup+162.301 s]
/proc/loadavg: 8.28 8.17 8.13 9/308 18800
/proc/meminfo: memFree=11020728/32951124 swapFree=66050672/67111528
[pid=18792] ppid=18790 vsize=418192 CPUtime=646.41 cores=0,2,4,6
/proc/18792/stat : 18792 (claspmt) R 18790 18792 18486 0 -1 4202496 75756 0 0 0 64600 41 0 0 25 0 4 0 653809350 428228608 72349 33554432000 4194304 4964800 140735337961184 18446744073709551615 4321102 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/18792/statm: 104548 72349 460 189 0 98897 0
[pid=18792/tid=18794] ppid=18790 vsize=418192 CPUtime=161.86 cores=0,2,4,6
/proc/18792/task/18794/stat : 18794 (claspmt) R 18790 18792 18486 0 -1 4202560 14046 0 0 0 16177 9 0 0 25 0 4 0 653809391 428228608 72349 33554432000 4194304 4964800 140735337961184 18446744073709551615 4320928 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=18792/tid=18795] ppid=18790 vsize=418192 CPUtime=161.88 cores=0,2,4,6
/proc/18792/task/18795/stat : 18795 (claspmt) R 18790 18792 18486 0 -1 4202560 22311 0 0 0 16177 11 0 0 25 0 4 0 653809391 428228608 72349 33554432000 4194304 4964800 140735337961184 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=18792/tid=18796] ppid=18790 vsize=418192 CPUtime=161.87 cores=0,2,4,6
/proc/18792/task/18796/stat : 18796 (claspmt) R 18790 18792 18486 0 -1 4202560 14325 0 0 0 16181 6 0 0 25 0 4 0 653809391 428228608 72349 33554432000 4194304 4964800 140735337961184 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 646.41
Current children cumulated vsize (KiB) 418192

[startup+222.301 s]
/proc/loadavg: 8.20 8.17 8.13 9/308 18802
/proc/meminfo: memFree=10915816/32951124 swapFree=66050672/67111528
[pid=18792] ppid=18790 vsize=431512 CPUtime=885.84 cores=0,2,4,6
/proc/18792/stat : 18792 (claspmt) R 18790 18792 18486 0 -1 4202496 82908 0 0 0 88537 47 0 0 25 0 4 0 653809350 441868288 79463 33554432000 4194304 4964800 140735337961184 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/18792/statm: 107878 79463 460 189 0 102227 0
[pid=18792/tid=18794] ppid=18790 vsize=431512 CPUtime=221.85 cores=0,2,4,6
/proc/18792/task/18794/stat : 18794 (claspmt) R 18790 18792 18486 0 -1 4202560 14952 0 0 0 22175 10 0 0 25 0 4 0 653809391 441868288 79463 33554432000 4194304 4964800 140735337961184 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=18792/tid=18795] ppid=18790 vsize=431512 CPUtime=221.88 cores=0,2,4,6
/proc/18792/task/18795/stat : 18795 (claspmt) R 18790 18792 18486 0 -1 4202560 24089 0 0 0 22176 12 0 0 25 0 4 0 653809391 441868288 79463 33554432000 4194304 4964800 140735337961184 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=18792/tid=18796] ppid=18790 vsize=431512 CPUtime=221.88 cores=0,2,4,6
/proc/18792/task/18796/stat : 18796 (claspmt) R 18790 18792 18486 0 -1 4202560 15789 0 0 0 22181 7 0 0 25 0 4 0 653809391 441868288 79463 33554432000 4194304 4964800 140735337961184 18446744073709551615 4659391 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 885.84
Current children cumulated vsize (KiB) 431512

[startup+282.301 s]

################
# More data... #
################

Current children cumulated CPU time (s) 2561.89
Current children cumulated vsize (KiB) 665680

[startup+702.301 s]
/proc/loadavg: 8.15 8.18 8.13 9/308 18815
/proc/meminfo: memFree=10394688/32951124 swapFree=66050672/67111528
[pid=18792] ppid=18790 vsize=665680 CPUtime=2801.25 cores=0,2,4,6
/proc/18792/stat : 18792 (claspmt) R 18790 18792 18486 0 -1 4202496 141954 0 0 0 280013 112 0 0 25 0 4 0 653809350 681656320 138256 33554432000 4194304 4964800 140735337961184 18446744073709551615 4669280 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/18792/statm: 166420 138256 460 189 0 160769 0
[pid=18792/tid=18794] ppid=18790 vsize=665680 CPUtime=701.79 cores=0,2,4,6
/proc/18792/task/18794/stat : 18794 (claspmt) R 18790 18792 18486 0 -1 4202560 25538 0 0 0 70159 20 0 0 25 0 4 0 653809391 681656320 138256 33554432000 4194304 4964800 140735337961184 18446744073709551615 4670310 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=18792/tid=18795] ppid=18790 vsize=665680 CPUtime=701.75 cores=0,2,4,6
/proc/18792/task/18795/stat : 18795 (claspmt) R 18790 18792 18486 0 -1 4202560 41240 0 0 0 70148 27 0 0 25 0 4 0 653809391 681656320 138256 33554432000 4194304 4964800 140735337961184 18446744073709551615 4321079 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=18792/tid=18796] ppid=18790 vsize=665680 CPUtime=698.57 cores=0,2,4,6
/proc/18792/task/18796/stat : 18796 (claspmt) R 18790 18792 18486 0 -1 4202560 37852 0 0 0 69822 35 0 0 25 0 4 0 653809391 681656320 138256 33554432000 4194304 4964800 140735337961184 18446744073709551615 4670206 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 2801.25
Current children cumulated vsize (KiB) 665680

[startup+762.312 s]
/proc/loadavg: 8.22 8.19 8.14 9/308 18816
/proc/meminfo: memFree=10394312/32951124 swapFree=66050672/67111528
[pid=18792] ppid=18790 vsize=665680 CPUtime=3040.71 cores=0,2,4,6
/proc/18792/stat : 18792 (claspmt) R 18790 18792 18486 0 -1 4202496 142176 0 0 0 303959 112 0 0 25 0 4 0 653809350 681656320 138478 33554432000 4194304 4964800 140735337961184 18446744073709551615 4668789 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/18792/statm: 166420 138478 460 189 0 160769 0
[pid=18792/tid=18794] ppid=18790 vsize=665680 CPUtime=761.8 cores=0,2,4,6
/proc/18792/task/18794/stat : 18794 (claspmt) R 18790 18792 18486 0 -1 4202560 25571 0 0 0 76160 20 0 0 25 0 4 0 653809391 681656320 138478 33554432000 4194304 4964800 140735337961184 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=18792/tid=18795] ppid=18790 vsize=665680 CPUtime=761.17 cores=0,2,4,6
/proc/18792/task/18795/stat : 18795 (claspmt) R 18790 18792 18486 0 -1 4202560 41418 0 0 0 76090 27 0 0 25 0 4 0 653809391 681656320 138478 33554432000 4194304 4964800 140735337961184 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=18792/tid=18796] ppid=18790 vsize=665680 CPUtime=758.58 cores=0,2,4,6
/proc/18792/task/18796/stat : 18796 (claspmt) R 18790 18792 18486 0 -1 4202560 37860 0 0 0 75823 35 0 0 25 0 4 0 653809391 681656320 138478 33554432000 4194304 4964800 140735337961184 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3040.71
Current children cumulated vsize (KiB) 665680

[startup+822.301 s]
/proc/loadavg: 8.16 8.18 8.14 9/308 18818
/proc/meminfo: memFree=10328820/32951124 swapFree=66050672/67111528
[pid=18792] ppid=18790 vsize=734832 CPUtime=3280.1 cores=0,2,4,6
/proc/18792/stat : 18792 (claspmt) R 18790 18792 18486 0 -1 4202496 158303 0 0 0 327877 133 0 0 25 0 4 0 653809350 752467968 154467 33554432000 4194304 4964800 140735337961184 18446744073709551615 4670328 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/18792/statm: 183708 154467 460 189 0 178057 0
[pid=18792/tid=18794] ppid=18790 vsize=734832 CPUtime=821.79 cores=0,2,4,6
/proc/18792/task/18794/stat : 18794 (claspmt) R 18790 18792 18486 0 -1 4202560 33296 0 0 0 82148 31 0 0 25 0 4 0 653809391 752467968 154467 33554432000 4194304 4964800 140735337961184 18446744073709551615 4321016 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=18792/tid=18795] ppid=18790 vsize=734832 CPUtime=820.59 cores=0,2,4,6
/proc/18792/task/18795/stat : 18795 (claspmt) R 18790 18792 18486 0 -1 4202560 49608 0 0 0 82023 36 0 0 25 0 4 0 653809391 752467968 154467 33554432000 4194304 4964800 140735337961184 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=18792/tid=18796] ppid=18790 vsize=734832 CPUtime=818.57 cores=0,2,4,6
/proc/18792/task/18796/stat : 18796 (claspmt) R 18790 18792 18486 0 -1 4202560 38022 0 0 0 81822 35 0 0 25 0 4 0 653809391 752467968 154467 33554432000 4194304 4964800 140735337961184 18446744073709551615 4668773 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3280.1
Current children cumulated vsize (KiB) 734832

[startup+882.301 s]
/proc/loadavg: 7.62 8.06 8.10 5/300 18837
/proc/meminfo: memFree=11476744/32951124 swapFree=66050672/67111528
[pid=18792] ppid=18790 vsize=735540 CPUtime=3519.51 cores=0,2,4,6
/proc/18792/stat : 18792 (claspmt) R 18790 18792 18486 0 -1 4202496 159873 0 0 0 351816 135 0 0 25 0 4 0 653809350 753192960 156037 33554432000 4194304 4964800 140735337961184 18446744073709551615 4332418 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/18792/statm: 183885 156037 460 189 0 178234 0
[pid=18792/tid=18794] ppid=18790 vsize=735540 CPUtime=881.79 cores=0,2,4,6
/proc/18792/task/18794/stat : 18794 (claspmt) R 18790 18792 18486 0 -1 4202560 34598 0 0 0 88146 33 0 0 25 0 4 0 653809391 753192960 156037 33554432000 4194304 4964800 140735337961184 18446744073709551615 4669350 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=18792/tid=18795] ppid=18790 vsize=735540 CPUtime=879.99 cores=0,2,4,6
/proc/18792/task/18795/stat : 18795 (claspmt) R 18790 18792 18486 0 -1 4202560 49837 0 0 0 87963 36 0 0 25 0 4 0 653809391 753192960 156037 33554432000 4194304 4964800 140735337961184 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=18792/tid=18796] ppid=18790 vsize=735540 CPUtime=878.57 cores=0,2,4,6
/proc/18792/task/18796/stat : 18796 (claspmt) R 18790 18792 18486 0 -1 4202560 38032 0 0 0 87822 35 0 0 25 0 4 0 653809391 753192960 156037 33554432000 4194304 4964800 140735337961184 18446744073709551615 4668712 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3519.51
Current children cumulated vsize (KiB) 735540

[startup+942.3 s]
/proc/loadavg: 5.33 7.32 7.84 5/299 18839
/proc/meminfo: memFree=11475796/32951124 swapFree=66050672/67111528
[pid=18792] ppid=18790 vsize=735540 CPUtime=3758.98 cores=0,2,4,6
/proc/18792/stat : 18792 (claspmt) R 18790 18792 18486 0 -1 4202496 161032 0 0 0 375758 140 0 0 25 0 4 0 653809350 753192960 157196 33554432000 4194304 4964800 140735337961184 18446744073709551615 4651454 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/18792/statm: 183885 157196 460 189 0 178234 0
[pid=18792/tid=18794] ppid=18790 vsize=735540 CPUtime=941.79 cores=0,2,4,6
/proc/18792/task/18794/stat : 18794 (claspmt) R 18790 18792 18486 0 -1 4202560 34637 0 0 0 94146 33 0 0 25 0 4 0 653809391 753192960 157196 33554432000 4194304 4964800 140735337961184 18446744073709551615 4669479 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=18792/tid=18795] ppid=18790 vsize=735540 CPUtime=939.46 cores=0,2,4,6
/proc/18792/task/18795/stat : 18795 (claspmt) R 18790 18792 18486 0 -1 4202560 50939 0 0 0 93905 41 0 0 25 0 4 0 653809391 753192960 157196 33554432000 4194304 4964800 140735337961184 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=18792/tid=18796] ppid=18790 vsize=735540 CPUtime=938.57 cores=0,2,4,6
/proc/18792/task/18796/stat : 18796 (claspmt) R 18790 18792 18486 0 -1 4202560 38048 0 0 0 93822 35 0 0 25 0 4 0 653809391 753192960 157196 33554432000 4194304 4964800 140735337961184 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3758.98
Current children cumulated vsize (KiB) 735540

[startup+1002.3 s]
/proc/loadavg: 4.57 6.74 7.61 5/299 18841
/proc/meminfo: memFree=11474796/32951124 swapFree=66050672/67111528
[pid=18792] ppid=18790 vsize=735540 CPUtime=3998.41 cores=0,2,4,6
/proc/18792/stat : 18792 (claspmt) R 18790 18792 18486 0 -1 4202496 161245 0 0 0 399701 140 0 0 25 0 4 0 653809350 753192960 157271 33554432000 4194304 4964800 140735337961184 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/18792/statm: 183885 157271 460 189 0 178234 0
[pid=18792/tid=18794] ppid=18790 vsize=735540 CPUtime=1001.79 cores=0,2,4,6
/proc/18792/task/18794/stat : 18794 (claspmt) R 18790 18792 18486 0 -1 4202560 34817 0 0 0 100146 33 0 0 25 0 4 0 653809391 753192960 157271 33554432000 4194304 4964800 140735337961184 18446744073709551615 4362287 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=18792/tid=18795] ppid=18790 vsize=735540 CPUtime=998.91 cores=0,2,4,6
/proc/18792/task/18795/stat : 18795 (claspmt) R 18790 18792 18486 0 -1 4202560 50940 0 0 0 99850 41 0 0 25 0 4 0 653809391 753192960 157271 33554432000 4194304 4964800 140735337961184 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=18792/tid=18796] ppid=18790 vsize=735540 CPUtime=998.56 cores=0,2,4,6
/proc/18792/task/18796/stat : 18796 (claspmt) R 18790 18792 18486 0 -1 4202560 38076 0 0 0 99821 35 0 0 25 0 4 0 653809391 753192960 157271 33554432000 4194304 4964800 140735337961184 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3998.41
Current children cumulated vsize (KiB) 735540

[startup+1062.3 s]
/proc/loadavg: 4.21 6.24 7.38 5/299 18842
/proc/meminfo: memFree=11473028/32951124 swapFree=66050672/67111528
[pid=18792] ppid=18790 vsize=735540 CPUtime=4237.84 cores=0,2,4,6
/proc/18792/stat : 18792 (claspmt) R 18790 18792 18486 0 -1 4202496 161866 0 0 0 423644 140 0 0 25 0 4 0 653809350 753192960 157892 33554432000 4194304 4964800 140735337961184 18446744073709551615 4668777 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/18792/statm: 183885 157892 460 189 0 178234 0
[pid=18792/tid=18794] ppid=18790 vsize=735540 CPUtime=1061.78 cores=0,2,4,6
/proc/18792/task/18794/stat : 18794 (claspmt) R 18790 18792 18486 0 -1 4202560 35307 0 0 0 106144 34 0 0 25 0 4 0 653809391 753192960 157892 33554432000 4194304 4964800 140735337961184 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=18792/tid=18795] ppid=18790 vsize=735540 CPUtime=1058.37 cores=0,2,4,6
/proc/18792/task/18795/stat : 18795 (claspmt) R 18790 18792 18486 0 -1 4202560 51064 0 0 0 105796 41 0 0 25 0 4 0 653809391 753192960 157892 33554432000 4194304 4964800 140735337961184 18446744073709551615 4669350 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=18792/tid=18796] ppid=18790 vsize=735540 CPUtime=1058.57 cores=0,2,4,6
/proc/18792/task/18796/stat : 18796 (claspmt) R 18790 18792 18486 0 -1 4202560 38079 0 0 0 105822 35 0 0 25 0 4 0 653809391 753192960 157892 33554432000 4194304 4964800 140735337961184 18446744073709551615 4378499 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4237.84
Current children cumulated vsize (KiB) 735540

[startup+1122.3 s]
/proc/loadavg: 4.16 5.86 7.17 5/299 18844
/proc/meminfo: memFree=11465804/32951124 swapFree=66050672/67111528
[pid=18792] ppid=18790 vsize=801076 CPUtime=4477.26 cores=0,2,4,6
/proc/18792/stat : 18792 (claspmt) R 18790 18792 18486 0 -1 4202496 163699 0 0 0 447584 142 0 0 25 0 4 0 653809350 820301824 159586 33554432000 4194304 4964800 140735337961184 18446744073709551615 4670530 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/18792/statm: 200269 159586 460 189 0 194618 0
[pid=18792/tid=18794] ppid=18790 vsize=801076 CPUtime=1121.78 cores=0,2,4,6
/proc/18792/task/18794/stat : 18794 (claspmt) R 18790 18792 18486 0 -1 4202560 37138 0 0 0 112142 36 0 0 25 0 4 0 653809391 820301824 159586 33554432000 4194304 4964800 140735337961184 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=18792/tid=18795] ppid=18790 vsize=801076 CPUtime=1117.82 cores=0,2,4,6
/proc/18792/task/18795/stat : 18795 (claspmt) R 18790 18792 18486 0 -1 4202560 51064 0 0 0 111741 41 0 0 25 0 4 0 653809391 820301824 159586 33554432000 4194304 4964800 140735337961184 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=18792/tid=18796] ppid=18790 vsize=801076 CPUtime=1118.57 cores=0,2,4,6
/proc/18792/task/18796/stat : 18796 (claspmt) R 18790 18792 18486 0 -1 4202560 38081 0 0 0 111822 35 0 0 25 0 4 0 653809391 820301824 159586 33554432000 4194304 4964800 140735337961184 18446744073709551615 4669086 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4477.26
Current children cumulated vsize (KiB) 801076

[startup+1182.3 s]
/proc/loadavg: 4.11 5.53 6.98 5/299 18845
/proc/meminfo: memFree=11457460/32951124 swapFree=66050672/67111528
[pid=18792] ppid=18790 vsize=801076 CPUtime=4716.71 cores=0,2,4,6
/proc/18792/stat : 18792 (claspmt) R 18790 18792 18486 0 -1 4202496 165790 0 0 0 471525 146 0 0 25 0 4 0 653809350 820301824 161677 33554432000 4194304 4964800 140735337961184 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/18792/statm: 200269 161677 460 189 0 194618 0
[pid=18792/tid=18794] ppid=18790 vsize=801076 CPUtime=1181.78 cores=0,2,4,6
/proc/18792/task/18794/stat : 18794 (claspmt) R 18790 18792 18486 0 -1 4202560 39031 0 0 0 118139 39 0 0 25 0 4 0 653809391 820301824 161677 33554432000 4194304 4964800 140735337961184 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=18792/tid=18795] ppid=18790 vsize=801076 CPUtime=1177.28 cores=0,2,4,6
/proc/18792/task/18795/stat : 18795 (claspmt) R 18790 18792 18486 0 -1 4202560 51191 0 0 0 117687 41 0 0 25 0 4 0 653809391 820301824 161677 33554432000 4194304 4964800 140735337961184 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=18792/tid=18796] ppid=18790 vsize=801076 CPUtime=1178.56 cores=0,2,4,6
/proc/18792/task/18796/stat : 18796 (claspmt) R 18790 18792 18486 0 -1 4202560 38110 0 0 0 117821 35 0 0 25 0 4 0 653809391 820301824 161677 33554432000 4194304 4964800 140735337961184 18446744073709551615 4320951 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4716.71
Current children cumulated vsize (KiB) 801076



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1203.2 s]
/proc/loadavg: 4.20 5.46 6.92 5/299 18846
/proc/meminfo: memFree=11457332/32951124 swapFree=66050672/67111528
[pid=18792] ppid=18790 vsize=801076 CPUtime=4800.15 cores=0,2,4,6
/proc/18792/stat : 18792 (claspmt) R 18790 18792 18486 0 -1 4202496 165799 0 0 0 479869 146 0 0 25 0 4 0 653809350 820301824 161686 33554432000 4194304 4964800 140735337961184 18446744073709551615 4670295 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/18792/statm: 200269 161686 460 189 0 194618 0
[pid=18792/tid=18794] ppid=18790 vsize=801076 CPUtime=1202.69 cores=0,2,4,6
/proc/18792/task/18794/stat : 18794 (claspmt) R 18790 18792 18486 0 -1 4202560 39039 0 0 0 120230 39 0 0 25 0 4 0 653809391 820301824 161686 33554432000 4194304 4964800 140735337961184 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=18792/tid=18795] ppid=18790 vsize=801076 CPUtime=1197.99 cores=0,2,4,6
/proc/18792/task/18795/stat : 18795 (claspmt) R 18790 18792 18486 0 -1 4202560 51191 0 0 0 119758 41 0 0 25 0 4 0 653809391 820301824 161686 33554432000 4194304 4964800 140735337961184 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=18792/tid=18796] ppid=18790 vsize=801076 CPUtime=1199.48 cores=0,2,4,6
/proc/18792/task/18796/stat : 18796 (claspmt) R 18790 18792 18486 0 -1 4202560 38111 0 0 0 119913 35 0 0 25 0 4 0 653809391 820301824 161686 33554432000 4194304 4964800 140735337961184 18446744073709551615 4670180 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4800.15
Current children cumulated vsize (KiB) 801076

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1203.32 s]
/proc/loadavg: 4.20 5.46 6.92 2/297 18847
/proc/meminfo: memFree=11472352/32951124 swapFree=66050672/67111528
[pid=18792] ppid=18790 vsize=718888 CPUtime=4800.29 cores=0,2,4,6
/proc/18792/stat : 18792 (claspmt) R 18790 18792 18486 0 -1 4202496 165810 0 0 0 479883 146 0 0 25 0 1 0 653809350 736141312 151247 33554432000 4194304 4964800 140735337961184 18446744073709551615 255377327210 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/18792/statm: 179722 151247 471 189 0 174071 0
Current children cumulated CPU time (s) 4800.29
Current children cumulated vsize (KiB) 718888

Child status: 0
Real time (s): 1203.35
CPU time (s): 4800.33
CPU user time (s): 4798.83
CPU system time (s): 1.49477
CPU usage (%): 398.912
Max. virtual memory (cumulated for all children) (KiB): 801076

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4798.83
system time used= 1.49477
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 165811
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 11081
involuntary context switches= 72331

runsolver used 3.19551 second user time and 8.07577 second system time

The end

Launcher Data 

Begin job on node135 at 2011-05-15 03:15:15
IDJOB=3373556
IDBENCH=83110
IDSOLVER=1853
FILE ID=node135/3373556-1305422115
RUNJOBID= node135-1305419508-18504
PBS_JOBID= 13324578
Free space on /tmp= 73332 MiB

SOLVER NAME= claspmt 2.0-R4095-patched (fixed)
BENCH NAME= SAT11/application/fuhs/slp-synthesis-AES/slp-synthesis-aes-bottom20.cnf
COMMAND LINE= HOME/claspmt -tNBCORE -p HOME/sat11-port.txt --distribute=all,2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3373556-1305422115/watcher-3373556-1305422115 -o /tmp/evaluation-result-3373556-1305422115/solver-3373556-1305422115 -C 4800 -W 1300 -M 15500  HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3373556-1305422115.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 9851f8e63efc4505343bf50c1cf30646
RANDOM SEED=1041290715

node135.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 6640.14
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.78
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      11468164 kB
Buffers:        281048 kB
Cached:        5921780 kB
SwapCached:      50684 kB
Active:       10515460 kB
Inactive:     10723888 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      11468164 kB
SwapTotal:    67111528 kB
SwapFree:     66050672 kB
Dirty:            3496 kB
Writeback:           0 kB
AnonPages:    14991264 kB
Mapped:          19632 kB
Slab:           135096 kB
PageTables:      47944 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 57695816 kB
VmallocTotal: 34359738367 kB
VmallocUsed:     33868 kB
VmallocChunk: 34359703231 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73340 MiB
End job on node135 at 2011-05-15 03:35:20