Trace number 3288977

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587? (TO) 4800.46 1201.83

General information on the benchmark

Nameapplication/fuhs/slp-synthesis-AES/
slp-synthesis-aes-bottom20.cnf
MD5SUM9851f8e63efc4505343bf50c1cf30646
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables44362
Number of clauses148436
Sum of the clauses size378642
Maximum clause length1419
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 276003
Number of clauses of size 371663
Number of clauses of size 4209
Number of clauses of size 518
Number of clauses of size over 5542

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3288977-1304073027/watcher-3288977-1304073027 -o /tmp/evaluation-result-3288977-1304073027/solver-3288977-1304073027 -C 4800 -W 1300 -M 15500 plingeling -t 4 HOME/instance-3288977-1304073027.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.11 8.13 7.94 3/177 14797
/proc/meminfo: memFree=26268692/32950928 swapFree=67111364/67111528
[pid=14797] ppid=14795 vsize=12340 CPUtime=0 cores=0,2,4,6
/proc/14797/stat : 14797 (plingeling) R 14795 14797 12570 0 -1 4202496 1065 1251 0 0 0 0 0 0 24 0 1 0 518902377 12636160 994 33554432000 4194304 4417332 140734546679568 18446744073709551615 208079926365 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/14797/statm: 3085 1009 140 55 0 971 0

[startup+0.039587 s]
/proc/loadavg: 8.11 8.13 7.94 3/177 14797
/proc/meminfo: memFree=26268692/32950928 swapFree=67111364/67111528
[pid=14797] ppid=14795 vsize=19676 CPUtime=0.02 cores=0,2,4,6
/proc/14797/stat : 14797 (plingeling) R 14795 14797 12570 0 -1 4202496 3013 1251 0 0 2 0 0 0 24 0 1 0 518902377 20148224 2942 33554432000 4194304 4417332 140734546679568 18446744073709551615 4320876 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/14797/statm: 4919 2942 148 55 0 2805 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 19676

[startup+0.100458 s]
/proc/loadavg: 8.11 8.13 7.94 3/177 14797
/proc/meminfo: memFree=26268692/32950928 swapFree=67111364/67111528
[pid=14797] ppid=14795 vsize=29552 CPUtime=0.08 cores=0,2,4,6
/proc/14797/stat : 14797 (plingeling) R 14795 14797 12570 0 -1 4202496 5482 1251 0 0 8 0 0 0 24 0 1 0 518902377 30261248 5411 33554432000 4194304 4417332 140734546679568 18446744073709551615 4274387 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/14797/statm: 7388 5411 148 55 0 5274 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 29552

[startup+0.300428 s]
/proc/loadavg: 8.11 8.13 7.94 3/177 14797
/proc/meminfo: memFree=26268692/32950928 swapFree=67111364/67111528
[pid=14797] ppid=14795 vsize=151188 CPUtime=0.62 cores=0,2,4,6
/proc/14797/stat : 14797 (plingeling) S 14795 14797 12570 0 -1 4202496 15874 1251 0 0 61 1 0 0 25 0 5 0 518902377 154816512 10450 33554432000 4194304 4417332 140734546679568 18446744073709551615 208092035045 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/14797/statm: 37797 10450 173 55 0 35683 0
Current children cumulated CPU time (s) 0.62
Current children cumulated vsize (KiB) 151188

[startup+0.700348 s]
/proc/loadavg: 8.11 8.13 7.94 3/177 14797
/proc/meminfo: memFree=26268692/32950928 swapFree=67111364/67111528
[pid=14797] ppid=14795 vsize=149848 CPUtime=2.22 cores=0,2,4,6
/proc/14797/stat : 14797 (plingeling) S 14795 14797 12570 0 -1 4202496 21608 1251 0 0 220 2 0 0 25 0 5 0 518902377 153444352 10117 33554432000 4194304 4417332 140734546679568 18446744073709551615 208092035045 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/14797/statm: 37462 10117 175 55 0 35348 0
Current children cumulated CPU time (s) 2.22
Current children cumulated vsize (KiB) 149848

[startup+1.50119 s]
/proc/loadavg: 8.11 8.13 7.94 9/186 14811
/proc/meminfo: memFree=26199808/32950928 swapFree=67111364/67111528
[pid=14797] ppid=14795 vsize=152856 CPUtime=5.42 cores=0,2,4,6
/proc/14797/stat : 14797 (plingeling) S 14795 14797 12570 0 -1 4202496 35095 1251 0 0 538 4 0 0 25 0 5 0 518902377 156524544 10952 33554432000 4194304 4417332 140734546679568 18446744073709551615 208092035045 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/14797/statm: 38214 10952 175 55 0 36100 0
[pid=14797/tid=14808] ppid=14795 vsize=152856 CPUtime=1.3 cores=0,2,4,6
/proc/14797/task/14808/stat : 14808 (plingeling) R 14795 14797 12570 0 -1 4202560 5094 1251 0 0 130 0 0 0 25 0 5 0 518902395 156524544 10952 33554432000 4194304 4417332 140734546679568 18446744073709551615 4284341 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=14797/tid=14809] ppid=14795 vsize=152856 CPUtime=1.3 cores=0,2,4,6
/proc/14797/task/14809/stat : 14809 (plingeling) R 14795 14797 12570 0 -1 4202560 11050 1251 0 0 129 1 0 0 25 0 5 0 518902395 156524544 10952 33554432000 4194304 4417332 140734546679568 18446744073709551615 4284514 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=14797/tid=14810] ppid=14795 vsize=152856 CPUtime=1.3 cores=0,2,4,6
/proc/14797/task/14810/stat : 14810 (plingeling) R 14795 14797 12570 0 -1 4202560 8525 1251 0 0 130 0 0 0 19 0 5 0 518902395 156524544 10952 33554432000 4194304 4417332 140734546679568 18446744073709551615 4290595 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=14797/tid=14811] ppid=14795 vsize=152856 CPUtime=1.3 cores=0,2,4,6
/proc/14797/task/14811/stat : 14811 (plingeling) R 14795 14797 12570 0 -1 4202560 993 1251 0 0 130 0 0 0 25 0 5 0 518902395 156524544 10952 33554432000 4194304 4417332 140734546679568 18446744073709551615 4364482 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 5.42
Current children cumulated vsize (KiB) 152856

[startup+3.10089 s]
/proc/loadavg: 8.10 8.12 7.94 9/186 14812
/proc/meminfo: memFree=26183140/32950928 swapFree=67111364/67111528
[pid=14797] ppid=14795 vsize=158588 CPUtime=11.81 cores=0,2,4,6
/proc/14797/stat : 14797 (plingeling) S 14795 14797 12570 0 -1 4202496 44540 1251 0 0 1176 5 0 0 25 0 5 0 518902377 162394112 12936 33554432000 4194304 4417332 140734546679568 18446744073709551615 208092035045 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/14797/statm: 39647 12936 181 55 0 37533 0
[pid=14797/tid=14808] ppid=14795 vsize=158588 CPUtime=2.9 cores=0,2,4,6
/proc/14797/task/14808/stat : 14808 (plingeling) R 14795 14797 12570 0 -1 4202560 7993 1251 0 0 290 0 0 0 25 0 5 0 518902395 162394112 12936 33554432000 4194304 4417332 140734546679568 18446744073709551615 4252365 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=14797/tid=14809] ppid=14795 vsize=158588 CPUtime=2.9 cores=0,2,4,6
/proc/14797/task/14809/stat : 14809 (plingeling) R 14795 14797 12570 0 -1 4202560 14027 1251 0 0 289 1 0 0 25 0 5 0 518902395 162394112 12936 33554432000 4194304 4417332 140734546679568 18446744073709551615 4319757 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=14797/tid=14810] ppid=14795 vsize=158588 CPUtime=2.9 cores=0,2,4,6
/proc/14797/task/14810/stat : 14810 (plingeling) R 14795 14797 12570 0 -1 4202560 11850 1251 0 0 289 1 0 0 24 0 5 0 518902395 162394112 12936 33554432000 4194304 4417332 140734546679568 18446744073709551615 4232702 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=14797/tid=14811] ppid=14795 vsize=158588 CPUtime=2.89 cores=0,2,4,6
/proc/14797/task/14811/stat : 14811 (plingeling) R 14795 14797 12570 0 -1 4202560 1237 1251 0 0 289 0 0 0 25 0 5 0 518902395 162394112 12936 33554432000 4194304 4417332 140734546679568 18446744073709551615 4365846 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 11.81
Current children cumulated vsize (KiB) 158588

[startup+6.30028 s]
/proc/loadavg: 8.10 8.12 7.94 9/186 14812
/proc/meminfo: memFree=26161192/32950928 swapFree=67111364/67111528
[pid=14797] ppid=14795 vsize=166504 CPUtime=24.59 cores=0,2,4,6
/proc/14797/stat : 14797 (plingeling) S 14795 14797 12570 0 -1 4202496 48655 1251 0 0 2453 6 0 0 25 0 5 0 518902377 170500096 14915 33554432000 4194304 4417332 140734546679568 18446744073709551615 208092035045 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/14797/statm: 41626 14915 181 55 0 39512 0
[pid=14797/tid=14808] ppid=14795 vsize=166504 CPUtime=6.1 cores=0,2,4,6
/proc/14797/task/14808/stat : 14808 (plingeling) R 14795 14797 12570 0 -1 4202560 9390 1251 0 0 610 0 0 0 25 0 5 0 518902395 170500096 14915 33554432000 4194304 4417332 140734546679568 18446744073709551615 4353472 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=14797/tid=14809] ppid=14795 vsize=166504 CPUtime=6.1 cores=0,2,4,6
/proc/14797/task/14809/stat : 14809 (plingeling) R 14795 14797 12570 0 -1 4202560 15362 1251 0 0 608 2 0 0 25 0 5 0 518902395 170500096 14915 33554432000 4194304 4417332 140734546679568 18446744073709551615 4277527 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=14797/tid=14810] ppid=14795 vsize=166504 CPUtime=6.1 cores=0,2,4,6
/proc/14797/task/14810/stat : 14810 (plingeling) R 14795 14797 12570 0 -1 4202560 12076 1251 0 0 609 1 0 0 25 0 5 0 518902395 170500096 14915 33554432000 4194304 4417332 140734546679568 18446744073709551615 4346401 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=14797/tid=14811] ppid=14795 vsize=166504 CPUtime=6.08 cores=0,2,4,6
/proc/14797/task/14811/stat : 14811 (plingeling) R 14795 14797 12570 0 -1 4202560 2394 1251 0 0 608 0 0 0 25 0 5 0 518902395 170500096 14915 33554432000 4194304 4417332 140734546679568 18446744073709551615 4353461 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 24.59
Current children cumulated vsize (KiB) 166504

[startup+12.7011 s]
/proc/loadavg: 8.09 8.12 7.94 9/186 14812
/proc/meminfo: memFree=26142920/32950928 swapFree=67111364/67111528
[pid=14797] ppid=14795 vsize=177176 CPUtime=50.16 cores=0,2,4,6
/proc/14797/stat : 14797 (plingeling) S 14795 14797 12570 0 -1 4202496 51364 1251 0 0 5010 6 0 0 25 0 5 0 518902377 181428224 17583 33554432000 4194304 4417332 140734546679568 18446744073709551615 208092035045 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/14797/statm: 44294 17583 181 55 0 42180 0
[pid=14797/tid=14808] ppid=14795 vsize=177176 CPUtime=12.5 cores=0,2,4,6
/proc/14797/task/14808/stat : 14808 (plingeling) R 14795 14797 12570 0 -1 4202560 9703 1251 0 0 1250 0 0 0 25 0 5 0 518902395 181428224 17583 33554432000 4194304 4417332 140734546679568 18446744073709551615 4365991 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=14797/tid=14809] ppid=14795 vsize=177176 CPUtime=12.51 cores=0,2,4,6
/proc/14797/task/14809/stat : 14809 (plingeling) R 14795 14797 12570 0 -1 4202560 15581 1251 0 0 1249 2 0 0 25 0 5 0 518902395 181428224 17583 33554432000 4194304 4417332 140734546679568 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=14797/tid=14810] ppid=14795 vsize=177176 CPUtime=12.5 cores=0,2,4,6
/proc/14797/task/14810/stat : 14810 (plingeling) R 14795 14797 12570 0 -1 4202560 13815 1251 0 0 1249 1 0 0 25 0 5 0 518902395 181428224 17583 33554432000 4194304 4417332 140734546679568 18446744073709551615 4364519 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=14797/tid=14811] ppid=14795 vsize=177176 CPUtime=12.45 cores=0,2,4,6
/proc/14797/task/14811/stat : 14811 (plingeling) R 14795 14797 12570 0 -1 4202560 2832 1251 0 0 1245 0 0 0 25 0 5 0 518902395 181428224 17583 33554432000 4194304 4417332 140734546679568 18446744073709551615 4364541 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 50.16
Current children cumulated vsize (KiB) 177176

[startup+25.5006 s]
/proc/loadavg: 8.07 8.11 7.94 9/186 14812
/proc/meminfo: memFree=26114524/32950928 swapFree=67111364/67111528
[pid=14797] ppid=14795 vsize=193484 CPUtime=101.3 cores=0,2,4,6
/proc/14797/stat : 14797 (plingeling) S 14795 14797 12570 0 -1 4202496 59070 1251 0 0 10123 7 0 0 25 0 5 0 518902377 198127616 21666 33554432000 4194304 4417332 140734546679568 18446744073709551615 208092035045 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/14797/statm: 48371 21666 181 55 0 46257 0
[pid=14797/tid=14808] ppid=14795 vsize=193484 CPUtime=25.3 cores=0,2,4,6
/proc/14797/task/14808/stat : 14808 (plingeling) R 14795 14797 12570 0 -1 4202560 12279 1251 0 0 2529 1 0 0 25 0 5 0 518902395 198127616 21666 33554432000 4194304 4417332 140734546679568 18446744073709551615 4364556 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=14797/tid=14809] ppid=14795 vsize=193484 CPUtime=25.3 cores=0,2,4,6
/proc/14797/task/14809/stat : 14809 (plingeling) R 14795 14797 12570 0 -1 4202560 17219 1251 0 0 2528 2 0 0 25 0 5 0 518902395 198127616 21666 33554432000 4194304 4417332 140734546679568 18446744073709551615 4250602 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=14797/tid=14810] ppid=14795 vsize=193484 CPUtime=25.3 cores=0,2,4,6
/proc/14797/task/14810/stat : 14810 (plingeling) R 14795 14797 12570 0 -1 4202560 14490 1251 0 0 2529 1 0 0 25 0 5 0 518902395 198127616 21666 33554432000 4194304 4417332 140734546679568 18446744073709551615 4236601 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=14797/tid=14811] ppid=14795 vsize=193484 CPUtime=25.18 cores=0,2,4,6
/proc/14797/task/14811/stat : 14811 (plingeling) R 14795 14797 12570 0 -1 4202560 5649 1251 0 0 2518 0 0 0 25 0 5 0 518902395 198127616 21666 33554432000 4194304 4417332 140734546679568 18446744073709551615 4365955 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 101.3
Current children cumulated vsize (KiB) 193484

[startup+51.1007 s]
/proc/loadavg: 8.12 8.12 7.95 9/186 14813
/proc/meminfo: memFree=26064748/32950928 swapFree=67111364/67111528
[pid=14797] ppid=14795 vsize=200292 CPUtime=203.57 cores=0,2,4,6
/proc/14797/stat : 14797 (plingeling) S 14795 14797 12570 0 -1 4202496 77788 1251 0 0 20347 10 0 0 25 0 5 0 518902377 205099008 23368 33554432000 4194304 4417332 140734546679568 18446744073709551615 208092035045 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/14797/statm: 50073 23368 181 55 0 47959 0
[pid=14797/tid=14808] ppid=14795 vsize=200292 CPUtime=50.9 cores=0,2,4,6
/proc/14797/task/14808/stat : 14808 (plingeling) R 14795 14797 12570 0 -1 4202560 14720 1251 0 0 5089 1 0 0 25 0 5 0 518902395 205099008 23368 33554432000 4194304 4417332 140734546679568 18446744073709551615 4357910 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=14797/tid=14809] ppid=14795 vsize=200292 CPUtime=50.91 cores=0,2,4,6
/proc/14797/task/14809/stat : 14809 (plingeling) R 14795 14797 12570 0 -1 4202560 21724 1251 0 0 5088 3 0 0 25 0 5 0 518902395 205099008 23368 33554432000 4194304 4417332 140734546679568 18446744073709551615 4364750 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=14797/tid=14810] ppid=14795 vsize=200292 CPUtime=50.9 cores=0,2,4,6
/proc/14797/task/14810/stat : 14810 (plingeling) R 14795 14797 12570 0 -1 4202560 20050 1251 0 0 5088 2 0 0 25 0 5 0 518902395 205099008 23368 33554432000 4194304 4417332 140734546679568 18446744073709551615 4364732 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=14797/tid=14811] ppid=14795 vsize=200292 CPUtime=50.66 cores=0,2,4,6
/proc/14797/task/14811/stat : 14811 (plingeling) R 14795 14797 12570 0 -1 4202560 11861 1251 0 0 5065 1 0 0 25 0 5 0 518902395 205099008 23368 33554432000 4194304 4417332 140734546679568 18446744073709551615 4364448 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 203.57
Current children cumulated vsize (KiB) 200292

[startup+102.306 s]
/proc/loadavg: 8.11 8.11 7.95 9/186 14814
/proc/meminfo: memFree=26021320/32950928 swapFree=67111364/67111528
[pid=14797] ppid=14795 vsize=227708 CPUtime=408.14 cores=0,2,4,6
/proc/14797/stat : 14797 (plingeling) S 14795 14797 12570 0 -1 4202496 124853 1251 0 0 40797 17 0 0 25 0 5 0 518902377 233172992 30254 33554432000 4194304 4417332 140734546679568 18446744073709551615 208092035045 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/14797/statm: 56927 30254 181 55 0 54813 0
[pid=14797/tid=14808] ppid=14795 vsize=227708 CPUtime=102.1 cores=0,2,4,6
/proc/14797/task/14808/stat : 14808 (plingeling) R 14795 14797 12570 0 -1 4202560 29954 1251 0 0 10207 3 0 0 25 0 5 0 518902395 233172992 30254 33554432000 4194304 4417332 140734546679568 18446744073709551615 4365963 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=14797/tid=14809] ppid=14795 vsize=227708 CPUtime=102.11 cores=0,2,4,6
/proc/14797/task/14809/stat : 14809 (plingeling) R 14795 14797 12570 0 -1 4202560 32554 1251 0 0 10207 4 0 0 25 0 5 0 518902395 233172992 30254 33554432000 4194304 4417332 140734546679568 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=14797/tid=14810] ppid=14795 vsize=227708 CPUtime=102.11 cores=0,2,4,6
/proc/14797/task/14810/stat : 14810 (plingeling) R 14795 14797 12570 0 -1 4202560 26319 1251 0 0 10207 4 0 0 25 0 5 0 518902395 233172992 30254 33554432000 4194304 4417332 140734546679568 18446744073709551615 4236649 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=14797/tid=14811] ppid=14795 vsize=227708 CPUtime=101.62 cores=0,2,4,6
/proc/14797/task/14811/stat : 14811 (plingeling) R 14795 14797 12570 0 -1 4202560 26593 1251 0 0 10158 4 0 0 25 0 5 0 518902395 233172992 30254 33554432000 4194304 4417332 140734546679568 18446744073709551615 4356899 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 408.14
Current children cumulated vsize (KiB) 227708

[startup+162.301 s]
/proc/loadavg: 8.15 8.12 7.96 9/186 14816
/proc/meminfo: memFree=25958536/32950928 swapFree=67111364/67111528
[pid=14797] ppid=14795 vsize=259596 CPUtime=647.84 cores=0,2,4,6
/proc/14797/stat : 14797 (plingeling) S 14795 14797 12570 0 -1 4202496 161194 1251 0 0 64761 23 0 0 25 0 5 0 518902377 265826304 38194 33554432000 4194304 4417332 140734546679568 18446744073709551615 208092035045 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/14797/statm: 64899 38194 181 55 0 62785 0
[pid=14797/tid=14808] ppid=14795 vsize=259596 CPUtime=162.09 cores=0,2,4,6
/proc/14797/task/14808/stat : 14808 (plingeling) R 14795 14797 12570 0 -1 4202560 43550 1251 0 0 16204 5 0 0 25 0 5 0 518902395 265826304 38194 33554432000 4194304 4417332 140734546679568 18446744073709551615 4236649 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=14797/tid=14809] ppid=14795 vsize=259596 CPUtime=162.11 cores=0,2,4,6
/proc/14797/task/14809/stat : 14809 (plingeling) R 14795 14797 12570 0 -1 4202560 36736 1251 0 0 16206 5 0 0 25 0 5 0 518902395 265826304 38194 33554432000 4194304 4417332 140734546679568 18446744073709551615 4236790 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=14797/tid=14810] ppid=14795 vsize=259596 CPUtime=162.11 cores=0,2,4,6
/proc/14797/task/14810/stat : 14810 (plingeling) R 14795 14797 12570 0 -1 4202560 31209 1251 0 0 16206 5 0 0 25 0 5 0 518902395 265826304 38194 33554432000 4194304 4417332 140734546679568 18446744073709551615 4364652 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=14797/tid=14811] ppid=14795 vsize=259596 CPUtime=161.32 cores=0,2,4,6
/proc/14797/task/14811/stat : 14811 (plingeling) R 14795 14797 12570 0 -1 4202560 40266 1251 0 0 16127 5 0 0 25 0 5 0 518902395 265826304 38194 33554432000 4194304 4417332 140734546679568 18446744073709551615 4237002 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 647.84
Current children cumulated vsize (KiB) 259596


################
# More data... #
################

[pid=14797/tid=14809] ppid=14795 vsize=415604 CPUtime=702.12 cores=0,2,4,6
/proc/14797/task/14809/stat : 14809 (plingeling) R 14795 14797 12570 0 -1 4202560 87257 1251 0 0 70200 12 0 0 25 0 5 0 518902395 425578496 77228 33554432000 4194304 4417332 140734546679568 18446744073709551615 4364531 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=14797/tid=14810] ppid=14795 vsize=415604 CPUtime=702.13 cores=0,2,4,6
/proc/14797/task/14810/stat : 14810 (plingeling) R 14795 14797 12570 0 -1 4202560 106425 1251 0 0 70198 15 0 0 25 0 5 0 518902395 425578496 77228 33554432000 4194304 4417332 140734546679568 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=14797/tid=14811] ppid=14795 vsize=415604 CPUtime=698.5 cores=0,2,4,6
/proc/14797/task/14811/stat : 14811 (plingeling) R 14795 14797 12570 0 -1 4202560 130388 1251 0 0 69831 19 0 0 25 0 5 0 518902395 425578496 77228 33554432000 4194304 4417332 140734546679568 18446744073709551615 4357111 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 2805.03
Current children cumulated vsize (KiB) 415604

[startup+762.306 s]
/proc/loadavg: 8.21 8.15 8.03 9/186 14832
/proc/meminfo: memFree=25612144/32950928 swapFree=67111364/67111528
[pid=14797] ppid=14795 vsize=443032 CPUtime=3044.73 cores=0,2,4,6
/proc/14797/stat : 14797 (plingeling) S 14795 14797 12570 0 -1 4202496 440217 1251 0 0 304409 64 0 0 25 0 5 0 518902377 453664768 84085 33554432000 4194304 4417332 140734546679568 18446744073709551615 208092035045 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/14797/statm: 110758 84085 181 55 0 108644 0
[pid=14797/tid=14808] ppid=14795 vsize=443032 CPUtime=762.06 cores=0,2,4,6
/proc/14797/task/14808/stat : 14808 (plingeling) R 14795 14797 12570 0 -1 4202560 90929 1251 0 0 76194 12 0 0 25 0 5 0 518902395 453664768 84085 33554432000 4194304 4417332 140734546679568 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=14797/tid=14809] ppid=14795 vsize=443032 CPUtime=762.14 cores=0,2,4,6
/proc/14797/task/14809/stat : 14809 (plingeling) R 14795 14797 12570 0 -1 4202560 90098 1251 0 0 76201 13 0 0 25 0 5 0 518902395 453664768 84085 33554432000 4194304 4417332 140734546679568 18446744073709551615 4364765 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=14797/tid=14810] ppid=14795 vsize=443032 CPUtime=762.14 cores=0,2,4,6
/proc/14797/task/14810/stat : 14810 (plingeling) R 14795 14797 12570 0 -1 4202560 110521 1251 0 0 76198 16 0 0 25 0 5 0 518902395 453664768 84085 33554432000 4194304 4417332 140734546679568 18446744073709551615 4364796 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=14797/tid=14811] ppid=14795 vsize=443032 CPUtime=758.18 cores=0,2,4,6
/proc/14797/task/14811/stat : 14811 (plingeling) R 14795 14797 12570 0 -1 4202560 139236 1251 0 0 75798 20 0 0 25 0 5 0 518902395 453664768 84085 33554432000 4194304 4417332 140734546679568 18446744073709551615 4364448 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3044.73
Current children cumulated vsize (KiB) 443032

[startup+822.301 s]
/proc/loadavg: 8.13 8.14 8.03 9/186 14833
/proc/meminfo: memFree=25624380/32950928 swapFree=67111364/67111528
[pid=14797] ppid=14795 vsize=415160 CPUtime=3284.39 cores=0,2,4,6
/proc/14797/stat : 14797 (plingeling) S 14795 14797 12570 0 -1 4202496 446263 1251 0 0 328374 65 0 0 25 0 5 0 518902377 425123840 77117 33554432000 4194304 4417332 140734546679568 18446744073709551615 208092035045 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/14797/statm: 103790 77117 181 55 0 101676 0
[pid=14797/tid=14808] ppid=14795 vsize=415160 CPUtime=822.05 cores=0,2,4,6
/proc/14797/task/14808/stat : 14808 (plingeling) R 14795 14797 12570 0 -1 4202560 90939 1251 0 0 82193 12 0 0 25 0 5 0 518902395 425123840 77117 33554432000 4194304 4417332 140734546679568 18446744073709551615 4364448 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=14797/tid=14809] ppid=14795 vsize=415160 CPUtime=822.13 cores=0,2,4,6
/proc/14797/task/14809/stat : 14809 (plingeling) R 14795 14797 12570 0 -1 4202560 90108 1251 0 0 82200 13 0 0 25 0 5 0 518902395 425123840 77117 33554432000 4194304 4417332 140734546679568 18446744073709551615 4364631 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=14797/tid=14810] ppid=14795 vsize=415160 CPUtime=822.14 cores=0,2,4,6
/proc/14797/task/14810/stat : 14810 (plingeling) R 14795 14797 12570 0 -1 4202560 110531 1251 0 0 82198 16 0 0 25 0 5 0 518902395 425123840 77117 33554432000 4194304 4417332 140734546679568 18446744073709551615 4364470 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=14797/tid=14811] ppid=14795 vsize=415160 CPUtime=817.87 cores=0,2,4,6
/proc/14797/task/14811/stat : 14811 (plingeling) R 14795 14797 12570 0 -1 4202560 145252 1251 0 0 81766 21 0 0 25 0 5 0 518902395 425123840 77117 33554432000 4194304 4417332 140734546679568 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3284.39
Current children cumulated vsize (KiB) 415160

[startup+882.3 s]
/proc/loadavg: 8.09 8.12 8.03 9/186 14835
/proc/meminfo: memFree=25609088/32950928 swapFree=67111364/67111528
[pid=14797] ppid=14795 vsize=439744 CPUtime=3524.08 cores=0,2,4,6
/proc/14797/stat : 14797 (plingeling) S 14795 14797 12570 0 -1 4202496 476029 1251 0 0 352340 68 0 0 25 0 5 0 518902377 450297856 83263 33554432000 4194304 4417332 140734546679568 18446744073709551615 208092035045 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/14797/statm: 109936 83263 181 55 0 107822 0
[pid=14797/tid=14808] ppid=14795 vsize=439744 CPUtime=882.05 cores=0,2,4,6
/proc/14797/task/14808/stat : 14808 (plingeling) R 14795 14797 12570 0 -1 4202560 103885 1251 0 0 88191 14 0 0 25 0 5 0 518902395 450297856 83263 33554432000 4194304 4417332 140734546679568 18446744073709551615 4354396 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=14797/tid=14809] ppid=14795 vsize=439744 CPUtime=882.13 cores=0,2,4,6
/proc/14797/task/14809/stat : 14809 (plingeling) R 14795 14797 12570 0 -1 4202560 96711 1251 0 0 88200 13 0 0 25 0 5 0 518902395 450297856 83263 33554432000 4194304 4417332 140734546679568 18446744073709551615 4364671 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=14797/tid=14810] ppid=14795 vsize=439744 CPUtime=882.13 cores=0,2,4,6
/proc/14797/task/14810/stat : 14810 (plingeling) R 14795 14797 12570 0 -1 4202560 116960 1251 0 0 88197 16 0 0 25 0 5 0 518902395 450297856 83263 33554432000 4194304 4417332 140734546679568 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=14797/tid=14811] ppid=14795 vsize=439744 CPUtime=877.55 cores=0,2,4,6
/proc/14797/task/14811/stat : 14811 (plingeling) R 14795 14797 12570 0 -1 4202560 149040 1251 0 0 87733 22 0 0 25 0 5 0 518902395 450297856 83263 33554432000 4194304 4417332 140734546679568 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3524.08
Current children cumulated vsize (KiB) 439744

[startup+942.301 s]
/proc/loadavg: 8.08 8.11 8.03 9/186 14837
/proc/meminfo: memFree=25560580/32950928 swapFree=67111364/67111528
[pid=14797] ppid=14795 vsize=447292 CPUtime=3763.76 cores=0,2,4,6
/proc/14797/stat : 14797 (plingeling) S 14795 14797 12570 0 -1 4202496 494315 1251 0 0 376306 70 0 0 25 0 5 0 518902377 458027008 85182 33554432000 4194304 4417332 140734546679568 18446744073709551615 208092035045 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/14797/statm: 111823 85182 181 55 0 109709 0
[pid=14797/tid=14808] ppid=14795 vsize=447292 CPUtime=942.04 cores=0,2,4,6
/proc/14797/task/14808/stat : 14808 (plingeling) R 14795 14797 12570 0 -1 4202560 107087 1251 0 0 94190 14 0 0 25 0 5 0 518902395 458027008 85182 33554432000 4194304 4417332 140734546679568 18446744073709551615 4354236 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=14797/tid=14809] ppid=14795 vsize=447292 CPUtime=942.13 cores=0,2,4,6
/proc/14797/task/14809/stat : 14809 (plingeling) R 14795 14797 12570 0 -1 4202560 102865 1251 0 0 94199 14 0 0 25 0 5 0 518902395 458027008 85182 33554432000 4194304 4417332 140734546679568 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=14797/tid=14810] ppid=14795 vsize=447292 CPUtime=942.13 cores=0,2,4,6
/proc/14797/task/14810/stat : 14810 (plingeling) R 14795 14797 12570 0 -1 4202560 121067 1251 0 0 94197 16 0 0 25 0 5 0 518902395 458027008 85182 33554432000 4194304 4417332 140734546679568 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=14797/tid=14811] ppid=14795 vsize=447292 CPUtime=937.23 cores=0,2,4,6
/proc/14797/task/14811/stat : 14811 (plingeling) R 14795 14797 12570 0 -1 4202560 153863 1251 0 0 93701 22 0 0 25 0 5 0 518902395 458027008 85182 33554432000 4194304 4417332 140734546679568 18446744073709551615 4364452 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3763.76
Current children cumulated vsize (KiB) 447292

[startup+1002.3 s]
/proc/loadavg: 8.03 8.09 8.02 9/186 14838
/proc/meminfo: memFree=25628624/32950928 swapFree=67111364/67111528
[pid=14797] ppid=14795 vsize=420176 CPUtime=4003.44 cores=0,2,4,6
/proc/14797/stat : 14797 (plingeling) S 14795 14797 12570 0 -1 4202496 504958 1251 0 0 400272 72 0 0 25 0 5 0 518902377 430260224 78403 33554432000 4194304 4417332 140734546679568 18446744073709551615 208092035045 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/14797/statm: 105044 78403 181 55 0 102930 0
[pid=14797/tid=14808] ppid=14795 vsize=420176 CPUtime=1002.04 cores=0,2,4,6
/proc/14797/task/14808/stat : 14808 (plingeling) R 14795 14797 12570 0 -1 4202560 114113 1251 0 0 100189 15 0 0 25 0 5 0 518902395 430260224 78403 33554432000 4194304 4417332 140734546679568 18446744073709551615 4364526 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=14797/tid=14809] ppid=14795 vsize=420176 CPUtime=1002.13 cores=0,2,4,6
/proc/14797/task/14809/stat : 14809 (plingeling) R 14795 14797 12570 0 -1 4202560 102865 1251 0 0 100199 14 0 0 25 0 5 0 518902395 430260224 78403 33554432000 4194304 4417332 140734546679568 18446744073709551615 4237221 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=14797/tid=14810] ppid=14795 vsize=420176 CPUtime=1002.14 cores=0,2,4,6
/proc/14797/task/14810/stat : 14810 (plingeling) R 14795 14797 12570 0 -1 4202560 121067 1251 0 0 100198 16 0 0 25 0 5 0 518902395 430260224 78403 33554432000 4194304 4417332 140734546679568 18446744073709551615 4366359 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=14797/tid=14811] ppid=14795 vsize=420176 CPUtime=996.92 cores=0,2,4,6
/proc/14797/task/14811/stat : 14811 (plingeling) R 14795 14797 12570 0 -1 4202560 157480 1251 0 0 99669 23 0 0 25 0 5 0 518902395 430260224 78403 33554432000 4194304 4417332 140734546679568 18446744073709551615 4237290 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4003.44
Current children cumulated vsize (KiB) 420176

[startup+1062.3 s]
/proc/loadavg: 8.07 8.09 8.02 9/186 14840
/proc/meminfo: memFree=25366092/32950928 swapFree=67111364/67111528
[pid=14797] ppid=14795 vsize=571672 CPUtime=4243.13 cores=0,2,4,6
/proc/14797/stat : 14797 (plingeling) S 14795 14797 12570 0 -1 4202496 574104 1251 0 0 424233 80 0 0 25 0 5 0 518902377 585392128 116245 33554432000 4194304 4417332 140734546679568 18446744073709551615 208092035045 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/14797/statm: 142918 116245 181 55 0 140804 0
[pid=14797/tid=14808] ppid=14795 vsize=571672 CPUtime=1062.03 cores=0,2,4,6
/proc/14797/task/14808/stat : 14808 (plingeling) R 14795 14797 12570 0 -1 4202560 122279 1251 0 0 106187 16 0 0 25 0 5 0 518902395 585392128 116245 33554432000 4194304 4417332 140734546679568 18446744073709551615 4357111 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=14797/tid=14809] ppid=14795 vsize=571672 CPUtime=1062.13 cores=0,2,4,6
/proc/14797/task/14809/stat : 14809 (plingeling) R 14795 14797 12570 0 -1 4202560 127417 1251 0 0 106196 17 0 0 25 0 5 0 518902395 585392128 116245 33554432000 4194304 4417332 140734546679568 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=14797/tid=14810] ppid=14795 vsize=571672 CPUtime=1062.14 cores=0,2,4,6
/proc/14797/task/14810/stat : 14810 (plingeling) R 14795 14797 12570 0 -1 4202560 134715 1251 0 0 106196 18 0 0 25 0 5 0 518902395 585392128 116245 33554432000 4194304 4417332 140734546679568 18446744073709551615 4364683 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=14797/tid=14811] ppid=14795 vsize=571672 CPUtime=1056.61 cores=0,2,4,6
/proc/14797/task/14811/stat : 14811 (plingeling) R 14795 14797 12570 0 -1 4202560 180260 1251 0 0 105635 26 0 0 25 0 5 0 518902395 585392128 116245 33554432000 4194304 4417332 140734546679568 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4243.13
Current children cumulated vsize (KiB) 571672

[startup+1122.3 s]
/proc/loadavg: 8.08 8.08 8.02 9/186 14841
/proc/meminfo: memFree=25465132/32950928 swapFree=67111364/67111528
[pid=14797] ppid=14795 vsize=470340 CPUtime=4482.81 cores=0,2,4,6
/proc/14797/stat : 14797 (plingeling) S 14795 14797 12570 0 -1 4202496 601226 1251 0 0 448197 84 0 0 25 0 5 0 518902377 481628160 90912 33554432000 4194304 4417332 140734546679568 18446744073709551615 208092035045 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/14797/statm: 117585 90912 181 55 0 115471 0
[pid=14797/tid=14808] ppid=14795 vsize=470340 CPUtime=1122.03 cores=0,2,4,6
/proc/14797/task/14808/stat : 14808 (plingeling) R 14795 14797 12570 0 -1 4202560 127218 1251 0 0 112186 17 0 0 25 0 5 0 518902395 481628160 90912 33554432000 4194304 4417332 140734546679568 18446744073709551615 4356771 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=14797/tid=14809] ppid=14795 vsize=470340 CPUtime=1122.13 cores=0,2,4,6
/proc/14797/task/14809/stat : 14809 (plingeling) R 14795 14797 12570 0 -1 4202560 127417 1251 0 0 112196 17 0 0 25 0 5 0 518902395 481628160 90912 33554432000 4194304 4417332 140734546679568 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=14797/tid=14810] ppid=14795 vsize=470340 CPUtime=1122.14 cores=0,2,4,6
/proc/14797/task/14810/stat : 14810 (plingeling) R 14795 14797 12570 0 -1 4202560 134715 1251 0 0 112196 18 0 0 25 0 5 0 518902395 481628160 90912 33554432000 4194304 4417332 140734546679568 18446744073709551615 4364544 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=14797/tid=14811] ppid=14795 vsize=470340 CPUtime=1116.29 cores=0,2,4,6
/proc/14797/task/14811/stat : 14811 (plingeling) R 14795 14797 12570 0 -1 4202560 202443 1251 0 0 111600 29 0 0 25 0 5 0 518902395 481628160 90912 33554432000 4194304 4417332 140734546679568 18446744073709551615 4357863 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4482.81
Current children cumulated vsize (KiB) 470340

[startup+1182.3 s]
/proc/loadavg: 8.12 8.10 8.03 9/186 14843
/proc/meminfo: memFree=25416852/32950928 swapFree=67111364/67111528
[pid=14797] ppid=14795 vsize=519784 CPUtime=4722.49 cores=0,2,4,6
/proc/14797/stat : 14797 (plingeling) S 14795 14797 12570 0 -1 4202496 630096 1251 0 0 472160 89 0 0 25 0 5 0 518902377 532258816 103273 33554432000 4194304 4417332 140734546679568 18446744073709551615 208092035045 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/14797/statm: 129946 103273 181 55 0 127832 0
[pid=14797/tid=14808] ppid=14795 vsize=519784 CPUtime=1182.03 cores=0,2,4,6
/proc/14797/task/14808/stat : 14808 (plingeling) R 14795 14797 12570 0 -1 4202560 133333 1251 0 0 118185 18 0 0 25 0 5 0 518902395 532258816 103273 33554432000 4194304 4417332 140734546679568 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=14797/tid=14809] ppid=14795 vsize=519784 CPUtime=1182.14 cores=0,2,4,6
/proc/14797/task/14809/stat : 14809 (plingeling) R 14795 14797 12570 0 -1 4202560 129245 1251 0 0 118196 18 0 0 25 0 5 0 518902395 532258816 103273 33554432000 4194304 4417332 140734546679568 18446744073709551615 4365963 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=14797/tid=14810] ppid=14795 vsize=519784 CPUtime=1182.14 cores=0,2,4,6
/proc/14797/task/14810/stat : 14810 (plingeling) R 14795 14797 12570 0 -1 4202560 137236 1251 0 0 118196 18 0 0 25 0 5 0 518902395 532258816 103273 33554432000 4194304 4417332 140734546679568 18446744073709551615 4364494 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=14797/tid=14811] ppid=14795 vsize=519784 CPUtime=1175.97 cores=0,2,4,6
/proc/14797/task/14811/stat : 14811 (plingeling) R 14795 14797 12570 0 -1 4202560 220849 1251 0 0 117565 32 0 0 25 0 5 0 518902395 532258816 103273 33554432000 4194304 4417332 140734546679568 18446744073709551615 4364541 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4722.49
Current children cumulated vsize (KiB) 519784



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.8 s]
/proc/loadavg: 8.15 8.10 8.03 5/180 14845
/proc/meminfo: memFree=25847296/32950928 swapFree=67111364/67111528
[pid=14797] ppid=14795 vsize=565628 CPUtime=4800.4 cores=0,2,4,6
/proc/14797/stat : 14797 (plingeling) S 14795 14797 12570 0 -1 4202496 643421 1251 0 0 479950 90 0 0 25 0 5 0 518902377 579203072 114734 33554432000 4194304 4417332 140734546679568 18446744073709551615 208092035045 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/14797/statm: 141407 114734 181 55 0 139293 0
[pid=14797/tid=14808] ppid=14795 vsize=565628 CPUtime=1201.53 cores=0,2,4,6
/proc/14797/task/14808/stat : 14808 (plingeling) R 14795 14797 12570 0 -1 4202560 134369 1251 0 0 120135 18 0 0 25 0 5 0 518902395 579203072 114734 33554432000 4194304 4417332 140734546679568 18446744073709551615 4364544 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=14797/tid=14809] ppid=14795 vsize=565628 CPUtime=1201.64 cores=0,2,4,6
/proc/14797/task/14809/stat : 14809 (plingeling) R 14795 14797 12570 0 -1 4202560 133341 1251 0 0 120146 18 0 0 25 0 5 0 518902395 579203072 114734 33554432000 4194304 4417332 140734546679568 18446744073709551615 4364796 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=14797/tid=14810] ppid=14795 vsize=565628 CPUtime=1201.65 cores=0,2,4,6
/proc/14797/task/14810/stat : 14810 (plingeling) R 14795 14797 12570 0 -1 4202560 141332 1251 0 0 120146 19 0 0 25 0 5 0 518902395 579203072 114734 33554432000 4194304 4417332 140734546679568 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=14797/tid=14811] ppid=14795 vsize=565628 CPUtime=1195.36 cores=0,2,4,6
/proc/14797/task/14811/stat : 14811 (plingeling) R 14795 14797 12570 0 -1 4202560 224946 1251 0 0 119504 32 0 0 25 0 5 0 518902395 579203072 114734 33554432000 4194304 4417332 140734546679568 18446744073709551615 4364375 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4800.4
Current children cumulated vsize (KiB) 565628

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1201.83
CPU time (s): 4800.46
CPU user time (s): 4799.53
CPU system time (s): 0.934857
CPU usage (%): 399.428
Max. virtual memory (cumulated for all children) (KiB): 572668

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4799.53
system time used= 0.934857
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 644673
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 209
involuntary context switches= 24825

runsolver used 1.9587 second user time and 4.34034 second system time

The end

Launcher Data 

Begin job on node127 at 2011-04-29 12:30:27
IDJOB=3288977
IDBENCH=83110
IDSOLVER=1605
FILE ID=node127/3288977-1304073027
RUNJOBID= node127-1304071822-14666
PBS_JOBID= 13170417
Free space on /tmp= 71812 MiB

SOLVER NAME= Plingeling 587
BENCH NAME= SAT11/application/fuhs/slp-synthesis-AES/slp-synthesis-aes-bottom20.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3288977-1304073027/watcher-3288977-1304073027 -o /tmp/evaluation-result-3288977-1304073027/solver-3288977-1304073027 -C 4800 -W 1300 -M 15500  plingeling -t 4 HOME/instance-3288977-1304073027.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 9851f8e63efc4505343bf50c1cf30646
RANDOM SEED=1536599082

node127.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.64
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.86
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.60
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      26268972 kB
Buffers:       1391080 kB
Cached:        4710100 kB
SwapCached:          0 kB
Active:        1800056 kB
Inactive:      4406780 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      26268972 kB
SwapTotal:    67111528 kB
SwapFree:     67111364 kB
Dirty:            6656 kB
Writeback:           0 kB
AnonPages:      105576 kB
Mapped:          15072 kB
Slab:           410024 kB
PageTables:       4652 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   247948 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71816 MiB
End job on node127 at 2011-04-29 12:50:31