Trace number 3257722

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587? (TO) 4800.48 1201.89

General information on the benchmark

NameCRAFTED/rbsat/random/unforced/
rbsat-v2400c266431g3.cnf
MD5SUM231f625a25c77518fbce98fe99f807b5
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables2400
Number of clauses266431
Sum of the clauses size535112
Maximum clause length32
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 2266356
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 575

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3257722-1304047047/watcher-3257722-1304047047 -o /tmp/evaluation-result-3257722-1304047047/solver-3257722-1304047047 -C 4800 -W 1300 -M 15500 plingeling -t 4 HOME/instance-3257722-1304047047.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.83 8.02 7.97 5/181 27081
/proc/meminfo: memFree=13796864/32950928 swapFree=67111528/67111528
[pid=27081] ppid=27079 vsize=9164 CPUtime=0 cores=0,2,4,6
/proc/27081/stat : 27081 (plingeling) R 27079 27081 26812 0 -1 4202496 382 1253 0 0 0 0 0 0 25 0 1 0 594935369 9383936 312 33554432000 4194304 4417332 140737467669488 18446744073709551615 218880259033 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/27081/statm: 2291 312 146 55 0 177 0

[startup+0.0204429 s]
/proc/loadavg: 7.83 8.02 7.97 5/181 27081
/proc/meminfo: memFree=13796864/32950928 swapFree=67111528/67111528
[pid=27081] ppid=27079 vsize=10556 CPUtime=0.01 cores=0,2,4,6
/proc/27081/stat : 27081 (plingeling) R 27079 27081 26812 0 -1 4202496 715 1253 0 0 1 0 0 0 25 0 1 0 594935369 10809344 645 33554432000 4194304 4417332 140737467669488 18446744073709551615 218880564992 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/27081/statm: 2639 645 147 55 0 525 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 10556

[startup+0.100429 s]
/proc/loadavg: 7.83 8.02 7.97 5/181 27081
/proc/meminfo: memFree=13796864/32950928 swapFree=67111528/67111528
[pid=27081] ppid=27079 vsize=26604 CPUtime=0.09 cores=0,2,4,6
/proc/27081/stat : 27081 (plingeling) R 27079 27081 26812 0 -1 4202496 4711 1253 0 0 9 0 0 0 25 0 1 0 594935369 27242496 4641 33554432000 4194304 4417332 140737467669488 18446744073709551615 218880564992 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/27081/statm: 6651 4641 147 55 0 4537 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 26604

[startup+0.300327 s]
/proc/loadavg: 7.83 8.02 7.97 5/181 27081
/proc/meminfo: memFree=13796864/32950928 swapFree=67111528/67111528
[pid=27081] ppid=27079 vsize=86000 CPUtime=0.64 cores=0,2,4,6
/proc/27081/stat : 27081 (plingeling) S 27079 27081 26812 0 -1 4202496 9807 1253 0 0 64 0 0 0 25 0 5 0 594935369 88064000 9313 33554432000 4194304 4417332 140737467669488 18446744073709551615 218892367845 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/27081/statm: 21500 9313 174 55 0 19386 0
Current children cumulated CPU time (s) 0.64
Current children cumulated vsize (KiB) 86000

[startup+0.700257 s]
/proc/loadavg: 7.83 8.02 7.97 5/181 27081
/proc/meminfo: memFree=13796864/32950928 swapFree=67111528/67111528
[pid=27081] ppid=27079 vsize=168604 CPUtime=2.24 cores=0,2,4,6
/proc/27081/stat : 27081 (plingeling) S 27079 27081 26812 0 -1 4202496 21472 1253 0 0 222 2 0 0 25 0 5 0 594935369 172650496 13269 33554432000 4194304 4417332 140737467669488 18446744073709551615 218892367845 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/27081/statm: 42151 13269 179 55 0 40037 0
Current children cumulated CPU time (s) 2.24
Current children cumulated vsize (KiB) 168604

[startup+1.50112 s]
/proc/loadavg: 7.83 8.02 7.97 9/186 27091
/proc/meminfo: memFree=13743884/32950928 swapFree=67111528/67111528
[pid=27081] ppid=27079 vsize=171016 CPUtime=5.45 cores=0,2,4,6
/proc/27081/stat : 27081 (plingeling) S 27079 27081 26812 0 -1 4202496 26532 1253 0 0 542 3 0 0 25 0 5 0 594935369 175120384 14205 33554432000 4194304 4417332 140737467669488 18446744073709551615 218892367845 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/27081/statm: 42754 14205 180 55 0 40640 0
[pid=27081/tid=27088] ppid=27079 vsize=171016 CPUtime=1.31 cores=0,2,4,6
/proc/27081/task/27088/stat : 27088 (plingeling) R 27079 27081 26812 0 -1 4202560 2718 1253 0 0 131 0 0 0 25 0 5 0 594935387 175120384 14205 33554432000 4194304 4417332 140737467669488 18446744073709551615 4249186 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=27081/tid=27089] ppid=27079 vsize=171016 CPUtime=1.31 cores=0,2,4,6
/proc/27081/task/27089/stat : 27089 (plingeling) R 27079 27081 26812 0 -1 4202560 3379 1253 0 0 131 0 0 0 25 0 5 0 594935387 175120384 14205 33554432000 4194304 4417332 140737467669488 18446744073709551615 4258258 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=27081/tid=27090] ppid=27079 vsize=171016 CPUtime=1.3 cores=0,2,4,6
/proc/27081/task/27090/stat : 27090 (plingeling) R 27079 27081 26812 0 -1 4202560 3604 1253 0 0 130 0 0 0 25 0 5 0 594935387 175120384 14205 33554432000 4194304 4417332 140737467669488 18446744073709551615 4250003 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=27081/tid=27091] ppid=27079 vsize=171016 CPUtime=1.31 cores=0,2,4,6
/proc/27081/task/27091/stat : 27091 (plingeling) R 27079 27081 26812 0 -1 4202560 8012 1253 0 0 131 0 0 0 25 0 5 0 594935387 175120384 14205 33554432000 4194304 4417332 140737467669488 18446744073709551615 4364556 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 5.45
Current children cumulated vsize (KiB) 171016

[startup+3.10084 s]
/proc/loadavg: 7.83 8.02 7.97 9/186 27091
/proc/meminfo: memFree=13736316/32950928 swapFree=67111528/67111528
[pid=27081] ppid=27079 vsize=183492 CPUtime=11.83 cores=0,2,4,6
/proc/27081/stat : 27081 (plingeling) S 27079 27081 26812 0 -1 4202496 31487 1253 0 0 1180 3 0 0 25 0 5 0 594935369 187895808 17356 33554432000 4194304 4417332 140737467669488 18446744073709551615 218892367845 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/27081/statm: 45873 17356 180 55 0 43759 0
[pid=27081/tid=27088] ppid=27079 vsize=183492 CPUtime=2.91 cores=0,2,4,6
/proc/27081/task/27088/stat : 27088 (plingeling) R 27079 27081 26812 0 -1 4202560 3956 1253 0 0 291 0 0 0 25 0 5 0 594935387 187895808 17356 33554432000 4194304 4417332 140737467669488 18446744073709551615 4249209 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=27081/tid=27089] ppid=27079 vsize=183492 CPUtime=2.91 cores=0,2,4,6
/proc/27081/task/27089/stat : 27089 (plingeling) R 27079 27081 26812 0 -1 4202560 4617 1253 0 0 291 0 0 0 25 0 5 0 594935387 187895808 17356 33554432000 4194304 4417332 140737467669488 18446744073709551615 4258491 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=27081/tid=27090] ppid=27079 vsize=183492 CPUtime=2.9 cores=0,2,4,6
/proc/27081/task/27090/stat : 27090 (plingeling) R 27079 27081 26812 0 -1 4202560 3604 1253 0 0 290 0 0 0 25 0 5 0 594935387 187895808 17356 33554432000 4194304 4417332 140737467669488 18446744073709551615 4364713 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=27081/tid=27091] ppid=27079 vsize=183492 CPUtime=2.92 cores=0,2,4,6
/proc/27081/task/27091/stat : 27091 (plingeling) R 27079 27081 26812 0 -1 4202560 10491 1253 0 0 291 1 0 0 25 0 5 0 594935387 187895808 17356 33554432000 4194304 4417332 140737467669488 18446744073709551615 4250947 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 11.83
Current children cumulated vsize (KiB) 183492

[startup+6.30028 s]
/proc/loadavg: 7.85 8.02 7.97 9/186 27091
/proc/meminfo: memFree=13716848/32950928 swapFree=67111528/67111528
[pid=27081] ppid=27079 vsize=202872 CPUtime=24.62 cores=0,2,4,6
/proc/27081/stat : 27081 (plingeling) S 27079 27081 26812 0 -1 4202496 41440 1253 0 0 2457 5 0 0 25 0 5 0 594935369 207740928 22169 33554432000 4194304 4417332 140737467669488 18446744073709551615 218892367845 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/27081/statm: 50718 22169 180 55 0 48604 0
[pid=27081/tid=27088] ppid=27079 vsize=202872 CPUtime=6.11 cores=0,2,4,6
/proc/27081/task/27088/stat : 27088 (plingeling) R 27079 27081 26812 0 -1 4202560 3956 1253 0 0 611 0 0 0 25 0 5 0 594935387 207740928 22169 33554432000 4194304 4417332 140737467669488 18446744073709551615 4249143 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=27081/tid=27089] ppid=27079 vsize=202872 CPUtime=6.11 cores=0,2,4,6
/proc/27081/task/27089/stat : 27089 (plingeling) R 27079 27081 26812 0 -1 4202560 4617 1253 0 0 611 0 0 0 25 0 5 0 594935387 207740928 22169 33554432000 4194304 4417332 140737467669488 18446744073709551615 4249601 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=27081/tid=27090] ppid=27079 vsize=202872 CPUtime=6.08 cores=0,2,4,6
/proc/27081/task/27090/stat : 27090 (plingeling) R 27079 27081 26812 0 -1 4202560 3604 1253 0 0 608 0 0 0 25 0 5 0 594935387 207740928 22169 33554432000 4194304 4417332 140737467669488 18446744073709551615 4251100 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=27081/tid=27091] ppid=27079 vsize=202872 CPUtime=6.11 cores=0,2,4,6
/proc/27081/task/27091/stat : 27091 (plingeling) R 27079 27081 26812 0 -1 4202560 20444 1253 0 0 609 2 0 0 25 0 5 0 594935387 207740928 22169 33554432000 4194304 4417332 140737467669488 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 24.62
Current children cumulated vsize (KiB) 202872

[startup+12.7012 s]
/proc/loadavg: 7.86 8.02 7.97 9/186 27091
/proc/meminfo: memFree=13698588/32950928 swapFree=67111528/67111528
[pid=27081] ppid=27079 vsize=216364 CPUtime=50.18 cores=0,2,4,6
/proc/27081/stat : 27081 (plingeling) S 27079 27081 26812 0 -1 4202496 57826 1253 0 0 5011 7 0 0 25 0 5 0 594935369 221556736 25542 33554432000 4194304 4417332 140737467669488 18446744073709551615 218892367845 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/27081/statm: 54091 25542 180 55 0 51977 0
[pid=27081/tid=27088] ppid=27079 vsize=216364 CPUtime=12.51 cores=0,2,4,6
/proc/27081/task/27088/stat : 27088 (plingeling) R 27079 27081 26812 0 -1 4202560 5194 1253 0 0 1251 0 0 0 25 0 5 0 594935387 221556736 25542 33554432000 4194304 4417332 140737467669488 18446744073709551615 4249584 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=27081/tid=27089] ppid=27079 vsize=216364 CPUtime=12.51 cores=0,2,4,6
/proc/27081/task/27089/stat : 27089 (plingeling) R 27079 27081 26812 0 -1 4202560 5855 1253 0 0 1250 1 0 0 25 0 5 0 594935387 221556736 25542 33554432000 4194304 4417332 140737467669488 18446744073709551615 4335808 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=27081/tid=27090] ppid=27079 vsize=216364 CPUtime=12.45 cores=0,2,4,6
/proc/27081/task/27090/stat : 27090 (plingeling) R 27079 27081 26812 0 -1 4202560 3604 1253 0 0 1245 0 0 0 25 0 5 0 594935387 221556736 25542 33554432000 4194304 4417332 140737467669488 18446744073709551615 4236757 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=27081/tid=27091] ppid=27079 vsize=216364 CPUtime=12.51 cores=0,2,4,6
/proc/27081/task/27091/stat : 27091 (plingeling) R 27079 27081 26812 0 -1 4202560 34354 1253 0 0 1247 4 0 0 25 0 5 0 594935387 221556736 25542 33554432000 4194304 4417332 140737467669488 18446744073709551615 4364547 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 50.18
Current children cumulated vsize (KiB) 216364

[startup+25.5009 s]
/proc/loadavg: 7.96 8.03 7.98 9/186 27129
/proc/meminfo: memFree=14217216/32950928 swapFree=67111528/67111528
[pid=27081] ppid=27079 vsize=307720 CPUtime=101.32 cores=0,2,4,6
/proc/27081/stat : 27081 (plingeling) S 27079 27081 26812 0 -1 4202496 90644 1253 0 0 10121 11 0 0 25 0 5 0 594935369 315105280 48370 33554432000 4194304 4417332 140737467669488 18446744073709551615 218892367845 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/27081/statm: 76930 48370 180 55 0 74816 0
[pid=27081/tid=27088] ppid=27079 vsize=307720 CPUtime=25.3 cores=0,2,4,6
/proc/27081/task/27088/stat : 27088 (plingeling) R 27079 27081 26812 0 -1 4202560 5194 1253 0 0 2530 0 0 0 25 0 5 0 594935387 315105280 48370 33554432000 4194304 4417332 140737467669488 18446744073709551615 4364479 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=27081/tid=27089] ppid=27079 vsize=307720 CPUtime=25.31 cores=0,2,4,6
/proc/27081/task/27089/stat : 27089 (plingeling) R 27079 27081 26812 0 -1 4202560 5861 1253 0 0 2530 1 0 0 25 0 5 0 594935387 315105280 48370 33554432000 4194304 4417332 140737467669488 18446744073709551615 4251272 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=27081/tid=27090] ppid=27079 vsize=307720 CPUtime=25.18 cores=0,2,4,6
/proc/27081/task/27090/stat : 27090 (plingeling) R 27079 27081 26812 0 -1 4202560 4628 1253 0 0 2518 0 0 0 25 0 5 0 594935387 315105280 48370 33554432000 4194304 4417332 140737467669488 18446744073709551615 4364667 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=27081/tid=27091] ppid=27079 vsize=307720 CPUtime=25.31 cores=0,2,4,6
/proc/27081/task/27091/stat : 27091 (plingeling) R 27079 27081 26812 0 -1 4202560 66142 1253 0 0 2524 7 0 0 25 0 5 0 594935387 315105280 48370 33554432000 4194304 4417332 140737467669488 18446744073709551615 4364565 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 101.32
Current children cumulated vsize (KiB) 307720

[startup+51.1005 s]
/proc/loadavg: 8.05 8.04 7.98 9/186 27129
/proc/meminfo: memFree=13982488/32950928 swapFree=67111528/67111528
[pid=27081] ppid=27079 vsize=451488 CPUtime=203.58 cores=0,2,4,6
/proc/27081/stat : 27081 (plingeling) S 27079 27081 26812 0 -1 4202496 155122 1253 0 0 20338 20 0 0 25 0 5 0 594935369 462323712 84312 33554432000 4194304 4417332 140737467669488 18446744073709551615 218892367845 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/27081/statm: 112872 84312 180 55 0 110758 0
[pid=27081/tid=27088] ppid=27079 vsize=451488 CPUtime=50.9 cores=0,2,4,6
/proc/27081/task/27088/stat : 27088 (plingeling) R 27079 27081 26812 0 -1 4202560 6179 1253 0 0 5090 0 0 0 25 0 5 0 594935387 462323712 84312 33554432000 4194304 4417332 140737467669488 18446744073709551615 4364750 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=27081/tid=27089] ppid=27079 vsize=451488 CPUtime=50.91 cores=0,2,4,6
/proc/27081/task/27089/stat : 27089 (plingeling) R 27079 27081 26812 0 -1 4202560 6189 1253 0 0 5090 1 0 0 25 0 5 0 594935387 462323712 84312 33554432000 4194304 4417332 140737467669488 18446744073709551615 4364547 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=27081/tid=27090] ppid=27079 vsize=451488 CPUtime=50.66 cores=0,2,4,6
/proc/27081/task/27090/stat : 27090 (plingeling) R 27079 27081 26812 0 -1 4202560 4628 1253 0 0 5066 0 0 0 25 0 5 0 594935387 462323712 84312 33554432000 4194304 4417332 140737467669488 18446744073709551615 4249209 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=27081/tid=27091] ppid=27079 vsize=451488 CPUtime=50.9 cores=0,2,4,6
/proc/27081/task/27091/stat : 27091 (plingeling) R 27079 27081 26812 0 -1 4202560 129307 1253 0 0 5074 16 0 0 25 0 5 0 594935387 462323712 84312 33554432000 4194304 4417332 140737467669488 18446744073709551615 4364463 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 203.58
Current children cumulated vsize (KiB) 451488

[startup+102.307 s]
/proc/loadavg: 8.10 8.05 7.99 9/186 27131
/proc/meminfo: memFree=13664052/32950928 swapFree=67111528/67111528
[pid=27081] ppid=27079 vsize=529612 CPUtime=408.16 cores=0,2,4,6
/proc/27081/stat : 27081 (plingeling) S 27079 27081 26812 0 -1 4202496 216917 1253 0 0 40785 31 0 0 25 0 5 0 594935369 542322688 103844 33554432000 4194304 4417332 140737467669488 18446744073709551615 218892367845 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/27081/statm: 132403 103844 181 55 0 130289 0
[pid=27081/tid=27088] ppid=27079 vsize=529612 CPUtime=102.1 cores=0,2,4,6
/proc/27081/task/27088/stat : 27088 (plingeling) R 27079 27081 26812 0 -1 4202560 7094 1253 0 0 10210 0 0 0 25 0 5 0 594935387 542322688 103844 33554432000 4194304 4417332 140737467669488 18446744073709551615 4364724 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=27081/tid=27089] ppid=27079 vsize=529612 CPUtime=102.11 cores=0,2,4,6
/proc/27081/task/27089/stat : 27089 (plingeling) R 27079 27081 26812 0 -1 4202560 7104 1253 0 0 10210 1 0 0 25 0 5 0 594935387 542322688 103844 33554432000 4194304 4417332 140737467669488 18446744073709551615 4364547 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=27081/tid=27090] ppid=27079 vsize=529612 CPUtime=101.62 cores=0,2,4,6
/proc/27081/task/27090/stat : 27090 (plingeling) R 27079 27081 26812 0 -1 4202560 4629 1253 0 0 10162 0 0 0 25 0 5 0 594935387 542322688 103844 33554432000 4194304 4417332 140737467669488 18446744073709551615 4248923 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=27081/tid=27091] ppid=27079 vsize=529612 CPUtime=102.11 cores=0,2,4,6
/proc/27081/task/27091/stat : 27091 (plingeling) R 27079 27081 26812 0 -1 4202560 189271 1253 0 0 10185 26 0 0 25 0 5 0 594935387 542322688 103844 33554432000 4194304 4417332 140737467669488 18446744073709551615 4365960 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 408.16
Current children cumulated vsize (KiB) 529612

[startup+162.301 s]
/proc/loadavg: 8.16 8.07 8.00 9/186 27132
/proc/meminfo: memFree=13466256/32950928 swapFree=67111528/67111528
[pid=27081] ppid=27079 vsize=676684 CPUtime=647.85 cores=0,2,4,6
/proc/27081/stat : 27081 (plingeling) S 27079 27081 26812 0 -1 4202496 307635 1253 0 0 64740 45 0 0 25 0 5 0 594935369 692924416 140612 33554432000 4194304 4417332 140737467669488 18446744073709551615 218892367845 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/27081/statm: 169171 140612 181 55 0 167057 0
[pid=27081/tid=27088] ppid=27079 vsize=676684 CPUtime=162.11 cores=0,2,4,6
/proc/27081/task/27088/stat : 27088 (plingeling) R 27079 27081 26812 0 -1 4202560 7375 1253 0 0 16210 1 0 0 25 0 5 0 594935387 692924416 140612 33554432000 4194304 4417332 140737467669488 18446744073709551615 4364560 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=27081/tid=27089] ppid=27079 vsize=676684 CPUtime=162.11 cores=0,2,4,6
/proc/27081/task/27089/stat : 27089 (plingeling) R 27079 27081 26812 0 -1 4202560 7385 1253 0 0 16210 1 0 0 25 0 5 0 594935387 692924416 140612 33554432000 4194304 4417332 140737467669488 18446744073709551615 4277864 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=27081/tid=27090] ppid=27079 vsize=676684 CPUtime=161.32 cores=0,2,4,6
/proc/27081/task/27090/stat : 27090 (plingeling) R 27079 27081 26812 0 -1 4202560 4629 1253 0 0 16132 0 0 0 25 0 5 0 594935387 692924416 140612 33554432000 4194304 4417332 140737467669488 18446744073709551615 4277571 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=27081/tid=27091] ppid=27079 vsize=676684 CPUtime=162.1 cores=0,2,4,6
/proc/27081/task/27091/stat : 27091 (plingeling) R 27079 27081 26812 0 -1 4202560 279427 1253 0 0 16170 40 0 0 25 0 5 0 594935387 692924416 140612 33554432000 4194304 4417332 140737467669488 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 647.85
Current children cumulated vsize (KiB) 676684


################
# More data... #
################

[pid=27081/tid=27089] ppid=27079 vsize=1761384 CPUtime=702.11 cores=0,2,4,6
/proc/27081/task/27089/stat : 27089 (plingeling) R 27079 27081 26812 0 -1 4202560 48319 1253 0 0 70205 6 0 0 25 0 5 0 594935387 1803657216 411791 33554432000 4194304 4417332 140737467669488 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=27081/tid=27090] ppid=27079 vsize=1761384 CPUtime=698.52 cores=0,2,4,6
/proc/27081/task/27090/stat : 27090 (plingeling) R 27079 27081 26812 0 -1 4202560 33453 1253 0 0 69847 5 0 0 25 0 5 0 594935387 1803657216 411791 33554432000 4194304 4417332 140737467669488 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=27081/tid=27091] ppid=27079 vsize=1761384 CPUtime=702.06 cores=0,2,4,6
/proc/27081/task/27091/stat : 27091 (plingeling) R 27079 27081 26812 0 -1 4202560 757876 1253 0 0 70087 119 0 0 25 0 5 0 594935387 1803657216 411791 33554432000 4194304 4417332 140737467669488 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 2805.01
Current children cumulated vsize (KiB) 1761384

[startup+762.306 s]
/proc/loadavg: 8.17 8.13 8.04 9/186 27148
/proc/meminfo: memFree=11570668/32950928 swapFree=67111528/67111528
[pid=27081] ppid=27079 vsize=1793796 CPUtime=3044.71 cores=0,2,4,6
/proc/27081/stat : 27081 (plingeling) S 27079 27081 26812 0 -1 4202496 908756 1253 0 0 304333 138 0 0 25 0 5 0 594935369 1836847104 419894 33554432000 4194304 4417332 140737467669488 18446744073709551615 218892367845 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/27081/statm: 448449 419894 181 55 0 446335 0
[pid=27081/tid=27088] ppid=27079 vsize=1793796 CPUtime=762.12 cores=0,2,4,6
/proc/27081/task/27088/stat : 27088 (plingeling) R 27079 27081 26812 0 -1 4202560 43579 1253 0 0 76207 5 0 0 25 0 5 0 594935387 1836847104 419894 33554432000 4194304 4417332 140737467669488 18446744073709551615 4366359 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=27081/tid=27089] ppid=27079 vsize=1793796 CPUtime=762.12 cores=0,2,4,6
/proc/27081/task/27089/stat : 27089 (plingeling) R 27079 27081 26812 0 -1 4202560 54200 1253 0 0 76205 7 0 0 25 0 5 0 594935387 1836847104 419894 33554432000 4194304 4417332 140737467669488 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=27081/tid=27090] ppid=27079 vsize=1793796 CPUtime=758.21 cores=0,2,4,6
/proc/27081/task/27090/stat : 27090 (plingeling) R 27079 27081 26812 0 -1 4202560 33453 1253 0 0 75816 5 0 0 25 0 5 0 594935387 1836847104 419894 33554432000 4194304 4417332 140737467669488 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=27081/tid=27091] ppid=27079 vsize=1793796 CPUtime=762.06 cores=0,2,4,6
/proc/27081/task/27091/stat : 27091 (plingeling) R 27079 27081 26812 0 -1 4202560 768705 1253 0 0 76086 120 0 0 25 0 5 0 594935387 1836847104 419894 33554432000 4194304 4417332 140737467669488 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3044.71
Current children cumulated vsize (KiB) 1793796

[startup+822.301 s]
/proc/loadavg: 8.16 8.13 8.04 9/186 27150
/proc/meminfo: memFree=11920444/32950928 swapFree=67111528/67111528
[pid=27081] ppid=27079 vsize=1219116 CPUtime=3284.37 cores=0,2,4,6
/proc/27081/stat : 27081 (plingeling) S 27079 27081 26812 0 -1 4202496 1027827 1253 0 0 328282 155 0 0 25 0 5 0 594935369 1248374784 276224 33554432000 4194304 4417332 140737467669488 18446744073709551615 218892367845 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/27081/statm: 304779 276224 181 55 0 302665 0
[pid=27081/tid=27088] ppid=27079 vsize=1219116 CPUtime=822.12 cores=0,2,4,6
/proc/27081/task/27088/stat : 27088 (plingeling) R 27079 27081 26812 0 -1 4202560 43812 1253 0 0 82207 5 0 0 25 0 5 0 594935387 1248374784 276224 33554432000 4194304 4417332 140737467669488 18446744073709551615 4365104 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=27081/tid=27089] ppid=27079 vsize=1219116 CPUtime=822.12 cores=0,2,4,6
/proc/27081/task/27089/stat : 27089 (plingeling) R 27079 27081 26812 0 -1 4202560 54200 1253 0 0 82205 7 0 0 25 0 5 0 594935387 1248374784 276224 33554432000 4194304 4417332 140737467669488 18446744073709551615 4310191 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=27081/tid=27090] ppid=27079 vsize=1219116 CPUtime=817.89 cores=0,2,4,6
/proc/27081/task/27090/stat : 27090 (plingeling) R 27079 27081 26812 0 -1 4202560 33453 1253 0 0 81784 5 0 0 25 0 5 0 594935387 1248374784 276224 33554432000 4194304 4417332 140737467669488 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=27081/tid=27091] ppid=27079 vsize=1219116 CPUtime=822.05 cores=0,2,4,6
/proc/27081/task/27091/stat : 27091 (plingeling) R 27079 27081 26812 0 -1 4202560 887543 1253 0 0 82069 136 0 0 25 0 5 0 594935387 1248374784 276224 33554432000 4194304 4417332 140737467669488 18446744073709551615 4364544 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3284.37
Current children cumulated vsize (KiB) 1219116

[startup+882.301 s]
/proc/loadavg: 8.11 8.12 8.04 9/186 27152
/proc/meminfo: memFree=11807096/32950928 swapFree=67111528/67111528
[pid=27081] ppid=27079 vsize=1333288 CPUtime=3524.05 cores=0,2,4,6
/proc/27081/stat : 27081 (plingeling) S 27079 27081 26812 0 -1 4202496 1076540 1253 0 0 352245 160 0 0 25 0 5 0 594935369 1365286912 304767 33554432000 4194304 4417332 140737467669488 18446744073709551615 218892367845 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/27081/statm: 333322 304767 181 55 0 331208 0
[pid=27081/tid=27088] ppid=27079 vsize=1333288 CPUtime=882.11 cores=0,2,4,6
/proc/27081/task/27088/stat : 27088 (plingeling) R 27079 27081 26812 0 -1 4202560 47526 1253 0 0 88206 5 0 0 25 0 5 0 594935387 1365286912 304767 33554432000 4194304 4417332 140737467669488 18446744073709551615 4232721 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=27081/tid=27089] ppid=27079 vsize=1333288 CPUtime=882.12 cores=0,2,4,6
/proc/27081/task/27089/stat : 27089 (plingeling) R 27079 27081 26812 0 -1 4202560 56146 1253 0 0 88205 7 0 0 25 0 5 0 594935387 1365286912 304767 33554432000 4194304 4417332 140737467669488 18446744073709551615 4343906 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=27081/tid=27090] ppid=27079 vsize=1333288 CPUtime=877.56 cores=0,2,4,6
/proc/27081/task/27090/stat : 27090 (plingeling) R 27079 27081 26812 0 -1 4202560 37549 1253 0 0 87751 5 0 0 25 0 5 0 594935387 1365286912 304767 33554432000 4194304 4417332 140737467669488 18446744073709551615 4364498 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=27081/tid=27091] ppid=27079 vsize=1333288 CPUtime=882.05 cores=0,2,4,6
/proc/27081/task/27091/stat : 27091 (plingeling) R 27079 27081 26812 0 -1 4202560 926500 1253 0 0 88065 140 0 0 25 0 5 0 594935387 1365286912 304767 33554432000 4194304 4417332 140737467669488 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3524.05
Current children cumulated vsize (KiB) 1333288

[startup+942.301 s]
/proc/loadavg: 8.09 8.11 8.04 9/186 27153
/proc/meminfo: memFree=11300168/32950928 swapFree=67111528/67111528
[pid=27081] ppid=27079 vsize=1429616 CPUtime=3763.73 cores=0,2,4,6
/proc/27081/stat : 27081 (plingeling) S 27079 27081 26812 0 -1 4202496 1100622 1253 0 0 376210 163 0 0 25 0 5 0 594935369 1463926784 328849 33554432000 4194304 4417332 140737467669488 18446744073709551615 218892367845 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/27081/statm: 357404 328849 181 55 0 355290 0
[pid=27081/tid=27088] ppid=27079 vsize=1429616 CPUtime=942.11 cores=0,2,4,6
/proc/27081/task/27088/stat : 27088 (plingeling) R 27079 27081 26812 0 -1 4202560 47526 1253 0 0 94206 5 0 0 25 0 5 0 594935387 1463926784 328849 33554432000 4194304 4417332 140737467669488 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=27081/tid=27089] ppid=27079 vsize=1429616 CPUtime=941.85 cores=0,2,4,6
/proc/27081/task/27089/stat : 27089 (plingeling) R 27079 27081 26812 0 -1 4202560 67638 1253 0 0 94176 9 0 0 25 0 5 0 594935387 1463926784 328849 33554432000 4194304 4417332 140737467669488 18446744073709551615 4357187 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=27081/tid=27090] ppid=27079 vsize=1429616 CPUtime=937.51 cores=0,2,4,6
/proc/27081/task/27090/stat : 27090 (plingeling) R 27079 27081 26812 0 -1 4202560 37549 1253 0 0 93746 5 0 0 25 0 5 0 594935387 1463926784 328849 33554432000 4194304 4417332 140737467669488 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=27081/tid=27091] ppid=27079 vsize=1429616 CPUtime=942.04 cores=0,2,4,6
/proc/27081/task/27091/stat : 27091 (plingeling) R 27079 27081 26812 0 -1 4202560 939090 1253 0 0 94063 141 0 0 25 0 5 0 594935387 1463926784 328849 33554432000 4194304 4417332 140737467669488 18446744073709551615 4364656 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3763.73
Current children cumulated vsize (KiB) 1429616

[startup+1002.3 s]
/proc/loadavg: 8.14 8.12 8.04 9/186 27155
/proc/meminfo: memFree=10966100/32950928 swapFree=67111528/67111528
[pid=27081] ppid=27079 vsize=1497460 CPUtime=4003.41 cores=0,2,4,6
/proc/27081/stat : 27081 (plingeling) S 27079 27081 26812 0 -1 4202496 1117583 1253 0 0 400177 164 0 0 25 0 5 0 594935369 1533399040 345810 33554432000 4194304 4417332 140737467669488 18446744073709551615 218892367845 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/27081/statm: 374365 345810 181 55 0 372251 0
[pid=27081/tid=27088] ppid=27079 vsize=1497460 CPUtime=1002.11 cores=0,2,4,6
/proc/27081/task/27088/stat : 27088 (plingeling) R 27079 27081 26812 0 -1 4202560 47526 1253 0 0 100206 5 0 0 25 0 5 0 594935387 1533399040 345810 33554432000 4194304 4417332 140737467669488 18446744073709551615 4365485 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=27081/tid=27089] ppid=27079 vsize=1497460 CPUtime=1001.53 cores=0,2,4,6
/proc/27081/task/27089/stat : 27089 (plingeling) R 27079 27081 26812 0 -1 4202560 75803 1253 0 0 100144 9 0 0 25 0 5 0 594935387 1533399040 345810 33554432000 4194304 4417332 140737467669488 18446744073709551615 4354410 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=27081/tid=27090] ppid=27079 vsize=1497460 CPUtime=997.51 cores=0,2,4,6
/proc/27081/task/27090/stat : 27090 (plingeling) R 27079 27081 26812 0 -1 4202560 37549 1253 0 0 99746 5 0 0 25 0 5 0 594935387 1533399040 345810 33554432000 4194304 4417332 140737467669488 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=27081/tid=27091] ppid=27079 vsize=1497460 CPUtime=1002.04 cores=0,2,4,6
/proc/27081/task/27091/stat : 27091 (plingeling) R 27079 27081 26812 0 -1 4202560 947886 1253 0 0 100062 142 0 0 25 0 5 0 594935387 1533399040 345810 33554432000 4194304 4417332 140737467669488 18446744073709551615 4364465 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4003.41
Current children cumulated vsize (KiB) 1497460

[startup+1062.3 s]
/proc/loadavg: 8.12 8.11 8.04 9/186 27156
/proc/meminfo: memFree=10619268/32950928 swapFree=67111528/67111528
[pid=27081] ppid=27079 vsize=1738308 CPUtime=4243.09 cores=0,2,4,6
/proc/27081/stat : 27081 (plingeling) S 27079 27081 26812 0 -1 4202496 1192020 1253 0 0 424137 172 0 0 25 0 5 0 594935369 1780027392 406054 33554432000 4194304 4417332 140737467669488 18446744073709551615 218892367845 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/27081/statm: 434577 406054 181 55 0 432463 0
[pid=27081/tid=27088] ppid=27079 vsize=1738308 CPUtime=1062.11 cores=0,2,4,6
/proc/27081/task/27088/stat : 27088 (plingeling) R 27079 27081 26812 0 -1 4202560 47526 1253 0 0 106206 5 0 0 25 0 5 0 594935387 1780027392 406054 33554432000 4194304 4417332 140737467669488 18446744073709551615 4251289 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=27081/tid=27089] ppid=27079 vsize=1738308 CPUtime=1061.22 cores=0,2,4,6
/proc/27081/task/27089/stat : 27089 (plingeling) R 27079 27081 26812 0 -1 4202560 75803 1253 0 0 106112 10 0 0 25 0 5 0 594935387 1780027392 406054 33554432000 4194304 4417332 140737467669488 18446744073709551615 4364734 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=27081/tid=27090] ppid=27079 vsize=1738308 CPUtime=1057.52 cores=0,2,4,6
/proc/27081/task/27090/stat : 27090 (plingeling) R 27079 27081 26812 0 -1 4202560 37549 1253 0 0 105747 5 0 0 25 0 5 0 594935387 1780027392 406054 33554432000 4194304 4417332 140737467669488 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=27081/tid=27091] ppid=27079 vsize=1738308 CPUtime=1062.03 cores=0,2,4,6
/proc/27081/task/27091/stat : 27091 (plingeling) R 27079 27081 26812 0 -1 4202560 1022323 1253 0 0 106054 149 0 0 25 0 5 0 594935387 1780027392 406054 33554432000 4194304 4417332 140737467669488 18446744073709551615 4365960 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4243.09
Current children cumulated vsize (KiB) 1738308

[startup+1122.3 s]
/proc/loadavg: 8.11 8.10 8.04 9/186 27158
/proc/meminfo: memFree=10241288/32950928 swapFree=67111528/67111528
[pid=27081] ppid=27079 vsize=1743692 CPUtime=4482.77 cores=0,2,4,6
/proc/27081/stat : 27081 (plingeling) S 27079 27081 26812 0 -1 4202496 1207701 1253 0 0 448103 174 0 0 25 0 5 0 594935369 1785540608 407368 33554432000 4194304 4417332 140737467669488 18446744073709551615 218892367845 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/27081/statm: 435923 407368 181 55 0 433809 0
[pid=27081/tid=27088] ppid=27079 vsize=1743692 CPUtime=1122.12 cores=0,2,4,6
/proc/27081/task/27088/stat : 27088 (plingeling) R 27079 27081 26812 0 -1 4202560 59910 1253 0 0 112205 7 0 0 25 0 5 0 594935387 1785540608 407368 33554432000 4194304 4417332 140737467669488 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=27081/tid=27089] ppid=27079 vsize=1743692 CPUtime=1120.9 cores=0,2,4,6
/proc/27081/task/27089/stat : 27089 (plingeling) R 27079 27081 26812 0 -1 4202560 79100 1253 0 0 112080 10 0 0 25 0 5 0 594935387 1785540608 407368 33554432000 4194304 4417332 140737467669488 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=27081/tid=27090] ppid=27079 vsize=1743692 CPUtime=1117.51 cores=0,2,4,6
/proc/27081/task/27090/stat : 27090 (plingeling) R 27079 27081 26812 0 -1 4202560 37549 1253 0 0 111746 5 0 0 25 0 5 0 594935387 1785540608 407368 33554432000 4194304 4417332 140737467669488 18446744073709551615 4366384 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=27081/tid=27091] ppid=27079 vsize=1743692 CPUtime=1122.02 cores=0,2,4,6
/proc/27081/task/27091/stat : 27091 (plingeling) R 27079 27081 26812 0 -1 4202560 1022323 1253 0 0 112053 149 0 0 25 0 5 0 594935387 1785540608 407368 33554432000 4194304 4417332 140737467669488 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4482.77
Current children cumulated vsize (KiB) 1743692

[startup+1182.3 s]
/proc/loadavg: 8.04 8.08 8.04 9/186 27160
/proc/meminfo: memFree=11557528/32950928 swapFree=67111528/67111528
[pid=27081] ppid=27079 vsize=1785212 CPUtime=4722.45 cores=0,2,4,6
/proc/27081/stat : 27081 (plingeling) S 27079 27081 26812 0 -1 4202496 1218081 1253 0 0 472070 175 0 0 25 0 5 0 594935369 1828057088 417748 33554432000 4194304 4417332 140737467669488 18446744073709551615 218892367845 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/27081/statm: 446303 417748 181 55 0 444189 0
[pid=27081/tid=27088] ppid=27079 vsize=1785212 CPUtime=1182.12 cores=0,2,4,6
/proc/27081/task/27088/stat : 27088 (plingeling) R 27079 27081 26812 0 -1 4202560 66439 1253 0 0 118205 7 0 0 25 0 5 0 594935387 1828057088 417748 33554432000 4194304 4417332 140737467669488 18446744073709551615 4364732 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=27081/tid=27089] ppid=27079 vsize=1785212 CPUtime=1180.59 cores=0,2,4,6
/proc/27081/task/27089/stat : 27089 (plingeling) R 27079 27081 26812 0 -1 4202560 82951 1253 0 0 118048 11 0 0 25 0 5 0 594935387 1828057088 417748 33554432000 4194304 4417332 140737467669488 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=27081/tid=27090] ppid=27079 vsize=1785212 CPUtime=1177.51 cores=0,2,4,6
/proc/27081/task/27090/stat : 27090 (plingeling) R 27079 27081 26812 0 -1 4202560 37549 1253 0 0 117746 5 0 0 25 0 5 0 594935387 1828057088 417748 33554432000 4194304 4417332 140737467669488 18446744073709551615 4366359 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=27081/tid=27091] ppid=27079 vsize=1785212 CPUtime=1182.02 cores=0,2,4,6
/proc/27081/task/27091/stat : 27091 (plingeling) R 27079 27081 26812 0 -1 4202560 1022323 1253 0 0 118053 149 0 0 25 0 5 0 594935387 1828057088 417748 33554432000 4194304 4417332 140737467669488 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4722.45
Current children cumulated vsize (KiB) 1785212



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.8 s]
/proc/loadavg: 8.03 8.08 8.04 9/186 27160
/proc/meminfo: memFree=11435380/32950928 swapFree=67111528/67111528
[pid=27081] ppid=27079 vsize=1894364 CPUtime=4800.37 cores=0,2,4,6
/proc/27081/stat : 27081 (plingeling) S 27079 27081 26812 0 -1 4202496 1245369 1253 0 0 479856 181 0 0 25 0 5 0 594935369 1939828736 445036 33554432000 4194304 4417332 140737467669488 18446744073709551615 218892367845 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/27081/statm: 473591 445036 181 55 0 471477 0
[pid=27081/tid=27088] ppid=27079 vsize=1894364 CPUtime=1201.62 cores=0,2,4,6
/proc/27081/task/27088/stat : 27088 (plingeling) R 27079 27081 26812 0 -1 4202560 66439 1253 0 0 120155 7 0 0 25 0 5 0 594935387 1939828736 445036 33554432000 4194304 4417332 140737467669488 18446744073709551615 4346410 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=27081/tid=27089] ppid=27079 vsize=1894364 CPUtime=1199.99 cores=0,2,4,6
/proc/27081/task/27089/stat : 27089 (plingeling) R 27079 27081 26812 0 -1 4202560 82951 1253 0 0 119988 11 0 0 25 0 5 0 594935387 1939828736 445036 33554432000 4194304 4417332 140737467669488 18446744073709551615 4364549 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=27081/tid=27090] ppid=27079 vsize=1894364 CPUtime=1197.02 cores=0,2,4,6
/proc/27081/task/27090/stat : 27090 (plingeling) R 27079 27081 26812 0 -1 4202560 37549 1253 0 0 119697 5 0 0 25 0 5 0 594935387 1939828736 445036 33554432000 4194304 4417332 140737467669488 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=27081/tid=27091] ppid=27079 vsize=1894364 CPUtime=1201.53 cores=0,2,4,6
/proc/27081/task/27091/stat : 27091 (plingeling) R 27079 27081 26812 0 -1 4202560 1049611 1253 0 0 119998 155 0 0 25 0 5 0 594935387 1939828736 445036 33554432000 4194304 4417332 140737467669488 18446744073709551615 4364556 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4800.37
Current children cumulated vsize (KiB) 1894364

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1201.89
CPU time (s): 4800.48
CPU user time (s): 4798.59
CPU system time (s): 1.89871
CPU usage (%): 399.412
Max. virtual memory (cumulated for all children) (KiB): 1894364

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4798.59
system time used= 1.89871
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1246622
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 199
involuntary context switches= 24339

runsolver used 1.92771 second user time and 4.33034 second system time

The end

Launcher Data 

Begin job on node112 at 2011-04-29 05:17:27
IDJOB=3257722
IDBENCH=71269
IDSOLVER=1605
FILE ID=node112/3257722-1304047047
RUNJOBID= node112-1304045841-26830
PBS_JOBID= 13170402
Free space on /tmp= 72560 MiB

SOLVER NAME= Plingeling 587
BENCH NAME= SAT09/CRAFTED/rbsat/random/unforced/rbsat-v2400c266431g3.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3257722-1304047047/watcher-3257722-1304047047 -o /tmp/evaluation-result-3257722-1304047047/solver-3257722-1304047047 -C 4800 -W 1300 -M 15500  plingeling -t 4 HOME/instance-3257722-1304047047.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 231f625a25c77518fbce98fe99f807b5
RANDOM SEED=2138626465

node112.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5261.27
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.93
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      13797144 kB
Buffers:       1994760 kB
Cached:       15801320 kB
SwapCached:          0 kB
Active:        7829680 kB
Inactive:     10767732 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      13797144 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:            3520 kB
Writeback:          20 kB
AnonPages:      800504 kB
Mapped:          15300 kB
Slab:           492264 kB
PageTables:       5924 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   987240 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72560 MiB
End job on node112 at 2011-04-29 05:37:31