Trace number 3372281

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587f (fixed)UNSAT 936.969 117.821

General information on the benchmark

NameAPPLICATIONS/bioinfo/
q_query_3_l46_lambda.cnf
MD5SUMeb4d0d02a25a8a84182ddd3b6d1fa8b5
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark79.111
Satisfiable
(Un)Satisfiability was proved
Number of variables33090
Number of clauses165828
Sum of the clauses size478271
Maximum clause length9
Minimum clause length1
Number of clauses of size 14268
Number of clauses of size 241089
Number of clauses of size 397665
Number of clauses of size 415752
Number of clauses of size 56916
Number of clauses of size over 5138

Solver Data 

936.93/117.82	s UNSATISFIABLE

Verifier Data 

No possible verification on an UNSAT instance

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3372281-1305437127/watcher-3372281-1305437127 -o /tmp/evaluation-result-3372281-1305437127/solver-3372281-1305437127 -C 40000 -W 5100 -M 31000 plingeling -t 8 HOME/instance-3372281-1305437127.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.07 5.02 4.34 2/378 6261
/proc/meminfo: memFree=26852412/32950928 swapFree=44388876/67111528
[pid=6261] ppid=6259 vsize=10656 CPUtime=0 cores=0-7
/proc/6261/stat : 6261 (plingeling) R 6259 6261 6192 0 -1 4202496 757 1257 0 0 0 0 0 0 25 0 1 0 655311368 10911744 687 33554432000 4194304 4417452 140734812804960 18446744073709551615 251814240000 0 0 4096 17442 0 0 0 17 0 0 0 0
/proc/6261/statm: 2664 687 148 55 0 550 0

[startup+0.0355069 s]
/proc/loadavg: 7.07 5.02 4.34 2/378 6261
/proc/meminfo: memFree=26852412/32950928 swapFree=44388876/67111528
[pid=6261] ppid=6259 vsize=19300 CPUtime=0.02 cores=0-7
/proc/6261/stat : 6261 (plingeling) R 6259 6261 6192 0 -1 4202496 2919 1257 0 0 2 0 0 0 25 0 1 0 655311368 19763200 2849 33554432000 4194304 4417452 140734812804960 18446744073709551615 4209566 0 0 4096 17442 0 0 0 17 0 0 0 0
/proc/6261/statm: 4825 2849 149 55 0 2711 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 19300

[startup+0.100478 s]
/proc/loadavg: 7.07 5.02 4.34 2/378 6261
/proc/meminfo: memFree=26852412/32950928 swapFree=44388876/67111528
[pid=6261] ppid=6259 vsize=30168 CPUtime=0.08 cores=0-7
/proc/6261/stat : 6261 (plingeling) R 6259 6261 6192 0 -1 4202496 5620 1257 0 0 8 0 0 0 25 0 1 0 655311368 30892032 5550 33554432000 4194304 4417452 140734812804960 18446744073709551615 4264940 0 0 4096 17442 0 0 0 17 0 0 0 0
/proc/6261/statm: 7542 5550 149 55 0 5428 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 30168

[startup+0.300449 s]
/proc/loadavg: 7.07 5.02 4.34 2/378 6261
/proc/meminfo: memFree=26852412/32950928 swapFree=44388876/67111528
[pid=6261] ppid=6259 vsize=66560 CPUtime=0.29 cores=0-7
/proc/6261/stat : 6261 (plingeling) R 6259 6261 6192 0 -1 4202496 14718 1257 0 0 28 1 0 0 25 0 1 0 655311368 68157440 14648 33554432000 4194304 4417452 140734812804960 18446744073709551615 4264940 0 0 4096 17442 0 0 0 17 0 0 0 0
/proc/6261/statm: 16640 14648 149 55 0 14526 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 66560

[startup+0.700316 s]
/proc/loadavg: 7.07 5.02 4.34 2/378 6261
/proc/meminfo: memFree=26852412/32950928 swapFree=44388876/67111528
[pid=6261] ppid=6259 vsize=318236 CPUtime=2.03 cores=0-7
/proc/6261/stat : 6261 (plingeling) S 6259 6261 6192 0 -1 4202496 35472 1257 0 0 199 4 0 0 25 0 9 0 655311368 325873664 26287 33554432000 4194304 4417452 140734812804960 18446744073709551615 251826042853 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/6261/statm: 79559 26287 175 55 0 77445 0
Current children cumulated CPU time (s) 2.03
Current children cumulated vsize (KiB) 318236

[startup+1.50118 s]
/proc/loadavg: 7.07 5.02 4.34 9/387 6275
/proc/meminfo: memFree=26745336/32950928 swapFree=44388876/67111528
[pid=6261] ppid=6259 vsize=316004 CPUtime=8.43 cores=0-7
/proc/6261/stat : 6261 (plingeling) S 6259 6261 6192 0 -1 4202496 46250 1257 0 0 837 6 0 0 25 0 9 0 655311368 323588096 26569 33554432000 4194304 4417452 140734812804960 18446744073709551615 251826042853 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/6261/statm: 79001 26569 176 55 0 76887 0
[pid=6261/tid=6268] ppid=6259 vsize=316004 CPUtime=1.03 cores=0-7
/proc/6261/task/6268/stat : 6268 (plingeling) R 6259 6261 6192 0 -1 4202560 717 1257 0 0 103 0 0 0 19 0 9 0 655311413 323588096 26569 33554432000 4194304 4417452 140734812804960 18446744073709551615 4293100 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=6261/tid=6269] ppid=6259 vsize=316004 CPUtime=1.03 cores=0-7
/proc/6261/task/6269/stat : 6269 (plingeling) R 6259 6261 6192 0 -1 4202560 8066 1257 0 0 103 0 0 0 19 0 9 0 655311413 323588096 26569 33554432000 4194304 4417452 140734812804960 18446744073709551615 4277579 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=6261/tid=6270] ppid=6259 vsize=316004 CPUtime=1.02 cores=0-7
/proc/6261/task/6270/stat : 6270 (plingeling) R 6259 6261 6192 0 -1 4202560 1315 1257 0 0 102 0 0 0 19 0 9 0 655311413 323588096 26569 33554432000 4194304 4417452 140734812804960 18446744073709551615 4281423 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=6261/tid=6271] ppid=6259 vsize=316004 CPUtime=1.03 cores=0-7
/proc/6261/task/6271/stat : 6271 (plingeling) R 6259 6261 6192 0 -1 4202560 508 1257 0 0 103 0 0 0 19 0 9 0 655311413 323588096 26569 33554432000 4194304 4417452 140734812804960 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=6261/tid=6272] ppid=6259 vsize=316004 CPUtime=0.86 cores=0-7
/proc/6261/task/6272/stat : 6272 (plingeling) R 6259 6261 6192 0 -1 4202560 3705 1257 0 0 86 0 0 0 25 0 9 0 655311413 323588096 26569 33554432000 4194304 4417452 140734812804960 18446744073709551615 4287486 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=6261/tid=6273] ppid=6259 vsize=316004 CPUtime=1.02 cores=0-7
/proc/6261/task/6273/stat : 6273 (plingeling) R 6259 6261 6192 0 -1 4202560 1509 1257 0 0 102 0 0 0 19 0 9 0 655311413 323588096 26569 33554432000 4194304 4417452 140734812804960 18446744073709551615 4292119 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=6261/tid=6274] ppid=6259 vsize=316004 CPUtime=1.01 cores=0-7
/proc/6261/task/6274/stat : 6274 (plingeling) R 6259 6261 6192 0 -1 4202560 1839 1257 0 0 101 0 0 0 19 0 9 0 655311414 323588096 26569 33554432000 4194304 4417452 140734812804960 18446744073709551615 4288259 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=6261/tid=6275] ppid=6259 vsize=316004 CPUtime=0.93 cores=0-7
/proc/6261/task/6275/stat : 6275 (plingeling) R 6259 6261 6192 0 -1 4202560 840 1257 0 0 93 0 0 0 25 0 9 0 655311415 323588096 26569 33554432000 4194304 4417452 140734812804960 18446744073709551615 4291497 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 8.43
Current children cumulated vsize (KiB) 316004

[startup+3.10091 s]
/proc/loadavg: 7.07 5.02 4.34 9/387 6275
/proc/meminfo: memFree=26745584/32950928 swapFree=44388876/67111528
[pid=6261] ppid=6259 vsize=306668 CPUtime=21.2 cores=0-7
/proc/6261/stat : 6261 (plingeling) S 6259 6261 6192 0 -1 4202496 54799 1257 0 0 2113 7 0 0 25 0 9 0 655311368 314028032 22819 33554432000 4194304 4417452 140734812804960 18446744073709551615 251826042853 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/6261/statm: 76667 22819 180 55 0 74553 0
[pid=6261/tid=6268] ppid=6259 vsize=306668 CPUtime=2.63 cores=0-7
/proc/6261/task/6268/stat : 6268 (plingeling) R 6259 6261 6192 0 -1 4202560 2069 1257 0 0 263 0 0 0 22 0 9 0 655311413 314028032 22819 33554432000 4194304 4417452 140734812804960 18446744073709551615 4357244 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=6261/tid=6269] ppid=6259 vsize=306668 CPUtime=2.63 cores=0-7
/proc/6261/task/6269/stat : 6269 (plingeling) R 6259 6261 6192 0 -1 4202560 9310 1257 0 0 262 1 0 0 22 0 9 0 655311413 314028032 22819 33554432000 4194304 4417452 140734812804960 18446744073709551615 4237332 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=6261/tid=6270] ppid=6259 vsize=306668 CPUtime=2.62 cores=0-7
/proc/6261/task/6270/stat : 6270 (plingeling) R 6259 6261 6192 0 -1 4202560 2249 1257 0 0 262 0 0 0 22 0 9 0 655311413 314028032 22819 33554432000 4194304 4417452 140734812804960 18446744073709551615 4278203 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=6261/tid=6271] ppid=6259 vsize=306668 CPUtime=2.63 cores=0-7
/proc/6261/task/6271/stat : 6271 (plingeling) R 6259 6261 6192 0 -1 4202560 508 1257 0 0 263 0 0 0 22 0 9 0 655311413 314028032 22819 33554432000 4194304 4417452 140734812804960 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=6261/tid=6272] ppid=6259 vsize=306668 CPUtime=2.44 cores=0-7
/proc/6261/task/6272/stat : 6272 (plingeling) R 6259 6261 6192 0 -1 4202560 5305 1257 0 0 244 0 0 0 25 0 9 0 655311413 314028032 22819 33554432000 4194304 4417452 140734812804960 18446744073709551615 4258370 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=6261/tid=6273] ppid=6259 vsize=306668 CPUtime=2.62 cores=0-7
/proc/6261/task/6273/stat : 6273 (plingeling) R 6259 6261 6192 0 -1 4202560 3340 1257 0 0 262 0 0 0 22 0 9 0 655311413 314028032 22819 33554432000 4194304 4417452 140734812804960 18446744073709551615 4249228 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=6261/tid=6274] ppid=6259 vsize=306668 CPUtime=2.61 cores=0-7
/proc/6261/task/6274/stat : 6274 (plingeling) R 6259 6261 6192 0 -1 4202560 2183 1257 0 0 261 0 0 0 22 0 9 0 655311414 314028032 22819 33554432000 4194304 4417452 140734812804960 18446744073709551615 4364657 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=6261/tid=6275] ppid=6259 vsize=306668 CPUtime=2.52 cores=0-7
/proc/6261/task/6275/stat : 6275 (plingeling) R 6259 6261 6192 0 -1 4202560 2084 1257 0 0 252 0 0 0 25 0 9 0 655311415 314028032 22819 33554432000 4194304 4417452 140734812804960 18446744073709551615 4249110 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 21.2
Current children cumulated vsize (KiB) 306668

[startup+6.30037 s]
/proc/loadavg: 7.14 5.07 4.36 9/387 6275
/proc/meminfo: memFree=26766192/32950928 swapFree=44388876/67111528
[pid=6261] ppid=6259 vsize=300208 CPUtime=46.76 cores=0-7
/proc/6261/stat : 6261 (plingeling) S 6259 6261 6192 0 -1 4202496 58063 1257 0 0 4668 8 0 0 25 0 9 0 655311368 307412992 21346 33554432000 4194304 4417452 140734812804960 18446744073709551615 251826042853 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/6261/statm: 75052 21346 180 55 0 72938 0
[pid=6261/tid=6268] ppid=6259 vsize=300208 CPUtime=5.83 cores=0-7
/proc/6261/task/6268/stat : 6268 (plingeling) R 6259 6261 6192 0 -1 4202560 2471 1257 0 0 583 0 0 0 25 0 9 0 655311413 307412992 21346 33554432000 4194304 4417452 140734812804960 18446744073709551615 4365936 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=6261/tid=6269] ppid=6259 vsize=300208 CPUtime=5.83 cores=0-7
/proc/6261/task/6269/stat : 6269 (plingeling) R 6259 6261 6192 0 -1 4202560 9573 1257 0 0 582 1 0 0 25 0 9 0 655311413 307412992 21346 33554432000 4194304 4417452 140734812804960 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=6261/tid=6270] ppid=6259 vsize=300208 CPUtime=5.82 cores=0-7
/proc/6261/task/6270/stat : 6270 (plingeling) R 6259 6261 6192 0 -1 4202560 2703 1257 0 0 582 0 0 0 25 0 9 0 655311413 307412992 21346 33554432000 4194304 4417452 140734812804960 18446744073709551615 4237002 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=6261/tid=6271] ppid=6259 vsize=300208 CPUtime=5.83 cores=0-7
/proc/6261/task/6271/stat : 6271 (plingeling) R 6259 6261 6192 0 -1 4202560 806 1257 0 0 583 0 0 0 25 0 9 0 655311413 307412992 21346 33554432000 4194304 4417452 140734812804960 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=6261/tid=6272] ppid=6259 vsize=300208 CPUtime=5.61 cores=0-7
/proc/6261/task/6272/stat : 6272 (plingeling) R 6259 6261 6192 0 -1 4202560 5369 1257 0 0 560 1 0 0 25 0 9 0 655311413 307412992 21346 33554432000 4194304 4417452 140734812804960 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=6261/tid=6273] ppid=6259 vsize=300208 CPUtime=5.82 cores=0-7
/proc/6261/task/6273/stat : 6273 (plingeling) R 6259 6261 6192 0 -1 4202560 4669 1257 0 0 582 0 0 0 25 0 9 0 655311413 307412992 21346 33554432000 4194304 4417452 140734812804960 18446744073709551615 4364550 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=6261/tid=6274] ppid=6259 vsize=300208 CPUtime=5.81 cores=0-7
/proc/6261/task/6274/stat : 6274 (plingeling) R 6259 6261 6192 0 -1 4202560 2289 1257 0 0 581 0 0 0 25 0 9 0 655311414 307412992 21346 33554432000 4194304 4417452 140734812804960 18446744073709551615 4365198 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=6261/tid=6275] ppid=6259 vsize=300208 CPUtime=5.72 cores=0-7
/proc/6261/task/6275/stat : 6275 (plingeling) R 6259 6261 6192 0 -1 4202560 2432 1257 0 0 572 0 0 0 25 0 9 0 655311415 307412992 21346 33554432000 4194304 4417452 140734812804960 18446744073709551615 4251034 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 46.76
Current children cumulated vsize (KiB) 300208

[startup+12.7013 s]
/proc/loadavg: 7.21 5.11 4.38 9/387 6275
/proc/meminfo: memFree=26753452/32950928 swapFree=44388876/67111528
[pid=6261] ppid=6259 vsize=313360 CPUtime=97.89 cores=0-7
/proc/6261/stat : 6261 (plingeling) S 6259 6261 6192 0 -1 4202496 64072 1257 0 0 9780 9 0 0 25 0 9 0 655311368 320880640 24667 33554432000 4194304 4417452 140734812804960 18446744073709551615 251826042853 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/6261/statm: 78340 24667 180 55 0 76226 0
[pid=6261/tid=6268] ppid=6259 vsize=313360 CPUtime=12.23 cores=0-7
/proc/6261/task/6268/stat : 6268 (plingeling) R 6259 6261 6192 0 -1 4202560 3165 1257 0 0 1223 0 0 0 25 0 9 0 655311413 320880640 24667 33554432000 4194304 4417452 140734812804960 18446744073709551615 4366048 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=6261/tid=6269] ppid=6259 vsize=313360 CPUtime=12.23 cores=0-7
/proc/6261/task/6269/stat : 6269 (plingeling) R 6259 6261 6192 0 -1 4202560 10659 1257 0 0 1222 1 0 0 25 0 9 0 655311413 320880640 24667 33554432000 4194304 4417452 140734812804960 18446744073709551615 4366563 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=6261/tid=6270] ppid=6259 vsize=313360 CPUtime=12.22 cores=0-7
/proc/6261/task/6270/stat : 6270 (plingeling) R 6259 6261 6192 0 -1 4202560 3007 1257 0 0 1222 0 0 0 25 0 9 0 655311413 320880640 24667 33554432000 4194304 4417452 140734812804960 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=6261/tid=6271] ppid=6259 vsize=313360 CPUtime=12.23 cores=0-7
/proc/6261/task/6271/stat : 6271 (plingeling) R 6259 6261 6192 0 -1 4202560 806 1257 0 0 1223 0 0 0 25 0 9 0 655311413 320880640 24667 33554432000 4194304 4417452 140734812804960 18446744073709551615 4357013 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=6261/tid=6272] ppid=6259 vsize=313360 CPUtime=11.93 cores=0-7
/proc/6261/task/6272/stat : 6272 (plingeling) R 6259 6261 6192 0 -1 4202560 6682 1257 0 0 1192 1 0 0 25 0 9 0 655311413 320880640 24667 33554432000 4194304 4417452 140734812804960 18446744073709551615 4352385 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=6261/tid=6273] ppid=6259 vsize=313360 CPUtime=12.22 cores=0-7
/proc/6261/task/6273/stat : 6273 (plingeling) R 6259 6261 6192 0 -1 4202560 6719 1257 0 0 1221 1 0 0 25 0 9 0 655311413 320880640 24667 33554432000 4194304 4417452 140734812804960 18446744073709551615 4364604 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=6261/tid=6274] ppid=6259 vsize=313360 CPUtime=12.21 cores=0-7
/proc/6261/task/6274/stat : 6274 (plingeling) R 6259 6261 6192 0 -1 4202560 2664 1257 0 0 1221 0 0 0 25 0 9 0 655311414 320880640 24667 33554432000 4194304 4417452 140734812804960 18446744073709551615 4365962 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=6261/tid=6275] ppid=6259 vsize=313360 CPUtime=12.12 cores=0-7
/proc/6261/task/6275/stat : 6275 (plingeling) R 6259 6261 6192 0 -1 4202560 2619 1257 0 0 1212 0 0 0 25 0 9 0 655311415 320880640 24667 33554432000 4194304 4417452 140734812804960 18446744073709551615 4364632 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 97.89
Current children cumulated vsize (KiB) 313360

[startup+25.5011 s]
/proc/loadavg: 7.39 5.26 4.44 9/387 6275
/proc/meminfo: memFree=26707184/32950928 swapFree=44388876/67111528
[pid=6261] ppid=6259 vsize=359128 CPUtime=200.13 cores=0-7
/proc/6261/stat : 6261 (plingeling) S 6259 6261 6192 0 -1 4202496 83496 1257 0 0 20002 11 0 0 25 0 9 0 655311368 367747072 36716 33554432000 4194304 4417452 140734812804960 18446744073709551615 251826042853 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/6261/statm: 89782 36716 180 55 0 87668 0
[pid=6261/tid=6268] ppid=6259 vsize=359128 CPUtime=25.02 cores=0-7
/proc/6261/task/6268/stat : 6268 (plingeling) R 6259 6261 6192 0 -1 4202560 6398 1257 0 0 2502 0 0 0 25 0 9 0 655311413 367747072 36716 33554432000 4194304 4417452 140734812804960 18446744073709551615 4364560 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=6261/tid=6269] ppid=6259 vsize=359128 CPUtime=25.03 cores=0-7
/proc/6261/task/6269/stat : 6269 (plingeling) R 6259 6261 6192 0 -1 4202560 11845 1257 0 0 2502 1 0 0 25 0 9 0 655311413 367747072 36716 33554432000 4194304 4417452 140734812804960 18446744073709551615 4365949 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=6261/tid=6270] ppid=6259 vsize=359128 CPUtime=25.02 cores=0-7
/proc/6261/task/6270/stat : 6270 (plingeling) R 6259 6261 6192 0 -1 4202560 5621 1257 0 0 2502 0 0 0 25 0 9 0 655311413 367747072 36716 33554432000 4194304 4417452 140734812804960 18446744073709551615 4365987 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=6261/tid=6271] ppid=6259 vsize=359128 CPUtime=25.03 cores=0-7
/proc/6261/task/6271/stat : 6271 (plingeling) R 6259 6261 6192 0 -1 4202560 1035 1257 0 0 2503 0 0 0 25 0 9 0 655311413 367747072 36716 33554432000 4194304 4417452 140734812804960 18446744073709551615 4364550 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=6261/tid=6272] ppid=6259 vsize=359128 CPUtime=24.57 cores=0-7
/proc/6261/task/6272/stat : 6272 (plingeling) R 6259 6261 6192 0 -1 4202560 8034 1257 0 0 2456 1 0 0 25 0 9 0 655311413 367747072 36716 33554432000 4194304 4417452 140734812804960 18446744073709551615 4366051 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=6261/tid=6273] ppid=6259 vsize=359128 CPUtime=25.02 cores=0-7
/proc/6261/task/6273/stat : 6273 (plingeling) R 6259 6261 6192 0 -1 4202560 12189 1257 0 0 2501 1 0 0 25 0 9 0 655311413 367747072 36716 33554432000 4194304 4417452 140734812804960 18446744073709551615 4232787 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=6261/tid=6274] ppid=6259 vsize=359128 CPUtime=25.01 cores=0-7
/proc/6261/task/6274/stat : 6274 (plingeling) R 6259 6261 6192 0 -1 4202560 5558 1257 0 0 2501 0 0 0 25 0 9 0 655311414 367747072 36716 33554432000 4194304 4417452 140734812804960 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=6261/tid=6275] ppid=6259 vsize=359128 CPUtime=24.92 cores=0-7
/proc/6261/task/6275/stat : 6275 (plingeling) R 6259 6261 6192 0 -1 4202560 5065 1257 0 0 2492 0 0 0 25 0 9 0 655311415 367747072 36716 33554432000 4194304 4417452 140734812804960 18446744073709551615 4348325 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 200.13
Current children cumulated vsize (KiB) 359128

[startup+51.1008 s]
/proc/loadavg: 7.60 5.47 4.53 9/387 6276
/proc/meminfo: memFree=26688628/32950928 swapFree=44388876/67111528
[pid=6261] ppid=6259 vsize=384372 CPUtime=404.62 cores=0-7
/proc/6261/stat : 6261 (plingeling) S 6259 6261 6192 0 -1 4202496 106381 1257 0 0 40447 15 0 0 25 0 9 0 655311368 393596928 42188 33554432000 4194304 4417452 140734812804960 18446744073709551615 251826042853 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/6261/statm: 96093 42188 180 55 0 93979 0
[pid=6261/tid=6268] ppid=6259 vsize=384372 CPUtime=50.63 cores=0-7
/proc/6261/task/6268/stat : 6268 (plingeling) R 6259 6261 6192 0 -1 4202560 11771 1257 0 0 5062 1 0 0 25 0 9 0 655311413 393596928 42188 33554432000 4194304 4417452 140734812804960 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=6261/tid=6269] ppid=6259 vsize=384372 CPUtime=50.63 cores=0-7
/proc/6261/task/6269/stat : 6269 (plingeling) R 6259 6261 6192 0 -1 4202560 12195 1257 0 0 5062 1 0 0 25 0 9 0 655311413 393596928 42188 33554432000 4194304 4417452 140734812804960 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=6261/tid=6270] ppid=6259 vsize=384372 CPUtime=50.62 cores=0-7

################
# More data... #
################

/proc/6261/task/6273/stat : 6273 (plingeling) R 6259 6261 6192 0 -1 4202560 36022 1257 0 0 10177 6 0 0 25 0 9 0 655311413 423051264 49503 33554432000 4194304 4417452 140734812804960 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=6261/tid=6274] ppid=6259 vsize=413136 CPUtime=101.83 cores=0-7
/proc/6261/task/6274/stat : 6274 (plingeling) R 6259 6261 6192 0 -1 4202560 21060 1257 0 0 10179 4 0 0 25 0 9 0 655311414 423051264 49503 33554432000 4194304 4417452 140734812804960 18446744073709551615 4365058 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=6261/tid=6275] ppid=6259 vsize=413136 CPUtime=101.72 cores=0-7
/proc/6261/task/6275/stat : 6275 (plingeling) R 6259 6261 6192 0 -1 4202560 19308 1257 0 0 10170 2 0 0 25 0 9 0 655311415 423051264 49503 33554432000 4194304 4417452 140734812804960 18446744073709551615 4364564 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 813.68
Current children cumulated vsize (KiB) 413136

Solver just ended. Dumping a history of the last processes samples

[startup+108.701 s]
/proc/loadavg: 7.84 5.90 4.73 9/387 6277
/proc/meminfo: memFree=26654744/32950928 swapFree=44388876/67111528
[pid=6261] ppid=6259 vsize=418800 CPUtime=864.7 cores=0-7
/proc/6261/stat : 6261 (plingeling) S 6259 6261 6192 0 -1 4202496 196310 1257 0 0 86439 31 0 0 25 0 9 0 655311368 428851200 50934 33554432000 4194304 4417452 140734812804960 18446744073709551615 251826042853 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/6261/statm: 104700 50934 180 55 0 102586 0
[pid=6261/tid=6268] ppid=6259 vsize=418800 CPUtime=108.22 cores=0-7
/proc/6261/task/6268/stat : 6268 (plingeling) R 6259 6261 6192 0 -1 4202560 19719 1257 0 0 10820 2 0 0 25 0 9 0 655311413 428851200 50934 33554432000 4194304 4417452 140734812804960 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=6261/tid=6269] ppid=6259 vsize=418800 CPUtime=108.23 cores=0-7
/proc/6261/task/6269/stat : 6269 (plingeling) R 6259 6261 6192 0 -1 4202560 21879 1257 0 0 10820 3 0 0 25 0 9 0 655311413 428851200 50934 33554432000 4194304 4417452 140734812804960 18446744073709551615 4364550 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=6261/tid=6270] ppid=6259 vsize=418800 CPUtime=108.22 cores=0-7
/proc/6261/task/6270/stat : 6270 (plingeling) R 6259 6261 6192 0 -1 4202560 24268 1257 0 0 10819 3 0 0 25 0 9 0 655311413 428851200 50934 33554432000 4194304 4417452 140734812804960 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=6261/tid=6271] ppid=6259 vsize=418800 CPUtime=108.22 cores=0-7
/proc/6261/task/6271/stat : 6271 (plingeling) R 6259 6261 6192 0 -1 4202560 3083 1257 0 0 10822 0 0 0 25 0 9 0 655311413 428851200 50934 33554432000 4194304 4417452 140734812804960 18446744073709551615 4364768 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=6261/tid=6272] ppid=6259 vsize=418800 CPUtime=106.75 cores=0-7
/proc/6261/task/6272/stat : 6272 (plingeling) R 6259 6261 6192 0 -1 4202560 16485 1257 0 0 10673 2 0 0 25 0 9 0 655311413 428851200 50934 33554432000 4194304 4417452 140734812804960 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=6261/tid=6273] ppid=6259 vsize=418800 CPUtime=108.21 cores=0-7
/proc/6261/task/6273/stat : 6273 (plingeling) R 6259 6261 6192 0 -1 4202560 37649 1257 0 0 10815 6 0 0 25 0 9 0 655311413 428851200 50934 33554432000 4194304 4417452 140734812804960 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=6261/tid=6274] ppid=6259 vsize=418800 CPUtime=108.21 cores=0-7
/proc/6261/task/6274/stat : 6274 (plingeling) R 6259 6261 6192 0 -1 4202560 22456 1257 0 0 10817 4 0 0 25 0 9 0 655311414 428851200 50934 33554432000 4194304 4417452 140734812804960 18446744073709551615 4364626 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=6261/tid=6275] ppid=6259 vsize=418800 CPUtime=108.1 cores=0-7
/proc/6261/task/6275/stat : 6275 (plingeling) R 6259 6261 6192 0 -1 4202560 23020 1257 0 0 10807 3 0 0 25 0 9 0 655311415 428851200 50934 33554432000 4194304 4417452 140734812804960 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 864.7
Current children cumulated vsize (KiB) 418800

[startup+111.901 s]
/proc/loadavg: 7.85 5.93 4.74 9/387 6278
/proc/meminfo: memFree=26633300/32950928 swapFree=44388876/67111528
[pid=6261] ppid=6259 vsize=430732 CPUtime=890.26 cores=0-7
/proc/6261/stat : 6261 (plingeling) S 6259 6261 6192 0 -1 4202496 203476 1257 0 0 88993 33 0 0 25 0 9 0 655311368 441069568 53926 33554432000 4194304 4417452 140734812804960 18446744073709551615 251826042853 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/6261/statm: 107683 53926 180 55 0 105569 0
[pid=6261/tid=6268] ppid=6259 vsize=430732 CPUtime=111.42 cores=0-7
/proc/6261/task/6268/stat : 6268 (plingeling) R 6259 6261 6192 0 -1 4202560 19719 1257 0 0 11140 2 0 0 25 0 9 0 655311413 441069568 53926 33554432000 4194304 4417452 140734812804960 18446744073709551615 4364564 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=6261/tid=6269] ppid=6259 vsize=430732 CPUtime=111.43 cores=0-7
/proc/6261/task/6269/stat : 6269 (plingeling) R 6259 6261 6192 0 -1 4202560 21879 1257 0 0 11140 3 0 0 25 0 9 0 655311413 441069568 53926 33554432000 4194304 4417452 140734812804960 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=6261/tid=6270] ppid=6259 vsize=430732 CPUtime=111.42 cores=0-7
/proc/6261/task/6270/stat : 6270 (plingeling) R 6259 6261 6192 0 -1 4202560 25215 1257 0 0 11139 3 0 0 25 0 9 0 655311413 441069568 53926 33554432000 4194304 4417452 140734812804960 18446744073709551615 4364550 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=6261/tid=6271] ppid=6259 vsize=430732 CPUtime=111.42 cores=0-7
/proc/6261/task/6271/stat : 6271 (plingeling) R 6259 6261 6192 0 -1 4202560 3083 1257 0 0 11142 0 0 0 25 0 9 0 655311413 441069568 53926 33554432000 4194304 4417452 140734812804960 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=6261/tid=6272] ppid=6259 vsize=430732 CPUtime=109.92 cores=0-7
/proc/6261/task/6272/stat : 6272 (plingeling) R 6259 6261 6192 0 -1 4202560 16803 1257 0 0 10989 3 0 0 25 0 9 0 655311413 441069568 53926 33554432000 4194304 4417452 140734812804960 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=6261/tid=6273] ppid=6259 vsize=430732 CPUtime=111.42 cores=0-7
/proc/6261/task/6273/stat : 6273 (plingeling) R 6259 6261 6192 0 -1 4202560 39474 1257 0 0 11135 7 0 0 25 0 9 0 655311413 441069568 53926 33554432000 4194304 4417452 140734812804960 18446744073709551615 4265437 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=6261/tid=6274] ppid=6259 vsize=430732 CPUtime=111.41 cores=0-7
/proc/6261/task/6274/stat : 6274 (plingeling) R 6259 6261 6192 0 -1 4202560 25590 1257 0 0 11136 5 0 0 25 0 9 0 655311414 441069568 53926 33554432000 4194304 4417452 140734812804960 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=6261/tid=6275] ppid=6259 vsize=430732 CPUtime=111.31 cores=0-7
/proc/6261/task/6275/stat : 6275 (plingeling) R 6259 6261 6192 0 -1 4202560 23962 1257 0 0 11127 4 0 0 25 0 9 0 655311415 441069568 53926 33554432000 4194304 4417452 140734812804960 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 890.26
Current children cumulated vsize (KiB) 430732

[startup+115.101 s]
/proc/loadavg: 7.94 5.98 4.77 9/387 6278
/proc/meminfo: memFree=26647580/32950928 swapFree=44388876/67111528
[pid=6261] ppid=6259 vsize=417572 CPUtime=915.82 cores=0-7
/proc/6261/stat : 6261 (plingeling) S 6259 6261 6192 0 -1 4202496 209577 1257 0 0 91548 34 0 0 25 0 9 0 655311368 427593728 50645 33554432000 4194304 4417452 140734812804960 18446744073709551615 251826042853 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/6261/statm: 104393 50645 180 55 0 102279 0
[pid=6261/tid=6268] ppid=6259 vsize=417572 CPUtime=114.62 cores=0-7
/proc/6261/task/6268/stat : 6268 (plingeling) R 6259 6261 6192 0 -1 4202560 20364 1257 0 0 11460 2 0 0 25 0 9 0 655311413 427593728 50645 33554432000 4194304 4417452 140734812804960 18446744073709551615 4199406 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=6261/tid=6269] ppid=6259 vsize=417572 CPUtime=114.63 cores=0-7
/proc/6261/task/6269/stat : 6269 (plingeling) R 6259 6261 6192 0 -1 4202560 22468 1257 0 0 11460 3 0 0 25 0 9 0 655311413 427593728 50645 33554432000 4194304 4417452 140734812804960 18446744073709551615 4351416 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=6261/tid=6270] ppid=6259 vsize=417572 CPUtime=114.62 cores=0-7
/proc/6261/task/6270/stat : 6270 (plingeling) R 6259 6261 6192 0 -1 4202560 25762 1257 0 0 11459 3 0 0 25 0 9 0 655311413 427593728 50645 33554432000 4194304 4417452 140734812804960 18446744073709551615 4366082 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=6261/tid=6271] ppid=6259 vsize=417572 CPUtime=114.62 cores=0-7
/proc/6261/task/6271/stat : 6271 (plingeling) R 6259 6261 6192 0 -1 4202560 3083 1257 0 0 11462 0 0 0 25 0 9 0 655311413 427593728 50645 33554432000 4194304 4417452 140734812804960 18446744073709551615 4364741 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=6261/tid=6272] ppid=6259 vsize=417572 CPUtime=113.07 cores=0-7
/proc/6261/task/6272/stat : 6272 (plingeling) R 6259 6261 6192 0 -1 4202560 17522 1257 0 0 11304 3 0 0 25 0 9 0 655311413 427593728 50645 33554432000 4194304 4417452 140734812804960 18446744073709551615 4364634 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=6261/tid=6273] ppid=6259 vsize=417572 CPUtime=114.62 cores=0-7
/proc/6261/task/6273/stat : 6273 (plingeling) R 6259 6261 6192 0 -1 4202560 40398 1257 0 0 11455 7 0 0 25 0 9 0 655311413 427593728 50645 33554432000 4194304 4417452 140734812804960 18446744073709551615 4364567 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=6261/tid=6274] ppid=6259 vsize=417572 CPUtime=114.61 cores=0-7
/proc/6261/task/6274/stat : 6274 (plingeling) R 6259 6261 6192 0 -1 4202560 26504 1257 0 0 11456 5 0 0 25 0 9 0 655311414 427593728 50645 33554432000 4194304 4417452 140734812804960 18446744073709551615 4364903 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=6261/tid=6275] ppid=6259 vsize=417572 CPUtime=114.51 cores=0-7
/proc/6261/task/6275/stat : 6275 (plingeling) R 6259 6261 6192 0 -1 4202560 25725 1257 0 0 11447 4 0 0 25 0 9 0 655311415 427593728 50645 33554432000 4194304 4417452 140734812804960 18446744073709551615 4364765 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 915.82
Current children cumulated vsize (KiB) 417572

[startup+116.701 s]
/proc/loadavg: 7.94 5.98 4.77 9/387 6278
/proc/meminfo: memFree=26673992/32950928 swapFree=44388876/67111528
[pid=6261] ppid=6259 vsize=396352 CPUtime=928.59 cores=0-7
/proc/6261/stat : 6261 (plingeling) S 6259 6261 6192 0 -1 4202496 211442 1257 0 0 92824 35 0 0 25 0 9 0 655311368 405864448 45230 33554432000 4194304 4417452 140734812804960 18446744073709551615 251826042853 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/6261/statm: 99088 45230 180 55 0 96974 0
[pid=6261/tid=6268] ppid=6259 vsize=396352 CPUtime=116.22 cores=0-7
/proc/6261/task/6268/stat : 6268 (plingeling) R 6259 6261 6192 0 -1 4202560 20659 1257 0 0 11620 2 0 0 25 0 9 0 655311413 405864448 45230 33554432000 4194304 4417452 140734812804960 18446744073709551615 4364768 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=6261/tid=6269] ppid=6259 vsize=396352 CPUtime=116.23 cores=0-7
/proc/6261/task/6269/stat : 6269 (plingeling) R 6259 6261 6192 0 -1 4202560 22468 1257 0 0 11620 3 0 0 25 0 9 0 655311413 405864448 45230 33554432000 4194304 4417452 140734812804960 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=6261/tid=6270] ppid=6259 vsize=396352 CPUtime=116.22 cores=0-7
/proc/6261/task/6270/stat : 6270 (plingeling) R 6259 6261 6192 0 -1 4202560 25982 1257 0 0 11619 3 0 0 25 0 9 0 655311413 405864448 45230 33554432000 4194304 4417452 140734812804960 18446744073709551615 4364621 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=6261/tid=6271] ppid=6259 vsize=396352 CPUtime=116.22 cores=0-7
/proc/6261/task/6271/stat : 6271 (plingeling) R 6259 6261 6192 0 -1 4202560 3083 1257 0 0 11622 0 0 0 25 0 9 0 655311413 405864448 45230 33554432000 4194304 4417452 140734812804960 18446744073709551615 4364604 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=6261/tid=6272] ppid=6259 vsize=396352 CPUtime=114.64 cores=0-7
/proc/6261/task/6272/stat : 6272 (plingeling) R 6259 6261 6192 0 -1 4202560 17687 1257 0 0 11461 3 0 0 25 0 9 0 655311413 405864448 45230 33554432000 4194304 4417452 140734812804960 18446744073709551615 4237290 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=6261/tid=6273] ppid=6259 vsize=396352 CPUtime=116.22 cores=0-7
/proc/6261/task/6273/stat : 6273 (plingeling) R 6259 6261 6192 0 -1 4202560 41254 1257 0 0 11615 7 0 0 25 0 9 0 655311413 405864448 45230 33554432000 4194304 4417452 140734812804960 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=6261/tid=6274] ppid=6259 vsize=396352 CPUtime=116.21 cores=0-7
/proc/6261/task/6274/stat : 6274 (plingeling) R 6259 6261 6192 0 -1 4202560 26663 1257 0 0 11616 5 0 0 25 0 9 0 655311414 405864448 45230 33554432000 4194304 4417452 140734812804960 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=6261/tid=6275] ppid=6259 vsize=396352 CPUtime=116.11 cores=0-7
/proc/6261/task/6275/stat : 6275 (plingeling) R 6259 6261 6192 0 -1 4202560 25895 1257 0 0 11607 4 0 0 25 0 9 0 655311415 405864448 45230 33554432000 4194304 4417452 140734812804960 18446744073709551615 4364583 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 928.59
Current children cumulated vsize (KiB) 396352

[startup+117.501 s]
/proc/loadavg: 7.94 5.98 4.77 9/387 6278
/proc/meminfo: memFree=26673992/32950928 swapFree=44388876/67111528
[pid=6261] ppid=6259 vsize=400476 CPUtime=934.99 cores=0-7
/proc/6261/stat : 6261 (plingeling) S 6259 6261 6192 0 -1 4202496 212473 1257 0 0 93464 35 0 0 25 0 9 0 655311368 410087424 46261 33554432000 4194304 4417452 140734812804960 18446744073709551615 251826042853 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/6261/statm: 100119 46261 180 55 0 98005 0
[pid=6261/tid=6268] ppid=6259 vsize=400476 CPUtime=117.02 cores=0-7
/proc/6261/task/6268/stat : 6268 (plingeling) R 6259 6261 6192 0 -1 4202560 20659 1257 0 0 11700 2 0 0 25 0 9 0 655311413 410087424 46261 33554432000 4194304 4417452 140734812804960 18446744073709551615 4364768 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=6261/tid=6269] ppid=6259 vsize=400476 CPUtime=117.03 cores=0-7
/proc/6261/task/6269/stat : 6269 (plingeling) R 6259 6261 6192 0 -1 4202560 23126 1257 0 0 11700 3 0 0 25 0 9 0 655311413 410087424 46261 33554432000 4194304 4417452 140734812804960 18446744073709551615 4364838 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=6261/tid=6270] ppid=6259 vsize=400476 CPUtime=117.02 cores=0-7
/proc/6261/task/6270/stat : 6270 (plingeling) R 6259 6261 6192 0 -1 4202560 26239 1257 0 0 11699 3 0 0 25 0 9 0 655311413 410087424 46261 33554432000 4194304 4417452 140734812804960 18446744073709551615 4366099 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=6261/tid=6271] ppid=6259 vsize=400476 CPUtime=117.02 cores=0-7
/proc/6261/task/6271/stat : 6271 (plingeling) R 6259 6261 6192 0 -1 4202560 3083 1257 0 0 11702 0 0 0 25 0 9 0 655311413 410087424 46261 33554432000 4194304 4417452 140734812804960 18446744073709551615 4357263 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=6261/tid=6272] ppid=6259 vsize=400476 CPUtime=115.44 cores=0-7
/proc/6261/task/6272/stat : 6272 (plingeling) R 6259 6261 6192 0 -1 4202560 17687 1257 0 0 11541 3 0 0 25 0 9 0 655311413 410087424 46261 33554432000 4194304 4417452 140734812804960 18446744073709551615 4237290 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=6261/tid=6273] ppid=6259 vsize=400476 CPUtime=117.02 cores=0-7
/proc/6261/task/6273/stat : 6273 (plingeling) R 6259 6261 6192 0 -1 4202560 41321 1257 0 0 11695 7 0 0 25 0 9 0 655311413 410087424 46261 33554432000 4194304 4417452 140734812804960 18446744073709551615 4364461 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=6261/tid=6274] ppid=6259 vsize=400476 CPUtime=117.01 cores=0-7
/proc/6261/task/6274/stat : 6274 (plingeling) R 6259 6261 6192 0 -1 4202560 26712 1257 0 0 11696 5 0 0 25 0 9 0 655311414 410087424 46261 33554432000 4194304 4417452 140734812804960 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=6261/tid=6275] ppid=6259 vsize=400476 CPUtime=116.91 cores=0-7
/proc/6261/task/6275/stat : 6275 (plingeling) R 6259 6261 6192 0 -1 4202560 25895 1257 0 0 11687 4 0 0 25 0 9 0 655311415 410087424 46261 33554432000 4194304 4417452 140734812804960 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 934.99
Current children cumulated vsize (KiB) 400476

[startup+117.715 s]
/proc/loadavg: 7.94 5.98 4.77 9/387 6278
/proc/meminfo: memFree=26664816/32950928 swapFree=44388876/67111528
[pid=6261] ppid=6259 vsize=406644 CPUtime=936.69 cores=0-7
/proc/6261/stat : 6261 (plingeling) S 6259 6261 6192 0 -1 4202496 214015 1257 0 0 93634 35 0 0 25 0 9 0 655311368 416403456 47803 33554432000 4194304 4417452 140734812804960 18446744073709551615 251826042853 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/6261/statm: 101661 47803 180 55 0 99547 0
[pid=6261/tid=6268] ppid=6259 vsize=406644 CPUtime=117.23 cores=0-7
/proc/6261/task/6268/stat : 6268 (plingeling) R 6259 6261 6192 0 -1 4202560 20659 1257 0 0 11721 2 0 0 25 0 9 0 655311413 416403456 47803 33554432000 4194304 4417452 140734812804960 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=6261/tid=6269] ppid=6259 vsize=406644 CPUtime=117.24 cores=0-7
/proc/6261/task/6269/stat : 6269 (plingeling) R 6259 6261 6192 0 -1 4202560 23126 1257 0 0 11721 3 0 0 25 0 9 0 655311413 416403456 47803 33554432000 4194304 4417452 140734812804960 18446744073709551615 4364650 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=6261/tid=6270] ppid=6259 vsize=406644 CPUtime=117.23 cores=0-7
/proc/6261/task/6270/stat : 6270 (plingeling) R 6259 6261 6192 0 -1 4202560 26239 1257 0 0 11720 3 0 0 25 0 9 0 655311413 416403456 47803 33554432000 4194304 4417452 140734812804960 18446744073709551615 4364881 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=6261/tid=6271] ppid=6259 vsize=406644 CPUtime=117.23 cores=0-7
/proc/6261/task/6271/stat : 6271 (plingeling) R 6259 6261 6192 0 -1 4202560 3083 1257 0 0 11723 0 0 0 25 0 9 0 655311413 416403456 47803 33554432000 4194304 4417452 140734812804960 18446744073709551615 4265429 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=6261/tid=6272] ppid=6259 vsize=406644 CPUtime=115.64 cores=0-7
/proc/6261/task/6272/stat : 6272 (plingeling) R 6259 6261 6192 0 -1 4202560 18962 1257 0 0 11561 3 0 0 25 0 9 0 655311413 416403456 47803 33554432000 4194304 4417452 140734812804960 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=6261/tid=6273] ppid=6259 vsize=406644 CPUtime=117.23 cores=0-7
/proc/6261/task/6273/stat : 6273 (plingeling) R 6259 6261 6192 0 -1 4202560 41321 1257 0 0 11716 7 0 0 25 0 9 0 655311413 416403456 47803 33554432000 4194304 4417452 140734812804960 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=6261/tid=6274] ppid=6259 vsize=406644 CPUtime=117.22 cores=0-7
/proc/6261/task/6274/stat : 6274 (plingeling) R 6259 6261 6192 0 -1 4202560 26979 1257 0 0 11717 5 0 0 25 0 9 0 655311414 416403456 47803 33554432000 4194304 4417452 140734812804960 18446744073709551615 4364558 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=6261/tid=6275] ppid=6259 vsize=406644 CPUtime=117.12 cores=0-7
/proc/6261/task/6275/stat : 6275 (plingeling) R 6259 6261 6192 0 -1 4202560 25895 1257 0 0 11708 4 0 0 25 0 9 0 655311415 416403456 47803 33554432000 4194304 4417452 140734812804960 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 936.69
Current children cumulated vsize (KiB) 406644

[startup+117.801 s]
/proc/loadavg: 7.94 5.98 4.77 9/387 6278
/proc/meminfo: memFree=26664816/32950928 swapFree=44388876/67111528
[pid=6261] ppid=6259 vsize=408032 CPUtime=936.93 cores=0-7
/proc/6261/stat : 6261 (plingeling) S 6259 6261 6192 0 -1 4202496 214363 1257 0 0 93658 35 0 0 18 0 2 0 655311368 417824768 48151 33554432000 4194304 4417452 140734812804960 18446744073709551615 251826042853 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/6261/statm: 102008 48151 181 55 0 99894 0
[pid=6261/tid=6269] ppid=6259 vsize=408032 CPUtime=117.33 cores=0-7
/proc/6261/task/6269/stat : 6269 (plingeling) R 6259 6261 6192 0 -1 4202560 23473 1257 0 0 11730 3 0 0 25 0 2 0 655311413 417824768 48151 33554432000 4194304 4417452 140734812804960 18446744073709551615 4366051 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 936.93
Current children cumulated vsize (KiB) 408032

Child status: 20
Real time (s): 117.821
CPU time (s): 936.969
CPU user time (s): 936.597
CPU system time (s): 0.371943
CPU usage (%): 795.247
Max. virtual memory (cumulated for all children) (KiB): 438076

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 936.597
system time used= 0.371943
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 215623
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 314
involuntary context switches= 4356

runsolver used 0.428934 second user time and 1.03184 second system time

The end

Launcher Data 

Begin job on node126 at 2011-05-15 07:25:27
IDJOB=3372281
IDBENCH=70941
IDSOLVER=1851
FILE ID=node126/3372281-1305437127
RUNJOBID= node126-1305437033-6206
PBS_JOBID= 13324762
Free space on /tmp= 73364 MiB

SOLVER NAME= Plingeling 587f (fixed)
BENCH NAME= SAT09/APPLICATIONS/bioinfo/q_query_3_l46_lambda.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3372281-1305437127/watcher-3372281-1305437127 -o /tmp/evaluation-result-3372281-1305437127/solver-3372281-1305437127 -C 40000 -W 5100 -M 31000  plingeling -t 8 HOME/instance-3372281-1305437127.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= eb4d0d02a25a8a84182ddd3b6d1fa8b5
RANDOM SEED=1563513477

node126.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      26852692 kB
Buffers:        272912 kB
Cached:        2611224 kB
SwapCached:      92524 kB
Active:         828988 kB
Inactive:      5012488 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      26852692 kB
SwapTotal:    67111528 kB
SwapFree:     44388876 kB
Dirty:            3124 kB
Writeback:          28 kB
AnonPages:     2877552 kB
Mapped:          14744 kB
Slab:           112668 kB
PageTables:      75084 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 88087140 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73364 MiB
End job on node126 at 2011-05-15 07:27:25