Trace number 3310305

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio par? (TO) 40000.2 5003.62

General information on the benchmark

Nameapplication/fuhs/slp-synthesis-AES/
slp-synthesis-aes-bottom15.cnf
MD5SUM1f0914c6141fdba914b73575a12b918a
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark16550.6
Satisfiable
(Un)Satisfiability was proved
Number of variables25972
Number of clauses86411
Sum of the clauses size219707
Maximum clause length879
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 245193
Number of clauses of size 340753
Number of clauses of size 4119
Number of clauses of size 513
Number of clauses of size over 5332

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 8 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	[5] plingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 0
0.00/0.00	Starting clasp 1.3.6 on core(s) 1
0.00/0.00	Starting TNM 2009 on core(s) 2
0.00/0.00	Starting march_hi 2009 on core(s) 3
0.00/0.00	Starting plingeling 276-6264d55-100731 on core(s) 4 5 6 7

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3310305-1304008800/watcher-3310305-1304008800 -o /tmp/evaluation-result-3310305-1304008800/solver-3310305-1304008800 -C 40000 -W 5100 -M 31000 ppfolio HOME/instance-3310305-1304008800.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.11 8.00 7.94 2/170 26416
/proc/meminfo: memFree=16747460/32951124 swapFree=67111528/67111528
[pid=26416] ppid=26414 vsize=18324 CPUtime=0 cores=0-7
/proc/26416/stat : 26416 (ppfolio) S 26414 26416 26251 0 -1 4202496 519 0 0 0 0 0 0 0 25 0 1 0 512478499 18763776 389 33554432000 4194304 4287625 140736246045568 18446744073709551615 210204667407 0 0 4096 65536 10858117270673031167 0 0 17 6 0 0 0
/proc/26416/statm: 4581 389 341 23 0 91 0

[startup+0.010432 s]
/proc/loadavg: 8.11 8.00 7.94 2/170 26416
/proc/meminfo: memFree=16747460/32951124 swapFree=67111528/67111528
[pid=26416] ppid=26414 vsize=18324 CPUtime=0 cores=0-7
/proc/26416/stat : 26416 (ppfolio) S 26414 26416 26251 0 -1 4202496 519 0 0 0 0 0 0 0 25 0 1 0 512478499 18763776 389 33554432000 4194304 4287625 140736246045568 18446744073709551615 210204667407 0 0 4096 65536 10858117270673031167 0 0 17 6 0 0 0
/proc/26416/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.100419 s]
/proc/loadavg: 8.11 8.00 7.94 2/170 26416
/proc/meminfo: memFree=16747460/32951124 swapFree=67111528/67111528
[pid=26416] ppid=26414 vsize=18324 CPUtime=0 cores=0-7
/proc/26416/stat : 26416 (ppfolio) S 26414 26416 26251 0 -1 4202496 519 0 0 0 0 0 0 0 25 0 1 0 512478499 18763776 389 33554432000 4194304 4287625 140736246045568 18446744073709551615 210204667407 0 0 4096 65536 10858117270673031167 0 0 17 4 0 0 0
/proc/26416/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.300359 s]
/proc/loadavg: 8.11 8.00 7.94 2/170 26416
/proc/meminfo: memFree=16747460/32951124 swapFree=67111528/67111528
[pid=26416] ppid=26414 vsize=18324 CPUtime=0 cores=0-7
/proc/26416/stat : 26416 (ppfolio) S 26414 26416 26251 0 -1 4202496 519 0 0 0 0 0 0 0 25 0 1 0 512478499 18763776 389 33554432000 4194304 4287625 140736246045568 18446744073709551615 210204667407 0 0 4096 65536 10858117270673031167 0 0 17 4 0 0 0
/proc/26416/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.700289 s]
/proc/loadavg: 8.11 8.00 7.94 2/170 26416
/proc/meminfo: memFree=16747460/32951124 swapFree=67111528/67111528
[pid=26416] ppid=26414 vsize=18324 CPUtime=0 cores=0-7
/proc/26416/stat : 26416 (ppfolio) S 26414 26416 26251 0 -1 4202496 519 0 0 0 0 0 0 0 20 0 1 0 512478499 18763776 389 33554432000 4194304 4287625 140736246045568 18446744073709551615 210204667407 0 0 4096 65536 10858117270673031167 0 0 17 4 0 0 0
/proc/26416/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50115 s]
/proc/loadavg: 8.11 8.00 7.94 9/180 26431
/proc/meminfo: memFree=16635152/32951124 swapFree=67111528/67111528
[pid=26416] ppid=26414 vsize=18324 CPUtime=0 cores=0-7
/proc/26416/stat : 26416 (ppfolio) S 26414 26416 26251 0 -1 4202496 519 0 0 0 0 0 0 0 15 0 1 0 512478499 18763776 389 33554432000 4194304 4287625 140736246045568 18446744073709551615 210204667407 0 0 4096 65536 10858117270673031167 0 0 17 4 0 0 0
/proc/26416/statm: 4581 389 341 23 0 91 0
[pid=26417] ppid=26416 vsize=46940 CPUtime=1.49 cores=0
/proc/26417/stat : 26417 (cryptominisat) R 26416 26416 26251 0 -1 4202496 8463 0 0 0 148 1 0 0 20 0 1 0 512478499 48066560 6695 33554432000 4194304 4587354 140733774431712 18446744073709551615 4242713 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/26417/statm: 11735 6695 330 96 0 8297 0
[pid=26418] ppid=26416 vsize=28412 CPUtime=1.48 cores=1
/proc/26418/stat : 26418 (clasp) R 26416 26416 26251 0 -1 4202496 5524 0 0 0 148 0 0 0 20 0 1 0 512478499 29093888 4381 33554432000 4194304 4785740 140734436965024 18446744073709551615 4552525 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/26418/statm: 7103 4381 340 145 0 4148 0
[pid=26419] ppid=26416 vsize=462164 CPUtime=1.49 cores=2
/proc/26419/stat : 26419 (TNM) R 26416 26416 26251 0 -1 4202496 3332 0 0 0 149 0 0 0 20 0 1 0 512478499 473255936 3229 33554432000 134512640 134534564 4287858496 18446744073709551615 134529944 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/26419/statm: 115541 3229 95 6 0 114207 0
[pid=26420] ppid=26416 vsize=64460 CPUtime=1.49 cores=3
/proc/26420/stat : 26420 (march_hi) R 26416 26416 26251 0 -1 4202496 31817 0 0 0 146 3 0 0 20 0 1 0 512478499 66007040 8081 33554432000 4194304 4331988 140736637194736 18446744073709551615 4237130 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/26420/statm: 16115 8081 175 34 0 14557 0
[pid=26421] ppid=26416 vsize=143528 CPUtime=5.62 cores=4-7
/proc/26421/stat : 26421 (plingeling) S 26416 26416 26251 0 -1 4202496 12960 1255 0 0 561 1 0 0 25 0 5 0 512478499 146972672 7943 33554432000 4194304 4356188 140736149172608 18446744073709551615 210216450021 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/26421/statm: 35882 7943 164 40 0 34426 0
[pid=26421/tid=26428] ppid=26416 vsize=143528 CPUtime=1.38 cores=4-7
/proc/26421/task/26428/stat : 26428 (plingeling) R 26416 26416 26251 0 -1 4202560 2304 1255 0 0 138 0 0 0 19 0 5 0 512478510 146972672 7943 33554432000 4194304 4356188 140736149172608 18446744073709551615 4210583 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26421/tid=26429] ppid=26416 vsize=143528 CPUtime=1.36 cores=4-7
/proc/26421/task/26429/stat : 26429 (plingeling) R 26416 26416 26251 0 -1 4202560 1918 1255 0 0 136 0 0 0 25 0 5 0 512478510 146972672 7943 33554432000 4194304 4356188 140736149172608 18446744073709551615 4233426 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=26421/tid=26430] ppid=26416 vsize=143528 CPUtime=1.38 cores=4-7
/proc/26421/task/26430/stat : 26430 (plingeling) R 26416 26416 26251 0 -1 4202560 2243 1255 0 0 138 0 0 0 25 0 5 0 512478510 146972672 7943 33554432000 4194304 4356188 140736149172608 18446744073709551615 4270872 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=26421/tid=26431] ppid=26416 vsize=143528 CPUtime=1.38 cores=4-7
/proc/26421/task/26431/stat : 26431 (plingeling) R 26416 26416 26251 0 -1 4202560 2005 1255 0 0 138 0 0 0 25 0 5 0 512478510 146972672 7943 33554432000 4194304 4356188 140736149172608 18446744073709551615 4236757 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 11.57
Current children cumulated vsize (KiB) 763828

[startup+3.10089 s]
/proc/loadavg: 8.11 8.00 7.94 9/180 26431
/proc/meminfo: memFree=16630192/32951124 swapFree=67111528/67111528
[pid=26416] ppid=26414 vsize=18324 CPUtime=0 cores=0-7
/proc/26416/stat : 26416 (ppfolio) S 26414 26416 26251 0 -1 4202496 519 0 0 0 0 0 0 0 15 0 1 0 512478499 18763776 389 33554432000 4194304 4287625 140736246045568 18446744073709551615 210204667407 0 0 4096 65536 10858117270673031167 0 0 17 4 0 0 0
/proc/26416/statm: 4581 389 341 23 0 91 0
[pid=26417] ppid=26416 vsize=46940 CPUtime=3.09 cores=0
/proc/26417/stat : 26417 (cryptominisat) R 26416 26416 26251 0 -1 4202496 9148 0 0 0 308 1 0 0 25 0 1 0 512478499 48066560 7367 33554432000 4194304 4587354 140733774431712 18446744073709551615 4238593 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/26417/statm: 11735 7367 330 96 0 8297 0
[pid=26418] ppid=26416 vsize=31996 CPUtime=3.09 cores=1
/proc/26418/stat : 26418 (clasp) R 26416 26416 26251 0 -1 4202496 6440 0 0 0 308 1 0 0 25 0 1 0 512478499 32763904 5297 33554432000 4194304 4785740 140734436965024 18446744073709551615 4550456 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/26418/statm: 7999 5297 340 145 0 5044 0
[pid=26419] ppid=26416 vsize=462164 CPUtime=3.09 cores=2
/proc/26419/stat : 26419 (TNM) R 26416 26416 26251 0 -1 4202496 3332 0 0 0 309 0 0 0 25 0 1 0 512478499 473255936 3229 33554432000 134512640 134534564 4287858496 18446744073709551615 134528979 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/26419/statm: 115541 3229 95 6 0 114207 0
[pid=26420] ppid=26416 vsize=65812 CPUtime=3.09 cores=3
/proc/26420/stat : 26420 (march_hi) R 26416 26416 26251 0 -1 4202496 32103 0 0 0 306 3 0 0 25 0 1 0 512478499 67391488 8367 33554432000 4194304 4331988 140736637194736 18446744073709551615 4210940 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/26420/statm: 16453 8367 175 34 0 14895 0
[pid=26421] ppid=26416 vsize=139656 CPUtime=12.01 cores=4-7
/proc/26421/stat : 26421 (plingeling) S 26416 26416 26251 0 -1 4202496 13556 1255 0 0 1200 1 0 0 25 0 5 0 512478499 143007744 6977 33554432000 4194304 4356188 140736149172608 18446744073709551615 210216450021 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/26421/statm: 34914 6977 164 40 0 33458 0
[pid=26421/tid=26428] ppid=26416 vsize=139656 CPUtime=2.98 cores=4-7
/proc/26421/task/26428/stat : 26428 (plingeling) R 26416 26416 26251 0 -1 4202560 2554 1255 0 0 298 0 0 0 25 0 5 0 512478510 143007744 6977 33554432000 4194304 4356188 140736149172608 18446744073709551615 4280645 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26421/tid=26429] ppid=26416 vsize=139656 CPUtime=2.95 cores=4-7
/proc/26421/task/26429/stat : 26429 (plingeling) R 26416 26416 26251 0 -1 4202560 1918 1255 0 0 295 0 0 0 25 0 5 0 512478510 143007744 6977 33554432000 4194304 4356188 140736149172608 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=26421/tid=26430] ppid=26416 vsize=139656 CPUtime=2.98 cores=4-7
/proc/26421/task/26430/stat : 26430 (plingeling) R 26416 26416 26251 0 -1 4202560 2296 1255 0 0 298 0 0 0 25 0 5 0 512478510 143007744 6977 33554432000 4194304 4356188 140736149172608 18446744073709551615 4237428 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=26421/tid=26431] ppid=26416 vsize=139656 CPUtime=2.98 cores=4-7
/proc/26421/task/26431/stat : 26431 (plingeling) R 26416 26416 26251 0 -1 4202560 2298 1255 0 0 298 0 0 0 25 0 5 0 512478510 143007744 6977 33554432000 4194304 4356188 140736149172608 18446744073709551615 4330862 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 24.37
Current children cumulated vsize (KiB) 764892

[startup+6.30136 s]
/proc/loadavg: 8.10 8.00 7.94 9/180 26431
/proc/meminfo: memFree=16621284/32951124 swapFree=67111528/67111528
[pid=26416] ppid=26414 vsize=18324 CPUtime=0 cores=0-7
/proc/26416/stat : 26416 (ppfolio) S 26414 26416 26251 0 -1 4202496 519 0 0 0 0 0 0 0 15 0 1 0 512478499 18763776 389 33554432000 4194304 4287625 140736246045568 18446744073709551615 210204667407 0 0 4096 65536 10858117270673031167 0 0 17 4 0 0 0
/proc/26416/statm: 4581 389 341 23 0 91 0
[pid=26417] ppid=26416 vsize=1738060 CPUtime=6.29 cores=0
/proc/26417/stat : 26417 (cryptominisat) R 26416 26416 26251 0 -1 4202496 13452 0 0 0 627 2 0 0 25 0 1 0 512478499 1779773440 9717 33554432000 4194304 4587354 140733774431712 18446744073709551615 4365154 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/26417/statm: 434515 9717 336 96 0 431077 0
[pid=26418] ppid=26416 vsize=35288 CPUtime=6.28 cores=1
/proc/26418/stat : 26418 (clasp) R 26416 26416 26251 0 -1 4202496 7229 0 0 0 627 1 0 0 25 0 1 0 512478499 36134912 6086 33554432000 4194304 4785740 140734436965024 18446744073709551615 4287028 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/26418/statm: 8822 6086 340 145 0 5867 0
[pid=26419] ppid=26416 vsize=462164 CPUtime=6.29 cores=2
/proc/26419/stat : 26419 (TNM) R 26416 26416 26251 0 -1 4202496 3332 0 0 0 629 0 0 0 25 0 1 0 512478499 473255936 3229 33554432000 134512640 134534564 4287858496 18446744073709551615 134528979 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/26419/statm: 115541 3229 95 6 0 114207 0
[pid=26420] ppid=26416 vsize=66912 CPUtime=6.29 cores=3
/proc/26420/stat : 26420 (march_hi) R 26416 26416 26251 0 -1 4202496 32388 0 0 0 626 3 0 0 25 0 1 0 512478499 68517888 8652 33554432000 4194304 4331988 140736637194736 18446744073709551615 4226237 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/26420/statm: 16728 8652 175 34 0 15170 0
[pid=26421] ppid=26416 vsize=142988 CPUtime=24.79 cores=4-7
/proc/26421/stat : 26421 (plingeling) S 26416 26416 26251 0 -1 4202496 14391 1255 0 0 2478 1 0 0 25 0 5 0 512478499 146419712 7808 33554432000 4194304 4356188 140736149172608 18446744073709551615 210216450021 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/26421/statm: 35747 7808 164 40 0 34291 0
[pid=26421/tid=26428] ppid=26416 vsize=142988 CPUtime=6.18 cores=4-7
/proc/26421/task/26428/stat : 26428 (plingeling) R 26416 26416 26251 0 -1 4202560 2554 1255 0 0 618 0 0 0 25 0 5 0 512478510 146419712 7808 33554432000 4194304 4356188 140736149172608 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26421/tid=26429] ppid=26416 vsize=142988 CPUtime=6.13 cores=4-7
/proc/26421/task/26429/stat : 26429 (plingeling) R 26416 26416 26251 0 -1 4202560 2218 1255 0 0 613 0 0 0 25 0 5 0 512478510 146419712 7808 33554432000 4194304 4356188 140736149172608 18446744073709551615 4212217 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=26421/tid=26430] ppid=26416 vsize=142988 CPUtime=6.18 cores=4-7
/proc/26421/task/26430/stat : 26430 (plingeling) R 26416 26416 26251 0 -1 4202560 2296 1255 0 0 618 0 0 0 25 0 5 0 512478510 146419712 7808 33554432000 4194304 4356188 140736149172608 18446744073709551615 4237407 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=26421/tid=26431] ppid=26416 vsize=142988 CPUtime=6.18 cores=4-7
/proc/26421/task/26431/stat : 26431 (plingeling) R 26416 26416 26251 0 -1 4202560 2833 1255 0 0 618 0 0 0 25 0 5 0 512478510 146419712 7808 33554432000 4194304 4356188 140736149172608 18446744073709551615 4331047 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 49.94
Current children cumulated vsize (KiB) 2463736

[startup+12.7013 s]
/proc/loadavg: 8.10 8.00 7.94 9/180 26432
/proc/meminfo: memFree=16597380/32951124 swapFree=67111528/67111528
[pid=26416] ppid=26414 vsize=18324 CPUtime=0 cores=0-7
/proc/26416/stat : 26416 (ppfolio) S 26414 26416 26251 0 -1 4202496 519 0 0 0 0 0 0 0 15 0 1 0 512478499 18763776 389 33554432000 4194304 4287625 140736246045568 18446744073709551615 210204667407 0 0 4096 65536 10858117270673031167 0 0 17 4 0 0 0
/proc/26416/statm: 4581 389 341 23 0 91 0
[pid=26417] ppid=26416 vsize=1720528 CPUtime=12.68 cores=0
/proc/26417/stat : 26417 (cryptominisat) R 26416 26416 26251 0 -1 4202496 16504 0 0 0 1266 2 0 0 25 0 1 0 512478499 1761820672 10484 33554432000 4194304 4587354 140733774431712 18446744073709551615 4237679 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/26417/statm: 430132 10484 336 96 0 426694 0
[pid=26418] ppid=26416 vsize=38092 CPUtime=12.68 cores=1
/proc/26418/stat : 26418 (clasp) R 26416 26416 26251 0 -1 4202496 7909 0 0 0 1267 1 0 0 25 0 1 0 512478499 39006208 6766 33554432000 4194304 4785740 140734436965024 18446744073709551615 210204308165 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/26418/statm: 9523 6766 340 145 0 6568 0
[pid=26419] ppid=26416 vsize=462164 CPUtime=12.69 cores=2
/proc/26419/stat : 26419 (TNM) R 26416 26416 26251 0 -1 4202496 3332 0 0 0 1269 0 0 0 25 0 1 0 512478499 473255936 3229 33554432000 134512640 134534564 4287858496 18446744073709551615 134529031 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/26419/statm: 115541 3229 95 6 0 114207 0
[pid=26420] ppid=26416 vsize=69748 CPUtime=12.69 cores=3
/proc/26420/stat : 26420 (march_hi) R 26416 26416 26251 0 -1 4202496 33176 0 0 0 1265 4 0 0 25 0 1 0 512478499 71421952 9425 33554432000 4194304 4331988 140736637194736 18446744073709551615 4210906 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/26420/statm: 17437 9425 175 34 0 15879 0
[pid=26421] ppid=26416 vsize=152204 CPUtime=50.36 cores=4-7
/proc/26421/stat : 26421 (plingeling) S 26416 26416 26251 0 -1 4202496 17719 1255 0 0 5034 2 0 0 25 0 5 0 512478499 155856896 10112 33554432000 4194304 4356188 140736149172608 18446744073709551615 210216450021 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/26421/statm: 38051 10112 164 40 0 36595 0
[pid=26421/tid=26428] ppid=26416 vsize=152204 CPUtime=12.58 cores=4-7
/proc/26421/task/26428/stat : 26428 (plingeling) R 26416 26416 26251 0 -1 4202560 3579 1255 0 0 1258 0 0 0 25 0 5 0 512478510 155856896 10112 33554432000 4194304 4356188 140736149172608 18446744073709551615 4331570 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26421/tid=26429] ppid=26416 vsize=152204 CPUtime=12.49 cores=4-7
/proc/26421/task/26429/stat : 26429 (plingeling) R 26416 26416 26251 0 -1 4202560 3370 1255 0 0 1249 0 0 0 25 0 5 0 512478510 155856896 10112 33554432000 4194304 4356188 140736149172608 18446744073709551615 4279725 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=26421/tid=26430] ppid=26416 vsize=152204 CPUtime=12.58 cores=4-7
/proc/26421/task/26430/stat : 26430 (plingeling) R 26416 26416 26251 0 -1 4202560 2928 1255 0 0 1258 0 0 0 25 0 5 0 512478510 155856896 10112 33554432000 4194304 4356188 140736149172608 18446744073709551615 4262906 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=26421/tid=26431] ppid=26416 vsize=152204 CPUtime=12.58 cores=4-7
/proc/26421/task/26431/stat : 26431 (plingeling) R 26416 26416 26251 0 -1 4202560 3352 1255 0 0 1258 0 0 0 25 0 5 0 512478510 155856896 10112 33554432000 4194304 4356188 140736149172608 18446744073709551615 4332020 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 101.1
Current children cumulated vsize (KiB) 2461060

[startup+25.5012 s]
/proc/loadavg: 8.07 8.00 7.94 9/180 26432
/proc/meminfo: memFree=16584484/32951124 swapFree=67111528/67111528
[pid=26416] ppid=26414 vsize=18324 CPUtime=0 cores=0-7
/proc/26416/stat : 26416 (ppfolio) S 26414 26416 26251 0 -1 4202496 519 0 0 0 0 0 0 0 15 0 1 0 512478499 18763776 389 33554432000 4194304 4287625 140736246045568 18446744073709551615 210204667407 0 0 4096 65536 10858117270673031167 0 0 17 4 0 0 0
/proc/26416/statm: 4581 389 341 23 0 91 0
[pid=26417] ppid=26416 vsize=1721776 CPUtime=25.49 cores=0
/proc/26417/stat : 26417 (cryptominisat) R 26416 26416 26251 0 -1 4202496 27331 0 0 0 2544 5 0 0 25 0 1 0 512478499 1763098624 7816 33554432000 4194304 4587354 140733774431712 18446744073709551615 4230359 0 0 4096 2 0 0 0 17 0 0 0 0

################
# More data... #
################

[pid=26419] ppid=26416 vsize=462168 CPUtime=4782.35 cores=2
/proc/26419/stat : 26419 (TNM) R 26416 26416 26251 0 -1 4202496 3341 0 0 0 478235 0 0 0 25 0 1 0 512478499 473260032 3238 33554432000 134512640 134534564 4287858496 18446744073709551615 134529042 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/26419/statm: 115542 3238 103 6 0 114208 0
[pid=26420] ppid=26416 vsize=393260 CPUtime=4782.34 cores=3
/proc/26420/stat : 26420 (march_hi) R 26416 26416 26251 0 -1 4202496 80300 0 0 0 478195 39 0 0 25 0 1 0 512478499 402698240 56533 33554432000 4194304 4331988 140736637194736 18446744073709551615 4243048 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/26420/statm: 98315 56533 175 34 0 96757 0
[pid=26421] ppid=26416 vsize=356260 CPUtime=19101.9 cores=4-7
/proc/26421/stat : 26421 (plingeling) S 26416 26416 26251 0 -1 4202496 1006028 1255 0 0 1910043 146 0 0 25 0 5 0 512478499 364810240 61128 33554432000 4194304 4356188 140736149172608 18446744073709551615 210216450021 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/26421/statm: 89065 61128 164 40 0 87609 0
[pid=26421/tid=26428] ppid=26416 vsize=356260 CPUtime=4782.25 cores=4-7
/proc/26421/task/26428/stat : 26428 (plingeling) R 26416 26416 26251 0 -1 4202560 258795 1255 0 0 478188 37 0 0 25 0 5 0 512478510 364810240 61128 33554432000 4194304 4356188 140736149172608 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26421/tid=26429] ppid=26416 vsize=356260 CPUtime=4756.15 cores=4-7
/proc/26421/task/26429/stat : 26429 (plingeling) R 26416 26416 26251 0 -1 4202560 283131 1255 0 0 475573 42 0 0 25 0 5 0 512478510 364810240 61128 33554432000 4194304 4356188 140736149172608 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=26421/tid=26430] ppid=26416 vsize=356260 CPUtime=4782.24 cores=4-7
/proc/26421/task/26430/stat : 26430 (plingeling) R 26416 26416 26251 0 -1 4202560 309763 1255 0 0 478181 43 0 0 25 0 5 0 512478510 364810240 61128 33554432000 4194304 4356188 140736149172608 18446744073709551615 4331069 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=26421/tid=26431] ppid=26416 vsize=356260 CPUtime=4781.14 cores=4-7
/proc/26421/task/26431/stat : 26431 (plingeling) R 26416 26416 26251 0 -1 4202560 149849 1255 0 0 478091 23 0 0 25 0 5 0 512478510 364810240 61128 33554432000 4194304 4356188 140736149172608 18446744073709551615 4279749 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 38231
Current children cumulated vsize (KiB) 3349608

[startup+4842.3 s]
/proc/loadavg: 8.12 8.07 8.00 9/180 26572
/proc/meminfo: memFree=15876340/32951124 swapFree=67111528/67111528
[pid=26416] ppid=26414 vsize=18324 CPUtime=0 cores=0-7
/proc/26416/stat : 26416 (ppfolio) S 26414 26416 26251 0 -1 4202496 519 0 0 0 0 0 0 0 15 0 1 0 512478499 18763776 389 33554432000 4194304 4287625 140736246045568 18446744073709551615 210204667407 0 0 4096 65536 10858117270673031167 0 0 17 4 0 0 0
/proc/26416/statm: 4581 389 341 23 0 91 0
[pid=26417] ppid=26416 vsize=1810584 CPUtime=4842.08 cores=0
/proc/26417/stat : 26417 (cryptominisat) R 26416 26416 26251 0 -1 4202496 349200 0 0 0 484045 163 0 0 25 0 1 0 512478499 1854038016 34436 33554432000 4194304 4587354 140733774431712 18446744073709551615 4238271 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/26417/statm: 452646 34436 336 96 0 449208 0
[pid=26418] ppid=26416 vsize=247360 CPUtime=4842.34 cores=1
/proc/26418/stat : 26418 (clasp) R 26416 26416 26251 0 -1 4202496 57685 0 0 0 484210 24 0 0 25 0 1 0 512478499 253296640 56542 33554432000 4194304 4785740 140734436965024 18446744073709551615 4287248 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/26418/statm: 61840 56542 340 145 0 58885 0
[pid=26419] ppid=26416 vsize=462168 CPUtime=4842.35 cores=2
/proc/26419/stat : 26419 (TNM) R 26416 26416 26251 0 -1 4202496 3341 0 0 0 484235 0 0 0 25 0 1 0 512478499 473260032 3238 33554432000 134512640 134534564 4287858496 18446744073709551615 134530712 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/26419/statm: 115542 3238 103 6 0 114208 0
[pid=26420] ppid=26416 vsize=393392 CPUtime=4842.34 cores=3
/proc/26420/stat : 26420 (march_hi) R 26416 26416 26251 0 -1 4202496 81037 0 0 0 484194 40 0 0 25 0 1 0 512478499 402833408 57270 33554432000 4194304 4331988 140736637194736 18446744073709551615 4211141 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/26420/statm: 98348 57270 175 34 0 96790 0
[pid=26421] ppid=26416 vsize=380836 CPUtime=19341.6 cores=4-7
/proc/26421/stat : 26421 (plingeling) S 26416 26416 26251 0 -1 4202496 1018572 1255 0 0 1934008 148 0 0 25 0 5 0 512478499 389976064 67272 33554432000 4194304 4356188 140736149172608 18446744073709551615 210216450021 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/26421/statm: 95209 67272 164 40 0 93753 0
[pid=26421/tid=26428] ppid=26416 vsize=380836 CPUtime=4842.25 cores=4-7
/proc/26421/task/26428/stat : 26428 (plingeling) R 26416 26416 26251 0 -1 4202560 261099 1255 0 0 484188 37 0 0 25 0 5 0 512478510 389976064 67272 33554432000 4194304 4356188 140736149172608 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26421/tid=26429] ppid=26416 vsize=380836 CPUtime=4815.81 cores=4-7
/proc/26421/task/26429/stat : 26429 (plingeling) R 26416 26416 26251 0 -1 4202560 285947 1255 0 0 481539 42 0 0 25 0 5 0 512478510 389976064 67272 33554432000 4194304 4356188 140736149172608 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=26421/tid=26430] ppid=26416 vsize=380836 CPUtime=4842.23 cores=4-7
/proc/26421/task/26430/stat : 26430 (plingeling) R 26416 26416 26251 0 -1 4202560 315395 1255 0 0 484180 43 0 0 25 0 5 0 512478510 389976064 67272 33554432000 4194304 4356188 140736149172608 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=26421/tid=26431] ppid=26416 vsize=380836 CPUtime=4841.13 cores=4-7
/proc/26421/task/26431/stat : 26431 (plingeling) R 26416 26416 26251 0 -1 4202560 151641 1255 0 0 484090 23 0 0 25 0 5 0 512478510 389976064 67272 33554432000 4194304 4356188 140736149172608 18446744073709551615 4244260 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 38710.7
Current children cumulated vsize (KiB) 3312664

[startup+4902.3 s]
/proc/loadavg: 8.05 8.06 8.00 9/180 26583
/proc/meminfo: memFree=15901512/32951124 swapFree=67111528/67111528
[pid=26416] ppid=26414 vsize=18324 CPUtime=0 cores=0-7
/proc/26416/stat : 26416 (ppfolio) S 26414 26416 26251 0 -1 4202496 519 0 0 0 0 0 0 0 15 0 1 0 512478499 18763776 389 33554432000 4194304 4287625 140736246045568 18446744073709551615 210204667407 0 0 4096 65536 10858117270673031167 0 0 17 4 0 0 0
/proc/26416/statm: 4581 389 341 23 0 91 0
[pid=26417] ppid=26416 vsize=1810584 CPUtime=4902.06 cores=0
/proc/26417/stat : 26417 (cryptominisat) R 26416 26416 26251 0 -1 4202496 351439 0 0 0 490041 165 0 0 25 0 1 0 512478499 1854038016 36608 33554432000 4194304 4587354 140733774431712 18446744073709551615 4239572 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/26417/statm: 452646 36608 336 96 0 449208 0
[pid=26418] ppid=26416 vsize=248640 CPUtime=4902.34 cores=1
/proc/26418/stat : 26418 (clasp) R 26416 26416 26251 0 -1 4202496 58002 0 0 0 490209 25 0 0 25 0 1 0 512478499 254607360 56859 33554432000 4194304 4785740 140734436965024 18446744073709551615 4287099 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/26418/statm: 62160 56859 340 145 0 59205 0
[pid=26419] ppid=26416 vsize=462168 CPUtime=4902.35 cores=2
/proc/26419/stat : 26419 (TNM) R 26416 26416 26251 0 -1 4202496 3341 0 0 0 490235 0 0 0 25 0 1 0 512478499 473260032 3238 33554432000 134512640 134534564 4287858496 18446744073709551615 134529870 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/26419/statm: 115542 3238 103 6 0 114208 0
[pid=26420] ppid=26416 vsize=393524 CPUtime=4902.34 cores=3
/proc/26420/stat : 26420 (march_hi) R 26416 26416 26251 0 -1 4202496 81602 0 0 0 490194 40 0 0 25 0 1 0 512478499 402968576 57835 33554432000 4194304 4331988 140736637194736 18446744073709551615 4226440 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/26420/statm: 98381 57835 175 34 0 96823 0
[pid=26421] ppid=26416 vsize=342948 CPUtime=19581.2 cores=4-7
/proc/26421/stat : 26421 (plingeling) S 26416 26416 26251 0 -1 4202496 1025228 1255 0 0 1957974 149 0 0 25 0 5 0 512478499 351178752 57800 33554432000 4194304 4356188 140736149172608 18446744073709551615 210216450021 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/26421/statm: 85737 57800 164 40 0 84281 0
[pid=26421/tid=26428] ppid=26416 vsize=342948 CPUtime=4902.25 cores=4-7
/proc/26421/task/26428/stat : 26428 (plingeling) R 26416 26416 26251 0 -1 4202560 262635 1255 0 0 490187 38 0 0 25 0 5 0 512478510 351178752 57800 33554432000 4194304 4356188 140736149172608 18446744073709551615 4211042 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26421/tid=26429] ppid=26416 vsize=342948 CPUtime=4875.5 cores=4-7
/proc/26421/task/26429/stat : 26429 (plingeling) R 26416 26416 26251 0 -1 4202560 287995 1255 0 0 487507 43 0 0 25 0 5 0 512478510 351178752 57800 33554432000 4194304 4356188 140736149172608 18446744073709551615 4330976 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=26421/tid=26430] ppid=26416 vsize=342948 CPUtime=4902.23 cores=4-7
/proc/26421/task/26430/stat : 26430 (plingeling) R 26416 26416 26251 0 -1 4202560 316931 1255 0 0 490180 43 0 0 25 0 5 0 512478510 351178752 57800 33554432000 4194304 4356188 140736149172608 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=26421/tid=26431] ppid=26416 vsize=342948 CPUtime=4901.12 cores=4-7
/proc/26421/task/26431/stat : 26431 (plingeling) R 26416 26416 26251 0 -1 4202560 153177 1255 0 0 490089 23 0 0 25 0 5 0 512478510 351178752 57800 33554432000 4194304 4356188 140736149172608 18446744073709551615 4284212 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 39190.3
Current children cumulated vsize (KiB) 3276188

[startup+4962.3 s]
/proc/loadavg: 8.01 8.05 8.00 9/180 26585
/proc/meminfo: memFree=15868000/32951124 swapFree=67111528/67111528
[pid=26416] ppid=26414 vsize=18324 CPUtime=0 cores=0-7
/proc/26416/stat : 26416 (ppfolio) S 26414 26416 26251 0 -1 4202496 519 0 0 0 0 0 0 0 15 0 1 0 512478499 18763776 389 33554432000 4194304 4287625 140736246045568 18446744073709551615 210204667407 0 0 4096 65536 10858117270673031167 0 0 17 4 0 0 0
/proc/26416/statm: 4581 389 341 23 0 91 0
[pid=26417] ppid=26416 vsize=1813624 CPUtime=4962.06 cores=0
/proc/26417/stat : 26417 (cryptominisat) R 26416 26416 26251 0 -1 4202496 352289 0 0 0 496040 166 0 0 25 0 1 0 512478499 1857150976 34591 33554432000 4194304 4587354 140733774431712 18446744073709551615 4243751 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/26417/statm: 453406 34591 336 96 0 449968 0
[pid=26418] ppid=26416 vsize=249600 CPUtime=4962.34 cores=1
/proc/26418/stat : 26418 (clasp) R 26416 26416 26251 0 -1 4202496 58240 0 0 0 496209 25 0 0 25 0 1 0 512478499 255590400 57097 33554432000 4194304 4785740 140734436965024 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/26418/statm: 62400 57097 340 145 0 59445 0
[pid=26419] ppid=26416 vsize=462168 CPUtime=4962.35 cores=2
/proc/26419/stat : 26419 (TNM) R 26416 26416 26251 0 -1 4202496 3341 0 0 0 496235 0 0 0 25 0 1 0 512478499 473260032 3238 33554432000 134512640 134534564 4287858496 18446744073709551615 134528957 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/26419/statm: 115542 3238 103 6 0 114208 0
[pid=26420] ppid=26416 vsize=393788 CPUtime=4962.34 cores=3
/proc/26420/stat : 26420 (march_hi) R 26416 26416 26251 0 -1 4202496 82162 0 0 0 496194 40 0 0 25 0 1 0 512478499 403238912 58395 33554432000 4194304 4331988 140736637194736 18446744073709551615 4242690 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/26420/statm: 98447 58395 175 34 0 96889 0
[pid=26421] ppid=26416 vsize=381860 CPUtime=19820.9 cores=4-7
/proc/26421/stat : 26421 (plingeling) S 26416 26416 26251 0 -1 4202496 1045196 1255 0 0 1981938 152 0 0 25 0 5 0 512478499 391024640 67528 33554432000 4194304 4356188 140736149172608 18446744073709551615 210216450021 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/26421/statm: 95465 67528 164 40 0 94009 0
[pid=26421/tid=26428] ppid=26416 vsize=381860 CPUtime=4962.25 cores=4-7
/proc/26421/task/26428/stat : 26428 (plingeling) R 26416 26416 26251 0 -1 4202560 269035 1255 0 0 496187 38 0 0 25 0 5 0 512478510 391024640 67528 33554432000 4194304 4356188 140736149172608 18446744073709551615 4331069 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26421/tid=26429] ppid=26416 vsize=381860 CPUtime=4935.16 cores=4-7
/proc/26421/task/26429/stat : 26429 (plingeling) R 26416 26416 26251 0 -1 4202560 293371 1255 0 0 493473 43 0 0 25 0 5 0 512478510 391024640 67528 33554432000 4194304 4356188 140736149172608 18446744073709551615 4331055 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=26421/tid=26430] ppid=26416 vsize=381860 CPUtime=4962.23 cores=4-7
/proc/26421/task/26430/stat : 26430 (plingeling) R 26416 26416 26251 0 -1 4202560 319747 1255 0 0 496179 44 0 0 25 0 5 0 512478510 391024640 67528 33554432000 4194304 4356188 140736149172608 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=26421/tid=26431] ppid=26416 vsize=381860 CPUtime=4961.11 cores=4-7
/proc/26421/task/26431/stat : 26431 (plingeling) R 26416 26416 26251 0 -1 4202560 158553 1255 0 0 496087 24 0 0 25 0 5 0 512478510 391024640 67528 33554432000 4194304 4356188 140736149172608 18446744073709551615 4279478 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 39670
Current children cumulated vsize (KiB) 3319364



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5003.6 s]
/proc/loadavg: 8.01 8.04 8.00 9/180 26585
/proc/meminfo: memFree=15889924/32951124 swapFree=67111528/67111528
[pid=26416] ppid=26414 vsize=18324 CPUtime=0 cores=0-7
/proc/26416/stat : 26416 (ppfolio) S 26414 26416 26251 0 -1 4202496 519 0 0 0 0 0 0 0 15 0 1 0 512478499 18763776 389 33554432000 4194304 4287625 140736246045568 18446744073709551615 210204667407 0 0 4096 65536 10858117270673031167 0 0 17 4 0 0 0
/proc/26416/statm: 4581 389 341 23 0 91 0
[pid=26417] ppid=26416 vsize=1813624 CPUtime=5003.37 cores=0
/proc/26417/stat : 26417 (cryptominisat) R 26416 26416 26251 0 -1 4202496 354507 0 0 0 500169 168 0 0 25 0 1 0 512478499 1857150976 36765 33554432000 4194304 4587354 140733774431712 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/26417/statm: 453406 36765 336 96 0 449968 0
[pid=26418] ppid=26416 vsize=249600 CPUtime=5003.65 cores=1
/proc/26418/stat : 26418 (clasp) R 26416 26416 26251 0 -1 4202496 58245 0 0 0 500340 25 0 0 25 0 1 0 512478499 255590400 57102 33554432000 4194304 4785740 140734436965024 18446744073709551615 4552666 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/26418/statm: 62400 57102 340 145 0 59445 0
[pid=26419] ppid=26416 vsize=462168 CPUtime=5003.66 cores=2
/proc/26419/stat : 26419 (TNM) R 26416 26416 26251 0 -1 4202496 3341 0 0 0 500366 0 0 0 25 0 1 0 512478499 473260032 3238 33554432000 134512640 134534564 4287858496 18446744073709551615 134529031 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/26419/statm: 115542 3238 103 6 0 114208 0
[pid=26420] ppid=26416 vsize=393920 CPUtime=5003.64 cores=3
/proc/26420/stat : 26420 (march_hi) R 26416 26416 26251 0 -1 4202496 82610 0 0 0 500324 40 0 0 25 0 1 0 512478499 403374080 58843 33554432000 4194304 4331988 140736637194736 18446744073709551615 4237147 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/26420/statm: 98480 58843 175 34 0 96922 0
[pid=26421] ppid=26416 vsize=348068 CPUtime=19985.9 cores=4-7
/proc/26421/stat : 26421 (plingeling) S 26416 26416 26251 0 -1 4202496 1049292 1255 0 0 1998437 152 0 0 25 0 5 0 512478499 356421632 59080 33554432000 4194304 4356188 140736149172608 18446744073709551615 210216450021 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/26421/statm: 87017 59080 164 40 0 85561 0
[pid=26421/tid=26428] ppid=26416 vsize=348068 CPUtime=5003.55 cores=4-7
/proc/26421/task/26428/stat : 26428 (plingeling) R 26416 26416 26251 0 -1 4202560 269035 1255 0 0 500317 38 0 0 25 0 5 0 512478510 356421632 59080 33554432000 4194304 4356188 140736149172608 18446744073709551615 4331165 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26421/tid=26429] ppid=26416 vsize=348068 CPUtime=4976.24 cores=4-7
/proc/26421/task/26429/stat : 26429 (plingeling) R 26416 26416 26251 0 -1 4202560 295419 1255 0 0 497581 43 0 0 25 0 5 0 512478510 356421632 59080 33554432000 4194304 4356188 140736149172608 18446744073709551615 4332046 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=26421/tid=26430] ppid=26416 vsize=348068 CPUtime=5003.54 cores=4-7
/proc/26421/task/26430/stat : 26430 (plingeling) R 26416 26416 26251 0 -1 4202560 320259 1255 0 0 500310 44 0 0 25 0 5 0 512478510 356421632 59080 33554432000 4194304 4356188 140736149172608 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=26421/tid=26431] ppid=26416 vsize=348068 CPUtime=5002.42 cores=4-7
/proc/26421/task/26431/stat : 26431 (plingeling) R 26416 26416 26251 0 -1 4202560 160089 1255 0 0 500217 25 0 0 25 0 5 0 512478510 356421632 59080 33554432000 4194304 4356188 140736149172608 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 40000.2
Current children cumulated vsize (KiB) 3285704

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 26416 and gives
#  childrusage.ru_utime.tv_sec=10005
#  childrusage.ru_utime.tv_usec=358954
#  childrusage.ru_stime.tv_sec=1
#  childrusage.ru_stime.tv_usec=705740
# CPU time returned by wait4() is 10007.1
# while last known CPU time is 40000.2
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 5003.62
CPU time (s): 40000.2
CPU user time (s): 39996.4
CPU system time (s): 3.85
CPU usage (%): 799.426
Max. virtual memory (cumulated for all children) (KiB): 18813316

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 10005.4
system time used= 1.70574
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 358368
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 479
involuntary context switches= 16298

runsolver used 8.22575 second user time and 19.0711 second system time

The end

Launcher Data 

Begin job on node130 at 2011-04-28 18:40:00
IDJOB=3310305
IDBENCH=83108
IDSOLVER=1638
FILE ID=node130/3310305-1304008800
RUNJOBID= node130-1304008132-26265
PBS_JOBID= 13168841
Free space on /tmp= 71992 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT11/application/fuhs/slp-synthesis-AES/slp-synthesis-aes-bottom15.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3310305-1304008800/watcher-3310305-1304008800 -o /tmp/evaluation-result-3310305-1304008800/solver-3310305-1304008800 -C 40000 -W 5100 -M 31000  ppfolio HOME/instance-3310305-1304008800.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 1f0914c6141fdba914b73575a12b918a
RANDOM SEED=86502530

node130.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.81
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.81
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      16747740 kB
Buffers:       2125496 kB
Cached:       13459276 kB
SwapCached:          0 kB
Active:        7421204 kB
Inactive:      8227280 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      16747740 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:           11276 kB
Writeback:           0 kB
AnonPages:       63800 kB
Mapped:          15112 kB
Slab:           489112 kB
PageTables:       4768 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   189276 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71984 MiB
End job on node130 at 2011-04-28 20:03:26