Trace number 3275201

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio par? (TO) 40000.2 5003.52

General information on the benchmark

NameCRAFTED/rbsat/crafted/
forced/rbsat-v2400c266431gyes2.cnf
MD5SUMaac2bd287b8cd6b96cbf7ecc463acf19
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables2400
Number of clauses266431
Sum of the clauses size535112
Maximum clause length32
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 2266356
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 575

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 8 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	[5] plingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 0
0.00/0.00	Starting clasp 1.3.6 on core(s) 1
0.00/0.00	Starting TNM 2009 on core(s) 2
0.00/0.00	Starting march_hi 2009 on core(s) 3
0.00/0.00	Starting plingeling 276-6264d55-100731 on core(s) 4 5 6 7

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3275201-1304145444/watcher-3275201-1304145444 -o /tmp/evaluation-result-3275201-1304145444/solver-3275201-1304145444 -C 40000 -W 5100 -M 31000 ppfolio HOME/instance-3275201-1304145444.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.55 2.60 3.15 2/170 354
/proc/meminfo: memFree=30098136/32950928 swapFree=67086612/67111528
[pid=354] ppid=352 vsize=18240 CPUtime=0 cores=0-7
/proc/354/stat : 354 (ppfolio) R 352 354 328 0 -1 4194304 271 0 0 0 0 0 0 0 20 0 1 0 526141482 18677760 220 33554432000 4194304 4287625 140734735958384 18446744073709551615 239471732200 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/354/statm: 4560 221 187 23 0 57 0

[startup+0.107794 s]
/proc/loadavg: 1.55 2.60 3.15 2/170 354
/proc/meminfo: memFree=30098136/32950928 swapFree=67086612/67111528
[pid=354] ppid=352 vsize=18324 CPUtime=0 cores=0-7
/proc/354/stat : 354 (ppfolio) S 352 354 328 0 -1 4202496 521 0 0 0 0 0 0 0 24 0 1 0 526141482 18763776 390 33554432000 4194304 4287625 140734735958384 18446744073709551615 239476715023 0 0 4096 65536 4369319575100063743 0 0 17 6 0 0 0
/proc/354/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.219848 s]
/proc/loadavg: 1.55 2.60 3.15 2/170 354
/proc/meminfo: memFree=30098136/32950928 swapFree=67086612/67111528
[pid=354] ppid=352 vsize=18324 CPUtime=0 cores=0-7
/proc/354/stat : 354 (ppfolio) S 352 354 328 0 -1 4202496 521 0 0 0 0 0 0 0 23 0 1 0 526141482 18763776 390 33554432000 4194304 4287625 140734735958384 18446744073709551615 239476715023 0 0 4096 65536 4369319575100063743 0 0 17 6 0 0 0
/proc/354/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.300699 s]
/proc/loadavg: 1.55 2.60 3.15 2/170 354
/proc/meminfo: memFree=30098136/32950928 swapFree=67086612/67111528
[pid=354] ppid=352 vsize=18324 CPUtime=0 cores=0-7
/proc/354/stat : 354 (ppfolio) S 352 354 328 0 -1 4202496 521 0 0 0 0 0 0 0 23 0 1 0 526141482 18763776 390 33554432000 4194304 4287625 140734735958384 18446744073709551615 239476715023 0 0 4096 65536 4369319575100063743 0 0 17 6 0 0 0
/proc/354/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.700623 s]
/proc/loadavg: 1.55 2.60 3.15 2/170 354
/proc/meminfo: memFree=30098136/32950928 swapFree=67086612/67111528
[pid=354] ppid=352 vsize=18324 CPUtime=0 cores=0-7
/proc/354/stat : 354 (ppfolio) S 352 354 328 0 -1 4202496 521 0 0 0 0 0 0 0 18 0 1 0 526141482 18763776 390 33554432000 4194304 4287625 140734735958384 18446744073709551615 239476715023 0 0 4096 65536 4369319575100063743 0 0 17 6 0 0 0
/proc/354/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50047 s]
/proc/loadavg: 1.55 2.60 3.15 9/180 369
/proc/meminfo: memFree=29947740/32950928 swapFree=67086612/67111528
[pid=354] ppid=352 vsize=18324 CPUtime=0 cores=0-7
/proc/354/stat : 354 (ppfolio) S 352 354 328 0 -1 4202496 521 0 0 0 0 0 0 0 15 0 1 0 526141482 18763776 390 33554432000 4194304 4287625 140734735958384 18446744073709551615 239476715023 0 0 4096 65536 4369319575100063743 0 0 17 6 0 0 0
/proc/354/statm: 4581 390 341 23 0 91 0
[pid=355] ppid=354 vsize=66824 CPUtime=1.48 cores=0
/proc/355/stat : 355 (cryptominisat) R 354 354 328 0 -1 4202496 17691 0 0 0 146 2 0 0 20 0 1 0 526141482 68427776 11643 33554432000 4194304 4587354 140737351525040 18446744073709551615 4238611 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/355/statm: 16706 11643 326 96 0 13268 0
[pid=356] ppid=354 vsize=32512 CPUtime=1.49 cores=1
/proc/356/stat : 356 (clasp) R 354 354 328 0 -1 4202496 6614 0 0 0 148 1 0 0 20 0 1 0 526141482 33292288 5334 33554432000 4194304 4785740 140735330960768 18446744073709551615 4482856 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/356/statm: 8128 5334 316 145 0 5173 0
[pid=357] ppid=354 vsize=464404 CPUtime=1.44 cores=2
/proc/357/stat : 357 (TNM) R 354 354 328 0 -1 4202496 4411 0 10 0 144 0 0 0 25 0 1 0 526141482 475549696 4318 33554432000 134512640 134534564 4290224288 18446744073709551615 134524508 0 0 4096 0 0 0 0 17 2 0 0 4
/proc/357/statm: 116101 4318 91 6 0 114767 0
[pid=358] ppid=354 vsize=43236 CPUtime=1.49 cores=3
/proc/358/stat : 358 (march_hi) R 354 354 328 0 -1 4202496 21421 0 0 0 147 2 0 0 25 0 1 0 526141482 44273664 4746 33554432000 4194304 4331988 140736135024368 18446744073709551615 4228247 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/358/statm: 10809 4746 174 34 0 9251 0
[pid=359] ppid=354 vsize=164020 CPUtime=5.43 cores=4-7
/proc/359/stat : 359 (plingeling) S 354 354 328 0 -1 4202496 17405 1255 0 0 541 2 0 0 18 0 5 0 526141482 167956480 13069 33554432000 4194304 4356188 140736063607856 18446744073709551615 239488497637 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/359/statm: 41005 13069 162 40 0 39549 0
[pid=359/tid=366] ppid=354 vsize=164020 CPUtime=1.31 cores=4-7
/proc/359/task/366/stat : 366 (plingeling) R 354 354 328 0 -1 4202560 1124 1255 0 0 131 0 0 0 19 0 5 0 526141500 167956480 13069 33554432000 4194304 4356188 140736063607856 18446744073709551615 4276723 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=359/tid=367] ppid=354 vsize=164020 CPUtime=1.31 cores=4-7
/proc/359/task/367/stat : 367 (plingeling) R 354 354 328 0 -1 4202560 2441 1255 0 0 131 0 0 0 25 0 5 0 526141500 167956480 13069 33554432000 4194304 4356188 140736063607856 18446744073709551615 4210596 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=359/tid=368] ppid=354 vsize=164020 CPUtime=1.3 cores=4-7
/proc/359/task/368/stat : 368 (plingeling) R 354 354 328 0 -1 4202560 2367 1255 0 0 130 0 0 0 25 0 5 0 526141500 167956480 13069 33554432000 4194304 4356188 140736063607856 18446744073709551615 4270728 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=359/tid=369] ppid=354 vsize=164020 CPUtime=1.3 cores=4-7
/proc/359/task/369/stat : 369 (plingeling) R 354 354 328 0 -1 4202560 2662 1255 0 0 130 0 0 0 19 0 5 0 526141500 167956480 13069 33554432000 4194304 4356188 140736063607856 18446744073709551615 4297475 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 11.33
Current children cumulated vsize (KiB) 789320

[startup+3.10116 s]
/proc/loadavg: 1.55 2.60 3.15 9/180 369
/proc/meminfo: memFree=29929804/32950928 swapFree=67086612/67111528
[pid=354] ppid=352 vsize=18324 CPUtime=0 cores=0-7
/proc/354/stat : 354 (ppfolio) S 352 354 328 0 -1 4202496 521 0 0 0 0 0 0 0 15 0 1 0 526141482 18763776 390 33554432000 4194304 4287625 140734735958384 18446744073709551615 239476715023 0 0 4096 65536 4369319575100063743 0 0 17 6 0 0 0
/proc/354/statm: 4581 390 341 23 0 91 0
[pid=355] ppid=354 vsize=553532 CPUtime=3.08 cores=0
/proc/355/stat : 355 (cryptominisat) R 354 354 328 0 -1 4202496 19845 0 0 0 306 2 0 0 25 0 1 0 526141482 566816768 11966 33554432000 4194304 4587354 140737351525040 18446744073709551615 4238778 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/355/statm: 138383 11966 331 96 0 134945 0
[pid=356] ppid=354 vsize=30404 CPUtime=3.09 cores=1
/proc/356/stat : 356 (clasp) R 354 354 328 0 -1 4202496 6717 0 0 0 308 1 0 0 25 0 1 0 526141482 31133696 4916 33554432000 4194304 4785740 140735330960768 18446744073709551615 4287241 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/356/statm: 7601 4916 340 145 0 4646 0
[pid=357] ppid=354 vsize=470344 CPUtime=3.04 cores=2
/proc/357/stat : 357 (TNM) R 354 354 328 0 -1 4202496 6377 0 11 0 304 0 0 0 25 0 1 0 526141482 481632256 6285 33554432000 134512640 134534564 4290224288 18446744073709551615 134530598 0 0 4096 0 0 0 0 17 2 0 0 4
/proc/357/statm: 117586 6285 95 6 0 116252 0
[pid=358] ppid=354 vsize=43896 CPUtime=3.09 cores=3
/proc/358/stat : 358 (march_hi) R 354 354 328 0 -1 4202496 21610 0 0 0 307 2 0 0 25 0 1 0 526141482 44949504 4935 33554432000 4194304 4331988 140736135024368 18446744073709551615 4316499 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/358/statm: 10974 4935 174 34 0 9416 0
[pid=359] ppid=354 vsize=181428 CPUtime=11.82 cores=4-7
/proc/359/stat : 359 (plingeling) S 354 354 328 0 -1 4202496 21757 1255 0 0 1180 2 0 0 18 0 5 0 526141482 185782272 17421 33554432000 4194304 4356188 140736063607856 18446744073709551615 239488497637 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/359/statm: 45357 17421 162 40 0 43901 0
[pid=359/tid=366] ppid=354 vsize=181428 CPUtime=2.91 cores=4-7
/proc/359/task/366/stat : 366 (plingeling) R 354 354 328 0 -1 4202560 2403 1255 0 0 291 0 0 0 24 0 5 0 526141500 185782272 17421 33554432000 4194304 4356188 140736063607856 18446744073709551615 4331015 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=359/tid=367] ppid=354 vsize=181428 CPUtime=2.91 cores=4-7
/proc/359/task/367/stat : 367 (plingeling) R 354 354 328 0 -1 4202560 3593 1255 0 0 291 0 0 0 25 0 5 0 526141500 185782272 17421 33554432000 4194304 4356188 140736063607856 18446744073709551615 4244237 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=359/tid=368] ppid=354 vsize=181428 CPUtime=2.9 cores=4-7
/proc/359/task/368/stat : 368 (plingeling) R 354 354 328 0 -1 4202560 2879 1255 0 0 290 0 0 0 25 0 5 0 526141500 185782272 17421 33554432000 4194304 4356188 140736063607856 18446744073709551615 4244260 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=359/tid=369] ppid=354 vsize=181428 CPUtime=2.9 cores=4-7
/proc/359/task/369/stat : 369 (plingeling) R 354 354 328 0 -1 4202560 4071 1255 0 0 290 0 0 0 25 0 5 0 526141500 185782272 17421 33554432000 4194304 4356188 140736063607856 18446744073709551615 4283944 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 24.12
Current children cumulated vsize (KiB) 1297928

[startup+6.30055 s]
/proc/loadavg: 2.15 2.71 3.18 9/180 369
/proc/meminfo: memFree=29903392/32950928 swapFree=67086612/67111528
[pid=354] ppid=352 vsize=18324 CPUtime=0 cores=0-7
/proc/354/stat : 354 (ppfolio) S 352 354 328 0 -1 4202496 521 0 0 0 0 0 0 0 15 0 1 0 526141482 18763776 390 33554432000 4194304 4287625 140734735958384 18446744073709551615 239476715023 0 0 4096 65536 4369319575100063743 0 0 17 6 0 0 0
/proc/354/statm: 4581 390 341 23 0 91 0
[pid=355] ppid=354 vsize=553532 CPUtime=6.28 cores=0
/proc/355/stat : 355 (cryptominisat) R 354 354 328 0 -1 4202496 20018 0 0 0 626 2 0 0 25 0 1 0 526141482 566816768 12138 33554432000 4194304 4587354 140737351525040 18446744073709551615 4365216 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/355/statm: 138383 12138 337 96 0 134945 0
[pid=356] ppid=354 vsize=40912 CPUtime=6.29 cores=1
/proc/356/stat : 356 (clasp) R 354 354 328 0 -1 4202496 9367 0 0 0 628 1 0 0 25 0 1 0 526141482 41893888 7566 33554432000 4194304 4785740 140735330960768 18446744073709551615 4287028 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/356/statm: 10228 7566 340 145 0 7273 0
[pid=357] ppid=354 vsize=470344 CPUtime=6.24 cores=2
/proc/357/stat : 357 (TNM) R 354 354 328 0 -1 4202496 6377 0 11 0 624 0 0 0 25 0 1 0 526141482 481632256 6285 33554432000 134512640 134534564 4290224288 18446744073709551615 134528687 0 0 4096 0 0 0 0 17 2 0 0 4
/proc/357/statm: 117586 6285 95 6 0 116252 0
[pid=358] ppid=354 vsize=44160 CPUtime=6.29 cores=3
/proc/358/stat : 358 (march_hi) R 354 354 328 0 -1 4202496 21678 0 0 0 627 2 0 0 25 0 1 0 526141482 45219840 5003 33554432000 4194304 4331988 140736135024368 18446744073709551615 4239588 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/358/statm: 11040 5003 174 34 0 9482 0
[pid=359] ppid=354 vsize=191180 CPUtime=24.61 cores=4-7
/proc/359/stat : 359 (plingeling) S 354 354 328 0 -1 4202496 24195 1255 0 0 2458 3 0 0 18 0 5 0 526141482 195768320 19859 33554432000 4194304 4356188 140736063607856 18446744073709551615 239488497637 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/359/statm: 47795 19859 162 40 0 46339 0
[pid=359/tid=366] ppid=354 vsize=191180 CPUtime=6.11 cores=4-7
/proc/359/task/366/stat : 366 (plingeling) R 354 354 328 0 -1 4202560 2961 1255 0 0 611 0 0 0 25 0 5 0 526141500 195768320 19859 33554432000 4194304 4356188 140736063607856 18446744073709551615 4330982 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=359/tid=367] ppid=354 vsize=191180 CPUtime=6.11 cores=4-7
/proc/359/task/367/stat : 367 (plingeling) R 354 354 328 0 -1 4202560 4490 1255 0 0 611 0 0 0 25 0 5 0 526141500 195768320 19859 33554432000 4194304 4356188 140736063607856 18446744073709551615 4331023 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=359/tid=368] ppid=354 vsize=191180 CPUtime=6.1 cores=4-7
/proc/359/task/368/stat : 368 (plingeling) R 354 354 328 0 -1 4202560 3670 1255 0 0 610 0 0 0 25 0 5 0 526141500 195768320 19859 33554432000 4194304 4356188 140736063607856 18446744073709551615 4244402 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=359/tid=369] ppid=354 vsize=191180 CPUtime=6.08 cores=4-7
/proc/359/task/369/stat : 369 (plingeling) R 354 354 328 0 -1 4202560 4263 1255 0 0 608 0 0 0 25 0 5 0 526141500 195768320 19859 33554432000 4194304 4356188 140736063607856 18446744073709551615 4323559 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 49.71
Current children cumulated vsize (KiB) 1318452

[startup+12.7013 s]
/proc/loadavg: 2.62 2.80 3.21 9/180 369
/proc/meminfo: memFree=29846128/32950928 swapFree=67086612/67111528
[pid=354] ppid=352 vsize=18324 CPUtime=0 cores=0-7
/proc/354/stat : 354 (ppfolio) S 352 354 328 0 -1 4202496 521 0 0 0 0 0 0 0 15 0 1 0 526141482 18763776 390 33554432000 4194304 4287625 140734735958384 18446744073709551615 239476715023 0 0 4096 65536 4369319575100063743 0 0 17 6 0 0 0
/proc/354/statm: 4581 390 341 23 0 91 0
[pid=355] ppid=354 vsize=587960 CPUtime=12.69 cores=0
/proc/355/stat : 355 (cryptominisat) R 354 354 328 0 -1 4202496 28323 0 0 0 1265 4 0 0 25 0 1 0 526141482 602071040 20442 33554432000 4194304 4587354 140737351525040 18446744073709551615 4365232 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/355/statm: 146990 20442 337 96 0 143552 0
[pid=356] ppid=354 vsize=58468 CPUtime=12.69 cores=1
/proc/356/stat : 356 (clasp) R 354 354 328 0 -1 4202496 13697 0 0 0 1266 3 0 0 25 0 1 0 526141482 59871232 11896 33554432000 4194304 4785740 140735330960768 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/356/statm: 14617 11896 340 145 0 11662 0
[pid=357] ppid=354 vsize=470344 CPUtime=12.64 cores=2
/proc/357/stat : 357 (TNM) R 354 354 328 0 -1 4202496 6377 0 11 0 1264 0 0 0 25 0 1 0 526141482 481632256 6285 33554432000 134512640 134534564 4290224288 18446744073709551615 134528295 0 0 4096 0 0 0 0 17 2 0 0 4
/proc/357/statm: 117586 6285 95 6 0 116252 0
[pid=358] ppid=354 vsize=44808 CPUtime=12.69 cores=3
/proc/358/stat : 358 (march_hi) R 354 354 328 0 -1 4202496 21801 0 0 0 1267 2 0 0 25 0 1 0 526141482 45883392 5125 33554432000 4194304 4331988 140736135024368 18446744073709551615 4228226 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/358/statm: 11202 5125 174 34 0 9644 0
[pid=359] ppid=354 vsize=193644 CPUtime=50.17 cores=4-7
/proc/359/stat : 359 (plingeling) S 354 354 328 0 -1 4202496 24811 1255 0 0 5014 3 0 0 18 0 5 0 526141482 198291456 20475 33554432000 4194304 4356188 140736063607856 18446744073709551615 239488497637 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/359/statm: 48411 20475 162 40 0 46955 0
[pid=359/tid=366] ppid=354 vsize=193644 CPUtime=12.51 cores=4-7
/proc/359/task/366/stat : 366 (plingeling) R 354 354 328 0 -1 4202560 2961 1255 0 0 1251 0 0 0 25 0 5 0 526141500 198291456 20475 33554432000 4194304 4356188 140736063607856 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=359/tid=367] ppid=354 vsize=193644 CPUtime=12.51 cores=4-7
/proc/359/task/367/stat : 367 (plingeling) R 354 354 328 0 -1 4202560 5106 1255 0 0 1251 0 0 0 25 0 5 0 526141500 198291456 20475 33554432000 4194304 4356188 140736063607856 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=359/tid=368] ppid=354 vsize=193644 CPUtime=12.5 cores=4-7
/proc/359/task/368/stat : 368 (plingeling) R 354 354 328 0 -1 4202560 3670 1255 0 0 1250 0 0 0 25 0 5 0 526141500 198291456 20475 33554432000 4194304 4356188 140736063607856 18446744073709551615 4241631 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=359/tid=369] ppid=354 vsize=193644 CPUtime=12.44 cores=4-7
/proc/359/task/369/stat : 369 (plingeling) R 354 354 328 0 -1 4202560 4263 1255 0 0 1244 0 0 0 25 0 5 0 526141500 198291456 20475 33554432000 4194304 4356188 140736063607856 18446744073709551615 4210834 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 100.88
Current children cumulated vsize (KiB) 1373548

[startup+25.5009 s]
/proc/loadavg: 3.88 3.07 3.29 9/180 369
/proc/meminfo: memFree=29801760/32950928 swapFree=67086612/67111528
[pid=354] ppid=352 vsize=18324 CPUtime=0 cores=0-7
/proc/354/stat : 354 (ppfolio) S 352 354 328 0 -1 4202496 521 0 0 0 0 0 0 0 15 0 1 0 526141482 18763776 390 33554432000 4194304 4287625 140734735958384 18446744073709551615 239476715023 0 0 4096 65536 4369319575100063743 0 0 17 6 0 0 0
/proc/354/statm: 4581 390 341 23 0 91 0
[pid=355] ppid=354 vsize=682396 CPUtime=25.49 cores=0
/proc/355/stat : 355 (cryptominisat) R 354 354 328 0 -1 4202496 33388 0 0 0 2545 4 0 0 25 0 1 0 526141482 698773504 22784 33554432000 4194304 4587354 140737351525040 18446744073709551615 4243700 0 0 4096 2 0 0 0 17 0 0 0 0

################
# More data... #
################

[pid=357] ppid=354 vsize=470344 CPUtime=4782.42 cores=2
/proc/357/stat : 357 (TNM) R 354 354 328 0 -1 4202496 6377 0 11 0 478240 2 0 0 25 0 1 0 526141482 481632256 6285 33554432000 134512640 134534564 4290224288 18446744073709551615 134528957 0 0 4096 0 0 0 0 17 2 0 0 4
/proc/357/statm: 117586 6285 95 6 0 116252 0
[pid=358] ppid=354 vsize=244504 CPUtime=4782.47 cores=3
/proc/358/stat : 358 (march_hi) R 354 354 328 0 -1 4202496 62900 0 0 0 478214 33 0 0 25 0 1 0 526141482 250372096 46223 33554432000 4194304 4331988 140736135024368 18446744073709551615 4226506 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/358/statm: 61126 46223 175 34 0 59568 0
[pid=359] ppid=354 vsize=528360 CPUtime=19101.9 cores=4-7
/proc/359/stat : 359 (plingeling) S 354 354 328 0 -1 4202496 3062699 1255 0 0 1909769 421 0 0 18 0 5 0 526141482 541040640 104154 33554432000 4194304 4356188 140736063607856 18446744073709551615 239488497637 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/359/statm: 132090 104154 162 40 0 130634 0
[pid=359/tid=366] ppid=354 vsize=528360 CPUtime=4782.15 cores=4-7
/proc/359/task/366/stat : 366 (plingeling) R 354 354 328 0 -1 4202560 889695 1255 0 0 478092 123 0 0 25 0 5 0 526141500 541040640 104154 33554432000 4194304 4356188 140736063607856 18446744073709551615 4330976 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=359/tid=367] ppid=354 vsize=528360 CPUtime=4782.29 cores=4-7
/proc/359/task/367/stat : 367 (plingeling) R 354 354 328 0 -1 4202560 668792 1255 0 0 478136 93 0 0 25 0 5 0 526141500 541040640 104154 33554432000 4194304 4356188 140736063607856 18446744073709551615 4279490 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=359/tid=368] ppid=354 vsize=528360 CPUtime=4781.83 cores=4-7
/proc/359/task/368/stat : 368 (plingeling) R 354 354 328 0 -1 4202560 819420 1255 0 0 478068 115 0 0 25 0 5 0 526141500 541040640 104154 33554432000 4194304 4356188 140736063607856 18446744073709551615 4279478 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=359/tid=369] ppid=354 vsize=528360 CPUtime=4755.41 cores=4-7
/proc/359/task/369/stat : 369 (plingeling) R 354 354 328 0 -1 4202560 675981 1255 0 0 475454 87 0 0 25 0 5 0 526141500 541040640 104154 33554432000 4194304 4356188 140736063607856 18446744073709551615 4330862 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 38231.7
Current children cumulated vsize (KiB) 2439900

[startup+4842.31 s]
/proc/loadavg: 8.05 8.04 8.00 9/180 520
/proc/meminfo: memFree=28729708/32950928 swapFree=67086612/67111528
[pid=354] ppid=352 vsize=18324 CPUtime=0 cores=0-7
/proc/354/stat : 354 (ppfolio) S 352 354 328 0 -1 4202496 521 0 0 0 0 0 0 0 15 0 1 0 526141482 18763776 390 33554432000 4194304 4287625 140734735958384 18446744073709551615 239476715023 0 0 4096 65536 4369319575100063743 0 0 17 6 0 0 0
/proc/354/statm: 4581 390 341 23 0 91 0
[pid=355] ppid=354 vsize=810772 CPUtime=4842.48 cores=0
/proc/355/stat : 355 (cryptominisat) R 354 354 328 0 -1 4202496 1632251 0 0 0 483549 699 0 0 25 0 1 0 526141482 830230528 85166 33554432000 4194304 4587354 140737351525040 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/355/statm: 202693 85166 337 96 0 199255 0
[pid=356] ppid=354 vsize=368316 CPUtime=4842.46 cores=1
/proc/356/stat : 356 (clasp) R 354 354 328 0 -1 4202496 87165 0 0 0 484215 31 0 0 25 0 1 0 526141482 377155584 85364 33554432000 4194304 4785740 140735330960768 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/356/statm: 92079 85364 340 145 0 89124 0
[pid=357] ppid=354 vsize=470344 CPUtime=4842.43 cores=2
/proc/357/stat : 357 (TNM) R 354 354 328 0 -1 4202496 6377 0 11 0 484241 2 0 0 25 0 1 0 526141482 481632256 6285 33554432000 134512640 134534564 4290224288 18446744073709551615 134528295 0 0 4096 0 0 0 0 17 2 0 0 4
/proc/357/statm: 117586 6285 95 6 0 116252 0
[pid=358] ppid=354 vsize=244504 CPUtime=4842.48 cores=3
/proc/358/stat : 358 (march_hi) R 354 354 328 0 -1 4202496 63323 0 0 0 484215 33 0 0 25 0 1 0 526141482 250372096 46646 33554432000 4194304 4331988 140736135024368 18446744073709551615 4228247 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/358/statm: 61126 46646 175 34 0 59568 0
[pid=359] ppid=354 vsize=585704 CPUtime=19341.6 cores=4-7
/proc/359/stat : 359 (plingeling) S 354 354 328 0 -1 4202496 3094443 1255 0 0 1933735 425 0 0 18 0 5 0 526141482 599760896 118490 33554432000 4194304 4356188 140736063607856 18446744073709551615 239488497637 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/359/statm: 146426 118490 162 40 0 144970 0
[pid=359/tid=366] ppid=354 vsize=585704 CPUtime=4842.17 cores=4-7
/proc/359/task/366/stat : 366 (plingeling) R 354 354 328 0 -1 4202560 898911 1255 0 0 484092 125 0 0 25 0 5 0 526141500 599760896 118490 33554432000 4194304 4356188 140736063607856 18446744073709551615 4332046 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=359/tid=367] ppid=354 vsize=585704 CPUtime=4842.3 cores=4-7
/proc/359/task/367/stat : 367 (plingeling) R 354 354 328 0 -1 4202560 676984 1255 0 0 484136 94 0 0 25 0 5 0 526141500 599760896 118490 33554432000 4194304 4356188 140736063607856 18446744073709551615 4331074 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=359/tid=368] ppid=354 vsize=585704 CPUtime=4841.84 cores=4-7
/proc/359/task/368/stat : 368 (plingeling) R 354 354 328 0 -1 4202560 825564 1255 0 0 484068 116 0 0 25 0 5 0 526141500 599760896 118490 33554432000 4194304 4356188 140736063607856 18446744073709551615 4331311 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=359/tid=369] ppid=354 vsize=585704 CPUtime=4815.08 cores=4-7
/proc/359/task/369/stat : 369 (plingeling) R 354 354 328 0 -1 4202560 684173 1255 0 0 481421 87 0 0 25 0 5 0 526141500 599760896 118490 33554432000 4194304 4356188 140736063607856 18446744073709551615 4331069 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 38711.4
Current children cumulated vsize (KiB) 2497964

[startup+4902.3 s]
/proc/loadavg: 8.02 8.03 8.00 9/180 521
/proc/meminfo: memFree=28712832/32950928 swapFree=67086612/67111528
[pid=354] ppid=352 vsize=18324 CPUtime=0 cores=0-7
/proc/354/stat : 354 (ppfolio) S 352 354 328 0 -1 4202496 521 0 0 0 0 0 0 0 15 0 1 0 526141482 18763776 390 33554432000 4194304 4287625 140734735958384 18446744073709551615 239476715023 0 0 4096 65536 4369319575100063743 0 0 17 6 0 0 0
/proc/354/statm: 4581 390 341 23 0 91 0
[pid=355] ppid=354 vsize=811944 CPUtime=4902.48 cores=0
/proc/355/stat : 355 (cryptominisat) R 354 354 328 0 -1 4202496 1650838 0 0 0 489540 708 0 0 25 0 1 0 526141482 831430656 91109 33554432000 4194304 4587354 140737351525040 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/355/statm: 202986 91109 337 96 0 199548 0
[pid=356] ppid=354 vsize=368316 CPUtime=4902.45 cores=1
/proc/356/stat : 356 (clasp) R 354 354 328 0 -1 4202496 87176 0 0 0 490214 31 0 0 25 0 1 0 526141482 377155584 85375 33554432000 4194304 4785740 140735330960768 18446744073709551615 4287178 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/356/statm: 92079 85375 340 145 0 89124 0
[pid=357] ppid=354 vsize=470344 CPUtime=4902.43 cores=2
/proc/357/stat : 357 (TNM) R 354 354 328 0 -1 4202496 6377 0 11 0 490241 2 0 0 25 0 1 0 526141482 481632256 6285 33554432000 134512640 134534564 4290224288 18446744073709551615 134530551 0 0 4096 0 0 0 0 17 2 0 0 4
/proc/357/statm: 117586 6285 95 6 0 116252 0
[pid=358] ppid=354 vsize=244504 CPUtime=4902.47 cores=3
/proc/358/stat : 358 (march_hi) R 354 354 328 0 -1 4202496 63776 0 0 0 490214 33 0 0 25 0 1 0 526141482 250372096 47099 33554432000 4194304 4331988 140736135024368 18446744073709551615 4228270 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/358/statm: 61126 47099 175 34 0 59568 0
[pid=359] ppid=354 vsize=585704 CPUtime=19581.2 cores=4-7
/proc/359/stat : 359 (plingeling) S 354 354 328 0 -1 4202496 3135403 1255 0 0 1957693 432 0 0 18 0 5 0 526141482 599760896 118490 33554432000 4194304 4356188 140736063607856 18446744073709551615 239488497637 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/359/statm: 146426 118490 162 40 0 144970 0
[pid=359/tid=366] ppid=354 vsize=585704 CPUtime=4902.16 cores=4-7
/proc/359/task/366/stat : 366 (plingeling) R 354 354 328 0 -1 4202560 912223 1255 0 0 490089 127 0 0 25 0 5 0 526141500 599760896 118490 33554432000 4194304 4356188 140736063607856 18446744073709551615 4210610 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=359/tid=367] ppid=354 vsize=585704 CPUtime=4902.3 cores=4-7
/proc/359/task/367/stat : 367 (plingeling) R 354 354 328 0 -1 4202560 689272 1255 0 0 490134 96 0 0 25 0 5 0 526141500 599760896 118490 33554432000 4194304 4356188 140736063607856 18446744073709551615 4279435 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=359/tid=368] ppid=354 vsize=585704 CPUtime=4901.82 cores=4-7
/proc/359/task/368/stat : 368 (plingeling) R 354 354 328 0 -1 4202560 838876 1255 0 0 490064 118 0 0 25 0 5 0 526141500 599760896 118490 33554432000 4194304 4356188 140736063607856 18446744073709551615 4332165 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=359/tid=369] ppid=354 vsize=585704 CPUtime=4874.76 cores=4-7
/proc/359/task/369/stat : 369 (plingeling) R 354 354 328 0 -1 4202560 686221 1255 0 0 487388 88 0 0 25 0 5 0 526141500 599760896 118490 33554432000 4194304 4356188 140736063607856 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 39191.1
Current children cumulated vsize (KiB) 2499136

[startup+4962.3 s]
/proc/loadavg: 8.12 8.05 8.01 9/180 523
/proc/meminfo: memFree=28720864/32950928 swapFree=67086612/67111528
[pid=354] ppid=352 vsize=18324 CPUtime=0 cores=0-7
/proc/354/stat : 354 (ppfolio) S 352 354 328 0 -1 4202496 521 0 0 0 0 0 0 0 15 0 1 0 526141482 18763776 390 33554432000 4194304 4287625 140734735958384 18446744073709551615 239476715023 0 0 4096 65536 4369319575100063743 0 0 17 6 0 0 0
/proc/354/statm: 4581 390 341 23 0 91 0
[pid=355] ppid=354 vsize=814260 CPUtime=4962.47 cores=0
/proc/355/stat : 355 (cryptominisat) R 354 354 328 0 -1 4202496 1666806 0 0 0 495530 717 0 0 25 0 1 0 526141482 833802240 81412 33554432000 4194304 4587354 140737351525040 18446744073709551615 4238509 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/355/statm: 203565 81412 337 96 0 200127 0
[pid=356] ppid=354 vsize=368508 CPUtime=4962.45 cores=1
/proc/356/stat : 356 (clasp) R 354 354 328 0 -1 4202496 87219 0 0 0 496214 31 0 0 25 0 1 0 526141482 377352192 85418 33554432000 4194304 4785740 140735330960768 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/356/statm: 92127 85418 340 145 0 89172 0
[pid=357] ppid=354 vsize=470344 CPUtime=4962.43 cores=2
/proc/357/stat : 357 (TNM) R 354 354 328 0 -1 4202496 6377 0 11 0 496241 2 0 0 25 0 1 0 526141482 481632256 6285 33554432000 134512640 134534564 4290224288 18446744073709551615 134528726 0 0 4096 0 0 0 0 17 2 0 0 4
/proc/357/statm: 117586 6285 95 6 0 116252 0
[pid=358] ppid=354 vsize=244504 CPUtime=4962.48 cores=3
/proc/358/stat : 358 (march_hi) R 354 354 328 0 -1 4202496 64281 0 0 0 496214 34 0 0 25 0 1 0 526141482 250372096 47604 33554432000 4194304 4331988 140736135024368 18446744073709551615 4226440 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/358/statm: 61126 47604 175 34 0 59568 0
[pid=359] ppid=354 vsize=606184 CPUtime=19820.9 cores=4-7
/proc/359/stat : 359 (plingeling) S 354 354 328 0 -1 4202496 3171243 1255 0 0 1981656 437 0 0 18 0 5 0 526141482 620732416 123610 33554432000 4194304 4356188 140736063607856 18446744073709551615 239488497637 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/359/statm: 151546 123610 162 40 0 150090 0
[pid=359/tid=366] ppid=354 vsize=606184 CPUtime=4962.16 cores=4-7
/proc/359/task/366/stat : 366 (plingeling) R 354 354 328 0 -1 4202560 921439 1255 0 0 496088 128 0 0 25 0 5 0 526141500 620732416 123610 33554432000 4194304 4356188 140736063607856 18446744073709551615 4330945 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=359/tid=367] ppid=354 vsize=606184 CPUtime=4962.3 cores=4-7
/proc/359/task/367/stat : 367 (plingeling) R 354 354 328 0 -1 4202560 695416 1255 0 0 496133 97 0 0 25 0 5 0 526141500 620732416 123610 33554432000 4194304 4356188 140736063607856 18446744073709551615 4331328 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=359/tid=368] ppid=354 vsize=606184 CPUtime=4961.83 cores=4-7
/proc/359/task/368/stat : 368 (plingeling) R 354 354 328 0 -1 4202560 849116 1255 0 0 496063 120 0 0 25 0 5 0 526141500 620732416 123610 33554432000 4194304 4356188 140736063607856 18446744073709551615 4331074 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=359/tid=369] ppid=354 vsize=606184 CPUtime=4934.43 cores=4-7
/proc/359/task/369/stat : 369 (plingeling) R 354 354 328 0 -1 4202560 696461 1255 0 0 493354 89 0 0 25 0 5 0 526141500 620732416 123610 33554432000 4194304 4356188 140736063607856 18446744073709551615 4331106 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 39670.8
Current children cumulated vsize (KiB) 2522124



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5003.5 s]
/proc/loadavg: 8.06 8.04 8.00 9/180 524
/proc/meminfo: memFree=28773296/32950928 swapFree=67086612/67111528
[pid=354] ppid=352 vsize=18324 CPUtime=0 cores=0-7
/proc/354/stat : 354 (ppfolio) S 352 354 328 0 -1 4202496 521 0 0 0 0 0 0 0 15 0 1 0 526141482 18763776 390 33554432000 4194304 4287625 140734735958384 18446744073709551615 239476715023 0 0 4096 65536 4369319575100063743 0 0 17 6 0 0 0
/proc/354/statm: 4581 390 341 23 0 91 0
[pid=355] ppid=354 vsize=810756 CPUtime=5003.68 cores=0
/proc/355/stat : 355 (cryptominisat) R 354 354 328 0 -1 4202496 1678847 0 0 0 499645 723 0 0 25 0 1 0 526141482 830214144 80574 33554432000 4194304 4587354 140737351525040 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/355/statm: 202689 80574 337 96 0 199251 0
[pid=356] ppid=354 vsize=370048 CPUtime=5003.66 cores=1
/proc/356/stat : 356 (clasp) R 354 354 328 0 -1 4202496 87562 0 0 0 500334 32 0 0 25 0 1 0 526141482 378929152 85761 33554432000 4194304 4785740 140735330960768 18446744073709551615 4307209 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/356/statm: 92512 85761 340 145 0 89557 0
[pid=357] ppid=354 vsize=470344 CPUtime=5003.63 cores=2
/proc/357/stat : 357 (TNM) R 354 354 328 0 -1 4202496 6377 0 11 0 500361 2 0 0 25 0 1 0 526141482 481632256 6285 33554432000 134512640 134534564 4290224288 18446744073709551615 134528726 0 0 4096 0 0 0 0 17 2 0 0 4
/proc/357/statm: 117586 6285 95 6 0 116252 0
[pid=358] ppid=354 vsize=244504 CPUtime=5003.68 cores=3
/proc/358/stat : 358 (march_hi) R 354 354 328 0 -1 4202496 64612 0 0 0 500334 34 0 0 25 0 1 0 526141482 250372096 47935 33554432000 4194304 4331988 140736135024368 18446744073709551615 4226474 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/358/statm: 61126 47935 175 34 0 59568 0
[pid=359] ppid=354 vsize=552936 CPUtime=19985.5 cores=4-7
/proc/359/stat : 359 (plingeling) S 354 354 328 0 -1 4202496 3187627 1255 0 0 1998112 439 0 0 18 0 5 0 526141482 566206464 110298 33554432000 4194304 4356188 140736063607856 18446744073709551615 239488497637 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/359/statm: 138234 110298 162 40 0 136778 0
[pid=359/tid=366] ppid=354 vsize=552936 CPUtime=5003.37 cores=4-7
/proc/359/task/366/stat : 366 (plingeling) R 354 354 328 0 -1 4202560 927583 1255 0 0 500208 129 0 0 25 0 5 0 526141500 566206464 110298 33554432000 4194304 4356188 140736063607856 18446744073709551615 4331060 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=359/tid=367] ppid=354 vsize=552936 CPUtime=5003.51 cores=4-7
/proc/359/task/367/stat : 367 (plingeling) R 354 354 328 0 -1 4202560 701560 1255 0 0 500253 98 0 0 25 0 5 0 526141500 566206464 110298 33554432000 4194304 4356188 140736063607856 18446744073709551615 4331731 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=359/tid=368] ppid=354 vsize=552936 CPUtime=5003.02 cores=4-7
/proc/359/task/368/stat : 368 (plingeling) R 354 354 328 0 -1 4202560 853212 1255 0 0 500182 120 0 0 25 0 5 0 526141500 566206464 110298 33554432000 4194304 4356188 140736063607856 18446744073709551615 4279432 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=359/tid=369] ppid=354 vsize=552936 CPUtime=4975.41 cores=4-7
/proc/359/task/369/stat : 369 (plingeling) R 354 354 328 0 -1 4202560 696461 1255 0 0 497452 89 0 0 25 0 5 0 526141500 566206464 110298 33554432000 4194304 4356188 140736063607856 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 40000.2
Current children cumulated vsize (KiB) 2466912

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 354 and gives
#  childrusage.ru_utime.tv_sec=5003
#  childrusage.ru_utime.tv_usec=623333
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=34994
# CPU time returned by wait4() is 5003.66
# while last known CPU time is 40000.2
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 5003.52
CPU time (s): 40000.2
CPU user time (s): 39987.9
CPU system time (s): 12.3
CPU usage (%): 799.441
Max. virtual memory (cumulated for all children) (KiB): 3019376

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 5003.62
system time used= 0.034994
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 6899
page faults= 11
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 442
involuntary context switches= 15630

runsolver used 7.63884 second user time and 19.643 second system time

The end

Launcher Data 

Begin job on node148 at 2011-04-30 08:37:24
IDJOB=3275201
IDBENCH=71612
IDSOLVER=1638
FILE ID=node148/3275201-1304145444
RUNJOBID= node148-1304145444-342
PBS_JOBID= 13170884
Free space on /tmp= 72960 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT09/CRAFTED/rbsat/crafted/forced/rbsat-v2400c266431gyes2.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3275201-1304145444/watcher-3275201-1304145444 -o /tmp/evaluation-result-3275201-1304145444/solver-3275201-1304145444 -C 40000 -W 5100 -M 31000  ppfolio HOME/instance-3275201-1304145444.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= aac2bd287b8cd6b96cbf7ecc463acf19
RANDOM SEED=73653567

node148.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      30098788 kB
Buffers:        756428 kB
Cached:        1682720 kB
SwapCached:       3696 kB
Active:         147108 kB
Inactive:      2333624 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      30098788 kB
SwapTotal:    67111528 kB
SwapFree:     67086612 kB
Dirty:           13616 kB
Writeback:           0 kB
AnonPages:       40476 kB
Mapped:          13488 kB
Slab:           305752 kB
PageTables:       4328 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   184880 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72948 MiB
End job on node148 at 2011-04-30 10:00:50