Trace number 3276106

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio par? (TO) 40000.2 5004.02

General information on the benchmark

NameSAT05/crafted/sabharwal05/counting/php/unsat/
easier/php-045-035.shuffled-as.sat05-1181.cnf
MD5SUM057b78ff24cc0773c9c67e770a7b9de2
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark44.4792
Satisfiable
(Un)Satisfiability was proved
Number of variables1575
Number of clauses34695
Sum of the clauses size70875
Maximum clause length35
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 234650
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 545

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 8 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	[5] plingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 0
0.00/0.00	Starting clasp 1.3.6 on core(s) 1
0.00/0.00	Starting TNM 2009 on core(s) 2
0.00/0.00	Starting march_hi 2009 on core(s) 3
0.00/0.00	Starting plingeling 276-6264d55-100731 on core(s) 4 5 6 7

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3276106-1304173560/watcher-3276106-1304173560 -o /tmp/evaluation-result-3276106-1304173560/solver-3276106-1304173560 -C 40000 -W 5100 -M 31000 ppfolio HOME/instance-3276106-1304173560.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.98 8.01 7.99 1/168 32362
/proc/meminfo: memFree=30747964/32951132 swapFree=67111356/67111528
[pid=32362] ppid=32360 vsize=18324 CPUtime=0 cores=0-7
/proc/32362/stat : 32362 (ppfolio) S 32360 32362 31594 0 -1 4202496 519 0 0 0 0 0 0 0 25 0 1 0 528955631 18763776 389 33554432000 4194304 4287625 140736949656016 18446744073709551615 274664828431 0 0 4096 65536 4576995331354394623 0 0 17 6 0 0 0
/proc/32362/statm: 4581 389 341 23 0 91 0

[startup+0.0579089 s]
/proc/loadavg: 7.98 8.01 7.99 1/168 32362
/proc/meminfo: memFree=30747964/32951132 swapFree=67111356/67111528
[pid=32362] ppid=32360 vsize=18324 CPUtime=0 cores=0-7
/proc/32362/stat : 32362 (ppfolio) S 32360 32362 31594 0 -1 4202496 519 0 0 0 0 0 0 0 25 0 1 0 528955631 18763776 389 33554432000 4194304 4287625 140736949656016 18446744073709551615 274664828431 0 0 4096 65536 4576995331354394623 0 0 17 6 0 0 0
/proc/32362/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.100903 s]
/proc/loadavg: 7.98 8.01 7.99 1/168 32362
/proc/meminfo: memFree=30747964/32951132 swapFree=67111356/67111528
[pid=32362] ppid=32360 vsize=18324 CPUtime=0 cores=0-7
/proc/32362/stat : 32362 (ppfolio) R 32360 32362 31594 0 -1 4202496 519 0 0 0 0 0 0 0 25 0 1 0 528955631 18763776 389 33554432000 4194304 4287625 140736949656016 18446744073709551615 274664828431 0 0 4096 65536 0 0 0 17 6 0 0 0
/proc/32362/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.300831 s]
/proc/loadavg: 7.98 8.01 7.99 1/168 32362
/proc/meminfo: memFree=30747964/32951132 swapFree=67111356/67111528
[pid=32362] ppid=32360 vsize=18324 CPUtime=0 cores=0-7
/proc/32362/stat : 32362 (ppfolio) S 32360 32362 31594 0 -1 4202496 519 0 0 0 0 0 0 0 25 0 1 0 528955631 18763776 389 33554432000 4194304 4287625 140736949656016 18446744073709551615 274664828431 0 0 4096 65536 4576995331354394623 0 0 17 6 0 0 0
/proc/32362/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.700763 s]
/proc/loadavg: 7.98 8.01 7.99 1/168 32362
/proc/meminfo: memFree=30747964/32951132 swapFree=67111356/67111528
[pid=32362] ppid=32360 vsize=18324 CPUtime=0 cores=0-7
/proc/32362/stat : 32362 (ppfolio) R 32360 32362 31594 0 -1 4202496 519 0 0 0 0 0 0 0 21 0 1 0 528955631 18763776 389 33554432000 4194304 4287625 140736949656016 18446744073709551615 274664828431 0 0 4096 65536 0 0 0 17 6 0 0 0
/proc/32362/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50063 s]
/proc/loadavg: 7.98 8.01 7.99 9/178 32377
/proc/meminfo: memFree=30702272/32951132 swapFree=67111356/67111528
[pid=32362] ppid=32360 vsize=18324 CPUtime=0 cores=0-7
/proc/32362/stat : 32362 (ppfolio) S 32360 32362 31594 0 -1 4202496 519 0 0 0 0 0 0 0 21 0 1 0 528955631 18763776 389 33554432000 4194304 4287625 140736949656016 18446744073709551615 274664828431 0 0 4096 65536 4576995331354394623 0 0 17 6 0 0 0
/proc/32362/statm: 4581 389 341 23 0 91 0
[pid=32363] ppid=32362 vsize=1679376 CPUtime=1.48 cores=0
/proc/32363/stat : 32363 (cryptominisat) R 32362 32362 31594 0 -1 4202496 6951 0 0 0 148 0 0 0 20 0 1 0 528955631 1719681024 3311 33554432000 4194304 4587354 140734550584816 18446744073709551615 4244166 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/32363/statm: 419844 3311 327 96 0 416406 0
[pid=32364] ppid=32362 vsize=29948 CPUtime=1.49 cores=1
/proc/32364/stat : 32364 (clasp) R 32362 32362 31594 0 -1 4202496 5113 0 0 0 149 0 0 0 20 0 1 0 528955631 30666752 4832 33554432000 4194304 4785740 140736618075584 18446744073709551615 4278587 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/32364/statm: 7487 4832 340 145 0 4532 0
[pid=32365] ppid=32362 vsize=457804 CPUtime=1.49 cores=2
/proc/32365/stat : 32365 (TNM) R 32362 32362 31594 0 -1 4202496 1148 0 0 0 149 0 0 0 20 0 1 0 528955631 468791296 1045 33554432000 134512640 134534564 4291252656 18446744073709551615 134530476 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/32365/statm: 114451 1045 95 6 0 113117 0
[pid=32366] ppid=32362 vsize=13768 CPUtime=1.49 cores=3
/proc/32366/stat : 32366 (march_hi) R 32362 32362 31594 0 -1 4202496 1413 0 0 0 149 0 0 0 20 0 1 0 528955631 14098432 1154 33554432000 4194304 4331988 140734928737296 18446744073709551615 4228247 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/32366/statm: 3442 1154 174 34 0 1884 0
[pid=32367] ppid=32362 vsize=121376 CPUtime=5.72 cores=4-7
/proc/32367/stat : 32367 (plingeling) S 32362 32362 31594 0 -1 4202496 2848 1260 0 0 572 0 0 0 18 0 5 0 528955631 124289024 2385 33554432000 4194304 4356188 140736195773808 18446744073709551615 274676611045 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/32367/statm: 30344 2385 162 40 0 28888 0
[pid=32367/tid=32374] ppid=32362 vsize=121376 CPUtime=1.46 cores=4-7
/proc/32367/task/32374/stat : 32374 (plingeling) R 32362 32362 31594 0 -1 4202560 351 1260 0 0 146 0 0 0 23 0 5 0 528955634 124289024 2385 33554432000 4194304 4356188 140736195773808 18446744073709551615 4279717 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=32367/tid=32375] ppid=32362 vsize=121376 CPUtime=1.35 cores=4-7
/proc/32367/task/32375/stat : 32375 (plingeling) R 32362 32362 31594 0 -1 4202560 270 1260 0 0 135 0 0 0 23 0 5 0 528955634 124289024 2385 33554432000 4194304 4356188 140736195773808 18446744073709551615 4284253 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=32367/tid=32376] ppid=32362 vsize=121376 CPUtime=1.42 cores=4-7
/proc/32367/task/32376/stat : 32376 (plingeling) R 32362 32362 31594 0 -1 4202560 343 1260 0 0 142 0 0 0 23 0 5 0 528955634 124289024 2385 33554432000 4194304 4356188 140736195773808 18446744073709551615 4331076 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=32367/tid=32377] ppid=32362 vsize=121376 CPUtime=1.46 cores=4-7
/proc/32367/task/32377/stat : 32377 (plingeling) R 32362 32362 31594 0 -1 4202560 330 1260 0 0 146 0 0 0 23 0 5 0 528955634 124289024 2385 33554432000 4194304 4356188 140736195773808 18446744073709551615 4234009 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 11.67
Current children cumulated vsize (KiB) 2320596

[startup+3.10135 s]
/proc/loadavg: 7.98 8.01 7.99 9/178 32377
/proc/meminfo: memFree=30689004/32951132 swapFree=67111356/67111528
[pid=32362] ppid=32360 vsize=18324 CPUtime=0 cores=0-7
/proc/32362/stat : 32362 (ppfolio) S 32360 32362 31594 0 -1 4202496 519 0 0 0 0 0 0 0 16 0 1 0 528955631 18763776 389 33554432000 4194304 4287625 140736949656016 18446744073709551615 274664828431 0 0 4096 65536 4576995331354394623 0 0 17 6 0 0 0
/proc/32362/statm: 4581 389 341 23 0 91 0
[pid=32363] ppid=32362 vsize=1680584 CPUtime=3.09 cores=0
/proc/32363/stat : 32363 (cryptominisat) R 32362 32362 31594 0 -1 4202496 10404 0 0 0 308 1 0 0 25 0 1 0 528955631 1720918016 4241 33554432000 4194304 4587354 140734550584816 18446744073709551615 274664505030 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/32363/statm: 420146 4241 331 96 0 416708 0
[pid=32364] ppid=32362 vsize=39168 CPUtime=3.08 cores=1
/proc/32364/stat : 32364 (clasp) R 32362 32362 31594 0 -1 4202496 7414 0 0 0 308 0 0 0 25 0 1 0 528955631 40108032 7133 33554432000 4194304 4785740 140736618075584 18446744073709551615 4286953 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/32364/statm: 9792 7133 340 145 0 6837 0
[pid=32365] ppid=32362 vsize=457804 CPUtime=3.09 cores=2
/proc/32365/stat : 32365 (TNM) R 32362 32362 31594 0 -1 4202496 1148 0 0 0 309 0 0 0 25 0 1 0 528955631 468791296 1045 33554432000 134512640 134534564 4291252656 18446744073709551615 134529758 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/32365/statm: 114451 1045 95 6 0 113117 0
[pid=32366] ppid=32362 vsize=14224 CPUtime=3.09 cores=3
/proc/32366/stat : 32366 (march_hi) R 32362 32362 31594 0 -1 4202496 1556 0 0 0 309 0 0 0 25 0 1 0 528955631 14565376 1297 33554432000 4194304 4331988 140734928737296 18446744073709551615 4226479 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/32366/statm: 3556 1297 175 34 0 1998 0
[pid=32367] ppid=32362 vsize=123944 CPUtime=12.12 cores=4-7
/proc/32367/stat : 32367 (plingeling) S 32362 32362 31594 0 -1 4202496 3490 1260 0 0 1212 0 0 0 18 0 5 0 528955631 126918656 3027 33554432000 4194304 4356188 140736195773808 18446744073709551615 274676611045 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/32367/statm: 30986 3027 162 40 0 29530 0
[pid=32367/tid=32374] ppid=32362 vsize=123944 CPUtime=3.06 cores=4-7
/proc/32367/task/32374/stat : 32374 (plingeling) R 32362 32362 31594 0 -1 4202560 351 1260 0 0 306 0 0 0 25 0 5 0 528955634 126918656 3027 33554432000 4194304 4356188 140736195773808 18446744073709551615 4331165 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=32367/tid=32375] ppid=32362 vsize=123944 CPUtime=2.95 cores=4-7
/proc/32367/task/32375/stat : 32375 (plingeling) R 32362 32362 31594 0 -1 4202560 398 1260 0 0 295 0 0 0 25 0 5 0 528955634 126918656 3027 33554432000 4194304 4356188 140736195773808 18446744073709551615 4281650 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=32367/tid=32376] ppid=32362 vsize=123944 CPUtime=3.02 cores=4-7
/proc/32367/task/32376/stat : 32376 (plingeling) R 32362 32362 31594 0 -1 4202560 600 1260 0 0 302 0 0 0 25 0 5 0 528955634 126918656 3027 33554432000 4194304 4356188 140736195773808 18446744073709551615 4279551 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=32367/tid=32377] ppid=32362 vsize=123944 CPUtime=3.06 cores=4-7
/proc/32367/task/32377/stat : 32377 (plingeling) R 32362 32362 31594 0 -1 4202560 587 1260 0 0 306 0 0 0 25 0 5 0 528955634 126918656 3027 33554432000 4194304 4356188 140736195773808 18446744073709551615 4281624 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 24.47
Current children cumulated vsize (KiB) 2334048

[startup+6.3008 s]
/proc/loadavg: 7.98 8.01 7.99 10/178 32377
/proc/meminfo: memFree=30649076/32951132 swapFree=67111356/67111528
[pid=32362] ppid=32360 vsize=18324 CPUtime=0 cores=0-7
/proc/32362/stat : 32362 (ppfolio) S 32360 32362 31594 0 -1 4202496 519 0 0 0 0 0 0 0 15 0 1 0 528955631 18763776 389 33554432000 4194304 4287625 140736949656016 18446744073709551615 274664828431 0 0 4096 65536 4576995331354394623 0 0 17 3 0 0 0
/proc/32362/statm: 4581 389 341 23 0 91 0
[pid=32363] ppid=32362 vsize=1710156 CPUtime=6.28 cores=0
/proc/32363/stat : 32363 (cryptominisat) R 32362 32362 31594 0 -1 4202496 20057 0 0 0 626 2 0 0 25 0 1 0 528955631 1751199744 11238 33554432000 4194304 4587354 140734550584816 18446744073709551615 4364908 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/32363/statm: 427539 11238 337 96 0 424101 0
[pid=32364] ppid=32362 vsize=44508 CPUtime=6.29 cores=1
/proc/32364/stat : 32364 (clasp) R 32362 32362 31594 0 -1 4202496 8718 0 0 0 628 1 0 0 25 0 1 0 528955631 45576192 8437 33554432000 4194304 4785740 140736618075584 18446744073709551615 274664469189 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/32364/statm: 11127 8437 340 145 0 8172 0
[pid=32365] ppid=32362 vsize=457804 CPUtime=6.29 cores=2
/proc/32365/stat : 32365 (TNM) R 32362 32362 31594 0 -1 4202496 1148 0 0 0 629 0 0 0 25 0 1 0 528955631 468791296 1045 33554432000 134512640 134534564 4291252656 18446744073709551615 134529880 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/32365/statm: 114451 1045 95 6 0 113117 0
[pid=32366] ppid=32362 vsize=14792 CPUtime=6.29 cores=3
/proc/32366/stat : 32366 (march_hi) R 32362 32362 31594 0 -1 4202496 1660 0 0 0 629 0 0 0 25 0 1 0 528955631 15147008 1401 33554432000 4194304 4331988 140734928737296 18446744073709551615 4228288 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/32366/statm: 3698 1401 175 34 0 2140 0
[pid=32367] ppid=32362 vsize=128300 CPUtime=23.07 cores=4-7
/proc/32367/stat : 32367 (plingeling) S 32362 32362 31594 0 -1 4202496 5157 1260 0 0 2299 8 0 0 18 0 5 0 528955631 131379200 4053 33554432000 4194304 4356188 140736195773808 18446744073709551615 274676611045 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/32367/statm: 32075 4053 162 40 0 30619 0
[pid=32367/tid=32374] ppid=32362 vsize=128300 CPUtime=6.26 cores=4-7
/proc/32367/task/32374/stat : 32374 (plingeling) R 32362 32362 31594 0 -1 4202560 864 1260 0 0 626 0 0 0 25 0 5 0 528955634 131379200 4053 33554432000 4194304 4356188 140736195773808 18446744073709551615 4331352 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=32367/tid=32375] ppid=32362 vsize=128300 CPUtime=5.89 cores=4-7
/proc/32367/task/32375/stat : 32375 (plingeling) R 32362 32362 31594 0 -1 4202560 911 1260 0 0 589 0 0 0 25 0 5 0 528955634 131379200 4053 33554432000 4194304 4356188 140736195773808 18446744073709551615 4330964 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=32367/tid=32376] ppid=32362 vsize=128300 CPUtime=6.2 cores=4-7
/proc/32367/task/32376/stat : 32376 (plingeling) R 32362 32362 31594 0 -1 4202560 985 1260 0 0 620 0 0 0 25 0 5 0 528955634 131379200 4053 33554432000 4194304 4356188 140736195773808 18446744073709551615 4274277 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=32367/tid=32377] ppid=32362 vsize=128300 CPUtime=4.67 cores=4-7
/proc/32367/task/32377/stat : 32377 (plingeling) R 32362 32362 31594 0 -1 4202560 843 1260 0 0 461 6 0 0 25 0 5 0 528955634 131379200 4053 33554432000 4194304 4356188 140736195773808 18446744073709551615 4281627 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 48.22
Current children cumulated vsize (KiB) 2373884

[startup+12.7007 s]
/proc/loadavg: 8.13 8.04 8.00 9/178 32377
/proc/meminfo: memFree=30594988/32951132 swapFree=67111356/67111528
[pid=32362] ppid=32360 vsize=18324 CPUtime=0 cores=0-7
/proc/32362/stat : 32362 (ppfolio) S 32360 32362 31594 0 -1 4202496 519 0 0 0 0 0 0 0 15 0 1 0 528955631 18763776 389 33554432000 4194304 4287625 140736949656016 18446744073709551615 274664828431 0 0 4096 65536 4576995331354394623 0 0 17 3 0 0 0
/proc/32362/statm: 4581 389 341 23 0 91 0
[pid=32363] ppid=32362 vsize=1740892 CPUtime=12.68 cores=0
/proc/32363/stat : 32363 (cryptominisat) R 32362 32362 31594 0 -1 4202496 30454 0 0 0 1264 4 0 0 25 0 1 0 528955631 1782673408 18668 33554432000 4194304 4587354 140734550584816 18446744073709551615 4388336 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/32363/statm: 435223 18668 337 96 0 431785 0
[pid=32364] ppid=32362 vsize=63012 CPUtime=12.69 cores=1
/proc/32364/stat : 32364 (clasp) R 32362 32362 31594 0 -1 4202496 13296 0 0 0 1267 2 0 0 25 0 1 0 528955631 64524288 13015 33554432000 4194304 4785740 140736618075584 18446744073709551615 4287050 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/32364/statm: 15753 13015 340 145 0 12798 0
[pid=32365] ppid=32362 vsize=457804 CPUtime=12.69 cores=2
/proc/32365/stat : 32365 (TNM) R 32362 32362 31594 0 -1 4202496 1148 0 0 0 1269 0 0 0 25 0 1 0 528955631 468791296 1045 33554432000 134512640 134534564 4291252656 18446744073709551615 134530367 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/32365/statm: 114451 1045 95 6 0 113117 0
[pid=32366] ppid=32362 vsize=16068 CPUtime=12.69 cores=3
/proc/32366/stat : 32366 (march_hi) R 32362 32362 31594 0 -1 4202496 1864 0 0 0 1269 0 0 0 25 0 1 0 528955631 16453632 1605 33554432000 4194304 4331988 140734928737296 18446744073709551615 4226240 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/32366/statm: 4017 1605 175 34 0 2459 0
[pid=32367] ppid=32362 vsize=137004 CPUtime=48.19 cores=4-7
/proc/32367/stat : 32367 (plingeling) S 32362 32362 31594 0 -1 4202496 7396 1260 0 0 4806 13 0 0 18 0 5 0 528955631 140292096 6292 33554432000 4194304 4356188 140736195773808 18446744073709551615 274676611045 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/32367/statm: 34251 6292 162 40 0 32795 0
[pid=32367/tid=32374] ppid=32362 vsize=137004 CPUtime=12.66 cores=4-7
/proc/32367/task/32374/stat : 32374 (plingeling) R 32362 32362 31594 0 -1 4202560 1376 1260 0 0 1265 1 0 0 25 0 5 0 528955634 140292096 6292 33554432000 4194304 4356188 140736195773808 18446744073709551615 4281771 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=32367/tid=32375] ppid=32362 vsize=137004 CPUtime=12.28 cores=4-7
/proc/32367/task/32375/stat : 32375 (plingeling) R 32362 32362 31594 0 -1 4202560 1488 1260 0 0 1228 0 0 0 25 0 5 0 528955634 140292096 6292 33554432000 4194304 4356188 140736195773808 18446744073709551615 4234006 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=32367/tid=32376] ppid=32362 vsize=137004 CPUtime=12.56 cores=4-7
/proc/32367/task/32376/stat : 32376 (plingeling) R 32362 32362 31594 0 -1 4202560 1560 1260 0 0 1256 0 0 0 25 0 5 0 528955634 140292096 6292 33554432000 4194304 4356188 140736195773808 18446744073709551615 4282013 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=32367/tid=32377] ppid=32362 vsize=137004 CPUtime=10.64 cores=4-7
/proc/32367/task/32377/stat : 32377 (plingeling) R 32362 32362 31594 0 -1 4202560 1418 1260 0 0 1054 10 0 0 25 0 5 0 528955634 140292096 6292 33554432000 4194304 4356188 140736195773808 18446744073709551615 4210557 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 98.94
Current children cumulated vsize (KiB) 2433104

[startup+25.5005 s]
/proc/loadavg: 8.11 8.04 8.00 9/178 32378
/proc/meminfo: memFree=30522116/32951132 swapFree=67111356/67111528
[pid=32362] ppid=32360 vsize=18324 CPUtime=0 cores=0-7
/proc/32362/stat : 32362 (ppfolio) S 32360 32362 31594 0 -1 4202496 519 0 0 0 0 0 0 0 15 0 1 0 528955631 18763776 389 33554432000 4194304 4287625 140736949656016 18446744073709551615 274664828431 0 0 4096 65536 4576995331354394623 0 0 17 3 0 0 0
/proc/32362/statm: 4581 389 341 23 0 91 0
[pid=32363] ppid=32362 vsize=1771408 CPUtime=25.48 cores=0
/proc/32363/stat : 32363 (cryptominisat) R 32362 32362 31594 0 -1 4202496 49408 0 0 0 2542 6 0 0 25 0 1 0 528955631 1813921792 27328 33554432000 4194304 4587354 140734550584816 18446744073709551615 4364768 0 0 4096 2 0 0 0 17 0 0 0 0

################
# More data... #
################

[pid=32365] ppid=32362 vsize=457808 CPUtime=4782.38 cores=2
/proc/32365/stat : 32365 (TNM) R 32362 32362 31594 0 -1 4202496 1157 0 0 0 478238 0 0 0 25 0 1 0 528955631 468795392 1054 33554432000 134512640 134534564 4291252656 18446744073709551615 134530659 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/32365/statm: 114452 1054 103 6 0 113118 0
[pid=32366] ppid=32362 vsize=1050452 CPUtime=4782.37 cores=3
/proc/32366/stat : 32366 (march_hi) R 32362 32362 31594 0 -1 4202496 181454 0 0 0 478139 98 0 0 25 0 1 0 528955631 1075662848 181195 33554432000 4194304 4331988 140734928737296 18446744073709551615 4265456 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/32366/statm: 262613 181195 175 34 0 261055 0
[pid=32367] ppid=32362 vsize=538476 CPUtime=19099.8 cores=4-7
/proc/32367/stat : 32367 (plingeling) S 32362 32362 31594 0 -1 4202496 1970594 1260 0 0 1909655 327 0 0 18 0 5 0 528955631 551399424 106619 33554432000 4194304 4356188 140736195773808 18446744073709551615 274676611045 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/32367/statm: 134619 106619 163 40 0 133163 0
[pid=32367/tid=32374] ppid=32362 vsize=538476 CPUtime=4782.34 cores=4-7
/proc/32367/task/32374/stat : 32374 (plingeling) R 32362 32362 31594 0 -1 4202560 295867 1260 0 0 478192 42 0 0 25 0 5 0 528955634 551399424 106619 33554432000 4194304 4356188 140736195773808 18446744073709551615 4281495 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=32367/tid=32375] ppid=32362 vsize=538476 CPUtime=4780.68 cores=4-7
/proc/32367/task/32375/stat : 32375 (plingeling) R 32362 32362 31594 0 -1 4202560 286024 1260 0 0 478028 40 0 0 25 0 5 0 528955634 551399424 106619 33554432000 4194304 4356188 140736195773808 18446744073709551615 4274258 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=32367/tid=32376] ppid=32362 vsize=538476 CPUtime=4758.19 cores=4-7
/proc/32367/task/32376/stat : 32376 (plingeling) R 32362 32362 31594 0 -1 4202560 289980 1260 0 0 475776 43 0 0 25 0 5 0 528955634 551399424 106619 33554432000 4194304 4356188 140736195773808 18446744073709551615 4331328 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=32367/tid=32377] ppid=32362 vsize=538476 CPUtime=4778.56 cores=4-7
/proc/32367/task/32377/stat : 32377 (plingeling) R 32362 32362 31594 0 -1 4202560 1097169 1260 0 0 477655 201 0 0 25 0 5 0 528955634 551399424 106619 33554432000 4194304 4356188 140736195773808 18446744073709551615 4274252 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 38227.9
Current children cumulated vsize (KiB) 5559732

[startup+4842.3 s]
/proc/loadavg: 8.05 8.04 8.00 9/178 32518
/proc/meminfo: memFree=27779332/32951132 swapFree=67111356/67111528
[pid=32362] ppid=32360 vsize=18324 CPUtime=0 cores=0-7
/proc/32362/stat : 32362 (ppfolio) S 32360 32362 31594 0 -1 4202496 519 0 0 0 0 0 0 0 15 0 1 0 528955631 18763776 389 33554432000 4194304 4287625 140736949656016 18446744073709551615 274664828431 0 0 4096 65536 4576995331354394623 0 0 17 3 0 0 0
/proc/32362/statm: 4581 389 341 23 0 91 0
[pid=32363] ppid=32362 vsize=3041792 CPUtime=4842.13 cores=0
/proc/32363/stat : 32363 (cryptominisat) R 32362 32362 31594 0 -1 4202496 4251933 0 0 0 483386 827 0 0 25 0 1 0 528955631 3114795008 335499 33554432000 4194304 4587354 140734550584816 18446744073709551615 4364784 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/32363/statm: 760448 335499 337 96 0 757010 0
[pid=32364] ppid=32362 vsize=452880 CPUtime=4841.16 cores=1
/proc/32364/stat : 32364 (clasp) R 32362 32362 31594 0 -1 4202496 106787 0 0 0 484092 24 0 0 25 0 1 0 528955631 463749120 105199 33554432000 4194304 4785740 140736618075584 18446744073709551615 4278587 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/32364/statm: 113220 105199 341 145 0 110265 0
[pid=32365] ppid=32362 vsize=457808 CPUtime=4842.38 cores=2
/proc/32365/stat : 32365 (TNM) R 32362 32362 31594 0 -1 4202496 1157 0 0 0 484238 0 0 0 25 0 1 0 528955631 468795392 1054 33554432000 134512640 134534564 4291252656 18446744073709551615 134530598 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/32365/statm: 114452 1054 103 6 0 113118 0
[pid=32366] ppid=32362 vsize=1050452 CPUtime=4842.38 cores=3
/proc/32366/stat : 32366 (march_hi) R 32362 32362 31594 0 -1 4202496 183519 0 0 0 484139 99 0 0 25 0 1 0 528955631 1075662848 183260 33554432000 4194304 4331988 140734928737296 18446744073709551615 4228205 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/32366/statm: 262613 183260 175 34 0 261055 0
[pid=32367] ppid=32362 vsize=579436 CPUtime=19339.5 cores=4-7
/proc/32367/stat : 32367 (plingeling) S 32362 32362 31594 0 -1 4202496 1989026 1260 0 0 1933621 330 0 0 18 0 5 0 528955631 593342464 116859 33554432000 4194304 4356188 140736195773808 18446744073709551615 274676611045 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/32367/statm: 144859 116859 163 40 0 143403 0
[pid=32367/tid=32374] ppid=32362 vsize=579436 CPUtime=4842.35 cores=4-7
/proc/32367/task/32374/stat : 32374 (plingeling) R 32362 32362 31594 0 -1 4202560 304059 1260 0 0 484192 43 0 0 25 0 5 0 528955634 593342464 116859 33554432000 4194304 4356188 140736195773808 18446744073709551615 4283959 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=32367/tid=32375] ppid=32362 vsize=579436 CPUtime=4840.67 cores=4-7
/proc/32367/task/32375/stat : 32375 (plingeling) R 32362 32362 31594 0 -1 4202560 295240 1260 0 0 484027 40 0 0 25 0 5 0 528955634 593342464 116859 33554432000 4194304 4356188 140736195773808 18446744073709551615 4281690 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=32367/tid=32376] ppid=32362 vsize=579436 CPUtime=4817.9 cores=4-7
/proc/32367/task/32376/stat : 32376 (plingeling) R 32362 32362 31594 0 -1 4202560 291004 1260 0 0 481747 43 0 0 25 0 5 0 528955634 593342464 116859 33554432000 4194304 4356188 140736195773808 18446744073709551615 4331350 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=32367/tid=32377] ppid=32362 vsize=579436 CPUtime=4838.54 cores=4-7
/proc/32367/task/32377/stat : 32377 (plingeling) R 32362 32362 31594 0 -1 4202560 1097169 1260 0 0 483652 202 0 0 25 0 5 0 528955634 593342464 116859 33554432000 4194304 4356188 140736195773808 18446744073709551615 4279478 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 38707.6
Current children cumulated vsize (KiB) 5600692

[startup+4902.3 s]
/proc/loadavg: 8.05 8.05 8.00 9/178 32520
/proc/meminfo: memFree=27787872/32951132 swapFree=67111356/67111528
[pid=32362] ppid=32360 vsize=18324 CPUtime=0 cores=0-7
/proc/32362/stat : 32362 (ppfolio) S 32360 32362 31594 0 -1 4202496 519 0 0 0 0 0 0 0 15 0 1 0 528955631 18763776 389 33554432000 4194304 4287625 140736949656016 18446744073709551615 274664828431 0 0 4096 65536 4576995331354394623 0 0 17 3 0 0 0
/proc/32362/statm: 4581 389 341 23 0 91 0
[pid=32363] ppid=32362 vsize=3041792 CPUtime=4902.13 cores=0
/proc/32363/stat : 32363 (cryptominisat) R 32362 32362 31594 0 -1 4202496 4259460 0 0 0 489384 829 0 0 25 0 1 0 528955631 3114795008 342999 33554432000 4194304 4587354 140734550584816 18446744073709551615 4238568 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/32363/statm: 760448 342999 337 96 0 757010 0
[pid=32364] ppid=32362 vsize=452880 CPUtime=4901.15 cores=1
/proc/32364/stat : 32364 (clasp) R 32362 32362 31594 0 -1 4202496 106820 0 0 0 490091 24 0 0 25 0 1 0 528955631 463749120 105232 33554432000 4194304 4785740 140736618075584 18446744073709551615 4548969 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/32364/statm: 113220 105232 341 145 0 110265 0
[pid=32365] ppid=32362 vsize=457808 CPUtime=4902.38 cores=2
/proc/32365/stat : 32365 (TNM) R 32362 32362 31594 0 -1 4202496 1157 0 0 0 490238 0 0 0 25 0 1 0 528955631 468795392 1054 33554432000 134512640 134534564 4291252656 18446744073709551615 134528957 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/32365/statm: 114452 1054 103 6 0 113118 0
[pid=32366] ppid=32362 vsize=1050452 CPUtime=4902.38 cores=3
/proc/32366/stat : 32366 (march_hi) R 32362 32362 31594 0 -1 4202496 185810 0 0 0 490138 100 0 0 25 0 1 0 528955631 1075662848 185551 33554432000 4194304 4331988 140734928737296 18446744073709551615 4313635 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/32366/statm: 262613 185551 175 34 0 261055 0
[pid=32367] ppid=32362 vsize=534380 CPUtime=19579.2 cores=4-7
/proc/32367/stat : 32367 (plingeling) S 32362 32362 31594 0 -1 4202496 2006434 1260 0 0 1957584 332 0 0 18 0 5 0 528955631 547205120 105595 33554432000 4194304 4356188 140736195773808 18446744073709551615 274676611045 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/32367/statm: 133595 105595 163 40 0 132139 0
[pid=32367/tid=32374] ppid=32362 vsize=534380 CPUtime=4902.35 cores=4-7
/proc/32367/task/32374/stat : 32374 (plingeling) R 32362 32362 31594 0 -1 4202560 304059 1260 0 0 490192 43 0 0 25 0 5 0 528955634 547205120 105595 33554432000 4194304 4356188 140736195773808 18446744073709551615 4331106 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=32367/tid=32375] ppid=32362 vsize=534380 CPUtime=4900.67 cores=4-7
/proc/32367/task/32375/stat : 32375 (plingeling) R 32362 32362 31594 0 -1 4202560 295240 1260 0 0 490026 41 0 0 25 0 5 0 528955634 547205120 105595 33554432000 4194304 4356188 140736195773808 18446744073709551615 4274240 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=32367/tid=32376] ppid=32362 vsize=534380 CPUtime=4877.58 cores=4-7
/proc/32367/task/32376/stat : 32376 (plingeling) R 32362 32362 31594 0 -1 4202560 299196 1260 0 0 487715 43 0 0 25 0 5 0 528955634 547205120 105595 33554432000 4194304 4356188 140736195773808 18446744073709551615 4242320 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=32367/tid=32377] ppid=32362 vsize=534380 CPUtime=4898.51 cores=4-7
/proc/32367/task/32377/stat : 32377 (plingeling) R 32362 32362 31594 0 -1 4202560 1106385 1260 0 0 489648 203 0 0 25 0 5 0 528955634 547205120 105595 33554432000 4194304 4356188 140736195773808 18446744073709551615 4281668 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 39187.2
Current children cumulated vsize (KiB) 5555636

[startup+4962.3 s]
/proc/loadavg: 8.05 8.05 8.00 9/178 32521
/proc/meminfo: memFree=27797020/32951132 swapFree=67111356/67111528
[pid=32362] ppid=32360 vsize=18324 CPUtime=0 cores=0-7
/proc/32362/stat : 32362 (ppfolio) S 32360 32362 31594 0 -1 4202496 519 0 0 0 0 0 0 0 15 0 1 0 528955631 18763776 389 33554432000 4194304 4287625 140736949656016 18446744073709551615 274664828431 0 0 4096 65536 4576995331354394623 0 0 17 3 0 0 0
/proc/32362/statm: 4581 389 341 23 0 91 0
[pid=32363] ppid=32362 vsize=3039792 CPUtime=4962.13 cores=0
/proc/32363/stat : 32363 (cryptominisat) R 32362 32362 31594 0 -1 4202496 4322774 0 0 0 495370 843 0 0 25 0 1 0 528955631 3112747008 337153 33554432000 4194304 4587354 140734550584816 18446744073709551615 4241103 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/32363/statm: 759948 337153 337 96 0 756510 0
[pid=32364] ppid=32362 vsize=452880 CPUtime=4961.15 cores=1
/proc/32364/stat : 32364 (clasp) R 32362 32362 31594 0 -1 4202496 106824 0 0 0 496091 24 0 0 25 0 1 0 528955631 463749120 105236 33554432000 4194304 4785740 140736618075584 18446744073709551615 4536000 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/32364/statm: 113220 105236 341 145 0 110265 0
[pid=32365] ppid=32362 vsize=457808 CPUtime=4962.39 cores=2
/proc/32365/stat : 32365 (TNM) R 32362 32362 31594 0 -1 4202496 1157 0 0 0 496239 0 0 0 25 0 1 0 528955631 468795392 1054 33554432000 134512640 134534564 4291252656 18446744073709551615 134529381 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/32365/statm: 114452 1054 103 6 0 113118 0
[pid=32366] ppid=32362 vsize=1050452 CPUtime=4962.38 cores=3
/proc/32366/stat : 32366 (march_hi) R 32362 32362 31594 0 -1 4202496 187923 0 0 0 496137 101 0 0 25 0 1 0 528955631 1075662848 187664 33554432000 4194304 4331988 140734928737296 18446744073709551615 4210448 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/32366/statm: 262613 187664 175 34 0 261055 0
[pid=32367] ppid=32362 vsize=538476 CPUtime=19818.8 cores=4-7
/proc/32367/stat : 32367 (plingeling) S 32362 32362 31594 0 -1 4202496 2008482 1260 0 0 1981548 333 0 0 18 0 5 0 528955631 551399424 106619 33554432000 4194304 4356188 140736195773808 18446744073709551615 274676611045 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/32367/statm: 134619 106619 163 40 0 133163 0
[pid=32367/tid=32374] ppid=32362 vsize=538476 CPUtime=4962.35 cores=4-7
/proc/32367/task/32374/stat : 32374 (plingeling) R 32362 32362 31594 0 -1 4202560 304059 1260 0 0 496192 43 0 0 25 0 5 0 528955634 551399424 106619 33554432000 4194304 4356188 140736195773808 18446744073709551615 4234139 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=32367/tid=32375] ppid=32362 vsize=538476 CPUtime=4960.66 cores=4-7
/proc/32367/task/32375/stat : 32375 (plingeling) R 32362 32362 31594 0 -1 4202560 296264 1260 0 0 496025 41 0 0 25 0 5 0 528955634 551399424 106619 33554432000 4194304 4356188 140736195773808 18446744073709551615 4331055 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=32367/tid=32376] ppid=32362 vsize=538476 CPUtime=4937.26 cores=4-7
/proc/32367/task/32376/stat : 32376 (plingeling) R 32362 32362 31594 0 -1 4202560 299196 1260 0 0 493683 43 0 0 25 0 5 0 528955634 551399424 106619 33554432000 4194304 4356188 140736195773808 18446744073709551615 4331305 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=32367/tid=32377] ppid=32362 vsize=538476 CPUtime=4958.49 cores=4-7
/proc/32367/task/32377/stat : 32377 (plingeling) R 32362 32362 31594 0 -1 4202560 1107409 1260 0 0 495645 204 0 0 25 0 5 0 528955634 551399424 106619 33554432000 4194304 4356188 140736195773808 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 39666.9
Current children cumulated vsize (KiB) 5557732



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5004 s]
/proc/loadavg: 8.02 8.04 8.00 9/178 32523
/proc/meminfo: memFree=27675352/32951132 swapFree=67111356/67111528
[pid=32362] ppid=32360 vsize=18324 CPUtime=0 cores=0-7
/proc/32362/stat : 32362 (ppfolio) S 32360 32362 31594 0 -1 4202496 519 0 0 0 0 0 0 0 15 0 1 0 528955631 18763776 389 33554432000 4194304 4287625 140736949656016 18446744073709551615 274664828431 0 0 4096 65536 4576995331354394623 0 0 17 3 0 0 0
/proc/32362/statm: 4581 389 341 23 0 91 0
[pid=32363] ppid=32362 vsize=3035296 CPUtime=5003.84 cores=0
/proc/32363/stat : 32363 (cryptominisat) R 32362 32362 31594 0 -1 4202496 4368594 0 0 0 499529 855 0 0 25 0 1 0 528955631 3108143104 347609 33554432000 4194304 4587354 140734550584816 18446744073709551615 274664504988 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/32363/statm: 758824 347609 337 96 0 755386 0
[pid=32364] ppid=32362 vsize=452880 CPUtime=5002.84 cores=1
/proc/32364/stat : 32364 (clasp) R 32362 32362 31594 0 -1 4202496 106826 0 0 0 500260 24 0 0 25 0 1 0 528955631 463749120 105238 33554432000 4194304 4785740 140736618075584 18446744073709551615 4550908 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/32364/statm: 113220 105238 341 145 0 110265 0
[pid=32365] ppid=32362 vsize=457808 CPUtime=5004.09 cores=2
/proc/32365/stat : 32365 (TNM) R 32362 32362 31594 0 -1 4202496 1157 0 0 0 500409 0 0 0 25 0 1 0 528955631 468795392 1054 33554432000 134512640 134534564 4291252656 18446744073709551615 134530593 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/32365/statm: 114452 1054 103 6 0 113118 0
[pid=32366] ppid=32362 vsize=1050452 CPUtime=5004.09 cores=3
/proc/32366/stat : 32366 (march_hi) R 32362 32362 31594 0 -1 4202496 189360 0 0 0 500307 102 0 0 25 0 1 0 528955631 1075662848 189101 33554432000 4194304 4331988 140734928737296 18446744073709551615 4239560 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/32366/statm: 262613 189101 175 34 0 261055 0
[pid=32367] ppid=32362 vsize=612204 CPUtime=19985.4 cores=4-7
/proc/32367/stat : 32367 (plingeling) S 32362 32362 31594 0 -1 4202496 2026914 1260 0 0 1998204 335 0 0 18 0 5 0 528955631 626896896 125051 33554432000 4194304 4356188 140736195773808 18446744073709551615 274676611045 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/32367/statm: 153051 125051 163 40 0 151595 0
[pid=32367/tid=32374] ppid=32362 vsize=612204 CPUtime=5004.06 cores=4-7
/proc/32367/task/32374/stat : 32374 (plingeling) R 32362 32362 31594 0 -1 4202560 313275 1260 0 0 500362 44 0 0 25 0 5 0 528955634 626896896 125051 33554432000 4194304 4356188 140736195773808 18446744073709551615 4283885 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=32367/tid=32375] ppid=32362 vsize=612204 CPUtime=5002.36 cores=4-7
/proc/32367/task/32375/stat : 32375 (plingeling) R 32362 32362 31594 0 -1 4202560 304456 1260 0 0 500195 41 0 0 25 0 5 0 528955634 626896896 125051 33554432000 4194304 4356188 140736195773808 18446744073709551615 4273850 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=32367/tid=32376] ppid=32362 vsize=612204 CPUtime=4978.76 cores=4-7
/proc/32367/task/32376/stat : 32376 (plingeling) R 32362 32362 31594 0 -1 4202560 300220 1260 0 0 497832 44 0 0 25 0 5 0 528955634 626896896 125051 33554432000 4194304 4356188 140736195773808 18446744073709551615 4274256 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=32367/tid=32377] ppid=32362 vsize=612204 CPUtime=5000.17 cores=4-7
/proc/32367/task/32377/stat : 32377 (plingeling) R 32362 32362 31594 0 -1 4202560 1107409 1260 0 0 499812 205 0 0 25 0 5 0 528955634 626896896 125051 33554432000 4194304 4356188 140736195773808 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 40000.2
Current children cumulated vsize (KiB) 5626964

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 32362 and gives
#  childrusage.ru_utime.tv_sec=5004
#  childrusage.ru_utime.tv_usec=101260
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=17997
# CPU time returned by wait4() is 5004.12
# while last known CPU time is 40000.2
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 5004.02
CPU time (s): 40000.2
CPU user time (s): 39987.1
CPU system time (s): 13.16
CPU usage (%): 799.363
Max. virtual memory (cumulated for all children) (KiB): 7258832

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 5004.1
system time used= 0.017997
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1678
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 561
involuntary context switches= 8176

runsolver used 7.8808 second user time and 17.3874 second system time

The end

Launcher Data 

Begin job on node131 at 2011-04-30 16:26:00
IDJOB=3276106
IDBENCH=85438
IDSOLVER=1638
FILE ID=node131/3276106-1304173560
RUNJOBID= node131-1304158426-31608
PBS_JOBID= 13170915
Free space on /tmp= 72060 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT05/crafted/sabharwal05/counting/php/unsat/easier/php-045-035.shuffled-as.sat05-1181.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3276106-1304173560/watcher-3276106-1304173560 -o /tmp/evaluation-result-3276106-1304173560/solver-3276106-1304173560 -C 40000 -W 5100 -M 31000  ppfolio HOME/instance-3276106-1304173560.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 057b78ff24cc0773c9c67e770a7b9de2
RANDOM SEED=488184295

node131.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951132 kB
MemFree:      30748120 kB
Buffers:        249940 kB
Cached:        1578488 kB
SwapCached:        168 kB
Active:         203300 kB
Inactive:      1690900 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951132 kB
LowFree:      30748120 kB
SwapTotal:    67111528 kB
SwapFree:     67111356 kB
Dirty:           10532 kB
Writeback:          32 kB
AnonPages:       66144 kB
Mapped:          15220 kB
Slab:           243500 kB
PageTables:       4664 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587092 kB
Committed_AS:   188648 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296000 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72052 MiB
End job on node131 at 2011-04-30 17:49:26