Trace number 3310166

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio par? (TO) 35973.4 5100.02

General information on the benchmark

NameAPPLICATIONS/
bitverif/maxxor/maxxor064.cnf
MD5SUM902b28046d424b16042ca612ddad48e0
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark809.913
Satisfiable
(Un)Satisfiability was proved
Number of variables51064
Number of clauses152039
Sum of the clauses size354755
Maximum clause length3
Minimum clause length1
Number of clauses of size 12
Number of clauses of size 2101358
Number of clauses of size 350679
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 8 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	[5] plingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 0
0.00/0.00	Starting clasp 1.3.6 on core(s) 1
0.00/0.00	Starting TNM 2009 on core(s) 2
0.00/0.00	Starting march_hi 2009 on core(s) 3
0.00/0.00	Starting plingeling 276-6264d55-100731 on core(s) 4 5 6 7

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3310166-1304002430/watcher-3310166-1304002430 -o /tmp/evaluation-result-3310166-1304002430/solver-3310166-1304002430 -C 40000 -W 5100 -M 31000 ppfolio HOME/instance-3310166-1304002430.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 6.77 7.75 7.91 2/170 23002
/proc/meminfo: memFree=14596264/32950928 swapFree=67111528/67111528
[pid=23002] ppid=23000 vsize=18324 CPUtime=0 cores=0-7
/proc/23002/stat : 23002 (ppfolio) S 23000 23002 22976 0 -1 4202496 522 0 0 0 0 0 0 0 25 0 1 0 590473674 18763776 390 33554432000 4194304 4287625 140735272117936 18446744073709551615 218880585231 0 0 4096 65536 17528204092701147135 0 0 17 4 0 0 0
/proc/23002/statm: 4581 390 341 23 0 91 0

[startup+0.0723621 s]
/proc/loadavg: 6.77 7.75 7.91 2/170 23002
/proc/meminfo: memFree=14596264/32950928 swapFree=67111528/67111528
[pid=23002] ppid=23000 vsize=18324 CPUtime=0 cores=0-7
/proc/23002/stat : 23002 (ppfolio) S 23000 23002 22976 0 -1 4202496 522 0 0 0 0 0 0 0 25 0 1 0 590473674 18763776 390 33554432000 4194304 4287625 140735272117936 18446744073709551615 218880585231 0 0 4096 65536 17528204092701147135 0 0 17 4 0 0 0
/proc/23002/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.100358 s]
/proc/loadavg: 6.77 7.75 7.91 2/170 23002
/proc/meminfo: memFree=14596264/32950928 swapFree=67111528/67111528
[pid=23002] ppid=23000 vsize=18324 CPUtime=0 cores=0-7
/proc/23002/stat : 23002 (ppfolio) S 23000 23002 22976 0 -1 4202496 522 0 0 0 0 0 0 0 25 0 1 0 590473674 18763776 390 33554432000 4194304 4287625 140735272117936 18446744073709551615 218880585231 0 0 4096 65536 17528204092701147135 0 0 17 4 0 0 0
/proc/23002/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.300265 s]
/proc/loadavg: 6.77 7.75 7.91 2/170 23002
/proc/meminfo: memFree=14596264/32950928 swapFree=67111528/67111528
[pid=23002] ppid=23000 vsize=18324 CPUtime=0 cores=0-7
/proc/23002/stat : 23002 (ppfolio) S 23000 23002 22976 0 -1 4202496 522 0 0 0 0 0 0 0 25 0 1 0 590473674 18763776 390 33554432000 4194304 4287625 140735272117936 18446744073709551615 218880585231 0 0 4096 65536 17528204092701147135 0 0 17 4 0 0 0
/proc/23002/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.700194 s]
/proc/loadavg: 6.77 7.75 7.91 2/170 23002
/proc/meminfo: memFree=14596264/32950928 swapFree=67111528/67111528
[pid=23002] ppid=23000 vsize=18324 CPUtime=0 cores=0-7
/proc/23002/stat : 23002 (ppfolio) S 23000 23002 22976 0 -1 4202496 522 0 0 0 0 0 0 0 25 0 1 0 590473674 18763776 390 33554432000 4194304 4287625 140735272117936 18446744073709551615 218880585231 0 0 4096 65536 17528204092701147135 0 0 17 4 0 0 0
/proc/23002/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50106 s]
/proc/loadavg: 6.77 7.75 7.91 9/180 23017
/proc/meminfo: memFree=14442796/32950928 swapFree=67111528/67111528
[pid=23002] ppid=23000 vsize=18324 CPUtime=0 cores=0-7
/proc/23002/stat : 23002 (ppfolio) S 23000 23002 22976 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 590473674 18763776 390 33554432000 4194304 4287625 140735272117936 18446744073709551615 218880585231 0 0 4096 65536 17528204092701147135 0 0 17 4 0 0 0
/proc/23002/statm: 4581 390 341 23 0 91 0
[pid=23003] ppid=23002 vsize=50916 CPUtime=1.49 cores=0
/proc/23003/stat : 23003 (cryptominisat) R 23002 23002 22976 0 -1 4202496 7198 0 0 0 148 1 0 0 20 0 1 0 590473675 52137984 7025 33554432000 4194304 4587354 140733463359344 18446744073709551615 4421086 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/23003/statm: 12729 7025 312 96 0 9291 0
[pid=23004] ppid=23002 vsize=41504 CPUtime=1.49 cores=1
/proc/23004/stat : 23004 (clasp) R 23002 23002 22976 0 -1 4202496 9699 0 0 0 148 1 0 0 20 0 1 0 590473675 42500096 7469 33554432000 4194304 4785740 140736875445840 18446744073709551615 4552628 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/23004/statm: 10376 7469 340 145 0 7421 0
[pid=23005] ppid=23002 vsize=462424 CPUtime=1.49 cores=2
/proc/23005/stat : 23005 (TNM) R 23002 23002 22976 0 -1 4202496 5468 0 0 0 149 0 0 0 20 0 1 0 590473675 473522176 5364 33554432000 134512640 134534564 4289734864 18446744073709551615 134528661 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/23005/statm: 115606 5364 95 6 0 114272 0
[pid=23006] ppid=23002 vsize=103364 CPUtime=1.48 cores=3
/proc/23006/stat : 23006 (march_hi) R 23002 23002 22976 0 -1 4202496 47718 0 0 0 141 7 0 0 20 0 1 0 590473675 105844736 15361 33554432000 4194304 4331988 140735213260528 18446744073709551615 4229439 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/23006/statm: 25841 15361 173 34 0 24283 0
[pid=23007] ppid=23002 vsize=84008 CPUtime=5.38 cores=4-7
/proc/23007/stat : 23007 (plingeling) S 23002 23002 22976 0 -1 4202496 18548 1253 0 0 536 2 0 0 18 0 5 0 590473675 86024192 9455 33554432000 4194304 4356188 140736281338992 18446744073709551615 218892367845 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/23007/statm: 21002 9455 159 40 0 19546 0
[pid=23007/tid=23014] ppid=23002 vsize=84008 CPUtime=1.31 cores=4-7
/proc/23007/task/23014/stat : 23014 (plingeling) R 23002 23002 22976 0 -1 4202560 1464 1253 0 0 131 0 0 0 25 0 5 0 590473693 86024192 9455 33554432000 4194304 4356188 140736281338992 18446744073709551615 4322064 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=23007/tid=23015] ppid=23002 vsize=84008 CPUtime=1.3 cores=4-7
/proc/23007/task/23015/stat : 23015 (plingeling) R 23002 23002 22976 0 -1 4202560 3142 1253 0 0 130 0 0 0 19 0 5 0 590473693 86024192 9455 33554432000 4194304 4356188 140736281338992 18446744073709551615 4322106 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=23007/tid=23016] ppid=23002 vsize=84008 CPUtime=1.3 cores=4-7
/proc/23007/task/23016/stat : 23016 (plingeling) R 23002 23002 22976 0 -1 4202560 3134 1253 0 0 130 0 0 0 19 0 5 0 590473693 86024192 9455 33554432000 4194304 4356188 140736281338992 18446744073709551615 4322016 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=23007/tid=23017] ppid=23002 vsize=84008 CPUtime=1.26 cores=4-7
/proc/23007/task/23017/stat : 23017 (plingeling) R 23002 23002 22976 0 -1 4202560 2205 1253 0 0 126 0 0 0 19 0 5 0 590473693 86024192 9455 33554432000 4194304 4356188 140736281338992 18446744073709551615 4330862 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 11.33
Current children cumulated vsize (KiB) 760540

[startup+3.10078 s]
/proc/loadavg: 6.77 7.75 7.91 9/180 23017
/proc/meminfo: memFree=14383896/32950928 swapFree=67111528/67111528
[pid=23002] ppid=23000 vsize=18324 CPUtime=0 cores=0-7
/proc/23002/stat : 23002 (ppfolio) S 23000 23002 22976 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 590473674 18763776 390 33554432000 4194304 4287625 140735272117936 18446744073709551615 218880585231 0 0 4096 65536 17528204092701147135 0 0 17 4 0 0 0
/proc/23002/statm: 4581 390 341 23 0 91 0
[pid=23003] ppid=23002 vsize=72620 CPUtime=3.08 cores=0
/proc/23003/stat : 23003 (cryptominisat) R 23002 23002 22976 0 -1 4202496 15644 0 0 0 306 2 0 0 25 0 1 0 590473675 74362880 12905 33554432000 4194304 4587354 140733463359344 18446744073709551615 4241274 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/23003/statm: 18155 12905 330 96 0 14717 0
[pid=23004] ppid=23002 vsize=41504 CPUtime=3.09 cores=1
/proc/23004/stat : 23004 (clasp) R 23002 23002 22976 0 -1 4202496 9717 0 0 0 308 1 0 0 25 0 1 0 590473675 42500096 7487 33554432000 4194304 4785740 140736875445840 18446744073709551615 4552628 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/23004/statm: 10376 7487 340 145 0 7421 0
[pid=23005] ppid=23002 vsize=462424 CPUtime=3.09 cores=2
/proc/23005/stat : 23005 (TNM) R 23002 23002 22976 0 -1 4202496 5468 0 0 0 309 0 0 0 25 0 1 0 590473675 473522176 5364 33554432000 134512640 134534564 4289734864 18446744073709551615 134528726 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/23005/statm: 115606 5364 95 6 0 114272 0
[pid=23006] ppid=23002 vsize=111400 CPUtime=3.09 cores=3
/proc/23006/stat : 23006 (march_hi) R 23002 23002 22976 0 -1 4202496 55962 0 0 0 301 8 0 0 25 0 1 0 590473675 114073600 23605 33554432000 4194304 4331988 140735213260528 18446744073709551615 4229351 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/23006/statm: 27850 23605 173 34 0 26292 0
[pid=23007] ppid=23002 vsize=105000 CPUtime=11.77 cores=4-7
/proc/23007/stat : 23007 (plingeling) S 23002 23002 22976 0 -1 4202496 23786 1253 0 0 1174 3 0 0 18 0 5 0 590473675 107520000 14693 33554432000 4194304 4356188 140736281338992 18446744073709551615 218892367845 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/23007/statm: 26250 14693 163 40 0 24794 0
[pid=23007/tid=23014] ppid=23002 vsize=105000 CPUtime=2.9 cores=4-7
/proc/23007/task/23014/stat : 23014 (plingeling) R 23002 23002 22976 0 -1 4202560 3006 1253 0 0 290 0 0 0 25 0 5 0 590473693 107520000 14693 33554432000 4194304 4356188 140736281338992 18446744073709551615 4302878 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=23007/tid=23015] ppid=23002 vsize=105000 CPUtime=2.9 cores=4-7
/proc/23007/task/23015/stat : 23015 (plingeling) R 23002 23002 22976 0 -1 4202560 4894 1253 0 0 290 0 0 0 24 0 5 0 590473693 107520000 14693 33554432000 4194304 4356188 140736281338992 18446744073709551615 4302844 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=23007/tid=23016] ppid=23002 vsize=105000 CPUtime=2.9 cores=4-7
/proc/23007/task/23016/stat : 23016 (plingeling) R 23002 23002 22976 0 -1 4202560 4680 1253 0 0 290 0 0 0 24 0 5 0 590473693 107520000 14693 33554432000 4194304 4356188 140736281338992 18446744073709551615 4304688 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=23007/tid=23017] ppid=23002 vsize=105000 CPUtime=2.85 cores=4-7
/proc/23007/task/23017/stat : 23017 (plingeling) R 23002 23002 22976 0 -1 4202560 2603 1253 0 0 285 0 0 0 24 0 5 0 590473693 107520000 14693 33554432000 4194304 4356188 140736281338992 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 24.12
Current children cumulated vsize (KiB) 811272

[startup+6.30122 s]
/proc/loadavg: 6.87 7.75 7.91 9/180 23017
/proc/meminfo: memFree=14335196/32950928 swapFree=67111528/67111528
[pid=23002] ppid=23000 vsize=18324 CPUtime=0 cores=0-7
/proc/23002/stat : 23002 (ppfolio) S 23000 23002 22976 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 590473674 18763776 390 33554432000 4194304 4287625 140735272117936 18446744073709551615 218880585231 0 0 4096 65536 17528204092701147135 0 0 17 4 0 0 0
/proc/23002/statm: 4581 390 341 23 0 91 0
[pid=23003] ppid=23002 vsize=73024 CPUtime=6.29 cores=0
/proc/23003/stat : 23003 (cryptominisat) R 23002 23002 22976 0 -1 4202496 16172 0 0 0 627 2 0 0 25 0 1 0 590473675 74776576 13411 33554432000 4194304 4587354 140733463359344 18446744073709551615 4237627 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/23003/statm: 18256 13411 330 96 0 14818 0
[pid=23004] ppid=23002 vsize=44968 CPUtime=6.29 cores=1
/proc/23004/stat : 23004 (clasp) R 23002 23002 22976 0 -1 4202496 10615 0 0 0 627 2 0 0 25 0 1 0 590473675 46047232 8385 33554432000 4194304 4785740 140736875445840 18446744073709551615 4553015 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/23004/statm: 11242 8385 340 145 0 8287 0
[pid=23005] ppid=23002 vsize=462424 CPUtime=6.28 cores=2
/proc/23005/stat : 23005 (TNM) R 23002 23002 22976 0 -1 4202496 5468 0 0 0 628 0 0 0 25 0 1 0 590473675 473522176 5364 33554432000 134512640 134534564 4289734864 18446744073709551615 134528661 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/23005/statm: 115606 5364 95 6 0 114272 0
[pid=23006] ppid=23002 vsize=115676 CPUtime=6.29 cores=3
/proc/23006/stat : 23006 (march_hi) R 23002 23002 22976 0 -1 4202496 57062 0 0 0 621 8 0 0 25 0 1 0 590473675 118452224 24705 33554432000 4194304 4331988 140735213260528 18446744073709551615 4229651 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/23006/statm: 28919 24705 173 34 0 27361 0
[pid=23007] ppid=23002 vsize=104720 CPUtime=24.55 cores=4-7
/proc/23007/stat : 23007 (plingeling) S 23002 23002 22976 0 -1 4202496 23786 1253 0 0 2452 3 0 0 18 0 5 0 590473675 107233280 14623 33554432000 4194304 4356188 140736281338992 18446744073709551615 218892367845 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/23007/statm: 26180 14623 163 40 0 24724 0
[pid=23007/tid=23014] ppid=23002 vsize=104720 CPUtime=6.1 cores=4-7
/proc/23007/task/23014/stat : 23014 (plingeling) R 23002 23002 22976 0 -1 4202560 3006 1253 0 0 610 0 0 0 25 0 5 0 590473693 107233280 14623 33554432000 4194304 4356188 140736281338992 18446744073709551615 4330862 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=23007/tid=23015] ppid=23002 vsize=104720 CPUtime=6.1 cores=4-7
/proc/23007/task/23015/stat : 23015 (plingeling) R 23002 23002 22976 0 -1 4202560 4894 1253 0 0 610 0 0 0 25 0 5 0 590473693 107233280 14623 33554432000 4194304 4356188 140736281338992 18446744073709551615 4237027 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=23007/tid=23016] ppid=23002 vsize=104720 CPUtime=6.1 cores=4-7
/proc/23007/task/23016/stat : 23016 (plingeling) R 23002 23002 22976 0 -1 4202560 4680 1253 0 0 610 0 0 0 25 0 5 0 590473693 107233280 14623 33554432000 4194304 4356188 140736281338992 18446744073709551615 4334538 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=23007/tid=23017] ppid=23002 vsize=104720 CPUtime=6.04 cores=4-7
/proc/23007/task/23017/stat : 23017 (plingeling) R 23002 23002 22976 0 -1 4202560 2603 1253 0 0 604 0 0 0 25 0 5 0 590473693 107233280 14623 33554432000 4194304 4356188 140736281338992 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 49.7
Current children cumulated vsize (KiB) 819136

[startup+12.7011 s]
/proc/loadavg: 7.04 7.77 7.92 9/180 23018
/proc/meminfo: memFree=14313900/32950928 swapFree=67111528/67111528
[pid=23002] ppid=23000 vsize=18324 CPUtime=0 cores=0-7
/proc/23002/stat : 23002 (ppfolio) S 23000 23002 22976 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 590473674 18763776 390 33554432000 4194304 4287625 140735272117936 18446744073709551615 218880585231 0 0 4096 65536 17528204092701147135 0 0 17 4 0 0 0
/proc/23002/statm: 4581 390 341 23 0 91 0
[pid=23003] ppid=23002 vsize=110968 CPUtime=12.69 cores=0
/proc/23003/stat : 23003 (cryptominisat) R 23002 23002 22976 0 -1 4202496 16899 0 0 0 1266 3 0 0 25 0 1 0 590473675 113631232 14131 33554432000 4194304 4587354 140733463359344 18446744073709551615 4450948 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/23003/statm: 27742 14131 336 96 0 24304 0
[pid=23004] ppid=23002 vsize=52796 CPUtime=12.69 cores=1
/proc/23004/stat : 23004 (clasp) R 23002 23002 22976 0 -1 4202496 12568 0 0 0 1266 3 0 0 25 0 1 0 590473675 54063104 10338 33554432000 4194304 4785740 140736875445840 18446744073709551615 4312619 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/23004/statm: 13199 10338 340 145 0 10244 0
[pid=23005] ppid=23002 vsize=462424 CPUtime=12.68 cores=2
/proc/23005/stat : 23005 (TNM) R 23002 23002 22976 0 -1 4202496 5468 0 0 0 1268 0 0 0 25 0 1 0 590473675 473522176 5364 33554432000 134512640 134534564 4289734864 18446744073709551615 134529970 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/23005/statm: 115606 5364 95 6 0 114272 0
[pid=23006] ppid=23002 vsize=121072 CPUtime=12.68 cores=3
/proc/23006/stat : 23006 (march_hi) R 23002 23002 22976 0 -1 4202496 58302 0 0 0 1260 8 0 0 25 0 1 0 590473675 123977728 25945 33554432000 4194304 4331988 140735213260528 18446744073709551615 4229539 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/23006/statm: 30268 25945 173 34 0 28710 0
[pid=23007] ppid=23002 vsize=109268 CPUtime=50.12 cores=4-7
/proc/23007/stat : 23007 (plingeling) S 23002 23002 22976 0 -1 4202496 25548 1253 0 0 5009 3 0 0 18 0 5 0 590473675 111890432 15760 33554432000 4194304 4356188 140736281338992 18446744073709551615 218892367845 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/23007/statm: 27317 15760 163 40 0 25861 0
[pid=23007/tid=23014] ppid=23002 vsize=109268 CPUtime=12.5 cores=4-7
/proc/23007/task/23014/stat : 23014 (plingeling) R 23002 23002 22976 0 -1 4202560 3120 1253 0 0 1250 0 0 0 25 0 5 0 590473693 111890432 15760 33554432000 4194304 4356188 140736281338992 18446744073709551615 4210557 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=23007/tid=23015] ppid=23002 vsize=109268 CPUtime=12.5 cores=4-7
/proc/23007/task/23015/stat : 23015 (plingeling) R 23002 23002 22976 0 -1 4202560 5518 1253 0 0 1250 0 0 0 25 0 5 0 590473693 111890432 15760 33554432000 4194304 4356188 140736281338992 18446744073709551615 4237246 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=23007/tid=23016] ppid=23002 vsize=109268 CPUtime=12.5 cores=4-7
/proc/23007/task/23016/stat : 23016 (plingeling) R 23002 23002 22976 0 -1 4202560 4680 1253 0 0 1250 0 0 0 25 0 5 0 590473693 111890432 15760 33554432000 4194304 4356188 140736281338992 18446744073709551615 4334538 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=23007/tid=23017] ppid=23002 vsize=109268 CPUtime=12.4 cores=4-7
/proc/23007/task/23017/stat : 23017 (plingeling) R 23002 23002 22976 0 -1 4202560 3627 1253 0 0 1240 0 0 0 25 0 5 0 590473693 111890432 15760 33554432000 4194304 4356188 140736281338992 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 100.86
Current children cumulated vsize (KiB) 874852

[startup+25.5009 s]
/proc/loadavg: 7.25 7.78 7.92 9/180 23018
/proc/meminfo: memFree=14297588/32950928 swapFree=67111528/67111528
[pid=23002] ppid=23000 vsize=18324 CPUtime=0 cores=0-7
/proc/23002/stat : 23002 (ppfolio) S 23000 23002 22976 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 590473674 18763776 390 33554432000 4194304 4287625 140735272117936 18446744073709551615 218880585231 0 0 4096 65536 17528204092701147135 0 0 17 4 0 0 0
/proc/23002/statm: 4581 390 341 23 0 91 0
[pid=23003] ppid=23002 vsize=90472 CPUtime=25.48 cores=0
/proc/23003/stat : 23003 (cryptominisat) R 23002 23002 22976 0 -1 4202496 21782 0 0 0 2545 3 0 0 25 0 1 0 590473675 92643328 15613 33554432000 4194304 4587354 140733463359344 18446744073709551615 4452317 0 0 4096 2 0 0 0 17 0 0 0 0

################
# More data... #
################

Current children cumulated CPU time (s) 34170.8
Current children cumulated vsize (KiB) 1975544

[startup+4902.3 s]
/proc/loadavg: 7.00 7.02 7.00 8/179 23169
/proc/meminfo: memFree=13292860/32950928 swapFree=67111528/67111528
[pid=23002] ppid=23000 vsize=18324 CPUtime=301.24 cores=0-7
/proc/23002/stat : 23002 (ppfolio) S 23000 23002 22976 0 -1 4202496 524 68653 0 0 0 0 30108 16 15 0 1 0 590473674 18763776 391 33554432000 4194304 4287625 140735272117936 18446744073709551615 218880585231 0 0 4096 65536 9224195742862639364 0 0 17 4 0 0 0
/proc/23002/statm: 4581 391 342 23 0 91 0
[pid=23004] ppid=23002 vsize=523372 CPUtime=4902.38 cores=1
/proc/23004/stat : 23004 (clasp) R 23002 23002 22976 0 -1 4202496 129767 0 0 0 490181 57 0 0 25 0 1 0 590473675 535932928 127537 33554432000 4194304 4785740 140736875445840 18446744073709551615 4278556 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/23004/statm: 130843 127537 340 145 0 127888 0
[pid=23005] ppid=23002 vsize=462428 CPUtime=4902.34 cores=2
/proc/23005/stat : 23005 (TNM) R 23002 23002 22976 0 -1 4202496 5477 0 0 0 490218 16 0 0 25 0 1 0 590473675 473526272 5373 33554432000 134512640 134534564 4289734864 18446744073709551615 134529374 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/23005/statm: 115607 5373 103 6 0 114273 0
[pid=23006] ppid=23002 vsize=513800 CPUtime=4902.39 cores=3
/proc/23006/stat : 23006 (march_hi) R 23002 23002 22976 0 -1 4202496 146212 0 0 0 490187 52 0 0 25 0 1 0 590473675 526131200 113814 33554432000 4194304 4331988 140735213260528 18446744073709551615 4229533 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/23006/statm: 128450 113814 177 34 0 126892 0
[pid=23007] ppid=23002 vsize=429212 CPUtime=19582.1 cores=4-7
/proc/23007/stat : 23007 (plingeling) S 23002 23002 22976 0 -1 4202496 659584 1253 0 0 1958112 101 0 0 18 0 5 0 590473675 439513088 79395 33554432000 4194304 4356188 140736281338992 18446744073709551615 218892367845 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/23007/statm: 107303 79395 163 40 0 105847 0
[pid=23007/tid=23014] ppid=23002 vsize=429212 CPUtime=4902.07 cores=4-7
/proc/23007/task/23014/stat : 23014 (plingeling) R 23002 23002 22976 0 -1 4202560 181927 1253 0 0 490180 27 0 0 25 0 5 0 590473693 439513088 79395 33554432000 4194304 4356188 140736281338992 18446744073709551615 4332046 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=23007/tid=23015] ppid=23002 vsize=429212 CPUtime=4902.21 cores=4-7
/proc/23007/task/23015/stat : 23015 (plingeling) R 23002 23002 22976 0 -1 4202560 212900 1253 0 0 490188 33 0 0 25 0 5 0 590473693 439513088 79395 33554432000 4194304 4356188 140736281338992 18446744073709551615 4330862 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=23007/tid=23016] ppid=23002 vsize=429212 CPUtime=4902.21 cores=4-7
/proc/23007/task/23016/stat : 23016 (plingeling) R 23002 23002 22976 0 -1 4202560 196385 1253 0 0 490191 30 0 0 25 0 5 0 590473693 439513088 79395 33554432000 4194304 4356188 140736281338992 18446744073709551615 4284208 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=23007/tid=23017] ppid=23002 vsize=429212 CPUtime=4875.44 cores=4-7
/proc/23007/task/23017/stat : 23017 (plingeling) R 23002 23002 22976 0 -1 4202560 59769 1253 0 0 487535 9 0 0 25 0 5 0 590473693 439513088 79395 33554432000 4194304 4356188 140736281338992 18446744073709551615 4284178 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 34590.5
Current children cumulated vsize (KiB) 1947136

[startup+4962.3 s]
/proc/loadavg: 7.05 7.03 7.00 8/179 23171
/proc/meminfo: memFree=13270760/32950928 swapFree=67111528/67111528
[pid=23002] ppid=23000 vsize=18324 CPUtime=301.24 cores=0-7
/proc/23002/stat : 23002 (ppfolio) S 23000 23002 22976 0 -1 4202496 524 68653 0 0 0 0 30108 16 15 0 1 0 590473674 18763776 391 33554432000 4194304 4287625 140735272117936 18446744073709551615 218880585231 0 0 4096 65536 9224195742862639364 0 0 17 4 0 0 0
/proc/23002/statm: 4581 391 342 23 0 91 0
[pid=23004] ppid=23002 vsize=523372 CPUtime=4962.38 cores=1
/proc/23004/stat : 23004 (clasp) R 23002 23002 22976 0 -1 4202496 129767 0 0 0 496181 57 0 0 25 0 1 0 590473675 535932928 127537 33554432000 4194304 4785740 140736875445840 18446744073709551615 4548936 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/23004/statm: 130843 127537 340 145 0 127888 0
[pid=23005] ppid=23002 vsize=462428 CPUtime=4962.35 cores=2
/proc/23005/stat : 23005 (TNM) R 23002 23002 22976 0 -1 4202496 5477 0 0 0 496218 17 0 0 25 0 1 0 590473675 473526272 5373 33554432000 134512640 134534564 4289734864 18446744073709551615 134528979 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/23005/statm: 115607 5373 103 6 0 114273 0
[pid=23006] ppid=23002 vsize=514200 CPUtime=4962.4 cores=3
/proc/23006/stat : 23006 (march_hi) R 23002 23002 22976 0 -1 4202496 147235 0 0 0 496187 53 0 0 25 0 1 0 590473675 526540800 114837 33554432000 4194304 4331988 140735213260528 18446744073709551615 4299854 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/23006/statm: 128550 114837 177 34 0 126992 0
[pid=23007] ppid=23002 vsize=451740 CPUtime=19821.8 cores=4-7
/proc/23007/stat : 23007 (plingeling) S 23002 23002 22976 0 -1 4202496 671872 1253 0 0 1982077 103 0 0 18 0 5 0 590473675 462581760 85027 33554432000 4194304 4356188 140736281338992 18446744073709551615 218892367845 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/23007/statm: 112935 85027 163 40 0 111479 0
[pid=23007/tid=23014] ppid=23002 vsize=451740 CPUtime=4962.07 cores=4-7
/proc/23007/task/23014/stat : 23014 (plingeling) R 23002 23002 22976 0 -1 4202560 187047 1253 0 0 496180 27 0 0 25 0 5 0 590473693 462581760 85027 33554432000 4194304 4356188 140736281338992 18446744073709551615 4331323 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=23007/tid=23015] ppid=23002 vsize=451740 CPUtime=4962.2 cores=4-7
/proc/23007/task/23015/stat : 23015 (plingeling) R 23002 23002 22976 0 -1 4202560 214436 1253 0 0 496187 33 0 0 25 0 5 0 590473693 462581760 85027 33554432000 4194304 4356188 140736281338992 18446744073709551615 4284127 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=23007/tid=23016] ppid=23002 vsize=451740 CPUtime=4962.2 cores=4-7
/proc/23007/task/23016/stat : 23016 (plingeling) R 23002 23002 22976 0 -1 4202560 197921 1253 0 0 496190 30 0 0 25 0 5 0 590473693 462581760 85027 33554432000 4194304 4356188 140736281338992 18446744073709551615 4331350 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=23007/tid=23017] ppid=23002 vsize=451740 CPUtime=4935.11 cores=4-7
/proc/23007/task/23017/stat : 23017 (plingeling) R 23002 23002 22976 0 -1 4202560 63865 1253 0 0 493501 10 0 0 25 0 5 0 590473693 462581760 85027 33554432000 4194304 4356188 140736281338992 18446744073709551615 4331015 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 35010.2
Current children cumulated vsize (KiB) 1970064

[startup+5022.3 s]
/proc/loadavg: 7.07 7.04 7.00 8/179 23172
/proc/meminfo: memFree=13259676/32950928 swapFree=67111528/67111528
[pid=23002] ppid=23000 vsize=18324 CPUtime=301.24 cores=0-7
/proc/23002/stat : 23002 (ppfolio) S 23000 23002 22976 0 -1 4202496 524 68653 0 0 0 0 30108 16 15 0 1 0 590473674 18763776 391 33554432000 4194304 4287625 140735272117936 18446744073709551615 218880585231 0 0 4096 65536 9224195742862639364 0 0 17 4 0 0 0
/proc/23002/statm: 4581 391 342 23 0 91 0
[pid=23004] ppid=23002 vsize=523372 CPUtime=5022.38 cores=1
/proc/23004/stat : 23004 (clasp) R 23002 23002 22976 0 -1 4202496 129784 0 0 0 502181 57 0 0 25 0 1 0 590473675 535932928 127554 33554432000 4194304 4785740 140736875445840 18446744073709551615 4287028 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/23004/statm: 130843 127554 340 145 0 127888 0
[pid=23005] ppid=23002 vsize=462428 CPUtime=5022.35 cores=2
/proc/23005/stat : 23005 (TNM) R 23002 23002 22976 0 -1 4202496 5477 0 0 0 502218 17 0 0 25 0 1 0 590473675 473526272 5373 33554432000 134512640 134534564 4289734864 18446744073709551615 134528422 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/23005/statm: 115607 5373 103 6 0 114273 0
[pid=23006] ppid=23002 vsize=514332 CPUtime=5022.41 cores=3
/proc/23006/stat : 23006 (march_hi) R 23002 23002 22976 0 -1 4202496 148369 0 0 0 502187 54 0 0 25 0 1 0 590473675 526675968 115971 33554432000 4194304 4331988 140735213260528 18446744073709551615 4228970 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/23006/statm: 128583 115971 177 34 0 127025 0
[pid=23007] ppid=23002 vsize=453784 CPUtime=20061.5 cores=4-7
/proc/23007/stat : 23007 (plingeling) S 23002 23002 22976 0 -1 4202496 676992 1253 0 0 2006044 104 0 0 18 0 5 0 590473675 464674816 85538 33554432000 4194304 4356188 140736281338992 18446744073709551615 218892367845 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/23007/statm: 113446 85538 163 40 0 111990 0
[pid=23007/tid=23014] ppid=23002 vsize=453784 CPUtime=5022.07 cores=4-7
/proc/23007/task/23014/stat : 23014 (plingeling) R 23002 23002 22976 0 -1 4202560 188071 1253 0 0 502180 27 0 0 25 0 5 0 590473693 464674816 85538 33554432000 4194304 4356188 140736281338992 18446744073709551615 4330969 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=23007/tid=23015] ppid=23002 vsize=453784 CPUtime=5022.2 cores=4-7
/proc/23007/task/23015/stat : 23015 (plingeling) R 23002 23002 22976 0 -1 4202560 214436 1253 0 0 502187 33 0 0 25 0 5 0 590473693 464674816 85538 33554432000 4194304 4356188 140736281338992 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=23007/tid=23016] ppid=23002 vsize=453784 CPUtime=5022.21 cores=4-7
/proc/23007/task/23016/stat : 23016 (plingeling) R 23002 23002 22976 0 -1 4202560 200993 1253 0 0 502190 31 0 0 25 0 5 0 590473693 464674816 85538 33554432000 4194304 4356188 140736281338992 18446744073709551615 4279478 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=23007/tid=23017] ppid=23002 vsize=453784 CPUtime=4994.78 cores=4-7
/proc/23007/task/23017/stat : 23017 (plingeling) R 23002 23002 22976 0 -1 4202560 64889 1253 0 0 499468 10 0 0 25 0 5 0 590473693 464674816 85538 33554432000 4194304 4356188 140736281338992 18446744073709551615 4281736 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 35429.9
Current children cumulated vsize (KiB) 1972240

[startup+5082.3 s]
/proc/loadavg: 7.07 7.04 7.00 8/179 23174
/proc/meminfo: memFree=13238548/32950928 swapFree=67111528/67111528
[pid=23002] ppid=23000 vsize=18324 CPUtime=301.24 cores=0-7
/proc/23002/stat : 23002 (ppfolio) S 23000 23002 22976 0 -1 4202496 524 68653 0 0 0 0 30108 16 15 0 1 0 590473674 18763776 391 33554432000 4194304 4287625 140735272117936 18446744073709551615 218880585231 0 0 4096 65536 9224195742862639364 0 0 17 4 0 0 0
/proc/23002/statm: 4581 391 342 23 0 91 0
[pid=23004] ppid=23002 vsize=523372 CPUtime=5082.38 cores=1
/proc/23004/stat : 23004 (clasp) R 23002 23002 22976 0 -1 4202496 129784 0 0 0 508181 57 0 0 25 0 1 0 590473675 535932928 127554 33554432000 4194304 4785740 140736875445840 18446744073709551615 4287017 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/23004/statm: 130843 127554 340 145 0 127888 0
[pid=23005] ppid=23002 vsize=462428 CPUtime=5082.35 cores=2
/proc/23005/stat : 23005 (TNM) R 23002 23002 22976 0 -1 4202496 5477 0 0 0 508218 17 0 0 25 0 1 0 590473675 473526272 5373 33554432000 134512640 134534564 4289734864 18446744073709551615 134528661 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/23005/statm: 115607 5373 103 6 0 114273 0
[pid=23006] ppid=23002 vsize=514464 CPUtime=5082.4 cores=3
/proc/23006/stat : 23006 (march_hi) R 23002 23002 22976 0 -1 4202496 149641 0 0 0 508186 54 0 0 25 0 1 0 590473675 526811136 117243 33554432000 4194304 4331988 140735213260528 18446744073709551615 4299876 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/23006/statm: 128616 117243 177 34 0 127058 0
[pid=23007] ppid=23002 vsize=470168 CPUtime=20301.2 cores=4-7
/proc/23007/stat : 23007 (plingeling) S 23002 23002 22976 0 -1 4202496 683648 1253 0 0 2030011 105 0 0 18 0 5 0 590473675 481452032 89634 33554432000 4194304 4356188 140736281338992 18446744073709551615 218892367845 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/23007/statm: 117542 89634 163 40 0 116086 0
[pid=23007/tid=23014] ppid=23002 vsize=470168 CPUtime=5082.06 cores=4-7
/proc/23007/task/23014/stat : 23014 (plingeling) R 23002 23002 22976 0 -1 4202560 189095 1253 0 0 508179 27 0 0 25 0 5 0 590473693 481452032 89634 33554432000 4194304 4356188 140736281338992 18446744073709551615 4210544 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=23007/tid=23015] ppid=23002 vsize=470168 CPUtime=5082.21 cores=4-7
/proc/23007/task/23015/stat : 23015 (plingeling) R 23002 23002 22976 0 -1 4202560 216484 1253 0 0 508188 33 0 0 25 0 5 0 590473693 481452032 89634 33554432000 4194304 4356188 140736281338992 18446744073709551615 4332020 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=23007/tid=23016] ppid=23002 vsize=470168 CPUtime=5082.21 cores=4-7
/proc/23007/task/23016/stat : 23016 (plingeling) R 23002 23002 22976 0 -1 4202560 202529 1253 0 0 508190 31 0 0 25 0 5 0 590473693 481452032 89634 33554432000 4194304 4356188 140736281338992 18446744073709551615 4284205 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=23007/tid=23017] ppid=23002 vsize=470168 CPUtime=5054.45 cores=4-7
/proc/23007/task/23017/stat : 23017 (plingeling) R 23002 23002 22976 0 -1 4202560 66937 1253 0 0 505435 10 0 0 25 0 5 0 590473693 481452032 89634 33554432000 4194304 4356188 140736281338992 18446744073709551615 4210575 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 35849.5
Current children cumulated vsize (KiB) 1988756



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+5100 s]
/proc/loadavg: 7.05 7.04 7.00 8/179 23174
/proc/meminfo: memFree=13233320/32950928 swapFree=67111528/67111528
[pid=23002] ppid=23000 vsize=18324 CPUtime=301.24 cores=0-7
/proc/23002/stat : 23002 (ppfolio) S 23000 23002 22976 0 -1 4202496 524 68653 0 0 0 0 30108 16 15 0 1 0 590473674 18763776 391 33554432000 4194304 4287625 140735272117936 18446744073709551615 218880585231 0 0 4096 65536 9224195742862639364 0 0 17 4 0 0 0
/proc/23002/statm: 4581 391 342 23 0 91 0
[pid=23004] ppid=23002 vsize=523372 CPUtime=5100.09 cores=1
/proc/23004/stat : 23004 (clasp) R 23002 23002 22976 0 -1 4202496 129785 0 0 0 509952 57 0 0 25 0 1 0 590473675 535932928 127555 33554432000 4194304 4785740 140736875445840 18446744073709551615 4287028 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/23004/statm: 130843 127555 340 145 0 127888 0
[pid=23005] ppid=23002 vsize=462428 CPUtime=5100.06 cores=2
/proc/23005/stat : 23005 (TNM) R 23002 23002 22976 0 -1 4202496 5477 0 0 0 509989 17 0 0 25 0 1 0 590473675 473526272 5373 33554432000 134512640 134534564 4289734864 18446744073709551615 134528523 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/23005/statm: 115607 5373 103 6 0 114273 0
[pid=23006] ppid=23002 vsize=514596 CPUtime=5100.11 cores=3
/proc/23006/stat : 23006 (march_hi) R 23002 23002 22976 0 -1 4202496 149936 0 0 0 509957 54 0 0 25 0 1 0 590473675 526946304 117538 33554432000 4194304 4331988 140735213260528 18446744073709551615 4211509 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/23006/statm: 128649 117538 177 34 0 127091 0
[pid=23007] ppid=23002 vsize=474264 CPUtime=20371.9 cores=4-7
/proc/23007/stat : 23007 (plingeling) S 23002 23002 22976 0 -1 4202496 688768 1253 0 0 2037082 105 0 0 18 0 5 0 590473675 485646336 90658 33554432000 4194304 4356188 140736281338992 18446744073709551615 218892367845 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/23007/statm: 118566 90658 163 40 0 117110 0
[pid=23007/tid=23014] ppid=23002 vsize=474264 CPUtime=5099.77 cores=4-7
/proc/23007/task/23014/stat : 23014 (plingeling) R 23002 23002 22976 0 -1 4202560 189095 1253 0 0 509950 27 0 0 25 0 5 0 590473693 485646336 90658 33554432000 4194304 4356188 140736281338992 18446744073709551615 4283965 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=23007/tid=23015] ppid=23002 vsize=474264 CPUtime=5099.91 cores=4-7
/proc/23007/task/23015/stat : 23015 (plingeling) R 23002 23002 22976 0 -1 4202560 218532 1253 0 0 509958 33 0 0 25 0 5 0 590473693 485646336 90658 33554432000 4194304 4356188 140736281338992 18446744073709551615 4281495 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=23007/tid=23016] ppid=23002 vsize=474264 CPUtime=5099.92 cores=4-7
/proc/23007/task/23016/stat : 23016 (plingeling) R 23002 23002 22976 0 -1 4202560 205601 1253 0 0 509960 32 0 0 25 0 5 0 590473693 485646336 90658 33554432000 4194304 4356188 140736281338992 18446744073709551615 4331383 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=23007/tid=23017] ppid=23002 vsize=474264 CPUtime=5072.06 cores=4-7
/proc/23007/task/23017/stat : 23017 (plingeling) R 23002 23002 22976 0 -1 4202560 66937 1253 0 0 507196 10 0 0 25 0 5 0 590473693 485646336 90658 33554432000 4194304 4356188 140736281338992 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 35973.4
Current children cumulated vsize (KiB) 1992984

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 23002 and gives
#  childrusage.ru_utime.tv_sec=5400
#  childrusage.ru_utime.tv_usec=977926
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=344947
# CPU time returned by wait4() is 5401.32
# while last known CPU time is 35973.4
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 5100.02
CPU time (s): 35973.4
CPU user time (s): 35970.9
CPU system time (s): 2.49
CPU usage (%): 705.358
Max. virtual memory (cumulated for all children) (KiB): 19203884

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 5400.98
system time used= 0.344947
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 74654
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 339
involuntary context switches= 14466

runsolver used 8.65668 second user time and 19.1711 second system time

The end

Launcher Data 

Begin job on node112 at 2011-04-28 16:53:50
IDJOB=3310166
IDBENCH=70817
IDSOLVER=1638
FILE ID=node112/3310166-1304002430
RUNJOBID= node112-1304002430-22990
PBS_JOBID= 13168792
Free space on /tmp= 72564 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT09/APPLICATIONS/bitverif/maxxor/maxxor064.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3310166-1304002430/watcher-3310166-1304002430 -o /tmp/evaluation-result-3310166-1304002430/solver-3310166-1304002430 -C 40000 -W 5100 -M 31000  ppfolio HOME/instance-3310166-1304002430.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 902b28046d424b16042ca612ddad48e0
RANDOM SEED=1549519407

node112.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5261.27
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.93
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      14596420 kB
Buffers:       1992048 kB
Cached:       15741204 kB
SwapCached:          0 kB
Active:        6791152 kB
Inactive:     11006768 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      14596420 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:           12500 kB
Writeback:           0 kB
AnonPages:       64384 kB
Mapped:          14488 kB
Slab:           491960 kB
PageTables:       5000 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   181172 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72552 MiB
End job on node112 at 2011-04-28 18:18:52