Trace number 3275051

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio par? (TO) 40000.4 5004.72

General information on the benchmark

NameCRAFTED/rbsat/random/
forced/rbsat-v2400c266431gyes7.cnf
MD5SUM92e61742efd2e322c59b4442206bebf1
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables2400
Number of clauses266431
Sum of the clauses size535112
Maximum clause length32
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 2266356
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 575

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 8 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	[5] plingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 0
0.00/0.00	Starting clasp 1.3.6 on core(s) 1
0.00/0.00	Starting TNM 2009 on core(s) 2
0.00/0.00	Starting march_hi 2009 on core(s) 3
0.00/0.00	Starting plingeling 276-6264d55-100731 on core(s) 4 5 6 7

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3275051-1304145123/watcher-3275051-1304145123 -o /tmp/evaluation-result-3275051-1304145123/solver-3275051-1304145123 -C 40000 -W 5100 -M 31000 ppfolio HOME/instance-3275051-1304145123.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.29 3.38 3.89 2/168 18677
/proc/meminfo: memFree=30936272/32951132 swapFree=67111364/67111528
[pid=18677] ppid=18675 vsize=18240 CPUtime=0 cores=0-7
/proc/18677/stat : 18677 (ppfolio) R 18675 18677 18651 0 -1 4194304 264 0 2 0 0 0 0 0 25 0 1 0 526110960 18677760 214 33554432000 4194304 4287625 140736289430064 18446744073709551615 242965587432 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/18677/statm: 4560 214 181 23 0 57 0

[startup+0.107139 s]
/proc/loadavg: 2.29 3.38 3.89 2/168 18677
/proc/meminfo: memFree=30936272/32951132 swapFree=67111364/67111528
[pid=18677] ppid=18675 vsize=18324 CPUtime=0 cores=0-7
/proc/18677/stat : 18677 (ppfolio) S 18675 18677 18651 0 -1 4202496 517 0 2 0 0 0 0 0 25 0 1 0 526110960 18763776 389 33554432000 4194304 4287625 140736289430064 18446744073709551615 242970570255 0 0 4096 65536 11367050554283917311 0 0 17 4 0 0 0
/proc/18677/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.20061 s]
/proc/loadavg: 2.29 3.38 3.89 2/168 18677
/proc/meminfo: memFree=30936272/32951132 swapFree=67111364/67111528
[pid=18677] ppid=18675 vsize=18324 CPUtime=0 cores=0-7
/proc/18677/stat : 18677 (ppfolio) S 18675 18677 18651 0 -1 4202496 517 0 2 0 0 0 0 0 24 0 1 0 526110960 18763776 389 33554432000 4194304 4287625 140736289430064 18446744073709551615 242970570255 0 0 4096 65536 11367050554283917311 0 0 17 4 0 0 0
/proc/18677/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.300591 s]
/proc/loadavg: 2.29 3.38 3.89 2/168 18677
/proc/meminfo: memFree=30936272/32951132 swapFree=67111364/67111528
[pid=18677] ppid=18675 vsize=18324 CPUtime=0 cores=0-7
/proc/18677/stat : 18677 (ppfolio) S 18675 18677 18651 0 -1 4202496 517 0 2 0 0 0 0 0 24 0 1 0 526110960 18763776 389 33554432000 4194304 4287625 140736289430064 18446744073709551615 242970570255 0 0 4096 65536 11367050554283917311 0 0 17 4 0 0 0
/proc/18677/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.700491 s]
/proc/loadavg: 2.29 3.38 3.89 2/168 18677
/proc/meminfo: memFree=30936272/32951132 swapFree=67111364/67111528
[pid=18677] ppid=18675 vsize=18324 CPUtime=0 cores=0-7
/proc/18677/stat : 18677 (ppfolio) S 18675 18677 18651 0 -1 4202496 517 0 2 0 0 0 0 0 19 0 1 0 526110960 18763776 389 33554432000 4194304 4287625 140736289430064 18446744073709551615 242970570255 0 0 4096 65536 11367050554283917311 0 0 17 4 0 0 0
/proc/18677/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50135 s]
/proc/loadavg: 2.29 3.38 3.89 9/178 18692
/proc/meminfo: memFree=30789180/32951132 swapFree=67111364/67111528
[pid=18677] ppid=18675 vsize=18324 CPUtime=0 cores=0-7
/proc/18677/stat : 18677 (ppfolio) S 18675 18677 18651 0 -1 4202496 517 0 2 0 0 0 0 0 15 0 1 0 526110960 18763776 389 33554432000 4194304 4287625 140736289430064 18446744073709551615 242970570255 0 0 4096 65536 11367050554283917311 0 0 17 4 0 0 0
/proc/18677/statm: 4581 389 341 23 0 91 0
[pid=18679] ppid=18677 vsize=66268 CPUtime=1.48 cores=0
/proc/18679/stat : 18679 (cryptominisat) R 18677 18677 18651 0 -1 4202496 17210 0 0 0 146 2 0 0 25 0 1 0 526110961 67858432 11291 33554432000 4194304 4587354 140734481947904 18446744073709551615 4238616 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/18679/statm: 16567 11291 326 96 0 13129 0
[pid=18680] ppid=18677 vsize=30008 CPUtime=1.49 cores=1
/proc/18680/stat : 18680 (clasp) R 18677 18677 18651 0 -1 4202496 6576 0 0 0 148 1 0 0 20 0 1 0 526110961 30728192 4775 33554432000 4194304 4785740 140733849986816 18446744073709551615 4545847 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/18680/statm: 7502 4775 322 145 0 4547 0
[pid=18681] ppid=18677 vsize=464404 CPUtime=1.09 cores=2
/proc/18681/stat : 18681 (TNM) R 18677 18677 18651 0 -1 4202496 4411 0 10 0 109 0 0 0 25 0 1 0 526110961 475549696 4318 33554432000 134512640 134534564 4288039936 18446744073709551615 134524544 0 0 4096 0 0 0 0 17 2 0 0 39
/proc/18681/statm: 116101 4318 91 6 0 114767 0
[pid=18682] ppid=18677 vsize=43384 CPUtime=1.48 cores=3
/proc/18682/stat : 18682 (march_hi) R 18677 18677 18651 0 -1 4202496 20254 0 0 0 145 3 0 0 20 0 1 0 526110961 44425216 4839 33554432000 4194304 4331988 140735560759632 18446744073709551615 4226184 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/18682/statm: 10846 4839 175 34 0 9288 0
[pid=18683] ppid=18677 vsize=161764 CPUtime=4.36 cores=4-7
/proc/18683/stat : 18683 (plingeling) S 18677 18677 18651 0 -1 4202496 16961 1249 0 0 432 4 0 0 18 0 5 0 526110961 165646336 12625 33554432000 4194304 4356188 140735221808624 18446744073709551615 242982352869 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/18683/statm: 40441 12625 162 40 0 38985 0
[pid=18683/tid=18689] ppid=18677 vsize=161764 CPUtime=1.02 cores=4-7
/proc/18683/task/18689/stat : 18689 (plingeling) R 18677 18677 18651 0 -1 4202560 2209 1249 0 0 102 0 0 0 19 0 5 0 526111007 165646336 12625 33554432000 4194304 4356188 140735221808624 18446744073709551615 4211178 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=18683/tid=18690] ppid=18677 vsize=161764 CPUtime=0.99 cores=4-7
/proc/18683/task/18690/stat : 18690 (plingeling) R 18677 18677 18651 0 -1 4202560 1638 1249 0 0 99 0 0 0 23 0 5 0 526111007 165646336 12625 33554432000 4194304 4356188 140735221808624 18446744073709551615 4271251 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=18683/tid=18691] ppid=18677 vsize=161764 CPUtime=1.01 cores=4-7
/proc/18683/task/18691/stat : 18691 (plingeling) R 18677 18677 18651 0 -1 4202560 2287 1249 0 0 101 0 0 0 25 0 5 0 526111007 165646336 12625 33554432000 4194304 4356188 140735221808624 18446744073709551615 4270848 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=18683/tid=18692] ppid=18677 vsize=161764 CPUtime=1.02 cores=4-7
/proc/18683/task/18692/stat : 18692 (plingeling) R 18677 18677 18651 0 -1 4202560 2016 1249 0 0 102 0 0 0 22 0 5 0 526111007 165646336 12625 33554432000 4194304 4356188 140735221808624 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 9.9
Current children cumulated vsize (KiB) 784152

[startup+3.10108 s]
/proc/loadavg: 2.29 3.38 3.89 10/178 18692
/proc/meminfo: memFree=30772692/32951132 swapFree=67111364/67111528
[pid=18677] ppid=18675 vsize=18324 CPUtime=0 cores=0-7
/proc/18677/stat : 18677 (ppfolio) S 18675 18677 18651 0 -1 4202496 517 0 2 0 0 0 0 0 15 0 1 0 526110960 18763776 389 33554432000 4194304 4287625 140736289430064 18446744073709551615 242970570255 0 0 4096 65536 11367050554283917311 0 0 17 3 0 0 0
/proc/18677/statm: 4581 389 341 23 0 91 0
[pid=18679] ppid=18677 vsize=2143416 CPUtime=3.08 cores=0
/proc/18679/stat : 18679 (cryptominisat) R 18677 18677 18651 0 -1 4202496 19105 0 0 0 306 2 0 0 25 0 1 0 526110961 2194857984 11634 33554432000 4194304 4587354 140734481947904 18446744073709551615 4244129 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/18679/statm: 535854 11634 331 96 0 532416 0
[pid=18680] ppid=18677 vsize=30008 CPUtime=3.08 cores=1
/proc/18680/stat : 18680 (clasp) R 18677 18677 18651 0 -1 4202496 6594 0 0 0 307 1 0 0 25 0 1 0 526110961 30728192 4793 33554432000 4194304 4785740 140733849986816 18446744073709551615 4548911 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/18680/statm: 7502 4793 340 145 0 4547 0
[pid=18681] ppid=18677 vsize=470216 CPUtime=2.65 cores=2
/proc/18681/stat : 18681 (TNM) R 18677 18677 18651 0 -1 4202496 6319 0 11 0 264 1 0 0 25 0 1 0 526110961 481501184 6227 33554432000 134512640 134534564 4288039936 18446744073709551615 134530820 0 0 4096 0 0 0 0 17 2 0 0 43
/proc/18681/statm: 117554 6227 95 6 0 116220 0
[pid=18682] ppid=18677 vsize=43792 CPUtime=3.08 cores=3
/proc/18682/stat : 18682 (march_hi) R 18677 18677 18651 0 -1 4202496 20344 0 0 0 305 3 0 0 25 0 1 0 526110961 44843008 4929 33554432000 4194304 4331988 140735560759632 18446744073709551615 242970247360 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/18682/statm: 10948 4929 175 34 0 9390 0
[pid=18683] ppid=18677 vsize=167652 CPUtime=9.86 cores=4-7
/proc/18683/stat : 18683 (plingeling) S 18677 18677 18651 0 -1 4202496 18433 1249 0 0 978 8 0 0 18 0 5 0 526110961 171675648 14097 33554432000 4194304 4356188 140735221808624 18446744073709551615 242982352869 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/18683/statm: 41913 14097 162 40 0 40457 0
[pid=18683/tid=18689] ppid=18677 vsize=167652 CPUtime=2.62 cores=4-7
/proc/18683/task/18689/stat : 18689 (plingeling) R 18677 18677 18651 0 -1 4202560 2209 1249 0 0 262 0 0 0 23 0 5 0 526111007 171675648 14097 33554432000 4194304 4356188 140735221808624 18446744073709551615 4331319 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=18683/tid=18690] ppid=18677 vsize=167652 CPUtime=2.59 cores=4-7
/proc/18683/task/18690/stat : 18690 (plingeling) R 18677 18677 18651 0 -1 4202560 1926 1249 0 0 259 0 0 0 25 0 5 0 526111007 171675648 14097 33554432000 4194304 4356188 140735221808624 18446744073709551615 4331264 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=18683/tid=18691] ppid=18677 vsize=167652 CPUtime=2.1 cores=4-7
/proc/18683/task/18691/stat : 18691 (plingeling) R 18677 18677 18651 0 -1 4202560 2574 1249 0 0 210 0 0 0 25 0 5 0 526111007 171675648 14097 33554432000 4194304 4356188 140735221808624 18446744073709551615 4331799 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=18683/tid=18692] ppid=18677 vsize=167652 CPUtime=2.22 cores=4-7
/proc/18683/task/18692/stat : 18692 (plingeling) R 18677 18677 18651 0 -1 4202560 2913 1249 0 0 219 3 0 0 25 0 5 0 526111007 171675648 14097 33554432000 4194304 4356188 140735221808624 18446744073709551615 4210834 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 21.75
Current children cumulated vsize (KiB) 2873408

[startup+6.30053 s]
/proc/loadavg: 3.07 3.53 3.93 9/178 18692
/proc/meminfo: memFree=30750708/32951132 swapFree=67111364/67111528
[pid=18677] ppid=18675 vsize=18324 CPUtime=0 cores=0-7
/proc/18677/stat : 18677 (ppfolio) S 18675 18677 18651 0 -1 4202496 517 0 2 0 0 0 0 0 15 0 1 0 526110960 18763776 389 33554432000 4194304 4287625 140736289430064 18446744073709551615 242970570255 0 0 4096 65536 11367050554283917311 0 0 17 3 0 0 0
/proc/18677/statm: 4581 389 341 23 0 91 0
[pid=18679] ppid=18677 vsize=2156788 CPUtime=6.29 cores=0
/proc/18679/stat : 18679 (cryptominisat) R 18677 18677 18651 0 -1 4202496 21397 0 0 0 626 3 0 0 25 0 1 0 526110961 2208550912 13924 33554432000 4194304 4587354 140734481947904 18446744073709551615 4364704 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/18679/statm: 539197 13924 337 96 0 535759 0
[pid=18680] ppid=18677 vsize=39372 CPUtime=6.28 cores=1
/proc/18680/stat : 18680 (clasp) R 18677 18677 18651 0 -1 4202496 8974 0 0 0 627 1 0 0 25 0 1 0 526110961 40316928 7173 33554432000 4194304 4785740 140733849986816 18446744073709551615 4286953 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/18680/statm: 9843 7173 340 145 0 6888 0
[pid=18681] ppid=18677 vsize=470216 CPUtime=5.85 cores=2
/proc/18681/stat : 18681 (TNM) R 18677 18677 18651 0 -1 4202496 6319 0 11 0 584 1 0 0 25 0 1 0 526110961 481501184 6227 33554432000 134512640 134534564 4288039936 18446744073709551615 134530551 0 0 4096 0 0 0 0 17 2 0 0 43
/proc/18681/statm: 117554 6227 95 6 0 116220 0
[pid=18682] ppid=18677 vsize=44188 CPUtime=6.28 cores=3
/proc/18682/stat : 18682 (march_hi) R 18677 18677 18651 0 -1 4202496 20442 0 0 0 625 3 0 0 25 0 1 0 526110961 45248512 5027 33554432000 4194304 4331988 140735560759632 18446744073709551615 4210502 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/18682/statm: 11047 5027 175 34 0 9489 0
[pid=18683] ppid=18677 vsize=181732 CPUtime=20.03 cores=4-7
/proc/18683/stat : 18683 (plingeling) S 18677 18677 18651 0 -1 4202496 21442 1249 0 0 1975 28 0 0 18 0 5 0 526110961 186093568 17106 33554432000 4194304 4356188 140735221808624 18446744073709551615 242982352869 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/18683/statm: 45433 17106 162 40 0 43977 0
[pid=18683/tid=18689] ppid=18677 vsize=181732 CPUtime=5.82 cores=4-7
/proc/18683/task/18689/stat : 18689 (plingeling) R 18677 18677 18651 0 -1 4202560 3490 1249 0 0 582 0 0 0 25 0 5 0 526111007 186093568 17106 33554432000 4194304 4356188 140735221808624 18446744073709551615 4210544 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=18683/tid=18690] ppid=18677 vsize=181732 CPUtime=4.62 cores=4-7
/proc/18683/task/18690/stat : 18690 (plingeling) R 18677 18677 18651 0 -1 4202560 2310 1249 0 0 451 11 0 0 25 0 5 0 526111007 186093568 17106 33554432000 4194304 4356188 140735221808624 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=18683/tid=18691] ppid=18677 vsize=181732 CPUtime=5.29 cores=4-7
/proc/18683/task/18691/stat : 18691 (plingeling) R 18677 18677 18651 0 -1 4202560 3918 1249 0 0 529 0 0 0 25 0 5 0 526111007 186093568 17106 33554432000 4194304 4356188 140735221808624 18446744073709551615 4286773 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=18683/tid=18692] ppid=18677 vsize=181732 CPUtime=3.98 cores=4-7
/proc/18683/task/18692/stat : 18692 (plingeling) R 18677 18677 18651 0 -1 4202560 2913 1249 0 0 386 12 0 0 25 0 5 0 526111007 186093568 17106 33554432000 4194304 4356188 140735221808624 18446744073709551615 4331060 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 44.73
Current children cumulated vsize (KiB) 2910620

[startup+12.7014 s]
/proc/loadavg: 3.47 3.60 3.95 9/178 18692
/proc/meminfo: memFree=30708524/32951132 swapFree=67111364/67111528
[pid=18677] ppid=18675 vsize=18324 CPUtime=0 cores=0-7
/proc/18677/stat : 18677 (ppfolio) S 18675 18677 18651 0 -1 4202496 517 0 2 0 0 0 0 0 15 0 1 0 526110960 18763776 389 33554432000 4194304 4287625 140736289430064 18446744073709551615 242970570255 0 0 4096 65536 11367050554283917311 0 0 17 3 0 0 0
/proc/18677/statm: 4581 389 341 23 0 91 0
[pid=18679] ppid=18677 vsize=2158004 CPUtime=12.68 cores=0
/proc/18679/stat : 18679 (cryptominisat) R 18677 18677 18651 0 -1 4202496 26682 0 0 0 1265 3 0 0 25 0 1 0 526110961 2209796096 15557 33554432000 4194304 4587354 140734481947904 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/18679/statm: 539501 15557 337 96 0 536063 0
[pid=18680] ppid=18677 vsize=56800 CPUtime=12.66 cores=1
/proc/18680/stat : 18680 (clasp) R 18677 18677 18651 0 -1 4202496 13265 0 0 0 1258 8 0 0 25 0 1 0 526110961 58163200 11464 33554432000 4194304 4785740 140733849986816 18446744073709551615 4287050 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/18680/statm: 14200 11464 340 145 0 11245 0
[pid=18681] ppid=18677 vsize=470216 CPUtime=12.25 cores=2
/proc/18681/stat : 18681 (TNM) R 18677 18677 18651 0 -1 4202496 6319 0 11 0 1224 1 0 0 25 0 1 0 526110961 481501184 6227 33554432000 134512640 134534564 4288039936 18446744073709551615 134530741 0 0 4096 0 0 0 0 17 2 0 0 43
/proc/18681/statm: 117554 6227 95 6 0 116220 0
[pid=18682] ppid=18677 vsize=45028 CPUtime=12.68 cores=3
/proc/18682/stat : 18682 (march_hi) R 18677 18677 18651 0 -1 4202496 20637 0 0 0 1265 3 0 0 25 0 1 0 526110961 46108672 5220 33554432000 4194304 4331988 140735560759632 18446744073709551615 4226530 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/18682/statm: 11257 5220 175 34 0 9699 0
[pid=18683] ppid=18677 vsize=192472 CPUtime=45.59 cores=4-7
/proc/18683/stat : 18683 (plingeling) S 18677 18677 18651 0 -1 4202496 24638 1249 0 0 4530 29 0 0 18 0 5 0 526110961 197091328 20302 33554432000 4194304 4356188 140735221808624 18446744073709551615 242982352869 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/18683/statm: 48118 20302 162 40 0 46662 0
[pid=18683/tid=18689] ppid=18677 vsize=192472 CPUtime=12.22 cores=4-7
/proc/18683/task/18689/stat : 18689 (plingeling) R 18677 18677 18651 0 -1 4202560 4262 1249 0 0 1222 0 0 0 25 0 5 0 526111007 197091328 20302 33554432000 4194304 4356188 140735221808624 18446744073709551615 4284231 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=18683/tid=18690] ppid=18677 vsize=192472 CPUtime=11.02 cores=4-7
/proc/18683/task/18690/stat : 18690 (plingeling) R 18677 18677 18651 0 -1 4202560 2950 1249 0 0 1090 12 0 0 25 0 5 0 526111007 197091328 20302 33554432000 4194304 4356188 140735221808624 18446744073709551615 4336063 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=18683/tid=18691] ppid=18677 vsize=192472 CPUtime=11.68 cores=4-7
/proc/18683/task/18691/stat : 18691 (plingeling) R 18677 18677 18651 0 -1 4202560 4311 1249 0 0 1168 0 0 0 25 0 5 0 526111007 197091328 20302 33554432000 4194304 4356188 140735221808624 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=18683/tid=18692] ppid=18677 vsize=192472 CPUtime=10.34 cores=4-7
/proc/18683/task/18692/stat : 18692 (plingeling) R 18677 18677 18651 0 -1 4202560 4304 1249 0 0 1022 12 0 0 25 0 5 0 526111007 197091328 20302 33554432000 4194304 4356188 140735221808624 18446744073709551615 4279490 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 95.86
Current children cumulated vsize (KiB) 2940844

[startup+25.5012 s]
/proc/loadavg: 4.47 3.81 4.01 9/178 18693
/proc/meminfo: memFree=30647040/32951132 swapFree=67111364/67111528
[pid=18677] ppid=18675 vsize=18324 CPUtime=0 cores=0-7
/proc/18677/stat : 18677 (ppfolio) S 18675 18677 18651 0 -1 4202496 517 0 2 0 0 0 0 0 15 0 1 0 526110960 18763776 389 33554432000 4194304 4287625 140736289430064 18446744073709551615 242970570255 0 0 4096 65536 11367050554283917311 0 0 17 3 0 0 0
/proc/18677/statm: 4581 389 341 23 0 91 0
[pid=18679] ppid=18677 vsize=2145188 CPUtime=25.48 cores=0
/proc/18679/stat : 18679 (cryptominisat) R 18677 18677 18651 0 -1 4202496 34370 0 0 0 2543 5 0 0 25 0 1 0 526110961 2196672512 18124 33554432000 4194304 4587354 140734481947904 18446744073709551615 4239304 0 0 4096 2 0 0 0 17 0 0 0 0

################
# More data... #
################

[pid=18681] ppid=18677 vsize=470216 CPUtime=4781.2 cores=2
/proc/18681/stat : 18681 (TNM) R 18677 18677 18651 0 -1 4202496 6319 0 11 0 478119 1 0 0 25 0 1 0 526110961 481501184 6227 33554432000 134512640 134534564 4288039936 18446744073709551615 134530353 0 0 4096 0 0 0 0 17 2 0 0 43
/proc/18681/statm: 117554 6227 95 6 0 116220 0
[pid=18682] ppid=18677 vsize=461036 CPUtime=4782.08 cores=3
/proc/18682/stat : 18682 (march_hi) R 18677 18677 18651 0 -1 4202496 91493 0 0 0 478154 54 0 0 25 0 1 0 526110961 472100864 75058 33554432000 4194304 4331988 140735560759632 18446744073709551615 4228235 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/18682/statm: 115259 75058 175 34 0 113701 0
[pid=18683] ppid=18677 vsize=532904 CPUtime=19094.5 cores=4-7
/proc/18683/stat : 18683 (plingeling) S 18677 18677 18651 0 -1 4202496 2908850 1249 0 0 1908939 508 0 0 18 0 5 0 526110961 545693696 105410 33554432000 4194304 4356188 140735221808624 18446744073709551615 242982352869 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/18683/statm: 133226 105410 162 40 0 131770 0
[pid=18683/tid=18689] ppid=18677 vsize=532904 CPUtime=4781.9 cores=4-7
/proc/18683/task/18689/stat : 18689 (plingeling) R 18677 18677 18651 0 -1 4202560 807087 1249 0 0 478083 107 0 0 25 0 5 0 526111007 545693696 105410 33554432000 4194304 4356188 140735221808624 18446744073709551615 4298515 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=18683/tid=18690] ppid=18677 vsize=532904 CPUtime=4778.41 cores=4-7
/proc/18683/task/18690/stat : 18690 (plingeling) R 18677 18677 18651 0 -1 4202560 677132 1249 0 0 477699 142 0 0 25 0 5 0 526111007 545693696 105410 33554432000 4194304 4356188 140735221808624 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=18683/tid=18691] ppid=18677 vsize=532904 CPUtime=4758.77 cores=4-7
/proc/18683/task/18691/stat : 18691 (plingeling) R 18677 18677 18651 0 -1 4202560 810461 1249 0 0 475755 122 0 0 25 0 5 0 526111007 545693696 105410 33554432000 4194304 4356188 140735221808624 18446744073709551615 4279575 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=18683/tid=18692] ppid=18677 vsize=532904 CPUtime=4775.07 cores=4-7
/proc/18683/task/18692/stat : 18692 (plingeling) R 18677 18677 18651 0 -1 4202560 605359 1249 0 0 477374 133 0 0 25 0 5 0 526111007 545693696 105410 33554432000 4194304 4356188 140735221808624 18446744073709551615 4331060 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 38222.5
Current children cumulated vsize (KiB) 4263268

[startup+4842.31 s]
/proc/loadavg: 8.11 8.04 7.97 9/178 18833
/proc/meminfo: memFree=29450692/32951132 swapFree=67111364/67111528
[pid=18677] ppid=18675 vsize=18324 CPUtime=0 cores=0-7
/proc/18677/stat : 18677 (ppfolio) S 18675 18677 18651 0 -1 4202496 517 0 2 0 0 0 0 0 15 0 1 0 526110960 18763776 389 33554432000 4194304 4287625 140736289430064 18446744073709551615 242970570255 0 0 4096 65536 11367050554283917311 0 0 17 3 0 0 0
/proc/18677/statm: 4581 389 341 23 0 91 0
[pid=18679] ppid=18677 vsize=2454948 CPUtime=4842.38 cores=0
/proc/18679/stat : 18679 (cryptominisat) R 18677 18677 18651 0 -1 4202496 1268335 0 0 0 483676 562 0 0 25 0 1 0 526110961 2513866752 94175 33554432000 4194304 4587354 140734481947904 18446744073709551615 4237677 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/18679/statm: 613737 94175 337 96 0 610299 0
[pid=18680] ppid=18677 vsize=349676 CPUtime=4842.34 cores=1
/proc/18680/stat : 18680 (clasp) R 18677 18677 18651 0 -1 4202496 82518 0 0 0 484199 35 0 0 25 0 1 0 526110961 358068224 80717 33554432000 4194304 4785740 140733849986816 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/18680/statm: 87419 80717 340 145 0 84464 0
[pid=18681] ppid=18677 vsize=470216 CPUtime=4841.19 cores=2
/proc/18681/stat : 18681 (TNM) R 18677 18677 18651 0 -1 4202496 6319 0 11 0 484118 1 0 0 25 0 1 0 526110961 481501184 6227 33554432000 134512640 134534564 4288039936 18446744073709551615 134528295 0 0 4096 0 0 0 0 17 2 0 0 43
/proc/18681/statm: 117554 6227 95 6 0 116220 0
[pid=18682] ppid=18677 vsize=461036 CPUtime=4842.09 cores=3
/proc/18682/stat : 18682 (march_hi) R 18677 18677 18651 0 -1 4202496 92364 0 0 0 484154 55 0 0 25 0 1 0 526110961 472100864 75929 33554432000 4194304 4331988 140735560759632 18446744073709551615 4228235 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/18682/statm: 115259 75929 175 34 0 113701 0
[pid=18683] ppid=18677 vsize=567724 CPUtime=19334.1 cores=4-7
/proc/18683/stat : 18683 (plingeling) S 18677 18677 18651 0 -1 4202496 2959539 1249 0 0 1932900 514 0 0 18 0 5 0 526110961 581349376 114115 33554432000 4194304 4356188 140735221808624 18446744073709551615 242982352869 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/18683/statm: 141931 114115 162 40 0 140475 0
[pid=18683/tid=18689] ppid=18677 vsize=567724 CPUtime=4841.9 cores=4-7
/proc/18683/task/18689/stat : 18689 (plingeling) R 18677 18677 18651 0 -1 4202560 819887 1249 0 0 484082 108 0 0 25 0 5 0 526111007 581349376 114115 33554432000 4194304 4356188 140735221808624 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=18683/tid=18690] ppid=18677 vsize=567724 CPUtime=4838.38 cores=4-7
/proc/18683/task/18690/stat : 18690 (plingeling) R 18677 18677 18651 0 -1 4202560 688397 1249 0 0 483695 143 0 0 25 0 5 0 526111007 581349376 114115 33554432000 4194304 4356188 140735221808624 18446744073709551615 4332109 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=18683/tid=18691] ppid=18677 vsize=567724 CPUtime=4818.45 cores=4-7
/proc/18683/task/18691/stat : 18691 (plingeling) R 18677 18677 18651 0 -1 4202560 824797 1249 0 0 481721 124 0 0 25 0 5 0 526111007 581349376 114115 33554432000 4194304 4356188 140735221808624 18446744073709551615 4331276 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=18683/tid=18692] ppid=18677 vsize=567724 CPUtime=4835.08 cores=4-7
/proc/18683/task/18692/stat : 18692 (plingeling) R 18677 18677 18651 0 -1 4202560 617647 1249 0 0 483374 134 0 0 25 0 5 0 526111007 581349376 114115 33554432000 4194304 4356188 140735221808624 18446744073709551615 4332573 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 38702.1
Current children cumulated vsize (KiB) 4321924

[startup+4902.3 s]
/proc/loadavg: 8.11 8.04 7.97 9/178 18835
/proc/meminfo: memFree=29462944/32951132 swapFree=67111364/67111528
[pid=18677] ppid=18675 vsize=18324 CPUtime=0 cores=0-7
/proc/18677/stat : 18677 (ppfolio) S 18675 18677 18651 0 -1 4202496 517 0 2 0 0 0 0 0 15 0 1 0 526110960 18763776 389 33554432000 4194304 4287625 140736289430064 18446744073709551615 242970570255 0 0 4096 65536 11367050554283917311 0 0 17 3 0 0 0
/proc/18677/statm: 4581 389 341 23 0 91 0
[pid=18679] ppid=18677 vsize=2444736 CPUtime=4902.38 cores=0
/proc/18679/stat : 18679 (cryptominisat) R 18677 18677 18651 0 -1 4202496 1281510 0 0 0 489669 569 0 0 25 0 1 0 526110961 2503409664 85822 33554432000 4194304 4587354 140734481947904 18446744073709551615 4239240 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/18679/statm: 611184 85822 337 96 0 607746 0
[pid=18680] ppid=18677 vsize=351828 CPUtime=4902.34 cores=1
/proc/18680/stat : 18680 (clasp) R 18677 18677 18651 0 -1 4202496 82936 0 0 0 490199 35 0 0 25 0 1 0 526110961 360271872 81135 33554432000 4194304 4785740 140733849986816 18446744073709551615 4286941 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/18680/statm: 87957 81135 340 145 0 85002 0
[pid=18681] ppid=18677 vsize=470216 CPUtime=4901.17 cores=2
/proc/18681/stat : 18681 (TNM) R 18677 18677 18651 0 -1 4202496 6319 0 11 0 490116 1 0 0 25 0 1 0 526110961 481501184 6227 33554432000 134512640 134534564 4288039936 18446744073709551615 134528979 0 0 4096 0 0 0 0 17 2 0 0 43
/proc/18681/statm: 117554 6227 95 6 0 116220 0
[pid=18682] ppid=18677 vsize=461036 CPUtime=4902.09 cores=3
/proc/18682/stat : 18682 (march_hi) R 18677 18677 18651 0 -1 4202496 93276 0 0 0 490153 56 0 0 25 0 1 0 526110961 472100864 76841 33554432000 4194304 4331988 140735560759632 18446744073709551615 4228224 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/18682/statm: 115259 76841 175 34 0 113701 0
[pid=18683] ppid=18677 vsize=582060 CPUtime=19573.8 cores=4-7
/proc/18683/stat : 18683 (plingeling) S 18677 18677 18651 0 -1 4202496 3010739 1249 0 0 1956854 522 0 0 18 0 5 0 526110961 596029440 117699 33554432000 4194304 4356188 140735221808624 18446744073709551615 242982352869 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/18683/statm: 145515 117699 162 40 0 144059 0
[pid=18683/tid=18689] ppid=18677 vsize=582060 CPUtime=4901.9 cores=4-7
/proc/18683/task/18689/stat : 18689 (plingeling) R 18677 18677 18651 0 -1 4202560 831151 1249 0 0 490080 110 0 0 25 0 5 0 526111007 596029440 117699 33554432000 4194304 4356188 140735221808624 18446744073709551615 4331350 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=18683/tid=18690] ppid=18677 vsize=582060 CPUtime=4898.35 cores=4-7
/proc/18683/task/18690/stat : 18690 (plingeling) R 18677 18677 18651 0 -1 4202560 697613 1249 0 0 489689 146 0 0 25 0 5 0 526111007 596029440 117699 33554432000 4194304 4356188 140735221808624 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=18683/tid=18691] ppid=18677 vsize=582060 CPUtime=4878.12 cores=4-7
/proc/18683/task/18691/stat : 18691 (plingeling) R 18677 18677 18651 0 -1 4202560 842205 1249 0 0 487686 126 0 0 25 0 5 0 526111007 596029440 117699 33554432000 4194304 4356188 140735221808624 18446744073709551615 4331305 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=18683/tid=18692] ppid=18677 vsize=582060 CPUtime=4895.07 cores=4-7
/proc/18683/task/18692/stat : 18692 (plingeling) R 18677 18677 18651 0 -1 4202560 630959 1249 0 0 489371 136 0 0 25 0 5 0 526111007 596029440 117699 33554432000 4194304 4356188 140735221808624 18446744073709551615 4331296 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 39181.7
Current children cumulated vsize (KiB) 4328200

[startup+4962.3 s]
/proc/loadavg: 8.04 8.03 7.97 9/178 18836
/proc/meminfo: memFree=29387660/32951132 swapFree=67111364/67111528
[pid=18677] ppid=18675 vsize=18324 CPUtime=0 cores=0-7
/proc/18677/stat : 18677 (ppfolio) S 18675 18677 18651 0 -1 4202496 517 0 2 0 0 0 0 0 15 0 1 0 526110960 18763776 389 33554432000 4194304 4287625 140736289430064 18446744073709551615 242970570255 0 0 4096 65536 11367050554283917311 0 0 17 3 0 0 0
/proc/18677/statm: 4581 389 341 23 0 91 0
[pid=18679] ppid=18677 vsize=2457700 CPUtime=4962.38 cores=0
/proc/18679/stat : 18679 (cryptominisat) R 18677 18677 18651 0 -1 4202496 1294563 0 0 0 495663 575 0 0 25 0 1 0 526110961 2516684800 88052 33554432000 4194304 4587354 140734481947904 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/18679/statm: 614425 88052 337 96 0 610987 0
[pid=18680] ppid=18677 vsize=355224 CPUtime=4962.34 cores=1
/proc/18680/stat : 18680 (clasp) R 18677 18677 18651 0 -1 4202496 83726 0 0 0 496199 35 0 0 25 0 1 0 526110961 363749376 81925 33554432000 4194304 4785740 140733849986816 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/18680/statm: 88806 81925 340 145 0 85851 0
[pid=18681] ppid=18677 vsize=470216 CPUtime=4961.16 cores=2
/proc/18681/stat : 18681 (TNM) R 18677 18677 18651 0 -1 4202496 6319 0 11 0 496115 1 0 0 25 0 1 0 526110961 481501184 6227 33554432000 134512640 134534564 4288039936 18446744073709551615 134528957 0 0 4096 0 0 0 0 17 2 0 0 43
/proc/18681/statm: 117554 6227 95 6 0 116220 0
[pid=18682] ppid=18677 vsize=461036 CPUtime=4962.08 cores=3
/proc/18682/stat : 18682 (march_hi) R 18677 18677 18651 0 -1 4202496 94305 0 0 0 496151 57 0 0 25 0 1 0 526110961 472100864 77870 33554432000 4194304 4331988 140735560759632 18446744073709551615 4246715 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/18682/statm: 115259 77870 175 34 0 113701 0
[pid=18683] ppid=18677 vsize=643500 CPUtime=19813.4 cores=4-7
/proc/18683/stat : 18683 (plingeling) S 18677 18677 18651 0 -1 4202496 3060915 1249 0 0 1980813 528 0 0 18 0 5 0 526110961 658944000 133059 33554432000 4194304 4356188 140735221808624 18446744073709551615 242982352869 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/18683/statm: 160875 133059 162 40 0 159419 0
[pid=18683/tid=18689] ppid=18677 vsize=643500 CPUtime=4961.9 cores=4-7
/proc/18683/task/18689/stat : 18689 (plingeling) R 18677 18677 18651 0 -1 4202560 844975 1249 0 0 496079 111 0 0 25 0 5 0 526111007 658944000 133059 33554432000 4194304 4356188 140735221808624 18446744073709551615 4330862 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=18683/tid=18690] ppid=18677 vsize=643500 CPUtime=4958.32 cores=4-7
/proc/18683/task/18690/stat : 18690 (plingeling) R 18677 18677 18651 0 -1 4202560 715533 1249 0 0 495684 148 0 0 25 0 5 0 526111007 658944000 133059 33554432000 4194304 4356188 140735221808624 18446744073709551615 4331264 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=18683/tid=18691] ppid=18677 vsize=643500 CPUtime=4937.79 cores=4-7
/proc/18683/task/18691/stat : 18691 (plingeling) R 18677 18677 18651 0 -1 4202560 851421 1249 0 0 493652 127 0 0 25 0 5 0 526111007 658944000 133059 33554432000 4194304 4356188 140735221808624 18446744073709551615 4331028 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=18683/tid=18692] ppid=18677 vsize=643500 CPUtime=4955.07 cores=4-7
/proc/18683/task/18692/stat : 18692 (plingeling) R 18677 18677 18651 0 -1 4202560 640175 1249 0 0 495370 137 0 0 25 0 5 0 526111007 658944000 133059 33554432000 4194304 4356188 140735221808624 18446744073709551615 4331311 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 39661.4
Current children cumulated vsize (KiB) 4406000



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5004.7 s]
/proc/loadavg: 8.10 8.04 7.98 9/178 18837
/proc/meminfo: memFree=29477412/32951132 swapFree=67111364/67111528
[pid=18677] ppid=18675 vsize=18324 CPUtime=0 cores=0-7
/proc/18677/stat : 18677 (ppfolio) S 18675 18677 18651 0 -1 4202496 517 0 2 0 0 0 0 0 15 0 1 0 526110960 18763776 389 33554432000 4194304 4287625 140736289430064 18446744073709551615 242970570255 0 0 4096 65536 11367050554283917311 0 0 17 3 0 0 0
/proc/18677/statm: 4581 389 341 23 0 91 0
[pid=18679] ppid=18677 vsize=2448720 CPUtime=5004.79 cores=0
/proc/18679/stat : 18679 (cryptominisat) R 18677 18677 18651 0 -1 4202496 1303947 0 0 0 499901 578 0 0 25 0 1 0 526110961 2507489280 86602 33554432000 4194304 4587354 140734481947904 18446744073709551615 4238658 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/18679/statm: 612180 86602 337 96 0 608742 0
[pid=18680] ppid=18677 vsize=355224 CPUtime=5004.74 cores=1
/proc/18680/stat : 18680 (clasp) R 18677 18677 18651 0 -1 4202496 83774 0 0 0 500439 35 0 0 25 0 1 0 526110961 363749376 81973 33554432000 4194304 4785740 140733849986816 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/18680/statm: 88806 81973 340 145 0 85851 0
[pid=18681] ppid=18677 vsize=470216 CPUtime=5003.55 cores=2
/proc/18681/stat : 18681 (TNM) R 18677 18677 18651 0 -1 4202496 6319 0 11 0 500354 1 0 0 25 0 1 0 526110961 481501184 6227 33554432000 134512640 134534564 4288039936 18446744073709551615 134530551 0 0 4096 0 0 0 0 17 2 0 0 43
/proc/18681/statm: 117554 6227 95 6 0 116220 0
[pid=18682] ppid=18677 vsize=461036 CPUtime=5004.49 cores=3
/proc/18682/stat : 18682 (march_hi) R 18677 18677 18651 0 -1 4202496 95025 0 0 0 500392 57 0 0 25 0 1 0 526110961 472100864 78590 33554432000 4194304 4331988 140735560759632 18446744073709551615 4228270 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/18682/statm: 115259 78590 175 34 0 113701 0
[pid=18683] ppid=18677 vsize=555436 CPUtime=19982.8 cores=4-7
/proc/18683/stat : 18683 (plingeling) S 18677 18677 18651 0 -1 4202496 3074739 1249 0 0 1997749 531 0 0 18 0 5 0 526110961 568766464 111043 33554432000 4194304 4356188 140735221808624 18446744073709551615 242982352869 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/18683/statm: 138859 111043 162 40 0 137403 0
[pid=18683/tid=18689] ppid=18677 vsize=555436 CPUtime=5004.31 cores=4-7
/proc/18683/task/18689/stat : 18689 (plingeling) R 18677 18677 18651 0 -1 4202560 852143 1249 0 0 500319 112 0 0 25 0 5 0 526111007 568766464 111043 33554432000 4194304 4356188 140735221808624 18446744073709551615 4331050 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=18683/tid=18690] ppid=18677 vsize=555436 CPUtime=5000.71 cores=4-7
/proc/18683/task/18690/stat : 18690 (plingeling) R 18677 18677 18651 0 -1 4202560 717069 1249 0 0 499922 149 0 0 25 0 5 0 526111007 568766464 111043 33554432000 4194304 4356188 140735221808624 18446744073709551615 4332046 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=18683/tid=18691] ppid=18677 vsize=555436 CPUtime=4979.96 cores=4-7
/proc/18683/task/18691/stat : 18691 (plingeling) R 18677 18677 18651 0 -1 4202560 856541 1249 0 0 497869 127 0 0 25 0 5 0 526111007 568766464 111043 33554432000 4194304 4356188 140735221808624 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=18683/tid=18692] ppid=18677 vsize=555436 CPUtime=4997.47 cores=4-7
/proc/18683/task/18692/stat : 18692 (plingeling) R 18677 18677 18651 0 -1 4202560 640175 1249 0 0 499610 137 0 0 25 0 5 0 526111007 568766464 111043 33554432000 4194304 4356188 140735221808624 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 40000.4
Current children cumulated vsize (KiB) 4308956

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 18677 and gives
#  childrusage.ru_utime.tv_sec=5003
#  childrusage.ru_utime.tv_usec=551344
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=30995
# CPU time returned by wait4() is 5003.58
# while last known CPU time is 40000.4
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 5004.72
CPU time (s): 40000.4
CPU user time (s): 39988.4
CPU system time (s): 12.02
CPU usage (%): 799.253
Max. virtual memory (cumulated for all children) (KiB): 6439044

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 5003.55
system time used= 0.030995
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 6838
page faults= 13
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 515
involuntary context switches= 23426

runsolver used 7.9078 second user time and 19.1101 second system time

The end

Launcher Data 

Begin job on node128 at 2011-04-30 08:32:03
IDJOB=3275051
IDBENCH=71353
IDSOLVER=1638
FILE ID=node128/3275051-1304145123
RUNJOBID= node128-1304145123-18665
PBS_JOBID= 13170867
Free space on /tmp= 67528 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT09/CRAFTED/rbsat/random/forced/rbsat-v2400c266431gyes7.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3275051-1304145123/watcher-3275051-1304145123 -o /tmp/evaluation-result-3275051-1304145123/solver-3275051-1304145123 -C 40000 -W 5100 -M 31000  ppfolio HOME/instance-3275051-1304145123.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 92e61742efd2e322c59b4442206bebf1
RANDOM SEED=1055165167

node128.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5434.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951132 kB
MemFree:      30936428 kB
Buffers:        445896 kB
Cached:        1087676 kB
SwapCached:          0 kB
Active:         171588 kB
Inactive:      1425916 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951132 kB
LowFree:      30936428 kB
SwapTotal:    67111528 kB
SwapFree:     67111364 kB
Dirty:           13400 kB
Writeback:           4 kB
AnonPages:       64312 kB
Mapped:          14032 kB
Slab:           353496 kB
PageTables:       4540 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587092 kB
Committed_AS:   188248 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296000 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 67516 MiB
End job on node128 at 2011-04-30 09:55:30