Trace number 3220419

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio par? (TO) 39972 5000.02

General information on the benchmark

Namerandom/medium/
unif-k3-r4.26-v600-c2556-S1734827769-099.UNKNOWN.cnf
MD5SUM2eb2fa74ab0dce335225200db81f6563
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables600
Number of clauses2556
Sum of the clauses size7668
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 32556
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 8 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	[5] plingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 0
0.00/0.00	Starting clasp 1.3.6 on core(s) 1
0.00/0.00	Starting TNM 2009 on core(s) 2
0.00/0.00	Starting march_hi 2009 on core(s) 3
0.00/0.00	Starting plingeling 276-6264d55-100731 on core(s) 4 5 6 7

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3220419-1304157757/watcher-3220419-1304157757 -o /tmp/evaluation-result-3220419-1304157757/solver-3220419-1304157757 -C 40000 -W 5000 -M 31000 ppfolio HOME/instance-3220419-1304157757.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.45 7.91 7.96 2/170 4126
/proc/meminfo: memFree=24808864/32950940 swapFree=67111364/67111528
[pid=4126] ppid=4124 vsize=18324 CPUtime=0 cores=0-7
/proc/4126/stat : 4126 (ppfolio) R 4124 4126 3977 0 -1 4202496 519 0 0 0 0 0 0 0 25 0 1 0 606006468 18763776 389 33554432000 4194304 4287625 140734999917520 18446744073709551615 215988612623 0 0 4096 65536 0 0 0 17 2 0 0 0
/proc/4126/statm: 4581 389 341 23 0 91 0

[startup+0.082359 s]
/proc/loadavg: 7.45 7.91 7.96 2/170 4126
/proc/meminfo: memFree=24808864/32950940 swapFree=67111364/67111528
[pid=4126] ppid=4124 vsize=18324 CPUtime=0 cores=0-7
/proc/4126/stat : 4126 (ppfolio) S 4124 4126 3977 0 -1 4202496 520 0 0 0 0 0 0 0 25 0 1 0 606006468 18763776 389 33554432000 4194304 4287625 140734999917520 18446744073709551615 215988612623 0 0 4096 65536 5558744865749073919 0 0 17 7 0 0 0
/proc/4126/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.100355 s]
/proc/loadavg: 7.45 7.91 7.96 2/170 4126
/proc/meminfo: memFree=24808864/32950940 swapFree=67111364/67111528
[pid=4126] ppid=4124 vsize=18324 CPUtime=0 cores=0-7
/proc/4126/stat : 4126 (ppfolio) S 4124 4126 3977 0 -1 4202496 520 0 0 0 0 0 0 0 25 0 1 0 606006468 18763776 389 33554432000 4194304 4287625 140734999917520 18446744073709551615 215988612623 0 0 4096 65536 5558744865749073919 0 0 17 7 0 0 0
/proc/4126/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.30032 s]
/proc/loadavg: 7.45 7.91 7.96 2/170 4126
/proc/meminfo: memFree=24808864/32950940 swapFree=67111364/67111528
[pid=4126] ppid=4124 vsize=18324 CPUtime=0 cores=0-7
/proc/4126/stat : 4126 (ppfolio) S 4124 4126 3977 0 -1 4202496 520 0 0 0 0 0 0 0 24 0 1 0 606006468 18763776 389 33554432000 4194304 4287625 140734999917520 18446744073709551615 215988612623 0 0 4096 65536 5558744865749073919 0 0 17 7 0 0 0
/proc/4126/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.70025 s]
/proc/loadavg: 7.45 7.91 7.96 2/170 4126
/proc/meminfo: memFree=24808864/32950940 swapFree=67111364/67111528
[pid=4126] ppid=4124 vsize=18324 CPUtime=0 cores=0-7
/proc/4126/stat : 4126 (ppfolio) S 4124 4126 3977 0 -1 4202496 520 0 0 0 0 0 0 0 21 0 1 0 606006468 18763776 389 33554432000 4194304 4287625 140734999917520 18446744073709551615 215988612623 0 0 4096 65536 5558744865749073919 0 0 17 7 0 0 0
/proc/4126/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50111 s]
/proc/loadavg: 7.45 7.91 7.96 9/180 4141
/proc/meminfo: memFree=24791416/32950940 swapFree=67111364/67111528
[pid=4126] ppid=4124 vsize=18324 CPUtime=0 cores=0-7
/proc/4126/stat : 4126 (ppfolio) S 4124 4126 3977 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 606006468 18763776 389 33554432000 4194304 4287625 140734999917520 18446744073709551615 215988612623 0 0 4096 65536 5558744865749073919 0 0 17 7 0 0 0
/proc/4126/statm: 4581 389 341 23 0 91 0
[pid=4127] ppid=4126 vsize=1289684 CPUtime=1.49 cores=0
/proc/4127/stat : 4127 (cryptominisat) R 4126 4126 3977 0 -1 4202496 3986 0 0 0 149 0 0 0 25 0 1 0 606006469 1320636416 2659 33554432000 4194304 4587354 140735447907968 18446744073709551615 4388277 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/4127/statm: 322421 2659 337 96 0 318983 0
[pid=4128] ppid=4126 vsize=14300 CPUtime=1.49 cores=1
/proc/4128/stat : 4128 (clasp) R 4126 4126 3977 0 -1 4202496 1041 0 0 0 149 0 0 0 20 0 1 0 606006469 14643200 928 33554432000 4194304 4785740 140733353043648 18446744073709551615 4309561 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/4128/statm: 3575 928 340 145 0 620 0
[pid=4129] ppid=4126 vsize=455956 CPUtime=1.49 cores=2
/proc/4129/stat : 4129 (TNM) R 4126 4126 3977 0 -1 4202496 355 0 0 0 149 0 0 0 25 0 1 0 606006469 466898944 252 33554432000 134512640 134534564 4290755312 18446744073709551615 134530307 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/4129/statm: 113989 252 95 6 0 112655 0
[pid=4130] ppid=4126 vsize=8256 CPUtime=1.49 cores=3
/proc/4130/stat : 4130 (march_hi) R 4126 4126 3977 0 -1 4202496 675 0 0 0 149 0 0 0 20 0 1 0 606006469 8454144 568 33554432000 4194304 4331988 140733427119056 18446744073709551615 4229294 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/4130/statm: 2064 568 173 34 0 506 0
[pid=4131] ppid=4126 vsize=122928 CPUtime=5.92 cores=4-7
/proc/4131/stat : 4131 (plingeling) S 4126 4126 3977 0 -1 4202496 4023 1251 0 0 592 0 0 0 19 0 5 0 606006469 125878272 2854 33554432000 4194304 4356188 140734017628288 18446744073709551615 216000395237 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/4131/statm: 30732 2854 164 40 0 29276 0
[pid=4131/tid=4138] ppid=4126 vsize=122928 CPUtime=1.48 cores=4-7
/proc/4131/task/4138/stat : 4138 (plingeling) R 4126 4126 3977 0 -1 4202560 901 1251 0 0 148 0 0 0 20 0 5 0 606006470 125878272 2854 33554432000 4194304 4356188 140734017628288 18446744073709551615 4332046 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4131/tid=4139] ppid=4126 vsize=122928 CPUtime=1.48 cores=4-7
/proc/4131/task/4139/stat : 4139 (plingeling) R 4126 4126 3977 0 -1 4202560 929 1251 0 0 148 0 0 0 23 0 5 0 606006470 125878272 2854 33554432000 4194304 4356188 140734017628288 18446744073709551615 4331047 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=4131/tid=4140] ppid=4126 vsize=122928 CPUtime=1.46 cores=4-7
/proc/4131/task/4140/stat : 4140 (plingeling) R 4126 4126 3977 0 -1 4202560 772 1251 0 0 146 0 0 0 25 0 5 0 606006470 125878272 2854 33554432000 4194304 4356188 140734017628288 18446744073709551615 4331305 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4131/tid=4141] ppid=4126 vsize=122928 CPUtime=1.47 cores=4-7
/proc/4131/task/4141/stat : 4141 (plingeling) R 4126 4126 3977 0 -1 4202560 890 1251 0 0 147 0 0 0 25 0 5 0 606006470 125878272 2854 33554432000 4194304 4356188 140734017628288 18446744073709551615 4330817 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 11.88
Current children cumulated vsize (KiB) 1909448

[startup+3.10083 s]
/proc/loadavg: 7.45 7.91 7.96 9/180 4141
/proc/meminfo: memFree=24783356/32950940 swapFree=67111364/67111528
[pid=4126] ppid=4124 vsize=18324 CPUtime=0 cores=0-7
/proc/4126/stat : 4126 (ppfolio) S 4124 4126 3977 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 606006468 18763776 389 33554432000 4194304 4287625 140734999917520 18446744073709551615 215988612623 0 0 4096 65536 5558744865749073919 0 0 17 7 0 0 0
/proc/4126/statm: 4581 389 341 23 0 91 0
[pid=4127] ppid=4126 vsize=1291344 CPUtime=3.09 cores=0
/proc/4127/stat : 4127 (cryptominisat) R 4126 4126 3977 0 -1 4202496 5676 0 0 0 309 0 0 0 25 0 1 0 606006469 1322336256 3389 33554432000 4194304 4587354 140735447907968 18446744073709551615 4357632 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/4127/statm: 322836 3389 337 96 0 319398 0
[pid=4128] ppid=4126 vsize=15100 CPUtime=3.09 cores=1
/proc/4128/stat : 4128 (clasp) R 4126 4126 3977 0 -1 4202496 1251 0 0 0 309 0 0 0 25 0 1 0 606006469 15462400 1138 33554432000 4194304 4785740 140733353043648 18446744073709551615 4553010 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/4128/statm: 3775 1138 340 145 0 820 0
[pid=4129] ppid=4126 vsize=455956 CPUtime=3.09 cores=2
/proc/4129/stat : 4129 (TNM) R 4126 4126 3977 0 -1 4202496 355 0 0 0 309 0 0 0 25 0 1 0 606006469 466898944 252 33554432000 134512640 134534564 4290755312 18446744073709551615 134529024 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/4129/statm: 113989 252 95 6 0 112655 0
[pid=4130] ppid=4126 vsize=8636 CPUtime=3.09 cores=3
/proc/4130/stat : 4130 (march_hi) R 4126 4126 3977 0 -1 4202496 735 0 0 0 309 0 0 0 25 0 1 0 606006469 8843264 628 33554432000 4194304 4331988 140733427119056 18446744073709551615 4229709 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/4130/statm: 2159 628 173 34 0 601 0
[pid=4131] ppid=4126 vsize=123068 CPUtime=12.31 cores=4-7
/proc/4131/stat : 4131 (plingeling) S 4126 4126 3977 0 -1 4202496 5274 1251 0 0 1231 0 0 0 19 0 5 0 606006469 126021632 2889 33554432000 4194304 4356188 140734017628288 18446744073709551615 216000395237 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/4131/statm: 30767 2889 164 40 0 29311 0
[pid=4131/tid=4138] ppid=4126 vsize=123068 CPUtime=3.08 cores=4-7
/proc/4131/task/4138/stat : 4138 (plingeling) R 4126 4126 3977 0 -1 4202560 1254 1251 0 0 308 0 0 0 25 0 5 0 606006470 126021632 2889 33554432000 4194304 4356188 140734017628288 18446744073709551615 4332136 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4131/tid=4139] ppid=4126 vsize=123068 CPUtime=3.08 cores=4-7
/proc/4131/task/4139/stat : 4139 (plingeling) R 4126 4126 3977 0 -1 4202560 1251 1251 0 0 308 0 0 0 25 0 5 0 606006470 126021632 2889 33554432000 4194304 4356188 140734017628288 18446744073709551615 4331960 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=4131/tid=4140] ppid=4126 vsize=123068 CPUtime=3.05 cores=4-7
/proc/4131/task/4140/stat : 4140 (plingeling) R 4126 4126 3977 0 -1 4202560 1173 1251 0 0 305 0 0 0 25 0 5 0 606006470 126021632 2889 33554432000 4194304 4356188 140734017628288 18446744073709551615 4331960 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4131/tid=4141] ppid=4126 vsize=123068 CPUtime=3.07 cores=4-7
/proc/4131/task/4141/stat : 4141 (plingeling) R 4126 4126 3977 0 -1 4202560 1065 1251 0 0 307 0 0 0 25 0 5 0 606006470 126021632 2889 33554432000 4194304 4356188 140734017628288 18446744073709551615 4331060 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 24.67
Current children cumulated vsize (KiB) 1912428

[startup+6.30127 s]
/proc/loadavg: 7.50 7.91 7.96 9/180 4141
/proc/meminfo: memFree=24772196/32950940 swapFree=67111364/67111528
[pid=4126] ppid=4124 vsize=18324 CPUtime=0 cores=0-7
/proc/4126/stat : 4126 (ppfolio) S 4124 4126 3977 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 606006468 18763776 389 33554432000 4194304 4287625 140734999917520 18446744073709551615 215988612623 0 0 4096 65536 5558744865749073919 0 0 17 7 0 0 0
/proc/4126/statm: 4581 389 341 23 0 91 0
[pid=4127] ppid=4126 vsize=1293320 CPUtime=6.29 cores=0
/proc/4127/stat : 4127 (cryptominisat) R 4126 4126 3977 0 -1 4202496 8128 0 0 0 629 0 0 0 25 0 1 0 606006469 1324359680 3994 33554432000 4194304 4587354 140735447907968 18446744073709551615 4238728 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/4127/statm: 323330 3994 337 96 0 319892 0
[pid=4128] ppid=4126 vsize=16180 CPUtime=6.29 cores=1
/proc/4128/stat : 4128 (clasp) R 4126 4126 3977 0 -1 4202496 1506 0 0 0 629 0 0 0 25 0 1 0 606006469 16568320 1393 33554432000 4194304 4785740 140733353043648 18446744073709551615 4552550 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/4128/statm: 4045 1393 340 145 0 1090 0
[pid=4129] ppid=4126 vsize=455956 CPUtime=6.29 cores=2
/proc/4129/stat : 4129 (TNM) R 4126 4126 3977 0 -1 4202496 355 0 0 0 629 0 0 0 25 0 1 0 606006469 466898944 252 33554432000 134512640 134534564 4290755312 18446744073709551615 134528250 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/4129/statm: 113989 252 95 6 0 112655 0
[pid=4130] ppid=4126 vsize=9244 CPUtime=6.29 cores=3
/proc/4130/stat : 4130 (march_hi) R 4126 4126 3977 0 -1 4202496 881 0 0 0 629 0 0 0 25 0 1 0 606006469 9465856 774 33554432000 4194304 4331988 140733427119056 18446744073709551615 4229471 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/4130/statm: 2311 774 173 34 0 753 0
[pid=4131] ppid=4126 vsize=125268 CPUtime=25.1 cores=4-7
/proc/4131/stat : 4131 (plingeling) S 4126 4126 3977 0 -1 4202496 8160 1251 0 0 2509 1 0 0 19 0 5 0 606006469 128274432 3439 33554432000 4194304 4356188 140734017628288 18446744073709551615 216000395237 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/4131/statm: 31317 3439 164 40 0 29861 0
[pid=4131/tid=4138] ppid=4126 vsize=125268 CPUtime=6.28 cores=4-7
/proc/4131/task/4138/stat : 4138 (plingeling) R 4126 4126 3977 0 -1 4202560 2152 1251 0 0 628 0 0 0 25 0 5 0 606006470 128274432 3439 33554432000 4194304 4356188 140734017628288 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4131/tid=4139] ppid=4126 vsize=125268 CPUtime=6.28 cores=4-7
/proc/4131/task/4139/stat : 4139 (plingeling) R 4126 4126 3977 0 -1 4202560 1893 1251 0 0 628 0 0 0 25 0 5 0 606006470 128274432 3439 33554432000 4194304 4356188 140734017628288 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=4131/tid=4140] ppid=4126 vsize=125268 CPUtime=6.23 cores=4-7
/proc/4131/task/4140/stat : 4140 (plingeling) R 4126 4126 3977 0 -1 4202560 1781 1251 0 0 623 0 0 0 25 0 5 0 606006470 128274432 3439 33554432000 4194304 4356188 140734017628288 18446744073709551615 4330969 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4131/tid=4141] ppid=4126 vsize=125268 CPUtime=6.27 cores=4-7
/proc/4131/task/4141/stat : 4141 (plingeling) R 4126 4126 3977 0 -1 4202560 1803 1251 0 0 627 0 0 0 25 0 5 0 606006470 128274432 3439 33554432000 4194304 4356188 140734017628288 18446744073709551615 4280017 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 50.26
Current children cumulated vsize (KiB) 1918292

[startup+12.7012 s]
/proc/loadavg: 7.54 7.91 7.96 9/180 4142
/proc/meminfo: memFree=24764192/32950940 swapFree=67111364/67111528
[pid=4126] ppid=4124 vsize=18324 CPUtime=0 cores=0-7
/proc/4126/stat : 4126 (ppfolio) S 4124 4126 3977 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 606006468 18763776 389 33554432000 4194304 4287625 140734999917520 18446744073709551615 215988612623 0 0 4096 65536 5558744865749073919 0 0 17 7 0 0 0
/proc/4126/statm: 4581 389 341 23 0 91 0
[pid=4127] ppid=4126 vsize=1298036 CPUtime=12.69 cores=0
/proc/4127/stat : 4127 (cryptominisat) R 4126 4126 3977 0 -1 4202496 12670 0 0 0 1268 1 0 0 25 0 1 0 606006469 1329188864 4565 33554432000 4194304 4587354 140735447907968 18446744073709551615 4230288 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/4127/statm: 324509 4565 337 96 0 321071 0
[pid=4128] ppid=4126 vsize=17688 CPUtime=12.69 cores=1
/proc/4128/stat : 4128 (clasp) R 4126 4126 3977 0 -1 4202496 1855 0 0 0 1269 0 0 0 25 0 1 0 606006469 18112512 1742 33554432000 4194304 4785740 140733353043648 18446744073709551615 4553003 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/4128/statm: 4422 1742 340 145 0 1467 0
[pid=4129] ppid=4126 vsize=455956 CPUtime=12.69 cores=2
/proc/4129/stat : 4129 (TNM) R 4126 4126 3977 0 -1 4202496 355 0 0 0 1269 0 0 0 25 0 1 0 606006469 466898944 252 33554432000 134512640 134534564 4290755312 18446744073709551615 134528708 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/4129/statm: 113989 252 95 6 0 112655 0
[pid=4130] ppid=4126 vsize=10920 CPUtime=12.69 cores=3
/proc/4130/stat : 4130 (march_hi) R 4126 4126 3977 0 -1 4202496 1126 0 0 0 1269 0 0 0 25 0 1 0 606006469 11182080 1019 33554432000 4194304 4331988 140733427119056 18446744073709551615 4226304 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/4130/statm: 2730 1019 173 34 0 1172 0
[pid=4131] ppid=4126 vsize=130080 CPUtime=50.66 cores=4-7
/proc/4131/stat : 4131 (plingeling) S 4126 4126 3977 0 -1 4202496 13059 1251 0 0 5065 1 0 0 19 0 5 0 606006469 133201920 4642 33554432000 4194304 4356188 140734017628288 18446744073709551615 216000395237 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/4131/statm: 32520 4642 164 40 0 31064 0
[pid=4131/tid=4138] ppid=4126 vsize=130080 CPUtime=12.68 cores=4-7
/proc/4131/task/4138/stat : 4138 (plingeling) R 4126 4126 3977 0 -1 4202560 3368 1251 0 0 1268 0 0 0 25 0 5 0 606006470 133201920 4642 33554432000 4194304 4356188 140734017628288 18446744073709551615 4331062 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4131/tid=4139] ppid=4126 vsize=130080 CPUtime=12.68 cores=4-7
/proc/4131/task/4139/stat : 4139 (plingeling) R 4126 4126 3977 0 -1 4202560 3302 1251 0 0 1268 0 0 0 25 0 5 0 606006470 133201920 4642 33554432000 4194304 4356188 140734017628288 18446744073709551615 4332026 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=4131/tid=4140] ppid=4126 vsize=130080 CPUtime=12.6 cores=4-7
/proc/4131/task/4140/stat : 4140 (plingeling) R 4126 4126 3977 0 -1 4202560 2935 1251 0 0 1260 0 0 0 25 0 5 0 606006470 133201920 4642 33554432000 4194304 4356188 140734017628288 18446744073709551615 4332046 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4131/tid=4141] ppid=4126 vsize=130080 CPUtime=12.67 cores=4-7
/proc/4131/task/4141/stat : 4141 (plingeling) R 4126 4126 3977 0 -1 4202560 2923 1251 0 0 1267 0 0 0 25 0 5 0 606006470 133201920 4642 33554432000 4194304 4356188 140734017628288 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 101.42
Current children cumulated vsize (KiB) 1931004

[startup+25.5009 s]
/proc/loadavg: 7.64 7.92 7.96 9/180 4142
/proc/meminfo: memFree=24752860/32950940 swapFree=67111364/67111528
[pid=4126] ppid=4124 vsize=18324 CPUtime=0 cores=0-7
/proc/4126/stat : 4126 (ppfolio) S 4124 4126 3977 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 606006468 18763776 389 33554432000 4194304 4287625 140734999917520 18446744073709551615 215988612623 0 0 4096 65536 5558744865749073919 0 0 17 3 0 0 0
/proc/4126/statm: 4581 389 341 23 0 91 0
[pid=4127] ppid=4126 vsize=1301068 CPUtime=25.49 cores=0
/proc/4127/stat : 4127 (cryptominisat) R 4126 4126 3977 0 -1 4202496 19133 0 0 0 2547 2 0 0 25 0 1 0 606006469 1332293632 5952 33554432000 4194304 4587354 140735447907968 18446744073709551615 4238690 0 0 4096 2 0 0 0 17 0 0 0 0

################
# More data... #
################

[pid=4129] ppid=4126 vsize=455960 CPUtime=4782.18 cores=2
/proc/4129/stat : 4129 (TNM) R 4126 4126 3977 0 -1 4202496 364 0 0 0 478217 1 0 0 25 0 1 0 606006469 466903040 261 33554432000 134512640 134534564 4290755312 18446744073709551615 134528444 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/4129/statm: 113990 261 103 6 0 112656 0
[pid=4130] ppid=4126 vsize=730860 CPUtime=4782.39 cores=3
/proc/4130/stat : 4130 (march_hi) R 4126 4126 3977 0 -1 4202496 143196 0 0 0 478124 115 0 0 25 0 1 0 606006469 748400640 143089 33554432000 4194304 4331988 140733427119056 18446744073709551615 4284439 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/4130/statm: 182715 143089 173 34 0 181157 0
[pid=4131] ppid=4126 vsize=255832 CPUtime=19102.2 cores=4-7
/proc/4131/stat : 4131 (plingeling) S 4126 4126 3977 0 -1 4202496 959438 1251 0 0 1910075 148 0 0 19 0 5 0 606006469 261971968 36114 33554432000 4194304 4356188 140734017628288 18446744073709551615 216000395237 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/4131/statm: 63958 36114 164 40 0 62502 0
[pid=4131/tid=4138] ppid=4126 vsize=255832 CPUtime=4782.39 cores=4-7
/proc/4131/task/4138/stat : 4138 (plingeling) R 4126 4126 3977 0 -1 4202560 249037 1251 0 0 478198 41 0 0 25 0 5 0 606006470 261971968 36114 33554432000 4194304 4356188 140734017628288 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4131/tid=4139] ppid=4126 vsize=255832 CPUtime=4781.94 cores=4-7
/proc/4131/task/4139/stat : 4139 (plingeling) R 4126 4126 3977 0 -1 4202560 232550 1251 0 0 478159 35 0 0 25 0 5 0 606006470 261971968 36114 33554432000 4194304 4356188 140734017628288 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=4131/tid=4140] ppid=4126 vsize=255832 CPUtime=4755.48 cores=4-7
/proc/4131/task/4140/stat : 4140 (plingeling) R 4126 4126 3977 0 -1 4202560 246140 1251 0 0 475512 36 0 0 25 0 5 0 606006470 261971968 36114 33554432000 4194304 4356188 140734017628288 18446744073709551615 4331151 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4131/tid=4141] ppid=4126 vsize=255832 CPUtime=4782.38 cores=4-7
/proc/4131/task/4141/stat : 4141 (plingeling) R 4126 4126 3977 0 -1 4202560 231180 1251 0 0 478204 34 0 0 25 0 5 0 606006470 261971968 36114 33554432000 4194304 4356188 140734017628288 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 38231.6
Current children cumulated vsize (KiB) 2900996

[startup+4842.3 s]
/proc/loadavg: 8.01 8.03 8.00 9/180 4282
/proc/meminfo: memFree=23915832/32950940 swapFree=67111364/67111528
[pid=4126] ppid=4124 vsize=18324 CPUtime=0 cores=0-7
/proc/4126/stat : 4126 (ppfolio) S 4124 4126 3977 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 606006468 18763776 389 33554432000 4194304 4287625 140734999917520 18446744073709551615 215988612623 0 0 4096 65536 5558744865749073919 0 0 17 3 0 0 0
/proc/4126/statm: 4581 389 341 23 0 91 0
[pid=4127] ppid=4126 vsize=1380064 CPUtime=4842.39 cores=0
/proc/4127/stat : 4127 (cryptominisat) R 4126 4126 3977 0 -1 4202496 493371 0 0 0 484025 214 0 0 25 0 1 0 606006469 1413185536 25569 33554432000 4194304 4587354 140735447907968 18446744073709551615 4238392 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/4127/statm: 345016 25569 337 96 0 341578 0
[pid=4128] ppid=4126 vsize=60192 CPUtime=4842.38 cores=1
/proc/4128/stat : 4128 (clasp) R 4126 4126 3977 0 -1 4202496 11649 0 0 0 484235 3 0 0 25 0 1 0 606006469 61636608 11536 33554432000 4194304 4785740 140733353043648 18446744073709551615 4553402 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/4128/statm: 15048 11536 341 145 0 12093 0
[pid=4129] ppid=4126 vsize=455960 CPUtime=4842.18 cores=2
/proc/4129/stat : 4129 (TNM) R 4126 4126 3977 0 -1 4202496 364 0 0 0 484217 1 0 0 25 0 1 0 606006469 466903040 261 33554432000 134512640 134534564 4290755312 18446744073709551615 134528275 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/4129/statm: 113990 261 103 6 0 112656 0
[pid=4130] ppid=4126 vsize=730860 CPUtime=4842.39 cores=3
/proc/4130/stat : 4130 (march_hi) R 4126 4126 3977 0 -1 4202496 145064 0 0 0 484122 117 0 0 25 0 1 0 606006469 748400640 144957 33554432000 4194304 4331988 140733427119056 18446744073709551615 4284335 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/4130/statm: 182715 144957 173 34 0 181157 0
[pid=4131] ppid=4126 vsize=281816 CPUtime=19341.9 cores=4-7
/proc/4131/stat : 4131 (plingeling) S 4126 4126 3977 0 -1 4202496 968270 1251 0 0 1934040 149 0 0 19 0 5 0 606006469 288579584 42610 33554432000 4194304 4356188 140734017628288 18446744073709551615 216000395237 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/4131/statm: 70454 42610 164 40 0 68998 0
[pid=4131/tid=4138] ppid=4126 vsize=281816 CPUtime=4842.39 cores=4-7
/proc/4131/task/4138/stat : 4138 (plingeling) R 4126 4126 3977 0 -1 4202560 249325 1251 0 0 484198 41 0 0 25 0 5 0 606006470 288579584 42610 33554432000 4194304 4356188 140734017628288 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4131/tid=4139] ppid=4126 vsize=281816 CPUtime=4841.93 cores=4-7
/proc/4131/task/4139/stat : 4139 (plingeling) R 4126 4126 3977 0 -1 4202560 237446 1251 0 0 484158 35 0 0 25 0 5 0 606006470 288579584 42610 33554432000 4194304 4356188 140734017628288 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=4131/tid=4140] ppid=4126 vsize=281816 CPUtime=4815.15 cores=4-7
/proc/4131/task/4140/stat : 4140 (plingeling) R 4126 4126 3977 0 -1 4202560 247324 1251 0 0 481479 36 0 0 25 0 5 0 606006470 288579584 42610 33554432000 4194304 4356188 140734017628288 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4131/tid=4141] ppid=4126 vsize=281816 CPUtime=4842.37 cores=4-7
/proc/4131/task/4141/stat : 4141 (plingeling) R 4126 4126 3977 0 -1 4202560 233644 1251 0 0 484203 34 0 0 25 0 5 0 606006470 288579584 42610 33554432000 4194304 4356188 140734017628288 18446744073709551615 4331072 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 38711.2
Current children cumulated vsize (KiB) 2927216

[startup+4902.3 s]
/proc/loadavg: 8.00 8.02 8.00 9/180 4284
/proc/meminfo: memFree=23871524/32950940 swapFree=67111364/67111528
[pid=4126] ppid=4124 vsize=18324 CPUtime=0 cores=0-7
/proc/4126/stat : 4126 (ppfolio) S 4124 4126 3977 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 606006468 18763776 389 33554432000 4194304 4287625 140734999917520 18446744073709551615 215988612623 0 0 4096 65536 5558744865749073919 0 0 17 3 0 0 0
/proc/4126/statm: 4581 389 341 23 0 91 0
[pid=4127] ppid=4126 vsize=1380064 CPUtime=4902.39 cores=0
/proc/4127/stat : 4127 (cryptominisat) R 4126 4126 3977 0 -1 4202496 496376 0 0 0 490022 217 0 0 25 0 1 0 606006469 1413185536 28513 33554432000 4194304 4587354 140735447907968 18446744073709551615 4237665 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/4127/statm: 345016 28513 337 96 0 341578 0
[pid=4128] ppid=4126 vsize=60192 CPUtime=4902.38 cores=1
/proc/4128/stat : 4128 (clasp) R 4126 4126 3977 0 -1 4202496 11650 0 0 0 490235 3 0 0 25 0 1 0 606006469 61636608 11537 33554432000 4194304 4785740 140733353043648 18446744073709551615 4553003 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/4128/statm: 15048 11537 341 145 0 12093 0
[pid=4129] ppid=4126 vsize=455960 CPUtime=4902.18 cores=2
/proc/4129/stat : 4129 (TNM) R 4126 4126 3977 0 -1 4202496 364 0 0 0 490217 1 0 0 25 0 1 0 606006469 466903040 261 33554432000 134512640 134534564 4290755312 18446744073709551615 134528726 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/4129/statm: 113990 261 103 6 0 112656 0
[pid=4130] ppid=4126 vsize=730860 CPUtime=4902.39 cores=3
/proc/4130/stat : 4130 (march_hi) R 4126 4126 3977 0 -1 4202496 146833 0 0 0 490121 118 0 0 25 0 1 0 606006469 748400640 146726 33554432000 4194304 4331988 140733427119056 18446744073709551615 4229471 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/4130/statm: 182715 146726 173 34 0 181157 0
[pid=4131] ppid=4126 vsize=306136 CPUtime=19581.6 cores=4-7
/proc/4131/stat : 4131 (plingeling) S 4126 4126 3977 0 -1 4202496 981774 1251 0 0 1958006 150 0 0 19 0 5 0 606006469 313483264 48690 33554432000 4194304 4356188 140734017628288 18446744073709551615 216000395237 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/4131/statm: 76534 48690 164 40 0 75078 0
[pid=4131/tid=4138] ppid=4126 vsize=306136 CPUtime=4902.39 cores=4-7
/proc/4131/task/4138/stat : 4138 (plingeling) R 4126 4126 3977 0 -1 4202560 255597 1251 0 0 490198 41 0 0 25 0 5 0 606006470 313483264 48690 33554432000 4194304 4356188 140734017628288 18446744073709551615 4331296 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4131/tid=4139] ppid=4126 vsize=306136 CPUtime=4901.93 cores=4-7
/proc/4131/task/4139/stat : 4139 (plingeling) R 4126 4126 3977 0 -1 4202560 239270 1251 0 0 490157 36 0 0 25 0 5 0 606006470 313483264 48690 33554432000 4194304 4356188 140734017628288 18446744073709551615 4332046 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=4131/tid=4140] ppid=4126 vsize=306136 CPUtime=4874.83 cores=4-7
/proc/4131/task/4140/stat : 4140 (plingeling) R 4126 4126 3977 0 -1 4202560 252732 1251 0 0 487446 37 0 0 25 0 5 0 606006470 313483264 48690 33554432000 4194304 4356188 140734017628288 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4131/tid=4141] ppid=4126 vsize=306136 CPUtime=4902.38 cores=4-7
/proc/4131/task/4141/stat : 4141 (plingeling) R 4126 4126 3977 0 -1 4202560 233644 1251 0 0 490203 35 0 0 25 0 5 0 606006470 313483264 48690 33554432000 4194304 4356188 140734017628288 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 39190.9
Current children cumulated vsize (KiB) 2951536

[startup+4962.3 s]
/proc/loadavg: 8.00 8.02 8.00 9/180 4286
/proc/meminfo: memFree=23844940/32950940 swapFree=67111364/67111528
[pid=4126] ppid=4124 vsize=18324 CPUtime=0 cores=0-7
/proc/4126/stat : 4126 (ppfolio) S 4124 4126 3977 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 606006468 18763776 389 33554432000 4194304 4287625 140734999917520 18446744073709551615 215988612623 0 0 4096 65536 5558744865749073919 0 0 17 3 0 0 0
/proc/4126/statm: 4581 389 341 23 0 91 0
[pid=4127] ppid=4126 vsize=1380132 CPUtime=4962.39 cores=0
/proc/4127/stat : 4127 (cryptominisat) R 4126 4126 3977 0 -1 4202496 501364 0 0 0 496020 219 0 0 25 0 1 0 606006469 1413255168 26848 33554432000 4194304 4587354 140735447907968 18446744073709551615 4238491 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/4127/statm: 345033 26848 337 96 0 341595 0
[pid=4128] ppid=4126 vsize=60388 CPUtime=4962.38 cores=1
/proc/4128/stat : 4128 (clasp) R 4126 4126 3977 0 -1 4202496 11668 0 0 0 496235 3 0 0 25 0 1 0 606006469 61837312 11555 33554432000 4194304 4785740 140733353043648 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/4128/statm: 15097 11555 341 145 0 12142 0
[pid=4129] ppid=4126 vsize=455960 CPUtime=4962.18 cores=2
/proc/4129/stat : 4129 (TNM) R 4126 4126 3977 0 -1 4202496 364 0 0 0 496217 1 0 0 25 0 1 0 606006469 466903040 261 33554432000 134512640 134534564 4290755312 18446744073709551615 134530135 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/4129/statm: 113990 261 103 6 0 112656 0
[pid=4130] ppid=4126 vsize=730860 CPUtime=4962.39 cores=3
/proc/4130/stat : 4130 (march_hi) R 4126 4126 3977 0 -1 4202496 148593 0 0 0 496120 119 0 0 25 0 1 0 606006469 748400640 148486 33554432000 4194304 4331988 140733427119056 18446744073709551615 4226446 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/4130/statm: 182715 148486 173 34 0 181157 0
[pid=4131] ppid=4126 vsize=333528 CPUtime=19821.2 cores=4-7
/proc/4131/stat : 4131 (plingeling) S 4126 4126 3977 0 -1 4202496 991086 1251 0 0 1981973 151 0 0 19 0 5 0 606006469 341532672 55538 33554432000 4194304 4356188 140734017628288 18446744073709551615 216000395237 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/4131/statm: 83382 55538 164 40 0 81926 0
[pid=4131/tid=4138] ppid=4126 vsize=333528 CPUtime=4962.39 cores=4-7
/proc/4131/task/4138/stat : 4138 (plingeling) R 4126 4126 3977 0 -1 4202560 256397 1251 0 0 496198 41 0 0 25 0 5 0 606006470 341532672 55538 33554432000 4194304 4356188 140734017628288 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4131/tid=4139] ppid=4126 vsize=333528 CPUtime=4961.93 cores=4-7
/proc/4131/task/4139/stat : 4139 (plingeling) R 4126 4126 3977 0 -1 4202560 240038 1251 0 0 496157 36 0 0 25 0 5 0 606006470 341532672 55538 33554432000 4194304 4356188 140734017628288 18446744073709551615 4331311 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=4131/tid=4140] ppid=4126 vsize=333528 CPUtime=4934.5 cores=4-7
/proc/4131/task/4140/stat : 4140 (plingeling) R 4126 4126 3977 0 -1 4202560 254428 1251 0 0 493413 37 0 0 25 0 5 0 606006470 341532672 55538 33554432000 4194304 4356188 140734017628288 18446744073709551615 4332165 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4131/tid=4141] ppid=4126 vsize=333528 CPUtime=4962.39 cores=4-7
/proc/4131/task/4141/stat : 4141 (plingeling) R 4126 4126 3977 0 -1 4202560 239692 1251 0 0 496203 36 0 0 25 0 5 0 606006470 341532672 55538 33554432000 4194304 4356188 140734017628288 18446744073709551615 4331035 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 39670.6
Current children cumulated vsize (KiB) 2979192



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+5000 s]
/proc/loadavg: 8.00 8.01 8.00 9/180 4287
/proc/meminfo: memFree=23853584/32950940 swapFree=67111364/67111528
[pid=4126] ppid=4124 vsize=18324 CPUtime=0 cores=0-7
/proc/4126/stat : 4126 (ppfolio) S 4124 4126 3977 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 606006468 18763776 389 33554432000 4194304 4287625 140734999917520 18446744073709551615 215988612623 0 0 4096 65536 5558744865749073919 0 0 17 3 0 0 0
/proc/4126/statm: 4581 389 341 23 0 91 0
[pid=4127] ppid=4126 vsize=1380132 CPUtime=5000.1 cores=0
/proc/4127/stat : 4127 (cryptominisat) R 4126 4126 3977 0 -1 4202496 503291 0 0 0 499790 220 0 0 25 0 1 0 606006469 1413255168 28716 33554432000 4194304 4587354 140735447907968 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/4127/statm: 345033 28716 337 96 0 341595 0
[pid=4128] ppid=4126 vsize=60388 CPUtime=5000.09 cores=1
/proc/4128/stat : 4128 (clasp) R 4126 4126 3977 0 -1 4202496 11683 0 0 0 500006 3 0 0 25 0 1 0 606006469 61837312 11570 33554432000 4194304 4785740 140733353043648 18446744073709551615 4287204 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/4128/statm: 15097 11570 341 145 0 12142 0
[pid=4129] ppid=4126 vsize=455960 CPUtime=4999.89 cores=2
/proc/4129/stat : 4129 (TNM) R 4126 4126 3977 0 -1 4202496 364 0 0 0 499988 1 0 0 25 0 1 0 606006469 466903040 261 33554432000 134512640 134534564 4290755312 18446744073709551615 7959995 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/4129/statm: 113990 261 103 6 0 112656 0
[pid=4130] ppid=4126 vsize=730860 CPUtime=5000.1 cores=3
/proc/4130/stat : 4130 (march_hi) R 4126 4126 3977 0 -1 4202496 149664 0 0 0 499890 120 0 0 25 0 1 0 606006469 748400640 149557 33554432000 4194304 4331988 140733427119056 18446744073709551615 4226483 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/4130/statm: 182715 149557 173 34 0 181157 0
[pid=4131] ppid=4126 vsize=312280 CPUtime=19971.8 cores=4-7
/proc/4131/stat : 4131 (plingeling) S 4126 4126 3977 0 -1 4202496 994830 1251 0 0 1997033 152 0 0 19 0 5 0 606006469 319774720 50226 33554432000 4194304 4356188 140734017628288 18446744073709551615 216000395237 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/4131/statm: 78070 50226 164 40 0 76614 0
[pid=4131/tid=4138] ppid=4126 vsize=312280 CPUtime=5000.1 cores=4-7
/proc/4131/task/4138/stat : 4138 (plingeling) R 4126 4126 3977 0 -1 4202560 257805 1251 0 0 499968 42 0 0 25 0 5 0 606006470 319774720 50226 33554432000 4194304 4356188 140734017628288 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4131/tid=4139] ppid=4126 vsize=312280 CPUtime=4999.63 cores=4-7
/proc/4131/task/4139/stat : 4139 (plingeling) R 4126 4126 3977 0 -1 4202560 241062 1251 0 0 499927 36 0 0 25 0 5 0 606006470 319774720 50226 33554432000 4194304 4356188 140734017628288 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=4131/tid=4140] ppid=4126 vsize=312280 CPUtime=4972 cores=4-7
/proc/4131/task/4140/stat : 4140 (plingeling) R 4126 4126 3977 0 -1 4202560 255228 1251 0 0 497163 37 0 0 25 0 5 0 606006470 319774720 50226 33554432000 4194304 4356188 140734017628288 18446744073709551615 4330976 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4131/tid=4141] ppid=4126 vsize=312280 CPUtime=5000.09 cores=4-7
/proc/4131/task/4141/stat : 4141 (plingeling) R 4126 4126 3977 0 -1 4202560 240204 1251 0 0 499973 36 0 0 25 0 5 0 606006470 319774720 50226 33554432000 4194304 4356188 140734017628288 18446744073709551615 4331060 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 39972
Current children cumulated vsize (KiB) 2957944

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 4126 and gives
#  childrusage.ru_utime.tv_sec=14997
#  childrusage.ru_utime.tv_usec=853979
#  childrusage.ru_stime.tv_sec=2
#  childrusage.ru_stime.tv_usec=274654
# CPU time returned by wait4() is 15000.1
# while last known CPU time is 39972
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 5000.02
CPU time (s): 39972
CPU user time (s): 39967.1
CPU system time (s): 4.96
CPU usage (%): 799.438
Max. virtual memory (cumulated for all children) (KiB): 4198796

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 14997.9
system time used= 2.27465
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 515873
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 612
involuntary context switches= 90942

runsolver used 8.46871 second user time and 18.8111 second system time

The end

Launcher Data 

Begin job on node117 at 2011-04-30 12:02:37
IDJOB=3220419
IDBENCH=82753
IDSOLVER=1638
FILE ID=node117/3220419-1304157757
RUNJOBID= node117-1304157751-3991
PBS_JOBID= 13170912
Free space on /tmp= 72632 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT11/random/medium/unif-k3-r4.26-v600-c2556-S1734827769-099.UNKNOWN.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3220419-1304157757/watcher-3220419-1304157757 -o /tmp/evaluation-result-3220419-1304157757/solver-3220419-1304157757 -C 40000 -W 5000 -M 31000  ppfolio HOME/instance-3220419-1304157757.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 2eb2fa74ab0dce335225200db81f6563
RANDOM SEED=635704846

node117.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5267.44
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950940 kB
MemFree:      24809020 kB
Buffers:       1891836 kB
Cached:        5618244 kB
SwapCached:        160 kB
Active:         895964 kB
Inactive:      6677732 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950940 kB
LowFree:      24809020 kB
SwapTotal:    67111528 kB
SwapFree:     67111364 kB
Dirty:           10276 kB
Writeback:           0 kB
AnonPages:       63816 kB
Mapped:          14740 kB
Slab:           500740 kB
PageTables:       4828 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586996 kB
Committed_AS:   183932 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72620 MiB
End job on node117 at 2011-04-30 13:25:59