Trace number 3310352

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio par? (TO) 40000.4 5005.62

General information on the benchmark

Nameapplication/leberre/
2dimensionalstrippacking/E00N23.cnf
MD5SUM1a1f0dddf727883e0973677dd00e9269
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark3122.96
Satisfiable
(Un)Satisfiability was proved
Number of variables15364
Number of clauses2210893
Sum of the clauses size20370578
Maximum clause length105
Minimum clause length1
Number of clauses of size 128
Number of clauses of size 241189
Number of clauses of size 336730
Number of clauses of size 432798
Number of clauses of size 5188784
Number of clauses of size over 51911364

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 8 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	[5] plingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 0
0.00/0.00	Starting clasp 1.3.6 on core(s) 1
0.00/0.00	Starting TNM 2009 on core(s) 2
0.00/0.00	Starting march_hi 2009 on core(s) 3
0.00/0.00	Starting plingeling 276-6264d55-100731 on core(s) 4 5 6 7

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3310352-1304015128/watcher-3310352-1304015128 -o /tmp/evaluation-result-3310352-1304015128/solver-3310352-1304015128 -C 40000 -W 5100 -M 31000 ppfolio HOME/instance-3310352-1304015128.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.66 7.76 7.39 1/170 12825
/proc/meminfo: memFree=12471588/32951124 swapFree=67111528/67111528
[pid=12825] ppid=12823 vsize=18324 CPUtime=0 cores=0-7
/proc/12825/stat : 12825 (ppfolio) S 12823 12825 12375 0 -1 4202496 521 0 0 0 0 0 0 0 25 0 1 0 493929377 18763776 390 33554432000 4194304 4287625 140736383393472 18446744073709551615 212039675407 0 0 4096 65536 4360101269612789759 0 0 17 6 0 0 0
/proc/12825/statm: 4581 390 341 23 0 91 0

[startup+0.0813439 s]
/proc/loadavg: 7.66 7.76 7.39 1/170 12825
/proc/meminfo: memFree=12471588/32951124 swapFree=67111528/67111528
[pid=12825] ppid=12823 vsize=18324 CPUtime=0 cores=0-7
/proc/12825/stat : 12825 (ppfolio) S 12823 12825 12375 0 -1 4202496 521 0 0 0 0 0 0 0 25 0 1 0 493929377 18763776 390 33554432000 4194304 4287625 140736383393472 18446744073709551615 212039675407 0 0 4096 65536 4360101269612789759 0 0 17 6 0 0 0
/proc/12825/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.100332 s]
/proc/loadavg: 7.66 7.76 7.39 1/170 12825
/proc/meminfo: memFree=12471588/32951124 swapFree=67111528/67111528
[pid=12825] ppid=12823 vsize=18324 CPUtime=0 cores=0-7
/proc/12825/stat : 12825 (ppfolio) S 12823 12825 12375 0 -1 4202496 521 0 0 0 0 0 0 0 25 0 1 0 493929377 18763776 390 33554432000 4194304 4287625 140736383393472 18446744073709551615 212039675407 0 0 4096 65536 4360101269612789759 0 0 17 6 0 0 0
/proc/12825/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.300303 s]
/proc/loadavg: 7.66 7.76 7.39 1/170 12825
/proc/meminfo: memFree=12471588/32951124 swapFree=67111528/67111528
[pid=12825] ppid=12823 vsize=18324 CPUtime=0 cores=0-7
/proc/12825/stat : 12825 (ppfolio) S 12823 12825 12375 0 -1 4202496 521 0 0 0 0 0 0 0 25 0 1 0 493929377 18763776 390 33554432000 4194304 4287625 140736383393472 18446744073709551615 212039675407 0 0 4096 65536 4360101269612789759 0 0 17 6 0 0 0
/proc/12825/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.700231 s]
/proc/loadavg: 7.66 7.76 7.39 1/170 12825
/proc/meminfo: memFree=12471588/32951124 swapFree=67111528/67111528
[pid=12825] ppid=12823 vsize=18324 CPUtime=0 cores=0-7
/proc/12825/stat : 12825 (ppfolio) S 12823 12825 12375 0 -1 4202496 521 0 0 0 0 0 0 0 25 0 1 0 493929377 18763776 390 33554432000 4194304 4287625 140736383393472 18446744073709551615 212039675407 0 0 4096 65536 4360101269612789759 0 0 17 6 0 0 0
/proc/12825/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50109 s]
/proc/loadavg: 7.66 7.76 7.39 6/176 12836
/proc/meminfo: memFree=11910316/32951124 swapFree=67111528/67111528
[pid=12825] ppid=12823 vsize=18324 CPUtime=0 cores=0-7
/proc/12825/stat : 12825 (ppfolio) S 12823 12825 12375 0 -1 4202496 521 0 0 0 0 0 0 0 18 0 1 0 493929377 18763776 390 33554432000 4194304 4287625 140736383393472 18446744073709551615 212039675407 0 0 4096 65536 4360101269612789759 0 0 17 6 0 0 0
/proc/12825/statm: 4581 390 341 23 0 91 0
[pid=12826] ppid=12825 vsize=300404 CPUtime=1.49 cores=0
/proc/12826/stat : 12826 (cryptominisat) R 12825 12825 12375 0 -1 4202496 50854 0 0 0 139 10 0 0 20 0 1 0 493929378 307613696 48788 33554432000 4194304 4587354 140736909079920 18446744073709551615 4238538 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/12826/statm: 75101 48788 306 96 0 71663 0
[pid=12827] ppid=12825 vsize=233436 CPUtime=1.48 cores=1
/proc/12827/stat : 12827 (clasp) R 12825 12825 12375 0 -1 4202496 64316 0 0 0 137 11 0 0 20 0 1 0 493929378 239038464 54884 33554432000 4194304 4785740 140736567508960 18446744073709551615 4502156 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/12827/statm: 58359 54885 313 145 0 55404 0
[pid=12828] ppid=12825 vsize=482360 CPUtime=1.49 cores=2
/proc/12828/stat : 12828 (TNM) R 12825 12825 12375 0 -1 4202496 9781 0 0 0 148 1 0 0 20 0 1 0 493929378 493936640 9679 33554432000 134512640 134534564 4287294064 18446744073709551615 11032060 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/12828/statm: 120590 9679 90 6 0 119256 0
[pid=12829] ppid=12825 vsize=89612 CPUtime=1.49 cores=3
/proc/12829/stat : 12829 (march_hi) R 12825 12825 12375 0 -1 4194304 19929 0 0 0 145 4 0 0 20 0 1 0 493929378 91762688 19824 33554432000 4194304 4331988 140734748838416 18446744073709551615 212039655168 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/12829/statm: 22403 19824 113 34 0 20845 0
[pid=12830] ppid=12825 vsize=272600 CPUtime=1.49 cores=4-7
/proc/12830/stat : 12830 (plingeling) R 12825 12825 12375 0 -1 4202496 66990 1247 0 0 140 9 0 0 25 0 1 0 493929378 279142400 66796 33554432000 4194304 4356188 140733894519200 18446744073709551615 212039655168 0 0 4096 17442 0 0 0 17 6 0 0 0
/proc/12830/statm: 68150 66796 132 40 0 66694 0
Current children cumulated CPU time (s) 7.44
Current children cumulated vsize (KiB) 1396736

[startup+3.10081 s]
/proc/loadavg: 7.66 7.76 7.39 6/176 12836
/proc/meminfo: memFree=11432572/32951124 swapFree=67111528/67111528
[pid=12825] ppid=12823 vsize=18324 CPUtime=0 cores=0-7
/proc/12825/stat : 12825 (ppfolio) S 12823 12825 12375 0 -1 4202496 521 0 0 0 0 0 0 0 15 0 1 0 493929377 18763776 390 33554432000 4194304 4287625 140736383393472 18446744073709551615 212039675407 0 0 4096 65536 4360101269612789759 0 0 17 6 0 0 0
/proc/12825/statm: 4581 390 341 23 0 91 0
[pid=12826] ppid=12825 vsize=743516 CPUtime=3.09 cores=0
/proc/12826/stat : 12826 (cryptominisat) R 12825 12825 12375 0 -1 4202496 148597 0 0 0 285 24 0 0 25 0 1 0 493929378 761360384 146129 33554432000 4194304 4587354 140736909079920 18446744073709551615 4357600 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/12826/statm: 185879 146129 311 96 0 182441 0
[pid=12827] ppid=12825 vsize=296432 CPUtime=3.09 cores=1
/proc/12827/stat : 12827 (clasp) R 12825 12825 12375 0 -1 4202496 79199 0 0 0 296 13 0 0 25 0 1 0 493929378 303546368 69767 33554432000 4194304 4785740 140736567508960 18446744073709551615 4495638 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/12827/statm: 74108 69767 317 145 0 71153 0
[pid=12828] ppid=12825 vsize=516944 CPUtime=3.08 cores=2
/proc/12828/stat : 12828 (TNM) R 12825 12825 12375 0 -1 4202496 20550 0 0 0 305 3 0 0 25 0 1 0 493929378 529350656 20448 33554432000 134512640 134534564 4287294064 18446744073709551615 4294960144 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/12828/statm: 129236 20448 90 6 0 127902 0
[pid=12829] ppid=12825 vsize=247160 CPUtime=3.08 cores=3
/proc/12829/stat : 12829 (march_hi) R 12825 12825 12375 0 -1 4194304 38842 0 0 0 299 9 0 0 25 0 1 0 493929378 253091840 38736 33554432000 4194304 4331988 140734748838416 18446744073709551615 4256805 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/12829/statm: 61790 38736 116 34 0 60232 0
[pid=12830] ppid=12825 vsize=534744 CPUtime=3.08 cores=4-7
/proc/12830/stat : 12830 (plingeling) R 12825 12825 12375 0 -1 4202496 132526 1247 0 0 291 17 0 0 25 0 1 0 493929378 547577856 132332 33554432000 4194304 4356188 140733894519200 18446744073709551615 212039655168 0 0 4096 17442 0 0 0 17 6 0 0 0
/proc/12830/statm: 133686 132332 132 40 0 132230 0
Current children cumulated CPU time (s) 15.42
Current children cumulated vsize (KiB) 2357120

[startup+6.30121 s]
/proc/loadavg: 7.53 7.73 7.38 9/180 12840
/proc/meminfo: memFree=10168484/32951124 swapFree=67111528/67111528
[pid=12825] ppid=12823 vsize=18324 CPUtime=0 cores=0-7
/proc/12825/stat : 12825 (ppfolio) S 12823 12825 12375 0 -1 4202496 521 0 0 0 0 0 0 0 15 0 1 0 493929377 18763776 390 33554432000 4194304 4287625 140736383393472 18446744073709551615 212039675407 0 0 4096 65536 4360101269612789759 0 0 17 6 0 0 0
/proc/12825/statm: 4581 390 341 23 0 91 0
[pid=12826] ppid=12825 vsize=753528 CPUtime=6.28 cores=0
/proc/12826/stat : 12826 (cryptominisat) R 12825 12825 12375 0 -1 4202496 150681 0 0 0 604 24 0 0 25 0 1 0 493929378 771612672 148213 33554432000 4194304 4587354 140736909079920 18446744073709551615 4357662 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/12826/statm: 188382 148213 311 96 0 184944 0
[pid=12827] ppid=12825 vsize=296432 CPUtime=6.29 cores=1
/proc/12827/stat : 12827 (clasp) R 12825 12825 12375 0 -1 4202496 79199 0 0 0 616 13 0 0 25 0 1 0 493929378 303546368 69767 33554432000 4194304 4785740 140736567508960 18446744073709551615 4495638 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/12827/statm: 74108 69767 317 145 0 71153 0
[pid=12828] ppid=12825 vsize=809928 CPUtime=6.28 cores=2
/proc/12828/stat : 12828 (TNM) R 12825 12825 12375 0 -1 4202496 98453 0 0 0 613 15 0 0 25 0 1 0 493929378 829366272 98350 33554432000 134512640 134534564 4287294064 18446744073709551615 134524664 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/12828/statm: 202482 98350 91 6 0 201148 0
[pid=12829] ppid=12825 vsize=257988 CPUtime=6.29 cores=3
/proc/12829/stat : 12829 (march_hi) R 12825 12825 12375 0 -1 4194304 106256 0 0 0 608 21 0 0 25 0 1 0 493929378 264179712 41467 33554432000 4194304 4331988 140734748838416 18446744073709551615 212039315995 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/12829/statm: 64497 41467 128 34 0 62939 0
[pid=12830] ppid=12825 vsize=964820 CPUtime=10.01 cores=4-7
/proc/12830/stat : 12830 (plingeling) S 12825 12825 12375 0 -1 4202496 273804 1247 0 0 958 43 0 0 25 0 5 0 493929378 987975680 229629 33554432000 4194304 4356188 140733894519200 18446744073709551615 212051458021 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/12830/statm: 241205 229629 146 40 0 239749 0
[pid=12830/tid=12837] ppid=12825 vsize=964820 CPUtime=1.24 cores=4-7
/proc/12830/task/12837/stat : 12837 (plingeling) R 12825 12825 12375 0 -1 4202560 18932 1247 0 0 122 2 0 0 25 0 5 0 493929882 987975680 229629 33554432000 4194304 4356188 140733894519200 18446744073709551615 4238570 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=12830/tid=12838] ppid=12825 vsize=964820 CPUtime=1.25 cores=4-7
/proc/12830/task/12838/stat : 12838 (plingeling) R 12825 12825 12375 0 -1 4202560 18934 1247 0 0 120 5 0 0 25 0 5 0 493929882 987975680 229629 33554432000 4194304 4356188 140733894519200 18446744073709551615 4238570 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=12830/tid=12839] ppid=12825 vsize=964820 CPUtime=1.21 cores=4-7
/proc/12830/task/12839/stat : 12839 (plingeling) R 12825 12825 12375 0 -1 4202560 18935 1247 0 0 119 2 0 0 25 0 5 0 493929882 987975680 229629 33554432000 4194304 4356188 140733894519200 18446744073709551615 4238570 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=12830/tid=12840] ppid=12825 vsize=964820 CPUtime=1.24 cores=4-7
/proc/12830/task/12840/stat : 12840 (plingeling) R 12825 12825 12375 0 -1 4202560 18929 1247 0 0 118 6 0 0 25 0 5 0 493929882 987975680 229629 33554432000 4194304 4356188 140733894519200 18446744073709551615 4238570 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 35.15
Current children cumulated vsize (KiB) 3101020

[startup+12.7011 s]
/proc/loadavg: 7.56 7.73 7.38 9/180 12840
/proc/meminfo: memFree=9670180/32951124 swapFree=67111528/67111528
[pid=12825] ppid=12823 vsize=18324 CPUtime=0 cores=0-7
/proc/12825/stat : 12825 (ppfolio) S 12823 12825 12375 0 -1 4202496 521 0 0 0 0 0 0 0 15 0 1 0 493929377 18763776 390 33554432000 4194304 4287625 140736383393472 18446744073709551615 212039675407 0 0 4096 65536 4360101269612789759 0 0 17 6 0 0 0
/proc/12825/statm: 4581 390 341 23 0 91 0
[pid=12826] ppid=12825 vsize=753528 CPUtime=12.68 cores=0
/proc/12826/stat : 12826 (cryptominisat) R 12825 12825 12375 0 -1 4202496 150681 0 0 0 1244 24 0 0 25 0 1 0 493929378 771612672 148213 33554432000 4194304 4587354 140736909079920 18446744073709551615 4357642 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/12826/statm: 188382 148213 311 96 0 184944 0
[pid=12827] ppid=12825 vsize=296432 CPUtime=12.69 cores=1
/proc/12827/stat : 12827 (clasp) R 12825 12825 12375 0 -1 4202496 79200 0 0 0 1256 13 0 0 25 0 1 0 493929378 303546368 69768 33554432000 4194304 4785740 140736567508960 18446744073709551615 4495610 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/12827/statm: 74108 69768 318 145 0 71153 0
[pid=12828] ppid=12825 vsize=809928 CPUtime=12.68 cores=2
/proc/12828/stat : 12828 (TNM) R 12825 12825 12375 0 -1 4202496 98453 0 0 0 1253 15 0 0 25 0 1 0 493929378 829366272 98350 33554432000 134512640 134534564 4287294064 18446744073709551615 134524691 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/12828/statm: 202482 98350 91 6 0 201148 0
[pid=12829] ppid=12825 vsize=425700 CPUtime=12.69 cores=3
/proc/12829/stat : 12829 (march_hi) R 12825 12825 12375 0 -1 4202496 376726 0 0 0 1207 62 0 0 25 0 1 0 493929378 435916800 68769 33554432000 4194304 4331988 140734748838416 18446744073709551615 4252200 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/12829/statm: 106425 68771 148 34 0 104867 0
[pid=12830] ppid=12825 vsize=1323552 CPUtime=35.52 cores=4-7
/proc/12830/stat : 12830 (plingeling) S 12825 12825 12375 0 -1 4202496 374391 1247 0 0 3481 71 0 0 25 0 5 0 493929378 1355317248 319312 33554432000 4194304 4356188 140733894519200 18446744073709551615 212051458021 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/12830/statm: 330888 319312 162 40 0 329432 0
[pid=12830/tid=12837] ppid=12825 vsize=1323552 CPUtime=7.64 cores=4-7
/proc/12830/task/12837/stat : 12837 (plingeling) R 12825 12825 12375 0 -1 4202560 52389 1247 0 0 754 10 0 0 25 0 5 0 493929882 1355317248 319312 33554432000 4194304 4356188 140733894519200 18446744073709551615 4270759 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=12830/tid=12838] ppid=12825 vsize=1323552 CPUtime=7.64 cores=4-7
/proc/12830/task/12838/stat : 12838 (plingeling) R 12825 12825 12375 0 -1 4202560 52315 1247 0 0 750 14 0 0 25 0 5 0 493929882 1355317248 319312 33554432000 4194304 4356188 140733894519200 18446744073709551615 4270728 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=12830/tid=12839] ppid=12825 vsize=1323552 CPUtime=7.57 cores=4-7
/proc/12830/task/12839/stat : 12839 (plingeling) R 12825 12825 12375 0 -1 4202560 52568 1247 0 0 744 13 0 0 25 0 5 0 493929882 1355317248 319312 33554432000 4194304 4356188 140733894519200 18446744073709551615 4270898 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=12830/tid=12840] ppid=12825 vsize=1323552 CPUtime=7.6 cores=4-7
/proc/12830/task/12840/stat : 12840 (plingeling) R 12825 12825 12375 0 -1 4202560 19045 1247 0 0 754 6 0 0 25 0 5 0 493929882 1355317248 319312 33554432000 4194304 4356188 140733894519200 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 86.26
Current children cumulated vsize (KiB) 3627464

[startup+25.5008 s]
/proc/loadavg: 7.66 7.75 7.39 9/180 12840
/proc/meminfo: memFree=9864548/32951124 swapFree=67111528/67111528
[pid=12825] ppid=12823 vsize=18324 CPUtime=0 cores=0-7
/proc/12825/stat : 12825 (ppfolio) S 12823 12825 12375 0 -1 4202496 521 0 0 0 0 0 0 0 15 0 1 0 493929377 18763776 390 33554432000 4194304 4287625 140736383393472 18446744073709551615 212039675407 0 0 4096 65536 4360101269612789759 0 0 17 6 0 0 0
/proc/12825/statm: 4581 390 341 23 0 91 0
[pid=12826] ppid=12825 vsize=796312 CPUtime=25.49 cores=0
/proc/12826/stat : 12826 (cryptominisat) R 12825 12825 12375 0 -1 4202496 224667 0 0 0 2514 35 0 0 25 0 1 0 493929378 815423488 166505 33554432000 4194304 4587354 140736909079920 18446744073709551615 4357604 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/12826/statm: 199078 166505 316 96 0 195640 0
[pid=12827] ppid=12825 vsize=296432 CPUtime=25.49 cores=1
/proc/12827/stat : 12827 (clasp) R 12825 12825 12375 0 -1 4202496 79200 0 0 0 2536 13 0 0 25 0 1 0 493929378 303546368 69768 33554432000 4194304 4785740 140736567508960 18446744073709551615 4495638 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/12827/statm: 74108 69768 318 145 0 71153 0
[pid=12828] ppid=12825 vsize=809928 CPUtime=25.48 cores=2
/proc/12828/stat : 12828 (TNM) R 12825 12825 12375 0 -1 4202496 98453 0 0 0 2533 15 0 0 25 0 1 0 493929378 829366272 98350 33554432000 134512640 134534564 4287294064 18446744073709551615 134524536 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/12828/statm: 202482 98350 91 6 0 201148 0
[pid=12829] ppid=12825 vsize=478224 CPUtime=25.49 cores=3
/proc/12829/stat : 12829 (march_hi) R 12825 12825 12375 0 -1 4202496 609707 0 0 0 2449 100 0 0 25 0 1 0 493929378 489701376 96186 33554432000 4194304 4331988 140734748838416 18446744073709551615 4226625 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/12829/statm: 119556 96186 151 34 0 117998 0
[pid=12830] ppid=12825 vsize=933412 CPUtime=86.65 cores=4-7
/proc/12830/stat : 12830 (plingeling) S 12825 12825 12375 0 -1 4202496 380673 1247 0 0 8592 73 0 0 25 0 5 0 493929378 955813888 221777 33554432000 4194304 4356188 140733894519200 18446744073709551615 212051458021 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/12830/statm: 233353 221777 162 40 0 231897 0
[pid=12830/tid=12837] ppid=12825 vsize=933412 CPUtime=20.44 cores=4-7
/proc/12830/task/12837/stat : 12837 (plingeling) R 12825 12825 12375 0 -1 4202560 52677 1247 0 0 2033 11 0 0 25 0 5 0 493929882 955813888 221777 33554432000 4194304 4356188 140733894519200 18446744073709551615 4330862 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=12830/tid=12838] ppid=12825 vsize=933412 CPUtime=20.45 cores=4-7

################
# More data... #
################

[pid=12828] ppid=12825 vsize=809928 CPUtime=4781.78 cores=2
/proc/12828/stat : 12828 (TNM) R 12825 12825 12375 0 -1 4202496 98453 0 0 0 478162 16 0 0 25 0 1 0 493929378 829366272 98350 33554432000 134512640 134534564 4287294064 18446744073709551615 134524691 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/12828/statm: 202482 98350 91 6 0 201148 0
[pid=12829] ppid=12825 vsize=20630696 CPUtime=4782.42 cores=3
/proc/12829/stat : 12829 (march_hi) R 12825 12825 12375 0 -1 4202496 4898368 0 0 0 475779 2463 0 0 25 0 1 0 493929378 21125832704 4384847 33554432000 4194304 4331988 140734748838416 18446744073709551615 4271154 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/12829/statm: 5157674 4384847 151 34 0 5156116 0
[pid=12830] ppid=12825 vsize=1073592 CPUtime=19087 cores=4-7
/proc/12830/stat : 12830 (plingeling) S 12825 12825 12375 0 -1 4202496 845166 1247 0 0 1908560 139 0 0 25 0 5 0 493929378 1099358208 256822 33554432000 4194304 4356188 140733894519200 18446744073709551615 212051458021 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/12830/statm: 268398 256822 162 40 0 266942 0
[pid=12830/tid=12837] ppid=12825 vsize=1073592 CPUtime=4776.7 cores=4-7
/proc/12830/task/12837/stat : 12837 (plingeling) R 12825 12825 12375 0 -1 4202560 181778 1247 0 0 477638 32 0 0 25 0 5 0 493929882 1099358208 256822 33554432000 4194304 4356188 140733894519200 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=12830/tid=12838] ppid=12825 vsize=1073592 CPUtime=4776.64 cores=4-7
/proc/12830/task/12838/stat : 12838 (plingeling) R 12825 12825 12375 0 -1 4202560 187456 1247 0 0 477630 34 0 0 25 0 5 0 493929882 1099358208 256822 33554432000 4194304 4356188 140733894519200 18446744073709551615 4331296 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=12830/tid=12839] ppid=12825 vsize=1073592 CPUtime=4777.29 cores=4-7
/proc/12830/task/12839/stat : 12839 (plingeling) R 12825 12825 12375 0 -1 4202560 201029 1247 0 0 477696 33 0 0 25 0 5 0 493929882 1099358208 256822 33554432000 4194304 4356188 140733894519200 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=12830/tid=12840] ppid=12825 vsize=1073592 CPUtime=4751.3 cores=4-7
/proc/12830/task/12840/stat : 12840 (plingeling) R 12825 12825 12375 0 -1 4202560 76829 1247 0 0 475117 13 0 0 25 0 5 0 493929882 1099358208 256822 33554432000 4194304 4356188 140733894519200 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 38215.3
Current children cumulated vsize (KiB) 24951416

[startup+4842.3 s]
/proc/loadavg: 8.06 8.05 8.00 9/180 12981
/proc/meminfo: memFree=91896/32951124 swapFree=67111524/67111528
[pid=12825] ppid=12823 vsize=18324 CPUtime=0 cores=0-7
/proc/12825/stat : 12825 (ppfolio) S 12823 12825 12375 0 -1 4202496 521 0 0 0 0 0 0 0 15 0 1 0 493929377 18763776 390 33554432000 4194304 4287625 140736383393472 18446744073709551615 212039675407 0 0 4096 65536 4360101269612789759 0 0 17 6 0 0 0
/proc/12825/statm: 4581 390 341 23 0 91 0
[pid=12826] ppid=12825 vsize=844400 CPUtime=4841.71 cores=0
/proc/12826/stat : 12826 (cryptominisat) R 12825 12825 12375 0 -1 4202496 1006129 0 0 0 484018 153 0 0 25 0 1 0 493929378 864665600 180058 33554432000 4194304 4587354 140736909079920 18446744073709551615 4388277 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/12826/statm: 211100 180058 338 96 0 207662 0
[pid=12827] ppid=12825 vsize=1579756 CPUtime=4842.41 cores=1
/proc/12827/stat : 12827 (clasp) R 12825 12825 12375 0 -1 4202496 397079 0 0 0 484117 124 0 0 25 0 1 0 493929378 1617670144 383330 33554432000 4194304 4785740 140736567508960 18446744073709551615 4552983 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/12827/statm: 394939 383330 340 145 0 391984 0
[pid=12828] ppid=12825 vsize=809928 CPUtime=4841.77 cores=2
/proc/12828/stat : 12828 (TNM) R 12825 12825 12375 0 -1 4202496 98453 0 0 0 484161 16 0 0 25 0 1 0 493929378 829366272 98350 33554432000 134512640 134534564 4287294064 18446744073709551615 134524664 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/12828/statm: 202482 98350 91 6 0 201148 0
[pid=12829] ppid=12825 vsize=20765864 CPUtime=4842.41 cores=3
/proc/12829/stat : 12829 (march_hi) R 12825 12825 12375 0 -1 4202496 4939900 0 0 0 481755 2486 0 0 25 0 1 0 493929378 21264244736 4426379 33554432000 4194304 4331988 140734748838416 18446744073709551615 4271136 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/12829/statm: 5191466 4426379 151 34 0 5189908 0
[pid=12830] ppid=12825 vsize=1073560 CPUtime=19326.7 cores=4-7
/proc/12830/stat : 12830 (plingeling) S 12825 12825 12375 0 -1 4202496 845166 1247 0 0 1932526 139 0 0 25 0 5 0 493929378 1099325440 256814 33554432000 4194304 4356188 140733894519200 18446744073709551615 212051458021 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/12830/statm: 268390 256814 162 40 0 266934 0
[pid=12830/tid=12837] ppid=12825 vsize=1073560 CPUtime=4836.68 cores=4-7
/proc/12830/task/12837/stat : 12837 (plingeling) R 12825 12825 12375 0 -1 4202560 181778 1247 0 0 483636 32 0 0 25 0 5 0 493929882 1099325440 256814 33554432000 4194304 4356188 140733894519200 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=12830/tid=12838] ppid=12825 vsize=1073560 CPUtime=4836.65 cores=4-7
/proc/12830/task/12838/stat : 12838 (plingeling) R 12825 12825 12375 0 -1 4202560 187456 1247 0 0 483631 34 0 0 25 0 5 0 493929882 1099325440 256814 33554432000 4194304 4356188 140733894519200 18446744073709551615 4331350 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=12830/tid=12839] ppid=12825 vsize=1073560 CPUtime=4837.29 cores=4-7
/proc/12830/task/12839/stat : 12839 (plingeling) R 12825 12825 12375 0 -1 4202560 201029 1247 0 0 483696 33 0 0 25 0 5 0 493929882 1099325440 256814 33554432000 4194304 4356188 140733894519200 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=12830/tid=12840] ppid=12825 vsize=1073560 CPUtime=4810.97 cores=4-7
/proc/12830/task/12840/stat : 12840 (plingeling) R 12825 12825 12375 0 -1 4202560 76829 1247 0 0 481084 13 0 0 25 0 5 0 493929882 1099325440 256814 33554432000 4194304 4356188 140733894519200 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 38694.9
Current children cumulated vsize (KiB) 25091832

[startup+4902.3 s]
/proc/loadavg: 8.07 8.06 8.00 9/180 12982
/proc/meminfo: memFree=92208/32951124 swapFree=67111524/67111528
[pid=12825] ppid=12823 vsize=18324 CPUtime=0 cores=0-7
/proc/12825/stat : 12825 (ppfolio) S 12823 12825 12375 0 -1 4202496 521 0 0 0 0 0 0 0 15 0 1 0 493929377 18763776 390 33554432000 4194304 4287625 140736383393472 18446744073709551615 212039675407 0 0 4096 65536 4360101269612789759 0 0 17 6 0 0 0
/proc/12825/statm: 4581 390 341 23 0 91 0
[pid=12826] ppid=12825 vsize=844400 CPUtime=4901.69 cores=0
/proc/12826/stat : 12826 (cryptominisat) R 12825 12825 12375 0 -1 4202496 1006129 0 0 0 490016 153 0 0 25 0 1 0 493929378 864665600 180058 33554432000 4194304 4587354 140736909079920 18446744073709551615 4388277 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/12826/statm: 211100 180058 338 96 0 207662 0
[pid=12827] ppid=12825 vsize=1579756 CPUtime=4902.41 cores=1
/proc/12827/stat : 12827 (clasp) R 12825 12825 12375 0 -1 4202496 397211 0 0 0 490117 124 0 0 25 0 1 0 493929378 1617670144 383462 33554432000 4194304 4785740 140736567508960 18446744073709551615 4287017 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/12827/statm: 394939 383462 340 145 0 391984 0
[pid=12828] ppid=12825 vsize=809928 CPUtime=4901.77 cores=2
/proc/12828/stat : 12828 (TNM) R 12825 12825 12375 0 -1 4202496 98453 0 0 0 490161 16 0 0 25 0 1 0 493929378 829366272 98350 33554432000 134512640 134534564 4287294064 18446744073709551615 134524734 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/12828/statm: 202482 98350 91 6 0 201148 0
[pid=12829] ppid=12825 vsize=20899712 CPUtime=4902.42 cores=3
/proc/12829/stat : 12829 (march_hi) R 12825 12825 12375 0 -1 4202496 4981292 0 0 0 487730 2512 0 0 25 0 1 0 493929378 21401305088 4467771 33554432000 4194304 4331988 140734748838416 18446744073709551615 4271184 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/12829/statm: 5224928 4467771 151 34 0 5223370 0
[pid=12830] ppid=12825 vsize=1077620 CPUtime=19566.3 cores=4-7
/proc/12830/stat : 12830 (plingeling) S 12825 12825 12375 0 -1 4202496 846190 1247 0 0 1956493 140 0 0 25 0 5 0 493929378 1103482880 257829 33554432000 4194304 4356188 140733894519200 18446744073709551615 212051458021 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/12830/statm: 269405 257829 162 40 0 267949 0
[pid=12830/tid=12837] ppid=12825 vsize=1077620 CPUtime=4896.67 cores=4-7
/proc/12830/task/12837/stat : 12837 (plingeling) R 12825 12825 12375 0 -1 4202560 181778 1247 0 0 489635 32 0 0 25 0 5 0 493929882 1103482880 257829 33554432000 4194304 4356188 140733894519200 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=12830/tid=12838] ppid=12825 vsize=1077620 CPUtime=4896.65 cores=4-7
/proc/12830/task/12838/stat : 12838 (plingeling) R 12825 12825 12375 0 -1 4202560 187456 1247 0 0 489631 34 0 0 25 0 5 0 493929882 1103482880 257829 33554432000 4194304 4356188 140733894519200 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=12830/tid=12839] ppid=12825 vsize=1077620 CPUtime=4897.29 cores=4-7
/proc/12830/task/12839/stat : 12839 (plingeling) R 12825 12825 12375 0 -1 4202560 201104 1247 0 0 489696 33 0 0 25 0 5 0 493929882 1103482880 257829 33554432000 4194304 4356188 140733894519200 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=12830/tid=12840] ppid=12825 vsize=1077620 CPUtime=4870.66 cores=4-7
/proc/12830/task/12840/stat : 12840 (plingeling) R 12825 12825 12375 0 -1 4202560 77778 1247 0 0 487052 14 0 0 25 0 5 0 493929882 1103482880 257829 33554432000 4194304 4356188 140733894519200 18446744073709551615 4331011 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 39174.6
Current children cumulated vsize (KiB) 25229740

[startup+4962.3 s]
/proc/loadavg: 8.06 8.06 8.00 9/180 12984
/proc/meminfo: memFree=96336/32951124 swapFree=67111524/67111528
[pid=12825] ppid=12823 vsize=18324 CPUtime=0 cores=0-7
/proc/12825/stat : 12825 (ppfolio) S 12823 12825 12375 0 -1 4202496 521 0 0 0 0 0 0 0 15 0 1 0 493929377 18763776 390 33554432000 4194304 4287625 140736383393472 18446744073709551615 212039675407 0 0 4096 65536 4360101269612789759 0 0 17 6 0 0 0
/proc/12825/statm: 4581 390 341 23 0 91 0
[pid=12826] ppid=12825 vsize=844400 CPUtime=4961.68 cores=0
/proc/12826/stat : 12826 (cryptominisat) R 12825 12825 12375 0 -1 4202496 1006129 0 0 0 496014 154 0 0 25 0 1 0 493929378 864665600 180058 33554432000 4194304 4587354 140736909079920 18446744073709551615 4388277 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/12826/statm: 211100 180058 338 96 0 207662 0
[pid=12827] ppid=12825 vsize=1582636 CPUtime=4962.4 cores=1
/proc/12827/stat : 12827 (clasp) R 12825 12825 12375 0 -1 4202496 397883 0 0 0 496116 124 0 0 25 0 1 0 493929378 1620619264 384134 33554432000 4194304 4785740 140736567508960 18446744073709551615 4287028 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/12827/statm: 395659 384134 340 145 0 392704 0
[pid=12828] ppid=12825 vsize=809928 CPUtime=4961.76 cores=2
/proc/12828/stat : 12828 (TNM) R 12825 12825 12375 0 -1 4202496 98453 0 0 0 496160 16 0 0 25 0 1 0 493929378 829366272 98350 33554432000 134512640 134534564 4287294064 18446744073709551615 134524691 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/12828/statm: 202482 98350 91 6 0 201148 0
[pid=12829] ppid=12825 vsize=21048608 CPUtime=4962.42 cores=3
/proc/12829/stat : 12829 (march_hi) R 12825 12825 12375 0 -1 4202496 5026726 0 0 0 493703 2539 0 0 25 0 1 0 493929378 21553774592 4513205 33554432000 4194304 4331988 140734748838416 18446744073709551615 4271172 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/12829/statm: 5262152 4513205 151 34 0 5260594 0
[pid=12830] ppid=12825 vsize=1082016 CPUtime=19806 cores=4-7
/proc/12830/stat : 12830 (plingeling) S 12825 12825 12375 0 -1 4202496 847289 1247 0 0 1980458 140 0 0 25 0 5 0 493929378 1107984384 258928 33554432000 4194304 4356188 140733894519200 18446744073709551615 212051458021 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/12830/statm: 270504 258928 162 40 0 269048 0
[pid=12830/tid=12837] ppid=12825 vsize=1082016 CPUtime=4956.65 cores=4-7
/proc/12830/task/12837/stat : 12837 (plingeling) R 12825 12825 12375 0 -1 4202560 181778 1247 0 0 495633 32 0 0 25 0 5 0 493929882 1107984384 258928 33554432000 4194304 4356188 140733894519200 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=12830/tid=12838] ppid=12825 vsize=1082016 CPUtime=4956.65 cores=4-7
/proc/12830/task/12838/stat : 12838 (plingeling) R 12825 12825 12375 0 -1 4202560 187531 1247 0 0 495631 34 0 0 25 0 5 0 493929882 1107984384 258928 33554432000 4194304 4356188 140733894519200 18446744073709551615 4332046 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=12830/tid=12839] ppid=12825 vsize=1082016 CPUtime=4957.29 cores=4-7
/proc/12830/task/12839/stat : 12839 (plingeling) R 12825 12825 12375 0 -1 4202560 202128 1247 0 0 495696 33 0 0 25 0 5 0 493929882 1107984384 258928 33554432000 4194304 4356188 140733894519200 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=12830/tid=12840] ppid=12825 vsize=1082016 CPUtime=4930.33 cores=4-7
/proc/12830/task/12840/stat : 12840 (plingeling) R 12825 12825 12375 0 -1 4202560 77778 1247 0 0 493019 14 0 0 25 0 5 0 493929882 1107984384 258928 33554432000 4194304 4356188 140733894519200 18446744073709551615 4234340 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 39654.2
Current children cumulated vsize (KiB) 25385912



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5005.6 s]
/proc/loadavg: 8.08 8.06 8.00 9/180 12985
/proc/meminfo: memFree=96736/32951124 swapFree=67111524/67111528
[pid=12825] ppid=12823 vsize=18324 CPUtime=0 cores=0-7
/proc/12825/stat : 12825 (ppfolio) S 12823 12825 12375 0 -1 4202496 521 0 0 0 0 0 0 0 15 0 1 0 493929377 18763776 390 33554432000 4194304 4287625 140736383393472 18446744073709551615 212039675407 0 0 4096 65536 4360101269612789759 0 0 17 6 0 0 0
/proc/12825/statm: 4581 390 341 23 0 91 0
[pid=12826] ppid=12825 vsize=844400 CPUtime=5004.98 cores=0
/proc/12826/stat : 12826 (cryptominisat) R 12825 12825 12375 0 -1 4202496 1006129 0 0 0 500343 155 0 0 25 0 1 0 493929378 864665600 180058 33554432000 4194304 4587354 140736909079920 18446744073709551615 4388264 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/12826/statm: 211100 180058 338 96 0 207662 0
[pid=12827] ppid=12825 vsize=1582636 CPUtime=5005.71 cores=1
/proc/12827/stat : 12827 (clasp) R 12825 12825 12375 0 -1 4202496 397999 0 0 0 500447 124 0 0 25 0 1 0 493929378 1620619264 384250 33554432000 4194304 4785740 140736567508960 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/12827/statm: 395659 384250 340 145 0 392704 0
[pid=12828] ppid=12825 vsize=809928 CPUtime=5005.07 cores=2
/proc/12828/stat : 12828 (TNM) R 12825 12825 12375 0 -1 4202496 98453 0 0 0 500491 16 0 0 25 0 1 0 493929378 829366272 98350 33554432000 134512640 134534564 4287294064 18446744073709551615 134524677 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/12828/statm: 202482 98350 91 6 0 201148 0
[pid=12829] ppid=12825 vsize=21146948 CPUtime=5005.73 cores=3
/proc/12829/stat : 12829 (march_hi) R 12825 12825 12375 0 -1 4202496 5057293 0 0 0 498015 2558 0 0 25 0 1 0 493929378 21654474752 4543772 33554432000 4194304 4331988 140734748838416 18446744073709551615 4271154 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/12829/statm: 5286737 4543772 151 34 0 5285179 0
[pid=12830] ppid=12825 vsize=1081972 CPUtime=19978.9 cores=4-7
/proc/12830/stat : 12830 (plingeling) S 12825 12825 12375 0 -1 4202496 847289 1247 0 0 1997755 140 0 0 25 0 5 0 493929378 1107939328 258917 33554432000 4194304 4356188 140733894519200 18446744073709551615 212051458021 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/12830/statm: 270493 258917 162 40 0 269037 0
[pid=12830/tid=12837] ppid=12825 vsize=1081972 CPUtime=4999.95 cores=4-7
/proc/12830/task/12837/stat : 12837 (plingeling) R 12825 12825 12375 0 -1 4202560 181778 1247 0 0 499963 32 0 0 25 0 5 0 493929882 1107939328 258917 33554432000 4194304 4356188 140733894519200 18446744073709551615 4332145 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=12830/tid=12838] ppid=12825 vsize=1081972 CPUtime=4999.96 cores=4-7
/proc/12830/task/12838/stat : 12838 (plingeling) R 12825 12825 12375 0 -1 4202560 187531 1247 0 0 499962 34 0 0 25 0 5 0 493929882 1107939328 258917 33554432000 4194304 4356188 140733894519200 18446744073709551615 4330862 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=12830/tid=12839] ppid=12825 vsize=1081972 CPUtime=5000.6 cores=4-7
/proc/12830/task/12839/stat : 12839 (plingeling) R 12825 12825 12375 0 -1 4202560 202128 1247 0 0 500027 33 0 0 25 0 5 0 493929882 1107939328 258917 33554432000 4194304 4356188 140733894519200 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=12830/tid=12840] ppid=12825 vsize=1081972 CPUtime=4973.39 cores=4-7
/proc/12830/task/12840/stat : 12840 (plingeling) R 12825 12825 12375 0 -1 4202560 77778 1247 0 0 497325 14 0 0 25 0 5 0 493929882 1107939328 258917 33554432000 4194304 4356188 140733894519200 18446744073709551615 4331055 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 40000.4
Current children cumulated vsize (KiB) 25484208

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 12825 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=2999
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=2999
# CPU time returned by wait4() is 0.005998
# while last known CPU time is 40000.4
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 5005.62
CPU time (s): 40000.4
CPU user time (s): 39970.5
CPU system time (s): 29.93
CPU usage (%): 799.111
Max. virtual memory (cumulated for all children) (KiB): 25484208

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.002999
system time used= 0.002999
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 521
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 101
involuntary context switches= 7

runsolver used 7.2679 second user time and 20.041 second system time

The end

Launcher Data 

Begin job on node146 at 2011-04-28 20:25:31
IDJOB=3310352
IDBENCH=83466
IDSOLVER=1638
FILE ID=node146/3310352-1304015128
RUNJOBID= node146-1304009324-12389
PBS_JOBID= 13168852
Free space on /tmp= 72884 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT11/application/leberre/2dimensionalstrippacking/E00N23.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3310352-1304015128/watcher-3310352-1304015128 -o /tmp/evaluation-result-3310352-1304015128/solver-3310352-1304015128 -C 40000 -W 5100 -M 31000  ppfolio HOME/instance-3310352-1304015128.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 1a1f0dddf727883e0973677dd00e9269
RANDOM SEED=1713517083

node146.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.86
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      12471992 kB
Buffers:       2088172 kB
Cached:       17788612 kB
SwapCached:          0 kB
Active:       10231836 kB
Inactive:      9708480 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      12471992 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:          125836 kB
Writeback:           0 kB
AnonPages:       62996 kB
Mapped:          14544 kB
Slab:           473860 kB
PageTables:       4300 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   185980 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72876 MiB
End job on node146 at 2011-04-28 21:48:59