Trace number 3317935

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-industrial? (TO) 4800.14 1286.39

General information on the benchmark

Nameapplication/rintanen/SATPlanning/
sokoban-sequential-p145-microban-sequential.080-SAT.cnf
MD5SUM1ca09a2b911e29894c6603aee8d3e672
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark153.91
Satisfiable
(Un)Satisfiability was proved
Number of variables175084
Number of clauses2826936
Sum of the clauses size6454456
Maximum clause length78
Minimum clause length1
Number of clauses of size 1696
Number of clauses of size 22728320
Number of clauses of size 37680
Number of clauses of size 435520
Number of clauses of size 515360
Number of clauses of size over 539360

Solver Data 

0.25/1.50	c INFO: loaded portfolio from HOME/etc/borg-mix+class.industrial.pickle
0.25/1.50	c INFO: solving HOME/instance-3317935-1304268858.cnf
0.25/1.50	c INFO: computing task features
8.51/9.66	c INFO: computed variable-clause graph statistics
8.80/9.97	c INFO: computed clause balance statistics
44.10/45.29	c INFO: computed variable balance statistics
72.80/73.93	c INFO: computed small-clause counts
73.41/74.51	c INFO: computed Horn-clause counts
109.51/110.65	c INFO: computed variable graph statistics
109.51/110.66	c INFO: collected features for HOME/instance-3317935-1304268858.cnf in 108.84 s
109.51/110.68	c INFO: running lingeling-276@0 for 97 with 4690 remaining (b = 0.46)
109.60/110.71	c INFO: running cryptominisat-2.9.0@0 for 485 with 4690 remaining (b = 0.31)
109.60/110.74	c INFO: running lingeling-276@0 for 485 with 4690 remaining (b = 0.28)
109.60/110.77	c INFO: running precosat-570@0 for 97 with 4690 remaining (b = 0.11)
509.29/210.85	c INFO: running cryptominisat-2.9.0@0 for 1649 with 4590 remaining (b = 0.41)
509.64/210.94	c INFO: running lingeling-276@0 for 1164 with 4590 remaining (b = 0.27)
2068.96/601.35	c INFO: running lingeling-276@0 for 97 with 4200 remaining (b = 0.17)
2089.31/606.49	c INFO: running precosat-570@99 for 97 with 4195 remaining (b = 0.04)
2469.08/701.54	c INFO: running precosat-570@0 for 97 with 4099 remaining (b = 0.06)
2477.44/703.65	c INFO: running precosat-570@199 for 97 with 4097 remaining (b = 0.02)
2865.01/800.74	c INFO: running precosat-570@97 for 97 with 4000 remaining (b = 0.02)
2877.37/803.82	c INFO: running precosat-570@298 for 97 with 3997 remaining (b = 0.04)
3256.50/898.96	c INFO: running precosat-570@0 for 97 with 3902 remaining (b = 0.04)
3264.45/900.90	c INFO: running lingeling-276@490 for 776 with 3900 remaining (b = 0.15)
3651.77/998.19	c INFO: running lingeling-276@0 for 97 with 3803 remaining (b = 0.07)
4050.97/1098.36	c INFO: running cryptominisat-2.9.0@0 for 1552 with 3703 remaining (b = 0.30)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3317935-1304268858/watcher-3317935-1304268858 -o /tmp/evaluation-result-3317935-1304268858/solver-3317935-1304268858 -C 4800 -W 1300 -M 15500 python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3317935-1304268858.cnf -seed 30873738 -budget 4800 -cores 4 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.63 4.89 5.20 2/188 9871
/proc/meminfo: memFree=23937308/32951124 swapFree=67111412/67111528
[pid=9871] ppid=9869 vsize=15184 CPUtime=0 cores=1,3,5,7
/proc/9871/stat : 9871 (python) S 9869 9871 9574 0 -1 4202496 728 0 0 0 0 0 0 0 21 0 1 0 538484177 15548416 617 33554432000 4194304 5683644 140735091804560 18446744073709551615 232335890432 0 2147483391 16781312 2 18446744071699453118 0 0 17 3 0 0 0
/proc/9871/statm: 3796 617 322 364 0 283 0

[startup+0.092363 s]
/proc/loadavg: 2.63 4.89 5.20 2/188 9871
/proc/meminfo: memFree=23937308/32951124 swapFree=67111412/67111528
[pid=9871] ppid=9869 vsize=84528 CPUtime=0.06 cores=1,3,5,7
/proc/9871/stat : 9871 (python) R 9869 9871 9574 0 -1 4202496 2206 0 0 0 4 2 0 0 17 0 1 0 538484177 86556672 1954 33554432000 4194304 5683644 140735091804560 18446744073709551615 232330930065 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/9871/statm: 21132 1958 579 364 0 1336 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 84528

[startup+0.100354 s]
/proc/loadavg: 2.63 4.89 5.20 2/188 9871
/proc/meminfo: memFree=23937308/32951124 swapFree=67111412/67111528
[pid=9871] ppid=9869 vsize=85624 CPUtime=0.06 cores=1,3,5,7
/proc/9871/stat : 9871 (python) S 9869 9871 9574 0 -1 4202496 2630 0 0 0 4 2 0 0 17 0 1 0 538484177 87678976 2348 33554432000 4194304 5683644 140735091804560 18446744073709551615 232335890432 0 2147483391 16781312 2 18446744071699453118 0 0 17 3 0 0 0
/proc/9871/statm: 21406 2348 713 364 0 1623 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 85624

[startup+0.300401 s]
/proc/loadavg: 2.63 4.89 5.20 2/188 9871
/proc/meminfo: memFree=23937308/32951124 swapFree=67111412/67111528
[pid=9871] ppid=9869 vsize=135752 CPUtime=0.18 cores=1,3,5,7
/proc/9871/stat : 9871 (python) R 9869 9871 9574 0 -1 4202496 5964 936 1 0 13 5 0 0 17 0 1 0 538484177 139010048 4150 33554432000 4194304 5683644 140735091804560 18446744073709551615 232335888389 0 2147483391 16781312 2 0 0 0 17 3 0 0 0
/proc/9871/statm: 33938 4150 1032 364 0 3124 0
Current children cumulated CPU time (s) 0.18
Current children cumulated vsize (KiB) 135752

[startup+0.700259 s]
/proc/loadavg: 2.63 4.89 5.20 2/188 9871
/proc/meminfo: memFree=23937308/32951124 swapFree=67111412/67111528
[pid=9871] ppid=9869 vsize=157384 CPUtime=0.25 cores=1,3,5,7
/proc/9871/stat : 9871 (python) D 9869 9871 9574 0 -1 4202496 6590 936 1 0 17 8 0 0 16 0 1 0 538484177 161161216 4696 33554432000 4194304 5683644 140735091804560 18446744073709551615 232335898167 0 0 16781312 2 18446744071562154983 0 0 17 3 0 0 0
/proc/9871/statm: 39346 4696 1257 364 0 3454 0
Current children cumulated CPU time (s) 0.25
Current children cumulated vsize (KiB) 157384

[startup+2.34697 s]
/proc/loadavg: 2.63 4.89 5.20 2/188 9871
/proc/meminfo: memFree=23937308/32951124 swapFree=67111412/67111528
[pid=9871] ppid=9869 vsize=388688 CPUtime=1.25 cores=1,3,5,7
/proc/9871/stat : 9871 (python) R 9869 9871 9574 0 -1 4202496 36294 936 1 0 109 16 0 0 16 0 1 0 538484177 398016512 33970 33554432000 4194304 5683644 140735091804560 18446744073709551615 232335553221 0 0 16781312 2 0 0 0 17 3 0 0 81
/proc/9871/statm: 97172 33972 1761 364 0 33096 0
Current children cumulated CPU time (s) 1.25
Current children cumulated vsize (KiB) 388688
heavy processes:

[startup+3.10084 s]
/proc/loadavg: 2.63 4.89 5.20 3/189 9876
/proc/meminfo: memFree=23797284/32951124 swapFree=67111412/67111528
[pid=9871] ppid=9869 vsize=442504 CPUtime=2 cores=1,3,5,7
/proc/9871/stat : 9871 (python) R 9869 9871 9574 0 -1 4202496 49688 936 1 0 182 18 0 0 17 0 1 0 538484177 453124096 47364 33554432000 4194304 5683644 140735091804560 18446744073709551615 4445115 0 0 16781312 2 0 0 0 17 3 0 0 81
/proc/9871/statm: 110626 47365 1761 364 0 46550 0
Current children cumulated CPU time (s) 2
Current children cumulated vsize (KiB) 442504
heavy processes:

[startup+6.30027 s]
/proc/loadavg: 2.58 4.84 5.18 3/189 9876
/proc/meminfo: memFree=23564028/32951124 swapFree=67111412/67111528
[pid=9871] ppid=9869 vsize=667080 CPUtime=5.2 cores=1,3,5,7
/proc/9871/stat : 9871 (python) R 9869 9871 9574 0 -1 4202496 105998 936 1 0 495 25 0 0 25 0 1 0 538484177 683089920 103674 33554432000 4194304 5683644 140735091804560 18446744073709551615 232335553221 0 0 16781312 2 0 0 0 17 3 0 0 81
/proc/9871/statm: 166770 103675 1761 364 0 102694 0
Current children cumulated CPU time (s) 5.2
Current children cumulated vsize (KiB) 667080

[startup+12.7001 s]
/proc/loadavg: 2.53 4.80 5.17 3/189 9876
/proc/meminfo: memFree=23468096/32951124 swapFree=67111412/67111528
[pid=9871] ppid=9869 vsize=725688 CPUtime=11.6 cores=1,3,5,7
/proc/9871/stat : 9871 (python) R 9869 9871 9574 0 -1 4202496 233818 936 1 0 1120 40 0 0 25 0 1 0 538484177 743104512 118838 33554432000 4194304 5683644 140735091804560 18446744073709551615 232335550605 0 0 16781312 2 0 0 0 17 3 0 0 81
/proc/9871/statm: 181422 118838 1826 364 0 117346 0
Current children cumulated CPU time (s) 11.6
Current children cumulated vsize (KiB) 725688

[startup+25.5008 s]
/proc/loadavg: 2.45 4.70 5.13 3/189 9877
/proc/meminfo: memFree=23468764/32951124 swapFree=67111412/67111528
[pid=9871] ppid=9869 vsize=725688 CPUtime=24.4 cores=1,3,5,7
/proc/9871/stat : 9871 (python) R 9869 9871 9574 0 -1 4202496 233818 936 1 0 2400 40 0 0 25 0 1 0 538484177 743104512 118838 33554432000 4194304 5683644 140735091804560 18446744073709551615 47871809851542 0 0 16781312 2 0 0 0 17 3 0 0 81
/proc/9871/statm: 181422 118838 1826 364 0 117346 0
Current children cumulated CPU time (s) 24.4
Current children cumulated vsize (KiB) 725688

[startup+51.1003 s]
/proc/loadavg: 2.34 4.46 5.04 3/189 9877
/proc/meminfo: memFree=23468852/32951124 swapFree=67111412/67111528
[pid=9871] ppid=9869 vsize=725688 CPUtime=50 cores=1,3,5,7
/proc/9871/stat : 9871 (python) R 9869 9871 9574 0 -1 4202496 233819 936 1 0 4960 40 0 0 25 0 1 0 538484177 743104512 118839 33554432000 4194304 5683644 140735091804560 18446744073709551615 4620223 0 0 16781312 2 0 0 0 17 3 0 0 81
/proc/9871/statm: 181422 118839 1827 364 0 117346 0
Current children cumulated CPU time (s) 50
Current children cumulated vsize (KiB) 725688

[startup+102.3 s]
/proc/loadavg: 2.15 4.08 4.87 3/189 9879
/proc/meminfo: memFree=23446724/32951124 swapFree=67111412/67111528
[pid=9871] ppid=9869 vsize=747772 CPUtime=101.21 cores=1,3,5,7
/proc/9871/stat : 9871 (python) R 9869 9871 9574 0 -1 4202496 255878 936 1 0 10078 43 0 0 25 0 1 0 538484177 765718528 124366 33554432000 4194304 5683644 140735091804560 18446744073709551615 47871809771660 0 0 16781312 2 0 0 0 17 3 0 0 81
/proc/9871/statm: 186943 124366 1833 364 0 122867 0
Current children cumulated CPU time (s) 101.21
Current children cumulated vsize (KiB) 747772

[startup+162.301 s]
/proc/loadavg: 3.81 4.18 4.85 6/201 9892
/proc/meminfo: memFree=22460884/32951124 swapFree=67111412/67111528
[pid=9871] ppid=9869 vsize=594956 CPUtime=109.68 cores=1,3,5,7
/proc/9871/stat : 9871 (python) S 9869 9871 9574 0 -1 4202496 258628 936 1 0 10921 47 0 0 20 0 5 0 538484177 609234944 75967 33554432000 4194304 5683644 140735091804560 18446744073709551615 232347719115 0 0 16781312 2 18446744073709551615 0 0 17 7 0 0 81
/proc/9871/statm: 148739 75967 1881 364 0 84648 0
[pid=9880] ppid=9871 vsize=553944 CPUtime=0.06 cores=1,3,5,7
/proc/9880/stat : 9880 (python) S 9871 9871 9574 0 -1 4202560 1005 0 0 0 3 3 0 0 18 0 1 0 538495246 567238656 74452 33554432000 4194304 5683644 140735091804560 18446744073709551615 232335912463 0 0 16781312 514 229085446670352648 0 0 17 5 0 0 0
/proc/9880/statm: 138486 74452 382 364 0 74404 0
[pid=9882] ppid=9880 vsize=106412 CPUtime=51.53 cores=1,3,5,7
/proc/9882/stat : 9882 (lingeling) R 9880 9882 9882 0 -1 4202496 40048 0 0 0 5145 8 0 0 25 0 1 0 538495247 108965888 25773 33554432000 4194304 4352236 140735104375472 18446744073709551615 4278746 0 0 16781312 17506 0 0 0 17 3 0 0 0
/proc/9882/statm: 26603 25773 129 39 0 25683 0
[pid=9883] ppid=9871 vsize=564200 CPUtime=0.07 cores=1,3,5,7
/proc/9883/stat : 9883 (python) S 9871 9871 9574 0 -1 4202560 945 0 0 0 4 3 0 0 15 0 1 0 538495249 577740800 74444 33554432000 4194304 5683644 140735091804560 18446744073709551615 232335912518 0 0 16781312 514 229085446670352648 0 0 17 7 0 0 0
/proc/9883/statm: 141050 74444 370 364 0 76965 0
[pid=9885] ppid=9883 vsize=784788 CPUtime=51.13 cores=1,3,5,7
/proc/9885/stat : 9885 (cryptominisat-2) R 9883 9885 9885 0 -1 4202496 142201 0 0 0 5088 25 0 0 25 0 1 0 538495250 803622912 137529 33554432000 4194304 4677096 140734674200496 18446744073709551615 4334285 0 0 16781312 2 0 0 0 17 7 0 0 0
/proc/9885/statm: 196197 137529 387 118 0 191156 0
[pid=9886] ppid=9871 vsize=574456 CPUtime=0.06 cores=1,3,5,7
/proc/9886/stat : 9886 (python) S 9871 9871 9574 0 -1 4202560 958 0 0 0 3 3 0 0 18 0 1 0 538495252 588242944 74448 33554432000 4194304 5683644 140735091804560 18446744073709551615 232335912518 0 0 16781312 514 229085446670352648 0 0 17 3 0 0 0
/proc/9886/statm: 143614 74448 370 364 0 79526 0
[pid=9888] ppid=9886 vsize=99908 CPUtime=51.46 cores=1,3,5,7
/proc/9888/stat : 9888 (lingeling) R 9886 9888 9888 0 -1 4202496 38414 0 0 0 5139 7 0 0 25 0 1 0 538495253 102305792 24147 33554432000 4194304 4352236 140733334219168 18446744073709551615 4281245 0 0 16781312 17506 0 0 0 17 5 0 0 0
/proc/9888/statm: 24977 24147 129 39 0 24057 0
[pid=9889] ppid=9871 vsize=584712 CPUtime=0.07 cores=1,3,5,7
/proc/9889/stat : 9889 (python) S 9871 9871 9574 0 -1 4202560 953 0 0 0 3 4 0 0 18 0 1 0 538495255 598745088 74452 33554432000 4194304 5683644 140735091804560 18446744073709551615 232335912518 0 0 16781312 514 229085446670352648 0 0 17 7 0 0 0
/proc/9889/statm: 146178 74452 370 364 0 82087 0
[pid=9891] ppid=9889 vsize=418212 CPUtime=51.5 cores=1,3,5,7
/proc/9891/stat : 9891 (precosat) R 9889 9891 9891 0 -1 4202496 119598 0 0 0 5130 20 0 0 25 0 1 0 538495256 428249088 103330 33554432000 4194304 4890832 140735086433296 18446744073709551615 4291474 0 0 16781312 17442 0 0 0 17 1 0 0 0
/proc/9891/statm: 104553 103330 86 171 0 104380 0
[pid=9871/tid=9881] ppid=9869 vsize=594956 CPUtime=0 cores=1,3,5,7
/proc/9871/task/9881/stat : 9881 (python) S 9869 9871 9574 0 -1 4202560 24 936 0 0 0 0 0 0 19 0 5 0 538495247 609234944 75967 33554432000 4194304 5683644 140735091804560 18446744073709551615 232347716017 0 0 16781312 2 18446604454223473344 0 0 -1 7 0 0 0
[pid=9871/tid=9884] ppid=9869 vsize=594956 CPUtime=0 cores=1,3,5,7
/proc/9871/task/9884/stat : 9884 (python) S 9869 9871 9574 0 -1 4202560 20 936 0 0 0 0 0 0 21 0 5 0 538495250 609234944 75967 33554432000 4194304 5683644 140735091804560 18446744073709551615 232347716017 0 0 16781312 2 18446604454223473344 0 0 -1 1 0 0 0
[pid=9871/tid=9887] ppid=9869 vsize=594956 CPUtime=0 cores=1,3,5,7
/proc/9871/task/9887/stat : 9887 (python) S 9869 9871 9574 0 -1 4202560 22 936 0 0 0 0 0 0 20 0 5 0 538495253 609234944 75967 33554432000 4194304 5683644 140735091804560 18446744073709551615 232347716017 0 0 16781312 2 18446604454223473344 0 0 -1 3 0 0 0
[pid=9871/tid=9890] ppid=9869 vsize=594956 CPUtime=0 cores=1,3,5,7
/proc/9871/task/9890/stat : 9890 (python) S 9869 9871 9574 0 -1 4202560 27 936 0 0 0 0 0 0 20 0 5 0 538495256 609234944 75967 33554432000 4194304 5683644 140735091804560 18446744073709551615 232347716017 0 0 16781312 2 18446604454223473344 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 315.56
Current children cumulated vsize (KiB) 4281588

[startup+222.301 s]
/proc/loadavg: 4.70 4.35 4.87 6/206 9899
/proc/meminfo: memFree=21708448/32951124 swapFree=67111412/67111528
[pid=9871] ppid=9869 vsize=605212 CPUtime=109.74 cores=1,3,5,7
/proc/9871/stat : 9871 (python) S 9869 9871 9574 0 -1 4202496 259960 936 1 0 10926 48 0 0 19 0 6 0 538484177 619737088 75974 33554432000 4194304 5683644 140735091804560 18446744073709551615 232347719115 0 0 16781312 2 18446744073709551615 0 0 17 7 0 0 81
/proc/9871/statm: 151303 75974 1884 364 0 87209 0
[pid=9880] ppid=9871 vsize=564188 CPUtime=0.15 cores=1,3,5,7
/proc/9880/stat : 9880 (python) S 9871 9871 9574 0 -1 4202560 1197 0 0 0 8 7 0 0 18 0 2 0 538495246 577728512 74491 33554432000 4194304 5683644 140735091804560 18446744073709551615 232335912518 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/9880/statm: 141047 74491 416 364 0 76965 0
[pid=9882] ppid=9880 vsize=177164 CPUtime=111.33 cores=1,3,5,7
/proc/9882/stat : 9882 (lingeling) R 9880 9882 9882 0 -1 4202496 82546 0 0 0 11121 12 0 0 25 0 1 0 538495247 181415936 43461 33554432000 4194304 4352236 140735104375472 18446744073709551615 4231316 0 0 16781312 17506 0 0 0 17 3 0 0 0
/proc/9882/statm: 44291 43461 129 39 0 43371 0
[pid=9880/tid=9895] ppid=9871 vsize=564188 CPUtime=0 cores=1,3,5,7
/proc/9880/task/9895/stat : 9895 (python) S 9871 9871 9574 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 538505261 577728512 74491 33554432000 4194304 5683644 140735091804560 18446744073709551615 232347716017 0 0 16781312 514 18446604457101979776 0 0 -1 5 0 0 0
[pid=9883] ppid=9871 vsize=564200 CPUtime=0.15 cores=1,3,5,7
/proc/9883/stat : 9883 (python) S 9871 9871 9574 0 -1 4202560 966 0 0 0 9 6 0 0 15 0 1 0 538495249 577740800 74444 33554432000 4194304 5683644 140735091804560 18446744073709551615 232335912518 0 0 16781312 514 5631377504368296200 0 0 17 7 0 0 0
/proc/9883/statm: 141050 74444 370 364 0 76965 0
[pid=9885] ppid=9883 vsize=823164 CPUtime=110.62 cores=1,3,5,7
/proc/9885/stat : 9885 (cryptominisat-2) R 9883 9885 9885 0 -1 4202496 192096 0 0 0 11025 37 0 0 25 0 1 0 538495250 842919936 158706 33554432000 4194304 4677096 140734674200496 18446744073709551615 4236605 0 0 16781312 2 0 0 0 17 7 0 0 0
/proc/9885/statm: 205791 158706 391 118 0 200750 0
[pid=9886] ppid=9871 vsize=574456 CPUtime=0.14 cores=1,3,5,7
/proc/9886/stat : 9886 (python) S 9871 9871 9574 0 -1 4202560 980 0 0 0 7 7 0 0 18 0 1 0 538495252 588242944 74448 33554432000 4194304 5683644 140735091804560 18446744073709551615 232335912518 0 0 16781312 514 229085446670352648 0 0 17 3 0 0 0
/proc/9886/statm: 143614 74448 370 364 0 79526 0
[pid=9888] ppid=9886 vsize=170100 CPUtime=111.38 cores=1,3,5,7
/proc/9888/stat : 9888 (lingeling) R 9886 9888 9888 0 -1 4202496 80774 0 0 0 11126 12 0 0 25 0 1 0 538495253 174182400 41695 33554432000 4194304 4352236 140733334219168 18446744073709551615 4278726 0 0 16781312 17506 0 0 0 17 5 0 0 0
/proc/9888/statm: 42525 41695 129 39 0 41605 0
[pid=9889] ppid=9871 vsize=584712 CPUtime=0.14 cores=1,3,5,7
/proc/9889/stat : 9889 (python) S 9871 9871 9574 0 -1 4202560 1129 0 0 0 7 7 0 0 19 0 2 0 538495255 598745088 74482 33554432000 4194304 5683644 140735091804560 18446744073709551615 232347719115 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/9889/statm: 146178 74482 399 364 0 82087 0
[pid=9891] ppid=9889 vsize=482124 CPUtime=100.12 cores=1,3,5,7

################
# More data... #
################

/proc/9920/statm: 151306 74490 399 364 0 87209 0
[pid=9922] ppid=9920 vsize=178788 CPUtime=438.28 cores=1,3,5,7
/proc/9922/stat : 9922 (lingeling) R 9920 9922 9922 0 -1 4202496 164955 0 0 0 43807 21 0 0 25 0 1 0 538544315 183078912 43868 33554432000 4194304 4352236 140735254109488 18446744073709551615 4328016 0 0 16781312 17506 0 0 0 17 7 0 0 0
/proc/9922/statm: 44697 43868 129 39 0 43777 0
[pid=9920/tid=9942] ppid=9871 vsize=605224 CPUtime=0 cores=1,3,5,7
/proc/9920/task/9942/stat : 9942 (python) S 9871 9871 9574 0 -1 4202560 51 0 0 0 0 0 0 0 19 0 2 0 538554330 619749376 74490 33554432000 4194304 5683644 140735091804560 18446744073709551615 232347716017 0 0 16781312 514 18446604471135044800 0 0 -1 5 0 0 0
[pid=9943] ppid=9871 vsize=615480 CPUtime=0.3 cores=1,3,5,7
/proc/9943/stat : 9943 (python) S 9871 9871 9574 0 -1 4202560 1160 0 0 0 13 17 0 0 18 0 2 0 538554332 630251520 74494 33554432000 4194304 5683644 140735091804560 18446744073709551615 232347719115 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/9943/statm: 153870 74494 399 364 0 89770 0
[pid=9945] ppid=9943 vsize=554324 CPUtime=199.19 cores=1,3,5,7
/proc/9945/stat : 9945 (precosat) T 9943 9945 9945 0 -1 4202496 158608 0 0 0 19890 29 0 0 25 0 1 0 538554333 567627776 137341 33554432000 4194304 4890832 140736078603744 18446744073709551615 4232386 0 0 16781312 17442 18446744071562691360 0 0 17 1 0 0 0
/proc/9945/statm: 138581 137341 86 171 0 138408 0
[pid=9943/tid=9952] ppid=9871 vsize=615480 CPUtime=0 cores=1,3,5,7
/proc/9943/task/9952/stat : 9952 (python) S 9871 9871 9574 0 -1 4202560 51 0 0 0 0 0 0 0 18 0 2 0 538564249 630251520 74494 33554432000 4194304 5683644 140735091804560 18446744073709551615 232347716017 0 0 16781312 514 18446604462999135296 0 0 -1 1 0 0 0
[pid=9988] ppid=9871 vsize=625736 CPUtime=0.14 cores=1,3,5,7
/proc/9988/stat : 9988 (python) S 9871 9871 9574 0 -1 4202560 1182 0 0 0 7 7 0 0 19 0 2 0 538574074 640753664 74504 33554432000 4194304 5683644 140735091804560 18446744073709551615 232347719115 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/9988/statm: 156434 74504 405 364 0 92331 0
[pid=9990] ppid=9988 vsize=489904 CPUtime=99.13 cores=1,3,5,7
/proc/9990/stat : 9990 (precosat) T 9988 9990 9990 0 -1 4202496 137523 0 0 0 9892 21 0 0 25 0 1 0 538574075 501661696 121235 33554432000 4194304 4890832 140735894924896 18446744073709551615 4238340 0 0 16781312 17442 18446744071562691360 0 0 17 1 0 0 0
/proc/9990/statm: 122476 121235 86 171 0 122303 0
[pid=9988/tid=9994] ppid=9871 vsize=625736 CPUtime=0 cores=1,3,5,7
/proc/9988/task/9994/stat : 9994 (python) S 9871 9871 9574 0 -1 4202560 50 0 0 0 0 0 0 0 19 0 2 0 538583994 640753664 74504 33554432000 4194304 5683644 140735091804560 18446744073709551615 232347716017 0 0 16781312 514 18446604457101981568 0 0 -1 7 0 0 0
[pid=9995] ppid=9871 vsize=635992 CPUtime=0.14 cores=1,3,5,7
/proc/9995/stat : 9995 (python) S 9871 9871 9574 0 -1 4202560 1117 0 0 0 8 6 0 0 19 0 2 0 538583997 651255808 74502 33554432000 4194304 5683644 140735091804560 18446744073709551615 232347719115 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/9995/statm: 158998 74502 399 364 0 94892 0
[pid=9997] ppid=9995 vsize=173544 CPUtime=98.17 cores=1,3,5,7
/proc/9997/stat : 9997 (lingeling) T 9995 9997 9997 0 -1 4202496 81642 0 0 0 9805 12 0 0 25 0 1 0 538583998 177709056 42555 33554432000 4194304 4352236 140733270991776 18446744073709551615 4278664 0 0 16781312 17506 18446744071562691360 0 0 17 7 0 0 0
/proc/9997/statm: 43386 42555 129 39 0 42466 0
[pid=9995/tid=10000] ppid=9871 vsize=635992 CPUtime=0 cores=1,3,5,7
/proc/9995/task/10000/stat : 10000 (python) S 9871 9871 9574 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 538594012 651255808 74502 33554432000 4194304 5683644 140735091804560 18446744073709551615 232347716017 0 0 16781312 514 18446604465321361728 0 0 -1 1 0 0 0
[pid=9871/tid=9881] ppid=9869 vsize=646236 CPUtime=0 cores=1,3,5,7
/proc/9871/task/9881/stat : 9881 (python) S 9869 9871 9574 0 -1 4202560 28 936 0 0 0 0 0 0 18 0 10 0 538495247 661745664 75998 33554432000 4194304 5683644 140735091804560 18446744073709551615 232347716017 0 0 16781312 2 18446604454223473344 0 0 -1 7 0 0 0
[pid=9871/tid=9884] ppid=9869 vsize=646236 CPUtime=0 cores=1,3,5,7
/proc/9871/task/9884/stat : 9884 (python) S 9869 9871 9574 0 -1 4202560 24 936 0 0 0 0 0 0 18 0 10 0 538495250 661745664 75998 33554432000 4194304 5683644 140735091804560 18446744073709551615 232347716017 0 0 16781312 2 18446604454223473344 0 0 -1 1 0 0 0
[pid=9871/tid=9887] ppid=9869 vsize=646236 CPUtime=0 cores=1,3,5,7
/proc/9871/task/9887/stat : 9887 (python) S 9869 9871 9574 0 -1 4202560 22 936 0 0 0 0 0 0 20 0 10 0 538495253 661745664 75998 33554432000 4194304 5683644 140735091804560 18446744073709551615 232347716017 0 0 16781312 2 18446604454223473344 0 0 -1 3 0 0 0
[pid=9871/tid=9890] ppid=9869 vsize=646236 CPUtime=0 cores=1,3,5,7
/proc/9871/task/9890/stat : 9890 (python) S 9869 9871 9574 0 -1 4202560 37 936 0 0 0 0 0 0 18 0 10 0 538495256 661745664 75998 33554432000 4194304 5683644 140735091804560 18446744073709551615 232347716017 0 0 16781312 2 18446604454223473344 0 0 -1 7 0 0 0
[pid=9871/tid=9897] ppid=9869 vsize=646236 CPUtime=0 cores=1,3,5,7
/proc/9871/task/9897/stat : 9897 (python) S 9869 9871 9574 0 -1 4202560 29 936 0 0 0 0 0 0 20 0 10 0 538505264 661745664 75998 33554432000 4194304 5683644 140735091804560 18446744073709551615 232347716017 0 0 16781312 2 18446604454223473344 0 0 -1 7 0 0 0
[pid=9871/tid=9921] ppid=9869 vsize=646236 CPUtime=0 cores=1,3,5,7
/proc/9871/task/9921/stat : 9921 (python) S 9869 9871 9574 0 -1 4202560 32 936 0 0 0 0 0 0 18 0 10 0 538544314 661745664 75998 33554432000 4194304 5683644 140735091804560 18446744073709551615 232347716017 0 0 16781312 2 18446604454223473344 0 0 -1 7 0 0 0
[pid=9871/tid=9944] ppid=9869 vsize=646236 CPUtime=0 cores=1,3,5,7
/proc/9871/task/9944/stat : 9944 (python) S 9869 9871 9574 0 -1 4202560 32 936 0 0 0 0 0 0 18 0 10 0 538554333 661745664 75998 33554432000 4194304 5683644 140735091804560 18446744073709551615 232347716017 0 0 16781312 2 18446604454223473344 0 0 -1 7 0 0 0
[pid=9871/tid=9989] ppid=9869 vsize=646236 CPUtime=0 cores=1,3,5,7
/proc/9871/task/9989/stat : 9989 (python) S 9869 9871 9574 0 -1 4202560 31 936 0 0 0 0 0 0 20 0 10 0 538574075 661745664 75998 33554432000 4194304 5683644 140735091804560 18446744073709551615 232347716017 0 0 16781312 2 18446604454223473344 0 0 -1 7 0 0 0
[pid=9871/tid=9996] ppid=9869 vsize=646236 CPUtime=0 cores=1,3,5,7
/proc/9871/task/9996/stat : 9996 (python) S 9869 9871 9574 0 -1 4202560 28 936 0 0 0 0 0 0 20 0 10 0 538583997 661745664 75998 33554432000 4194304 5683644 140735091804560 18446744073709551615 232347716017 0 0 16781312 2 18446604454223473344 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4624.79
Current children cumulated vsize (KiB) 14637488



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1286.31 s]
/proc/loadavg: 5.20 5.46 5.37 6/225 10005
/proc/meminfo: memFree=15001024/32951124 swapFree=67111412/67111528
[pid=9871] ppid=9869 vsize=646236 CPUtime=110.02 cores=1,3,5,7
/proc/9871/stat : 9871 (python) S 9869 9871 9574 0 -1 4202496 263380 936 1 0 10950 52 0 0 18 0 10 0 538484177 661745664 75998 33554432000 4194304 5683644 140735091804560 18446744073709551615 232347719115 0 0 16781312 2 18446744073709551615 0 0 17 7 0 0 81
/proc/9871/statm: 161559 75998 1892 364 0 97453 0
[pid=9880] ppid=9871 vsize=564188 CPUtime=1.59 cores=1,3,5,7
/proc/9880/stat : 9880 (python) S 9871 9871 9574 0 -1 4202560 1226 0 0 0 88 71 0 0 18 0 2 0 538495246 577728512 74491 33554432000 4194304 5683644 140735091804560 18446744073709551615 232335912518 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/9880/statm: 141047 74491 416 364 0 76965 0
[pid=9882] ppid=9880 vsize=199620 CPUtime=1174.86 cores=1,3,5,7
/proc/9882/stat : 9882 (lingeling) R 9880 9882 9882 0 -1 4202496 396676 0 0 0 117438 48 0 0 25 0 1 0 538495247 204410880 49075 33554432000 4194304 4352236 140735104375472 18446744073709551615 4278667 0 0 16781312 17506 0 0 0 17 3 0 0 0
/proc/9882/statm: 49905 49075 129 39 0 48985 0
[pid=9880/tid=9895] ppid=9871 vsize=564188 CPUtime=0 cores=1,3,5,7
/proc/9880/task/9895/stat : 9895 (python) S 9871 9871 9574 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 538505261 577728512 74491 33554432000 4194304 5683644 140735091804560 18446744073709551615 232347716017 0 0 16781312 514 18446604457101979776 0 0 -1 5 0 0 0
[pid=9883] ppid=9871 vsize=564200 CPUtime=0.98 cores=1,3,5,7
/proc/9883/stat : 9883 (python) S 9871 9871 9574 0 -1 4202560 1185 0 0 0 55 43 0 0 15 0 2 0 538495249 577740800 74474 33554432000 4194304 5683644 140735091804560 18446744073709551615 232335912518 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/9883/statm: 141050 74474 399 364 0 76965 0
[pid=9885] ppid=9883 vsize=3598000 CPUtime=679.1 cores=1,3,5,7
/proc/9885/stat : 9885 (cryptominisat-2) R 9883 9885 9885 0 -1 4202496 915466 0 0 0 67740 170 0 0 25 0 1 0 538495250 3684352000 720978 33554432000 4194304 4677096 140734674200496 18446744073709551615 4336189 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/9885/statm: 899500 720978 391 118 0 894459 0
[pid=9883/tid=9925] ppid=9871 vsize=564200 CPUtime=0 cores=1,3,5,7
/proc/9883/task/9925/stat : 9925 (python) S 9871 9871 9574 0 -1 4202560 48 0 0 0 0 0 0 0 16 0 2 0 538544825 577740800 74474 33554432000 4194304 5683644 140735091804560 18446744073709551615 232347716017 0 0 16781312 514 18446604466512829312 0 0 -1 7 0 0 0
[pid=9886] ppid=9871 vsize=574456 CPUtime=0.66 cores=1,3,5,7
/proc/9886/stat : 9886 (python) S 9871 9871 9574 0 -1 4202560 1170 0 0 0 35 31 0 0 19 0 2 0 538495252 588242944 74478 33554432000 4194304 5683644 140735091804560 18446744073709551615 232347719115 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/9886/statm: 143614 74478 399 364 0 79526 0
[pid=9888] ppid=9886 vsize=195900 CPUtime=489.92 cores=1,3,5,7
/proc/9888/stat : 9888 (lingeling) T 9886 9888 9888 0 -1 4202496 210198 0 0 0 48964 28 0 0 25 0 1 0 538495253 200601600 48145 33554432000 4194304 4352236 140733334219168 18446744073709551615 4234057 0 0 16781312 17506 18446744071562691360 0 0 17 5 0 0 0
/proc/9888/statm: 48975 48145 129 39 0 48055 0
[pid=9886/tid=9919] ppid=9871 vsize=574456 CPUtime=0 cores=1,3,5,7
/proc/9886/task/9919/stat : 9919 (python) S 9871 9871 9574 0 -1 4202560 45 0 0 0 0 0 0 0 19 0 2 0 538544311 588242944 74478 33554432000 4194304 5683644 140735091804560 18446744073709551615 232347716017 0 0 16781312 514 18446604457101980672 0 0 -1 3 0 0 0
[pid=9889] ppid=9871 vsize=584712 CPUtime=0.57 cores=1,3,5,7
/proc/9889/stat : 9889 (python) S 9871 9871 9574 0 -1 4202560 1181 0 0 0 29 28 0 0 18 0 2 0 538495255 598745088 74482 33554432000 4194304 5683644 140735091804560 18446744073709551615 232347719115 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/9889/statm: 146178 74482 399 364 0 82087 0
[pid=9891] ppid=9889 vsize=554768 CPUtime=389.52 cores=1,3,5,7
/proc/9891/stat : 9891 (precosat) T 9889 9891 9891 0 -1 4202496 166294 0 0 0 38920 32 0 0 25 0 1 0 538495256 568082432 137469 33554432000 4194304 4890832 140735086433296 18446744073709551615 4238338 0 0 16781312 17442 18446744071562691360 0 0 17 7 0 0 0
/proc/9891/statm: 138692 137469 86 171 0 138519 0
[pid=9889/tid=9899] ppid=9871 vsize=584712 CPUtime=0 cores=1,3,5,7
/proc/9889/task/9899/stat : 9899 (python) S 9871 9871 9574 0 -1 4202560 47 0 0 0 0 0 0 0 18 0 2 0 538505270 598745088 74482 33554432000 4194304 5683644 140735091804560 18446744073709551615 232347716017 0 0 16781312 514 18446604466512827520 0 0 -1 7 0 0 0
[pid=9896] ppid=9871 vsize=594968 CPUtime=1.54 cores=1,3,5,7
/proc/9896/stat : 9896 (python) S 9871 9871 9574 0 -1 4202560 1021 0 0 0 87 67 0 0 15 0 1 0 538505263 609247232 74456 33554432000 4194304 5683644 140735091804560 18446744073709551615 232335912518 0 0 16781312 514 229085446670352645 0 0 17 7 0 0 0
/proc/9896/statm: 148742 74456 370 364 0 84648 0
[pid=9898] ppid=9896 vsize=3657676 CPUtime=1072.23 cores=1,3,5,7
/proc/9898/stat : 9898 (cryptominisat-2) R 9896 9898 9898 0 -1 4202496 1037269 0 0 0 107017 206 0 0 25 0 1 0 538505264 3745460224 721225 33554432000 4194304 4677096 140736851266752 18446744073709551615 4319328 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/9898/statm: 914419 721225 391 118 0 909378 0
[pid=9920] ppid=9871 vsize=605224 CPUtime=0.67 cores=1,3,5,7
/proc/9920/stat : 9920 (python) S 9871 9871 9574 0 -1 4202560 1164 0 0 0 36 31 0 0 18 0 2 0 538544313 619749376 74490 33554432000 4194304 5683644 140735091804560 18446744073709551615 232335912518 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/9920/statm: 151306 74490 399 364 0 87209 0
[pid=9922] ppid=9920 vsize=178788 CPUtime=481.41 cores=1,3,5,7
/proc/9922/stat : 9922 (lingeling) R 9920 9922 9922 0 -1 4202496 205917 0 0 0 48115 26 0 0 25 0 1 0 538544315 183078912 43868 33554432000 4194304 4352236 140735254109488 18446744073709551615 4280965 0 0 16781312 17506 0 0 0 17 7 0 0 0
/proc/9922/statm: 44697 43868 129 39 0 43777 0
[pid=9920/tid=9942] ppid=9871 vsize=605224 CPUtime=0 cores=1,3,5,7
/proc/9920/task/9942/stat : 9942 (python) S 9871 9871 9574 0 -1 4202560 51 0 0 0 0 0 0 0 19 0 2 0 538554330 619749376 74490 33554432000 4194304 5683644 140735091804560 18446744073709551615 232347716017 0 0 16781312 514 18446604471135044800 0 0 -1 5 0 0 0
[pid=9943] ppid=9871 vsize=615480 CPUtime=0.3 cores=1,3,5,7
/proc/9943/stat : 9943 (python) S 9871 9871 9574 0 -1 4202560 1160 0 0 0 13 17 0 0 18 0 2 0 538554332 630251520 74494 33554432000 4194304 5683644 140735091804560 18446744073709551615 232347719115 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/9943/statm: 153870 74494 399 364 0 89770 0
[pid=9945] ppid=9943 vsize=554324 CPUtime=199.19 cores=1,3,5,7
/proc/9945/stat : 9945 (precosat) T 9943 9945 9945 0 -1 4202496 158608 0 0 0 19890 29 0 0 25 0 1 0 538554333 567627776 137341 33554432000 4194304 4890832 140736078603744 18446744073709551615 4232386 0 0 16781312 17442 18446744071562691360 0 0 17 1 0 0 0
/proc/9945/statm: 138581 137341 86 171 0 138408 0
[pid=9943/tid=9952] ppid=9871 vsize=615480 CPUtime=0 cores=1,3,5,7
/proc/9943/task/9952/stat : 9952 (python) S 9871 9871 9574 0 -1 4202560 51 0 0 0 0 0 0 0 18 0 2 0 538564249 630251520 74494 33554432000 4194304 5683644 140735091804560 18446744073709551615 232347716017 0 0 16781312 514 18446604462999135296 0 0 -1 1 0 0 0
[pid=9988] ppid=9871 vsize=625736 CPUtime=0.14 cores=1,3,5,7
/proc/9988/stat : 9988 (python) S 9871 9871 9574 0 -1 4202560 1182 0 0 0 7 7 0 0 19 0 2 0 538574074 640753664 74504 33554432000 4194304 5683644 140735091804560 18446744073709551615 232347719115 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/9988/statm: 156434 74504 405 364 0 92331 0
[pid=9990] ppid=9988 vsize=489904 CPUtime=99.13 cores=1,3,5,7
/proc/9990/stat : 9990 (precosat) T 9988 9990 9990 0 -1 4202496 137523 0 0 0 9892 21 0 0 25 0 1 0 538574075 501661696 121235 33554432000 4194304 4890832 140735894924896 18446744073709551615 4238340 0 0 16781312 17442 18446744071562691360 0 0 17 1 0 0 0
/proc/9990/statm: 122476 121235 86 171 0 122303 0
[pid=9988/tid=9994] ppid=9871 vsize=625736 CPUtime=0 cores=1,3,5,7
/proc/9988/task/9994/stat : 9994 (python) S 9871 9871 9574 0 -1 4202560 50 0 0 0 0 0 0 0 19 0 2 0 538583994 640753664 74504 33554432000 4194304 5683644 140735091804560 18446744073709551615 232347716017 0 0 16781312 514 18446604457101981568 0 0 -1 7 0 0 0
[pid=9995] ppid=9871 vsize=635992 CPUtime=0.14 cores=1,3,5,7
/proc/9995/stat : 9995 (python) S 9871 9871 9574 0 -1 4202560 1117 0 0 0 8 6 0 0 19 0 2 0 538583997 651255808 74502 33554432000 4194304 5683644 140735091804560 18446744073709551615 232347719115 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/9995/statm: 158998 74502 399 364 0 94892 0
[pid=9997] ppid=9995 vsize=173544 CPUtime=98.17 cores=1,3,5,7
/proc/9997/stat : 9997 (lingeling) T 9995 9997 9997 0 -1 4202496 81642 0 0 0 9805 12 0 0 25 0 1 0 538583998 177709056 42555 33554432000 4194304 4352236 140733270991776 18446744073709551615 4278664 0 0 16781312 17506 18446744071562691360 0 0 17 7 0 0 0
/proc/9997/statm: 43386 42555 129 39 0 42466 0
[pid=9995/tid=10000] ppid=9871 vsize=635992 CPUtime=0 cores=1,3,5,7
/proc/9995/task/10000/stat : 10000 (python) S 9871 9871 9574 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 538594012 651255808 74502 33554432000 4194304 5683644 140735091804560 18446744073709551615 232347716017 0 0 16781312 514 18446604465321361728 0 0 -1 1 0 0 0
[pid=9871/tid=9881] ppid=9869 vsize=646236 CPUtime=0 cores=1,3,5,7
/proc/9871/task/9881/stat : 9881 (python) S 9869 9871 9574 0 -1 4202560 28 936 0 0 0 0 0 0 18 0 10 0 538495247 661745664 75998 33554432000 4194304 5683644 140735091804560 18446744073709551615 232347716017 0 0 16781312 2 18446604454223473344 0 0 -1 7 0 0 0
[pid=9871/tid=9884] ppid=9869 vsize=646236 CPUtime=0 cores=1,3,5,7
/proc/9871/task/9884/stat : 9884 (python) S 9869 9871 9574 0 -1 4202560 24 936 0 0 0 0 0 0 18 0 10 0 538495250 661745664 75998 33554432000 4194304 5683644 140735091804560 18446744073709551615 232347716017 0 0 16781312 2 18446604454223473344 0 0 -1 1 0 0 0
[pid=9871/tid=9887] ppid=9869 vsize=646236 CPUtime=0 cores=1,3,5,7
/proc/9871/task/9887/stat : 9887 (python) S 9869 9871 9574 0 -1 4202560 22 936 0 0 0 0 0 0 20 0 10 0 538495253 661745664 75998 33554432000 4194304 5683644 140735091804560 18446744073709551615 232347716017 0 0 16781312 2 18446604454223473344 0 0 -1 3 0 0 0
[pid=9871/tid=9890] ppid=9869 vsize=646236 CPUtime=0 cores=1,3,5,7
/proc/9871/task/9890/stat : 9890 (python) S 9869 9871 9574 0 -1 4202560 37 936 0 0 0 0 0 0 18 0 10 0 538495256 661745664 75998 33554432000 4194304 5683644 140735091804560 18446744073709551615 232347716017 0 0 16781312 2 18446604454223473344 0 0 -1 7 0 0 0
[pid=9871/tid=9897] ppid=9869 vsize=646236 CPUtime=0 cores=1,3,5,7
/proc/9871/task/9897/stat : 9897 (python) S 9869 9871 9574 0 -1 4202560 29 936 0 0 0 0 0 0 20 0 10 0 538505264 661745664 75998 33554432000 4194304 5683644 140735091804560 18446744073709551615 232347716017 0 0 16781312 2 18446604454223473344 0 0 -1 7 0 0 0
[pid=9871/tid=9921] ppid=9869 vsize=646236 CPUtime=0 cores=1,3,5,7
/proc/9871/task/9921/stat : 9921 (python) S 9869 9871 9574 0 -1 4202560 32 936 0 0 0 0 0 0 18 0 10 0 538544314 661745664 75998 33554432000 4194304 5683644 140735091804560 18446744073709551615 232347716017 0 0 16781312 2 18446604454223473344 0 0 -1 7 0 0 0
[pid=9871/tid=9944] ppid=9869 vsize=646236 CPUtime=0 cores=1,3,5,7
/proc/9871/task/9944/stat : 9944 (python) S 9869 9871 9574 0 -1 4202560 32 936 0 0 0 0 0 0 18 0 10 0 538554333 661745664 75998 33554432000 4194304 5683644 140735091804560 18446744073709551615 232347716017 0 0 16781312 2 18446604454223473344 0 0 -1 7 0 0 0
[pid=9871/tid=9989] ppid=9869 vsize=646236 CPUtime=0 cores=1,3,5,7
/proc/9871/task/9989/stat : 9989 (python) S 9869 9871 9574 0 -1 4202560 31 936 0 0 0 0 0 0 20 0 10 0 538574075 661745664 75998 33554432000 4194304 5683644 140735091804560 18446744073709551615 232347716017 0 0 16781312 2 18446604454223473344 0 0 -1 7 0 0 0
[pid=9871/tid=9996] ppid=9869 vsize=646236 CPUtime=0 cores=1,3,5,7
/proc/9871/task/9996/stat : 9996 (python) S 9869 9871 9574 0 -1 4202560 28 936 0 0 0 0 0 0 20 0 10 0 538583997 661745664 75998 33554432000 4194304 5683644 140735091804560 18446744073709551615 232347716017 0 0 16781312 2 18446604454223473344 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4800.14
Current children cumulated vsize (KiB) 15613716

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 9871 and gives
#  childrusage.ru_utime.tv_sec=109
#  childrusage.ru_utime.tv_usec=504352
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=548916
# CPU time returned by wait4() is 110.053
# while last known CPU time is 4800.14
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1286.39
CPU time (s): 4800.14
CPU user time (s): 4790.89
CPU system time (s): 9.25
CPU usage (%): 373.148
Max. virtual memory (cumulated for all children) (KiB): 15620888

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 109.504
system time used= 0.548916
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 264322
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2917
involuntary context switches= 208

runsolver used 4.09138 second user time and 8.18975 second system time

The end

Launcher Data 

Begin job on node132 at 2011-05-01 18:54:20
IDJOB=3317935
IDBENCH=82394
IDSOLVER=1706
FILE ID=node132/3317935-1304268858
RUNJOBID= node132-1304267281-9593
PBS_JOBID= 13173947
Free space on /tmp= 72012 MiB

SOLVER NAME= borg-sat 11.03.02-industrial
BENCH NAME= SAT11/application/rintanen/SATPlanning/sokoban-sequential-p145-microban-sequential.080-SAT.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.industrial.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3317935-1304268858/watcher-3317935-1304268858 -o /tmp/evaluation-result-3317935-1304268858/solver-3317935-1304268858 -C 4800 -W 1300 -M 15500  python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3317935-1304268858.cnf -seed 30873738 -budget 4800 -cores 4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 1ca09a2b911e29894c6603aee8d3e672
RANDOM SEED=30873738

node132.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      23937588 kB
Buffers:        704824 kB
Cached:        6175376 kB
SwapCached:        112 kB
Active:        3417320 kB
Inactive:      5103400 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      23937588 kB
SwapTotal:    67111528 kB
SwapFree:     67111412 kB
Dirty:          128036 kB
Writeback:           0 kB
AnonPages:     1640100 kB
Mapped:          22168 kB
Slab:           425120 kB
PageTables:       8744 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:  1814152 kB
VmallocTotal: 34359738367 kB
VmallocUsed:     33868 kB
VmallocChunk: 34359703231 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71940 MiB
End job on node132 at 2011-05-01 19:15:49