Trace number 3321569

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-industrial? (MO) 2794.41 387.081

General information on the benchmark

Nameapplication/rintanen/SATPlanning/
openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_3.035-NOTKNOWN.cnf
MD5SUMc4319228342e10028de028a9b67c3404
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables133566
Number of clauses676901
Sum of the clauses size1609791
Maximum clause length63
Minimum clause length1
Number of clauses of size 1211
Number of clauses of size 2668220
Number of clauses of size 32100
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 56370

Solver Data 

0.44/2.67	c INFO: loaded portfolio from HOME/etc/borg-mix+class.industrial.pickle
0.44/2.67	c INFO: solving HOME/instance-3321569-1304346638.cnf
0.44/2.67	c INFO: computing task features
2.39/4.68	c INFO: computed variable-clause graph statistics
2.49/4.75	c INFO: computed clause balance statistics
11.89/14.18	c INFO: computed variable balance statistics
18.60/20.89	c INFO: computed small-clause counts
18.79/21.01	c INFO: computed Horn-clause counts
39.69/41.93	c INFO: computed variable graph statistics
39.69/41.93	c INFO: collected features for HOME/instance-3321569-1304346638.cnf in 39.21 s
39.69/41.97	c INFO: running lingeling-276@0 for 97 with 39960 remaining (b = 0.23)
39.78/42.00	c INFO: running cryptominisat-2.9.0@0 for 485 with 39960 remaining (b = 0.20)
39.78/42.03	c INFO: running lingeling-276@0 for 1261 with 39960 remaining (b = 0.34)
39.78/42.07	c INFO: running cryptominisat-2.9.0@0 for 1940 with 39960 remaining (b = 0.44)
39.89/42.10	c INFO: running lingeling-276@0 for 1261 with 39960 remaining (b = 0.28)
39.89/42.13	c INFO: running cryptominisat-2.9.0@0 for 1649 with 39960 remaining (b = 0.34)
39.89/42.17	c INFO: running SApperloT@0 for 97 with 39960 remaining (b = 0.02)
39.99/42.21	c INFO: running lingeling-276@0 for 1261 with 39960 remaining (b = 0.21)
839.10/142.15	c INFO: running precosat-570@0 for 388 with 39860 remaining (b = 0.10)
840.55/142.39	c INFO: running cryptominisat-2.9.0@0 for 1940 with 39860 remaining (b = 0.30)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3321569-1304346638/watcher-3321569-1304346638 -o /tmp/evaluation-result-3321569-1304346638/solver-3321569-1304346638 -C 40000 -W 5100 -M 31000 python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3321569-1304346638.cnf -seed 1842385070 -budget 40000 -cores 8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.68 6.26 4.43 2/195 31178
/proc/meminfo: memFree=25170808/32951124 swapFree=59765712/67111528
[pid=31178] ppid=31176 vsize=1964 CPUtime=0 cores=0-7
/proc/31178/stat : 31178 (python) R 31176 31178 30702 0 -1 4194304 77 0 2 0 0 0 0 0 20 0 1 0 546264361 2011136 31 33554432000 4194304 5683644 140736094739312 18446744073709551615 230804242055 0 2147483391 4096 0 0 0 0 17 4 0 0 0
/proc/31178/statm: 491 31 23 364 0 37 0

[startup+0.0781249 s]
/proc/loadavg: 7.68 6.26 4.43 2/195 31178
/proc/meminfo: memFree=25170808/32951124 swapFree=59765712/67111528
[pid=31178] ppid=31176 vsize=16236 CPUtime=0 cores=0-7
/proc/31178/stat : 31178 (python) R 31176 31178 30702 0 -1 4202496 1042 0 8 0 0 0 0 0 20 0 1 0 546264361 16625664 921 33554432000 4194304 5683644 140736094739312 18446744073709551615 4522582 0 0 16781312 2 0 0 0 17 2 0 0 4
/proc/31178/statm: 4059 921 381 364 0 546 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 16236

[startup+0.10112 s]
/proc/loadavg: 7.68 6.26 4.43 2/195 31178
/proc/meminfo: memFree=25170808/32951124 swapFree=59765712/67111528
[pid=31178] ppid=31176 vsize=16396 CPUtime=0.01 cores=0-7
/proc/31178/stat : 31178 (python) D 31176 31178 30702 0 -1 4202496 1121 0 8 0 1 0 0 0 20 0 1 0 546264361 16789504 995 33554432000 4194304 5683644 140736094739312 18446744073709551615 230809165568 0 0 16781312 2 18446744071562234166 0 0 17 2 0 0 4
/proc/31178/statm: 4099 995 413 364 0 586 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 16396

[startup+0.301078 s]
/proc/loadavg: 7.68 6.26 4.43 2/195 31178
/proc/meminfo: memFree=25170808/32951124 swapFree=59765712/67111528
[pid=31178] ppid=31176 vsize=50012 CPUtime=0.06 cores=0-7
/proc/31178/stat : 31178 (python) S 31176 31178 30702 0 -1 4202496 1935 0 19 0 4 2 0 0 18 0 1 0 546264361 51212288 1717 33554432000 4194304 5683644 140736094739312 18446744073709551615 230809163776 0 2147483391 16781312 2 18446744071699199166 0 0 17 2 0 0 8
/proc/31178/statm: 12503 1717 476 364 0 1203 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 50012

[startup+0.701039 s]
/proc/loadavg: 7.68 6.26 4.43 2/195 31178
/proc/meminfo: memFree=25170808/32951124 swapFree=59765712/67111528
[pid=31178] ppid=31176 vsize=104228 CPUtime=0.1 cores=0-7
/proc/31178/stat : 31178 (python) D 31176 31178 30702 0 -1 4202496 3030 0 47 0 6 4 0 0 17 0 1 0 546264361 106729472 2757 33554432000 4194304 5683644 140736094739312 18446744073709551615 230809165568 0 0 16781312 2 18446744071562234166 0 0 17 2 0 0 26
/proc/31178/statm: 26057 2757 847 364 0 1805 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 104228

[startup+1.50085 s]
/proc/loadavg: 7.68 6.26 4.43 1/196 31179
/proc/meminfo: memFree=25153104/32951124 swapFree=59765712/67111528
[pid=31178] ppid=31176 vsize=124236 CPUtime=0.16 cores=0-7
/proc/31178/stat : 31178 (python) S 31176 31178 30702 0 -1 4202496 4258 0 56 0 10 6 0 0 16 0 1 0 546264361 127217664 3880 33554432000 4194304 5683644 140736094739312 18446744073709551615 230809165568 0 0 16781312 2 18446744071562362840 0 0 17 2 0 0 92
/proc/31178/statm: 31059 3880 997 364 0 2870 0
Current children cumulated CPU time (s) 0.16
Current children cumulated vsize (KiB) 124236

[startup+3.10056 s]
/proc/loadavg: 7.68 6.26 4.43 1/196 31183
/proc/meminfo: memFree=25137400/32951124 swapFree=59765712/67111528
[pid=31178] ppid=31176 vsize=319676 CPUtime=0.89 cores=0-7
/proc/31178/stat : 31178 (python) R 31176 31178 30702 0 -1 4202496 19214 927 127 8 72 17 0 0 16 0 1 0 546264361 327348224 17018 33554432000 4194304 5683644 140736094739312 18446744073709551615 230808862128 0 0 16781312 2 0 0 0 17 2 0 0 113
/proc/31178/statm: 79919 17018 1761 364 0 15843 0
Current children cumulated CPU time (s) 0.89
Current children cumulated vsize (KiB) 319676
heavy processes:

[startup+6.30099 s]
/proc/loadavg: 7.15 6.17 4.41 2/196 31183
/proc/meminfo: memFree=24978012/32951124 swapFree=59765712/67111528
[pid=31178] ppid=31176 vsize=416348 CPUtime=4.09 cores=0-7
/proc/31178/stat : 31178 (python) R 31176 31178 30702 0 -1 4202496 59125 927 127 8 388 21 0 0 21 0 1 0 546264361 426340352 41472 33554432000 4194304 5683644 140736094739312 18446744073709551615 5003249 0 0 16781312 2 0 0 0 17 2 0 0 113
/proc/31178/statm: 104087 41472 1826 364 0 40011 0
Current children cumulated CPU time (s) 4.09
Current children cumulated vsize (KiB) 416348
heavy processes:

[startup+12.7008 s]
/proc/loadavg: 6.66 6.09 4.39 2/196 31183
/proc/meminfo: memFree=24979788/32951124 swapFree=59765712/67111528
[pid=31178] ppid=31176 vsize=416348 CPUtime=10.49 cores=0-7
/proc/31178/stat : 31178 (python) R 31176 31178 30702 0 -1 4202496 59125 927 127 8 1028 21 0 0 25 0 1 0 546264361 426340352 41472 33554432000 4194304 5683644 140736094739312 18446744073709551615 230808826457 0 0 16781312 2 0 0 0 17 2 0 0 113
/proc/31178/statm: 104087 41472 1826 364 0 40011 0
Current children cumulated CPU time (s) 10.49
Current children cumulated vsize (KiB) 416348

[startup+25.5005 s]
/proc/loadavg: 5.40 5.84 4.33 2/196 31183
/proc/meminfo: memFree=24983504/32951124 swapFree=59765712/67111528
[pid=31178] ppid=31176 vsize=416348 CPUtime=23.29 cores=0-7
/proc/31178/stat : 31178 (python) R 31176 31178 30702 0 -1 4202496 59132 927 127 8 2308 21 0 0 25 0 1 0 546264361 426340352 41479 33554432000 4194304 5683644 140736094739312 18446744073709551615 47095904315532 0 0 16781312 2 0 0 0 17 2 0 0 113
/proc/31178/statm: 104087 41479 1833 364 0 40011 0
Current children cumulated CPU time (s) 23.29
Current children cumulated vsize (KiB) 416348

[startup+51.1017 s]
/proc/loadavg: 4.98 5.68 4.32 9/220 31208
/proc/meminfo: memFree=23198952/32951124 swapFree=59765712/67111528
[pid=31178] ppid=31176 vsize=553428 CPUtime=39.99 cores=0-7
/proc/31178/stat : 31178 (python) S 31176 31178 30702 0 -1 4202496 64353 927 127 8 3973 26 0 0 24 0 9 0 546264361 566710272 39054 33554432000 4194304 5683644 140736094739312 18446744073709551615 230820992459 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 114
/proc/31178/statm: 138357 39054 1889 364 0 74254 0
[pid=31185] ppid=31178 vsize=405856 CPUtime=0 cores=0-7
/proc/31185/stat : 31185 (python) S 31178 31178 30702 0 -1 4202560 926 0 0 0 0 0 0 0 18 0 1 0 546268559 415596544 37393 33554432000 4194304 5683644 140736094739312 18446744073709551615 230809185807 0 0 16781312 514 4070770007443734786 0 0 17 1 0 0 0
/proc/31185/statm: 101464 37393 376 364 0 37382 0
[pid=31187] ppid=31185 vsize=28832 CPUtime=9.11 cores=0-7
/proc/31187/stat : 31187 (lingeling) R 31185 31187 31187 0 -1 4202496 14063 0 0 0 909 2 0 0 25 0 1 0 546268559 29523968 6378 33554432000 4194304 4352236 140735924766976 18446744073709551615 4238648 0 0 16781312 17506 0 0 0 17 2 0 0 0
/proc/31187/statm: 7208 6378 129 39 0 6288 0
[pid=31188] ppid=31178 vsize=416112 CPUtime=0.01 cores=0-7
/proc/31188/stat : 31188 (python) S 31178 31178 30702 0 -1 4202560 907 0 0 0 0 1 0 0 15 0 1 0 546268562 426098688 37391 33554432000 4194304 5683644 140736094739312 18446744073709551615 230809185862 0 0 16781312 514 4610951548954968321 0 0 17 5 0 0 0
/proc/31188/statm: 104028 37391 370 364 0 39943 0
[pid=31190] ppid=31188 vsize=753304 CPUtime=9.06 cores=0-7
/proc/31190/stat : 31190 (cryptominisat-2) R 31188 31190 31190 0 -1 4202496 145685 0 2 0 888 18 0 0 25 0 1 0 546268563 771383296 141104 33554432000 4194304 4677096 140735500729728 18446744073709551615 4586861 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/31190/statm: 188326 141104 372 118 0 183285 0
[pid=31191] ppid=31178 vsize=491904 CPUtime=0.01 cores=0-7
/proc/31191/stat : 31191 (python) S 31178 31178 30702 0 -1 4202560 788 0 0 0 0 1 0 0 18 0 1 0 546268565 503709696 37513 33554432000 4194304 5683644 140736094739312 18446744073709551615 230809185862 0 0 16781312 514 4091726973947052295 0 0 17 7 0 0 0
/proc/31191/statm: 122976 37513 371 364 0 58888 0
[pid=31193] ppid=31191 vsize=26408 CPUtime=9.03 cores=0-7
/proc/31193/stat : 31193 (lingeling) R 31191 31193 31193 0 -1 4202496 13548 0 0 0 901 2 0 0 25 0 1 0 546268566 27041792 5773 33554432000 4194304 4352236 140734250655168 18446744073709551615 4281237 0 0 16781312 17506 0 0 0 17 5 0 0 0
/proc/31193/statm: 6602 5773 129 39 0 5682 0
[pid=31194] ppid=31178 vsize=502160 CPUtime=0 cores=0-7
/proc/31194/stat : 31194 (python) S 31178 31178 30702 0 -1 4202560 800 0 0 0 0 0 0 0 15 0 1 0 546268569 514211840 37497 33554432000 4194304 5683644 140736094739312 18446744073709551615 230809185862 0 0 16781312 514 3321057283806298372 0 0 17 6 0 0 0
/proc/31194/statm: 125540 37497 371 364 0 61449 0
[pid=31196] ppid=31194 vsize=753304 CPUtime=9 cores=0-7
/proc/31196/stat : 31196 (cryptominisat-2) R 31194 31196 31196 0 -1 4202496 145682 0 0 0 882 18 0 0 25 0 1 0 546268569 771383296 141111 33554432000 4194304 4677096 140733366123872 18446744073709551615 4586829 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/31196/statm: 188326 141111 372 118 0 183285 0
[pid=31197] ppid=31178 vsize=512416 CPUtime=0 cores=0-7
/proc/31197/stat : 31197 (python) S 31178 31178 30702 0 -1 4202560 808 0 0 0 0 0 0 0 18 0 1 0 546268572 524713984 37570 33554432000 4194304 5683644 140736094739312 18446744073709551615 230809185862 0 0 16781312 514 3966387596182913284 0 0 17 1 0 0 0
/proc/31197/statm: 128104 37570 371 364 0 64010 0
[pid=31199] ppid=31197 vsize=27984 CPUtime=8.98 cores=0-7
/proc/31199/stat : 31199 (lingeling) R 31197 31199 31199 0 -1 4202496 13946 0 0 0 895 3 0 0 25 0 1 0 546268573 28655616 6166 33554432000 4194304 4352236 140734465713424 18446744073709551615 4278692 0 0 16781312 17506 0 0 0 17 0 0 0 0
/proc/31199/statm: 6996 6166 129 39 0 6076 0
[pid=31200] ppid=31178 vsize=522672 CPUtime=0.01 cores=0-7
/proc/31200/stat : 31200 (python) S 31178 31178 30702 0 -1 4202560 826 0 0 0 0 1 0 0 15 0 1 0 546268575 535216128 37586 33554432000 4194304 5683644 140736094739312 18446744073709551615 230809185862 0 0 16781312 514 4190595059516670209 0 0 17 1 0 0 0
/proc/31200/statm: 130668 37586 371 364 0 66571 0
[pid=31202] ppid=31200 vsize=753300 CPUtime=8.87 cores=0-7
/proc/31202/stat : 31202 (cryptominisat-2) R 31200 31202 31202 0 -1 4202496 145685 0 0 0 869 18 0 0 25 0 1 0 546268576 771379200 141108 33554432000 4194304 4677096 140733231844048 18446744073709551615 4586869 0 0 16781312 2 0 0 0 17 7 0 0 0
/proc/31202/statm: 188325 141108 372 118 0 183284 0
[pid=31203] ppid=31178 vsize=532928 CPUtime=0 cores=0-7
/proc/31203/stat : 31203 (python) S 31178 31178 30702 0 -1 4202560 827 0 0 0 0 0 0 0 18 0 1 0 546268579 545718272 37590 33554432000 4194304 5683644 140736094739312 18446744073709551615 230809185862 0 0 16781312 514 3931630109483565316 0 0 17 1 0 0 0
/proc/31203/statm: 133232 37590 371 364 0 69132 0
[pid=31205] ppid=31203 vsize=31516 CPUtime=8.88 cores=0-7
/proc/31205/stat : 31205 (SApperloT-base) R 31203 31205 31205 0 -1 4202496 7339 0 0 0 887 1 0 0 25 0 1 0 546268581 32272384 6899 33554432000 134512640 135674940 4291858656 18446744073709551615 134551574 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/31205/statm: 7879 6899 99 284 0 7593 0
[pid=31206] ppid=31178 vsize=543184 CPUtime=0.01 cores=0-7
/proc/31206/stat : 31206 (python) S 31178 31178 30702 0 -1 4202560 866 0 0 0 0 1 0 0 18 0 1 0 546268583 556220416 37538 33554432000 4194304 5683644 140736094739312 18446744073709551615 230809185862 0 0 16781312 514 10008705642992206083 0 0 17 1 0 0 0
/proc/31206/statm: 135796 37538 377 364 0 71693 0
[pid=31208] ppid=31206 vsize=27476 CPUtime=8.8 cores=0-7
/proc/31208/stat : 31208 (lingeling) R 31206 31208 31208 0 -1 4202496 13827 0 0 0 877 3 0 0 25 0 1 0 546268585 28135424 6039 33554432000 4194304 4352236 140734141361104 18446744073709551615 4280960 0 0 16781312 17506 0 0 0 17 1 0 0 0
/proc/31208/statm: 6869 6039 129 39 0 5949 0
[pid=31178/tid=31186] ppid=31176 vsize=553428 CPUtime=0 cores=0-7
/proc/31178/task/31186/stat : 31186 (python) S 31176 31178 30702 0 -1 4202560 27 927 0 8 0 0 0 0 17 0 9 0 546268559 566710272 39054 33554432000 4194304 5683644 140736094739312 18446744073709551615 230820989361 0 0 16781312 2 18446604451036441344 0 0 -1 1 0 0 0
[pid=31178/tid=31189] ppid=31176 vsize=553428 CPUtime=0 cores=0-7
/proc/31178/task/31189/stat : 31189 (python) S 31176 31178 30702 0 -1 4202560 24 927 0 8 0 0 0 0 18 0 9 0 546268562 566710272 39054 33554432000 4194304 5683644 140736094739312 18446744073709551615 230820989361 0 0 16781312 2 18446604451036441344 0 0 -1 3 0 0 0
[pid=31178/tid=31192] ppid=31176 vsize=553428 CPUtime=0 cores=0-7
/proc/31178/task/31192/stat : 31192 (python) S 31176 31178 30702 0 -1 4202560 72 927 0 8 0 0 0 0 19 0 9 0 546268566 566710272 39054 33554432000 4194304 5683644 140736094739312 18446744073709551615 230820989361 0 0 16781312 2 18446604451036441344 0 0 -1 4 0 0 0
[pid=31178/tid=31195] ppid=31176 vsize=553428 CPUtime=0 cores=0-7
/proc/31178/task/31195/stat : 31195 (python) S 31176 31178 30702 0 -1 4202560 34 927 0 8 0 0 0 0 20 0 9 0 546268569 566710272 39054 33554432000 4194304 5683644 140736094739312 18446744073709551615 230820989361 0 0 16781312 2 18446604451036441344 0 0 -1 0 0 0 0
[pid=31178/tid=31198] ppid=31176 vsize=553428 CPUtime=0 cores=0-7
/proc/31178/task/31198/stat : 31198 (python) S 31176 31178 30702 0 -1 4202560 34 927 0 8 0 0 0 0 21 0 9 0 546268573 566710272 39054 33554432000 4194304 5683644 140736094739312 18446744073709551615 230820989361 0 0 16781312 2 18446604451036441344 0 0 -1 0 0 0 0
[pid=31178/tid=31201] ppid=31176 vsize=553428 CPUtime=0 cores=0-7
/proc/31178/task/31201/stat : 31201 (python) S 31176 31178 30702 0 -1 4202560 34 927 0 8 0 0 0 0 22 0 9 0 546268576 566710272 39054 33554432000 4194304 5683644 140736094739312 18446744073709551615 230820989361 0 0 16781312 2 18446604451036441344 0 0 -1 7 0 0 0
[pid=31178/tid=31204] ppid=31176 vsize=553428 CPUtime=0 cores=0-7
/proc/31178/task/31204/stat : 31204 (python) S 31176 31178 30702 0 -1 4202560 33 927 0 8 0 0 0 0 23 0 9 0 546268580 566710272 39054 33554432000 4194304 5683644 140736094739312 18446744073709551615 230820989361 0 0 16781312 2 18446604451036441344 0 0 -1 1 0 0 0
[pid=31178/tid=31207] ppid=31176 vsize=553428 CPUtime=0 cores=0-7
/proc/31178/task/31207/stat : 31207 (python) S 31176 31178 30702 0 -1 4202560 34 927 0 8 0 0 0 0 24 0 9 0 546268583 566710272 39054 33554432000 4194304 5683644 140736094739312 18446744073709551615 230820989361 0 0 16781312 2 18446604451036441344 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 111.76
Current children cumulated vsize (KiB) 6882784

[startup+102.308 s]
/proc/loadavg: 6.76 6.05 4.51 9/220 31209
/proc/meminfo: memFree=22386980/32951124 swapFree=59765712/67111528
[pid=31178] ppid=31176 vsize=553428 CPUtime=39.99 cores=0-7
/proc/31178/stat : 31178 (python) S 31176 31178 30702 0 -1 4202496 64353 927 127 8 3973 26 0 0 24 0 9 0 546264361 566710272 39054 33554432000 4194304 5683644 140736094739312 18446744073709551615 230820992459 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 114
/proc/31178/statm: 138357 39054 1889 364 0 74254 0
[pid=31185] ppid=31178 vsize=405856 CPUtime=0.08 cores=0-7
/proc/31185/stat : 31185 (python) S 31178 31178 30702 0 -1 4202560 949 0 0 0 4 4 0 0 18 0 1 0 546268559 415596544 37393 33554432000 4194304 5683644 140736094739312 18446744073709551615 230809185807 0 0 16781312 514 6601203930376405250 0 0 17 1 0 0 0
/proc/31185/statm: 101464 37393 376 364 0 37382 0
[pid=31187] ppid=31185 vsize=62388 CPUtime=60.32 cores=0-7
/proc/31187/stat : 31187 (lingeling) R 31185 31187 31187 0 -1 4202496 22761 0 0 0 6029 3 0 0 25 0 1 0 546268559 63885312 14767 33554432000 4194304 4352236 140735924766976 18446744073709551615 4278800 0 0 16781312 17506 0 0 0 17 2 0 0 0
/proc/31187/statm: 15597 14767 129 39 0 14677 0
[pid=31188] ppid=31178 vsize=416112 CPUtime=0.14 cores=0-7
/proc/31188/stat : 31188 (python) S 31178 31178 30702 0 -1 4202560 1026 0 0 0 9 5 0 0 15 0 1 0 546268562 426098688 37392 33554432000 4194304 5683644 140736094739312 18446744073709551615 230809185862 0 0 16781312 514 4610951548954968321 0 0 17 5 0 0 0
/proc/31188/statm: 104028 37392 371 364 0 39943 0
[pid=31190] ppid=31188 vsize=1261004 CPUtime=60.27 cores=0-7

################
# More data... #
################

[pid=31200] ppid=31178 vsize=522672 CPUtime=1.22 cores=0-7
/proc/31200/stat : 31200 (python) S 31178 31178 30702 0 -1 4202560 1572 0 0 0 84 38 0 0 15 0 1 0 546268575 535216128 37907 33554432000 4194304 5683644 140736094739312 18446744073709551615 230809185862 0 0 16781312 514 6601203930376405249 0 0 17 7 0 0 0
/proc/31200/statm: 130668 37907 372 364 0 66571 0
[pid=31202] ppid=31200 vsize=6304288 CPUtime=294.68 cores=0-7
/proc/31202/stat : 31202 (cryptominisat-2) R 31200 31202 31202 0 -1 4202496 8729002 0 0 0 28312 1156 0 0 25 0 1 0 546268576 6455590912 1399311 33554432000 4194304 4677096 140733231844048 18446744073709551615 4468061 0 0 16781312 2 0 0 0 17 7 0 0 0
/proc/31202/statm: 1576072 1399311 393 118 0 1571031 0
[pid=31203] ppid=31178 vsize=532928 CPUtime=0.15 cores=0-7
/proc/31203/stat : 31203 (python) S 31178 31178 30702 0 -1 4202560 1001 0 0 0 7 8 0 0 19 0 2 0 546268579 545718272 37619 33554432000 4194304 5683644 140736094739312 18446744073709551615 230820992459 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/31203/statm: 133232 37619 399 364 0 69132 0
[pid=31205] ppid=31203 vsize=130508 CPUtime=100.13 cores=0-7
/proc/31205/stat : 31205 (SApperloT-base) T 31203 31205 31205 0 -1 4202496 33365 0 0 0 10006 7 0 0 25 0 1 0 546268581 133640192 31001 33554432000 134512640 135674940 4291858656 18446744073709551615 134552074 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/31205/statm: 32627 31001 99 284 0 32341 0
[pid=31203/tid=31216] ppid=31178 vsize=532928 CPUtime=0 cores=0-7
/proc/31203/task/31216/stat : 31216 (python) S 31178 31178 30702 0 -1 4202560 66 0 0 0 0 0 0 0 19 0 2 0 546278597 545718272 37619 33554432000 4194304 5683644 140736094739312 18446744073709551615 230820989361 0 0 16781312 514 18446604453828097216 0 0 -1 2 0 0 0
[pid=31206] ppid=31178 vsize=543184 CPUtime=0.44 cores=0-7
/proc/31206/stat : 31206 (python) S 31178 31178 30702 0 -1 4202560 867 0 0 0 21 23 0 0 18 0 1 0 546268583 556220416 37538 33554432000 4194304 5683644 140736094739312 18446744073709551615 230809185862 0 0 16781312 514 6601203930376405251 0 0 17 1 0 0 0
/proc/31206/statm: 135796 37538 377 364 0 71693 0
[pid=31208] ppid=31206 vsize=123000 CPUtime=298.68 cores=0-7
/proc/31208/stat : 31208 (lingeling) R 31206 31208 31208 0 -1 4202496 44339 0 0 0 29862 6 0 0 25 0 1 0 546268585 125952000 29920 33554432000 4194304 4352236 140734141361104 18446744073709551615 4235610 0 0 16781312 17506 0 0 0 17 1 0 0 0
/proc/31208/statm: 30750 29920 129 39 0 29830 0
[pid=31213] ppid=31178 vsize=553440 CPUtime=0.3 cores=0-7
/proc/31213/stat : 31213 (python) S 31178 31178 30702 0 -1 4202560 841 0 0 0 14 16 0 0 18 0 1 0 546278577 566722560 37536 33554432000 4194304 5683644 140736094739312 18446744073709551615 230809185862 0 0 16781312 514 6601203930376405252 0 0 17 4 0 0 0
/proc/31213/statm: 138360 37536 371 364 0 74254 0
[pid=31215] ppid=31213 vsize=189728 CPUtime=200.12 cores=0-7
/proc/31215/stat : 31215 (precosat) R 31213 31215 31215 0 -1 4202496 66309 0 0 0 20002 10 0 0 25 0 1 0 546278578 194281472 45489 33554432000 4194304 4890832 140735667118592 18446744073709551615 4232329 0 0 16781312 17442 0 0 0 17 2 0 0 0
/proc/31215/statm: 47432 45489 86 171 0 47259 0
[pid=31217] ppid=31178 vsize=563696 CPUtime=1.04 cores=0-7
/proc/31217/stat : 31217 (python) S 31178 31178 30702 0 -1 4202560 1239 0 0 0 77 27 0 0 15 0 1 0 546278601 577224704 37893 33554432000 4194304 5683644 140736094739312 18446744073709551615 230809185862 0 0 16781312 514 6601203930376405252 0 0 17 4 0 0 0
/proc/31217/statm: 140924 37893 372 364 0 76815 0
[pid=31219] ppid=31217 vsize=5062684 CPUtime=198.55 cores=0-7
/proc/31219/stat : 31219 (cryptominisat-2) R 31217 31219 31219 0 -1 4202496 8421813 0 0 0 18723 1132 0 0 25 0 1 0 546278601 5184188416 1192993 33554432000 4194304 4677096 140734526858544 18446744073709551615 4319726 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/31219/statm: 1265671 1192993 393 118 0 1260630 0
[pid=31178/tid=31186] ppid=31176 vsize=573940 CPUtime=0 cores=0-7
/proc/31178/task/31186/stat : 31186 (python) S 31176 31178 30702 0 -1 4202560 27 927 0 8 0 0 0 0 17 0 11 0 546268559 587714560 39095 33554432000 4194304 5683644 140736094739312 18446744073709551615 230820989361 0 0 16781312 2 18446604451036441344 0 0 -1 1 0 0 0
[pid=31178/tid=31189] ppid=31176 vsize=573940 CPUtime=0 cores=0-7
/proc/31178/task/31189/stat : 31189 (python) S 31176 31178 30702 0 -1 4202560 24 927 0 8 0 0 0 0 18 0 11 0 546268562 587714560 39095 33554432000 4194304 5683644 140736094739312 18446744073709551615 230820989361 0 0 16781312 2 18446604451036441344 0 0 -1 3 0 0 0
[pid=31178/tid=31192] ppid=31176 vsize=573940 CPUtime=0 cores=0-7
/proc/31178/task/31192/stat : 31192 (python) S 31176 31178 30702 0 -1 4202560 72 927 0 8 0 0 0 0 19 0 11 0 546268566 587714560 39095 33554432000 4194304 5683644 140736094739312 18446744073709551615 230820989361 0 0 16781312 2 18446604451036441344 0 0 -1 4 0 0 0
[pid=31178/tid=31195] ppid=31176 vsize=573940 CPUtime=0 cores=0-7
/proc/31178/task/31195/stat : 31195 (python) S 31176 31178 30702 0 -1 4202560 34 927 0 8 0 0 0 0 20 0 11 0 546268569 587714560 39095 33554432000 4194304 5683644 140736094739312 18446744073709551615 230820989361 0 0 16781312 2 18446604451036441344 0 0 -1 0 0 0 0
[pid=31178/tid=31198] ppid=31176 vsize=573940 CPUtime=0 cores=0-7
/proc/31178/task/31198/stat : 31198 (python) S 31176 31178 30702 0 -1 4202560 34 927 0 8 0 0 0 0 21 0 11 0 546268573 587714560 39095 33554432000 4194304 5683644 140736094739312 18446744073709551615 230820989361 0 0 16781312 2 18446604451036441344 0 0 -1 0 0 0 0
[pid=31178/tid=31201] ppid=31176 vsize=573940 CPUtime=0 cores=0-7
/proc/31178/task/31201/stat : 31201 (python) S 31176 31178 30702 0 -1 4202560 34 927 0 8 0 0 0 0 22 0 11 0 546268576 587714560 39095 33554432000 4194304 5683644 140736094739312 18446744073709551615 230820989361 0 0 16781312 2 18446604451036441344 0 0 -1 7 0 0 0
[pid=31178/tid=31204] ppid=31176 vsize=573940 CPUtime=0 cores=0-7
/proc/31178/task/31204/stat : 31204 (python) S 31176 31178 30702 0 -1 4202560 33 927 0 8 0 0 0 0 23 0 11 0 546268580 587714560 39095 33554432000 4194304 5683644 140736094739312 18446744073709551615 230820989361 0 0 16781312 2 18446604451036441344 0 0 -1 1 0 0 0
[pid=31178/tid=31207] ppid=31176 vsize=573940 CPUtime=0 cores=0-7
/proc/31178/task/31207/stat : 31207 (python) S 31176 31178 30702 0 -1 4202560 34 927 0 8 0 0 0 0 24 0 11 0 546268583 587714560 39095 33554432000 4194304 5683644 140736094739312 18446744073709551615 230820989361 0 0 16781312 2 18446604451036441344 0 0 -1 1 0 0 0
[pid=31178/tid=31214] ppid=31176 vsize=573940 CPUtime=0 cores=0-7
/proc/31178/task/31214/stat : 31214 (python) S 31176 31178 30702 0 -1 4202560 37 927 0 8 0 0 0 0 20 0 11 0 546278578 587714560 39095 33554432000 4194304 5683644 140736094739312 18446744073709551615 230820989361 0 0 16781312 2 18446604451036441344 0 0 -1 1 0 0 0
[pid=31178/tid=31218] ppid=31176 vsize=573940 CPUtime=0 cores=0-7
/proc/31178/task/31218/stat : 31218 (python) S 31176 31178 30702 0 -1 4202560 35 927 0 8 0 0 0 0 20 0 11 0 546278601 587714560 39095 33554432000 4194304 5683644 140736094739312 18446744073709551615 230820989361 0 0 16781312 2 18446604451036441344 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 2437.46
Current children cumulated vsize (KiB) 30530944



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+387.001 s]
/proc/loadavg: 8.18 7.34 5.46 9/228 31225
/proc/meminfo: memFree=1582036/32951124 swapFree=59765712/67111528
[pid=31178] ppid=31176 vsize=573940 CPUtime=40.07 cores=0-7
/proc/31178/stat : 31178 (python) S 31176 31178 30702 0 -1 4202496 65797 927 127 8 3980 27 0 0 19 0 11 0 546264361 587714560 39095 33554432000 4194304 5683644 140736094739312 18446744073709551615 230820992459 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 114
/proc/31178/statm: 143485 39095 1894 364 0 79376 0
[pid=31185] ppid=31178 vsize=416100 CPUtime=0.15 cores=0-7
/proc/31185/stat : 31185 (python) S 31178 31178 30702 0 -1 4202560 1120 0 0 0 8 7 0 0 19 0 2 0 546268559 426086400 37431 33554432000 4194304 5683644 140736094739312 18446744073709551615 230820992459 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/31185/statm: 104025 37431 409 364 0 39943 0
[pid=31187] ppid=31185 vsize=62976 CPUtime=100.13 cores=0-7
/proc/31187/stat : 31187 (lingeling) T 31185 31187 31187 0 -1 4202496 22911 0 0 0 10010 3 0 0 25 0 1 0 546268559 64487424 14914 33554432000 4194304 4352236 140735924766976 18446744073709551615 4281293 0 0 16781312 17506 18446744071562691360 0 0 17 2 0 0 0
/proc/31187/statm: 15744 14914 129 39 0 14824 0
[pid=31185/tid=31212] ppid=31178 vsize=416100 CPUtime=0 cores=0-7
/proc/31185/task/31212/stat : 31212 (python) S 31178 31178 30702 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 546278574 426086400 37431 33554432000 4194304 5683644 140736094739312 18446744073709551615 230820989361 0 0 16781312 514 18446604453860493248 0 0 -1 2 0 0 0
[pid=31188] ppid=31178 vsize=416112 CPUtime=1.19 cores=0-7
/proc/31188/stat : 31188 (python) S 31178 31178 30702 0 -1 4202560 2305 0 0 0 80 39 0 0 15 0 1 0 546268562 426098688 37392 33554432000 4194304 5683644 140736094739312 18446744073709551615 230809185862 0 0 16781312 514 4610951548954968321 0 0 17 5 0 0 0
/proc/31188/statm: 104028 37392 371 364 0 39943 0
[pid=31190] ppid=31188 vsize=6656860 CPUtime=344.97 cores=0-7
/proc/31190/stat : 31190 (cryptominisat-2) R 31188 31190 31190 0 -1 4202496 8699559 0 2 0 33357 1140 0 0 25 0 1 0 546268563 6816624640 1471941 33554432000 4194304 4677096 140735500729728 18446744073709551615 4336422 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/31190/statm: 1664215 1471941 393 118 0 1659174 0
[pid=31191] ppid=31178 vsize=491904 CPUtime=0.52 cores=0-7
/proc/31191/stat : 31191 (python) S 31178 31178 30702 0 -1 4202560 789 0 0 0 25 27 0 0 18 0 1 0 546268565 503709696 37513 33554432000 4194304 5683644 140736094739312 18446744073709551615 230809185862 0 0 16781312 514 6601203930376405255 0 0 17 7 0 0 0
/proc/31191/statm: 122976 37513 371 364 0 58888 0
[pid=31193] ppid=31191 vsize=110196 CPUtime=343.76 cores=0-7
/proc/31193/stat : 31193 (lingeling) R 31191 31193 31193 0 -1 4202496 39079 0 0 0 34370 6 0 0 25 0 1 0 546268566 112840704 26720 33554432000 4194304 4352236 140734250655168 18446744073709551615 4328380 0 0 16781312 17506 0 0 0 17 5 0 0 0
/proc/31193/statm: 27549 26720 129 39 0 26629 0
[pid=31194] ppid=31178 vsize=502160 CPUtime=1.24 cores=0-7
/proc/31194/stat : 31194 (python) S 31178 31178 30702 0 -1 4202560 1186 0 0 0 89 35 0 0 15 0 1 0 546268569 514211840 37812 33554432000 4194304 5683644 140736094739312 18446744073709551615 230809185862 0 0 16781312 514 6601203930376405252 0 0 17 6 0 0 0
/proc/31194/statm: 125540 37812 372 364 0 61449 0
[pid=31196] ppid=31194 vsize=6441612 CPUtime=343.68 cores=0-7
/proc/31196/stat : 31196 (cryptominisat-2) R 31194 31196 31196 0 -1 4202496 8388589 0 0 0 33327 1041 0 0 25 0 1 0 546268569 6596210688 1433026 33554432000 4194304 4677096 140733366123872 18446744073709551615 4249367 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/31196/statm: 1610403 1433026 393 118 0 1605362 0
[pid=31197] ppid=31178 vsize=512416 CPUtime=0.51 cores=0-7
/proc/31197/stat : 31197 (python) S 31178 31178 30702 0 -1 4202560 808 0 0 0 25 26 0 0 18 0 1 0 546268572 524713984 37570 33554432000 4194304 5683644 140736094739312 18446744073709551615 230809185862 0 0 16781312 514 6601203930376405252 0 0 17 1 0 0 0
/proc/31197/statm: 128104 37570 371 364 0 64010 0
[pid=31199] ppid=31197 vsize=103004 CPUtime=344.89 cores=0-7
/proc/31199/stat : 31199 (lingeling) R 31197 31199 31199 0 -1 4202496 39465 0 0 0 34483 6 0 0 25 0 1 0 546268573 105476096 24921 33554432000 4194304 4352236 140734465713424 18446744073709551615 4208055 0 0 16781312 17506 0 0 0 17 0 0 0 0
/proc/31199/statm: 25751 24921 129 39 0 24831 0
[pid=31200] ppid=31178 vsize=522672 CPUtime=1.29 cores=0-7
/proc/31200/stat : 31200 (python) S 31178 31178 30702 0 -1 4202560 1573 0 0 0 88 41 0 0 15 0 1 0 546268575 535216128 37908 33554432000 4194304 5683644 140736094739312 18446744073709551615 230809185862 0 0 16781312 514 6601203930376405249 0 0 17 7 0 0 0
/proc/31200/statm: 130668 37908 372 364 0 66571 0
[pid=31202] ppid=31200 vsize=6494220 CPUtime=338.54 cores=0-7
/proc/31202/stat : 31202 (cryptominisat-2) R 31200 31202 31202 0 -1 4202496 8777459 0 0 0 32689 1165 0 0 25 0 1 0 546268576 6650081280 1434754 33554432000 4194304 4677096 140733231844048 18446744073709551615 4319643 0 0 16781312 2 0 0 0 17 7 0 0 0
/proc/31202/statm: 1623555 1434754 393 118 0 1618514 0
[pid=31203] ppid=31178 vsize=532928 CPUtime=0.15 cores=0-7
/proc/31203/stat : 31203 (python) S 31178 31178 30702 0 -1 4202560 1001 0 0 0 7 8 0 0 19 0 2 0 546268579 545718272 37619 33554432000 4194304 5683644 140736094739312 18446744073709551615 230820992459 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/31203/statm: 133232 37619 399 364 0 69132 0
[pid=31205] ppid=31203 vsize=130508 CPUtime=100.13 cores=0-7
/proc/31205/stat : 31205 (SApperloT-base) T 31203 31205 31205 0 -1 4202496 33365 0 0 0 10006 7 0 0 25 0 1 0 546268581 133640192 31001 33554432000 134512640 135674940 4291858656 18446744073709551615 134552074 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/31205/statm: 32627 31001 99 284 0 32341 0
[pid=31203/tid=31216] ppid=31178 vsize=532928 CPUtime=0 cores=0-7
/proc/31203/task/31216/stat : 31216 (python) S 31178 31178 30702 0 -1 4202560 66 0 0 0 0 0 0 0 19 0 2 0 546278597 545718272 37619 33554432000 4194304 5683644 140736094739312 18446744073709551615 230820989361 0 0 16781312 514 18446604453828097216 0 0 -1 2 0 0 0
[pid=31206] ppid=31178 vsize=543184 CPUtime=0.51 cores=0-7
/proc/31206/stat : 31206 (python) S 31178 31178 30702 0 -1 4202560 867 0 0 0 24 27 0 0 18 0 1 0 546268583 556220416 37538 33554432000 4194304 5683644 140736094739312 18446744073709551615 230809185862 0 0 16781312 514 6601203930376405251 0 0 17 1 0 0 0
/proc/31206/statm: 135796 37538 377 364 0 71693 0
[pid=31208] ppid=31206 vsize=118916 CPUtime=343.25 cores=0-7
/proc/31208/stat : 31208 (lingeling) R 31206 31208 31208 0 -1 4202496 45493 0 0 0 34319 6 0 0 25 0 1 0 546268585 121769984 28899 33554432000 4194304 4352236 140734141361104 18446744073709551615 4328042 0 0 16781312 17506 0 0 0 17 1 0 0 0
/proc/31208/statm: 29729 28899 129 39 0 28809 0
[pid=31213] ppid=31178 vsize=553440 CPUtime=0.37 cores=0-7
/proc/31213/stat : 31213 (python) S 31178 31178 30702 0 -1 4202560 841 0 0 0 17 20 0 0 18 0 1 0 546278577 566722560 37536 33554432000 4194304 5683644 140736094739312 18446744073709551615 230809185862 0 0 16781312 514 6601203930376405252 0 0 17 4 0 0 0
/proc/31213/statm: 138360 37536 371 364 0 74254 0
[pid=31215] ppid=31213 vsize=204476 CPUtime=244.83 cores=0-7
/proc/31215/stat : 31215 (precosat) R 31213 31215 31215 0 -1 4202496 76191 0 0 0 24471 12 0 0 25 0 1 0 546278578 209383424 49175 33554432000 4194304 4890832 140735667118592 18446744073709551615 4238565 0 0 16781312 17442 0 0 0 17 2 0 0 0
/proc/31215/statm: 51119 49175 86 171 0 50946 0
[pid=31217] ppid=31178 vsize=563696 CPUtime=1.12 cores=0-7
/proc/31217/stat : 31217 (python) S 31178 31178 30702 0 -1 4202560 1240 0 0 0 81 31 0 0 15 0 1 0 546278601 577224704 37894 33554432000 4194304 5683644 140736094739312 18446744073709551615 230809185862 0 0 16781312 514 12538808617219883268 0 0 17 4 0 0 0
/proc/31217/statm: 140924 37894 372 364 0 76815 0
[pid=31219] ppid=31217 vsize=5795124 CPUtime=243.11 cores=0-7
/proc/31219/stat : 31219 (cryptominisat-2) R 31217 31219 31219 0 -1 4202496 8548016 0 0 0 23158 1153 0 0 25 0 1 0 546278601 5934206976 1314623 33554432000 4194304 4677096 140734526858544 18446744073709551615 4586840 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/31219/statm: 1448781 1314623 393 118 0 1443740 0
[pid=31178/tid=31186] ppid=31176 vsize=573940 CPUtime=0 cores=0-7
/proc/31178/task/31186/stat : 31186 (python) S 31176 31178 30702 0 -1 4202560 27 927 0 8 0 0 0 0 17 0 11 0 546268559 587714560 39095 33554432000 4194304 5683644 140736094739312 18446744073709551615 230820989361 0 0 16781312 2 18446604451036441344 0 0 -1 1 0 0 0
[pid=31178/tid=31189] ppid=31176 vsize=573940 CPUtime=0 cores=0-7
/proc/31178/task/31189/stat : 31189 (python) S 31176 31178 30702 0 -1 4202560 24 927 0 8 0 0 0 0 18 0 11 0 546268562 587714560 39095 33554432000 4194304 5683644 140736094739312 18446744073709551615 230820989361 0 0 16781312 2 18446604451036441344 0 0 -1 3 0 0 0
[pid=31178/tid=31192] ppid=31176 vsize=573940 CPUtime=0 cores=0-7
/proc/31178/task/31192/stat : 31192 (python) S 31176 31178 30702 0 -1 4202560 72 927 0 8 0 0 0 0 19 0 11 0 546268566 587714560 39095 33554432000 4194304 5683644 140736094739312 18446744073709551615 230820989361 0 0 16781312 2 18446604451036441344 0 0 -1 4 0 0 0
[pid=31178/tid=31195] ppid=31176 vsize=573940 CPUtime=0 cores=0-7
/proc/31178/task/31195/stat : 31195 (python) S 31176 31178 30702 0 -1 4202560 34 927 0 8 0 0 0 0 20 0 11 0 546268569 587714560 39095 33554432000 4194304 5683644 140736094739312 18446744073709551615 230820989361 0 0 16781312 2 18446604451036441344 0 0 -1 0 0 0 0
[pid=31178/tid=31198] ppid=31176 vsize=573940 CPUtime=0 cores=0-7
/proc/31178/task/31198/stat : 31198 (python) S 31176 31178 30702 0 -1 4202560 34 927 0 8 0 0 0 0 21 0 11 0 546268573 587714560 39095 33554432000 4194304 5683644 140736094739312 18446744073709551615 230820989361 0 0 16781312 2 18446604451036441344 0 0 -1 0 0 0 0
[pid=31178/tid=31201] ppid=31176 vsize=573940 CPUtime=0 cores=0-7
/proc/31178/task/31201/stat : 31201 (python) S 31176 31178 30702 0 -1 4202560 34 927 0 8 0 0 0 0 22 0 11 0 546268576 587714560 39095 33554432000 4194304 5683644 140736094739312 18446744073709551615 230820989361 0 0 16781312 2 18446604451036441344 0 0 -1 7 0 0 0
[pid=31178/tid=31204] ppid=31176 vsize=573940 CPUtime=0 cores=0-7
/proc/31178/task/31204/stat : 31204 (python) S 31176 31178 30702 0 -1 4202560 33 927 0 8 0 0 0 0 23 0 11 0 546268580 587714560 39095 33554432000 4194304 5683644 140736094739312 18446744073709551615 230820989361 0 0 16781312 2 18446604451036441344 0 0 -1 1 0 0 0
[pid=31178/tid=31207] ppid=31176 vsize=573940 CPUtime=0 cores=0-7
/proc/31178/task/31207/stat : 31207 (python) S 31176 31178 30702 0 -1 4202560 34 927 0 8 0 0 0 0 24 0 11 0 546268583 587714560 39095 33554432000 4194304 5683644 140736094739312 18446744073709551615 230820989361 0 0 16781312 2 18446604451036441344 0 0 -1 1 0 0 0
[pid=31178/tid=31214] ppid=31176 vsize=573940 CPUtime=0 cores=0-7
/proc/31178/task/31214/stat : 31214 (python) S 31176 31178 30702 0 -1 4202560 37 927 0 8 0 0 0 0 20 0 11 0 546278578 587714560 39095 33554432000 4194304 5683644 140736094739312 18446744073709551615 230820989361 0 0 16781312 2 18446604451036441344 0 0 -1 1 0 0 0
[pid=31178/tid=31218] ppid=31176 vsize=573940 CPUtime=0 cores=0-7
/proc/31178/task/31218/stat : 31218 (python) S 31176 31178 30702 0 -1 4202560 35 927 0 8 0 0 0 0 20 0 11 0 546278601 587714560 39095 33554432000 4194304 5683644 140736094739312 18446744073709551615 230820989361 0 0 16781312 2 18446604451036441344 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 2794.41
Current children cumulated vsize (KiB) 31746444

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 31178 and gives
#  childrusage.ru_utime.tv_sec=39
#  childrusage.ru_utime.tv_usec=810947
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=299954
# CPU time returned by wait4() is 40.1109
# while last known CPU time is 2794.41
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 387.081
CPU time (s): 2794.41
CPU user time (s): 2746.14
CPU system time (s): 48.27
CPU usage (%): 721.918
Max. virtual memory (cumulated for all children) (KiB): 31746444

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39.8109
system time used= 0.299954
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 66731
page faults= 135
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 8002
involuntary context switches= 177

runsolver used 1.39979 second user time and 3.49447 second system time

The end

Launcher Data 

Begin job on node104 at 2011-05-02 16:30:39
IDJOB=3321569
IDBENCH=82372
IDSOLVER=1710
FILE ID=node104/3321569-1304346638
RUNJOBID= node104-1304342614-30716
PBS_JOBID= 13178062
Free space on /tmp= 73420 MiB

SOLVER NAME= borg-sat 11.03.02-industrial
BENCH NAME= SAT11/application/rintanen/SATPlanning/openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_3.035-NOTKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.industrial.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3321569-1304346638/watcher-3321569-1304346638 -o /tmp/evaluation-result-3321569-1304346638/solver-3321569-1304346638 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3321569-1304346638.cnf -seed 1842385070 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= c4319228342e10028de028a9b67c3404
RANDOM SEED=1842385070

node104.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.71
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5293.18
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      25171088 kB
Buffers:          1164 kB
Cached:          94440 kB
SwapCached:      36176 kB
Active:          72724 kB
Inactive:      7541012 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      25171088 kB
SwapTotal:    67111528 kB
SwapFree:     59765712 kB
Dirty:           43556 kB
Writeback:           0 kB
AnonPages:     7489368 kB
Mapped:           9616 kB
Slab:            62564 kB
PageTables:      36760 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 16434956 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73388 MiB
End job on node104 at 2011-05-02 16:37:08