Trace number 3378989

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-par-industrial (fixed)? (MO) 1348.41 382.358

General information on the benchmark

Nameapplication/rintanen/SATPlanning/
openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_3.045-NOTKNOWN.cnf
MD5SUM4ab53801f3b1a3f7169c9fb38cba4184
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables171676
Number of clauses870241
Sum of the clauses size2069671
Maximum clause length63
Minimum clause length1
Number of clauses of size 1211
Number of clauses of size 2859140
Number of clauses of size 32700
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 58190

Solver Data 

0.42/0.81	c INFO: loaded portfolio from HOME/etc/borg-mix+class.industrial.pickle
0.42/0.81	c INFO: solving HOME/instance-3378989-1305465319.cnf
0.42/0.81	c INFO: computing task features
3.11/3.56	c INFO: computed variable-clause graph statistics
3.81/4.30	c INFO: computed clause balance statistics
15.51/15.97	c INFO: computed variable balance statistics
23.91/24.31	c INFO: computed small-clause counts
24.01/24.49	c INFO: computed Horn-clause counts
58.31/58.78	c INFO: computed variable graph statistics
58.31/58.78	c INFO: collected features for HOME/instance-3378989-1305465319.cnf in 57.88 s
58.31/58.79	c INFO: running cryptominisat-2.9.0@0 for 1142 with 1142 remaining (b = 0.45)
58.40/58.80	c INFO: running lingeling-276@0 for 1142 with 1142 remaining (b = 0.43)
58.40/58.82	c INFO: running lingeling-276@0 for 1142 with 1142 remaining (b = 0.38)
58.40/58.83	c INFO: running lingeling-276@0 for 97 with 1141 remaining (b = 0.17)
458.28/159.12	c INFO: running cryptominisat-2.9.0@0 for 1041 with 1041 remaining (b = 0.21)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3378989-1305465319/watcher-3378989-1305465319 -o /tmp/evaluation-result-3378989-1305465319/solver-3378989-1305465319 -C 4800 -W 1300 -M 15500 python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3378989-1305465319.cnf -seed 2051470122 -budget 4800 -cores 4 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.00 0.00 0.60 2/359 2903
/proc/meminfo: memFree=26482220/32951124 swapFree=63649232/67111528
[pid=2903] ppid=2901 vsize=15184 CPUtime=0 cores=1,3,5,7
/proc/2903/stat : 2903 (python) S 2901 2903 2862 0 -1 4202496 723 0 0 0 0 0 0 0 20 0 1 0 658130496 15548416 615 33554432000 4194304 5683644 140736440038896 18446744073709551615 210204645376 0 2147483391 16781312 2 18446744071699207358 0 0 17 1 0 0 0
/proc/2903/statm: 3796 615 321 364 0 283 0

[startup+0.086497 s]
/proc/loadavg: 0.00 0.00 0.60 2/359 2903
/proc/meminfo: memFree=26482220/32951124 swapFree=63649232/67111528
[pid=2903] ppid=2901 vsize=29788 CPUtime=0.04 cores=1,3,5,7
/proc/2903/stat : 2903 (python) S 2901 2903 2862 0 -1 4202496 1454 0 0 0 3 1 0 0 17 0 1 0 658130496 30502912 1296 33554432000 4194304 5683644 140736440038896 18446744073709551615 210204645376 0 2147483391 16781312 2 18446744071699207358 0 0 17 1 0 0 0
/proc/2903/statm: 7447 1296 443 364 0 817 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 29788

[startup+0.100541 s]
/proc/loadavg: 0.00 0.00 0.60 2/359 2903
/proc/meminfo: memFree=26482220/32951124 swapFree=63649232/67111528
[pid=2903] ppid=2901 vsize=38904 CPUtime=0.04 cores=1,3,5,7
/proc/2903/stat : 2903 (python) R 2901 2903 2862 0 -1 4202496 1657 0 0 0 3 1 0 0 17 0 1 0 658130496 39837696 1486 33554432000 4194304 5683644 140736440038896 18446744073709551615 210204645376 0 2147483391 16781312 2 0 0 0 17 1 0 0 0
/proc/2903/statm: 9726 1486 455 364 0 1026 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 38904

[startup+0.300459 s]
/proc/loadavg: 0.00 0.00 0.60 2/359 2903
/proc/meminfo: memFree=26482220/32951124 swapFree=63649232/67111528
[pid=2903] ppid=2901 vsize=126300 CPUtime=0.15 cores=1,3,5,7
/proc/2903/stat : 2903 (python) R 2901 2903 2862 0 -1 4202496 4851 939 1 0 11 4 0 0 18 0 1 0 658130496 129331200 3900 33554432000 4194304 5683644 140736440038896 18446744073709551615 4539972 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/2903/statm: 31575 3900 1001 364 0 2870 0
Current children cumulated CPU time (s) 0.15
Current children cumulated vsize (KiB) 126300

[startup+0.70042 s]
/proc/loadavg: 0.00 0.00 0.60 2/359 2903
/proc/meminfo: memFree=26482220/32951124 swapFree=63649232/67111528
[pid=2903] ppid=2901 vsize=245780 CPUtime=0.35 cores=1,3,5,7
/proc/2903/stat : 2903 (python) R 2901 2903 2862 0 -1 4202496 7993 939 1 0 21 14 0 0 15 0 1 0 658130496 251678720 5894 33554432000 4194304 5683644 140736440038896 18446744073709551615 210204308165 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/2903/statm: 61445 5894 1621 364 0 4447 0
Current children cumulated CPU time (s) 0.35
Current children cumulated vsize (KiB) 245780

[startup+1.50026 s]
/proc/loadavg: 0.00 0.00 0.60 3/358 2908
/proc/meminfo: memFree=26398304/32951124 swapFree=63649232/67111528
[pid=2903] ppid=2901 vsize=337808 CPUtime=1.11 cores=1,3,5,7
/proc/2903/stat : 2903 (python) R 2901 2903 2862 0 -1 4202496 23858 939 1 0 93 18 0 0 16 0 1 0 658130496 345915392 21539 33554432000 4194304 5683644 140736440038896 18446744073709551615 210204308513 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/2903/statm: 84452 21540 1761 364 0 20376 0
Current children cumulated CPU time (s) 1.11
Current children cumulated vsize (KiB) 337808

[startup+3.10099 s]
/proc/loadavg: 0.00 0.00 0.60 3/363 2918
/proc/meminfo: memFree=26198928/32951124 swapFree=63649232/67111528
[pid=2903] ppid=2901 vsize=401596 CPUtime=2.71 cores=1,3,5,7
/proc/2903/stat : 2903 (python) R 2901 2903 2862 0 -1 4202496 50067 939 1 0 250 21 0 0 18 0 1 0 658130496 411234304 37455 33554432000 4194304 5683644 140736440038896 18446744073709551615 4438566 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/2903/statm: 100399 37455 1764 364 0 36323 0
Current children cumulated CPU time (s) 2.71
Current children cumulated vsize (KiB) 401596

[startup+6.30046 s]
/proc/loadavg: 0.16 0.03 0.61 3/363 2919
/proc/meminfo: memFree=25910884/32951124 swapFree=63649232/67111528
[pid=2903] ppid=2901 vsize=455912 CPUtime=5.91 cores=1,3,5,7
/proc/2903/stat : 2903 (python) R 2901 2903 2862 0 -1 4202496 73642 939 1 0 567 24 0 0 25 0 1 0 658130496 466853888 51363 33554432000 4194304 5683644 140736440038896 18446744073709551615 47520528380704 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/2903/statm: 113978 51363 1826 364 0 49902 0
Current children cumulated CPU time (s) 5.91
Current children cumulated vsize (KiB) 455912

[startup+12.7004 s]
/proc/loadavg: 0.31 0.07 0.62 3/363 2919
/proc/meminfo: memFree=25549768/32951124 swapFree=63649232/67111528
[pid=2903] ppid=2901 vsize=455912 CPUtime=12.31 cores=1,3,5,7
/proc/2903/stat : 2903 (python) R 2901 2903 2862 0 -1 4202496 73642 939 1 0 1207 24 0 0 25 0 1 0 658130496 466853888 51363 33554432000 4194304 5683644 140736440038896 18446744073709551615 210208055989 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/2903/statm: 113978 51363 1826 364 0 49902 0
Current children cumulated CPU time (s) 12.31
Current children cumulated vsize (KiB) 455912

[startup+25.5002 s]
/proc/loadavg: 0.75 0.18 0.64 3/363 2919
/proc/meminfo: memFree=25673168/32951124 swapFree=63649232/67111528
[pid=2903] ppid=2901 vsize=455912 CPUtime=25.11 cores=1,3,5,7
/proc/2903/stat : 2903 (python) R 2901 2903 2862 0 -1 4202496 73649 939 1 0 2487 24 0 0 25 0 1 0 658130496 466853888 51370 33554432000 4194304 5683644 140736440038896 18446744073709551615 47520525605004 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/2903/statm: 113978 51370 1833 364 0 49902 0
Current children cumulated CPU time (s) 25.11
Current children cumulated vsize (KiB) 455912

[startup+51.1009 s]
/proc/loadavg: 1.24 0.34 0.68 3/363 2920
/proc/meminfo: memFree=25673184/32951124 swapFree=63649232/67111528
[pid=2903] ppid=2901 vsize=455912 CPUtime=50.71 cores=1,3,5,7
/proc/2903/stat : 2903 (python) R 2901 2903 2862 0 -1 4202496 73649 939 1 0 5047 24 0 0 25 0 1 0 658130496 466853888 51370 33554432000 4194304 5683644 140736440038896 18446744073709551615 47520525605004 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/2903/statm: 113978 51370 1833 364 0 49902 0
Current children cumulated CPU time (s) 50.71
Current children cumulated vsize (KiB) 455912

[startup+102.314 s]
/proc/loadavg: 3.26 1.00 0.89 6/375 2934
/proc/meminfo: memFree=24889632/32951124 swapFree=63649232/67111528
[pid=2903] ppid=2901 vsize=483436 CPUtime=58.44 cores=1,3,5,7
/proc/2903/stat : 2903 (python) S 2901 2903 2862 0 -1 4202496 76307 939 1 0 5818 26 0 0 25 0 5 0 658130496 495038464 48056 33554432000 4194304 5683644 140736440038896 18446744073709551615 210216474059 0 0 16781312 2 18446744073709551615 0 0 17 1 0 0 0
/proc/2903/statm: 120859 48056 1881 364 0 56768 0
[pid=2921] ppid=2903 vsize=442424 CPUtime=0.11 cores=1,3,5,7
/proc/2921/stat : 2921 (python) S 2903 2903 2862 0 -1 4202560 933 0 0 0 5 6 0 0 15 0 1 0 658136375 453042176 46535 33554432000 4194304 5683644 140736440038896 18446744073709551615 210204667407 0 0 16781312 514 8264465960333705477 0 0 17 1 0 0 0
/proc/2921/statm: 110606 46535 376 364 0 46524 0
[pid=2926] ppid=2921 vsize=805064 CPUtime=43.49 cores=1,3,5,7
/proc/2926/stat : 2926 (cryptominisat-2) R 2921 2926 2926 0 -1 4202496 157481 0 0 0 4327 22 0 0 25 0 1 0 658136377 824385536 147312 33554432000 4194304 4677096 140735867134784 18446744073709551615 4336280 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/2926/statm: 201266 147312 387 118 0 196225 0
[pid=2924] ppid=2903 vsize=452680 CPUtime=0.11 cores=1,3,5,7
/proc/2924/stat : 2924 (python) S 2903 2903 2862 0 -1 4202560 926 0 0 0 6 5 0 0 18 0 1 0 658136377 463544320 46533 33554432000 4194304 5683644 140736440038896 18446744073709551615 210204667462 0 0 16781312 514 4108092100719902984 0 0 17 1 0 0 0
/proc/2924/statm: 113170 46533 370 364 0 49085 0
[pid=2927] ppid=2924 vsize=64668 CPUtime=42.96 cores=1,3,5,7
/proc/2927/stat : 2927 (lingeling) R 2924 2927 2927 0 -1 4202496 22805 0 0 0 4293 3 0 0 25 0 1 0 658136378 66220032 14313 33554432000 4194304 4352236 140736299216960 18446744073709551615 4331541 0 0 16781312 17506 0 0 0 17 7 0 0 0
/proc/2927/statm: 16167 14313 129 39 0 15247 0
[pid=2928] ppid=2903 vsize=462936 CPUtime=0.11 cores=1,3,5,7
/proc/2928/stat : 2928 (python) S 2903 2903 2862 0 -1 4202560 939 0 0 0 5 6 0 0 18 0 1 0 658136378 474046464 46537 33554432000 4194304 5683644 140736440038896 18446744073709551615 210204667462 0 0 16781312 514 4108092100719902982 0 0 17 1 0 0 0
/proc/2928/statm: 115734 46537 370 364 0 51646 0
[pid=2930] ppid=2928 vsize=64932 CPUtime=43.48 cores=1,3,5,7
/proc/2930/stat : 2930 (lingeling) R 2928 2930 2930 0 -1 4202496 22842 0 0 0 4345 3 0 0 25 0 1 0 658136378 66490368 14380 33554432000 4194304 4352236 140735663280640 18446744073709551615 4281048 0 0 16781312 17506 0 0 0 17 5 0 0 0
/proc/2930/statm: 16233 14380 129 39 0 15313 0
[pid=2931] ppid=2903 vsize=473192 CPUtime=0.11 cores=1,3,5,7
/proc/2931/stat : 2931 (python) S 2903 2903 2862 0 -1 4202560 945 0 0 0 6 5 0 0 18 0 1 0 658136379 484548608 46541 33554432000 4194304 5683644 140736440038896 18446744073709551615 210204667462 0 0 16781312 514 4108092100719902982 0 0 17 1 0 0 0
/proc/2931/statm: 118298 46541 370 364 0 54207 0
[pid=2933] ppid=2931 vsize=60124 CPUtime=43.01 cores=1,3,5,7
/proc/2933/stat : 2933 (lingeling) R 2931 2933 2933 0 -1 4202496 21663 0 0 0 4298 3 0 0 25 0 1 0 658136379 61566976 13177 33554432000 4194304 4352236 140736981479872 18446744073709551615 4278730 0 0 16781312 17506 0 0 0 17 1 0 0 0
/proc/2933/statm: 15031 13177 129 39 0 14111 0
[pid=2903/tid=2923] ppid=2901 vsize=483436 CPUtime=0 cores=1,3,5,7
/proc/2903/task/2923/stat : 2923 (python) S 2901 2903 2862 0 -1 4202560 36 939 0 0 0 0 0 0 25 0 5 0 658136376 495038464 48056 33554432000 4194304 5683644 140736440038896 18446744073709551615 210216470961 0 0 16781312 2 18446604465934113792 0 0 -1 5 0 0 0
[pid=2903/tid=2925] ppid=2901 vsize=483436 CPUtime=0 cores=1,3,5,7
/proc/2903/task/2925/stat : 2925 (python) S 2901 2903 2862 0 -1 4202560 16 939 0 0 0 0 0 0 25 0 5 0 658136377 495038464 48056 33554432000 4194304 5683644 140736440038896 18446744073709551615 210216470961 0 0 16781312 2 18446604465934113792 0 0 -1 1 0 0 0
[pid=2903/tid=2929] ppid=2901 vsize=483436 CPUtime=0 cores=1,3,5,7
/proc/2903/task/2929/stat : 2929 (python) S 2901 2903 2862 0 -1 4202560 24 939 0 0 0 0 0 0 25 0 5 0 658136378 495038464 48056 33554432000 4194304 5683644 140736440038896 18446744073709551615 210216470961 0 0 16781312 2 18446604465934113792 0 0 -1 5 0 0 0
[pid=2903/tid=2932] ppid=2901 vsize=483436 CPUtime=0 cores=1,3,5,7
/proc/2903/task/2932/stat : 2932 (python) S 2901 2903 2862 0 -1 4202560 27 939 0 0 0 0 0 0 25 0 5 0 658136379 495038464 48056 33554432000 4194304 5683644 140736440038896 18446744073709551615 210216470961 0 0 16781312 2 18446604465934113792 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 231.82
Current children cumulated vsize (KiB) 3309456

[startup+162.301 s]
/proc/loadavg: 4.43 1.74 1.15 6/379 2940
/proc/meminfo: memFree=24660308/32951124 swapFree=63649232/67111528
[pid=2903] ppid=2901 vsize=493692 CPUtime=58.46 cores=1,3,5,7
/proc/2903/stat : 2903 (python) S 2901 2903 2862 0 -1 4202496 77077 939 1 0 5819 27 0 0 19 0 6 0 658130496 505540608 48063 33554432000 4194304 5683644 140736440038896 18446744073709551615 210216474059 0 0 16781312 2 18446744073709551615 0 0 17 1 0 0 0
/proc/2903/statm: 123423 48063 1884 364 0 59329 0
[pid=2921] ppid=2903 vsize=442424 CPUtime=0.27 cores=1,3,5,7
/proc/2921/stat : 2921 (python) S 2903 2903 2862 0 -1 4202560 953 0 0 0 13 14 0 0 15 0 1 0 658136375 453042176 46535 33554432000 4194304 5683644 140736440038896 18446744073709551615 210204667407 0 0 16781312 514 4108092100719902981 0 0 17 1 0 0 0
/proc/2921/statm: 110606 46535 376 364 0 46524 0
[pid=2926] ppid=2921 vsize=807936 CPUtime=103.47 cores=1,3,5,7
/proc/2926/stat : 2926 (cryptominisat-2) R 2921 2926 2926 0 -1 4202496 167948 0 0 0 10323 24 0 0 25 0 1 0 658136377 827326464 148345 33554432000 4194304 4677096 140735867134784 18446744073709551615 4336170 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/2926/statm: 201984 148345 387 118 0 196943 0
[pid=2924] ppid=2903 vsize=452680 CPUtime=0.27 cores=1,3,5,7
/proc/2924/stat : 2924 (python) S 2903 2903 2862 0 -1 4202560 951 0 0 0 15 12 0 0 18 0 1 0 658136377 463544320 46533 33554432000 4194304 5683644 140736440038896 18446744073709551615 210204667462 0 0 16781312 514 4108092100719902984 0 0 17 1 0 0 0
/proc/2924/statm: 113170 46533 370 364 0 49085 0
[pid=2927] ppid=2924 vsize=79372 CPUtime=102.25 cores=1,3,5,7
/proc/2927/stat : 2927 (lingeling) R 2924 2927 2927 0 -1 4202496 27729 0 0 0 10221 4 0 0 25 0 1 0 658136378 81276928 19012 33554432000 4194304 4352236 140736299216960 18446744073709551615 4278811 0 0 16781312 17506 0 0 0 17 7 0 0 0
/proc/2927/statm: 19843 19012 129 39 0 18923 0
[pid=2928] ppid=2903 vsize=462936 CPUtime=0.26 cores=1,3,5,7
/proc/2928/stat : 2928 (python) S 2903 2903 2862 0 -1 4202560 961 0 0 0 14 12 0 0 18 0 1 0 658136378 474046464 46537 33554432000 4194304 5683644 140736440038896 18446744073709551615 210204667462 0 0 16781312 514 4108092100719902982 0 0 17 1 0 0 0
/proc/2928/statm: 115734 46537 370 364 0 51646 0
[pid=2930] ppid=2928 vsize=68464 CPUtime=103.46 cores=1,3,5,7
/proc/2930/stat : 2930 (lingeling) R 2928 2930 2930 0 -1 4202496 24993 0 0 0 10343 3 0 0 25 0 1 0 658136378 70107136 16286 33554432000 4194304 4352236 140735663280640 18446744073709551615 4207607 0 0 16781312 17506 0 0 0 17 5 0 0 0
/proc/2930/statm: 17116 16286 129 39 0 16196 0
[pid=2931] ppid=2903 vsize=473192 CPUtime=0.27 cores=1,3,5,7
/proc/2931/stat : 2931 (python) S 2903 2903 2862 0 -1 4202560 1122 0 0 0 14 13 0 0 19 0 2 0 658136379 484548608 46571 33554432000 4194304 5683644 140736440038896 18446744073709551615 210216474059 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/2931/statm: 118298 46571 399 364 0 54207 0
[pid=2933] ppid=2931 vsize=69976 CPUtime=99.18 cores=1,3,5,7
/proc/2933/stat : 2933 (lingeling) T 2931 2933 2933 0 -1 4202496 25374 0 0 0 9915 3 0 0 25 0 1 0 658136379 71655424 16663 33554432000 4194304 4352236 140736981479872 18446744073709551615 4207627 0 0 16781312 17506 18446744071562691360 0 0 17 1 0 0 0
/proc/2933/statm: 17494 16663 129 39 0 16574 0
[pid=2931/tid=2937] ppid=2903 vsize=473192 CPUtime=0 cores=1,3,5,7
/proc/2931/task/2937/stat : 2937 (python) S 2903 2903 2862 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 658146408 484548608 46571 33554432000 4194304 5683644 140736440038896 18446744073709551615 210216470961 0 0 16781312 514 18446604454223471552 0 0 -1 1 0 0 0
[pid=2938] ppid=2903 vsize=483448 CPUtime=0 cores=1,3,5,7
/proc/2938/stat : 2938 (python) S 2903 2903 2862 0 -1 4202560 764 0 0 0 0 0 0 0 15 0 1 0 658146408 495050752 46522 33554432000 4194304 5683644 140736440038896 18446744073709551615 210204667462 0 0 16781312 514 8126982201762873607 0 0 17 1 0 0 0
/proc/2938/statm: 120862 46522 347 364 0 56768 0
[pid=2940] ppid=2938 vsize=305712 CPUtime=3.16 cores=1,3,5,7
/proc/2940/stat : 2940 (cryptominisat-2) R 2938 2940 2940 0 -1 4202496 60240 0 0 0 308 8 0 0 25 0 1 0 658146409 313049088 55585 33554432000 4194304 4677096 140733592199088 18446744073709551615 4319726 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/2940/statm: 76428 55585 361 118 0 71387 0
[pid=2903/tid=2923] ppid=2901 vsize=493692 CPUtime=0 cores=1,3,5,7
/proc/2903/task/2923/stat : 2923 (python) S 2901 2903 2862 0 -1 4202560 36 939 0 0 0 0 0 0 25 0 6 0 658136376 505540608 48063 33554432000 4194304 5683644 140736440038896 18446744073709551615 210216470961 0 0 16781312 2 18446604465934113792 0 0 -1 5 0 0 0
[pid=2903/tid=2925] ppid=2901 vsize=493692 CPUtime=0 cores=1,3,5,7

################
# More data... #
################

/proc/2903/statm: 123423 48063 1884 364 0 59329 0
[pid=2921] ppid=2903 vsize=442424 CPUtime=1.47 cores=1,3,5,7
/proc/2921/stat : 2921 (python) S 2903 2903 2862 0 -1 4202560 1903 0 0 0 96 51 0 0 15 0 1 0 658136375 453042176 46536 33554432000 4194304 5683644 140736440038896 18446744073709551615 210204667407 0 0 16781312 514 4108092100719902981 0 0 17 5 0 0 0
/proc/2921/statm: 110606 46536 377 364 0 46524 0
[pid=2926] ppid=2921 vsize=6198800 CPUtime=283.47 cores=1,3,5,7
/proc/2926/stat : 2926 (cryptominisat-2) R 2921 2926 2926 0 -1 4202496 6935832 0 0 0 27457 890 0 0 25 0 1 0 658136377 6347571200 1486131 33554432000 4194304 4677096 140735867134784 18446744073709551615 4336189 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/2926/statm: 1549700 1486131 390 118 0 1544659 0
[pid=2924] ppid=2903 vsize=452680 CPUtime=0.75 cores=1,3,5,7
/proc/2924/stat : 2924 (python) S 2903 2903 2862 0 -1 4202560 980 0 0 0 38 37 0 0 18 0 1 0 658136377 463544320 46533 33554432000 4194304 5683644 140736440038896 18446744073709551615 210204667462 0 0 16781312 514 4108092100719902984 0 0 17 1 0 0 0
/proc/2924/statm: 113170 46533 370 364 0 49085 0
[pid=2927] ppid=2924 vsize=107940 CPUtime=280.05 cores=1,3,5,7
/proc/2927/stat : 2927 (lingeling) R 2924 2927 2927 0 -1 4202496 35099 0 0 0 28000 5 0 0 25 0 1 0 658136378 110530560 26154 33554432000 4194304 4352236 140736299216960 18446744073709551615 4231316 0 0 16781312 17506 0 0 0 17 7 0 0 0
/proc/2927/statm: 26985 26154 129 39 0 26065 0
[pid=2928] ppid=2903 vsize=462936 CPUtime=0.75 cores=1,3,5,7
/proc/2928/stat : 2928 (python) S 2903 2903 2862 0 -1 4202560 992 0 0 0 40 35 0 0 18 0 1 0 658136378 474046464 46537 33554432000 4194304 5683644 140736440038896 18446744073709551615 210204667462 0 0 16781312 514 4108092100719902982 0 0 17 1 0 0 0
/proc/2928/statm: 115734 46537 370 364 0 51646 0
[pid=2930] ppid=2928 vsize=115464 CPUtime=282.43 cores=1,3,5,7
/proc/2930/stat : 2930 (lingeling) R 2928 2930 2930 0 -1 4202496 39046 0 0 0 28236 7 0 0 25 0 1 0 658136378 118235136 28036 33554432000 4194304 4352236 140735663280640 18446744073709551615 4207623 0 0 16781312 17506 0 0 0 17 5 0 0 0
/proc/2930/statm: 28866 28036 129 39 0 27946 0
[pid=2931] ppid=2903 vsize=473192 CPUtime=0.27 cores=1,3,5,7
/proc/2931/stat : 2931 (python) S 2903 2903 2862 0 -1 4202560 1122 0 0 0 14 13 0 0 19 0 2 0 658136379 484548608 46571 33554432000 4194304 5683644 140736440038896 18446744073709551615 210216474059 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/2931/statm: 118298 46571 399 364 0 54207 0
[pid=2933] ppid=2931 vsize=69976 CPUtime=99.18 cores=1,3,5,7
/proc/2933/stat : 2933 (lingeling) T 2931 2933 2933 0 -1 4202496 25374 0 0 0 9915 3 0 0 25 0 1 0 658136379 71655424 16663 33554432000 4194304 4352236 140736981479872 18446744073709551615 4207627 0 0 16781312 17506 18446744071562691360 0 0 17 1 0 0 0
/proc/2933/statm: 17494 16663 129 39 0 16574 0
[pid=2931/tid=2937] ppid=2903 vsize=473192 CPUtime=0 cores=1,3,5,7
/proc/2931/task/2937/stat : 2937 (python) S 2903 2903 2862 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 658146408 484548608 46571 33554432000 4194304 5683644 140736440038896 18446744073709551615 210216470961 0 0 16781312 514 18446604454223471552 0 0 -1 1 0 0 0
[pid=2938] ppid=2903 vsize=483448 CPUtime=1.26 cores=1,3,5,7
/proc/2938/stat : 2938 (python) S 2903 2903 2862 0 -1 4202560 1509 0 0 0 90 36 0 0 15 0 1 0 658146408 495050752 46546 33554432000 4194304 5683644 140736440038896 18446744073709551615 210204667462 0 0 16781312 514 1632071084100518151 0 0 17 1 0 0 0
/proc/2938/statm: 120862 46546 371 364 0 56768 0
[pid=2940] ppid=2938 vsize=5972440 CPUtime=180.76 cores=1,3,5,7
/proc/2940/stat : 2940 (cryptominisat-2) R 2938 2940 2940 0 -1 4202496 7466626 0 0 0 17121 955 0 0 25 0 1 0 658146409 6115778560 1427030 33554432000 4194304 4677096 140733592199088 18446744073709551615 4364771 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/2940/statm: 1493110 1427030 390 118 0 1488069 0
[pid=2903/tid=2923] ppid=2901 vsize=493692 CPUtime=0 cores=1,3,5,7
/proc/2903/task/2923/stat : 2923 (python) S 2901 2903 2862 0 -1 4202560 36 939 0 0 0 0 0 0 25 0 6 0 658136376 505540608 48063 33554432000 4194304 5683644 140736440038896 18446744073709551615 210216470961 0 0 16781312 2 18446604465934113792 0 0 -1 5 0 0 0
[pid=2903/tid=2925] ppid=2901 vsize=493692 CPUtime=0 cores=1,3,5,7
/proc/2903/task/2925/stat : 2925 (python) S 2901 2903 2862 0 -1 4202560 16 939 0 0 0 0 0 0 25 0 6 0 658136377 505540608 48063 33554432000 4194304 5683644 140736440038896 18446744073709551615 210216470961 0 0 16781312 2 18446604465934113792 0 0 -1 1 0 0 0
[pid=2903/tid=2929] ppid=2901 vsize=493692 CPUtime=0 cores=1,3,5,7
/proc/2903/task/2929/stat : 2929 (python) S 2901 2903 2862 0 -1 4202560 24 939 0 0 0 0 0 0 25 0 6 0 658136378 505540608 48063 33554432000 4194304 5683644 140736440038896 18446744073709551615 210216470961 0 0 16781312 2 18446604465934113792 0 0 -1 5 0 0 0
[pid=2903/tid=2932] ppid=2901 vsize=493692 CPUtime=0 cores=1,3,5,7
/proc/2903/task/2932/stat : 2932 (python) S 2901 2903 2862 0 -1 4202560 27 939 0 0 0 0 0 0 25 0 6 0 658136379 505540608 48063 33554432000 4194304 5683644 140736440038896 18446744073709551615 210216470961 0 0 16781312 2 18446604465934113792 0 0 -1 1 0 0 0
[pid=2903/tid=2939] ppid=2901 vsize=493692 CPUtime=0 cores=1,3,5,7
/proc/2903/task/2939/stat : 2939 (python) S 2901 2903 2862 0 -1 4202560 24 939 0 0 0 0 0 0 20 0 6 0 658146409 505540608 48063 33554432000 4194304 5683644 140736440038896 18446744073709551615 210216470961 0 0 16781312 2 18446604465934113792 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1188.85
Current children cumulated vsize (KiB) 15272992



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+382.301 s]
/proc/loadavg: 5.01 3.47 1.97 6/379 2948
/proc/meminfo: memFree=13107072/32951124 swapFree=63649232/67111528
[pid=2903] ppid=2901 vsize=493692 CPUtime=58.46 cores=1,3,5,7
/proc/2903/stat : 2903 (python) S 2901 2903 2862 0 -1 4202496 77077 939 1 0 5819 27 0 0 19 0 6 0 658130496 505540608 48063 33554432000 4194304 5683644 140736440038896 18446744073709551615 210216474059 0 0 16781312 2 18446744073709551615 0 0 17 1 0 0 0
/proc/2903/statm: 123423 48063 1884 364 0 59329 0
[pid=2921] ppid=2903 vsize=442424 CPUtime=1.59 cores=1,3,5,7
/proc/2921/stat : 2921 (python) S 2903 2903 2862 0 -1 4202560 1904 0 0 0 102 57 0 0 15 0 1 0 658136375 453042176 46536 33554432000 4194304 5683644 140736440038896 18446744073709551615 210204667407 0 0 16781312 514 4108092100719902981 0 0 17 5 0 0 0
/proc/2921/statm: 110606 46536 377 364 0 46524 0
[pid=2926] ppid=2921 vsize=6570776 CPUtime=323.49 cores=1,3,5,7
/proc/2926/stat : 2926 (cryptominisat-2) R 2921 2926 2926 0 -1 4202496 7024216 0 0 0 31444 905 0 0 25 0 1 0 658136377 6728474624 1569370 33554432000 4194304 4677096 140735867134784 18446744073709551615 4320006 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/2926/statm: 1642694 1569370 393 118 0 1637653 0
[pid=2924] ppid=2903 vsize=452680 CPUtime=0.86 cores=1,3,5,7
/proc/2924/stat : 2924 (python) S 2903 2903 2862 0 -1 4202560 980 0 0 0 43 43 0 0 18 0 1 0 658136377 463544320 46533 33554432000 4194304 5683644 140736440038896 18446744073709551615 210204667462 0 0 16781312 514 4108092100719902984 0 0 17 1 0 0 0
/proc/2924/statm: 113170 46533 370 364 0 49085 0
[pid=2927] ppid=2924 vsize=107892 CPUtime=319.58 cores=1,3,5,7
/proc/2927/stat : 2927 (lingeling) R 2924 2927 2927 0 -1 4202496 35099 0 0 0 31953 5 0 0 25 0 1 0 658136378 110481408 26142 33554432000 4194304 4352236 140736299216960 18446744073709551615 4278726 0 0 16781312 17506 0 0 0 17 7 0 0 0
/proc/2927/statm: 26973 26142 129 39 0 26053 0
[pid=2928] ppid=2903 vsize=462936 CPUtime=0.86 cores=1,3,5,7
/proc/2928/stat : 2928 (python) S 2903 2903 2862 0 -1 4202560 992 0 0 0 46 40 0 0 18 0 1 0 658136378 474046464 46537 33554432000 4194304 5683644 140736440038896 18446744073709551615 210204667462 0 0 16781312 514 4108092100719902982 0 0 17 1 0 0 0
/proc/2928/statm: 115734 46537 370 364 0 51646 0
[pid=2930] ppid=2928 vsize=123620 CPUtime=322.32 cores=1,3,5,7
/proc/2930/stat : 2930 (lingeling) R 2928 2930 2930 0 -1 4202496 42118 0 0 0 32225 7 0 0 25 0 1 0 658136378 126586880 30075 33554432000 4194304 4352236 140735663280640 18446744073709551615 4276518 0 0 16781312 17506 0 0 0 17 5 0 0 0
/proc/2930/statm: 30905 30075 129 39 0 29985 0
[pid=2931] ppid=2903 vsize=473192 CPUtime=0.27 cores=1,3,5,7
/proc/2931/stat : 2931 (python) S 2903 2903 2862 0 -1 4202560 1122 0 0 0 14 13 0 0 19 0 2 0 658136379 484548608 46571 33554432000 4194304 5683644 140736440038896 18446744073709551615 210216474059 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/2931/statm: 118298 46571 399 364 0 54207 0
[pid=2933] ppid=2931 vsize=69976 CPUtime=99.18 cores=1,3,5,7
/proc/2933/stat : 2933 (lingeling) T 2931 2933 2933 0 -1 4202496 25374 0 0 0 9915 3 0 0 25 0 1 0 658136379 71655424 16663 33554432000 4194304 4352236 140736981479872 18446744073709551615 4207627 0 0 16781312 17506 18446744071562691360 0 0 17 1 0 0 0
/proc/2933/statm: 17494 16663 129 39 0 16574 0
[pid=2931/tid=2937] ppid=2903 vsize=473192 CPUtime=0 cores=1,3,5,7
/proc/2931/task/2937/stat : 2937 (python) S 2903 2903 2862 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 658146408 484548608 46571 33554432000 4194304 5683644 140736440038896 18446744073709551615 210216470961 0 0 16781312 514 18446604454223471552 0 0 -1 1 0 0 0
[pid=2938] ppid=2903 vsize=483448 CPUtime=1.4 cores=1,3,5,7
/proc/2938/stat : 2938 (python) S 2903 2903 2862 0 -1 4202560 1836 0 0 0 96 44 0 0 15 0 1 0 658146408 495050752 46546 33554432000 4194304 5683644 140736440038896 18446744073709551615 210204667462 0 0 16781312 514 8126982201762873607 0 0 17 1 0 0 0
/proc/2938/statm: 120862 46546 371 364 0 56768 0
[pid=2940] ppid=2938 vsize=6196744 CPUtime=220.4 cores=1,3,5,7
/proc/2940/stat : 2940 (cryptominisat-2) R 2938 2940 2940 0 -1 4202496 7786922 0 0 0 21047 993 0 0 25 0 1 0 658146409 6345465856 1484240 33554432000 4194304 4677096 140733592199088 18446744073709551615 4319729 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/2940/statm: 1549250 1484246 393 118 0 1544209 0
[pid=2903/tid=2923] ppid=2901 vsize=493692 CPUtime=0 cores=1,3,5,7
/proc/2903/task/2923/stat : 2923 (python) S 2901 2903 2862 0 -1 4202560 36 939 0 0 0 0 0 0 25 0 6 0 658136376 505540608 48063 33554432000 4194304 5683644 140736440038896 18446744073709551615 210216470961 0 0 16781312 2 18446604465934113792 0 0 -1 5 0 0 0
[pid=2903/tid=2925] ppid=2901 vsize=493692 CPUtime=0 cores=1,3,5,7
/proc/2903/task/2925/stat : 2925 (python) S 2901 2903 2862 0 -1 4202560 16 939 0 0 0 0 0 0 25 0 6 0 658136377 505540608 48063 33554432000 4194304 5683644 140736440038896 18446744073709551615 210216470961 0 0 16781312 2 18446604465934113792 0 0 -1 1 0 0 0
[pid=2903/tid=2929] ppid=2901 vsize=493692 CPUtime=0 cores=1,3,5,7
/proc/2903/task/2929/stat : 2929 (python) S 2901 2903 2862 0 -1 4202560 24 939 0 0 0 0 0 0 25 0 6 0 658136378 505540608 48063 33554432000 4194304 5683644 140736440038896 18446744073709551615 210216470961 0 0 16781312 2 18446604465934113792 0 0 -1 5 0 0 0
[pid=2903/tid=2932] ppid=2901 vsize=493692 CPUtime=0 cores=1,3,5,7
/proc/2903/task/2932/stat : 2932 (python) S 2901 2903 2862 0 -1 4202560 27 939 0 0 0 0 0 0 25 0 6 0 658136379 505540608 48063 33554432000 4194304 5683644 140736440038896 18446744073709551615 210216470961 0 0 16781312 2 18446604465934113792 0 0 -1 1 0 0 0
[pid=2903/tid=2939] ppid=2901 vsize=493692 CPUtime=0 cores=1,3,5,7
/proc/2903/task/2939/stat : 2939 (python) S 2901 2903 2862 0 -1 4202560 24 939 0 0 0 0 0 0 20 0 6 0 658146409 505540608 48063 33554432000 4194304 5683644 140736440038896 18446744073709551615 210216470961 0 0 16781312 2 18446604465934113792 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1348.41
Current children cumulated vsize (KiB) 15877380

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+382.301 s]
/proc/loadavg: 5.01 3.47 1.97 6/379 2948
/proc/meminfo: memFree=13107072/32951124 swapFree=63649232/67111528
[pid=2903] ppid=2901 vsize=493692 CPUtime=58.46 cores=1,3,5,7
/proc/2903/stat : 2903 (python) S 2901 2903 2862 0 -1 4202496 77077 939 1 0 5819 27 0 0 19 0 6 0 658130496 505540608 48063 33554432000 4194304 5683644 140736440038896 18446744073709551615 210216474059 0 0 16781312 2 18446744073709551615 0 0 17 1 0 0 0
/proc/2903/statm: 123423 48063 1884 364 0 59329 0
[pid=2921] ppid=2903 vsize=442424 CPUtime=1.59 cores=1,3,5,7
/proc/2921/stat : 2921 (python) S 2903 2903 2862 0 -1 4202560 1904 0 0 0 102 57 0 0 15 0 1 0 658136375 453042176 46536 33554432000 4194304 5683644 140736440038896 18446744073709551615 210204667407 0 0 16781312 514 4108092100719902981 0 0 17 5 0 0 0
/proc/2921/statm: 110606 46536 377 364 0 46524 0
[pid=2926] ppid=2921 vsize=6570776 CPUtime=323.49 cores=1,3,5,7
/proc/2926/stat : 2926 (cryptominisat-2) R 2921 2926 2926 0 -1 4202496 7024216 0 0 0 31444 905 0 0 25 0 1 0 658136377 6728474624 1569370 33554432000 4194304 4677096 140735867134784 18446744073709551615 4320006 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/2926/statm: 1642694 1569370 393 118 0 1637653 0
[pid=2924] ppid=2903 vsize=452680 CPUtime=0.86 cores=1,3,5,7
/proc/2924/stat : 2924 (python) S 2903 2903 2862 0 -1 4202560 980 0 0 0 43 43 0 0 18 0 1 0 658136377 463544320 46533 33554432000 4194304 5683644 140736440038896 18446744073709551615 210204667462 0 0 16781312 514 4108092100719902984 0 0 17 1 0 0 0
/proc/2924/statm: 113170 46533 370 364 0 49085 0
[pid=2927] ppid=2924 vsize=107892 CPUtime=319.58 cores=1,3,5,7
/proc/2927/stat : 2927 (lingeling) R 2924 2927 2927 0 -1 4202496 35099 0 0 0 31953 5 0 0 25 0 1 0 658136378 110481408 26142 33554432000 4194304 4352236 140736299216960 18446744073709551615 4278726 0 0 16781312 17506 0 0 0 17 7 0 0 0
/proc/2927/statm: 26973 26142 129 39 0 26053 0
[pid=2928] ppid=2903 vsize=462936 CPUtime=0.86 cores=1,3,5,7
/proc/2928/stat : 2928 (python) S 2903 2903 2862 0 -1 4202560 992 0 0 0 46 40 0 0 18 0 1 0 658136378 474046464 46537 33554432000 4194304 5683644 140736440038896 18446744073709551615 210204667462 0 0 16781312 514 4108092100719902982 0 0 17 1 0 0 0
/proc/2928/statm: 115734 46537 370 364 0 51646 0
[pid=2930] ppid=2928 vsize=123620 CPUtime=322.32 cores=1,3,5,7
/proc/2930/stat : 2930 (lingeling) R 2928 2930 2930 0 -1 4202496 42118 0 0 0 32225 7 0 0 25 0 1 0 658136378 126586880 30075 33554432000 4194304 4352236 140735663280640 18446744073709551615 4276518 0 0 16781312 17506 0 0 0 17 5 0 0 0
/proc/2930/statm: 30905 30075 129 39 0 29985 0
[pid=2931] ppid=2903 vsize=473192 CPUtime=0.27 cores=1,3,5,7
/proc/2931/stat : 2931 (python) S 2903 2903 2862 0 -1 4202560 1122 0 0 0 14 13 0 0 19 0 2 0 658136379 484548608 46571 33554432000 4194304 5683644 140736440038896 18446744073709551615 210216474059 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/2931/statm: 118298 46571 399 364 0 54207 0
[pid=2933] ppid=2931 vsize=69976 CPUtime=99.18 cores=1,3,5,7
/proc/2933/stat : 2933 (lingeling) T 2931 2933 2933 0 -1 4202496 25374 0 0 0 9915 3 0 0 25 0 1 0 658136379 71655424 16663 33554432000 4194304 4352236 140736981479872 18446744073709551615 4207627 0 0 16781312 17506 18446744071562691360 0 0 17 1 0 0 0
/proc/2933/statm: 17494 16663 129 39 0 16574 0
[pid=2931/tid=2937] ppid=2903 vsize=473192 CPUtime=0 cores=1,3,5,7
/proc/2931/task/2937/stat : 2937 (python) S 2903 2903 2862 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 658146408 484548608 46571 33554432000 4194304 5683644 140736440038896 18446744073709551615 210216470961 0 0 16781312 514 18446604454223471552 0 0 -1 1 0 0 0
[pid=2938] ppid=2903 vsize=483448 CPUtime=1.4 cores=1,3,5,7
/proc/2938/stat : 2938 (python) S 2903 2903 2862 0 -1 4202560 1836 0 0 0 96 44 0 0 15 0 1 0 658146408 495050752 46546 33554432000 4194304 5683644 140736440038896 18446744073709551615 210204667462 0 0 16781312 514 8126982201762873607 0 0 17 1 0 0 0
/proc/2938/statm: 120862 46546 371 364 0 56768 0
[pid=2940] ppid=2938 vsize=6196744 CPUtime=220.4 cores=1,3,5,7
/proc/2940/stat : 2940 (cryptominisat-2) R 2938 2940 2940 0 -1 4202496 7786922 0 0 0 21047 993 0 0 25 0 1 0 658146409 6345465856 1484240 33554432000 4194304 4677096 140733592199088 18446744073709551615 4319729 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/2940/statm: 1549250 1484246 393 118 0 1544209 0
[pid=2903/tid=2923] ppid=2901 vsize=493692 CPUtime=0 cores=1,3,5,7
/proc/2903/task/2923/stat : 2923 (python) S 2901 2903 2862 0 -1 4202560 36 939 0 0 0 0 0 0 25 0 6 0 658136376 505540608 48063 33554432000 4194304 5683644 140736440038896 18446744073709551615 210216470961 0 0 16781312 2 18446604465934113792 0 0 -1 5 0 0 0
[pid=2903/tid=2925] ppid=2901 vsize=493692 CPUtime=0 cores=1,3,5,7
/proc/2903/task/2925/stat : 2925 (python) S 2901 2903 2862 0 -1 4202560 16 939 0 0 0 0 0 0 25 0 6 0 658136377 505540608 48063 33554432000 4194304 5683644 140736440038896 18446744073709551615 210216470961 0 0 16781312 2 18446604465934113792 0 0 -1 1 0 0 0
[pid=2903/tid=2929] ppid=2901 vsize=493692 CPUtime=0 cores=1,3,5,7
/proc/2903/task/2929/stat : 2929 (python) S 2901 2903 2862 0 -1 4202560 24 939 0 0 0 0 0 0 25 0 6 0 658136378 505540608 48063 33554432000 4194304 5683644 140736440038896 18446744073709551615 210216470961 0 0 16781312 2 18446604465934113792 0 0 -1 5 0 0 0
[pid=2903/tid=2932] ppid=2901 vsize=493692 CPUtime=0 cores=1,3,5,7
/proc/2903/task/2932/stat : 2932 (python) S 2901 2903 2862 0 -1 4202560 27 939 0 0 0 0 0 0 25 0 6 0 658136379 505540608 48063 33554432000 4194304 5683644 140736440038896 18446744073709551615 210216470961 0 0 16781312 2 18446604465934113792 0 0 -1 1 0 0 0
[pid=2903/tid=2939] ppid=2901 vsize=493692 CPUtime=0 cores=1,3,5,7
/proc/2903/task/2939/stat : 2939 (python) S 2901 2903 2862 0 -1 4202560 24 939 0 0 0 0 0 0 20 0 6 0 658146409 505540608 48063 33554432000 4194304 5683644 140736440038896 18446744073709551615 210216470961 0 0 16781312 2 18446604465934113792 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1348.41
Current children cumulated vsize (KiB) 15877380

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 2903 and gives
#  childrusage.ru_utime.tv_sec=58
#  childrusage.ru_utime.tv_usec=191153
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=287956
# CPU time returned by wait4() is 58.4791
# while last known CPU time is 1348.41
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 382.358
CPU time (s): 1348.41
CPU user time (s): 1327.04
CPU system time (s): 21.37
CPU usage (%): 352.656
Max. virtual memory (cumulated for all children) (KiB): 15877380

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 58.1912
system time used= 0.287956
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 78018
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3038
involuntary context switches= 113

runsolver used 1.37879 second user time and 3.18452 second system time

The end

Launcher Data 

Begin job on node130 at 2011-05-15 15:15:20
IDJOB=3378989
IDBENCH=82389
IDSOLVER=1860
FILE ID=node130/3378989-1305465319
RUNJOBID= node130-1305465318-2889
PBS_JOBID= 13325052
Free space on /tmp= 73364 MiB

SOLVER NAME= borg-sat 11.03.02-par-industrial (fixed)
BENCH NAME= SAT11/application/rintanen/SATPlanning/openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_3.045-NOTKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.industrial.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3378989-1305465319/watcher-3378989-1305465319 -o /tmp/evaluation-result-3378989-1305465319/solver-3378989-1305465319 -C 4800 -W 1300 -M 15500  python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3378989-1305465319.cnf -seed 2051470122 -budget 4800 -cores 4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 4ab53801f3b1a3f7169c9fb38cba4184
RANDOM SEED=2051470122

node130.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.81
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.81
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      26482500 kB
Buffers:        291572 kB
Cached:        4142120 kB
SwapCached:      10248 kB
Active:        2220716 kB
Inactive:      3958384 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      26482500 kB
SwapTotal:    67111528 kB
SwapFree:     63649232 kB
Dirty:           74544 kB
Writeback:           0 kB
AnonPages:     1743432 kB
Mapped:          20076 kB
Slab:           190440 kB
PageTables:      33976 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 88823196 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73260 MiB
End job on node130 at 2011-05-15 15:21:44