Trace number 3317900

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-industrial? (TO) 4800.39 1208.26

General information on the benchmark

Nameapplication/fuhs/slp-synthesis-AES/
slp-synthesis-aes-bottom20.cnf
MD5SUM9851f8e63efc4505343bf50c1cf30646
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables44362
Number of clauses148436
Sum of the clauses size378642
Maximum clause length1419
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 276003
Number of clauses of size 371663
Number of clauses of size 4209
Number of clauses of size 518
Number of clauses of size over 5542

Solver Data 

0.32/0.46	c INFO: loaded portfolio from HOME/etc/borg-mix+class.industrial.pickle
0.32/0.46	c INFO: solving HOME/instance-3317900-1304269879.cnf
0.32/0.46	c INFO: computing task features
0.81/0.92	c INFO: computed variable-clause graph statistics
0.81/0.94	c INFO: computed clause balance statistics
3.32/3.43	c INFO: computed variable balance statistics
5.12/5.28	c INFO: computed small-clause counts
5.12/5.29	c INFO: computed Horn-clause counts
7.62/7.75	c INFO: computed variable graph statistics
7.62/7.75	c INFO: collected features for HOME/instance-3317900-1304269879.cnf in 7.26 s
7.62/7.77	c INFO: running lingeling-276@0 for 97 with 4792 remaining (b = 0.33)
7.62/7.79	c INFO: running cryptominisat-2.9.0@0 for 485 with 4792 remaining (b = 0.32)
7.70/7.82	c INFO: running lingeling-276@0 for 1261 with 4792 remaining (b = 0.47)
7.70/7.84	c INFO: running lingeling-276@0 for 1261 with 4792 remaining (b = 0.40)
407.36/107.93	c INFO: running cryptominisat-2.9.0@0 for 1649 with 4692 remaining (b = 0.49)
1964.33/497.86	c INFO: running lingeling-276@0 for 97 with 4302 remaining (b = 0.08)
2352.45/595.02	c INFO: running lingeling-276@97 for 97 with 4205 remaining (b = 0.08)
2732.14/690.17	c INFO: running SApperloT@0 for 97 with 4110 remaining (b = 0.11)
3132.20/790.35	c INFO: running precosat-570@0 for 291 with 4010 remaining (b = 0.18)
4300.00/1082.82	c INFO: running precosat-570@291 for 97 with 3717 remaining (b = 0.06)
4703.58/1183.99	c INFO: running precosat-570@0 for 97 with 3616 remaining (b = 0.05)
4800.39/1208.25	c INFO: running cryptominisat-2.9.0@0 for 1746 with 3592 remaining (b = 0.41)
4800.39/1208.25	Traceback (most recent call last):
4800.39/1208.25	  File "HOME/solve", line 33, in <module>
4800.39/1208.25	    plac.call(main)
4800.39/1208.25	  File "/home/evaluation/evaluation/tools64/lib/python2.7/site-packages/plac-0.8.1-py2.7.egg/plac_core.py", line 311, in call
4800.39/1208.25	    cmd, result = parser_from(obj).consume(arglist)
4800.39/1208.25	  File "/home/evaluation/evaluation/tools64/lib/python2.7/site-packages/plac-0.8.1-py2.7.egg/plac_core.py", line 192, in consume
4800.39/1208.25	    return cmd, self.func(*(args + varargs + extraopts), **kwargs)
4800.39/1208.25	  File "HOME/borg/build/lib/borg/tools/solve.py", line 84, in main
4800.39/1208.25	    (_, answer, _) = solver(input_path, budget, cores)
4800.39/1208.25	  File "HOME/borg/build/lib/borg/bilevel.py", line 202, in __call__
4800.39/1208.25	    solver.go(max_cost * borg.defaults.machine_speed)
4800.39/1208.25	  File "HOME/borg/build/lib/borg/solvers.py", line 179, in go
4800.39/1208.25	    self._process.start()
4800.39/1208.25	  File "/home/evaluation/evaluation/tools64/lib/python2.7/multiprocessing/process.py", line 94, in start
4800.39/1208.25	    assert self._popen is None, 'cannot start a process twice'
4800.39/1208.25	AssertionError: cannot start a process twice

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3317900-1304269879/watcher-3317900-1304269879 -o /tmp/evaluation-result-3317900-1304269879/solver-3317900-1304269879 -C 4800 -W 1300 -M 15500 python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3317900-1304269879.cnf -seed 966247080 -budget 4800 -cores 4 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 5.74 5.24 5.19 5/216 20189
/proc/meminfo: memFree=25821648/32950928 swapFree=67111464/67111528
[pid=20189] ppid=20187 vsize=15760 CPUtime=0 cores=1,3,5,7
/proc/20189/stat : 20189 (python) S 20187 20189 19634 0 -1 4202496 844 0 0 0 0 0 0 0 25 0 1 0 538586723 16138240 727 33554432000 4194304 5683644 140735128399824 18446744073709551615 268272687104 0 2147483391 16781312 2 18446744071699199166 0 0 17 1 0 0 0
/proc/20189/statm: 3940 727 334 364 0 427 0

[startup+0.0246181 s]
/proc/loadavg: 5.74 5.24 5.19 5/216 20189
/proc/meminfo: memFree=25821648/32950928 swapFree=67111464/67111528
[pid=20189] ppid=20187 vsize=16532 CPUtime=0.01 cores=1,3,5,7
/proc/20189/stat : 20189 (python) R 20187 20189 19634 0 -1 4202496 1189 0 0 0 1 0 0 0 25 0 1 0 538586723 16928768 1049 33554432000 4194304 5683644 140735128399824 18446744073709551615 268272687104 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/20189/statm: 4133 1049 417 364 0 620 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 16532

[startup+0.100605 s]
/proc/loadavg: 5.74 5.24 5.19 5/216 20189
/proc/meminfo: memFree=25821648/32950928 swapFree=67111464/67111528
[pid=20189] ppid=20187 vsize=104228 CPUtime=0.08 cores=1,3,5,7
/proc/20189/stat : 20189 (python) R 20187 20189 19634 0 -1 4202496 3062 0 0 0 6 2 0 0 25 0 1 0 538586723 106729472 2745 33554432000 4194304 5683644 140735128399824 18446744073709551615 4620076 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/20189/statm: 26057 2747 847 364 0 1805 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 104228

[startup+0.30057 s]
/proc/loadavg: 5.74 5.24 5.19 5/216 20189
/proc/meminfo: memFree=25821648/32950928 swapFree=67111464/67111528
[pid=20189] ppid=20187 vsize=185036 CPUtime=0.23 cores=1,3,5,7
/proc/20189/stat : 20189 (python) R 20187 20189 19634 0 -1 4202496 6751 936 1 0 16 7 0 0 25 0 1 0 538586723 189476864 4819 33554432000 4194304 5683644 140735128399824 18446744073709551615 268267719360 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/20189/statm: 46259 4820 1342 364 0 3723 0
Current children cumulated CPU time (s) 0.23
Current children cumulated vsize (KiB) 185036

[startup+0.700497 s]
/proc/loadavg: 5.74 5.24 5.19 5/216 20189
/proc/meminfo: memFree=25821648/32950928 swapFree=67111464/67111528
[pid=20189] ppid=20187 vsize=295508 CPUtime=0.61 cores=1,3,5,7
/proc/20189/stat : 20189 (python) R 20187 20189 19634 0 -1 4202496 13493 936 1 0 50 11 0 0 25 0 1 0 538586723 302600192 11178 33554432000 4194304 5683644 140735128399824 18446744073709551615 268272375504 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/20189/statm: 73877 11178 1761 364 0 9801 0
Current children cumulated CPU time (s) 0.61
Current children cumulated vsize (KiB) 295508

[startup+1.50035 s]
/proc/loadavg: 5.74 5.24 5.19 6/217 20194
/proc/meminfo: memFree=25772164/32950928 swapFree=67111464/67111528
[pid=20189] ppid=20187 vsize=309808 CPUtime=1.42 cores=1,3,5,7
/proc/20189/stat : 20189 (python) R 20187 20189 19634 0 -1 4202496 20707 936 1 0 130 12 0 0 25 0 1 0 538586723 317243392 14837 33554432000 4194304 5683644 140735128399824 18446744073709551615 47832332770944 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/20189/statm: 77452 14837 1826 364 0 13376 0
Current children cumulated CPU time (s) 1.42
Current children cumulated vsize (KiB) 309808

[startup+3.10007 s]
/proc/loadavg: 5.68 5.23 5.19 6/217 20194
/proc/meminfo: memFree=25771668/32950928 swapFree=67111464/67111528
[pid=20189] ppid=20187 vsize=309808 CPUtime=3.02 cores=1,3,5,7
/proc/20189/stat : 20189 (python) R 20187 20189 19634 0 -1 4202496 20707 936 1 0 290 12 0 0 25 0 1 0 538586723 317243392 14837 33554432000 4194304 5683644 140735128399824 18446744073709551615 47832335566255 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/20189/statm: 77452 14837 1826 364 0 13376 0
Current children cumulated CPU time (s) 3.02
Current children cumulated vsize (KiB) 309808

[startup+6.3005 s]
/proc/loadavg: 5.68 5.23 5.19 6/217 20194
/proc/meminfo: memFree=25754056/32950928 swapFree=67111464/67111528
[pid=20189] ppid=20187 vsize=309808 CPUtime=6.22 cores=1,3,5,7
/proc/20189/stat : 20189 (python) R 20187 20189 19634 0 -1 4202496 20714 936 1 0 610 12 0 0 25 0 1 0 538586723 317243392 14844 33554432000 4194304 5683644 140735128399824 18446744073709551615 47832332691584 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/20189/statm: 77452 14844 1833 364 0 13376 0
Current children cumulated CPU time (s) 6.22
Current children cumulated vsize (KiB) 309808

[startup+12.7014 s]
/proc/loadavg: 5.89 5.29 5.21 9/229 20206
/proc/meminfo: memFree=25578196/32950928 swapFree=67111464/67111528
[pid=20189] ppid=20187 vsize=348412 CPUtime=7.75 cores=1,3,5,7
/proc/20189/stat : 20189 (python) S 20187 20189 19634 0 -1 4202496 23454 936 1 0 762 13 0 0 25 0 5 0 538586723 356773888 14300 33554432000 4194304 5683644 140735128399824 18446744073709551615 268284515787 0 0 16781312 2 18446744073709551615 0 0 17 7 0 0 0
/proc/20189/statm: 87103 14300 1881 364 0 23012 0
[pid=20195] ppid=20189 vsize=307400 CPUtime=0 cores=1,3,5,7
/proc/20195/stat : 20195 (python) S 20189 20189 19634 0 -1 4202560 985 0 0 0 0 0 0 0 18 0 1 0 538587500 314777600 12783 33554432000 4194304 5683644 140735128399824 18446744073709551615 268272709135 0 0 16781312 514 4423313567483134216 0 0 17 5 0 0 0
/proc/20195/statm: 76850 12783 380 364 0 12768 0
[pid=20197] ppid=20195 vsize=15752 CPUtime=4.91 cores=1,3,5,7
/proc/20197/stat : 20197 (lingeling) R 20195 20197 20197 0 -1 4202496 6024 0 0 0 491 0 0 0 25 0 1 0 538587500 16130048 2926 33554432000 4194304 4352236 140735651543056 18446744073709551615 4236145 0 0 16781312 17506 0 0 0 17 1 0 0 0
/proc/20197/statm: 3938 2926 129 39 0 3018 0
[pid=20198] ppid=20189 vsize=317656 CPUtime=0 cores=1,3,5,7
/proc/20198/stat : 20198 (python) S 20189 20189 19634 0 -1 4202560 914 0 0 0 0 0 0 0 15 0 1 0 538587502 325279744 12777 33554432000 4194304 5683644 140735128399824 18446744073709551615 268272709190 0 0 16781312 514 5628606735066300680 0 0 17 3 0 0 0
/proc/20198/statm: 79414 12777 370 364 0 15329 0
[pid=20200] ppid=20198 vsize=138636 CPUtime=4.87 cores=1,3,5,7
/proc/20200/stat : 20200 (cryptominisat-2) R 20198 20200 20200 0 -1 4202496 29584 0 0 0 483 4 0 0 25 0 1 0 538587503 141963264 28271 33554432000 4194304 4677096 140733817485616 18446744073709551615 4337858 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/20200/statm: 34659 28271 392 118 0 29618 0
[pid=20201] ppid=20189 vsize=327912 CPUtime=0 cores=1,3,5,7
/proc/20201/stat : 20201 (python) S 20189 20189 19634 0 -1 4202560 933 0 0 0 0 0 0 0 18 0 1 0 538587505 335781888 12780 33554432000 4194304 5683644 140735128399824 18446744073709551615 268272709190 0 0 16781312 514 4590171603823722759 0 0 17 5 0 0 0
/proc/20201/statm: 81978 12780 369 364 0 17890 0
[pid=20203] ppid=20201 vsize=15744 CPUtime=4.84 cores=1,3,5,7
/proc/20203/stat : 20203 (lingeling) R 20201 20203 20203 0 -1 4202496 6022 0 0 0 484 0 0 0 25 0 1 0 538587505 16121856 2922 33554432000 4194304 4352236 140737114049936 18446744073709551615 4329333 0 0 16781312 17506 0 0 0 17 5 0 0 0
/proc/20203/statm: 3936 2922 129 39 0 3016 0
[pid=20204] ppid=20189 vsize=338168 CPUtime=0 cores=1,3,5,7
/proc/20204/stat : 20204 (python) S 20189 20189 19634 0 -1 4202560 937 0 0 0 0 0 0 0 18 0 1 0 538587507 346284032 12785 33554432000 4194304 5683644 140735128399824 18446744073709551615 268272709190 0 0 16781312 514 4334825971191382015 0 0 17 7 0 0 0
/proc/20204/statm: 84542 12785 370 364 0 20451 0
[pid=20206] ppid=20204 vsize=15744 CPUtime=4.8 cores=1,3,5,7
/proc/20206/stat : 20206 (lingeling) R 20204 20206 20206 0 -1 4202496 6023 0 0 0 479 1 0 0 25 0 1 0 538587507 16121856 2921 33554432000 4194304 4352236 140736277637744 18446744073709551615 4328100 0 0 16781312 17506 0 0 0 17 7 0 0 0
/proc/20206/statm: 3936 2921 129 39 0 3016 0
[pid=20189/tid=20196] ppid=20187 vsize=348412 CPUtime=0 cores=1,3,5,7
/proc/20189/task/20196/stat : 20196 (python) S 20187 20189 19634 0 -1 4202560 25 936 0 0 0 0 0 0 25 0 5 0 538587500 356773888 14300 33554432000 4194304 5683644 140735128399824 18446744073709551615 268284512689 0 0 16781312 2 18446604466354070784 0 0 -1 1 0 0 0
[pid=20189/tid=20199] ppid=20187 vsize=348412 CPUtime=0 cores=1,3,5,7
/proc/20189/task/20199/stat : 20199 (python) S 20187 20189 19634 0 -1 4202560 21 936 0 0 0 0 0 0 25 0 5 0 538587502 356773888 14300 33554432000 4194304 5683644 140735128399824 18446744073709551615 268284512689 0 0 16781312 2 18446604466354070784 0 0 -1 7 0 0 0
[pid=20189/tid=20202] ppid=20187 vsize=348412 CPUtime=0 cores=1,3,5,7
/proc/20189/task/20202/stat : 20202 (python) S 20187 20189 19634 0 -1 4202560 26 936 0 0 0 0 0 0 25 0 5 0 538587505 356773888 14300 33554432000 4194304 5683644 140735128399824 18446744073709551615 268284512689 0 0 16781312 2 18446604466354070784 0 0 -1 5 0 0 0
[pid=20189/tid=20205] ppid=20187 vsize=348412 CPUtime=0 cores=1,3,5,7
/proc/20189/task/20205/stat : 20205 (python) S 20187 20189 19634 0 -1 4202560 28 936 0 0 0 0 0 0 25 0 5 0 538587507 356773888 14300 33554432000 4194304 5683644 140735128399824 18446744073709551615 268284512689 0 0 16781312 2 18446604466354070784 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 27.17
Current children cumulated vsize (KiB) 1825424

[startup+25.5011 s]
/proc/loadavg: 6.21 5.38 5.24 9/229 20207
/proc/meminfo: memFree=25534936/32950928 swapFree=67111464/67111528
[pid=20189] ppid=20187 vsize=348412 CPUtime=7.75 cores=1,3,5,7
/proc/20189/stat : 20189 (python) S 20187 20189 19634 0 -1 4202496 23454 936 1 0 762 13 0 0 25 0 5 0 538586723 356773888 14300 33554432000 4194304 5683644 140735128399824 18446744073709551615 268284515787 0 0 16781312 2 18446744073709551615 0 0 17 7 0 0 0
/proc/20189/statm: 87103 14300 1881 364 0 23012 0
[pid=20195] ppid=20189 vsize=307400 CPUtime=0.02 cores=1,3,5,7
/proc/20195/stat : 20195 (python) S 20189 20189 19634 0 -1 4202560 992 0 0 0 1 1 0 0 18 0 1 0 538587500 314777600 12784 33554432000 4194304 5683644 140735128399824 18446744073709551615 268272709135 0 0 16781312 514 15143758367312281864 0 0 17 5 0 0 0
/proc/20195/statm: 76850 12784 381 364 0 12768 0
[pid=20197] ppid=20195 vsize=16756 CPUtime=17.71 cores=1,3,5,7
/proc/20197/stat : 20197 (lingeling) R 20195 20197 20197 0 -1 4202496 6458 0 0 0 1771 0 0 0 25 0 1 0 538587500 17158144 3359 33554432000 4194304 4352236 140735651543056 18446744073709551615 4328004 0 0 16781312 17506 0 0 0 17 1 0 0 0
/proc/20197/statm: 4189 3359 129 39 0 3269 0
[pid=20198] ppid=20189 vsize=317656 CPUtime=0.03 cores=1,3,5,7
/proc/20198/stat : 20198 (python) S 20189 20189 19634 0 -1 4202560 924 0 0 0 2 1 0 0 15 0 1 0 538587502 325279744 12777 33554432000 4194304 5683644 140735128399824 18446744073709551615 268272709190 0 0 16781312 514 5628606735066300680 0 0 17 3 0 0 0
/proc/20198/statm: 79414 12777 370 364 0 15329 0
[pid=20200] ppid=20198 vsize=161884 CPUtime=17.65 cores=1,3,5,7
/proc/20200/stat : 20200 (cryptominisat-2) R 20198 20200 20200 0 -1 4202496 41980 0 0 0 1758 7 0 0 25 0 1 0 538587503 165769216 33363 33554432000 4194304 4677096 140733817485616 18446744073709551615 268272385803 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/20200/statm: 40471 33363 393 118 0 35430 0
[pid=20201] ppid=20189 vsize=327912 CPUtime=0.02 cores=1,3,5,7
/proc/20201/stat : 20201 (python) S 20189 20189 19634 0 -1 4202560 944 0 0 0 1 1 0 0 18 0 1 0 538587505 335781888 12781 33554432000 4194304 5683644 140735128399824 18446744073709551615 268272709190 0 0 16781312 514 15143758367312281863 0 0 17 5 0 0 0
/proc/20201/statm: 81978 12781 370 364 0 17890 0
[pid=20203] ppid=20201 vsize=17216 CPUtime=17.61 cores=1,3,5,7
/proc/20203/stat : 20203 (lingeling) R 20201 20203 20203 0 -1 4202496 6576 0 0 0 1761 0 0 0 25 0 1 0 538587505 17629184 3475 33554432000 4194304 4352236 140737114049936 18446744073709551615 4328194 0 0 16781312 17506 0 0 0 17 5 0 0 0
/proc/20203/statm: 4304 3475 129 39 0 3384 0
[pid=20204] ppid=20189 vsize=338168 CPUtime=0.02 cores=1,3,5,7
/proc/20204/stat : 20204 (python) S 20189 20189 19634 0 -1 4202560 941 0 0 0 1 1 0 0 18 0 1 0 538587507 346284032 12785 33554432000 4194304 5683644 140735128399824 18446744073709551615 268272709190 0 0 16781312 514 15143758367312281864 0 0 17 7 0 0 0
/proc/20204/statm: 84542 12785 370 364 0 20451 0
[pid=20206] ppid=20204 vsize=16476 CPUtime=17.5 cores=1,3,5,7
/proc/20206/stat : 20206 (lingeling) R 20204 20206 20206 0 -1 4202496 6392 0 0 0 1749 1 0 0 25 0 1 0 538587507 16871424 3289 33554432000 4194304 4352236 140736277637744 18446744073709551615 4327902 0 0 16781312 17506 0 0 0 17 7 0 0 0
/proc/20206/statm: 4119 3289 129 39 0 3199 0
[pid=20189/tid=20196] ppid=20187 vsize=348412 CPUtime=0 cores=1,3,5,7
/proc/20189/task/20196/stat : 20196 (python) S 20187 20189 19634 0 -1 4202560 25 936 0 0 0 0 0 0 25 0 5 0 538587500 356773888 14300 33554432000 4194304 5683644 140735128399824 18446744073709551615 268284512689 0 0 16781312 2 18446604466354070784 0 0 -1 1 0 0 0
[pid=20189/tid=20199] ppid=20187 vsize=348412 CPUtime=0 cores=1,3,5,7
/proc/20189/task/20199/stat : 20199 (python) S 20187 20189 19634 0 -1 4202560 21 936 0 0 0 0 0 0 25 0 5 0 538587502 356773888 14300 33554432000 4194304 5683644 140735128399824 18446744073709551615 268284512689 0 0 16781312 2 18446604466354070784 0 0 -1 7 0 0 0
[pid=20189/tid=20202] ppid=20187 vsize=348412 CPUtime=0 cores=1,3,5,7
/proc/20189/task/20202/stat : 20202 (python) S 20187 20189 19634 0 -1 4202560 26 936 0 0 0 0 0 0 25 0 5 0 538587505 356773888 14300 33554432000 4194304 5683644 140735128399824 18446744073709551615 268284512689 0 0 16781312 2 18446604466354070784 0 0 -1 5 0 0 0
[pid=20189/tid=20205] ppid=20187 vsize=348412 CPUtime=0 cores=1,3,5,7
/proc/20189/task/20205/stat : 20205 (python) S 20187 20189 19634 0 -1 4202560 28 936 0 0 0 0 0 0 25 0 5 0 538587507 356773888 14300 33554432000 4194304 5683644 140735128399824 18446744073709551615 268284512689 0 0 16781312 2 18446604466354070784 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 78.31
Current children cumulated vsize (KiB) 1851880

[startup+51.1015 s]
/proc/loadavg: 6.90 5.60 5.32 9/229 20207
/proc/meminfo: memFree=25397436/32950928 swapFree=67111464/67111528
[pid=20189] ppid=20187 vsize=348412 CPUtime=7.75 cores=1,3,5,7
/proc/20189/stat : 20189 (python) S 20187 20189 19634 0 -1 4202496 23454 936 1 0 762 13 0 0 25 0 5 0 538586723 356773888 14300 33554432000 4194304 5683644 140735128399824 18446744073709551615 268284515787 0 0 16781312 2 18446744073709551615 0 0 17 7 0 0 0
/proc/20189/statm: 87103 14300 1881 364 0 23012 0
[pid=20195] ppid=20189 vsize=307400 CPUtime=0.06 cores=1,3,5,7
/proc/20195/stat : 20195 (python) S 20189 20189 19634 0 -1 4202560 1005 0 0 0 3 3 0 0 18 0 1 0 538587500 314777600 12784 33554432000 4194304 5683644 140735128399824 18446744073709551615 268272709135 0 0 16781312 514 15143758367312281864 0 0 17 5 0 0 0
/proc/20195/statm: 76850 12784 381 364 0 12768 0
[pid=20197] ppid=20195 vsize=17924 CPUtime=43.3 cores=1,3,5,7
/proc/20197/stat : 20197 (lingeling) R 20195 20197 20197 0 -1 4202496 6750 0 0 0 4330 0 0 0 25 0 1 0 538587500 18354176 3651 33554432000 4194304 4352236 140735651543056 18446744073709551615 4328351 0 0 16781312 17506 0 0 0 17 1 0 0 0
/proc/20197/statm: 4481 3651 129 39 0 3561 0
[pid=20198] ppid=20189 vsize=317656 CPUtime=0.08 cores=1,3,5,7
/proc/20198/stat : 20198 (python) S 20189 20189 19634 0 -1 4202560 945 0 0 0 5 3 0 0 15 0 1 0 538587502 325279744 12777 33554432000 4194304 5683644 140735128399824 18446744073709551615 268272709190 0 0 16781312 514 5628606735066300680 0 0 17 3 0 0 0
/proc/20198/statm: 79414 12777 370 364 0 15329 0
[pid=20200] ppid=20198 vsize=259828 CPUtime=43.2 cores=1,3,5,7
/proc/20200/stat : 20200 (cryptominisat-2) R 20198 20200 20200 0 -1 4202496 68840 0 0 0 4309 11 0 0 25 0 1 0 538587503 266063872 46225 33554432000 4194304 4677096 140733817485616 18446744073709551615 4320006 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/20200/statm: 64957 46225 393 118 0 59916 0
[pid=20201] ppid=20189 vsize=327912 CPUtime=0.05 cores=1,3,5,7
/proc/20201/stat : 20201 (python) S 20189 20189 19634 0 -1 4202560 953 0 0 0 3 2 0 0 18 0 1 0 538587505 335781888 12781 33554432000 4194304 5683644 140735128399824 18446744073709551615 268272709190 0 0 16781312 514 15143758367312281863 0 0 17 5 0 0 0
/proc/20201/statm: 81978 12781 370 364 0 17890 0
[pid=20203] ppid=20201 vsize=18116 CPUtime=43.14 cores=1,3,5,7
/proc/20203/stat : 20203 (lingeling) R 20201 20203 20203 0 -1 4202496 6801 0 0 0 4313 1 0 0 25 0 1 0 538587505 18550784 3700 33554432000 4194304 4352236 140737114049936 18446744073709551615 4328026 0 0 16781312 17506 0 0 0 17 5 0 0 0
/proc/20203/statm: 4529 3700 129 39 0 3609 0
[pid=20204] ppid=20189 vsize=338168 CPUtime=0.06 cores=1,3,5,7
/proc/20204/stat : 20204 (python) S 20189 20189 19634 0 -1 4202560 950 0 0 0 3 3 0 0 18 0 1 0 538587507 346284032 12785 33554432000 4194304 5683644 140735128399824 18446744073709551615 268272709190 0 0 16781312 514 15143758367312281864 0 0 17 7 0 0 0
/proc/20204/statm: 84542 12785 370 364 0 20451 0

################
# More data... #
################

[pid=20195] ppid=20189 vsize=317644 CPUtime=0.44 cores=1,3,5,7
/proc/20195/stat : 20195 (python) S 20189 20189 19634 0 -1 4202560 1216 0 0 0 22 22 0 0 18 0 2 0 538587500 325267456 12823 33554432000 4194304 5683644 140735128399824 18446744073709551615 268284515787 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/20195/statm: 79411 12823 415 364 0 15329 0
[pid=20197] ppid=20195 vsize=33472 CPUtime=292.39 cores=1,3,5,7
/proc/20197/stat : 20197 (lingeling) T 20195 20197 20197 0 -1 4202496 11662 0 0 0 29238 1 0 0 25 0 1 0 538587500 34275328 7538 33554432000 4194304 4352236 140735651543056 18446744073709551615 4328349 0 0 16781312 17506 18446744071562691360 0 0 17 1 0 0 0
/proc/20197/statm: 8368 7538 129 39 0 7448 0
[pid=20195/tid=20211] ppid=20189 vsize=317644 CPUtime=0 cores=1,3,5,7
/proc/20195/task/20211/stat : 20211 (python) S 20189 20189 19634 0 -1 4202560 47 0 0 0 0 0 0 0 18 0 2 0 538597514 325267456 12823 33554432000 4194304 5683644 140735128399824 18446744073709551615 268284512689 0 0 16781312 514 18446604471122445376 0 0 -1 5 0 0 0
[pid=20198] ppid=20189 vsize=317656 CPUtime=0.78 cores=1,3,5,7
/proc/20198/stat : 20198 (python) S 20189 20189 19634 0 -1 4202560 1151 0 0 0 42 36 0 0 16 0 2 0 538587502 325279744 12807 33554432000 4194304 5683644 140735128399824 18446744073709551615 268284515787 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/20198/statm: 79414 12807 399 364 0 15329 0
[pid=20200] ppid=20198 vsize=397644 CPUtime=489.25 cores=1,3,5,7
/proc/20200/stat : 20200 (cryptominisat-2) T 20198 20200 20200 0 -1 4202496 283032 0 0 0 48861 64 0 0 25 0 1 0 538587503 407187456 90789 33554432000 4194304 4677096 140733817485616 18446744073709551615 4334607 0 0 16781312 2 18446744071562691360 0 0 17 3 0 0 0
/proc/20200/statm: 99411 90789 393 118 0 94370 0
[pid=20198/tid=20229] ppid=20189 vsize=317656 CPUtime=0 cores=1,3,5,7
/proc/20198/task/20229/stat : 20229 (python) S 20189 20189 19634 0 -1 4202560 48 0 0 0 0 0 0 0 16 0 2 0 538636507 325279744 12807 33554432000 4194304 5683644 140735128399824 18446744073709551615 268284512689 0 0 16781312 514 18446604471130098688 0 0 -1 3 0 0 0
[pid=20201] ppid=20189 vsize=327912 CPUtime=1.81 cores=1,3,5,7
/proc/20201/stat : 20201 (python) S 20189 20189 19634 0 -1 4202560 1007 0 0 0 99 82 0 0 18 0 1 0 538587505 335781888 12781 33554432000 4194304 5683644 140735128399824 18446744073709551615 268272709190 0 0 16781312 514 15143758367312281863 0 0 17 5 0 0 0
/proc/20201/statm: 81978 12781 370 364 0 17890 0
[pid=20203] ppid=20201 vsize=47048 CPUtime=1172.22 cores=1,3,5,7
/proc/20203/stat : 20203 (lingeling) R 20201 20203 20203 0 -1 4202496 45267 0 0 0 117217 5 0 0 25 0 1 0 538587505 48177152 10933 33554432000 4194304 4352236 140737114049936 18446744073709551615 4328039 0 0 16781312 17506 0 0 0 17 5 0 0 0
/proc/20203/statm: 11762 10933 129 39 0 10842 0
[pid=20204] ppid=20189 vsize=338168 CPUtime=1.82 cores=1,3,5,7
/proc/20204/stat : 20204 (python) S 20189 20189 19634 0 -1 4202560 1001 0 0 0 94 88 0 0 18 0 1 0 538587507 346284032 12785 33554432000 4194304 5683644 140735128399824 18446744073709551615 268272709190 0 0 16781312 514 15143758367312281864 0 0 17 7 0 0 0
/proc/20204/statm: 84542 12785 370 364 0 20451 0
[pid=20206] ppid=20204 vsize=48900 CPUtime=1166.32 cores=1,3,5,7
/proc/20206/stat : 20206 (lingeling) R 20204 20206 20206 0 -1 4202496 46499 0 0 0 116626 6 0 0 25 0 1 0 538587507 50073600 11395 33554432000 4194304 4352236 140736277637744 18446744073709551615 4329086 0 0 16781312 17506 0 0 0 17 7 0 0 0
/proc/20206/statm: 12225 11395 129 39 0 11305 0
[pid=20212] ppid=20189 vsize=348424 CPUtime=1.73 cores=1,3,5,7
/proc/20212/stat : 20212 (python) S 20189 20189 19634 0 -1 4202560 1011 0 0 0 92 81 0 0 15 0 1 0 538597516 356786176 12790 33554432000 4194304 5683644 140735128399824 18446744073709551615 268272709190 0 0 16781312 514 15143758367312281863 0 0 17 7 0 0 0
/proc/20212/statm: 87106 12790 371 364 0 23012 0
[pid=20214] ppid=20212 vsize=581324 CPUtime=1070.49 cores=1,3,5,7
/proc/20214/stat : 20214 (cryptominisat-2) R 20212 20214 20214 0 -1 4202496 572873 0 0 0 106874 175 0 0 25 0 1 0 538597517 595275776 111820 33554432000 4194304 4677096 140734255630592 18446744073709551615 4320307 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/20214/statm: 145331 111820 393 118 0 140290 0
[pid=20239] ppid=20189 vsize=358680 CPUtime=0.16 cores=1,3,5,7
/proc/20239/stat : 20239 (python) S 20189 20189 19634 0 -1 4202560 1138 0 0 0 7 9 0 0 19 0 2 0 538655740 367288320 12823 33554432000 4194304 5683644 140735128399824 18446744073709551615 268284515787 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/20239/statm: 89670 12823 399 364 0 25573 0
[pid=20241] ppid=20239 vsize=87320 CPUtime=99.97 cores=1,3,5,7
/proc/20241/stat : 20241 (SApperloT-base) T 20239 20241 20241 0 -1 4202496 21530 0 0 0 9991 6 0 0 25 0 1 0 538655740 89415680 21164 33554432000 134512640 135674940 4289973248 18446744073709551615 135111743 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/20241/statm: 21830 21164 100 284 0 21544 0
[pid=20239/tid=20245] ppid=20189 vsize=358680 CPUtime=0 cores=1,3,5,7
/proc/20239/task/20245/stat : 20245 (python) S 20189 20189 19634 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 538665755 367288320 12823 33554432000 4194304 5683644 140735128399824 18446744073709551615 268284512689 0 0 16781312 514 18446604454223472448 0 0 -1 1 0 0 0
[pid=20246] ppid=20189 vsize=368936 CPUtime=0.64 cores=1,3,5,7
/proc/20246/stat : 20246 (python) S 20189 20189 19634 0 -1 4202560 1188 0 0 0 37 27 0 0 18 0 2 0 538665758 377790464 12827 33554432000 4194304 5683644 140735128399824 18446744073709551615 268272709190 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/20246/statm: 92234 12827 399 364 0 28134 0
[pid=20248] ppid=20246 vsize=59264 CPUtime=391.27 cores=1,3,5,7
/proc/20248/stat : 20248 (precosat) R 20246 20248 20248 0 -1 4202496 30052 0 0 0 39122 5 0 0 25 0 1 0 538665758 60686336 14115 33554432000 4194304 4890832 140736566908640 18446744073709551615 4238673 0 0 16781312 17442 0 0 0 17 1 0 0 0
/proc/20248/statm: 14816 14115 86 171 0 14643 0
[pid=20246/tid=20258] ppid=20189 vsize=368936 CPUtime=0 cores=1,3,5,7
/proc/20246/task/20258/stat : 20258 (python) S 20189 20189 19634 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 538695002 377790464 12827 33554432000 4194304 5683644 140735128399824 18446744073709551615 268284512689 0 0 16781312 514 18446604471131423168 0 0 -1 1 0 0 0
[pid=20189/tid=20196] ppid=20187 vsize=379180 CPUtime=0 cores=1,3,5,7
/proc/20189/task/20196/stat : 20196 (python) S 20187 20189 19634 0 -1 4202560 31 936 0 0 0 0 0 0 18 0 8 0 538587500 388280320 14319 33554432000 4194304 5683644 140735128399824 18446744073709551615 268284512689 0 0 16781312 2 18446604466354070784 0 0 -1 1 0 0 0
[pid=20189/tid=20199] ppid=20187 vsize=379180 CPUtime=0 cores=1,3,5,7
/proc/20189/task/20199/stat : 20199 (python) S 20187 20189 19634 0 -1 4202560 21 936 0 0 0 0 0 0 25 0 8 0 538587502 388280320 14319 33554432000 4194304 5683644 140735128399824 18446744073709551615 268284512689 0 0 16781312 2 18446604466354070784 0 0 -1 7 0 0 0
[pid=20189/tid=20202] ppid=20187 vsize=379180 CPUtime=0 cores=1,3,5,7
/proc/20189/task/20202/stat : 20202 (python) S 20187 20189 19634 0 -1 4202560 26 936 0 0 0 0 0 0 25 0 8 0 538587505 388280320 14319 33554432000 4194304 5683644 140735128399824 18446744073709551615 268284512689 0 0 16781312 2 18446604466354070784 0 0 -1 5 0 0 0
[pid=20189/tid=20205] ppid=20187 vsize=379180 CPUtime=0 cores=1,3,5,7
/proc/20189/task/20205/stat : 20205 (python) S 20187 20189 19634 0 -1 4202560 28 936 0 0 0 0 0 0 25 0 8 0 538587507 388280320 14319 33554432000 4194304 5683644 140735128399824 18446744073709551615 268284512689 0 0 16781312 2 18446604466354070784 0 0 -1 7 0 0 0
[pid=20189/tid=20213] ppid=20187 vsize=379180 CPUtime=0 cores=1,3,5,7
/proc/20189/task/20213/stat : 20213 (python) S 20187 20189 19634 0 -1 4202560 27 936 0 0 0 0 0 0 20 0 8 0 538597517 388280320 14319 33554432000 4194304 5683644 140735128399824 18446744073709551615 268284512689 0 0 16781312 2 18446604466354070784 0 0 -1 7 0 0 0
[pid=20189/tid=20240] ppid=20187 vsize=379180 CPUtime=0 cores=1,3,5,7
/proc/20189/task/20240/stat : 20240 (python) S 20187 20189 19634 0 -1 4202560 28 936 0 0 0 0 0 0 20 0 8 0 538655740 388280320 14319 33554432000 4194304 5683644 140735128399824 18446744073709551615 268284512689 0 0 16781312 2 18446604466354070784 0 0 -1 1 0 0 0
[pid=20189/tid=20247] ppid=20187 vsize=379180 CPUtime=0 cores=1,3,5,7
/proc/20189/task/20247/stat : 20247 (python) S 20187 20189 19634 0 -1 4202560 30 936 0 0 0 0 0 0 18 0 8 0 538665758 388280320 14319 33554432000 4194304 5683644 140735128399824 18446744073709551615 268284512689 0 0 16781312 2 18446604466354070784 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4697.19
Current children cumulated vsize (KiB) 4011572



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1208.2 s]
/proc/loadavg: 7.72 7.95 7.25 9/247 20308
/proc/meminfo: memFree=24176152/32950928 swapFree=67111464/67111528
[pid=20189] ppid=20187 vsize=389436 CPUtime=7.92 cores=1,3,5,7
/proc/20189/stat : 20189 (python) S 20187 20189 19634 0 -1 4202496 26908 936 1 0 778 14 0 0 20 0 9 0 538586723 398782464 14325 33554432000 4194304 5683644 140735128399824 18446744073709551615 268284515787 0 0 16781312 2 18446744073709551615 0 0 17 1 0 0 0
/proc/20189/statm: 97359 14325 1890 364 0 33256 0
[pid=20195] ppid=20189 vsize=317644 CPUtime=0.44 cores=1,3,5,7
/proc/20195/stat : 20195 (python) S 20189 20189 19634 0 -1 4202560 1216 0 0 0 22 22 0 0 18 0 2 0 538587500 325267456 12823 33554432000 4194304 5683644 140735128399824 18446744073709551615 268284515787 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/20195/statm: 79411 12823 415 364 0 15329 0
[pid=20197] ppid=20195 vsize=33472 CPUtime=292.39 cores=1,3,5,7
/proc/20197/stat : 20197 (lingeling) T 20195 20197 20197 0 -1 4202496 11662 0 0 0 29238 1 0 0 25 0 1 0 538587500 34275328 7538 33554432000 4194304 4352236 140735651543056 18446744073709551615 4328349 0 0 16781312 17506 18446744071562691360 0 0 17 1 0 0 0
/proc/20197/statm: 8368 7538 129 39 0 7448 0
[pid=20195/tid=20211] ppid=20189 vsize=317644 CPUtime=0 cores=1,3,5,7
/proc/20195/task/20211/stat : 20211 (python) S 20189 20189 19634 0 -1 4202560 47 0 0 0 0 0 0 0 18 0 2 0 538597514 325267456 12823 33554432000 4194304 5683644 140735128399824 18446744073709551615 268284512689 0 0 16781312 514 18446604471122445376 0 0 -1 5 0 0 0
[pid=20198] ppid=20189 vsize=317656 CPUtime=0.78 cores=1,3,5,7
/proc/20198/stat : 20198 (python) S 20189 20189 19634 0 -1 4202560 1151 0 0 0 42 36 0 0 16 0 2 0 538587502 325279744 12807 33554432000 4194304 5683644 140735128399824 18446744073709551615 268284515787 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/20198/statm: 79414 12807 399 364 0 15329 0
[pid=20200] ppid=20198 vsize=397644 CPUtime=489.25 cores=1,3,5,7
/proc/20200/stat : 20200 (cryptominisat-2) T 20198 20200 20200 0 -1 4202496 283032 0 0 0 48861 64 0 0 25 0 1 0 538587503 407187456 90789 33554432000 4194304 4677096 140733817485616 18446744073709551615 4334607 0 0 16781312 2 18446744071562691360 0 0 17 3 0 0 0
/proc/20200/statm: 99411 90789 393 118 0 94370 0
[pid=20198/tid=20229] ppid=20189 vsize=317656 CPUtime=0 cores=1,3,5,7
/proc/20198/task/20229/stat : 20229 (python) S 20189 20189 19634 0 -1 4202560 48 0 0 0 0 0 0 0 16 0 2 0 538636507 325279744 12807 33554432000 4194304 5683644 140735128399824 18446744073709551615 268284512689 0 0 16781312 514 18446604471130098688 0 0 -1 3 0 0 0
[pid=20201] ppid=20189 vsize=327912 CPUtime=1.86 cores=1,3,5,7
/proc/20201/stat : 20201 (python) S 20189 20189 19634 0 -1 4202560 1007 0 0 0 102 84 0 0 18 0 1 0 538587505 335781888 12781 33554432000 4194304 5683644 140735128399824 18446744073709551615 268272709190 0 0 16781312 514 15143758367312281863 0 0 17 5 0 0 0
/proc/20201/statm: 81978 12781 370 364 0 17890 0
[pid=20203] ppid=20201 vsize=46024 CPUtime=1198.08 cores=1,3,5,7
/proc/20203/stat : 20203 (lingeling) R 20201 20203 20203 0 -1 4202496 45779 0 0 0 119803 5 0 0 25 0 1 0 538587505 47128576 10677 33554432000 4194304 4352236 140737114049936 18446744073709551615 4231337 0 0 16781312 17506 0 0 0 17 5 0 0 0
/proc/20203/statm: 11506 10677 129 39 0 10586 0
[pid=20204] ppid=20189 vsize=338168 CPUtime=1.87 cores=1,3,5,7
/proc/20204/stat : 20204 (python) S 20189 20189 19634 0 -1 4202560 1001 0 0 0 97 90 0 0 18 0 1 0 538587507 346284032 12785 33554432000 4194304 5683644 140735128399824 18446744073709551615 268272709190 0 0 16781312 514 15143758367312281864 0 0 17 7 0 0 0
/proc/20204/statm: 84542 12785 370 364 0 20451 0
[pid=20206] ppid=20204 vsize=48900 CPUtime=1191.73 cores=1,3,5,7
/proc/20206/stat : 20206 (lingeling) R 20204 20206 20206 0 -1 4202496 47011 0 0 0 119167 6 0 0 25 0 1 0 538587507 50073600 11395 33554432000 4194304 4352236 140736277637744 18446744073709551615 4328026 0 0 16781312 17506 0 0 0 17 7 0 0 0
/proc/20206/statm: 12225 11395 129 39 0 11305 0
[pid=20212] ppid=20189 vsize=348424 CPUtime=1.77 cores=1,3,5,7
/proc/20212/stat : 20212 (python) S 20189 20189 19634 0 -1 4202560 1011 0 0 0 94 83 0 0 15 0 1 0 538597516 356786176 12790 33554432000 4194304 5683644 140735128399824 18446744073709551615 268272709190 0 0 16781312 514 15143758367312281863 0 0 17 7 0 0 0
/proc/20212/statm: 87106 12790 371 364 0 23012 0
[pid=20214] ppid=20212 vsize=488592 CPUtime=1096.4 cores=1,3,5,7
/proc/20214/stat : 20214 (cryptominisat-2) R 20212 20214 20214 0 -1 4202496 582125 0 0 0 109460 180 0 0 25 0 1 0 538597517 500318208 110062 33554432000 4194304 4677096 140734255630592 18446744073709551615 4334301 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/20214/statm: 122148 110062 393 118 0 117107 0
[pid=20239] ppid=20189 vsize=358680 CPUtime=0.16 cores=1,3,5,7
/proc/20239/stat : 20239 (python) S 20189 20189 19634 0 -1 4202560 1138 0 0 0 7 9 0 0 19 0 2 0 538655740 367288320 12823 33554432000 4194304 5683644 140735128399824 18446744073709551615 268284515787 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/20239/statm: 89670 12823 399 364 0 25573 0
[pid=20241] ppid=20239 vsize=87320 CPUtime=99.97 cores=1,3,5,7
/proc/20241/stat : 20241 (SApperloT-base) T 20239 20241 20241 0 -1 4202496 21530 0 0 0 9991 6 0 0 25 0 1 0 538655740 89415680 21164 33554432000 134512640 135674940 4289973248 18446744073709551615 135111743 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/20241/statm: 21830 21164 100 284 0 21544 0
[pid=20239/tid=20245] ppid=20189 vsize=358680 CPUtime=0 cores=1,3,5,7
/proc/20239/task/20245/stat : 20245 (python) S 20189 20189 19634 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 538665755 367288320 12823 33554432000 4194304 5683644 140735128399824 18446744073709551615 268284512689 0 0 16781312 514 18446604454223472448 0 0 -1 1 0 0 0
[pid=20246] ppid=20189 vsize=368936 CPUtime=0.66 cores=1,3,5,7
/proc/20246/stat : 20246 (python) S 20189 20189 19634 0 -1 4202560 1188 0 0 0 38 28 0 0 18 0 2 0 538665758 377790464 12827 33554432000 4194304 5683644 140735128399824 18446744073709551615 268284515787 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/20246/statm: 92234 12827 399 364 0 28134 0
[pid=20248] ppid=20246 vsize=59264 CPUtime=392.93 cores=1,3,5,7
/proc/20248/stat : 20248 (precosat) T 20246 20248 20248 0 -1 4202496 30052 0 0 0 39288 5 0 0 25 0 1 0 538665758 60686336 14115 33554432000 4194304 4890832 140736566908640 18446744073709551615 4238327 0 0 16781312 17442 18446744071562691360 0 0 17 1 0 0 0
/proc/20248/statm: 14816 14115 86 171 0 14643 0
[pid=20246/tid=20258] ppid=20189 vsize=368936 CPUtime=0 cores=1,3,5,7
/proc/20246/task/20258/stat : 20258 (python) S 20189 20189 19634 0 -1 4202560 48 0 0 0 0 0 0 0 18 0 2 0 538695002 377790464 12827 33554432000 4194304 5683644 140735128399824 18446744073709551615 268284512689 0 0 16781312 514 18446604471131423168 0 0 -1 1 0 0 0
[pid=20261] ppid=20189 vsize=379192 CPUtime=0.03 cores=1,3,5,7
/proc/20261/stat : 20261 (python) S 20189 20189 19634 0 -1 4202560 989 0 0 0 2 1 0 0 18 0 1 0 538705122 388292608 12807 33554432000 4194304 5683644 140735128399824 18446744073709551615 268272709190 0 0 16781312 514 15143758367312281862 0 0 17 1 0 0 0
/proc/20261/statm: 94798 12807 376 364 0 30695 0
[pid=20263] ppid=20261 vsize=46580 CPUtime=24.15 cores=1,3,5,7
/proc/20263/stat : 20263 (precosat) R 20261 20263 20263 0 -1 4202496 11885 0 0 0 2414 1 0 0 25 0 1 0 538705122 47697920 10918 33554432000 4194304 4890832 140733768708672 18446744073709551615 4238562 0 0 16781312 17442 0 0 0 17 1 0 0 0
/proc/20263/statm: 11645 10918 86 171 0 11472 0
[pid=20189/tid=20196] ppid=20187 vsize=389436 CPUtime=0 cores=1,3,5,7
/proc/20189/task/20196/stat : 20196 (python) S 20187 20189 19634 0 -1 4202560 31 936 0 0 0 0 0 0 18 0 9 0 538587500 398782464 14325 33554432000 4194304 5683644 140735128399824 18446744073709551615 268284512689 0 0 16781312 2 18446604466354070784 0 0 -1 1 0 0 0
[pid=20189/tid=20199] ppid=20187 vsize=389436 CPUtime=0 cores=1,3,5,7
/proc/20189/task/20199/stat : 20199 (python) S 20187 20189 19634 0 -1 4202560 21 936 0 0 0 0 0 0 25 0 9 0 538587502 398782464 14325 33554432000 4194304 5683644 140735128399824 18446744073709551615 268284512689 0 0 16781312 2 18446604466354070784 0 0 -1 7 0 0 0
[pid=20189/tid=20202] ppid=20187 vsize=389436 CPUtime=0 cores=1,3,5,7
/proc/20189/task/20202/stat : 20202 (python) S 20187 20189 19634 0 -1 4202560 26 936 0 0 0 0 0 0 25 0 9 0 538587505 398782464 14325 33554432000 4194304 5683644 140735128399824 18446744073709551615 268284512689 0 0 16781312 2 18446604466354070784 0 0 -1 5 0 0 0
[pid=20189/tid=20205] ppid=20187 vsize=389436 CPUtime=0 cores=1,3,5,7
/proc/20189/task/20205/stat : 20205 (python) S 20187 20189 19634 0 -1 4202560 28 936 0 0 0 0 0 0 25 0 9 0 538587507 398782464 14325 33554432000 4194304 5683644 140735128399824 18446744073709551615 268284512689 0 0 16781312 2 18446604466354070784 0 0 -1 7 0 0 0
[pid=20189/tid=20213] ppid=20187 vsize=389436 CPUtime=0 cores=1,3,5,7
/proc/20189/task/20213/stat : 20213 (python) S 20187 20189 19634 0 -1 4202560 27 936 0 0 0 0 0 0 20 0 9 0 538597517 398782464 14325 33554432000 4194304 5683644 140735128399824 18446744073709551615 268284512689 0 0 16781312 2 18446604466354070784 0 0 -1 7 0 0 0
[pid=20189/tid=20240] ppid=20187 vsize=389436 CPUtime=0 cores=1,3,5,7
/proc/20189/task/20240/stat : 20240 (python) S 20187 20189 19634 0 -1 4202560 28 936 0 0 0 0 0 0 20 0 9 0 538655740 398782464 14325 33554432000 4194304 5683644 140735128399824 18446744073709551615 268284512689 0 0 16781312 2 18446604466354070784 0 0 -1 1 0 0 0
[pid=20189/tid=20247] ppid=20187 vsize=389436 CPUtime=0 cores=1,3,5,7
/proc/20189/task/20247/stat : 20247 (python) S 20187 20189 19634 0 -1 4202560 30 936 0 0 0 0 0 0 18 0 9 0 538665758 398782464 14325 33554432000 4194304 5683644 140735128399824 18446744073709551615 268284512689 0 0 16781312 2 18446604466354070784 0 0 -1 1 0 0 0
[pid=20189/tid=20262] ppid=20187 vsize=389436 CPUtime=0 cores=1,3,5,7
/proc/20189/task/20262/stat : 20262 (python) S 20187 20189 19634 0 -1 4202560 33 936 0 0 0 0 0 0 20 0 9 0 538705122 398782464 14325 33554432000 4194304 5683644 140735128399824 18446744073709551615 268284512689 0 0 16781312 2 18446604466354070784 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4800.39
Current children cumulated vsize (KiB) 4353844

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 20189 and gives
#  childrusage.ru_utime.tv_sec=1227
#  childrusage.ru_utime.tv_usec=753353
#  childrusage.ru_stime.tv_sec=3
#  childrusage.ru_stime.tv_usec=833417
# CPU time returned by wait4() is 1231.59
# while last known CPU time is 4800.39
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1208.26
CPU time (s): 4800.39
CPU user time (s): 4794.04
CPU system time (s): 6.35
CPU usage (%): 397.298
Max. virtual memory (cumulated for all children) (KiB): 4449652

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1227.75
system time used= 3.83342
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 98343
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 7135
involuntary context switches= 12415

runsolver used 2.77258 second user time and 6.16406 second system time

The end

Launcher Data 

Begin job on node122 at 2011-05-01 19:11:19
IDJOB=3317900
IDBENCH=83110
IDSOLVER=1706
FILE ID=node122/3317900-1304269879
RUNJOBID= node122-1304267283-19653
PBS_JOBID= 13173957
Free space on /tmp= 73364 MiB

SOLVER NAME= borg-sat 11.03.02-industrial
BENCH NAME= SAT11/application/fuhs/slp-synthesis-AES/slp-synthesis-aes-bottom20.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.industrial.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3317900-1304269879/watcher-3317900-1304269879 -o /tmp/evaluation-result-3317900-1304269879/solver-3317900-1304269879 -C 4800 -W 1300 -M 15500  python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3317900-1304269879.cnf -seed 966247080 -budget 4800 -cores 4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 9851f8e63efc4505343bf50c1cf30646
RANDOM SEED=966247080

node122.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.64
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.97
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      25821680 kB
Buffers:        361204 kB
Cached:        1913892 kB
SwapCached:         64 kB
Active:        4962716 kB
Inactive:      1802276 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      25821680 kB
SwapTotal:    67111528 kB
SwapFree:     67111464 kB
Dirty:           70812 kB
Writeback:           0 kB
AnonPages:     4490032 kB
Mapped:          22824 kB
Slab:           285976 kB
PageTables:      17476 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:  5151968 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73324 MiB
End job on node122 at 2011-05-01 19:31:30