Trace number 3498263

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-seq-industrial (fixed)? (TO) 5000.11 5010.16

General information on the benchmark

Nameindustrial/jarvisalo/
eq.atree.braun.11.unsat.cnf
MD5SUM90581094793af5fc10d4e4b9a10259ac
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark642.926
Satisfiable
(Un)Satisfiability was proved
Number of variables1400
Number of clauses4732
Sum of the clauses size12300
Maximum clause length21
Minimum clause length1
Number of clauses of size 13
Number of clauses of size 22052
Number of clauses of size 32605
Number of clauses of size 427
Number of clauses of size 531
Number of clauses of size over 514

Solver Data 

0.42/16.95	c INFO: loaded portfolio from HOME/etc/borg-mix+class.industrial.pickle
0.42/16.95	c INFO: solving HOME/instance-3498263-1307953114.cnf
0.42/16.95	c INFO: computing task features
0.42/16.97	c INFO: computed variable-clause graph statistics
0.42/16.97	c INFO: computed clause balance statistics
0.48/17.05	c INFO: computed variable balance statistics
0.58/17.11	c INFO: computed small-clause counts
0.58/17.11	c INFO: computed Horn-clause counts
0.58/17.12	c INFO: computed variable graph statistics
0.58/17.12	c INFO: collected features for HOME/instance-3498263-1307953114.cnf in 0.16 s
0.58/17.16	c INFO: running lingeling-276@0 for 97 with 4999 remaining (b = 0.28)
100.75/117.29	c INFO: running lingeling-276@100 for 485 with 4899 remaining (b = 0.41)
586.83/602.79	c INFO: running SApperloT@0 for 97 with 4414 remaining (b = 0.15)
687.14/702.92	c INFO: running cryptominisat-2.9.0@0 for 485 with 4314 remaining (b = 0.41)
1178.52/1193.75	c INFO: running precosat-570@0 for 388 with 3823 remaining (b = 0.29)
1572.56/1587.23	c INFO: running lingeling-276@585 for 679 with 3430 remaining (b = 0.27)
2253.29/2267.02	c INFO: running lingeling-276@0 for 582 with 2750 remaining (b = 0.39)
2840.74/2853.72	c INFO: running lingeling-276@586 for 291 with 2163 remaining (b = 0.11)
3128.42/3141.06	c INFO: running lingeling-276@0 for 582 with 1876 remaining (b = 0.32)
3715.90/3727.76	c INFO: running cryptominisat-2.9.0@490 for 97 with 1289 remaining (b = 0.08)
3813.13/3824.89	c INFO: running cryptominisat-2.9.0@0 for 291 with 1192 remaining (b = 0.19)
4106.12/4117.46	c INFO: running cryptominisat-2.9.0@292 for 194 with 900 remaining (b = 0.13)
4300.42/4311.49	c INFO: running precosat-570@393 for 291 with 706 remaining (b = 0.15)
4590.23/4600.84	c INFO: running precosat-570@682 for 97 with 416 remaining (b = 0.07)
4685.45/4695.97	c INFO: running precosat-570@0 for 194 with 321 remaining (b = 0.13)
4882.01/4892.23	c INFO: running cryptominisat-2.9.0@486 for 125 with 125 remaining (b = 0.05)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /var/tmp/evaluation-result-3498263-1307953114/watcher-3498263-1307953114 -o /var/tmp/evaluation-result-3498263-1307953114/solver-3498263-1307953114 -C 5000 -W 5100 -M 15500 python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3498263-1307953114.cnf -seed 462826349 -budget 5000 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 5000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 5030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.16 0.03 0.01 2/177 18295
/proc/meminfo: memFree=4879968/32951124 swapFree=67051728/67111528
[pid=18295] ppid=18290 vsize=11804 CPUtime=0 cores=1,3,5,7
/proc/18295/stat : 18295 (runsolver) S 18290 18295 18249 0 -1 4202560 42 0 0 0 0 0 0 0 19 0 1 0 906910038 12087296 50 33554432000 4194304 5436572 140733296752864 18446744073709551615 4883175 0 2147483391 4096 24578 18446744071699968823 0 0 17 3 0 0 0
/proc/18295/statm: 2951 50 31 304 0 2643 0

[startup+0.082126 s]
/proc/loadavg: 0.16 0.03 0.01 2/177 18295
/proc/meminfo: memFree=4879968/32951124 swapFree=67051728/67111528
[pid=18295] ppid=18290 vsize=15080 CPUtime=0 cores=1,3,5,7
/proc/18295/stat : 18295 (python) S 18290 18295 18249 0 -1 4202496 651 0 0 0 0 0 0 0 17 0 1 0 906910038 15441920 545 33554432000 4194304 5683644 140734417663408 18446744073709551615 228122712064 0 2147483391 16781312 2 18446744071699207358 0 0 17 5 0 0 0
/proc/18295/statm: 3770 545 312 364 0 257 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 15080

[startup+0.101134 s]
/proc/loadavg: 0.16 0.03 0.01 2/177 18295
/proc/meminfo: memFree=4879968/32951124 swapFree=67051728/67111528
[pid=18295] ppid=18290 vsize=15184 CPUtime=0 cores=1,3,5,7
/proc/18295/stat : 18295 (python) S 18290 18295 18249 0 -1 4202496 713 0 0 0 0 0 0 0 17 0 1 0 906910038 15548416 603 33554432000 4194304 5683644 140734417663408 18446744073709551615 228122712064 0 2147483391 16781312 2 18446744071699207358 0 0 17 5 0 0 0
/proc/18295/statm: 3796 603 319 364 0 283 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 15184

[startup+0.301104 s]
/proc/loadavg: 0.16 0.03 0.01 2/177 18295
/proc/meminfo: memFree=4879968/32951124 swapFree=67051728/67111528
[pid=18295] ppid=18290 vsize=15776 CPUtime=0 cores=1,3,5,7
/proc/18295/stat : 18295 (python) S 18290 18295 18249 0 -1 4202496 897 0 0 0 0 0 0 0 16 0 1 0 906910038 16154624 777 33554432000 4194304 5683644 140734417663408 18446744073709551615 228122712064 0 2147483391 16781312 2 18446744071699207358 0 0 17 5 0 0 0
/proc/18295/statm: 3944 777 343 364 0 431 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 15776

[startup+0.701009 s]
/proc/loadavg: 0.16 0.03 0.01 2/177 18295
/proc/meminfo: memFree=4879968/32951124 swapFree=67051728/67111528
[pid=18295] ppid=18290 vsize=18888 CPUtime=0.01 cores=1,3,5,7
/proc/18295/stat : 18295 (python) S 18290 18295 18249 0 -1 4202496 1252 0 0 0 1 0 0 0 15 0 1 0 906910038 19341312 1105 33554432000 4194304 5683644 140734417663408 18446744073709551615 228122712064 0 2147483391 16781312 2 18446744071699207358 0 0 17 5 0 0 0
/proc/18295/statm: 4722 1105 421 364 0 691 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 18888

[startup+1.50087 s]
/proc/loadavg: 0.16 0.03 0.01 1/178 18296
/proc/meminfo: memFree=4868476/32951124 swapFree=67051728/67111528
[pid=18295] ppid=18290 vsize=99344 CPUtime=0.06 cores=1,3,5,7
/proc/18295/stat : 18295 (python) S 18290 18295 18249 0 -1 4202496 2859 0 0 0 4 2 0 0 15 0 1 0 906910038 101728256 2558 33554432000 4194304 5683644 140734417663408 18446744073709551615 228122709861 0 2147483391 16781312 2 18446744071699207358 0 0 17 5 0 0 0
/proc/18295/statm: 24836 2558 818 364 0 1687 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 99344

[startup+3.10058 s]
/proc/loadavg: 0.15 0.03 0.01 1/178 18296
/proc/meminfo: memFree=4864260/32951124 swapFree=67051728/67111528
[pid=18295] ppid=18290 vsize=104636 CPUtime=0.08 cores=1,3,5,7
/proc/18295/stat : 18295 (python) S 18290 18295 18249 0 -1 4202496 3183 0 0 0 5 3 0 0 15 0 1 0 906910038 107147264 2852 33554432000 4194304 5683644 140734417663408 18446744073709551615 228122712064 0 2147483391 16781312 2 18446744071699207358 0 0 17 5 0 0 0
/proc/18295/statm: 26159 2852 847 364 0 1907 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 104636
heavy processes:

[startup+6.30095 s]
/proc/loadavg: 0.15 0.03 0.01 1/178 18296
/proc/meminfo: memFree=4855692/32951124 swapFree=67051728/67111528
[pid=18295] ppid=18290 vsize=135748 CPUtime=0.18 cores=1,3,5,7
/proc/18295/stat : 18295 (python) S 18290 18295 18249 0 -1 4202496 5968 934 1 0 13 5 0 0 15 0 1 0 906910038 139005952 4149 33554432000 4194304 5683644 140734417663408 18446744073709551615 228122710021 0 2147483391 16781312 2 18446744071699207358 0 0 17 7 0 0 0
/proc/18295/statm: 33937 4149 1032 364 0 3123 0
Current children cumulated CPU time (s) 0.18
Current children cumulated vsize (KiB) 135748
heavy processes:

[startup+12.7008 s]
/proc/loadavg: 0.13 0.03 0.01 1/178 18304
/proc/meminfo: memFree=4851664/32951124 swapFree=67051728/67111528
[pid=18295] ppid=18290 vsize=135748 CPUtime=0.23 cores=1,3,5,7
/proc/18295/stat : 18295 (python) S 18290 18295 18249 0 -1 4202496 5971 934 1 0 16 7 0 0 16 0 1 0 906910038 139005952 4150 33554432000 4194304 5683644 140734417663408 18446744073709551615 228122710021 0 2147483391 16781312 2 18446744071699207358 0 0 17 7 0 0 0
/proc/18295/statm: 33937 4150 1032 364 0 3123 0
Current children cumulated CPU time (s) 0.23
Current children cumulated vsize (KiB) 135748
heavy processes:

[startup+25.5005 s]
/proc/loadavg: 0.41 0.09 0.03 3/184 18311
/proc/meminfo: memFree=4784120/32951124 swapFree=67051728/67111528
[pid=18295] ppid=18290 vsize=289168 CPUtime=0.62 cores=1,3,5,7
/proc/18295/stat : 18295 (python) S 18290 18295 18249 0 -1 4202496 9861 934 1 0 49 13 0 0 17 0 2 0 906910038 296108032 7191 33554432000 4194304 5683644 140734417663408 18446744073709551615 228134540747 0 0 16781312 2 18446744073709551615 0 0 17 7 0 0 0
/proc/18295/statm: 72292 7191 1875 364 0 8210 0
[pid=18306] ppid=18295 vsize=278924 CPUtime=0 cores=1,3,5,7
/proc/18306/stat : 18306 (python) S 18295 18295 18249 0 -1 4202560 959 0 0 0 0 0 0 0 15 0 1 0 906911755 285618176 5693 33554432000 4194304 5683644 140734417663408 18446744073709551615 228122734095 0 0 16781312 514 3802616163859398920 0 0 17 7 0 0 0
/proc/18306/statm: 69731 5693 381 364 0 5649 0
[pid=18308] ppid=18306 vsize=9056 CPUtime=8.33 cores=1,3,5,7
/proc/18308/stat : 18308 (lingeling) R 18306 18308 18308 0 -1 4202496 3481 0 0 0 833 0 0 0 25 0 1 0 906911755 9273344 1466 33554432000 4194304 4352236 140736525039904 18446744073709551615 4328114 0 0 16781312 17506 0 0 0 17 1 0 0 0
/proc/18308/statm: 2264 1466 129 39 0 1344 0
[pid=18295/tid=18307] ppid=18290 vsize=289168 CPUtime=0 cores=1,3,5,7
/proc/18295/task/18307/stat : 18307 (python) S 18290 18295 18249 0 -1 4202560 27 934 0 0 0 0 0 0 17 0 2 0 906911755 296108032 7191 33554432000 4194304 5683644 140734417663408 18446744073709551615 228134537649 0 0 16781312 2 18446604458093025216 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 8.95
Current children cumulated vsize (KiB) 577148
heavy processes:

[startup+51.1008 s]
/proc/loadavg: 0.95 0.25 0.08 3/184 18311
/proc/meminfo: memFree=4767580/32951124 swapFree=67051728/67111528
[pid=18295] ppid=18290 vsize=289168 CPUtime=0.62 cores=1,3,5,7
/proc/18295/stat : 18295 (python) S 18290 18295 18249 0 -1 4202496 9861 934 1 0 49 13 0 0 17 0 2 0 906910038 296108032 7191 33554432000 4194304 5683644 140734417663408 18446744073709551615 228134540747 0 0 16781312 2 18446744073709551615 0 0 17 7 0 0 0
/proc/18295/statm: 72292 7191 1875 364 0 8210 0
[pid=18306] ppid=18295 vsize=278924 CPUtime=0.02 cores=1,3,5,7
/proc/18306/stat : 18306 (python) S 18295 18295 18249 0 -1 4202560 968 0 0 0 1 1 0 0 15 0 1 0 906911755 285618176 5694 33554432000 4194304 5683644 140734417663408 18446744073709551615 228122734095 0 0 16781312 514 5563915864639504648 0 0 17 7 0 0 0
/proc/18306/statm: 69731 5694 382 364 0 5649 0
[pid=18308] ppid=18306 vsize=13288 CPUtime=33.92 cores=1,3,5,7
/proc/18308/stat : 18308 (lingeling) R 18306 18308 18308 0 -1 4202496 8699 0 0 0 3392 0 0 0 25 0 1 0 906911755 13606912 2524 33554432000 4194304 4352236 140736525039904 18446744073709551615 4329086 0 0 16781312 17506 0 0 0 17 1 0 0 0
/proc/18308/statm: 3322 2524 129 39 0 2402 0
[pid=18295/tid=18307] ppid=18290 vsize=289168 CPUtime=0 cores=1,3,5,7
/proc/18295/task/18307/stat : 18307 (python) S 18290 18295 18249 0 -1 4202560 27 934 0 0 0 0 0 0 17 0 2 0 906911755 296108032 7191 33554432000 4194304 5683644 140734417663408 18446744073709551615 228134537649 0 0 16781312 2 18446604458093025216 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 34.56
Current children cumulated vsize (KiB) 581380
heavy processes:

[startup+102.307 s]
/proc/loadavg: 1.58 0.54 0.19 3/184 18313
/proc/meminfo: memFree=4759708/32951124 swapFree=67051728/67111528
[pid=18295] ppid=18290 vsize=289168 CPUtime=0.62 cores=1,3,5,7
/proc/18295/stat : 18295 (python) S 18290 18295 18249 0 -1 4202496 9861 934 1 0 49 13 0 0 17 0 2 0 906910038 296108032 7191 33554432000 4194304 5683644 140734417663408 18446744073709551615 228134540747 0 0 16781312 2 18446744073709551615 0 0 17 7 0 0 0
/proc/18295/statm: 72292 7191 1875 364 0 8210 0
[pid=18306] ppid=18295 vsize=278924 CPUtime=0.09 cores=1,3,5,7
/proc/18306/stat : 18306 (python) S 18295 18295 18249 0 -1 4202560 987 0 0 0 5 4 0 0 15 0 1 0 906911755 285618176 5694 33554432000 4194304 5683644 140734417663408 18446744073709551615 228122734095 0 0 16781312 514 5563915864639504648 0 0 17 7 0 0 0
/proc/18306/statm: 69731 5694 382 364 0 5649 0
[pid=18308] ppid=18306 vsize=14696 CPUtime=85.13 cores=1,3,5,7
/proc/18308/stat : 18308 (lingeling) R 18306 18308 18308 0 -1 4202496 14747 0 0 0 8512 1 0 0 25 0 1 0 906911755 15048704 2876 33554432000 4194304 4352236 140736525039904 18446744073709551615 4328009 0 0 16781312 17506 0 0 0 17 1 0 0 0
/proc/18308/statm: 3674 2876 129 39 0 2754 0
[pid=18295/tid=18307] ppid=18290 vsize=289168 CPUtime=0 cores=1,3,5,7
/proc/18295/task/18307/stat : 18307 (python) S 18290 18295 18249 0 -1 4202560 27 934 0 0 0 0 0 0 17 0 2 0 906911755 296108032 7191 33554432000 4194304 5683644 140734417663408 18446744073709551615 228134537649 0 0 16781312 2 18446604458093025216 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 85.84
Current children cumulated vsize (KiB) 582788

[startup+162.301 s]
/proc/loadavg: 1.83 0.78 0.29 3/189 18319
/proc/meminfo: memFree=4522892/32951124 swapFree=67051728/67111528
[pid=18295] ppid=18290 vsize=289328 CPUtime=0.64 cores=1,3,5,7
/proc/18295/stat : 18295 (python) S 18290 18295 18249 0 -1 4202496 10328 934 1 0 51 13 0 0 17 0 2 0 906910038 296271872 7204 33554432000 4194304 5683644 140734417663408 18446744073709551615 228134540747 0 0 16781312 2 18446744073709551615 0 0 17 7 0 0 0
/proc/18295/statm: 72332 7204 1876 364 0 8250 0
[pid=18306] ppid=18295 vsize=289168 CPUtime=0.16 cores=1,3,5,7
/proc/18306/stat : 18306 (python) S 18295 18295 18249 0 -1 4202560 1177 0 0 0 8 8 0 0 15 0 2 0 906911755 296108032 5733 33554432000 4194304 5683644 140734417663408 18446744073709551615 228122734150 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/18306/statm: 72292 5733 416 364 0 8210 0
[pid=18308] ppid=18306 vsize=14568 CPUtime=145.1 cores=1,3,5,7
/proc/18308/stat : 18308 (lingeling) R 18306 18308 18308 0 -1 4202496 22203 0 0 0 14508 2 0 0 25 0 1 0 906911755 14917632 2844 33554432000 4194304 4352236 140736525039904 18446744073709551615 4328194 0 0 16781312 17506 0 0 0 17 1 0 0 0
/proc/18308/statm: 3642 2844 129 39 0 2722 0
[pid=18306/tid=18314] ppid=18295 vsize=289168 CPUtime=0 cores=1,3,5,7
/proc/18306/task/18314/stat : 18314 (python) S 18295 18295 18249 0 -1 4202560 47 0 0 0 0 0 0 0 16 0 2 0 906921765 296108032 5733 33554432000 4194304 5683644 140734417663408 18446744073709551615 228134537649 0 0 16781312 514 18446604458093026112 0 0 -1 7 0 0 0
[pid=18295/tid=18307] ppid=18290 vsize=289328 CPUtime=0 cores=1,3,5,7
/proc/18295/task/18307/stat : 18307 (python) S 18290 18295 18249 0 -1 4202560 28 934 0 0 0 0 0 0 15 0 2 0 906911755 296271872 7204 33554432000 4194304 5683644 140734417663408 18446744073709551615 228134537649 0 0 16781312 2 18446604458093025216 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 145.9
Current children cumulated vsize (KiB) 593064

[startup+222.301 s]
/proc/loadavg: 1.94 1.02 0.40 3/189 18321
/proc/meminfo: memFree=4457620/32951124 swapFree=67051728/67111528
[pid=18295] ppid=18290 vsize=289328 CPUtime=0.64 cores=1,3,5,7
/proc/18295/stat : 18295 (python) S 18290 18295 18249 0 -1 4202496 10328 934 1 0 51 13 0 0 17 0 2 0 906910038 296271872 7204 33554432000 4194304 5683644 140734417663408 18446744073709551615 228134540747 0 0 16781312 2 18446744073709551615 0 0 17 7 0 0 0
/proc/18295/statm: 72332 7204 1876 364 0 8250 0
[pid=18306] ppid=18295 vsize=289168 CPUtime=0.23 cores=1,3,5,7
/proc/18306/stat : 18306 (python) S 18295 18295 18249 0 -1 4202560 1194 0 0 0 12 11 0 0 15 0 2 0 906911755 296108032 5733 33554432000 4194304 5683644 140734417663408 18446744073709551615 228122734150 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/18306/statm: 72292 5733 416 364 0 8210 0
[pid=18308] ppid=18306 vsize=22248 CPUtime=205.1 cores=1,3,5,7
/proc/18308/stat : 18308 (lingeling) R 18306 18308 18308 0 -1 4202496 29339 0 0 0 20507 3 0 0 25 0 1 0 906911755 22781952 4764 33554432000 4194304 4352236 140736525039904 18446744073709551615 4329205 0 0 16781312 17506 0 0 0 17 1 0 0 0
/proc/18308/statm: 5562 4764 129 39 0 4642 0
[pid=18306/tid=18314] ppid=18295 vsize=289168 CPUtime=0 cores=1,3,5,7
/proc/18306/task/18314/stat : 18314 (python) S 18295 18295 18249 0 -1 4202560 47 0 0 0 0 0 0 0 16 0 2 0 906921765 296108032 5733 33554432000 4194304 5683644 140734417663408 18446744073709551615 228134537649 0 0 16781312 514 18446604458093026112 0 0 -1 7 0 0 0
[pid=18295/tid=18307] ppid=18290 vsize=289328 CPUtime=0 cores=1,3,5,7
/proc/18295/task/18307/stat : 18307 (python) S 18290 18295 18249 0 -1 4202560 28 934 0 0 0 0 0 0 15 0 2 0 906911755 296271872 7204 33554432000 4194304 5683644 140734417663408 18446744073709551615 228134537649 0 0 16781312 2 18446604458093025216 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 205.97
Current children cumulated vsize (KiB) 600744

[startup+282.301 s]
/proc/loadavg: 1.97 1.18 0.49 3/189 18323
/proc/meminfo: memFree=4449136/32951124 swapFree=67051728/67111528
[pid=18295] ppid=18290 vsize=289328 CPUtime=0.64 cores=1,3,5,7
/proc/18295/stat : 18295 (python) S 18290 18295 18249 0 -1 4202496 10328 934 1 0 51 13 0 0 17 0 2 0 906910038 296271872 7204 33554432000 4194304 5683644 140734417663408 18446744073709551615 228134540747 0 0 16781312 2 18446744073709551615 0 0 17 7 0 0 0
/proc/18295/statm: 72332 7204 1876 364 0 8250 0

################
# More data... #
################

/proc/18342/stat : 18342 (cryptominisat-2) T 18340 18342 18342 0 -1 4202496 105041 0 0 0 58775 18 0 0 25 0 1 0 906980331 102146048 17841 33554432000 4194304 4677096 140736643870304 18446744073709551615 4319581 0 0 16781312 2 18446744071562691360 0 0 17 1 0 0 0
/proc/18342/statm: 24938 17841 392 118 0 19897 0
[pid=18340/tid=18363] ppid=18295 vsize=299596 CPUtime=0 cores=1,3,5,7
/proc/18340/task/18363/stat : 18363 (python) S 18295 18295 18249 0 -1 4202560 44 0 0 0 0 0 0 0 15 0 2 0 907029411 306786304 5761 33554432000 4194304 5683644 140734417663408 18446744073709551615 228134537649 0 0 16781312 514 18446604471106920512 0 0 -1 5 0 0 0
[pid=18364] ppid=18295 vsize=310024 CPUtime=1.06 cores=1,3,5,7
/proc/18364/stat : 18364 (python) S 18295 18295 18249 0 -1 4202560 1172 0 0 0 58 48 0 0 18 0 2 0 907029413 317464576 5780 33554432000 4194304 5683644 140734417663408 18446744073709551615 228134540747 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/18364/statm: 77506 5780 400 364 0 13415 0
[pid=18366] ppid=18364 vsize=42132 CPUtime=777.94 cores=1,3,5,7
/proc/18366/stat : 18366 (precosat) T 18364 18366 18366 0 -1 4202496 15592 0 0 0 77791 3 0 0 25 0 1 0 907029414 43143168 10410 33554432000 4194304 4890832 140736558374912 18446744073709551615 4238592 0 0 16781312 17442 18446744071562691360 0 0 17 1 0 0 0
/proc/18366/statm: 10533 10410 86 171 0 10360 0
[pid=18364/tid=18378] ppid=18295 vsize=310024 CPUtime=0 cores=1,3,5,7
/proc/18364/task/18378/stat : 18378 (python) S 18295 18295 18249 0 -1 4202560 47 0 0 0 0 0 0 0 18 0 2 0 907068760 317464576 5780 33554432000 4194304 5683644 140734417663408 18446744073709551615 228134537649 0 0 16781312 514 18446604471098583040 0 0 -1 3 0 0 0
[pid=18406] ppid=18295 vsize=320280 CPUtime=1.16 cores=1,3,5,7
/proc/18406/stat : 18406 (python) S 18295 18295 18249 0 -1 4202560 1168 0 0 0 62 54 0 0 18 0 2 0 907136741 327966720 5804 33554432000 4194304 5683644 140734417663408 18446744073709551615 228134540747 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/18406/statm: 80070 5804 400 364 0 15976 0
[pid=18408] ppid=18406 vsize=37280 CPUtime=874.02 cores=1,3,5,7
/proc/18408/stat : 18408 (lingeling) T 18406 18408 18408 0 -1 4202496 84940 0 0 0 87393 9 0 0 25 0 1 0 907136741 38174720 8522 33554432000 4194304 4352236 140733712910992 18446744073709551615 4329000 0 0 16781312 17506 18446744071562691360 0 0 17 3 0 0 0
/proc/18408/statm: 9320 8522 129 39 0 8400 0
[pid=18406/tid=18440] ppid=18295 vsize=320280 CPUtime=0 cores=1,3,5,7
/proc/18406/task/18440/stat : 18440 (python) S 18295 18295 18249 0 -1 4202560 46 0 0 0 0 0 0 0 18 0 2 0 907195409 327966720 5804 33554432000 4194304 5683644 140734417663408 18446744073709551615 228134537649 0 0 16781312 514 18446604471137942272 0 0 -1 3 0 0 0
[pid=18449] ppid=18295 vsize=330672 CPUtime=0.77 cores=1,3,5,7
/proc/18449/stat : 18449 (python) S 18295 18295 18249 0 -1 4202560 1170 0 0 0 39 38 0 0 19 0 2 0 907224145 338608128 5822 33554432000 4194304 5683644 140734417663408 18446744073709551615 228134540747 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/18449/statm: 82668 5822 400 364 0 18571 0
[pid=18451] ppid=18449 vsize=34456 CPUtime=586.68 cores=1,3,5,7
/proc/18451/stat : 18451 (lingeling) T 18449 18451 18451 0 -1 4202496 65871 0 0 0 58660 8 0 0 25 0 1 0 907224145 35282944 7810 33554432000 4194304 4352236 140735574124528 18446744073709551615 4328090 0 0 16781312 17506 18446744071562691360 0 0 17 5 0 0 0
/proc/18451/statm: 8614 7810 129 39 0 7694 0
[pid=18449/tid=18468] ppid=18295 vsize=330672 CPUtime=0 cores=1,3,5,7
/proc/18449/task/18468/stat : 18468 (python) S 18295 18295 18249 0 -1 4202560 45 0 0 0 0 0 0 0 19 0 2 0 907282813 338608128 5822 33554432000 4194304 5683644 140734417663408 18446744073709551615 228134537649 0 0 16781312 514 18446604469059719424 0 0 -1 5 0 0 0
[pid=18471] ppid=18295 vsize=340928 CPUtime=0.84 cores=1,3,5,7
/proc/18471/stat : 18471 (python) S 18295 18295 18249 0 -1 4202560 1182 0 0 0 46 38 0 0 15 0 2 0 907292527 349110272 5827 33554432000 4194304 5683644 140734417663408 18446744073709551615 228122734150 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/18471/statm: 85232 5827 401 364 0 21132 0
[pid=18473] ppid=18471 vsize=122504 CPUtime=604.47 cores=1,3,5,7
/proc/18473/stat : 18473 (cryptominisat-2) R 18471 18473 18473 0 -1 4202496 108817 0 0 0 60430 17 0 0 25 0 1 0 907292528 125444096 22992 33554432000 4194304 4677096 140735610450304 18446744073709551615 4320152 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/18473/statm: 30626 22992 392 118 0 25585 0
[pid=18471/tid=18482] ppid=18295 vsize=340928 CPUtime=0 cores=1,3,5,7
/proc/18471/task/18482/stat : 18482 (python) S 18295 18295 18249 0 -1 4202560 48 0 0 0 0 0 0 0 15 0 2 0 907321783 349110272 5827 33554432000 4194304 5683644 140734417663408 18446744073709551615 228134537649 0 0 16781312 514 18446604469059721216 0 0 -1 1 0 0 0
[pid=18498] ppid=18295 vsize=351248 CPUtime=0.27 cores=1,3,5,7
/proc/18498/stat : 18498 (python) S 18295 18295 18249 0 -1 4202560 1190 0 0 0 14 13 0 0 16 0 2 0 907379636 359677952 5867 33554432000 4194304 5683644 140734417663408 18446744073709551615 228134540747 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/18498/statm: 87812 5867 406 364 0 23709 0
[pid=18500] ppid=18498 vsize=25664 CPUtime=196.24 cores=1,3,5,7
/proc/18500/stat : 18500 (precosat) T 18498 18500 18500 0 -1 4202496 6758 0 0 0 19623 1 0 0 25 0 1 0 907379636 26279936 6227 33554432000 4194304 4890832 140733726708208 18446744073709551615 4238544 0 0 16781312 17442 18446744071562691360 0 0 17 3 0 0 0
/proc/18500/statm: 6416 6227 86 171 0 6243 0
[pid=18498/tid=18507] ppid=18295 vsize=351248 CPUtime=0 cores=1,3,5,7
/proc/18498/task/18507/stat : 18507 (python) S 18295 18295 18249 0 -1 4202560 48 0 0 0 0 0 0 0 16 0 2 0 907399261 359677952 5867 33554432000 4194304 5683644 140734417663408 18446744073709551615 228134537649 0 0 16781312 514 18446604458093023424 0 0 -1 1 0 0 0
[pid=18295/tid=18307] ppid=18290 vsize=361492 CPUtime=0 cores=1,3,5,7
/proc/18295/task/18307/stat : 18307 (python) S 18290 18295 18249 0 -1 4202560 33 934 0 0 0 0 0 0 15 0 9 0 906911755 370167808 7354 33554432000 4194304 5683644 140734417663408 18446744073709551615 228134537649 0 0 16781312 2 18446604458093025216 0 0 -1 7 0 0 0
[pid=18295/tid=18333] ppid=18290 vsize=361492 CPUtime=0 cores=1,3,5,7
/proc/18295/task/18333/stat : 18333 (python) S 18290 18295 18249 0 -1 4202560 25 934 0 0 0 0 0 0 19 0 9 0 906970318 370167808 7354 33554432000 4194304 5683644 140734417663408 18446744073709551615 228134537649 0 0 16781312 2 18446604458093025216 0 0 -1 7 0 0 0
[pid=18295/tid=18341] ppid=18290 vsize=361492 CPUtime=0 cores=1,3,5,7
/proc/18295/task/18341/stat : 18341 (python) S 18290 18295 18249 0 -1 4202560 34 934 0 0 0 0 0 0 18 0 9 0 906980331 370167808 7354 33554432000 4194304 5683644 140734417663408 18446744073709551615 228134537649 0 0 16781312 2 18446604458093025216 0 0 -1 7 0 0 0
[pid=18295/tid=18365] ppid=18290 vsize=361492 CPUtime=0 cores=1,3,5,7
/proc/18295/task/18365/stat : 18365 (python) S 18290 18295 18249 0 -1 4202560 33 934 0 0 0 0 0 0 18 0 9 0 907029414 370167808 7354 33554432000 4194304 5683644 140734417663408 18446744073709551615 228134537649 0 0 16781312 2 18446604458093025216 0 0 -1 7 0 0 0
[pid=18295/tid=18407] ppid=18290 vsize=361492 CPUtime=0 cores=1,3,5,7
/proc/18295/task/18407/stat : 18407 (python) S 18290 18295 18249 0 -1 4202560 29 934 0 0 0 0 0 0 18 0 9 0 907136741 370167808 7354 33554432000 4194304 5683644 140734417663408 18446744073709551615 228134537649 0 0 16781312 2 18446604458093025216 0 0 -1 1 0 0 0
[pid=18295/tid=18450] ppid=18290 vsize=361492 CPUtime=0 cores=1,3,5,7
/proc/18295/task/18450/stat : 18450 (python) S 18290 18295 18249 0 -1 4202560 32 934 0 0 0 0 0 0 20 0 9 0 907224145 370167808 7354 33554432000 4194304 5683644 140734417663408 18446744073709551615 228134537649 0 0 16781312 2 18446604458093025216 0 0 -1 3 0 0 0
[pid=18295/tid=18472] ppid=18290 vsize=361492 CPUtime=0 cores=1,3,5,7
/proc/18295/task/18472/stat : 18472 (python) S 18290 18295 18249 0 -1 4202560 34 934 0 0 0 0 0 0 18 0 9 0 907292527 370167808 7354 33554432000 4194304 5683644 140734417663408 18446744073709551615 228134537649 0 0 16781312 2 18446604458093025216 0 0 -1 3 0 0 0
[pid=18295/tid=18499] ppid=18290 vsize=361492 CPUtime=0 cores=1,3,5,7
/proc/18295/task/18499/stat : 18499 (python) S 18290 18295 18249 0 -1 4202560 28 934 0 0 0 0 0 0 20 0 9 0 907379636 370167808 7354 33554432000 4194304 5683644 140734417663408 18446744073709551615 228134537649 0 0 16781312 2 18446604458093025216 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 5000.11
Current children cumulated vsize (KiB) 3298636

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5010.1 s]
/proc/loadavg: 2.03 2.03 1.97 6/238 18510
/proc/meminfo: memFree=2946160/32951124 swapFree=67051728/67111528
[pid=18295] ppid=18290 vsize=361492 CPUtime=0.83 cores=1,3,5,7
/proc/18295/stat : 18295 (python) S 18290 18295 18249 0 -1 4202496 16380 934 1 0 68 15 0 0 18 0 9 0 906910038 370167808 7354 33554432000 4194304 5683644 140734417663408 18446744073709551615 228134540747 0 0 16781312 2 18446744073709551615 0 0 17 1 0 0 0
/proc/18295/statm: 90373 7354 1890 364 0 26270 0
[pid=18306] ppid=18295 vsize=289168 CPUtime=1.57 cores=1,3,5,7
/proc/18306/stat : 18306 (python) S 18295 18295 18249 0 -1 4202560 1211 0 0 0 80 77 0 0 16 0 2 0 906911755 296108032 5733 33554432000 4194304 5683644 140734417663408 18446744073709551615 228134540747 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/18306/statm: 72292 5733 416 364 0 8210 0
[pid=18308] ppid=18306 vsize=37872 CPUtime=1265.38 cores=1,3,5,7
/proc/18308/stat : 18308 (lingeling) T 18306 18308 18308 0 -1 4202496 111677 0 0 0 126525 13 0 0 25 0 1 0 906911755 38780928 8670 33554432000 4194304 4352236 140736525039904 18446744073709551615 4329086 0 0 16781312 17506 18446744071562691360 0 0 17 1 0 0 0
/proc/18308/statm: 9468 8670 129 39 0 8548 0
[pid=18306/tid=18314] ppid=18295 vsize=289168 CPUtime=0 cores=1,3,5,7
/proc/18306/task/18314/stat : 18314 (python) S 18295 18295 18249 0 -1 4202560 47 0 0 0 0 0 0 0 15 0 2 0 906921765 296108032 5733 33554432000 4194304 5683644 140734417663408 18446744073709551615 228134537649 0 0 16781312 514 18446604458093026112 0 0 -1 7 0 0 0
[pid=18332] ppid=18295 vsize=289340 CPUtime=0.11 cores=1,3,5,7
/proc/18332/stat : 18332 (python) S 18295 18295 18249 0 -1 4202560 1085 0 0 0 7 4 0 0 19 0 2 0 906970317 296284160 5729 33554432000 4194304 5683644 140734417663408 18446744073709551615 228134540747 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/18332/statm: 72335 5729 400 364 0 8250 0
[pid=18334] ppid=18332 vsize=6228 CPUtime=100.1 cores=1,3,5,7
/proc/18334/stat : 18334 (SApperloT-base) T 18332 18334 18334 0 -1 4202496 1576 0 0 0 10010 0 0 0 25 0 1 0 906970318 6377472 1311 33554432000 134512640 135674940 4293108048 18446744073709551615 134581580 0 0 16781312 0 18446744071562691360 0 0 17 5 0 0 0
/proc/18334/statm: 1557 1311 100 284 0 1271 0
[pid=18332/tid=18339] ppid=18295 vsize=289340 CPUtime=0 cores=1,3,5,7
/proc/18332/task/18339/stat : 18339 (python) S 18295 18295 18249 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 906980328 296284160 5729 33554432000 4194304 5683644 140734417663408 18446744073709551615 228134537649 0 0 16781312 514 18446604471161512064 0 0 -1 1 0 0 0
[pid=18340] ppid=18295 vsize=299596 CPUtime=0.74 cores=1,3,5,7
/proc/18340/stat : 18340 (python) S 18295 18295 18249 0 -1 4202560 1180 0 0 0 40 34 0 0 15 0 2 0 906980330 306786304 5761 33554432000 4194304 5683644 140734417663408 18446744073709551615 228134540747 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/18340/statm: 74899 5761 400 364 0 10811 0
[pid=18342] ppid=18340 vsize=99752 CPUtime=587.93 cores=1,3,5,7
/proc/18342/stat : 18342 (cryptominisat-2) T 18340 18342 18342 0 -1 4202496 105041 0 0 0 58775 18 0 0 25 0 1 0 906980331 102146048 17841 33554432000 4194304 4677096 140736643870304 18446744073709551615 4319581 0 0 16781312 2 18446744071562691360 0 0 17 1 0 0 0
/proc/18342/statm: 24938 17841 392 118 0 19897 0
[pid=18340/tid=18363] ppid=18295 vsize=299596 CPUtime=0 cores=1,3,5,7
/proc/18340/task/18363/stat : 18363 (python) S 18295 18295 18249 0 -1 4202560 44 0 0 0 0 0 0 0 15 0 2 0 907029411 306786304 5761 33554432000 4194304 5683644 140734417663408 18446744073709551615 228134537649 0 0 16781312 514 18446604471106920512 0 0 -1 5 0 0 0
[pid=18364] ppid=18295 vsize=310024 CPUtime=1.06 cores=1,3,5,7
/proc/18364/stat : 18364 (python) S 18295 18295 18249 0 -1 4202560 1172 0 0 0 58 48 0 0 18 0 2 0 907029413 317464576 5780 33554432000 4194304 5683644 140734417663408 18446744073709551615 228134540747 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/18364/statm: 77506 5780 400 364 0 13415 0
[pid=18366] ppid=18364 vsize=42132 CPUtime=777.94 cores=1,3,5,7
/proc/18366/stat : 18366 (precosat) T 18364 18366 18366 0 -1 4202496 15592 0 0 0 77791 3 0 0 25 0 1 0 907029414 43143168 10410 33554432000 4194304 4890832 140736558374912 18446744073709551615 4238592 0 0 16781312 17442 18446744071562691360 0 0 17 1 0 0 0
/proc/18366/statm: 10533 10410 86 171 0 10360 0
[pid=18364/tid=18378] ppid=18295 vsize=310024 CPUtime=0 cores=1,3,5,7
/proc/18364/task/18378/stat : 18378 (python) S 18295 18295 18249 0 -1 4202560 47 0 0 0 0 0 0 0 18 0 2 0 907068760 317464576 5780 33554432000 4194304 5683644 140734417663408 18446744073709551615 228134537649 0 0 16781312 514 18446604471098583040 0 0 -1 3 0 0 0
[pid=18406] ppid=18295 vsize=320280 CPUtime=1.16 cores=1,3,5,7
/proc/18406/stat : 18406 (python) S 18295 18295 18249 0 -1 4202560 1168 0 0 0 62 54 0 0 18 0 2 0 907136741 327966720 5804 33554432000 4194304 5683644 140734417663408 18446744073709551615 228134540747 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/18406/statm: 80070 5804 400 364 0 15976 0
[pid=18408] ppid=18406 vsize=37280 CPUtime=874.02 cores=1,3,5,7
/proc/18408/stat : 18408 (lingeling) T 18406 18408 18408 0 -1 4202496 84940 0 0 0 87393 9 0 0 25 0 1 0 907136741 38174720 8522 33554432000 4194304 4352236 140733712910992 18446744073709551615 4329000 0 0 16781312 17506 18446744071562691360 0 0 17 3 0 0 0
/proc/18408/statm: 9320 8522 129 39 0 8400 0
[pid=18406/tid=18440] ppid=18295 vsize=320280 CPUtime=0 cores=1,3,5,7
/proc/18406/task/18440/stat : 18440 (python) S 18295 18295 18249 0 -1 4202560 46 0 0 0 0 0 0 0 18 0 2 0 907195409 327966720 5804 33554432000 4194304 5683644 140734417663408 18446744073709551615 228134537649 0 0 16781312 514 18446604471137942272 0 0 -1 3 0 0 0
[pid=18449] ppid=18295 vsize=330672 CPUtime=0.77 cores=1,3,5,7
/proc/18449/stat : 18449 (python) S 18295 18295 18249 0 -1 4202560 1170 0 0 0 39 38 0 0 19 0 2 0 907224145 338608128 5822 33554432000 4194304 5683644 140734417663408 18446744073709551615 228134540747 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/18449/statm: 82668 5822 400 364 0 18571 0
[pid=18451] ppid=18449 vsize=34456 CPUtime=586.68 cores=1,3,5,7
/proc/18451/stat : 18451 (lingeling) T 18449 18451 18451 0 -1 4202496 65871 0 0 0 58660 8 0 0 25 0 1 0 907224145 35282944 7810 33554432000 4194304 4352236 140735574124528 18446744073709551615 4328090 0 0 16781312 17506 18446744071562691360 0 0 17 5 0 0 0
/proc/18451/statm: 8614 7810 129 39 0 7694 0
[pid=18449/tid=18468] ppid=18295 vsize=330672 CPUtime=0 cores=1,3,5,7
/proc/18449/task/18468/stat : 18468 (python) S 18295 18295 18249 0 -1 4202560 45 0 0 0 0 0 0 0 19 0 2 0 907282813 338608128 5822 33554432000 4194304 5683644 140734417663408 18446744073709551615 228134537649 0 0 16781312 514 18446604469059719424 0 0 -1 5 0 0 0
[pid=18471] ppid=18295 vsize=340928 CPUtime=0.84 cores=1,3,5,7
/proc/18471/stat : 18471 (python) S 18295 18295 18249 0 -1 4202560 1182 0 0 0 46 38 0 0 15 0 2 0 907292527 349110272 5827 33554432000 4194304 5683644 140734417663408 18446744073709551615 228122734150 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/18471/statm: 85232 5827 401 364 0 21132 0
[pid=18473] ppid=18471 vsize=122504 CPUtime=604.47 cores=1,3,5,7
/proc/18473/stat : 18473 (cryptominisat-2) R 18471 18473 18473 0 -1 4202496 108817 0 0 0 60430 17 0 0 25 0 1 0 907292528 125444096 22992 33554432000 4194304 4677096 140735610450304 18446744073709551615 4320152 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/18473/statm: 30626 22992 392 118 0 25585 0
[pid=18471/tid=18482] ppid=18295 vsize=340928 CPUtime=0 cores=1,3,5,7
/proc/18471/task/18482/stat : 18482 (python) S 18295 18295 18249 0 -1 4202560 48 0 0 0 0 0 0 0 15 0 2 0 907321783 349110272 5827 33554432000 4194304 5683644 140734417663408 18446744073709551615 228134537649 0 0 16781312 514 18446604469059721216 0 0 -1 1 0 0 0
[pid=18498] ppid=18295 vsize=351248 CPUtime=0.27 cores=1,3,5,7
/proc/18498/stat : 18498 (python) S 18295 18295 18249 0 -1 4202560 1190 0 0 0 14 13 0 0 16 0 2 0 907379636 359677952 5867 33554432000 4194304 5683644 140734417663408 18446744073709551615 228134540747 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/18498/statm: 87812 5867 406 364 0 23709 0
[pid=18500] ppid=18498 vsize=25664 CPUtime=196.24 cores=1,3,5,7
/proc/18500/stat : 18500 (precosat) T 18498 18500 18500 0 -1 4202496 6758 0 0 0 19623 1 0 0 25 0 1 0 907379636 26279936 6227 33554432000 4194304 4890832 140733726708208 18446744073709551615 4238544 0 0 16781312 17442 18446744071562691360 0 0 17 3 0 0 0
/proc/18500/statm: 6416 6227 86 171 0 6243 0
[pid=18498/tid=18507] ppid=18295 vsize=351248 CPUtime=0 cores=1,3,5,7
/proc/18498/task/18507/stat : 18507 (python) S 18295 18295 18249 0 -1 4202560 48 0 0 0 0 0 0 0 16 0 2 0 907399261 359677952 5867 33554432000 4194304 5683644 140734417663408 18446744073709551615 228134537649 0 0 16781312 514 18446604458093023424 0 0 -1 1 0 0 0
[pid=18295/tid=18307] ppid=18290 vsize=361492 CPUtime=0 cores=1,3,5,7
/proc/18295/task/18307/stat : 18307 (python) S 18290 18295 18249 0 -1 4202560 33 934 0 0 0 0 0 0 15 0 9 0 906911755 370167808 7354 33554432000 4194304 5683644 140734417663408 18446744073709551615 228134537649 0 0 16781312 2 18446604458093025216 0 0 -1 7 0 0 0
[pid=18295/tid=18333] ppid=18290 vsize=361492 CPUtime=0 cores=1,3,5,7
/proc/18295/task/18333/stat : 18333 (python) S 18290 18295 18249 0 -1 4202560 25 934 0 0 0 0 0 0 19 0 9 0 906970318 370167808 7354 33554432000 4194304 5683644 140734417663408 18446744073709551615 228134537649 0 0 16781312 2 18446604458093025216 0 0 -1 7 0 0 0
[pid=18295/tid=18341] ppid=18290 vsize=361492 CPUtime=0 cores=1,3,5,7
/proc/18295/task/18341/stat : 18341 (python) S 18290 18295 18249 0 -1 4202560 34 934 0 0 0 0 0 0 18 0 9 0 906980331 370167808 7354 33554432000 4194304 5683644 140734417663408 18446744073709551615 228134537649 0 0 16781312 2 18446604458093025216 0 0 -1 7 0 0 0
[pid=18295/tid=18365] ppid=18290 vsize=361492 CPUtime=0 cores=1,3,5,7
/proc/18295/task/18365/stat : 18365 (python) S 18290 18295 18249 0 -1 4202560 33 934 0 0 0 0 0 0 18 0 9 0 907029414 370167808 7354 33554432000 4194304 5683644 140734417663408 18446744073709551615 228134537649 0 0 16781312 2 18446604458093025216 0 0 -1 7 0 0 0
[pid=18295/tid=18407] ppid=18290 vsize=361492 CPUtime=0 cores=1,3,5,7
/proc/18295/task/18407/stat : 18407 (python) S 18290 18295 18249 0 -1 4202560 29 934 0 0 0 0 0 0 18 0 9 0 907136741 370167808 7354 33554432000 4194304 5683644 140734417663408 18446744073709551615 228134537649 0 0 16781312 2 18446604458093025216 0 0 -1 1 0 0 0
[pid=18295/tid=18450] ppid=18290 vsize=361492 CPUtime=0 cores=1,3,5,7
/proc/18295/task/18450/stat : 18450 (python) S 18290 18295 18249 0 -1 4202560 32 934 0 0 0 0 0 0 20 0 9 0 907224145 370167808 7354 33554432000 4194304 5683644 140734417663408 18446744073709551615 228134537649 0 0 16781312 2 18446604458093025216 0 0 -1 3 0 0 0
[pid=18295/tid=18472] ppid=18290 vsize=361492 CPUtime=0 cores=1,3,5,7
/proc/18295/task/18472/stat : 18472 (python) S 18290 18295 18249 0 -1 4202560 34 934 0 0 0 0 0 0 18 0 9 0 907292527 370167808 7354 33554432000 4194304 5683644 140734417663408 18446744073709551615 228134537649 0 0 16781312 2 18446604458093025216 0 0 -1 3 0 0 0
[pid=18295/tid=18499] ppid=18290 vsize=361492 CPUtime=0 cores=1,3,5,7
/proc/18295/task/18499/stat : 18499 (python) S 18290 18295 18249 0 -1 4202560 28 934 0 0 0 0 0 0 20 0 9 0 907379636 370167808 7354 33554432000 4194304 5683644 140734417663408 18446744073709551615 228134537649 0 0 16781312 2 18446604458093025216 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 5000.11
Current children cumulated vsize (KiB) 3298636

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 18295 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=684895
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=153976
# CPU time returned by wait4() is 0.838871
# while last known CPU time is 5000.11
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 5010.16
CPU time (s): 5000.11
CPU user time (s): 4996.21
CPU system time (s): 3.9
CPU usage (%): 99.7995
Max. virtual memory (cumulated for all children) (KiB): 3329100

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.684895
system time used= 0.153976
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 17319
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 6162
involuntary context switches= 39

runsolver used 10.8803 second user time and 23.9064 second system time

The end

Launcher Data 

Begin job on node138 at 2011-06-13 10:18:35
IDJOB=3498263
IDBENCH=20472
IDSOLVER=1991
FILE ID=node138/3498263-1307953114
RUNJOBID= node138-1307953114-18268
PBS_JOBID= 13559690
Free space on /var/tmp= 2892 MiB

SOLVER NAME= borg-sat 11.03.02-seq-industrial (fixed)
BENCH NAME= SAT07/industrial/jarvisalo/eq.atree.braun.11.unsat.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.industrial.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /var/tmp/evaluation-result-3498263-1307953114/watcher-3498263-1307953114 -o /var/tmp/evaluation-result-3498263-1307953114/solver-3498263-1307953114 -C 5000 -W 5100 -M 15500  python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3498263-1307953114.cnf -seed 462826349 -budget 5000

TIME LIMIT= 5000 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 90581094793af5fc10d4e4b9a10259ac
RANDOM SEED=462826349

node138.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:       4881520 kB
Buffers:        109092 kB
Cached:       27059464 kB
SwapCached:      13136 kB
Active:       12142968 kB
Inactive:     15043000 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:       4881520 kB
SwapTotal:    67111528 kB
SwapFree:     67051728 kB
Dirty:           68272 kB
Writeback:           0 kB
AnonPages:       15512 kB
Mapped:           8684 kB
Slab:           818632 kB
PageTables:       4672 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   188024 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /var/tmp at the end= 2828 MiB
End job on node138 at 2011-06-13 11:42:13