Trace number 3377197

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-seq-random (fixed)? (MO) 703.51 712.774

General information on the benchmark

Namerandom/large/
unif-k7-r85-v150-c12750-S93401285-051-UNKNOWN.cnf
MD5SUMdc0028248c86c8aff67bef1f8d7ffb16
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark5.2752
Satisfiable
(Un)Satisfiability was proved
Number of variables150
Number of clauses12750
Sum of the clauses size89250
Maximum clause length7
Minimum clause length7
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 512750

Solver Data 

0.62/9.81	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.62/9.81	c INFO: solving HOME/instance-3377197-1305451278.cnf
0.62/9.81	c INFO: computing task features
0.62/9.89	c INFO: computed variable-clause graph statistics
0.62/9.89	c INFO: computed clause balance statistics
1.11/10.32	c INFO: computed variable balance statistics
1.21/10.49	c INFO: computed small-clause counts
1.21/10.49	c INFO: computed Horn-clause counts
1.31/10.51	c INFO: computed variable graph statistics
1.31/10.51	c INFO: collected features for HOME/instance-3377197-1305451278.cnf in 0.70 s
1.33/10.64	c INFO: running gnovelty+2@0 for 97 with 2399 remaining (b = 0.37)
101.47/110.89	c INFO: running gnovelty+2@0 for 97 with 2299 remaining (b = 0.12)
201.74/211.14	c INFO: running adaptg2wsat2009++@0 for 97 with 2199 remaining (b = 0.08)
302.15/311.38	c INFO: running adaptg2wsat2009++@0 for 97 with 2099 remaining (b = 0.06)
402.45/411.62	c INFO: running adaptg2wsat2009++@0 for 97 with 1999 remaining (b = 0.05)
502.64/511.86	c INFO: running gnovelty+2@0 for 97 with 1899 remaining (b = 0.04)
602.91/612.13	c INFO: running FH@0 for 97 with 1799 remaining (b = 0.03)
703.10/712.38	c INFO: running adaptg2wsat2009++@0 for 97 with 1699 remaining (b = 0.03)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3377197-1305451278/watcher-3377197-1305451278 -o /tmp/evaluation-result-3377197-1305451278/solver-3377197-1305451278 -C 2400 -W 1300 -M 7680 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3377197-1305451278.cnf -seed 961747126 -budget 2400 

running on 2 cores: 4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 7864320 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 7915520 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.22 2.84 3.22 3/302 32367
/proc/meminfo: memFree=27300016/32951124 swapFree=63649232/67111528
[pid=32367] ppid=32365 vsize=15780 CPUtime=0 cores=4,6
/proc/32367/stat : 32367 (python) R 32365 32367 31275 0 -1 4202496 926 0 0 0 0 0 0 0 17 0 1 0 656726423 16158720 807 33554432000 4194304 5683644 140737089349248 18446744073709551615 210204647056 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/32367/statm: 3945 807 356 364 0 432 0

[startup+0.0526361 s]
/proc/loadavg: 1.22 2.84 3.22 3/302 32367
/proc/meminfo: memFree=27300016/32951124 swapFree=63649232/67111528
[pid=32367] ppid=32365 vsize=18892 CPUtime=0.01 cores=4,6
/proc/32367/stat : 32367 (python) D 32365 32367 31275 0 -1 4202496 1233 0 1 0 1 0 0 0 17 0 1 0 656726423 19345408 1092 33554432000 4194304 5683644 140737089349248 18446744073709551615 210204647168 0 0 16781312 2 18446744071562234166 0 0 17 4 0 0 0
/proc/32367/statm: 4723 1092 421 364 0 692 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 18892

[startup+0.100638 s]
/proc/loadavg: 1.22 2.84 3.22 3/302 32367
/proc/meminfo: memFree=27300016/32951124 swapFree=63649232/67111528
[pid=32367] ppid=32365 vsize=18888 CPUtime=0.03 cores=4,6
/proc/32367/stat : 32367 (python) R 32365 32367 31275 0 -1 4202496 1286 0 1 0 3 0 0 0 17 0 1 0 656726423 19341312 1141 33554432000 4194304 5683644 140737089349248 18446744073709551615 210204645376 0 0 16781312 2 0 0 0 17 4 0 0 4
/proc/32367/statm: 4722 1141 421 364 0 691 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 18888

[startup+0.30059 s]
/proc/loadavg: 1.22 2.84 3.22 3/302 32367
/proc/meminfo: memFree=27300016/32951124 swapFree=63649232/67111528
[pid=32367] ppid=32365 vsize=29796 CPUtime=0.04 cores=4,6
/proc/32367/stat : 32367 (python) D 32365 32367 31275 0 -1 4202496 1410 0 5 0 3 1 0 0 17 0 1 0 656726423 30511104 1260 33554432000 4194304 5683644 140737089349248 18446744073709551615 210204647168 0 0 16781312 2 18446744071562234166 0 0 17 4 0 0 18
/proc/32367/statm: 7449 1260 443 364 0 819 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 29796

[startup+0.700534 s]
/proc/loadavg: 1.22 2.84 3.22 3/302 32367
/proc/meminfo: memFree=27300016/32951124 swapFree=63649232/67111528
[pid=32367] ppid=32365 vsize=47940 CPUtime=0.06 cores=4,6
/proc/32367/stat : 32367 (python) R 32365 32367 31275 0 -1 4202496 1926 0 11 0 5 1 0 0 17 0 1 0 656726423 49090560 1711 33554432000 4194304 5683644 140737089349248 18446744073709551615 210199723655 0 0 16781312 2 0 0 0 17 4 0 0 45
/proc/32367/statm: 12517 1714 481 364 0 1204 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 47940

[startup+1.50039 s]
/proc/loadavg: 1.60 2.90 3.24 1/308 32373
/proc/meminfo: memFree=27275984/32951124 swapFree=63649232/67111528
[pid=32367] ppid=32365 vsize=101748 CPUtime=0.1 cores=4,6
/proc/32367/stat : 32367 (python) D 32365 32367 31275 0 -1 4202496 2905 0 24 0 7 3 0 0 16 0 1 0 656726423 104189952 2626 33554432000 4194304 5683644 140737089349248 18446744073709551615 210204647168 0 0 16781312 2 18446744071562234166 0 0 17 4 0 0 98
/proc/32367/statm: 25437 2626 837 364 0 1737 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 101748

[startup+3.10118 s]
/proc/loadavg: 1.60 2.90 3.24 1/308 32373
/proc/meminfo: memFree=27256768/32951124 swapFree=63649232/67111528
[pid=32367] ppid=32365 vsize=135752 CPUtime=0.26 cores=4,6
/proc/32367/stat : 32367 (python) D 32365 32367 31275 0 -1 4202496 5942 927 30 8 18 8 0 0 17 0 1 0 656726423 139010048 4149 33554432000 4194304 5683644 140737089349248 18446744073709551615 210204643333 0 0 16781312 2 0 0 0 17 4 0 0 194
/proc/32367/statm: 33938 4149 1032 364 0 3124 0
Current children cumulated CPU time (s) 0.26
Current children cumulated vsize (KiB) 135752
heavy processes:

[startup+6.30063 s]
/proc/loadavg: 1.60 2.90 3.24 1/308 32389
/proc/meminfo: memFree=27226724/32951124 swapFree=63649232/67111528
[pid=32367] ppid=32365 vsize=201392 CPUtime=0.46 cores=4,6
/proc/32367/stat : 32367 (python) D 32365 32367 31275 0 -1 4202496 7066 927 66 8 26 20 0 0 16 0 1 0 656726423 206225408 5152 33554432000 4194304 5683644 140737089349248 18446744073709551615 210204647168 0 0 16781312 2 18446744071562234166 0 0 17 4 0 0 389
/proc/32367/statm: 50348 5152 1490 364 0 3857 0
Current children cumulated CPU time (s) 0.46
Current children cumulated vsize (KiB) 201392
heavy processes:

[startup+12.7005 s]
/proc/loadavg: 1.97 2.93 3.25 5/320 32401
/proc/meminfo: memFree=27114376/32951124 swapFree=63649232/67111528
[pid=32367] ppid=32365 vsize=289260 CPUtime=1.34 cores=4,6
/proc/32367/stat : 32367 (python) S 32365 32367 31275 0 -1 4202496 10993 927 102 8 108 26 0 0 17 0 2 0 656726423 296202240 7196 33554432000 4194304 5683644 140737089349248 18446744073709551615 210216474059 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 663
/proc/32367/statm: 72315 7196 1869 364 0 8233 0
[pid=32390] ppid=32367 vsize=279016 CPUtime=0 cores=4,6
/proc/32390/stat : 32390 (python) S 32367 32367 31275 0 -1 4202560 728 0 0 0 0 0 0 0 15 0 1 0 656727487 285712384 5677 33554432000 4194304 5683644 140737089349248 18446744073709551615 210204667407 0 0 16781312 514 7400408150576169217 0 0 17 4 0 0 0
/proc/32390/statm: 69754 5677 354 364 0 5672 0
[pid=32392] ppid=32390 vsize=1018364 CPUtime=2.03 cores=4,6
/proc/32392/stat : 32392 (gnovelty+2) R 32390 32392 32392 0 -1 4202496 673 0 0 0 203 0 0 0 23 0 1 0 656727488 1042804736 408 33554432000 134512640 135663704 4288422176 18446744073709551615 134524874 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/32392/statm: 254591 408 113 282 0 254307 0
[pid=32367/tid=32391] ppid=32365 vsize=289260 CPUtime=0 cores=4,6
/proc/32367/task/32391/stat : 32391 (python) S 32365 32367 31275 0 -1 4202560 25 927 0 8 0 0 0 0 18 0 2 0 656727487 296202240 7196 33554432000 4194304 5683644 140737089349248 18446744073709551615 210216470961 0 0 16781312 2 18446604449712624000 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3.37
Current children cumulated vsize (KiB) 1586640
heavy processes:

[startup+25.5004 s]
/proc/loadavg: 2.28 2.97 3.26 5/320 32402
/proc/meminfo: memFree=27113192/32951124 swapFree=63649232/67111528
[pid=32367] ppid=32365 vsize=289260 CPUtime=1.34 cores=4,6
/proc/32367/stat : 32367 (python) S 32365 32367 31275 0 -1 4202496 10993 927 102 8 108 26 0 0 17 0 2 0 656726423 296202240 7196 33554432000 4194304 5683644 140737089349248 18446744073709551615 210216474059 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 663
/proc/32367/statm: 72315 7196 1869 364 0 8233 0
[pid=32390] ppid=32367 vsize=279016 CPUtime=0.02 cores=4,6
/proc/32390/stat : 32390 (python) S 32367 32367 31275 0 -1 4202560 967 0 0 0 1 1 0 0 15 0 1 0 656727487 285712384 5705 33554432000 4194304 5683644 140737089349248 18446744073709551615 210204667407 0 0 16781312 514 17096702124474990849 0 0 17 4 0 0 0
/proc/32390/statm: 69754 5705 382 364 0 5672 0
[pid=32392] ppid=32390 vsize=1018364 CPUtime=14.81 cores=4,6
/proc/32392/stat : 32392 (gnovelty+2) R 32390 32392 32392 0 -1 4202496 673 0 0 0 1481 0 0 0 25 0 1 0 656727488 1042804736 408 33554432000 134512640 135663704 4288422176 18446744073709551615 134525286 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/32392/statm: 254591 408 113 282 0 254307 0
[pid=32367/tid=32391] ppid=32365 vsize=289260 CPUtime=0 cores=4,6
/proc/32367/task/32391/stat : 32391 (python) S 32365 32367 31275 0 -1 4202560 25 927 0 8 0 0 0 0 18 0 2 0 656727487 296202240 7196 33554432000 4194304 5683644 140737089349248 18446744073709551615 210216470961 0 0 16781312 2 18446604449712624000 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 16.17
Current children cumulated vsize (KiB) 1586640
heavy processes:

[startup+51.101 s]
/proc/loadavg: 2.87 3.05 3.27 5/320 32437
/proc/meminfo: memFree=27131164/32951124 swapFree=63649232/67111528
[pid=32367] ppid=32365 vsize=289260 CPUtime=1.34 cores=4,6
/proc/32367/stat : 32367 (python) S 32365 32367 31275 0 -1 4202496 10993 927 102 8 108 26 0 0 17 0 2 0 656726423 296202240 7196 33554432000 4194304 5683644 140737089349248 18446744073709551615 210216474059 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 663
/proc/32367/statm: 72315 7196 1869 364 0 8233 0
[pid=32390] ppid=32367 vsize=279016 CPUtime=0.08 cores=4,6
/proc/32390/stat : 32390 (python) S 32367 32367 31275 0 -1 4202560 982 0 0 0 5 3 0 0 15 0 1 0 656727487 285712384 5705 33554432000 4194304 5683644 140737089349248 18446744073709551615 210204667407 0 0 16781312 514 17096702124474990849 0 0 17 4 0 0 0
/proc/32390/statm: 69754 5705 382 364 0 5672 0
[pid=32392] ppid=32390 vsize=1018364 CPUtime=40.34 cores=4,6
/proc/32392/stat : 32392 (gnovelty+2) R 32390 32392 32392 0 -1 4202496 673 0 0 0 4034 0 0 0 25 0 1 0 656727488 1042804736 408 33554432000 134512640 135663704 4288422176 18446744073709551615 134525260 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/32392/statm: 254591 408 113 282 0 254307 0
[pid=32367/tid=32391] ppid=32365 vsize=289260 CPUtime=0 cores=4,6
/proc/32367/task/32391/stat : 32391 (python) S 32365 32367 31275 0 -1 4202560 25 927 0 8 0 0 0 0 18 0 2 0 656727487 296202240 7196 33554432000 4194304 5683644 140737089349248 18446744073709551615 210216470961 0 0 16781312 2 18446604449712624000 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 41.76
Current children cumulated vsize (KiB) 1586640

[startup+102.312 s]
/proc/loadavg: 3.63 3.22 3.32 5/317 32576
/proc/meminfo: memFree=27059368/32951124 swapFree=63649232/67111528
[pid=32367] ppid=32365 vsize=289260 CPUtime=1.34 cores=4,6
/proc/32367/stat : 32367 (python) S 32365 32367 31275 0 -1 4202496 10993 927 102 8 108 26 0 0 17 0 2 0 656726423 296202240 7196 33554432000 4194304 5683644 140737089349248 18446744073709551615 210216474059 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 663
/proc/32367/statm: 72315 7196 1869 364 0 8233 0
[pid=32390] ppid=32367 vsize=279016 CPUtime=0.19 cores=4,6
/proc/32390/stat : 32390 (python) S 32367 32367 31275 0 -1 4202560 1006 0 0 0 11 8 0 0 15 0 1 0 656727487 285712384 5705 33554432000 4194304 5683644 140737089349248 18446744073709551615 210204667407 0 0 16781312 514 17096702124474990849 0 0 17 4 0 0 0
/proc/32390/statm: 69754 5705 382 364 0 5672 0
[pid=32392] ppid=32390 vsize=1018364 CPUtime=91.45 cores=4,6
/proc/32392/stat : 32392 (gnovelty+2) R 32390 32392 32392 0 -1 4202496 673 0 0 0 9145 0 0 0 25 0 1 0 656727488 1042804736 408 33554432000 134512640 135663704 4288422176 18446744073709551615 134525255 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/32392/statm: 254591 408 113 282 0 254307 0
[pid=32367/tid=32391] ppid=32365 vsize=289260 CPUtime=0 cores=4,6
/proc/32367/task/32391/stat : 32391 (python) S 32365 32367 31275 0 -1 4202560 25 927 0 8 0 0 0 0 18 0 2 0 656727487 296202240 7196 33554432000 4194304 5683644 140737089349248 18446744073709551615 210216470961 0 0 16781312 2 18446604449712624000 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 92.98
Current children cumulated vsize (KiB) 1586640

[startup+162.3 s]
/proc/loadavg: 3.90 3.38 3.36 5/332 32592
/proc/meminfo: memFree=26980072/32951124 swapFree=63649232/67111528
[pid=32367] ppid=32365 vsize=300124 CPUtime=1.35 cores=4,6
/proc/32367/stat : 32367 (python) S 32365 32367 31275 0 -1 4202496 11903 927 102 8 109 26 0 0 20 0 3 0 656726423 307326976 7346 33554432000 4194304 5683644 140737089349248 18446744073709551615 210216474059 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 663
/proc/32367/statm: 75031 7346 1880 364 0 10946 0
[pid=32390] ppid=32367 vsize=289260 CPUtime=0.21 cores=4,6
/proc/32390/stat : 32390 (python) S 32367 32367 31275 0 -1 4202560 1145 0 0 0 12 9 0 0 16 0 2 0 656727487 296202240 5743 33554432000 4194304 5683644 140737089349248 18446744073709551615 210216474059 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/32390/statm: 72315 5743 415 364 0 8233 0
[pid=32392] ppid=32390 vsize=1018364 CPUtime=99.99 cores=4,6
/proc/32392/stat : 32392 (gnovelty+2) T 32390 32392 32392 0 -1 4202496 673 0 0 0 9999 0 0 0 25 0 1 0 656727488 1042804736 408 33554432000 134512640 135663704 4288422176 18446744073709551615 134524888 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/32392/statm: 254591 408 113 282 0 254307 0
[pid=32390/tid=32580] ppid=32367 vsize=289260 CPUtime=0 cores=4,6
/proc/32390/task/32580/stat : 32580 (python) S 32367 32367 31275 0 -1 4202560 45 0 0 0 0 0 0 0 16 0 2 0 656737510 296202240 5743 33554432000 4194304 5683644 140737089349248 18446744073709551615 210216470961 0 0 16781312 514 18446604450340767744 0 0 -1 4 0 0 0
[pid=32581] ppid=32367 vsize=289880 CPUtime=0.1 cores=4,6
/proc/32581/stat : 32581 (python) S 32367 32367 31275 0 -1 4202560 896 0 0 0 5 5 0 0 18 0 1 0 656737512 296837120 5833 33554432000 4194304 5683644 140737089349248 18446744073709551615 210204667462 0 0 16781312 514 17096702124474990850 0 0 17 4 0 0 0
/proc/32581/statm: 72470 5833 371 364 0 8385 0
[pid=32583] ppid=32581 vsize=1018364 CPUtime=51.29 cores=4,6
/proc/32583/stat : 32583 (gnovelty+2) R 32581 32583 32583 0 -1 4202496 673 0 0 0 5129 0 0 0 25 0 1 0 656737512 1042804736 408 33554432000 134512640 135663704 4293406512 18446744073709551615 134524509 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/32583/statm: 254591 408 113 282 0 254307 0
[pid=32367/tid=32391] ppid=32365 vsize=300124 CPUtime=0 cores=4,6
/proc/32367/task/32391/stat : 32391 (python) S 32365 32367 31275 0 -1 4202560 25 927 0 8 0 0 0 0 18 0 3 0 656727487 307326976 7346 33554432000 4194304 5683644 140737089349248 18446744073709551615 210216470961 0 0 16781312 2 18446604449712624000 0 0 -1 4 0 0 0
[pid=32367/tid=32582] ppid=32365 vsize=300124 CPUtime=0 cores=4,6
/proc/32367/task/32582/stat : 32582 (python) S 32365 32367 31275 0 -1 4202560 28 927 0 8 0 0 0 0 20 0 3 0 656737512 307326976 7346 33554432000 4194304 5683644 140737089349248 18446744073709551615 210216470961 0 0 16781312 2 18446604449712624000 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 152.94
Current children cumulated vsize (KiB) 2915992

[startup+222.301 s]
/proc/loadavg: 4.04 3.52 3.41 5/336 32633
/proc/meminfo: memFree=27037332/32951124 swapFree=63649232/67111528
[pid=32367] ppid=32365 vsize=310380 CPUtime=1.36 cores=4,6
/proc/32367/stat : 32367 (python) S 32365 32367 31275 0 -1 4202496 12746 927 102 8 110 26 0 0 20 0 4 0 656726423 317829120 7352 33554432000 4194304 5683644 140737089349248 18446744073709551615 210216474059 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 663
/proc/32367/statm: 77595 7352 1882 364 0 13507 0
[pid=32390] ppid=32367 vsize=289260 CPUtime=0.21 cores=4,6
/proc/32390/stat : 32390 (python) S 32367 32367 31275 0 -1 4202560 1145 0 0 0 12 9 0 0 16 0 2 0 656727487 296202240 5743 33554432000 4194304 5683644 140737089349248 18446744073709551615 210216474059 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/32390/statm: 72315 5743 415 364 0 8233 0
[pid=32392] ppid=32390 vsize=1018364 CPUtime=99.99 cores=4,6

################
# More data... #
################

[pid=32630] ppid=32367 vsize=300136 CPUtime=0.22 cores=4,6
/proc/32630/stat : 32630 (python) S 32367 32367 31275 0 -1 4202560 1083 0 0 0 14 8 0 0 19 0 2 0 656747537 307339264 5867 33554432000 4194304 5683644 140737089349248 18446744073709551615 210216474059 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/32630/statm: 75034 5867 400 364 0 10946 0
[pid=32632] ppid=32630 vsize=417976 CPUtime=100.22 cores=4,6
/proc/32632/stat : 32632 (adaptg2wsat2009) T 32630 32632 32632 0 -1 4202496 1001 0 0 0 10022 0 0 0 25 0 1 0 656747537 428007424 735 33554432000 134512640 135107411 4288038112 18446744073709551615 134532264 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/32632/statm: 104494 735 59 146 0 103370 0
[pid=32630/tid=32648] ppid=32367 vsize=300136 CPUtime=0 cores=4,6
/proc/32630/task/32648/stat : 32648 (python) S 32367 32367 31275 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 656757559 307339264 5867 33554432000 4194304 5683644 140737089349248 18446744073709551615 210216470961 0 0 16781312 514 18446604442571511104 0 0 -1 6 0 0 0
[pid=32649] ppid=32367 vsize=310392 CPUtime=0.23 cores=4,6
/proc/32649/stat : 32649 (python) S 32367 32367 31275 0 -1 4202560 1092 0 0 0 14 9 0 0 19 0 2 0 656757561 317841408 5871 33554432000 4194304 5683644 140737089349248 18446744073709551615 210216474059 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/32649/statm: 77598 5871 400 364 0 13507 0
[pid=32651] ppid=32649 vsize=417976 CPUtime=99.99 cores=4,6
/proc/32651/stat : 32651 (adaptg2wsat2009) T 32649 32651 32651 0 -1 4202496 1002 0 0 0 9999 0 0 0 25 0 1 0 656757561 428007424 735 33554432000 134512640 135107411 4293855440 18446744073709551615 134531856 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/32651/statm: 104494 735 59 146 0 103370 0
[pid=32649/tid=32664] ppid=32367 vsize=310392 CPUtime=0 cores=4,6
/proc/32649/task/32664/stat : 32664 (python) S 32367 32367 31275 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 656767583 317841408 5871 33554432000 4194304 5683644 140737089349248 18446744073709551615 210216470961 0 0 16781312 514 18446604442571510208 0 0 -1 6 0 0 0
[pid=32665] ppid=32367 vsize=320964 CPUtime=0.23 cores=4,6
/proc/32665/stat : 32665 (python) S 32367 32367 31275 0 -1 4202560 1092 0 0 0 13 10 0 0 19 0 2 0 656767585 328667136 5954 33554432000 4194304 5683644 140737089349248 18446744073709551615 210216474059 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/32665/statm: 80241 5954 400 364 0 16147 0
[pid=32667] ppid=32665 vsize=417976 CPUtime=99.97 cores=4,6
/proc/32667/stat : 32667 (adaptg2wsat2009) T 32665 32667 32667 0 -1 4202496 1001 0 0 0 9997 0 0 0 25 0 1 0 656767585 428007424 736 33554432000 134512640 135107411 4293284400 18446744073709551615 134531797 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/32667/statm: 104494 736 59 146 0 103370 0
[pid=32665/tid=32678] ppid=32367 vsize=320964 CPUtime=0 cores=4,6
/proc/32665/task/32678/stat : 32678 (python) S 32367 32367 31275 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 656777607 328667136 5954 33554432000 4194304 5683644 140737089349248 18446744073709551615 210216470961 0 0 16781312 514 18446604446083313728 0 0 -1 6 0 0 0
[pid=32679] ppid=32367 vsize=331220 CPUtime=0.23 cores=4,6
/proc/32679/stat : 32679 (python) S 32367 32367 31275 0 -1 4202560 1089 0 0 0 12 11 0 0 19 0 2 0 656777609 339169280 5958 33554432000 4194304 5683644 140737089349248 18446744073709551615 210216474059 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/32679/statm: 82805 5958 399 364 0 18708 0
[pid=32681] ppid=32679 vsize=1018364 CPUtime=100.03 cores=4,6
/proc/32681/stat : 32681 (gnovelty+2) T 32679 32681 32681 0 -1 4202496 673 0 0 0 10003 0 0 0 25 0 1 0 656777609 1042804736 409 33554432000 134512640 135663704 4288741168 18446744073709551615 134524888 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/32681/statm: 254591 409 113 282 0 254307 0
[pid=32679/tid=32696] ppid=32367 vsize=331220 CPUtime=0 cores=4,6
/proc/32679/task/32696/stat : 32696 (python) S 32367 32367 31275 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 656787634 339169280 5958 33554432000 4194304 5683644 140737089349248 18446744073709551615 210216470961 0 0 16781312 514 18446604447750189248 0 0 -1 6 0 0 0
[pid=32697] ppid=32367 vsize=341476 CPUtime=0.24 cores=4,6
/proc/32697/stat : 32697 (python) S 32367 32367 31275 0 -1 4202560 1095 0 0 0 13 11 0 0 19 0 2 0 656787636 349671424 5962 33554432000 4194304 5683644 140737089349248 18446744073709551615 210216474059 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/32697/statm: 85369 5962 400 364 0 21269 0
[pid=32699] ppid=32697 vsize=247992 CPUtime=99.97 cores=4,6
/proc/32699/stat : 32699 (FH) T 32697 32699 32699 0 -1 4202496 924 0 0 0 9997 0 0 0 25 0 1 0 656787636 253943808 659 33554432000 134512640 134936988 4288737312 18446744073709551615 134552368 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/32699/statm: 61998 659 41 104 0 61502 0
[pid=32697/tid=32712] ppid=32367 vsize=341476 CPUtime=0 cores=4,6
/proc/32697/task/32712/stat : 32712 (python) S 32367 32367 31275 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 656797660 349671424 5962 33554432000 4194304 5683644 140737089349248 18446744073709551615 210216470961 0 0 16781312 514 18446604443423883520 0 0 -1 6 0 0 0
[pid=32713] ppid=32367 vsize=351732 CPUtime=0 cores=4,6
/proc/32713/stat : 32713 (python) S 32367 32367 31275 0 -1 4202560 774 0 0 0 0 0 0 0 19 0 1 0 656797662 360173568 5915 33554432000 4194304 5683644 140737089349248 18446744073709551615 210204667462 0 0 16781312 514 4373148899221700607 0 0 17 4 0 0 0
/proc/32713/statm: 87933 5915 350 364 0 23830 0
[pid=32715] ppid=32713 vsize=417840 CPUtime=0.32 cores=4,6
/proc/32715/stat : 32715 (adaptg2wsat2009) R 32713 32715 32715 0 -1 4202496 893 0 0 0 32 0 0 0 21 0 1 0 656797662 427868160 624 33554432000 134512640 135107411 4291800640 18446744073709551615 134523344 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/32715/statm: 104460 624 49 146 0 103336 0
[pid=32367/tid=32391] ppid=32365 vsize=361976 CPUtime=0 cores=4,6
/proc/32367/task/32391/stat : 32391 (python) S 32365 32367 31275 0 -1 4202560 25 927 0 8 0 0 0 0 18 0 9 0 656727487 370663424 7461 33554432000 4194304 5683644 140737089349248 18446744073709551615 210216470961 0 0 16781312 2 18446604449712624000 0 0 -1 4 0 0 0
[pid=32367/tid=32582] ppid=32365 vsize=361976 CPUtime=0 cores=4,6
/proc/32367/task/32582/stat : 32582 (python) S 32365 32367 31275 0 -1 4202560 28 927 0 8 0 0 0 0 20 0 9 0 656737512 370663424 7461 33554432000 4194304 5683644 140737089349248 18446744073709551615 210216470961 0 0 16781312 2 18446604449712624000 0 0 -1 4 0 0 0
[pid=32367/tid=32631] ppid=32365 vsize=361976 CPUtime=0 cores=4,6
/proc/32367/task/32631/stat : 32631 (python) S 32365 32367 31275 0 -1 4202560 30 927 0 8 0 0 0 0 20 0 9 0 656747537 370663424 7461 33554432000 4194304 5683644 140737089349248 18446744073709551615 210216470961 0 0 16781312 2 18446604449712624000 0 0 -1 4 0 0 0
[pid=32367/tid=32650] ppid=32365 vsize=361976 CPUtime=0 cores=4,6
/proc/32367/task/32650/stat : 32650 (python) S 32365 32367 31275 0 -1 4202560 28 927 0 8 0 0 0 0 20 0 9 0 656757561 370663424 7461 33554432000 4194304 5683644 140737089349248 18446744073709551615 210216470961 0 0 16781312 2 18446604449712624000 0 0 -1 4 0 0 0
[pid=32367/tid=32666] ppid=32365 vsize=361976 CPUtime=0 cores=4,6
/proc/32367/task/32666/stat : 32666 (python) S 32365 32367 31275 0 -1 4202560 27 927 0 8 0 0 0 0 20 0 9 0 656767585 370663424 7461 33554432000 4194304 5683644 140737089349248 18446744073709551615 210216470961 0 0 16781312 2 18446604449712624000 0 0 -1 4 0 0 0
[pid=32367/tid=32680] ppid=32365 vsize=361976 CPUtime=0 cores=4,6
/proc/32367/task/32680/stat : 32680 (python) S 32365 32367 31275 0 -1 4202560 30 927 0 8 0 0 0 0 20 0 9 0 656777609 370663424 7461 33554432000 4194304 5683644 140737089349248 18446744073709551615 210216470961 0 0 16781312 2 18446604449712624000 0 0 -1 4 0 0 0
[pid=32367/tid=32698] ppid=32365 vsize=361976 CPUtime=0 cores=4,6
/proc/32367/task/32698/stat : 32698 (python) S 32365 32367 31275 0 -1 4202560 29 927 0 8 0 0 0 0 20 0 9 0 656787636 370663424 7461 33554432000 4194304 5683644 140737089349248 18446744073709551615 210216470961 0 0 16781312 2 18446604449712624000 0 0 -1 4 0 0 0
[pid=32367/tid=32714] ppid=32365 vsize=361976 CPUtime=0 cores=4,6
/proc/32367/task/32714/stat : 32714 (python) S 32365 32367 31275 0 -1 4202560 25 927 0 8 0 0 0 0 20 0 9 0 656797662 370663424 7461 33554432000 4194304 5683644 140737089349248 18446744073709551615 210216470961 0 0 16781312 2 18446604449712624000 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 703.51
Current children cumulated vsize (KiB) 7871888

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+712.701 s]
/proc/loadavg: 4.10 3.96 3.66 5/405 32715
/proc/meminfo: memFree=26847072/32951124 swapFree=63649232/67111528
[pid=32367] ppid=32365 vsize=361976 CPUtime=1.44 cores=4,6
/proc/32367/stat : 32367 (python) S 32365 32367 31275 0 -1 4202496 17031 927 102 8 116 28 0 0 20 0 9 0 656726423 370663424 7461 33554432000 4194304 5683644 140737089349248 18446744073709551615 210216474059 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 663
/proc/32367/statm: 90494 7461 1892 364 0 26391 0
[pid=32390] ppid=32367 vsize=289260 CPUtime=0.21 cores=4,6
/proc/32390/stat : 32390 (python) S 32367 32367 31275 0 -1 4202560 1145 0 0 0 12 9 0 0 16 0 2 0 656727487 296202240 5743 33554432000 4194304 5683644 140737089349248 18446744073709551615 210216474059 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/32390/statm: 72315 5743 415 364 0 8233 0
[pid=32392] ppid=32390 vsize=1018364 CPUtime=99.99 cores=4,6
/proc/32392/stat : 32392 (gnovelty+2) T 32390 32392 32392 0 -1 4202496 673 0 0 0 9999 0 0 0 25 0 1 0 656727488 1042804736 408 33554432000 134512640 135663704 4288422176 18446744073709551615 134524888 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/32392/statm: 254591 408 113 282 0 254307 0
[pid=32390/tid=32580] ppid=32367 vsize=289260 CPUtime=0 cores=4,6
/proc/32390/task/32580/stat : 32580 (python) S 32367 32367 31275 0 -1 4202560 45 0 0 0 0 0 0 0 16 0 2 0 656737510 296202240 5743 33554432000 4194304 5683644 140737089349248 18446744073709551615 210216470961 0 0 16781312 514 18446604450340767744 0 0 -1 4 0 0 0
[pid=32581] ppid=32367 vsize=289880 CPUtime=0.21 cores=4,6
/proc/32581/stat : 32581 (python) S 32367 32367 31275 0 -1 4202560 1064 0 0 0 11 10 0 0 19 0 2 0 656737512 296837120 5863 33554432000 4194304 5683644 140737089349248 18446744073709551615 210216474059 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/32581/statm: 72470 5863 400 364 0 8385 0
[pid=32583] ppid=32581 vsize=1018364 CPUtime=100.01 cores=4,6
/proc/32583/stat : 32583 (gnovelty+2) T 32581 32583 32583 0 -1 4202496 673 0 0 0 10001 0 0 0 25 0 1 0 656737512 1042804736 408 33554432000 134512640 135663704 4293406512 18446744073709551615 134524882 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/32583/statm: 254591 408 113 282 0 254307 0
[pid=32581/tid=32629] ppid=32367 vsize=289880 CPUtime=0 cores=4,6
/proc/32581/task/32629/stat : 32629 (python) S 32367 32367 31275 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 656747535 296837120 5863 33554432000 4194304 5683644 140737089349248 18446744073709551615 210216470961 0 0 16781312 514 18446604443946658560 0 0 -1 6 0 0 0
[pid=32630] ppid=32367 vsize=300136 CPUtime=0.22 cores=4,6
/proc/32630/stat : 32630 (python) S 32367 32367 31275 0 -1 4202560 1083 0 0 0 14 8 0 0 19 0 2 0 656747537 307339264 5867 33554432000 4194304 5683644 140737089349248 18446744073709551615 210216474059 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/32630/statm: 75034 5867 400 364 0 10946 0
[pid=32632] ppid=32630 vsize=417976 CPUtime=100.22 cores=4,6
/proc/32632/stat : 32632 (adaptg2wsat2009) T 32630 32632 32632 0 -1 4202496 1001 0 0 0 10022 0 0 0 25 0 1 0 656747537 428007424 735 33554432000 134512640 135107411 4288038112 18446744073709551615 134532264 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/32632/statm: 104494 735 59 146 0 103370 0
[pid=32630/tid=32648] ppid=32367 vsize=300136 CPUtime=0 cores=4,6
/proc/32630/task/32648/stat : 32648 (python) S 32367 32367 31275 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 656757559 307339264 5867 33554432000 4194304 5683644 140737089349248 18446744073709551615 210216470961 0 0 16781312 514 18446604442571511104 0 0 -1 6 0 0 0
[pid=32649] ppid=32367 vsize=310392 CPUtime=0.23 cores=4,6
/proc/32649/stat : 32649 (python) S 32367 32367 31275 0 -1 4202560 1092 0 0 0 14 9 0 0 19 0 2 0 656757561 317841408 5871 33554432000 4194304 5683644 140737089349248 18446744073709551615 210216474059 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/32649/statm: 77598 5871 400 364 0 13507 0
[pid=32651] ppid=32649 vsize=417976 CPUtime=99.99 cores=4,6
/proc/32651/stat : 32651 (adaptg2wsat2009) T 32649 32651 32651 0 -1 4202496 1002 0 0 0 9999 0 0 0 25 0 1 0 656757561 428007424 735 33554432000 134512640 135107411 4293855440 18446744073709551615 134531856 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/32651/statm: 104494 735 59 146 0 103370 0
[pid=32649/tid=32664] ppid=32367 vsize=310392 CPUtime=0 cores=4,6
/proc/32649/task/32664/stat : 32664 (python) S 32367 32367 31275 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 656767583 317841408 5871 33554432000 4194304 5683644 140737089349248 18446744073709551615 210216470961 0 0 16781312 514 18446604442571510208 0 0 -1 6 0 0 0
[pid=32665] ppid=32367 vsize=320964 CPUtime=0.23 cores=4,6
/proc/32665/stat : 32665 (python) S 32367 32367 31275 0 -1 4202560 1092 0 0 0 13 10 0 0 19 0 2 0 656767585 328667136 5954 33554432000 4194304 5683644 140737089349248 18446744073709551615 210216474059 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/32665/statm: 80241 5954 400 364 0 16147 0
[pid=32667] ppid=32665 vsize=417976 CPUtime=99.97 cores=4,6
/proc/32667/stat : 32667 (adaptg2wsat2009) T 32665 32667 32667 0 -1 4202496 1001 0 0 0 9997 0 0 0 25 0 1 0 656767585 428007424 736 33554432000 134512640 135107411 4293284400 18446744073709551615 134531797 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/32667/statm: 104494 736 59 146 0 103370 0
[pid=32665/tid=32678] ppid=32367 vsize=320964 CPUtime=0 cores=4,6
/proc/32665/task/32678/stat : 32678 (python) S 32367 32367 31275 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 656777607 328667136 5954 33554432000 4194304 5683644 140737089349248 18446744073709551615 210216470961 0 0 16781312 514 18446604446083313728 0 0 -1 6 0 0 0
[pid=32679] ppid=32367 vsize=331220 CPUtime=0.23 cores=4,6
/proc/32679/stat : 32679 (python) S 32367 32367 31275 0 -1 4202560 1089 0 0 0 12 11 0 0 19 0 2 0 656777609 339169280 5958 33554432000 4194304 5683644 140737089349248 18446744073709551615 210216474059 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/32679/statm: 82805 5958 399 364 0 18708 0
[pid=32681] ppid=32679 vsize=1018364 CPUtime=100.03 cores=4,6
/proc/32681/stat : 32681 (gnovelty+2) T 32679 32681 32681 0 -1 4202496 673 0 0 0 10003 0 0 0 25 0 1 0 656777609 1042804736 409 33554432000 134512640 135663704 4288741168 18446744073709551615 134524888 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/32681/statm: 254591 409 113 282 0 254307 0
[pid=32679/tid=32696] ppid=32367 vsize=331220 CPUtime=0 cores=4,6
/proc/32679/task/32696/stat : 32696 (python) S 32367 32367 31275 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 656787634 339169280 5958 33554432000 4194304 5683644 140737089349248 18446744073709551615 210216470961 0 0 16781312 514 18446604447750189248 0 0 -1 6 0 0 0
[pid=32697] ppid=32367 vsize=341476 CPUtime=0.24 cores=4,6
/proc/32697/stat : 32697 (python) S 32367 32367 31275 0 -1 4202560 1095 0 0 0 13 11 0 0 19 0 2 0 656787636 349671424 5962 33554432000 4194304 5683644 140737089349248 18446744073709551615 210216474059 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/32697/statm: 85369 5962 400 364 0 21269 0
[pid=32699] ppid=32697 vsize=247992 CPUtime=99.97 cores=4,6
/proc/32699/stat : 32699 (FH) T 32697 32699 32699 0 -1 4202496 924 0 0 0 9997 0 0 0 25 0 1 0 656787636 253943808 659 33554432000 134512640 134936988 4288737312 18446744073709551615 134552368 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/32699/statm: 61998 659 41 104 0 61502 0
[pid=32697/tid=32712] ppid=32367 vsize=341476 CPUtime=0 cores=4,6
/proc/32697/task/32712/stat : 32712 (python) S 32367 32367 31275 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 656797660 349671424 5962 33554432000 4194304 5683644 140737089349248 18446744073709551615 210216470961 0 0 16781312 514 18446604443423883520 0 0 -1 6 0 0 0
[pid=32713] ppid=32367 vsize=351732 CPUtime=0 cores=4,6
/proc/32713/stat : 32713 (python) S 32367 32367 31275 0 -1 4202560 774 0 0 0 0 0 0 0 19 0 1 0 656797662 360173568 5915 33554432000 4194304 5683644 140737089349248 18446744073709551615 210204667462 0 0 16781312 514 4373148899221700607 0 0 17 4 0 0 0
/proc/32713/statm: 87933 5915 350 364 0 23830 0
[pid=32715] ppid=32713 vsize=417840 CPUtime=0.32 cores=4,6
/proc/32715/stat : 32715 (adaptg2wsat2009) R 32713 32715 32715 0 -1 4202496 893 0 0 0 32 0 0 0 21 0 1 0 656797662 427868160 624 33554432000 134512640 135107411 4291800640 18446744073709551615 134523344 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/32715/statm: 104460 624 49 146 0 103336 0
[pid=32367/tid=32391] ppid=32365 vsize=361976 CPUtime=0 cores=4,6
/proc/32367/task/32391/stat : 32391 (python) S 32365 32367 31275 0 -1 4202560 25 927 0 8 0 0 0 0 18 0 9 0 656727487 370663424 7461 33554432000 4194304 5683644 140737089349248 18446744073709551615 210216470961 0 0 16781312 2 18446604449712624000 0 0 -1 4 0 0 0
[pid=32367/tid=32582] ppid=32365 vsize=361976 CPUtime=0 cores=4,6
/proc/32367/task/32582/stat : 32582 (python) S 32365 32367 31275 0 -1 4202560 28 927 0 8 0 0 0 0 20 0 9 0 656737512 370663424 7461 33554432000 4194304 5683644 140737089349248 18446744073709551615 210216470961 0 0 16781312 2 18446604449712624000 0 0 -1 4 0 0 0
[pid=32367/tid=32631] ppid=32365 vsize=361976 CPUtime=0 cores=4,6
/proc/32367/task/32631/stat : 32631 (python) S 32365 32367 31275 0 -1 4202560 30 927 0 8 0 0 0 0 20 0 9 0 656747537 370663424 7461 33554432000 4194304 5683644 140737089349248 18446744073709551615 210216470961 0 0 16781312 2 18446604449712624000 0 0 -1 4 0 0 0
[pid=32367/tid=32650] ppid=32365 vsize=361976 CPUtime=0 cores=4,6
/proc/32367/task/32650/stat : 32650 (python) S 32365 32367 31275 0 -1 4202560 28 927 0 8 0 0 0 0 20 0 9 0 656757561 370663424 7461 33554432000 4194304 5683644 140737089349248 18446744073709551615 210216470961 0 0 16781312 2 18446604449712624000 0 0 -1 4 0 0 0
[pid=32367/tid=32666] ppid=32365 vsize=361976 CPUtime=0 cores=4,6
/proc/32367/task/32666/stat : 32666 (python) S 32365 32367 31275 0 -1 4202560 27 927 0 8 0 0 0 0 20 0 9 0 656767585 370663424 7461 33554432000 4194304 5683644 140737089349248 18446744073709551615 210216470961 0 0 16781312 2 18446604449712624000 0 0 -1 4 0 0 0
[pid=32367/tid=32680] ppid=32365 vsize=361976 CPUtime=0 cores=4,6
/proc/32367/task/32680/stat : 32680 (python) S 32365 32367 31275 0 -1 4202560 30 927 0 8 0 0 0 0 20 0 9 0 656777609 370663424 7461 33554432000 4194304 5683644 140737089349248 18446744073709551615 210216470961 0 0 16781312 2 18446604449712624000 0 0 -1 4 0 0 0
[pid=32367/tid=32698] ppid=32365 vsize=361976 CPUtime=0 cores=4,6
/proc/32367/task/32698/stat : 32698 (python) S 32365 32367 31275 0 -1 4202560 29 927 0 8 0 0 0 0 20 0 9 0 656787636 370663424 7461 33554432000 4194304 5683644 140737089349248 18446744073709551615 210216470961 0 0 16781312 2 18446604449712624000 0 0 -1 4 0 0 0
[pid=32367/tid=32714] ppid=32365 vsize=361976 CPUtime=0 cores=4,6
/proc/32367/task/32714/stat : 32714 (python) S 32365 32367 31275 0 -1 4202560 25 927 0 8 0 0 0 0 20 0 9 0 656797662 370663424 7461 33554432000 4194304 5683644 140737089349248 18446744073709551615 210216470961 0 0 16781312 2 18446604449712624000 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 703.51
Current children cumulated vsize (KiB) 7871888

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 32367 and gives
#  childrusage.ru_utime.tv_sec=1
#  childrusage.ru_utime.tv_usec=166822
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=288956
# CPU time returned by wait4() is 1.45578
# while last known CPU time is 703.51
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 712.774
CPU time (s): 703.51
CPU user time (s): 702.55
CPU system time (s): 0.96
CPU usage (%): 98.7003
Max. virtual memory (cumulated for all children) (KiB): 7871888

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1.16682
system time used= 0.288956
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 17964
page faults= 110
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 39795
involuntary context switches= 38

runsolver used 2.47862 second user time and 5.01424 second system time

The end

Launcher Data 

Begin job on node130 at 2011-05-15 11:21:18
IDJOB=3377197
IDBENCH=82506
IDSOLVER=1857
FILE ID=node130/3377197-1305451278
RUNJOBID= node130-1305451278-32331
PBS_JOBID= 13324842
Free space on /tmp= 73400 MiB

SOLVER NAME= borg-sat 11.03.02-seq-random (fixed)
BENCH NAME= SAT11/random/large/unif-k7-r85-v150-c12750-S93401285-051-UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3377197-1305451278/watcher-3377197-1305451278 -o /tmp/evaluation-result-3377197-1305451278/solver-3377197-1305451278 -C 2400 -W 1300 -M 7680  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3377197-1305451278.cnf -seed 961747126 -budget 2400

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 7680 MiB
NBCORE= 2

MD5SUM BENCH= dc0028248c86c8aff67bef1f8d7ffb16
RANDOM SEED=961747126

node130.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.81
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.81
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      27300736 kB
Buffers:        280624 kB
Cached:        4030476 kB
SwapCached:      10248 kB
Active:        1493316 kB
Inactive:      3878152 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      27300736 kB
SwapTotal:    67111528 kB
SwapFree:     63649232 kB
Dirty:          129424 kB
Writeback:           0 kB
AnonPages:     1058020 kB
Mapped:          14492 kB
Slab:           192316 kB
PageTables:      25552 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 51505248 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73336 MiB
End job on node130 at 2011-05-15 11:33:14