Trace number 3386763

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-seq-random (fixed)? (TO) 5000.08 4989.72

General information on the benchmark

Namerandom/medium/
unif-k7-r89-v80-c7120-S1980280938-088.UNKNOWN.cnf
MD5SUM4fa782cc700b96dfddf41b0ed3b14006
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables80
Number of clauses7120
Sum of the clauses size49840
Maximum clause length7
Minimum clause length7
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 57120

Solver Data 

0.31/0.45	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.31/0.45	c INFO: solving HOME/instance-3386763-1305591472.cnf
0.31/0.45	c INFO: computing task features
0.40/0.50	c INFO: computed variable-clause graph statistics
0.40/0.50	c INFO: computed clause balance statistics
0.60/0.75	c INFO: computed variable balance statistics
0.70/0.85	c INFO: computed small-clause counts
0.70/0.85	c INFO: computed Horn-clause counts
0.70/0.86	c INFO: computed variable graph statistics
0.70/0.86	c INFO: collected features for HOME/instance-3386763-1305591472.cnf in 0.41 s
0.70/0.89	c INFO: running gnovelty+2@0 for 97 with 4999 remaining (b = 0.49)
101.17/101.21	c INFO: running gnovelty+2@0 for 97 with 4899 remaining (b = 0.11)
201.85/201.54	c INFO: running adaptg2wsat2009++@0 for 97 with 4799 remaining (b = 0.06)
302.43/301.88	c INFO: running adaptg2wsat2009++@0 for 97 with 4698 remaining (b = 0.05)
403.06/402.21	c INFO: running adaptg2wsat2009++@0 for 97 with 4598 remaining (b = 0.04)
502.64/501.56	c INFO: running gnovelty+2@0 for 97 with 4499 remaining (b = 0.03)
603.30/601.92	c INFO: running FH@0 for 97 with 4398 remaining (b = 0.02)
702.88/701.27	c INFO: running adaptg2wsat2009++@0 for 97 with 4299 remaining (b = 0.02)
802.60/800.64	c INFO: running adaptg2wsat2009++@0 for 97 with 4200 remaining (b = 0.02)
903.30/901.00	c INFO: running hybridGM3@0 for 194 with 4099 remaining (b = 0.03)
1098.43/1095.68	c INFO: running FH@0 for 97 with 3905 remaining (b = 0.01)
1198.13/1195.05	c INFO: running march_hi@0 for 485 with 3805 remaining (b = 0.07)
1686.27/1682.03	c INFO: running march_hi@486 for 194 with 3319 remaining (b = 0.04)
1881.67/1877.08	c INFO: running march_hi@681 for 97 with 3124 remaining (b = 0.01)
1977.00/1972.17	c INFO: running march_hi@0 for 388 with 3029 remaining (b = 0.05)
2366.68/2360.82	c INFO: running march_hi@388 for 97 with 2641 remaining (b = 0.02)
2463.88/2457.79	c INFO: running march_hi@485 for 194 with 2544 remaining (b = 0.03)
2664.25/2657.61	c INFO: running gnovelty+2@0 for 97 with 2344 remaining (b = 0.01)
2764.97/2757.97	c INFO: running hybridGM3@0 for 194 with 2244 remaining (b = 0.02)
2960.28/2952.67	c INFO: running march_hi@776 for 582 with 2049 remaining (b = 0.06)
3548.14/3538.58	c INFO: running march_hi@1362 for 776 with 1463 remaining (b = 0.10)
4328.02/4315.89	c INFO: running march_hi@2139 for 97 with 686 remaining (b = 0.02)
4421.74/4409.26	c INFO: running march_hi@2232 for 592 with 592 remaining (b = 0.07)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3386763-1305591472/watcher-3386763-1305591472 -o /tmp/evaluation-result-3386763-1305591472/solver-3386763-1305591472 -C 5000 -W 5100 -M 15500 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3386763-1305591472.cnf -seed 1906858759 -budget 5000 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 5000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 5030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 4.25 4.13 4.08 5/412 29422
/proc/meminfo: memFree=13919560/32951132 swapFree=67093824/67111528
[pid=29422] ppid=29420 vsize=16240 CPUtime=0 cores=1,3,5,7
/proc/29422/stat : 29422 (python) R 29420 29422 28742 0 -1 4202496 1039 0 0 0 0 0 0 0 25 0 1 0 670746832 16629760 912 33554432000 4194304 5683644 140734628121424 18446744073709551615 4540219 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/29422/statm: 4060 912 380 364 0 547 0

[startup+0.083095 s]
/proc/loadavg: 4.25 4.13 4.08 5/412 29422
/proc/meminfo: memFree=13919560/32951132 swapFree=67093824/67111528
[pid=29422] ppid=29420 vsize=93964 CPUtime=0.06 cores=1,3,5,7
/proc/29422/stat : 29422 (python) R 29420 29422 28742 0 -1 4202496 2692 0 0 0 4 2 0 0 17 0 1 0 670746832 96219136 2407 33554432000 4194304 5683644 140734628121424 18446744073709551615 274664806400 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/29422/statm: 23491 2407 764 364 0 1623 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 93964

[startup+0.10108 s]
/proc/loadavg: 4.25 4.13 4.08 5/412 29422
/proc/meminfo: memFree=13919560/32951132 swapFree=67093824/67111528
[pid=29422] ppid=29420 vsize=104616 CPUtime=0.06 cores=1,3,5,7
/proc/29422/stat : 29422 (python) R 29420 29422 28742 0 -1 4202496 3141 0 0 0 4 2 0 0 17 0 1 0 670746832 107126784 2821 33554432000 4194304 5683644 140734628121424 18446744073709551615 4639680 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/29422/statm: 26154 2821 847 364 0 1902 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 104616

[startup+0.301044 s]
/proc/loadavg: 4.25 4.13 4.08 5/412 29422
/proc/meminfo: memFree=13919560/32951132 swapFree=67093824/67111528
[pid=29422] ppid=29420 vsize=198920 CPUtime=0.22 cores=1,3,5,7
/proc/29422/stat : 29422 (python) R 29420 29422 28742 0 -1 4202496 7027 933 1 0 16 6 0 0 17 0 1 0 670746832 203694080 5053 33554432000 4194304 5683644 140734628121424 18446744073709551615 4868488 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/29422/statm: 49730 5053 1466 364 0 3757 0
Current children cumulated CPU time (s) 0.22
Current children cumulated vsize (KiB) 198920

[startup+0.700973 s]
/proc/loadavg: 4.25 4.13 4.08 5/412 29422
/proc/meminfo: memFree=13919560/32951132 swapFree=67093824/67111528
[pid=29422] ppid=29420 vsize=279952 CPUtime=0.6 cores=1,3,5,7
/proc/29422/stat : 29422 (python) R 29420 29422 28742 0 -1 4202496 9811 933 1 0 52 8 0 0 17 0 1 0 670746832 286670848 7372 33554432000 4194304 5683644 140734628121424 18446744073709551615 47591827864751 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/29422/statm: 69988 7372 1826 364 0 5912 0
Current children cumulated CPU time (s) 0.6
Current children cumulated vsize (KiB) 279952

[startup+1.5008 s]
/proc/loadavg: 4.25 4.13 4.08 5/416 29430
/proc/meminfo: memFree=13892992/32951132 swapFree=67093824/67111528
[pid=29422] ppid=29420 vsize=290220 CPUtime=0.79 cores=1,3,5,7
/proc/29422/stat : 29422 (python) S 29420 29422 28742 0 -1 4202496 10116 933 1 0 71 8 0 0 20 0 2 0 670746832 297185280 7427 33554432000 4194304 5683644 140734628121424 18446744073709551615 274676635083 0 0 16781312 2 18446744073709551615 0 0 17 3 0 0 0
/proc/29422/statm: 72555 7427 1877 364 0 8473 0
[pid=29428] ppid=29422 vsize=279976 CPUtime=0 cores=1,3,5,7
/proc/29428/stat : 29428 (python) S 29422 29422 28742 0 -1 4202560 743 0 0 0 0 0 0 0 19 0 1 0 670746921 286695424 5900 33554432000 4194304 5683644 140734628121424 18446744073709551615 274664828431 0 0 16781312 514 2701440425234792447 0 0 17 3 0 0 0
/proc/29428/statm: 69994 5900 354 364 0 5912 0
[pid=29430] ppid=29428 vsize=1018084 CPUtime=0.58 cores=1,3,5,7
/proc/29430/stat : 29430 (gnovelty+2) R 29428 29430 29430 0 -1 4202496 552 0 0 0 58 0 0 0 22 0 1 0 670746922 1042518016 286 33554432000 134512640 135663704 4292381600 18446744073709551615 134525255 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/29430/statm: 254521 286 113 282 0 254237 0
[pid=29422/tid=29429] ppid=29420 vsize=290220 CPUtime=0 cores=1,3,5,7
/proc/29422/task/29429/stat : 29429 (python) S 29420 29422 28742 0 -1 4202560 30 933 0 0 0 0 0 0 20 0 2 0 670746922 297185280 7427 33554432000 4194304 5683644 140734628121424 18446744073709551615 274676631985 0 0 16781312 2 18446604465219701632 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 1.37
Current children cumulated vsize (KiB) 1588280

[startup+3.10056 s]
/proc/loadavg: 4.25 4.13 4.08 5/416 29430
/proc/meminfo: memFree=13891380/32951132 swapFree=67093824/67111528
[pid=29422] ppid=29420 vsize=290220 CPUtime=0.79 cores=1,3,5,7
/proc/29422/stat : 29422 (python) S 29420 29422 28742 0 -1 4202496 10116 933 1 0 71 8 0 0 20 0 2 0 670746832 297185280 7427 33554432000 4194304 5683644 140734628121424 18446744073709551615 274676635083 0 0 16781312 2 18446744073709551615 0 0 17 3 0 0 0
/proc/29422/statm: 72555 7427 1877 364 0 8473 0
[pid=29428] ppid=29422 vsize=279976 CPUtime=0 cores=1,3,5,7
/proc/29428/stat : 29428 (python) S 29422 29422 28742 0 -1 4202560 743 0 0 0 0 0 0 0 18 0 1 0 670746921 286695424 5900 33554432000 4194304 5683644 140734628121424 18446744073709551615 274664828431 0 0 16781312 514 2701440425234759943 0 0 17 3 0 0 0
/proc/29428/statm: 69994 5900 354 364 0 5912 0
[pid=29430] ppid=29428 vsize=1018084 CPUtime=2.18 cores=1,3,5,7
/proc/29430/stat : 29430 (gnovelty+2) R 29428 29430 29430 0 -1 4202496 552 0 0 0 218 0 0 0 25 0 1 0 670746922 1042518016 286 33554432000 134512640 135663704 4292381600 18446744073709551615 134524888 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/29430/statm: 254521 286 113 282 0 254237 0
[pid=29422/tid=29429] ppid=29420 vsize=290220 CPUtime=0 cores=1,3,5,7
/proc/29422/task/29429/stat : 29429 (python) S 29420 29422 28742 0 -1 4202560 30 933 0 0 0 0 0 0 20 0 2 0 670746922 297185280 7427 33554432000 4194304 5683644 140734628121424 18446744073709551615 274676631985 0 0 16781312 2 18446604465219701632 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 2.97
Current children cumulated vsize (KiB) 1588280

[startup+6.301 s]
/proc/loadavg: 4.31 4.14 4.09 5/416 29430
/proc/meminfo: memFree=13891064/32951132 swapFree=67093824/67111528
[pid=29422] ppid=29420 vsize=290220 CPUtime=0.79 cores=1,3,5,7
/proc/29422/stat : 29422 (python) S 29420 29422 28742 0 -1 4202496 10116 933 1 0 71 8 0 0 20 0 2 0 670746832 297185280 7427 33554432000 4194304 5683644 140734628121424 18446744073709551615 274676635083 0 0 16781312 2 18446744073709551615 0 0 17 3 0 0 0
/proc/29422/statm: 72555 7427 1877 364 0 8473 0
[pid=29428] ppid=29422 vsize=279976 CPUtime=0.01 cores=1,3,5,7
/proc/29428/stat : 29428 (python) S 29422 29422 28742 0 -1 4202560 887 0 0 0 1 0 0 0 18 0 1 0 670746921 286695424 5922 33554432000 4194304 5683644 140734628121424 18446744073709551615 274664828431 0 0 16781312 514 2701440425234759943 0 0 17 3 0 0 0
/proc/29428/statm: 69994 5922 376 364 0 5912 0
[pid=29430] ppid=29428 vsize=1018084 CPUtime=5.38 cores=1,3,5,7
/proc/29430/stat : 29430 (gnovelty+2) R 29428 29430 29430 0 -1 4202496 552 0 0 0 538 0 0 0 25 0 1 0 670746922 1042518016 286 33554432000 134512640 135663704 4292381600 18446744073709551615 134524755 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/29430/statm: 254521 286 113 282 0 254237 0
[pid=29422/tid=29429] ppid=29420 vsize=290220 CPUtime=0 cores=1,3,5,7
/proc/29422/task/29429/stat : 29429 (python) S 29420 29422 28742 0 -1 4202560 30 933 0 0 0 0 0 0 20 0 2 0 670746922 297185280 7427 33554432000 4194304 5683644 140734628121424 18446744073709551615 274676631985 0 0 16781312 2 18446604465219701632 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 6.18
Current children cumulated vsize (KiB) 1588280

[startup+12.7009 s]
/proc/loadavg: 4.37 4.15 4.09 5/416 29430
/proc/meminfo: memFree=13890964/32951132 swapFree=67093824/67111528
[pid=29422] ppid=29420 vsize=290220 CPUtime=0.79 cores=1,3,5,7
/proc/29422/stat : 29422 (python) S 29420 29422 28742 0 -1 4202496 10116 933 1 0 71 8 0 0 20 0 2 0 670746832 297185280 7427 33554432000 4194304 5683644 140734628121424 18446744073709551615 274676635083 0 0 16781312 2 18446744073709551615 0 0 17 3 0 0 0
/proc/29422/statm: 72555 7427 1877 364 0 8473 0
[pid=29428] ppid=29422 vsize=279976 CPUtime=0.03 cores=1,3,5,7
/proc/29428/stat : 29428 (python) S 29422 29422 28742 0 -1 4202560 890 0 0 0 2 1 0 0 18 0 1 0 670746921 286695424 5922 33554432000 4194304 5683644 140734628121424 18446744073709551615 274664828431 0 0 16781312 514 16033571137438843143 0 0 17 3 0 0 0
/proc/29428/statm: 69994 5922 376 364 0 5912 0
[pid=29430] ppid=29428 vsize=1018084 CPUtime=11.76 cores=1,3,5,7
/proc/29430/stat : 29430 (gnovelty+2) R 29428 29430 29430 0 -1 4202496 552 0 0 0 1176 0 0 0 25 0 1 0 670746922 1042518016 286 33554432000 134512640 135663704 4292381600 18446744073709551615 134525255 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/29430/statm: 254521 286 113 282 0 254237 0
[pid=29422/tid=29429] ppid=29420 vsize=290220 CPUtime=0 cores=1,3,5,7
/proc/29422/task/29429/stat : 29429 (python) S 29420 29422 28742 0 -1 4202560 30 933 0 0 0 0 0 0 20 0 2 0 670746922 297185280 7427 33554432000 4194304 5683644 140734628121424 18446744073709551615 274676631985 0 0 16781312 2 18446604465219701632 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 12.58
Current children cumulated vsize (KiB) 1588280

[startup+25.5007 s]
/proc/loadavg: 4.29 4.15 4.09 5/416 29430
/proc/meminfo: memFree=13890556/32951132 swapFree=67093824/67111528
[pid=29422] ppid=29420 vsize=290220 CPUtime=0.79 cores=1,3,5,7
/proc/29422/stat : 29422 (python) S 29420 29422 28742 0 -1 4202496 10116 933 1 0 71 8 0 0 20 0 2 0 670746832 297185280 7427 33554432000 4194304 5683644 140734628121424 18446744073709551615 274676635083 0 0 16781312 2 18446744073709551615 0 0 17 3 0 0 0
/proc/29422/statm: 72555 7427 1877 364 0 8473 0
[pid=29428] ppid=29422 vsize=279976 CPUtime=0.06 cores=1,3,5,7
/proc/29428/stat : 29428 (python) S 29422 29422 28742 0 -1 4202560 896 0 0 0 4 2 0 0 18 0 1 0 670746921 286695424 5922 33554432000 4194304 5683644 140734628121424 18446744073709551615 274664828431 0 0 16781312 514 16033571137438843143 0 0 17 3 0 0 0
/proc/29428/statm: 69994 5922 376 364 0 5912 0
[pid=29430] ppid=29428 vsize=1018084 CPUtime=24.52 cores=1,3,5,7
/proc/29430/stat : 29430 (gnovelty+2) R 29428 29430 29430 0 -1 4202496 552 0 0 0 2452 0 0 0 25 0 1 0 670746922 1042518016 286 33554432000 134512640 135663704 4292381600 18446744073709551615 134525213 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/29430/statm: 254521 286 113 282 0 254237 0
[pid=29422/tid=29429] ppid=29420 vsize=290220 CPUtime=0 cores=1,3,5,7
/proc/29422/task/29429/stat : 29429 (python) S 29420 29422 28742 0 -1 4202560 30 933 0 0 0 0 0 0 20 0 2 0 670746922 297185280 7427 33554432000 4194304 5683644 140734628121424 18446744073709551615 274676631985 0 0 16781312 2 18446604465219701632 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 25.37
Current children cumulated vsize (KiB) 1588280

[startup+51.1003 s]
/proc/loadavg: 4.26 4.15 4.09 5/416 29431
/proc/meminfo: memFree=13887808/32951132 swapFree=67093824/67111528
[pid=29422] ppid=29420 vsize=290220 CPUtime=0.79 cores=1,3,5,7
/proc/29422/stat : 29422 (python) S 29420 29422 28742 0 -1 4202496 10116 933 1 0 71 8 0 0 20 0 2 0 670746832 297185280 7427 33554432000 4194304 5683644 140734628121424 18446744073709551615 274676635083 0 0 16781312 2 18446744073709551615 0 0 17 3 0 0 0
/proc/29422/statm: 72555 7427 1877 364 0 8473 0
[pid=29428] ppid=29422 vsize=279976 CPUtime=0.13 cores=1,3,5,7
/proc/29428/stat : 29428 (python) S 29422 29422 28742 0 -1 4202560 908 0 0 0 7 6 0 0 18 0 1 0 670746921 286695424 5923 33554432000 4194304 5683644 140734628121424 18446744073709551615 274664828431 0 0 16781312 514 16033571137438843143 0 0 17 3 0 0 0
/proc/29428/statm: 69994 5923 377 364 0 5912 0
[pid=29430] ppid=29428 vsize=1018084 CPUtime=50.11 cores=1,3,5,7
/proc/29430/stat : 29430 (gnovelty+2) R 29428 29430 29430 0 -1 4202496 552 0 0 0 5011 0 0 0 25 0 1 0 670746922 1042518016 286 33554432000 134512640 135663704 4292381600 18446744073709551615 134525316 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/29430/statm: 254521 286 113 282 0 254237 0
[pid=29422/tid=29429] ppid=29420 vsize=290220 CPUtime=0 cores=1,3,5,7
/proc/29422/task/29429/stat : 29429 (python) S 29420 29422 28742 0 -1 4202560 30 933 0 0 0 0 0 0 20 0 2 0 670746922 297185280 7427 33554432000 4194304 5683644 140734628121424 18446744073709551615 274676631985 0 0 16781312 2 18446604465219701632 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 51.03
Current children cumulated vsize (KiB) 1588280

[startup+102.315 s]
/proc/loadavg: 4.21 4.16 4.09 5/420 29436
/proc/meminfo: memFree=13877612/32951132 swapFree=67093824/67111528
[pid=29422] ppid=29420 vsize=300476 CPUtime=0.82 cores=1,3,5,7
/proc/29422/stat : 29422 (python) S 29420 29422 28742 0 -1 4202496 11002 933 1 0 74 8 0 0 19 0 3 0 670746832 307687424 7434 33554432000 4194304 5683644 140734628121424 18446744073709551615 274676635083 0 0 16781312 2 18446744073709551615 0 0 17 5 0 0 0
/proc/29422/statm: 75119 7434 1880 364 0 11034 0
[pid=29428] ppid=29422 vsize=290220 CPUtime=0.28 cores=1,3,5,7
/proc/29428/stat : 29428 (python) S 29422 29422 28742 0 -1 4202560 1084 0 0 0 14 14 0 0 19 0 2 0 670746921 297185280 5961 33554432000 4194304 5683644 140734628121424 18446744073709551615 274676635083 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/29428/statm: 72555 5961 410 364 0 8473 0
[pid=29430] ppid=29428 vsize=1018084 CPUtime=100.19 cores=1,3,5,7
/proc/29430/stat : 29430 (gnovelty+2) T 29428 29430 29430 0 -1 4202496 552 0 0 0 10019 0 0 0 25 0 1 0 670746922 1042518016 286 33554432000 134512640 135663704 4292381600 18446744073709551615 134524548 0 0 16781312 0 18446744071562691360 0 0 17 5 0 0 0
/proc/29430/statm: 254521 286 113 282 0 254237 0
[pid=29428/tid=29433] ppid=29422 vsize=290220 CPUtime=0 cores=1,3,5,7
/proc/29428/task/29433/stat : 29433 (python) S 29422 29422 28742 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 670756951 297185280 5961 33554432000 4194304 5683644 140734628121424 18446744073709551615 274676631985 0 0 16781312 514 18446604466426573248 0 0 -1 5 0 0 0
[pid=29434] ppid=29422 vsize=290232 CPUtime=0 cores=1,3,5,7
/proc/29434/stat : 29434 (python) S 29422 29422 28742 0 -1 4202560 747 0 0 0 0 0 0 0 18 0 1 0 670756953 297197568 5898 33554432000 4194304 5683644 140734628121424 18446744073709551615 274664828486 0 0 16781312 514 8887537759317623047 0 0 17 5 0 0 0
/proc/29434/statm: 72558 5898 348 364 0 8473 0
[pid=29436] ppid=29434 vsize=1018084 CPUtime=1.09 cores=1,3,5,7
/proc/29436/stat : 29436 (gnovelty+2) R 29434 29436 29436 0 -1 4202496 552 0 0 0 109 0 0 0 24 0 1 0 670756954 1042518016 287 33554432000 134512640 135663704 4289931008 18446744073709551615 134525091 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/29436/statm: 254521 287 113 282 0 254237 0
[pid=29422/tid=29429] ppid=29420 vsize=300476 CPUtime=0 cores=1,3,5,7
/proc/29422/task/29429/stat : 29429 (python) S 29420 29422 28742 0 -1 4202560 30 933 0 0 0 0 0 0 20 0 3 0 670746922 307687424 7434 33554432000 4194304 5683644 140734628121424 18446744073709551615 274676631985 0 0 16781312 2 18446604465219701632 0 0 -1 7 0 0 0
[pid=29422/tid=29435] ppid=29420 vsize=300476 CPUtime=0 cores=1,3,5,7
/proc/29422/task/29435/stat : 29435 (python) S 29420 29422 28742 0 -1 4202560 27 933 0 0 0 0 0 0 20 0 3 0 670756954 307687424 7434 33554432000 4194304 5683644 140734628121424 18446744073709551615 274676631985 0 0 16781312 2 18446604465219701632 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 102.38
Current children cumulated vsize (KiB) 2917096

[startup+162.301 s]
/proc/loadavg: 4.07 4.12 4.09 5/424 29442
/proc/meminfo: memFree=13865164/32951132 swapFree=67093824/67111528
[pid=29422] ppid=29420 vsize=300476 CPUtime=0.82 cores=1,3,5,7
/proc/29422/stat : 29422 (python) S 29420 29422 28742 0 -1 4202496 11002 933 1 0 74 8 0 0 19 0 3 0 670746832 307687424 7434 33554432000 4194304 5683644 140734628121424 18446744073709551615 274676635083 0 0 16781312 2 18446744073709551615 0 0 17 5 0 0 0
/proc/29422/statm: 75119 7434 1880 364 0 11034 0
[pid=29428] ppid=29422 vsize=290220 CPUtime=0.28 cores=1,3,5,7

################
# More data... #
################

/proc/29428/stat : 29428 (python) S 29422 29422 28742 0 -1 4202560 1084 0 0 0 14 14 0 0 19 0 2 0 670746921 297185280 5961 33554432000 4194304 5683644 140734628121424 18446744073709551615 274676635083 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/29428/statm: 72555 5961 410 364 0 8473 0
[pid=29430] ppid=29428 vsize=1018084 CPUtime=100.19 cores=1,3,5,7
/proc/29430/stat : 29430 (gnovelty+2) T 29428 29430 29430 0 -1 4202496 552 0 0 0 10019 0 0 0 25 0 1 0 670746922 1042518016 286 33554432000 134512640 135663704 4292381600 18446744073709551615 134524548 0 0 16781312 0 18446744071562691360 0 0 17 5 0 0 0
/proc/29430/statm: 254521 286 113 282 0 254237 0
[pid=29428/tid=29433] ppid=29422 vsize=290220 CPUtime=0 cores=1,3,5,7
/proc/29428/task/29433/stat : 29433 (python) S 29422 29422 28742 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 670756951 297185280 5961 33554432000 4194304 5683644 140734628121424 18446744073709551615 274676631985 0 0 16781312 514 18446604466426573248 0 0 -1 5 0 0 0
[pid=29434] ppid=29422 vsize=290232 CPUtime=0.29 cores=1,3,5,7
/proc/29434/stat : 29434 (python) S 29422 29422 28742 0 -1 4202560 1088 0 0 0 16 13 0 0 19 0 2 0 670756953 297197568 5951 33554432000 4194304 5683644 140734628121424 18446744073709551615 274676635083 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/29434/statm: 72558 5951 400 364 0 8473 0
[pid=29436] ppid=29434 vsize=1018084 CPUtime=100.3 cores=1,3,5,7
/proc/29436/stat : 29436 (gnovelty+2) T 29434 29436 29436 0 -1 4202496 552 0 0 0 10030 0 0 0 25 0 1 0 670756954 1042518016 287 33554432000 134512640 135663704 4289931008 18446744073709551615 134525688 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/29436/statm: 254521 287 113 282 0 254237 0
[pid=29434/tid=29444] ppid=29422 vsize=290232 CPUtime=0 cores=1,3,5,7
/proc/29434/task/29444/stat : 29444 (python) S 29422 29422 28742 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 670766984 297197568 5951 33554432000 4194304 5683644 140734628121424 18446744073709551615 274676631985 0 0 16781312 514 18446604459276951680 0 0 -1 1 0 0 0
[pid=29445] ppid=29422 vsize=300488 CPUtime=0.3 cores=1,3,5,7
/proc/29445/stat : 29445 (python) S 29422 29422 28742 0 -1 4202560 1087 0 0 0 15 15 0 0 19 0 2 0 670766987 307699712 5955 33554432000 4194304 5683644 140734628121424 18446744073709551615 274676635083 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/29445/statm: 75122 5955 400 364 0 11034 0
[pid=29447] ppid=29445 vsize=417056 CPUtime=100.29 cores=1,3,5,7
/proc/29447/stat : 29447 (adaptg2wsat2009) T 29445 29447 29447 0 -1 4202496 718 0 0 0 10029 0 0 0 25 0 1 0 670766987 427065344 450 33554432000 134512640 135107411 4286867904 18446744073709551615 134531696 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/29447/statm: 104264 450 59 146 0 103140 0
[pid=29445/tid=29452] ppid=29422 vsize=300488 CPUtime=0 cores=1,3,5,7
/proc/29445/task/29452/stat : 29452 (python) S 29422 29422 28742 0 -1 4202560 50 0 0 0 0 0 0 0 19 0 2 0 670777017 307699712 5955 33554432000 4194304 5683644 140734628121424 18446744073709551615 274676631985 0 0 16781312 514 18446604456893171776 0 0 -1 1 0 0 0
[pid=29453] ppid=29422 vsize=310744 CPUtime=0.29 cores=1,3,5,7
/proc/29453/stat : 29453 (python) S 29422 29422 28742 0 -1 4202560 1110 0 0 0 16 13 0 0 19 0 2 0 670777021 318201856 5959 33554432000 4194304 5683644 140734628121424 18446744073709551615 274676635083 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/29453/statm: 77686 5959 400 364 0 13595 0
[pid=29455] ppid=29453 vsize=417056 CPUtime=100.21 cores=1,3,5,7
/proc/29455/stat : 29455 (adaptg2wsat2009) T 29453 29455 29455 0 -1 4202496 721 0 0 0 10021 0 0 0 25 0 1 0 670777021 427065344 450 33554432000 134512640 135107411 4293218960 18446744073709551615 134532371 0 0 16781312 0 18446744071562691360 0 0 17 7 0 0 0
/proc/29455/statm: 104264 450 59 146 0 103140 0
[pid=29453/tid=29458] ppid=29422 vsize=310744 CPUtime=0 cores=1,3,5,7
/proc/29453/task/29458/stat : 29458 (python) S 29422 29422 28742 0 -1 4202560 51 0 0 0 0 0 0 0 19 0 2 0 670787050 318201856 5959 33554432000 4194304 5683644 140734628121424 18446744073709551615 274676631985 0 0 16781312 514 18446604458014342144 0 0 -1 1 0 0 0
[pid=29459] ppid=29422 vsize=321000 CPUtime=0.3 cores=1,3,5,7
/proc/29459/stat : 29459 (python) S 29422 29422 28742 0 -1 4202560 1126 0 0 0 15 15 0 0 19 0 2 0 670787053 328704000 5963 33554432000 4194304 5683644 140734628121424 18446744073709551615 274676635083 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/29459/statm: 80250 5963 400 364 0 16156 0
[pid=29461] ppid=29459 vsize=417056 CPUtime=99.31 cores=1,3,5,7
/proc/29461/stat : 29461 (adaptg2wsat2009) T 29459 29461 29461 0 -1 4202496 724 0 0 0 9931 0 0 0 25 0 1 0 670787054 427065344 451 33554432000 134512640 135107411 4292338112 18446744073709551615 134531942 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/29461/statm: 104264 451 59 146 0 103140 0
[pid=29459/tid=29465] ppid=29422 vsize=321000 CPUtime=0 cores=1,3,5,7
/proc/29459/task/29465/stat : 29465 (python) S 29422 29422 28742 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 670796986 328704000 5963 33554432000 4194304 5683644 140734628121424 18446744073709551615 274676631985 0 0 16781312 514 18446604465219700736 0 0 -1 7 0 0 0
[pid=29466] ppid=29422 vsize=331256 CPUtime=0.3 cores=1,3,5,7
/proc/29466/stat : 29466 (python) S 29422 29422 28742 0 -1 4202560 1124 0 0 0 16 14 0 0 19 0 2 0 670796989 339206144 5967 33554432000 4194304 5683644 140734628121424 18446744073709551615 274676635083 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/29466/statm: 82814 5967 400 364 0 18717 0
[pid=29468] ppid=29466 vsize=1018084 CPUtime=100.28 cores=1,3,5,7
/proc/29468/stat : 29468 (gnovelty+2) T 29466 29468 29468 0 -1 4202496 554 0 0 0 10028 0 0 0 25 0 1 0 670796989 1042518016 286 33554432000 134512640 135663704 4293247872 18446744073709551615 134525286 0 0 16781312 0 18446744071562691360 0 0 17 7 0 0 0
/proc/29468/statm: 254521 286 113 282 0 254237 0
[pid=29466/tid=29475] ppid=29422 vsize=331256 CPUtime=0 cores=1,3,5,7
/proc/29466/task/29475/stat : 29475 (python) S 29422 29422 28742 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 670807021 339206144 5967 33554432000 4194304 5683644 140734628121424 18446744073709551615 274676631985 0 0 16781312 514 18446604470355862528 0 0 -1 7 0 0 0
[pid=29476] ppid=29422 vsize=341512 CPUtime=0.31 cores=1,3,5,7
/proc/29476/stat : 29476 (python) S 29422 29422 28742 0 -1 4202560 1159 0 0 0 17 14 0 0 19 0 2 0 670807025 349708288 5977 33554432000 4194304 5683644 140734628121424 18446744073709551615 274676635083 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/29476/statm: 85378 5977 406 364 0 21278 0
[pid=29478] ppid=29476 vsize=247232 CPUtime=99.3 cores=1,3,5,7
/proc/29478/stat : 29478 (FH) T 29476 29478 29478 0 -1 4202496 671 0 0 0 9930 0 0 0 25 0 1 0 670807025 253165568 406 33554432000 134512640 134936988 4288716096 18446744073709551615 134554227 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/29478/statm: 61808 406 41 104 0 61312 0
[pid=29476/tid=29482] ppid=29422 vsize=341512 CPUtime=0 cores=1,3,5,7
/proc/29476/task/29482/stat : 29482 (python) S 29422 29422 28742 0 -1 4202560 97 0 0 0 0 0 0 0 19 0 2 0 670816956 349708288 5977 33554432000 4194304 5683644 140734628121424 18446744073709551615 274676631985 0 0 16781312 514 18446604464653678784 0 0 -1 7 0 0 0
[pid=29483] ppid=29422 vsize=351768 CPUtime=0.31 cores=1,3,5,7
/proc/29483/stat : 29483 (python) S 29422 29422 28742 0 -1 4202560 1171 0 0 0 17 14 0 0 19 0 2 0 670816960 360210432 5981 33554432000 4194304 5683644 140734628121424 18446744073709551615 274676635083 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/29483/statm: 87942 5981 406 364 0 23839 0
[pid=29485] ppid=29483 vsize=417056 CPUtime=99.31 cores=1,3,5,7
/proc/29485/stat : 29485 (adaptg2wsat2009) T 29483 29485 29485 0 -1 4202496 724 0 0 0 9931 0 0 0 25 0 1 0 670816960 427065344 450 33554432000 134512640 135107411 4286954864 18446744073709551615 134531942 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/29485/statm: 104264 450 59 146 0 103140 0
[pid=29483/tid=29489] ppid=29422 vsize=351768 CPUtime=0 cores=1,3,5,7
/proc/29483/task/29489/stat : 29489 (python) S 29422 29422 28742 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 670826893 360210432 5981 33554432000 4194304 5683644 140734628121424 18446744073709551615 274676631985 0 0 16781312 514 18446604458710461120 0 0 -1 1 0 0 0
[pid=29490] ppid=29422 vsize=362024 CPUtime=0.32 cores=1,3,5,7
/proc/29490/stat : 29490 (python) S 29422 29422 28742 0 -1 4202560 1134 0 0 0 17 15 0 0 19 0 2 0 670826897 370712576 5979 33554432000 4194304 5683644 140734628121424 18446744073709551615 274676635083 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/29490/statm: 90506 5979 400 364 0 26400 0
[pid=29492] ppid=29490 vsize=417056 CPUtime=100.32 cores=1,3,5,7
/proc/29492/stat : 29492 (adaptg2wsat2009) T 29490 29492 29492 0 -1 4202496 719 0 0 0 10032 0 0 0 25 0 1 0 670826897 427065344 449 33554432000 134512640 135107411 4292623936 18446744073709551615 134531942 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/29492/statm: 104264 449 59 146 0 103140 0
[pid=29490/tid=29496] ppid=29422 vsize=362024 CPUtime=0 cores=1,3,5,7
/proc/29490/task/29496/stat : 29496 (python) S 29422 29422 28742 0 -1 4202560 51 0 0 0 0 0 0 0 19 0 2 0 670836929 370712576 5979 33554432000 4194304 5683644 140734628121424 18446744073709551615 274676631985 0 0 16781312 514 18446604459276952576 0 0 -1 1 0 0 0
[pid=29497] ppid=29422 vsize=372280 CPUtime=0.61 cores=1,3,5,7
/proc/29497/stat : 29497 (python) S 29422 29422 28742 0 -1 4202560 1169 0 0 0 35 26 0 0 19 0 2 0 670836933 381214720 5983 33554432000 4194304 5683644 140734628121424 18446744073709551615 274676635083 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/29497/statm: 93070 5983 400 364 0 28961 0
[pid=29499] ppid=29497 vsize=268424 CPUtime=194.57 cores=1,3,5,7
/proc/29499/stat : 29499 (hybridGM3) T 29497 29499 29499 0 -1 4202496 4922 0 0 0 19457 0 0 0 25 0 1 0 670836933 274866176 4650 33554432000 134512640 135204385 4292654096 18446744073709551615 134536656 0 0 16781312 0 18446744071562691360 0 0 17 5 0 0 0
/proc/29499/statm: 67106 4650 64 169 0 66936 0
[pid=29497/tid=29509] ppid=29422 vsize=372280 CPUtime=0 cores=1,3,5,7
/proc/29497/task/29509/stat : 29509 (python) S 29422 29422 28742 0 -1 4202560 50 0 0 0 0 0 0 0 19 0 2 0 670856398 381214720 5983 33554432000 4194304 5683644 140734628121424 18446744073709551615 274676631985 0 0 16781312 514 18446604458710460224 0 0 -1 7 0 0 0
[pid=29510] ppid=29422 vsize=382536 CPUtime=0.32 cores=1,3,5,7
/proc/29510/stat : 29510 (python) S 29422 29422 28742 0 -1 4202560 1127 0 0 0 17 15 0 0 18 0 2 0 670856401 391716864 5987 33554432000 4194304 5683644 140734628121424 18446744073709551615 274676635083 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/29510/statm: 95634 5987 400 364 0 31522 0
[pid=29512] ppid=29510 vsize=247232 CPUtime=99.32 cores=1,3,5,7
/proc/29512/stat : 29512 (FH) T 29510 29512 29512 0 -1 4202496 676 0 0 0 9932 0 0 0 25 0 1 0 670856402 253165568 406 33554432000 134512640 134936988 4288001536 18446744073709551615 134553480 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/29512/statm: 61808 406 41 104 0 61312 0
[pid=29510/tid=29516] ppid=29422 vsize=382536 CPUtime=0 cores=1,3,5,7
/proc/29510/task/29516/stat : 29516 (python) S 29422 29422 28742 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 670866334 391716864 5987 33554432000 4194304 5683644 140734628121424 18446744073709551615 274676631985 0 0 16781312 514 18446604464653677888 0 0 -1 7 0 0 0
[pid=29517] ppid=29422 vsize=392792 CPUtime=9.29 cores=1,3,5,7
/proc/29517/stat : 29517 (python) S 29422 29422 28742 0 -1 4202560 1178 0 0 0 482 447 0 0 15 0 2 0 670866338 402219008 5991 33554432000 4194304 5683644 140734628121424 18446744073709551615 274664828486 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/29517/statm: 98198 5991 400 364 0 34083 0
[pid=29519] ppid=29517 vsize=309592 CPUtime=2809.17 cores=1,3,5,7
/proc/29519/stat : 29519 (march_hi) R 29517 29519 29519 0 -1 4202496 69832 0 0 0 280889 28 0 0 25 0 1 0 670866338 317022208 68734 33554432000 4194304 4955518 140735733251008 18446744073709551615 4208667 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/29519/statm: 77398 68734 106 186 0 77211 0
[pid=29517/tid=29535] ppid=29422 vsize=392792 CPUtime=0 cores=1,3,5,7
/proc/29517/task/29535/stat : 29535 (python) S 29422 29422 28742 0 -1 4202560 47 0 0 0 0 0 0 0 15 0 2 0 670915033 402219008 5991 33554432000 4194304 5683644 140734628121424 18446744073709551615 274676631985 0 0 16781312 514 18446604455194326208 0 0 -1 1 0 0 0
[pid=29545] ppid=29422 vsize=403048 CPUtime=2.28 cores=1,3,5,7
/proc/29545/stat : 29545 (python) S 29422 29422 28742 0 -1 4202560 1186 0 0 0 119 109 0 0 16 0 2 0 670944049 412721152 5995 33554432000 4194304 5683644 140734628121424 18446744073709551615 274676635083 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/29545/statm: 100762 5995 400 364 0 36644 0
[pid=29547] ppid=29545 vsize=93528 CPUtime=684.94 cores=1,3,5,7
/proc/29547/stat : 29547 (march_hi) T 29545 29547 29547 0 -1 4202496 19571 0 0 0 68490 4 0 0 25 0 1 0 670944050 95772672 18480 33554432000 4194304 4955518 140735520369792 18446744073709551615 4237786 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/29547/statm: 23382 18480 106 186 0 23195 0
[pid=29545/tid=29559] ppid=29422 vsize=403048 CPUtime=0 cores=1,3,5,7
/proc/29545/task/29559/stat : 29559 (python) S 29422 29422 28742 0 -1 4202560 47 0 0 0 0 0 0 0 15 0 2 0 670982912 412721152 5995 33554432000 4194304 5683644 140734628121424 18446744073709551615 274676631985 0 0 16781312 514 18446604455194328000 0 0 -1 7 0 0 0
[pid=29579] ppid=29422 vsize=413304 CPUtime=0.32 cores=1,3,5,7
/proc/29579/stat : 29579 (python) S 29422 29422 28742 0 -1 4202560 1153 0 0 0 17 15 0 0 19 0 2 0 671012594 423223296 6017 33554432000 4194304 5683644 140734628121424 18446744073709551615 274676635083 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/29579/statm: 103326 6017 400 364 0 39205 0
[pid=29581] ppid=29579 vsize=1018084 CPUtime=100.33 cores=1,3,5,7
/proc/29581/stat : 29581 (gnovelty+2) T 29579 29581 29581 0 -1 4202496 557 0 0 0 10033 0 0 0 25 0 1 0 671012594 1042518016 287 33554432000 134512640 135663704 4293404384 18446744073709551615 134525213 0 0 16781312 0 18446744071562691360 0 0 17 5 0 0 0
/proc/29581/statm: 254521 287 113 282 0 254237 0
[pid=29579/tid=29585] ppid=29422 vsize=413304 CPUtime=0 cores=1,3,5,7
/proc/29579/task/29585/stat : 29585 (python) S 29422 29422 28742 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 671022628 423223296 6017 33554432000 4194304 5683644 140734628121424 18446744073709551615 274676631985 0 0 16781312 514 18446604456305987968 0 0 -1 7 0 0 0
[pid=29586] ppid=29422 vsize=423560 CPUtime=0.63 cores=1,3,5,7
/proc/29586/stat : 29586 (python) S 29422 29422 28742 0 -1 4202560 1215 0 0 0 31 32 0 0 19 0 2 0 671022630 433725440 6028 33554432000 4194304 5683644 140734628121424 18446744073709551615 274676635083 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/29586/statm: 105890 6028 407 364 0 41766 0
[pid=29588] ppid=29586 vsize=268428 CPUtime=194.66 cores=1,3,5,7
/proc/29588/stat : 29588 (hybridGM3) T 29586 29588 29588 0 -1 4202496 4926 0 0 0 19466 0 0 0 25 0 1 0 671022631 274870272 4650 33554432000 134512640 135204385 4287580384 18446744073709551615 134537272 0 0 16781312 0 18446744071562691360 0 0 17 5 0 0 0
/proc/29588/statm: 67107 4650 64 169 0 66937 0
[pid=29586/tid=29597] ppid=29422 vsize=423560 CPUtime=0 cores=1,3,5,7
/proc/29586/task/29597/stat : 29597 (python) S 29422 29422 28742 0 -1 4202560 45 0 0 0 0 0 0 0 19 0 2 0 671042098 433725440 6028 33554432000 4194304 5683644 140734628121424 18446744073709551615 274676631985 0 0 16781312 514 18446604466083750272 0 0 -1 7 0 0 0
[pid=29422/tid=29429] ppid=29420 vsize=433804 CPUtime=0 cores=1,3,5,7
/proc/29422/task/29429/stat : 29429 (python) S 29420 29422 28742 0 -1 4202560 30 933 0 0 0 0 0 0 20 0 16 0 670746922 444215296 7534 33554432000 4194304 5683644 140734628121424 18446744073709551615 274676631985 0 0 16781312 2 18446604465219701632 0 0 -1 7 0 0 0
[pid=29422/tid=29435] ppid=29420 vsize=433804 CPUtime=0 cores=1,3,5,7
/proc/29422/task/29435/stat : 29435 (python) S 29420 29422 28742 0 -1 4202560 27 933 0 0 0 0 0 0 20 0 16 0 670756954 444215296 7534 33554432000 4194304 5683644 140734628121424 18446744073709551615 274676631985 0 0 16781312 2 18446604465219701632 0 0 -1 5 0 0 0
[pid=29422/tid=29446] ppid=29420 vsize=433804 CPUtime=0 cores=1,3,5,7
/proc/29422/task/29446/stat : 29446 (python) S 29420 29422 28742 0 -1 4202560 23 933 0 0 0 0 0 0 20 0 16 0 670766987 444215296 7534 33554432000 4194304 5683644 140734628121424 18446744073709551615 274676631985 0 0 16781312 2 18446604465219701632 0 0 -1 7 0 0 0
[pid=29422/tid=29454] ppid=29420 vsize=433804 CPUtime=0 cores=1,3,5,7
/proc/29422/task/29454/stat : 29454 (python) S 29420 29422 28742 0 -1 4202560 24 933 0 0 0 0 0 0 20 0 16 0 670777021 444215296 7534 33554432000 4194304 5683644 140734628121424 18446744073709551615 274676631985 0 0 16781312 2 18446604465219701632 0 0 -1 7 0 0 0
[pid=29422/tid=29460] ppid=29420 vsize=433804 CPUtime=0 cores=1,3,5,7
/proc/29422/task/29460/stat : 29460 (python) S 29420 29422 28742 0 -1 4202560 30 933 0 0 0 0 0 0 20 0 16 0 670787053 444215296 7534 33554432000 4194304 5683644 140734628121424 18446744073709551615 274676631985 0 0 16781312 2 18446604465219701632 0 0 -1 1 0 0 0
[pid=29422/tid=29467] ppid=29420 vsize=433804 CPUtime=0 cores=1,3,5,7
/proc/29422/task/29467/stat : 29467 (python) S 29420 29422 28742 0 -1 4202560 31 933 0 0 0 0 0 0 20 0 16 0 670796989 444215296 7534 33554432000 4194304 5683644 140734628121424 18446744073709551615 274676631985 0 0 16781312 2 18446604465219701632 0 0 -1 1 0 0 0
[pid=29422/tid=29477] ppid=29420 vsize=433804 CPUtime=0 cores=1,3,5,7
/proc/29422/task/29477/stat : 29477 (python) S 29420 29422 28742 0 -1 4202560 29 933 0 0 0 0 0 0 20 0 16 0 670807025 444215296 7534 33554432000 4194304 5683644 140734628121424 18446744073709551615 274676631985 0 0 16781312 2 18446604465219701632 0 0 -1 1 0 0 0
[pid=29422/tid=29484] ppid=29420 vsize=433804 CPUtime=0 cores=1,3,5,7
/proc/29422/task/29484/stat : 29484 (python) S 29420 29422 28742 0 -1 4202560 26 933 0 0 0 0 0 0 20 0 16 0 670816960 444215296 7534 33554432000 4194304 5683644 140734628121424 18446744073709551615 274676631985 0 0 16781312 2 18446604465219701632 0 0 -1 7 0 0 0
[pid=29422/tid=29491] ppid=29420 vsize=433804 CPUtime=0 cores=1,3,5,7
/proc/29422/task/29491/stat : 29491 (python) S 29420 29422 28742 0 -1 4202560 29 933 0 0 0 0 0 0 20 0 16 0 670826897 444215296 7534 33554432000 4194304 5683644 140734628121424 18446744073709551615 274676631985 0 0 16781312 2 18446604465219701632 0 0 -1 7 0 0 0
[pid=29422/tid=29498] ppid=29420 vsize=433804 CPUtime=0 cores=1,3,5,7
/proc/29422/task/29498/stat : 29498 (python) S 29420 29422 28742 0 -1 4202560 28 933 0 0 0 0 0 0 20 0 16 0 670836933 444215296 7534 33554432000 4194304 5683644 140734628121424 18446744073709551615 274676631985 0 0 16781312 2 18446604465219701632 0 0 -1 1 0 0 0
[pid=29422/tid=29511] ppid=29420 vsize=433804 CPUtime=0 cores=1,3,5,7
/proc/29422/task/29511/stat : 29511 (python) S 29420 29422 28742 0 -1 4202560 30 933 0 0 0 0 0 0 20 0 16 0 670856401 444215296 7534 33554432000 4194304 5683644 140734628121424 18446744073709551615 274676631985 0 0 16781312 2 18446604465219701632 0 0 -1 1 0 0 0
[pid=29422/tid=29518] ppid=29420 vsize=433804 CPUtime=0 cores=1,3,5,7
/proc/29422/task/29518/stat : 29518 (python) S 29420 29422 28742 0 -1 4202560 30 933 0 0 0 0 0 0 15 0 16 0 670866338 444215296 7534 33554432000 4194304 5683644 140734628121424 18446744073709551615 274676631985 0 0 16781312 2 18446604465219701632 0 0 -1 1 0 0 0
[pid=29422/tid=29546] ppid=29420 vsize=433804 CPUtime=0 cores=1,3,5,7
/proc/29422/task/29546/stat : 29546 (python) S 29420 29422 28742 0 -1 4202560 27 933 0 0 0 0 0 0 18 0 16 0 670944050 444215296 7534 33554432000 4194304 5683644 140734628121424 18446744073709551615 274676631985 0 0 16781312 2 18446604465219701632 0 0 -1 1 0 0 0
[pid=29422/tid=29580] ppid=29420 vsize=433804 CPUtime=0 cores=1,3,5,7
/proc/29422/task/29580/stat : 29580 (python) S 29420 29422 28742 0 -1 4202560 29 933 0 0 0 0 0 0 20 0 16 0 671012594 444215296 7534 33554432000 4194304 5683644 140734628121424 18446744073709551615 274676631985 0 0 16781312 2 18446604465219701632 0 0 -1 1 0 0 0
[pid=29422/tid=29587] ppid=29420 vsize=433804 CPUtime=0 cores=1,3,5,7
/proc/29422/task/29587/stat : 29587 (python) S 29420 29422 28742 0 -1 4202560 25 933 0 0 0 0 0 0 20 0 16 0 671022630 444215296 7534 33554432000 4194304 5683644 140734628121424 18446744073709551615 274676631985 0 0 16781312 2 18446604465219701632 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 5000.08
Current children cumulated vsize (KiB) 13312620

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 29422 and gives
#  childrusage.ru_utime.tv_sec=1
#  childrusage.ru_utime.tv_usec=316799
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=125980
# CPU time returned by wait4() is 1.44278
# while last known CPU time is 5000.08
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 4989.72
CPU time (s): 5000.08
CPU user time (s): 4991.93
CPU system time (s): 8.15
CPU usage (%): 100.208
Max. virtual memory (cumulated for all children) (KiB): 13312624

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1.3168
system time used= 0.12598
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 25326
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1067
involuntary context switches= 38

runsolver used 35.0007 second user time and 75.5655 second system time

The end

Launcher Data 

Begin job on node131 at 2011-05-17 02:17:52
IDJOB=3386763
IDBENCH=82828
IDSOLVER=1872
FILE ID=node131/3386763-1305591472
RUNJOBID= node131-1305586144-28761
PBS_JOBID= 13350347
Free space on /tmp= 73524 MiB

SOLVER NAME= borg-sat 11.03.02-seq-random (fixed)
BENCH NAME= SAT11/random/medium/unif-k7-r89-v80-c7120-S1980280938-088.UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3386763-1305591472/watcher-3386763-1305591472 -o /tmp/evaluation-result-3386763-1305591472/solver-3386763-1305591472 -C 5000 -W 5100 -M 15500  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3386763-1305591472.cnf -seed 1906858759 -budget 5000

TIME LIMIT= 5000 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 4fa782cc700b96dfddf41b0ed3b14006
RANDOM SEED=1906858759

node131.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951132 kB
MemFree:      13919592 kB
Buffers:        313968 kB
Cached:        4830132 kB
SwapCached:       1504 kB
Active:       15054136 kB
Inactive:      3682192 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951132 kB
LowFree:      13919592 kB
SwapTotal:    67111528 kB
SwapFree:     67093824 kB
Dirty:           32016 kB
Writeback:           8 kB
AnonPages:    13590444 kB
Mapped:          40784 kB
Slab:           173888 kB
PageTables:      53296 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587092 kB
Committed_AS: 82002500 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296000 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73488 MiB
End job on node131 at 2011-05-17 03:41:04