Trace number 3385597

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-par-random (fixed)SAT 48.3007 9.59257

General information on the benchmark

Namerandom/medium/
unif-k5-r21.3-v150-c3195-S259896945-079.SATISFIABLE.cnf
MD5SUMaf1e3a30945401f0fc52ffcd9f70aa15
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark0.082987
Satisfiable
(Un)Satisfiability was proved
Number of variables150
Number of clauses3195
Sum of the clauses size15975
Maximum clause length5
Minimum clause length5
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 53195
Number of clauses of size over 50

Solver Data 

0.36/0.63	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.36/0.63	c INFO: solving HOME/instance-3385597-1305570126.cnf
0.36/0.63	c INFO: computing task features
0.36/0.65	c INFO: computed variable-clause graph statistics
0.36/0.65	c INFO: computed clause balance statistics
0.44/0.73	c INFO: computed variable balance statistics
0.44/0.77	c INFO: computed small-clause counts
0.44/0.77	c INFO: computed Horn-clause counts
0.44/0.78	c INFO: computed variable graph statistics
0.44/0.78	c INFO: collected features for HOME/instance-3385597-1305570126.cnf in 0.15 s
0.55/0.81	c INFO: running gnovelty+2@0 for 97 with 4999 remaining (b = 0.63)
0.55/0.84	c INFO: running gnovelty+2@0 for 97 with 4999 remaining (b = 0.08)
0.55/0.87	c INFO: running march_hi@0 for 679 with 4999 remaining (b = 0.35)
0.63/0.91	c INFO: running march_hi@0 for 679 with 4999 remaining (b = 0.32)
0.63/0.94	c INFO: running march_hi@0 for 485 with 4999 remaining (b = 0.24)
0.63/0.97	c INFO: running march_hi@0 for 485 with 4999 remaining (b = 0.21)
0.63/1.01	c INFO: running march_hi@0 for 388 with 4999 remaining (b = 0.16)
1.30/1.04	c INFO: running adaptg2wsat2009++@0 for 97 with 4999 remaining (b = 0.03)
47.77/9.56	s SATISFIABLE
47.77/9.56	v -1 -2 -3 -4 -5 6 -7 -8 9 10 11 12 13 14 15 -16 17 18 -19 -20 -21 22 -23 24 25 -26 -27 -28 -29 -30 31 32 33 -34 35 -36 -37 38 -39 -40 41 -42 43 44 45 46 -47 48 49 50 -51 52 -53 -54 -55 -56 -57 -58 59 60 -61 -62 63 -64 -65 66 -67 -68 -69 -70 71 -72 -73 -74 -75 -76 -77 78 -79 -80 -81 82 83 84 -85 -86 87 88 89 90 -91 -92 93 -94 -95 -96 -97 98 99 -100 -101 102 -103 104 105 106 -107 -108 109 -110 -111 112 -113 114 -115 -116 -117 118 119 120 -121 122 123 -124 -125 -126 -127 -128 -129 130 -131 -132 -133 -134 135 136 137 138 139 -140 -141 -142 -143 144 145 146 -147 148 149 -150 0

Verifier Data 

OK

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3385597-1305570126/watcher-3385597-1305570126 -o /tmp/evaluation-result-3385597-1305570126/solver-3385597-1305570126 -C 40000 -W 5100 -M 31000 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3385597-1305570126.cnf -seed 930569595 -budget 40000 -cores 8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 11.07 11.12 10.93 4/353 25887
/proc/meminfo: memFree=15021084/32951124 swapFree=52307772/67111528
[pid=25887] ppid=25885 vsize=15772 CPUtime=0 cores=0-7
/proc/25887/stat : 25887 (python) S 25885 25887 25102 0 -1 4202496 933 0 0 0 0 0 0 0 20 0 1 0 668615398 16150528 813 33554432000 4194304 5683644 140734689516944 18446744073709551615 218370955264 0 2147483391 16781312 2 18446744071699199166 0 0 17 4 0 0 0
/proc/25887/statm: 3943 813 356 364 0 430 0

[startup+0.086452 s]
/proc/loadavg: 11.07 11.12 10.93 4/353 25887
/proc/meminfo: memFree=15021084/32951124 swapFree=52307772/67111528
[pid=25887] ppid=25885 vsize=56776 CPUtime=0.04 cores=0-7
/proc/25887/stat : 25887 (python) S 25885 25887 25102 0 -1 4202496 2100 0 0 0 3 1 0 0 20 0 1 0 668615398 58138624 1856 33554432000 4194304 5683644 140734689516944 18446744073709551615 218370955264 0 2147483391 16781312 2 18446744071699199166 0 0 17 4 0 0 0
/proc/25887/statm: 14194 1856 499 364 0 1317 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 56776

[startup+0.10045 s]
/proc/loadavg: 11.07 11.12 10.93 4/353 25887
/proc/meminfo: memFree=15021084/32951124 swapFree=52307772/67111528
[pid=25887] ppid=25885 vsize=93956 CPUtime=0.05 cores=0-7
/proc/25887/stat : 25887 (python) S 25885 25887 25102 0 -1 4202496 2690 0 0 0 4 1 0 0 17 0 1 0 668615398 96210944 2406 33554432000 4194304 5683644 140734689516944 18446744073709551615 218370953061 0 2147483391 16781312 2 18446744071699199166 0 0 17 4 0 0 0
/proc/25887/statm: 23489 2406 764 364 0 1621 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 93956

[startup+0.300413 s]
/proc/loadavg: 11.07 11.12 10.93 4/353 25887
/proc/meminfo: memFree=15021084/32951124 swapFree=52307772/67111528
[pid=25887] ppid=25885 vsize=135748 CPUtime=0.17 cores=0-7
/proc/25887/stat : 25887 (python) S 25885 25887 25102 0 -1 4202496 5964 934 1 0 12 5 0 0 18 0 1 0 668615398 139005952 4151 33554432000 4194304 5683644 140734689516944 18446744073709551615 218370953221 0 2147483391 16781312 2 18446744071699199166 0 0 17 4 0 0 0
/proc/25887/statm: 33937 4151 1032 364 0 3123 0
Current children cumulated CPU time (s) 0.17
Current children cumulated vsize (KiB) 135748

[startup+0.700345 s]
/proc/loadavg: 11.07 11.12 10.93 4/353 25887
/proc/meminfo: memFree=15021084/32951124 swapFree=52307772/67111528
[pid=25887] ppid=25885 vsize=278652 CPUtime=0.44 cores=0-7
/proc/25887/stat : 25887 (python) R 25885 25887 25102 0 -1 4202496 9486 934 1 0 34 10 0 0 17 0 1 0 668615398 285339648 7060 33554432000 4194304 5683644 140734689516944 18446744073709551615 47667579302080 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/25887/statm: 69663 7060 1826 364 0 5587 0
Current children cumulated CPU time (s) 0.44
Current children cumulated vsize (KiB) 278652

[startup+1.50116 s]
/proc/loadavg: 11.07 11.12 10.93 11/371 25909
/proc/meminfo: memFree=14972332/32951124 swapFree=52307772/67111528
[pid=25887] ppid=25885 vsize=360796 CPUtime=0.78 cores=0-7
/proc/25887/stat : 25887 (python) S 25885 25887 25102 0 -1 4202496 15938 934 1 0 66 12 0 0 25 0 9 0 668615398 369455104 7174 33554432000 4194304 5683644 140734689516944 18446744073709551615 218382783947 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/25887/statm: 90199 7174 1889 364 0 26096 0
[pid=25893] ppid=25887 vsize=278676 CPUtime=0 cores=0-7
/proc/25893/stat : 25893 (python) S 25887 25887 25102 0 -1 4202560 735 0 0 0 0 0 0 0 18 0 1 0 668615479 285364224 5588 33554432000 4194304 5683644 140734689516944 18446744073709551615 218370977295 0 0 16781312 514 14769479115954192383 0 0 17 4 0 0 0
/proc/25893/statm: 69669 5588 354 364 0 5587 0
[pid=25895] ppid=25893 vsize=1017940 CPUtime=0.67 cores=0-7
/proc/25895/stat : 25895 (gnovelty+2) R 25893 25895 25895 0 -1 4202496 454 0 0 0 67 0 0 0 21 0 1 0 668615480 1042370560 191 33554432000 134512640 135663704 4288793840 18446744073709551615 134524498 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/25895/statm: 254485 191 113 282 0 254201 0
[pid=25896] ppid=25887 vsize=289304 CPUtime=0 cores=0-7
/proc/25896/stat : 25896 (python) S 25887 25887 25102 0 -1 4202560 740 0 0 0 0 0 0 0 20 0 1 0 668615483 296247296 5684 33554432000 4194304 5683644 140734689516944 18446744073709551615 218370977350 0 0 16781312 514 7002518257106157567 0 0 17 0 0 0 0
/proc/25896/statm: 72326 5684 348 364 0 8241 0
[pid=25898] ppid=25896 vsize=1017940 CPUtime=0.42 cores=0-7
/proc/25898/stat : 25898 (gnovelty+2) R 25896 25898 25898 0 -1 4202496 453 0 0 0 42 0 0 0 23 0 1 0 668615483 1042370560 191 33554432000 134512640 135663704 4293006224 18446744073709551615 134525278 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/25898/statm: 254485 191 113 282 0 254201 0
[pid=25899] ppid=25887 vsize=299188 CPUtime=0 cores=0-7
/proc/25899/stat : 25899 (python) S 25887 25887 25102 0 -1 4202560 760 0 0 0 0 0 0 0 17 0 1 0 668615486 306368512 5592 33554432000 4194304 5683644 140734689516944 18446744073709551615 218370977350 0 0 16781312 514 7865070560567329031 0 0 17 6 0 0 0
/proc/25899/statm: 74797 5592 348 364 0 10709 0
[pid=25901] ppid=25899 vsize=2124 CPUtime=0.61 cores=0-7
/proc/25901/stat : 25901 (march_hi) R 25899 25901 25901 0 -1 4202496 623 0 0 0 61 0 0 0 25 0 1 0 668615486 2174976 350 33554432000 4194304 4955518 140736418082848 18446744073709551615 4244434 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/25901/statm: 531 350 106 186 0 344 0
[pid=25902] ppid=25887 vsize=309984 CPUtime=0 cores=0-7
/proc/25902/stat : 25902 (python) S 25887 25887 25102 0 -1 4202560 766 0 0 0 0 0 0 0 20 0 1 0 668615489 317423616 5717 33554432000 4194304 5683644 140734689516944 18446744073709551615 218370977350 0 0 16781312 514 17151514982437847299 0 0 17 6 0 0 0
/proc/25902/statm: 77496 5717 348 364 0 13405 0
[pid=25904] ppid=25902 vsize=1980 CPUtime=0.32 cores=0-7
/proc/25904/stat : 25904 (march_hi) R 25902 25904 25904 0 -1 4202496 572 0 0 0 32 0 0 0 25 0 1 0 668615490 2027520 300 33554432000 4194304 4955518 140737036083936 18446744073709551615 4237810 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/25904/statm: 495 300 106 186 0 308 0
[pid=25905] ppid=25887 vsize=320240 CPUtime=0 cores=0-7
/proc/25905/stat : 25905 (python) S 25887 25887 25102 0 -1 4202560 774 0 0 0 0 0 0 0 16 0 1 0 668615492 327925760 5721 33554432000 4194304 5683644 140734689516944 18446744073709551615 218370977350 0 0 16781312 514 3000747556402594049 0 0 17 1 0 0 0
/proc/25905/statm: 80060 5721 348 364 0 15966 0
[pid=25907] ppid=25905 vsize=1980 CPUtime=0.25 cores=0-7
/proc/25907/stat : 25907 (march_hi) R 25905 25907 25907 0 -1 4202496 567 0 0 0 25 0 0 0 21 0 1 0 668615495 2027520 295 33554432000 4194304 4955518 140736424254016 18446744073709551615 4297451 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/25907/statm: 495 295 106 186 0 308 0
[pid=25908] ppid=25887 vsize=330496 CPUtime=0 cores=0-7
/proc/25908/stat : 25908 (python) S 25887 25887 25102 0 -1 4202560 773 0 0 0 0 0 0 0 17 0 1 0 668615496 338427904 5725 33554432000 4194304 5683644 140734689516944 18446744073709551615 218370977350 0 0 16781312 514 16707633342211653891 0 0 17 0 0 0 0
/proc/25908/statm: 82624 5725 348 364 0 18527 0
[pid=25887/tid=25894] ppid=25885 vsize=360796 CPUtime=0 cores=0-7
/proc/25887/task/25894/stat : 25894 (python) S 25885 25887 25102 0 -1 4202560 27 934 0 0 0 0 0 0 19 0 9 0 668615480 369455104 7174 33554432000 4194304 5683644 140734689516944 18446744073709551615 218382780849 0 0 16781312 2 18446604443274430656 0 0 -1 4 0 0 0
[pid=25887/tid=25897] ppid=25885 vsize=360796 CPUtime=0 cores=0-7
/proc/25887/task/25897/stat : 25897 (python) S 25885 25887 25102 0 -1 4202560 20 934 0 0 0 0 0 0 18 0 9 0 668615483 369455104 7174 33554432000 4194304 5683644 140734689516944 18446744073709551615 218382780849 0 0 16781312 2 18446604443274430656 0 0 -1 4 0 0 0
[pid=25887/tid=25900] ppid=25885 vsize=360796 CPUtime=0 cores=0-7
/proc/25887/task/25900/stat : 25900 (python) S 25885 25887 25102 0 -1 4202560 19 934 0 0 0 0 0 0 23 0 9 0 668615486 369455104 7174 33554432000 4194304 5683644 140734689516944 18446744073709551615 218382780849 0 0 16781312 2 18446604443274430656 0 0 -1 0 0 0 0
[pid=25887/tid=25903] ppid=25885 vsize=360796 CPUtime=0 cores=0-7
/proc/25887/task/25903/stat : 25903 (python) S 25885 25887 25102 0 -1 4202560 27 934 0 0 0 0 0 0 25 0 9 0 668615489 369455104 7174 33554432000 4194304 5683644 140734689516944 18446744073709551615 218382780849 0 0 16781312 2 18446604443274430656 0 0 -1 6 0 0 0
[pid=25887/tid=25906] ppid=25885 vsize=360796 CPUtime=0 cores=0-7
/proc/25887/task/25906/stat : 25906 (python) S 25885 25887 25102 0 -1 4202560 25 934 0 0 0 0 0 0 20 0 9 0 668615493 369455104 7174 33554432000 4194304 5683644 140734689516944 18446744073709551615 218382780849 0 0 16781312 2 18446604443274430656 0 0 -1 0 0 0 0
[pid=25887/tid=25909] ppid=25885 vsize=360796 CPUtime=0 cores=0-7
/proc/25887/task/25909/stat : 25909 (python) S 25885 25887 25102 0 -1 4202560 21 934 0 0 0 0 0 0 22 0 9 0 668615496 369455104 7174 33554432000 4194304 5683644 140734689516944 18446744073709551615 218382780849 0 0 16781312 2 18446604443274430656 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3.05
Current children cumulated vsize (KiB) 4230648

[startup+3.10088 s]
/proc/loadavg: 11.23 11.16 10.94 12/378 25916
/proc/meminfo: memFree=14961372/32951124 swapFree=52307772/67111528
[pid=25887] ppid=25885 vsize=360796 CPUtime=0.78 cores=0-7
/proc/25887/stat : 25887 (python) S 25885 25887 25102 0 -1 4202496 15938 934 1 0 66 12 0 0 25 0 9 0 668615398 369455104 7174 33554432000 4194304 5683644 140734689516944 18446744073709551615 218382783947 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/25887/statm: 90199 7174 1889 364 0 26096 0
[pid=25893] ppid=25887 vsize=278676 CPUtime=0 cores=0-7
/proc/25893/stat : 25893 (python) S 25887 25887 25102 0 -1 4202560 735 0 0 0 0 0 0 0 18 0 1 0 668615479 285364224 5588 33554432000 4194304 5683644 140734689516944 18446744073709551615 218370977295 0 0 16781312 514 14769479115954159875 0 0 17 4 0 0 0
/proc/25893/statm: 69669 5588 354 364 0 5587 0
[pid=25895] ppid=25893 vsize=1017940 CPUtime=2.25 cores=0-7
/proc/25895/stat : 25895 (gnovelty+2) R 25893 25895 25895 0 -1 4202496 454 0 0 0 225 0 0 0 25 0 1 0 668615480 1042370560 191 33554432000 134512640 135663704 4288793840 18446744073709551615 134524945 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/25895/statm: 254485 191 113 282 0 254201 0
[pid=25896] ppid=25887 vsize=289304 CPUtime=0 cores=0-7
/proc/25896/stat : 25896 (python) S 25887 25887 25102 0 -1 4202560 740 0 0 0 0 0 0 0 18 0 1 0 668615483 296247296 5684 33554432000 4194304 5683644 140734689516944 18446744073709551615 218370977350 0 0 16781312 514 7002518257106125058 0 0 17 0 0 0 0
/proc/25896/statm: 72326 5684 348 364 0 8241 0
[pid=25898] ppid=25896 vsize=1017940 CPUtime=1.22 cores=0-7
/proc/25898/stat : 25898 (gnovelty+2) R 25896 25898 25898 0 -1 4202496 453 0 0 0 122 0 0 0 25 0 1 0 668615483 1042370560 191 33554432000 134512640 135663704 4293006224 18446744073709551615 134525286 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/25898/statm: 254485 191 113 282 0 254201 0
[pid=25899] ppid=25887 vsize=299188 CPUtime=0 cores=0-7
/proc/25899/stat : 25899 (python) S 25887 25887 25102 0 -1 4202560 761 0 0 0 0 0 0 0 15 0 1 0 668615486 306368512 5592 33554432000 4194304 5683644 140734689516944 18446744073709551615 218370977350 0 0 16781312 514 7865070560567329031 0 0 17 6 0 0 0
/proc/25899/statm: 74797 5592 348 364 0 10709 0
[pid=25901] ppid=25899 vsize=2604 CPUtime=2.21 cores=0-7
/proc/25901/stat : 25901 (march_hi) R 25899 25901 25901 0 -1 4202496 718 0 0 0 221 0 0 0 25 0 1 0 668615486 2666496 445 33554432000 4194304 4955518 140736418082848 18446744073709551615 4237804 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/25901/statm: 651 445 106 186 0 464 0
[pid=25902] ppid=25887 vsize=309984 CPUtime=0 cores=0-7
/proc/25902/stat : 25902 (python) S 25887 25887 25102 0 -1 4202560 767 0 0 0 0 0 0 0 15 0 1 0 668615489 317423616 5717 33554432000 4194304 5683644 140734689516944 18446744073709551615 218370977350 0 0 16781312 514 14769475267663495167 0 0 17 6 0 0 0
/proc/25902/statm: 77496 5717 348 364 0 13405 0
[pid=25904] ppid=25902 vsize=2224 CPUtime=1.12 cores=0-7
/proc/25904/stat : 25904 (march_hi) R 25902 25904 25904 0 -1 4202496 654 0 0 0 112 0 0 0 25 0 1 0 668615490 2277376 380 33554432000 4194304 4955518 140737036083936 18446744073709551615 4208784 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/25904/statm: 556 380 106 186 0 369 0
[pid=25905] ppid=25887 vsize=320240 CPUtime=0 cores=0-7
/proc/25905/stat : 25905 (python) S 25887 25887 25102 0 -1 4202560 778 0 0 0 0 0 0 0 15 0 1 0 668615492 327925760 5721 33554432000 4194304 5683644 140734689516944 18446744073709551615 218370977350 0 0 16781312 514 14241632995394977791 0 0 17 1 0 0 0
/proc/25905/statm: 80060 5721 348 364 0 15966 0
[pid=25907] ppid=25905 vsize=2224 CPUtime=1.05 cores=0-7
/proc/25907/stat : 25907 (march_hi) R 25905 25907 25907 0 -1 4202496 651 0 0 0 105 0 0 0 24 0 1 0 668615495 2277376 377 33554432000 4194304 4955518 140736424254016 18446744073709551615 4297477 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/25907/statm: 556 377 106 186 0 369 0
[pid=25908] ppid=25887 vsize=330496 CPUtime=0 cores=0-7
/proc/25908/stat : 25908 (python) S 25887 25887 25102 0 -1 4202560 775 0 0 0 0 0 0 0 15 0 1 0 668615496 338427904 5725 33554432000 4194304 5683644 140734689516944 18446744073709551615 218370977350 0 0 16781312 514 16707633342211653891 0 0 17 0 0 0 0
/proc/25908/statm: 82624 5725 348 364 0 18527 0
[pid=25910] ppid=25908 vsize=2604 CPUtime=2.06 cores=0-7
/proc/25910/stat : 25910 (march_hi) R 25908 25910 25910 0 -1 4202496 714 0 0 0 206 0 0 0 25 0 1 0 668615498 2666496 439 33554432000 4194304 4955518 140736483865600 18446744073709551615 4286525 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/25910/statm: 651 439 106 186 0 464 0
[pid=25911] ppid=25887 vsize=340752 CPUtime=0 cores=0-7
/proc/25911/stat : 25911 (python) S 25887 25887 25102 0 -1 4202560 778 0 0 0 0 0 0 0 15 0 1 0 668615499 348930048 5729 33554432000 4194304 5683644 140734689516944 18446744073709551615 218370977350 0 0 16781312 514 6079934268035793156 0 0 17 2 0 0 0
/proc/25911/statm: 85188 5729 348 364 0 21088 0
[pid=25913] ppid=25911 vsize=2224 CPUtime=0.94 cores=0-7
/proc/25913/stat : 25913 (march_hi) R 25911 25913 25913 0 -1 4202496 645 0 0 0 94 0 0 0 25 0 1 0 668615502 2277376 371 33554432000 4194304 4955518 140737055962688 18446744073709551615 4224468 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/25913/statm: 556 371 106 186 0 369 0
[pid=25914] ppid=25887 vsize=350552 CPUtime=0 cores=0-7
/proc/25914/stat : 25914 (python) S 25887 25887 25102 0 -1 4202560 803 0 0 0 0 0 0 0 18 0 1 0 668615503 358965248 5635 33554432000 4194304 5683644 140734689516944 18446744073709551615 218370977350 0 0 16781312 514 2837412630195339263 0 0 17 0 0 0 0
/proc/25914/statm: 87638 5635 354 364 0 23535 0
[pid=25916] ppid=25914 vsize=416280 CPUtime=1.02 cores=0-7
/proc/25916/stat : 25916 (adaptg2wsat2009) R 25914 25916 25916 0 -1 4202496 531 0 0 0 102 0 0 0 25 0 1 0 668615503 426270720 252 33554432000 134512640 135107411 4287749680 18446744073709551615 134531905 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/25916/statm: 104070 252 59 146 0 102946 0
[pid=25887/tid=25894] ppid=25885 vsize=360796 CPUtime=0 cores=0-7
/proc/25887/task/25894/stat : 25894 (python) S 25885 25887 25102 0 -1 4202560 27 934 0 0 0 0 0 0 19 0 9 0 668615480 369455104 7174 33554432000 4194304 5683644 140734689516944 18446744073709551615 218382780849 0 0 16781312 2 18446604443274430656 0 0 -1 4 0 0 0
[pid=25887/tid=25897] ppid=25885 vsize=360796 CPUtime=0 cores=0-7
/proc/25887/task/25897/stat : 25897 (python) S 25885 25887 25102 0 -1 4202560 20 934 0 0 0 0 0 0 18 0 9 0 668615483 369455104 7174 33554432000 4194304 5683644 140734689516944 18446744073709551615 218382780849 0 0 16781312 2 18446604443274430656 0 0 -1 4 0 0 0
[pid=25887/tid=25900] ppid=25885 vsize=360796 CPUtime=0 cores=0-7
/proc/25887/task/25900/stat : 25900 (python) S 25885 25887 25102 0 -1 4202560 19 934 0 0 0 0 0 0 23 0 9 0 668615486 369455104 7174 33554432000 4194304 5683644 140734689516944 18446744073709551615 218382780849 0 0 16781312 2 18446604443274430656 0 0 -1 0 0 0 0
[pid=25887/tid=25903] ppid=25885 vsize=360796 CPUtime=0 cores=0-7
/proc/25887/task/25903/stat : 25903 (python) S 25885 25887 25102 0 -1 4202560 27 934 0 0 0 0 0 0 25 0 9 0 668615489 369455104 7174 33554432000 4194304 5683644 140734689516944 18446744073709551615 218382780849 0 0 16781312 2 18446604443274430656 0 0 -1 6 0 0 0
[pid=25887/tid=25906] ppid=25885 vsize=360796 CPUtime=0 cores=0-7
/proc/25887/task/25906/stat : 25906 (python) S 25885 25887 25102 0 -1 4202560 25 934 0 0 0 0 0 0 20 0 9 0 668615493 369455104 7174 33554432000 4194304 5683644 140734689516944 18446744073709551615 218382780849 0 0 16781312 2 18446604443274430656 0 0 -1 0 0 0 0
[pid=25887/tid=25909] ppid=25885 vsize=360796 CPUtime=0 cores=0-7
/proc/25887/task/25909/stat : 25909 (python) S 25885 25887 25102 0 -1 4202560 21 934 0 0 0 0 0 0 22 0 9 0 668615496 369455104 7174 33554432000 4194304 5683644 140734689516944 18446744073709551615 218382780849 0 0 16781312 2 18446604443274430656 0 0 -1 0 0 0 0
[pid=25887/tid=25912] ppid=25885 vsize=360796 CPUtime=0 cores=0-7
/proc/25887/task/25912/stat : 25912 (python) S 25885 25887 25102 0 -1 4202560 27 934 0 0 0 0 0 0 24 0 9 0 668615500 369455104 7174 33554432000 4194304 5683644 140734689516944 18446744073709551615 218382780849 0 0 16781312 2 18446604443274430656 0 0 -1 0 0 0 0
[pid=25887/tid=25915] ppid=25885 vsize=360796 CPUtime=0 cores=0-7
/proc/25887/task/25915/stat : 25915 (python) S 25885 25887 25102 0 -1 4202560 30 934 0 0 0 0 0 0 25 0 9 0 668615503 369455104 7174 33554432000 4194304 5683644 140734689516944 18446744073709551615 218382780849 0 0 16781312 2 18446604443274430656 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 12.65
Current children cumulated vsize (KiB) 5344028

[startup+6.30131 s]
/proc/loadavg: 11.23 11.16 10.94 12/378 25916
/proc/meminfo: memFree=14957288/32951124 swapFree=52307772/67111528
[pid=25887] ppid=25885 vsize=360796 CPUtime=0.78 cores=0-7
/proc/25887/stat : 25887 (python) S 25885 25887 25102 0 -1 4202496 15938 934 1 0 66 12 0 0 25 0 9 0 668615398 369455104 7174 33554432000 4194304 5683644 140734689516944 18446744073709551615 218382783947 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/25887/statm: 90199 7174 1889 364 0 26096 0
[pid=25893] ppid=25887 vsize=278676 CPUtime=0.01 cores=0-7
/proc/25893/stat : 25893 (python) S 25887 25887 25102 0 -1 4202560 901 0 0 0 0 1 0 0 18 0 1 0 668615479 285364224 5611 33554432000 4194304 5683644 140734689516944 18446744073709551615 218370977295 0 0 16781312 514 14769479115954159875 0 0 17 4 0 0 0
/proc/25893/statm: 69669 5611 377 364 0 5587 0

################
# More data... #
################

[pid=25914] ppid=25887 vsize=350552 CPUtime=0 cores=0-7
/proc/25914/stat : 25914 (python) S 25887 25887 25102 0 -1 4202560 985 0 0 0 0 0 0 0 18 0 1 0 668615503 358965248 5658 33554432000 4194304 5683644 140734689516944 18446744073709551615 218370977350 0 0 16781312 514 2837412630195306755 0 0 17 0 0 0 0
/proc/25914/statm: 87638 5658 377 364 0 23535 0
[pid=25916] ppid=25914 vsize=416280 CPUtime=3.82 cores=0-7
/proc/25916/stat : 25916 (adaptg2wsat2009) R 25914 25916 25916 0 -1 4202496 531 0 0 0 382 0 0 0 25 0 1 0 668615503 426270720 252 33554432000 134512640 135107411 4287749680 18446744073709551615 134531508 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/25916/statm: 104070 252 59 146 0 102946 0
[pid=25887/tid=25894] ppid=25885 vsize=360796 CPUtime=0 cores=0-7
/proc/25887/task/25894/stat : 25894 (python) S 25885 25887 25102 0 -1 4202560 27 934 0 0 0 0 0 0 19 0 9 0 668615480 369455104 7174 33554432000 4194304 5683644 140734689516944 18446744073709551615 218382780849 0 0 16781312 2 18446604443274430656 0 0 -1 4 0 0 0
[pid=25887/tid=25897] ppid=25885 vsize=360796 CPUtime=0 cores=0-7
/proc/25887/task/25897/stat : 25897 (python) S 25885 25887 25102 0 -1 4202560 20 934 0 0 0 0 0 0 18 0 9 0 668615483 369455104 7174 33554432000 4194304 5683644 140734689516944 18446744073709551615 218382780849 0 0 16781312 2 18446604443274430656 0 0 -1 4 0 0 0
[pid=25887/tid=25900] ppid=25885 vsize=360796 CPUtime=0 cores=0-7
/proc/25887/task/25900/stat : 25900 (python) S 25885 25887 25102 0 -1 4202560 19 934 0 0 0 0 0 0 23 0 9 0 668615486 369455104 7174 33554432000 4194304 5683644 140734689516944 18446744073709551615 218382780849 0 0 16781312 2 18446604443274430656 0 0 -1 0 0 0 0
[pid=25887/tid=25903] ppid=25885 vsize=360796 CPUtime=0 cores=0-7
/proc/25887/task/25903/stat : 25903 (python) S 25885 25887 25102 0 -1 4202560 27 934 0 0 0 0 0 0 25 0 9 0 668615489 369455104 7174 33554432000 4194304 5683644 140734689516944 18446744073709551615 218382780849 0 0 16781312 2 18446604443274430656 0 0 -1 6 0 0 0
[pid=25887/tid=25906] ppid=25885 vsize=360796 CPUtime=0 cores=0-7
/proc/25887/task/25906/stat : 25906 (python) S 25885 25887 25102 0 -1 4202560 25 934 0 0 0 0 0 0 20 0 9 0 668615493 369455104 7174 33554432000 4194304 5683644 140734689516944 18446744073709551615 218382780849 0 0 16781312 2 18446604443274430656 0 0 -1 0 0 0 0
[pid=25887/tid=25909] ppid=25885 vsize=360796 CPUtime=0 cores=0-7
/proc/25887/task/25909/stat : 25909 (python) S 25885 25887 25102 0 -1 4202560 21 934 0 0 0 0 0 0 22 0 9 0 668615496 369455104 7174 33554432000 4194304 5683644 140734689516944 18446744073709551615 218382780849 0 0 16781312 2 18446604443274430656 0 0 -1 0 0 0 0
[pid=25887/tid=25912] ppid=25885 vsize=360796 CPUtime=0 cores=0-7
/proc/25887/task/25912/stat : 25912 (python) S 25885 25887 25102 0 -1 4202560 27 934 0 0 0 0 0 0 24 0 9 0 668615500 369455104 7174 33554432000 4194304 5683644 140734689516944 18446744073709551615 218382780849 0 0 16781312 2 18446604443274430656 0 0 -1 0 0 0 0
[pid=25887/tid=25915] ppid=25885 vsize=360796 CPUtime=0 cores=0-7
/proc/25887/task/25915/stat : 25915 (python) S 25885 25887 25102 0 -1 4202560 30 934 0 0 0 0 0 0 25 0 9 0 668615503 369455104 7174 33554432000 4194304 5683644 140734689516944 18446744073709551615 218382780849 0 0 16781312 2 18446604443274430656 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 43.43
Current children cumulated vsize (KiB) 4331992

[startup+9.10082 s]
/proc/loadavg: 11.21 11.15 10.94 13/378 25916
/proc/meminfo: memFree=14955212/32951124 swapFree=52307772/67111528
[pid=25887] ppid=25885 vsize=360796 CPUtime=0.78 cores=0-7
/proc/25887/stat : 25887 (python) S 25885 25887 25102 0 -1 4202496 15938 934 1 0 66 12 0 0 25 0 9 0 668615398 369455104 7174 33554432000 4194304 5683644 140734689516944 18446744073709551615 218382783947 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/25887/statm: 90199 7174 1889 364 0 26096 0
[pid=25893] ppid=25887 vsize=278676 CPUtime=1.15 cores=0-7
/proc/25893/stat : 25893 (python) R 25887 25887 25102 0 -1 4202560 902 0 0 0 99 16 0 0 18 0 1 0 668615479 285364224 5611 33554432000 4194304 5683644 140734689516944 18446744073709551615 218382787333 0 0 16781312 514 0 0 0 17 7 0 0 0
/proc/25893/statm: 69669 5611 377 364 0 5587 0
[pid=25895] ppid=25893 vsize=0 CPUtime=7.02 cores=0-7
/proc/25895/stat : 25895 (gnovelty+2) R 25893 25895 25895 0 -1 4202500 456 0 0 0 702 0 0 0 25 0 1 0 668615480 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 7 0 0 0
/proc/25895/statm: 0 0 0 0 0 0 0
[pid=25896] ppid=25887 vsize=289304 CPUtime=0.01 cores=0-7
/proc/25896/stat : 25896 (python) S 25887 25887 25102 0 -1 4202560 905 0 0 0 0 1 0 0 18 0 1 0 668615483 296247296 5707 33554432000 4194304 5683644 140734689516944 18446744073709551615 218370977350 0 0 16781312 514 7002518257106125058 0 0 17 0 0 0 0
/proc/25896/statm: 72326 5707 371 364 0 8241 0
[pid=25898] ppid=25896 vsize=1017940 CPUtime=4.21 cores=0-7
/proc/25898/stat : 25898 (gnovelty+2) R 25896 25898 25898 0 -1 4202496 453 0 0 0 421 0 0 0 25 0 1 0 668615483 1042370560 191 33554432000 134512640 135663704 4293006224 18446744073709551615 134525218 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/25898/statm: 254485 191 113 282 0 254201 0
[pid=25899] ppid=25887 vsize=299188 CPUtime=0.01 cores=0-7
/proc/25899/stat : 25899 (python) S 25887 25887 25102 0 -1 4202560 911 0 0 0 1 0 0 0 15 0 1 0 668615486 306368512 5615 33554432000 4194304 5683644 140734689516944 18446744073709551615 218370977350 0 0 16781312 514 7865070560567329031 0 0 17 6 0 0 0
/proc/25899/statm: 74797 5615 371 364 0 10709 0
[pid=25901] ppid=25899 vsize=4220 CPUtime=8.21 cores=0-7
/proc/25901/stat : 25901 (march_hi) R 25899 25901 25901 0 -1 4202496 1065 0 0 0 821 0 0 0 25 0 1 0 668615486 4321280 792 33554432000 4194304 4955518 140736418082848 18446744073709551615 4208638 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/25901/statm: 1055 792 106 186 0 868 0
[pid=25902] ppid=25887 vsize=309984 CPUtime=0.01 cores=0-7
/proc/25902/stat : 25902 (python) S 25887 25887 25102 0 -1 4202560 928 0 0 0 0 1 0 0 15 0 1 0 668615489 317423616 5739 33554432000 4194304 5683644 140734689516944 18446744073709551615 218370977350 0 0 16781312 514 17151514982437847299 0 0 17 6 0 0 0
/proc/25902/statm: 77496 5739 370 364 0 13405 0
[pid=25904] ppid=25902 vsize=2944 CPUtime=4.02 cores=0-7
/proc/25904/stat : 25904 (march_hi) R 25902 25904 25904 0 -1 4202496 828 0 0 0 402 0 0 0 25 0 1 0 668615490 3014656 554 33554432000 4194304 4955518 140737036083936 18446744073709551615 4297477 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/25904/statm: 736 554 106 186 0 549 0
[pid=25905] ppid=25887 vsize=320240 CPUtime=0.01 cores=0-7
/proc/25905/stat : 25905 (python) S 25887 25887 25102 0 -1 4202560 948 0 0 0 1 0 0 0 15 0 1 0 668615492 327925760 5744 33554432000 4194304 5683644 140734689516944 18446744073709551615 218370977350 0 0 16781312 514 3000747556402594049 0 0 17 1 0 0 0
/proc/25905/statm: 80060 5744 371 364 0 15966 0
[pid=25907] ppid=25905 vsize=3456 CPUtime=4.64 cores=0-7
/proc/25907/stat : 25907 (march_hi) R 25905 25907 25907 0 -1 4202496 865 0 0 0 464 0 0 0 25 0 1 0 668615495 3538944 591 33554432000 4194304 4955518 140736424254016 18446744073709551615 4208667 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/25907/statm: 864 591 106 186 0 677 0
[pid=25908] ppid=25887 vsize=330496 CPUtime=0.02 cores=0-7
/proc/25908/stat : 25908 (python) S 25887 25887 25102 0 -1 4202560 949 0 0 0 1 1 0 0 15 0 1 0 668615496 338427904 5748 33554432000 4194304 5683644 140734689516944 18446744073709551615 218370977350 0 0 16781312 514 16707633342211653891 0 0 17 0 0 0 0
/proc/25908/statm: 82624 5748 371 364 0 18527 0
[pid=25910] ppid=25908 vsize=4220 CPUtime=7.5 cores=0-7
/proc/25910/stat : 25910 (march_hi) R 25908 25910 25910 0 -1 4202496 1030 0 0 0 750 0 0 0 25 0 1 0 668615498 4321280 755 33554432000 4194304 4955518 140736483865600 18446744073709551615 4296743 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/25910/statm: 1055 755 106 186 0 868 0
[pid=25911] ppid=25887 vsize=340752 CPUtime=0.01 cores=0-7
/proc/25911/stat : 25911 (python) S 25887 25887 25102 0 -1 4202560 959 0 0 0 0 1 0 0 15 0 1 0 668615499 348930048 5751 33554432000 4194304 5683644 140734689516944 18446744073709551615 218370977350 0 0 16781312 514 6079934268035793156 0 0 17 2 0 0 0
/proc/25911/statm: 85188 5751 370 364 0 21088 0
[pid=25913] ppid=25911 vsize=2944 CPUtime=3.94 cores=0-7
/proc/25913/stat : 25913 (march_hi) R 25911 25913 25913 0 -1 4202496 824 0 0 0 394 0 0 0 25 0 1 0 668615502 3014656 550 33554432000 4194304 4955518 140737055962688 18446744073709551615 4297067 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/25913/statm: 736 550 106 186 0 549 0
[pid=25914] ppid=25887 vsize=350552 CPUtime=0 cores=0-7
/proc/25914/stat : 25914 (python) S 25887 25887 25102 0 -1 4202560 985 0 0 0 0 0 0 0 18 0 1 0 668615503 358965248 5658 33554432000 4194304 5683644 140734689516944 18446744073709551615 218370977350 0 0 16781312 514 2837412630195306755 0 0 17 0 0 0 0
/proc/25914/statm: 87638 5658 377 364 0 23535 0
[pid=25916] ppid=25914 vsize=416280 CPUtime=4.01 cores=0-7
/proc/25916/stat : 25916 (adaptg2wsat2009) R 25914 25916 25916 0 -1 4202496 531 0 0 0 401 0 0 0 25 0 1 0 668615503 426270720 252 33554432000 134512640 135107411 4287749680 18446744073709551615 134532275 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/25916/statm: 104070 252 59 146 0 102946 0
[pid=25887/tid=25894] ppid=25885 vsize=360796 CPUtime=0 cores=0-7
/proc/25887/task/25894/stat : 25894 (python) S 25885 25887 25102 0 -1 4202560 27 934 0 0 0 0 0 0 19 0 9 0 668615480 369455104 7174 33554432000 4194304 5683644 140734689516944 18446744073709551615 218382780849 0 0 16781312 2 18446604443274430656 0 0 -1 4 0 0 0
[pid=25887/tid=25897] ppid=25885 vsize=360796 CPUtime=0 cores=0-7
/proc/25887/task/25897/stat : 25897 (python) S 25885 25887 25102 0 -1 4202560 20 934 0 0 0 0 0 0 18 0 9 0 668615483 369455104 7174 33554432000 4194304 5683644 140734689516944 18446744073709551615 218382780849 0 0 16781312 2 18446604443274430656 0 0 -1 4 0 0 0
[pid=25887/tid=25900] ppid=25885 vsize=360796 CPUtime=0 cores=0-7
/proc/25887/task/25900/stat : 25900 (python) S 25885 25887 25102 0 -1 4202560 19 934 0 0 0 0 0 0 23 0 9 0 668615486 369455104 7174 33554432000 4194304 5683644 140734689516944 18446744073709551615 218382780849 0 0 16781312 2 18446604443274430656 0 0 -1 0 0 0 0
[pid=25887/tid=25903] ppid=25885 vsize=360796 CPUtime=0 cores=0-7
/proc/25887/task/25903/stat : 25903 (python) S 25885 25887 25102 0 -1 4202560 27 934 0 0 0 0 0 0 25 0 9 0 668615489 369455104 7174 33554432000 4194304 5683644 140734689516944 18446744073709551615 218382780849 0 0 16781312 2 18446604443274430656 0 0 -1 6 0 0 0
[pid=25887/tid=25906] ppid=25885 vsize=360796 CPUtime=0 cores=0-7
/proc/25887/task/25906/stat : 25906 (python) S 25885 25887 25102 0 -1 4202560 25 934 0 0 0 0 0 0 20 0 9 0 668615493 369455104 7174 33554432000 4194304 5683644 140734689516944 18446744073709551615 218382780849 0 0 16781312 2 18446604443274430656 0 0 -1 0 0 0 0
[pid=25887/tid=25909] ppid=25885 vsize=360796 CPUtime=0 cores=0-7
/proc/25887/task/25909/stat : 25909 (python) S 25885 25887 25102 0 -1 4202560 21 934 0 0 0 0 0 0 22 0 9 0 668615496 369455104 7174 33554432000 4194304 5683644 140734689516944 18446744073709551615 218382780849 0 0 16781312 2 18446604443274430656 0 0 -1 0 0 0 0
[pid=25887/tid=25912] ppid=25885 vsize=360796 CPUtime=0 cores=0-7
/proc/25887/task/25912/stat : 25912 (python) S 25885 25887 25102 0 -1 4202560 27 934 0 0 0 0 0 0 24 0 9 0 668615500 369455104 7174 33554432000 4194304 5683644 140734689516944 18446744073709551615 218382780849 0 0 16781312 2 18446604443274430656 0 0 -1 0 0 0 0
[pid=25887/tid=25915] ppid=25885 vsize=360796 CPUtime=0 cores=0-7
/proc/25887/task/25915/stat : 25915 (python) S 25885 25887 25102 0 -1 4202560 30 934 0 0 0 0 0 0 25 0 9 0 668615503 369455104 7174 33554432000 4194304 5683644 140734689516944 18446744073709551615 218382780849 0 0 16781312 2 18446604443274430656 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 45.55
Current children cumulated vsize (KiB) 4331992

[startup+9.50174 s]
/proc/loadavg: 11.21 11.15 10.94 13/378 25916
/proc/meminfo: memFree=14955212/32951124 swapFree=52307772/67111528
[pid=25887] ppid=25885 vsize=360796 CPUtime=0.78 cores=0-7
/proc/25887/stat : 25887 (python) S 25885 25887 25102 0 -1 4202496 15938 934 1 0 66 12 0 0 25 0 9 0 668615398 369455104 7174 33554432000 4194304 5683644 140734689516944 18446744073709551615 218382783947 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/25887/statm: 90199 7174 1889 364 0 26096 0
[pid=25893] ppid=25887 vsize=278676 CPUtime=1.56 cores=0-7
/proc/25893/stat : 25893 (python) R 25887 25887 25102 0 -1 4202560 902 0 0 0 135 21 0 0 18 0 1 0 668615479 285364224 5611 33554432000 4194304 5683644 140734689516944 18446744073709551615 4892519 0 0 16781312 514 0 0 0 17 7 0 0 0
/proc/25893/statm: 69669 5611 377 364 0 5587 0
[pid=25895] ppid=25893 vsize=0 CPUtime=7.02 cores=0-7
/proc/25895/stat : 25895 (gnovelty+2) R 25893 25895 25895 0 -1 4202500 456 0 0 0 702 0 0 0 25 0 1 0 668615480 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 7 0 0 0
/proc/25895/statm: 0 0 0 0 0 0 0
[pid=25896] ppid=25887 vsize=289304 CPUtime=0.01 cores=0-7
/proc/25896/stat : 25896 (python) S 25887 25887 25102 0 -1 4202560 905 0 0 0 0 1 0 0 18 0 1 0 668615483 296247296 5707 33554432000 4194304 5683644 140734689516944 18446744073709551615 218370977350 0 0 16781312 514 7002518257106125058 0 0 17 0 0 0 0
/proc/25896/statm: 72326 5707 371 364 0 8241 0
[pid=25898] ppid=25896 vsize=1017940 CPUtime=4.41 cores=0-7
/proc/25898/stat : 25898 (gnovelty+2) R 25896 25898 25898 0 -1 4202496 453 0 0 0 441 0 0 0 25 0 1 0 668615483 1042370560 191 33554432000 134512640 135663704 4293006224 18446744073709551615 134524503 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/25898/statm: 254485 191 113 282 0 254201 0
[pid=25899] ppid=25887 vsize=299188 CPUtime=0.01 cores=0-7
/proc/25899/stat : 25899 (python) S 25887 25887 25102 0 -1 4202560 911 0 0 0 1 0 0 0 15 0 1 0 668615486 306368512 5615 33554432000 4194304 5683644 140734689516944 18446744073709551615 218370977350 0 0 16781312 514 7865070560567329031 0 0 17 6 0 0 0
/proc/25899/statm: 74797 5615 371 364 0 10709 0
[pid=25901] ppid=25899 vsize=4220 CPUtime=8.61 cores=0-7
/proc/25901/stat : 25901 (march_hi) R 25899 25901 25901 0 -1 4202496 1086 0 0 0 861 0 0 0 25 0 1 0 668615486 4321280 813 33554432000 4194304 4955518 140736418082848 18446744073709551615 4261539 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/25901/statm: 1055 813 106 186 0 868 0
[pid=25902] ppid=25887 vsize=309984 CPUtime=0.01 cores=0-7
/proc/25902/stat : 25902 (python) S 25887 25887 25102 0 -1 4202560 928 0 0 0 0 1 0 0 15 0 1 0 668615489 317423616 5739 33554432000 4194304 5683644 140734689516944 18446744073709551615 218370977350 0 0 16781312 514 17151514982437847299 0 0 17 6 0 0 0
/proc/25902/statm: 77496 5739 370 364 0 13405 0
[pid=25904] ppid=25902 vsize=3456 CPUtime=4.22 cores=0-7
/proc/25904/stat : 25904 (march_hi) R 25902 25904 25904 0 -1 4202496 841 0 0 0 422 0 0 0 25 0 1 0 668615490 3538944 567 33554432000 4194304 4955518 140737036083936 18446744073709551615 4237786 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/25904/statm: 864 567 106 186 0 677 0
[pid=25905] ppid=25887 vsize=320240 CPUtime=0.01 cores=0-7
/proc/25905/stat : 25905 (python) S 25887 25887 25102 0 -1 4202560 948 0 0 0 1 0 0 0 15 0 1 0 668615492 327925760 5744 33554432000 4194304 5683644 140734689516944 18446744073709551615 218370977350 0 0 16781312 514 3000747556402594049 0 0 17 1 0 0 0
/proc/25905/statm: 80060 5744 371 364 0 15966 0
[pid=25907] ppid=25905 vsize=3456 CPUtime=5.04 cores=0-7
/proc/25907/stat : 25907 (march_hi) R 25905 25907 25907 0 -1 4202496 891 0 0 0 504 0 0 0 25 0 1 0 668615495 3538944 617 33554432000 4194304 4955518 140736424254016 18446744073709551615 4208626 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/25907/statm: 864 617 106 186 0 677 0
[pid=25908] ppid=25887 vsize=330496 CPUtime=0.02 cores=0-7
/proc/25908/stat : 25908 (python) S 25887 25887 25102 0 -1 4202560 949 0 0 0 1 1 0 0 15 0 1 0 668615496 338427904 5748 33554432000 4194304 5683644 140734689516944 18446744073709551615 218370977350 0 0 16781312 514 16707633342211653891 0 0 17 0 0 0 0
/proc/25908/statm: 82624 5748 371 364 0 18527 0
[pid=25910] ppid=25908 vsize=4220 CPUtime=7.71 cores=0-7
/proc/25910/stat : 25910 (march_hi) R 25908 25910 25910 0 -1 4202496 1043 0 0 0 771 0 0 0 25 0 1 0 668615498 4321280 768 33554432000 4194304 4955518 140736483865600 18446744073709551615 4208624 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/25910/statm: 1055 768 106 186 0 868 0
[pid=25911] ppid=25887 vsize=340752 CPUtime=0.01 cores=0-7
/proc/25911/stat : 25911 (python) S 25887 25887 25102 0 -1 4202560 959 0 0 0 0 1 0 0 15 0 1 0 668615499 348930048 5751 33554432000 4194304 5683644 140734689516944 18446744073709551615 218370977350 0 0 16781312 514 6079934268035793156 0 0 17 2 0 0 0
/proc/25911/statm: 85188 5751 370 364 0 21088 0
[pid=25913] ppid=25911 vsize=2944 CPUtime=4.14 cores=0-7
/proc/25913/stat : 25913 (march_hi) R 25911 25913 25913 0 -1 4202496 837 0 0 0 414 0 0 0 25 0 1 0 668615502 3014656 563 33554432000 4194304 4955518 140737055962688 18446744073709551615 4226515 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/25913/statm: 736 563 106 186 0 549 0
[pid=25914] ppid=25887 vsize=350552 CPUtime=0 cores=0-7
/proc/25914/stat : 25914 (python) S 25887 25887 25102 0 -1 4202560 985 0 0 0 0 0 0 0 18 0 1 0 668615503 358965248 5658 33554432000 4194304 5683644 140734689516944 18446744073709551615 218370977350 0 0 16781312 514 2837412630195306755 0 0 17 0 0 0 0
/proc/25914/statm: 87638 5658 377 364 0 23535 0
[pid=25916] ppid=25914 vsize=416280 CPUtime=4.21 cores=0-7
/proc/25916/stat : 25916 (adaptg2wsat2009) R 25914 25916 25916 0 -1 4202496 531 0 0 0 421 0 0 0 25 0 1 0 668615503 426270720 252 33554432000 134512640 135107411 4287749680 18446744073709551615 134532384 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/25916/statm: 104070 252 59 146 0 102946 0
[pid=25887/tid=25894] ppid=25885 vsize=360796 CPUtime=0 cores=0-7
/proc/25887/task/25894/stat : 25894 (python) S 25885 25887 25102 0 -1 4202560 27 934 0 0 0 0 0 0 19 0 9 0 668615480 369455104 7174 33554432000 4194304 5683644 140734689516944 18446744073709551615 218382780849 0 0 16781312 2 18446604443274430656 0 0 -1 4 0 0 0
[pid=25887/tid=25897] ppid=25885 vsize=360796 CPUtime=0 cores=0-7
/proc/25887/task/25897/stat : 25897 (python) S 25885 25887 25102 0 -1 4202560 20 934 0 0 0 0 0 0 18 0 9 0 668615483 369455104 7174 33554432000 4194304 5683644 140734689516944 18446744073709551615 218382780849 0 0 16781312 2 18446604443274430656 0 0 -1 4 0 0 0
[pid=25887/tid=25900] ppid=25885 vsize=360796 CPUtime=0 cores=0-7
/proc/25887/task/25900/stat : 25900 (python) S 25885 25887 25102 0 -1 4202560 19 934 0 0 0 0 0 0 23 0 9 0 668615486 369455104 7174 33554432000 4194304 5683644 140734689516944 18446744073709551615 218382780849 0 0 16781312 2 18446604443274430656 0 0 -1 0 0 0 0
[pid=25887/tid=25903] ppid=25885 vsize=360796 CPUtime=0 cores=0-7
/proc/25887/task/25903/stat : 25903 (python) S 25885 25887 25102 0 -1 4202560 27 934 0 0 0 0 0 0 25 0 9 0 668615489 369455104 7174 33554432000 4194304 5683644 140734689516944 18446744073709551615 218382780849 0 0 16781312 2 18446604443274430656 0 0 -1 6 0 0 0
[pid=25887/tid=25906] ppid=25885 vsize=360796 CPUtime=0 cores=0-7
/proc/25887/task/25906/stat : 25906 (python) S 25885 25887 25102 0 -1 4202560 25 934 0 0 0 0 0 0 20 0 9 0 668615493 369455104 7174 33554432000 4194304 5683644 140734689516944 18446744073709551615 218382780849 0 0 16781312 2 18446604443274430656 0 0 -1 0 0 0 0
[pid=25887/tid=25909] ppid=25885 vsize=360796 CPUtime=0 cores=0-7
/proc/25887/task/25909/stat : 25909 (python) S 25885 25887 25102 0 -1 4202560 21 934 0 0 0 0 0 0 22 0 9 0 668615496 369455104 7174 33554432000 4194304 5683644 140734689516944 18446744073709551615 218382780849 0 0 16781312 2 18446604443274430656 0 0 -1 0 0 0 0
[pid=25887/tid=25912] ppid=25885 vsize=360796 CPUtime=0 cores=0-7
/proc/25887/task/25912/stat : 25912 (python) S 25885 25887 25102 0 -1 4202560 27 934 0 0 0 0 0 0 24 0 9 0 668615500 369455104 7174 33554432000 4194304 5683644 140734689516944 18446744073709551615 218382780849 0 0 16781312 2 18446604443274430656 0 0 -1 0 0 0 0
[pid=25887/tid=25915] ppid=25885 vsize=360796 CPUtime=0 cores=0-7
/proc/25887/task/25915/stat : 25915 (python) S 25885 25887 25102 0 -1 4202560 30 934 0 0 0 0 0 0 25 0 9 0 668615503 369455104 7174 33554432000 4194304 5683644 140734689516944 18446744073709551615 218382780849 0 0 16781312 2 18446604443274430656 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 47.77
Current children cumulated vsize (KiB) 4332504

Child status: 0
Real time (s): 9.59257
CPU time (s): 48.3007
CPU user time (s): 47.8357
CPU system time (s): 0.464929
CPU usage (%): 503.522
Max. virtual memory (cumulated for all children) (KiB): 5349420

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 47.8357
system time used= 0.464929
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 35487
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3619
involuntary context switches= 830

runsolver used 0.029995 second user time and 0.091986 second system time

The end

Launcher Data 

Begin job on node101 at 2011-05-16 20:22:06
IDJOB=3385597
IDBENCH=82862
IDSOLVER=1870
FILE ID=node101/3385597-1305570126
RUNJOBID= node101-1305564967-25116
PBS_JOBID= 13350149
Free space on /tmp= 73724 MiB

SOLVER NAME= borg-sat 11.03.02-par-random (fixed)
BENCH NAME= SAT11/random/medium/unif-k5-r21.3-v150-c3195-S259896945-079.SATISFIABLE.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3385597-1305570126/watcher-3385597-1305570126 -o /tmp/evaluation-result-3385597-1305570126/solver-3385597-1305570126 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3385597-1305570126.cnf -seed 930569595 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= af1e3a30945401f0fc52ffcd9f70aa15
RANDOM SEED=930569595

node101.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.841
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.841
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.841
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.841
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.841
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.841
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.841
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.841
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      15021240 kB
Buffers:        354232 kB
Cached:        6548992 kB
SwapCached:      14844 kB
Active:       12211600 kB
Inactive:      5412780 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      15021240 kB
SwapTotal:    67111528 kB
SwapFree:     52307772 kB
Dirty:           31944 kB
Writeback:           0 kB
AnonPages:    10718152 kB
Mapped:          18352 kB
Slab:           163084 kB
PageTables:      70608 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 67750848 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73692 MiB
End job on node101 at 2011-05-16 20:22:16