Trace number 3321999

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-randomSAT 17.2284 3.07795

General information on the benchmark

Namerandom/medium/
unif-k5-r21.3-v150-c3195-S1116496771-020.SATISFIABLE.cnf
MD5SUM55b0e04e9e653549cf2eabcc194b78ff
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark0.141977
Satisfiable
(Un)Satisfiability was proved
Number of variables150
Number of clauses3195
Sum of the clauses size15975
Maximum clause length5
Minimum clause length5
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 53195
Number of clauses of size over 50

Solver Data 

0.35/0.67	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.35/0.67	c INFO: solving HOME/instance-3321999-1304370576.cnf
0.35/0.67	c INFO: computing task features
0.35/0.69	c INFO: computed variable-clause graph statistics
0.35/0.69	c INFO: computed clause balance statistics
0.43/0.77	c INFO: computed variable balance statistics
0.53/0.81	c INFO: computed small-clause counts
0.53/0.81	c INFO: computed Horn-clause counts
0.53/0.82	c INFO: computed variable graph statistics
0.53/0.82	c INFO: collected features for HOME/instance-3321999-1304370576.cnf in 0.14 s
0.53/0.85	c INFO: running gnovelty+2@0 for 97 with 39999 remaining (b = 0.63)
0.53/0.89	c INFO: running gnovelty+2@0 for 97 with 39999 remaining (b = 0.08)
0.63/0.93	c INFO: running march_hi@0 for 679 with 39999 remaining (b = 0.35)
0.63/0.97	c INFO: running march_hi@0 for 679 with 39999 remaining (b = 0.31)
0.63/1.01	c INFO: running march_hi@0 for 485 with 39999 remaining (b = 0.23)
1.03/1.05	c INFO: running march_hi@0 for 485 with 39999 remaining (b = 0.21)
1.03/1.09	c INFO: running march_hi@0 for 388 with 39999 remaining (b = 0.15)
1.54/1.13	c INFO: running adaptg2wsat2009++@0 for 97 with 39999 remaining (b = 0.03)
16.71/3.05	s SATISFIABLE
16.71/3.05	v 1 2 -3 -4 -5 6 -7 -8 -9 10 -11 12 13 -14 -15 16 -17 18 -19 -20 21 -22 23 24 25 -26 -27 28 -29 30 31 -32 33 34 -35 36 -37 -38 -39 40 -41 -42 43 44 45 -46 47 48 49 -50 -51 -52 53 -54 55 56 57 58 59 60 -61 -62 63 64 -65 66 67 -68 -69 -70 -71 -72 73 74 -75 76 77 -78 -79 80 81 -82 83 84 85 -86 87 88 89 90 91 -92 -93 -94 95 96 97 -98 99 100 -101 102 103 104 105 106 -107 -108 -109 -110 -111 112 -113 114 115 116 -117 -118 -119 -120 -121 122 123 -124 125 126 -127 128 -129 130 131 -132 -133 -134 135 136 137 138 139 140 141 142 -143 144 -145 -146 147 -148 -149 -150 0

Verifier Data 

OK

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3321999-1304370576/watcher-3321999-1304370576 -o /tmp/evaluation-result-3321999-1304370576/solver-3321999-1304370576 -C 40000 -W 5100 -M 31000 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3321999-1304370576.cnf -seed 595080448 -budget 40000 -cores 8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.49 7.92 7.96 2/286 2106
/proc/meminfo: memFree=18114936/32951124 swapFree=67111356/67111528
[pid=2106] ppid=2104 vsize=15084 CPUtime=0 cores=0-7
/proc/2106/stat : 2106 (python) R 2104 2106 2080 0 -1 4202496 618 0 0 0 0 0 0 0 25 0 1 0 529473222 15446016 515 33554432000 4194304 5683644 140733576205264 18446744073709551615 270338383616 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/2106/statm: 3771 520 302 364 0 258 0

[startup+0.0953329 s]
/proc/loadavg: 7.49 7.92 7.96 2/286 2106
/proc/meminfo: memFree=18114936/32951124 swapFree=67111356/67111528
[pid=2106] ppid=2104 vsize=85072 CPUtime=0.05 cores=0-7
/proc/2106/stat : 2106 (python) R 2104 2106 2080 0 -1 4202496 2498 0 0 0 4 1 0 0 25 0 1 0 529473222 87113728 2225 33554432000 4194304 5683644 140733576205264 18446744073709551615 4540219 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/2106/statm: 21268 2232 707 364 0 1485 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 85072

[startup+0.100364 s]
/proc/loadavg: 7.49 7.92 7.96 2/286 2106
/proc/meminfo: memFree=18114936/32951124 swapFree=67111356/67111528
[pid=2106] ppid=2104 vsize=87704 CPUtime=0.06 cores=0-7
/proc/2106/stat : 2106 (python) R 2104 2106 2080 0 -1 4202496 2638 0 0 0 4 2 0 0 25 0 1 0 529473222 89808896 2354 33554432000 4194304 5683644 140733576205264 18446744073709551615 270338379621 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/2106/statm: 21926 2354 717 364 0 1622 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 87704

[startup+0.300302 s]
/proc/loadavg: 7.49 7.92 7.96 2/286 2106
/proc/meminfo: memFree=18114936/32951124 swapFree=67111356/67111528
[pid=2106] ppid=2104 vsize=135748 CPUtime=0.19 cores=0-7
/proc/2106/stat : 2106 (python) S 2104 2106 2080 0 -1 4202496 5967 932 1 0 13 6 0 0 25 0 1 0 529473222 139005952 4151 33554432000 4194304 5683644 140733576205264 18446744073709551615 270338379781 0 2147483391 16781312 2 18446744071699199166 0 0 17 4 0 0 0
/proc/2106/statm: 33937 4151 1032 364 0 3123 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 135748

[startup+0.700218 s]
/proc/loadavg: 7.49 7.92 7.96 2/286 2106
/proc/meminfo: memFree=18114936/32951124 swapFree=67111356/67111528
[pid=2106] ppid=2104 vsize=278760 CPUtime=0.43 cores=0-7
/proc/2106/stat : 2106 (python) R 2104 2106 2080 0 -1 4202496 9405 932 1 0 31 12 0 0 25 0 1 0 529473222 285450240 7073 33554432000 4194304 5683644 140733576205264 18446744073709551615 47594307512174 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/2106/statm: 69690 7073 1826 364 0 5614 0
Current children cumulated CPU time (s) 0.43
Current children cumulated vsize (KiB) 278760

[startup+1.50098 s]
/proc/loadavg: 7.49 7.92 7.96 6/299 2123
/proc/meminfo: memFree=18073444/32951124 swapFree=67111356/67111528
[pid=2106] ppid=2104 vsize=361236 CPUtime=0.85 cores=0-7
/proc/2106/stat : 2106 (python) S 2104 2106 2080 0 -1 4202496 15949 932 1 0 72 13 0 0 20 0 9 0 529473222 369905664 7274 33554432000 4194304 5683644 140733576205264 18446744073709551615 270350210507 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/2106/statm: 90309 7274 1889 364 0 26206 0
[pid=2112] ppid=2106 vsize=278784 CPUtime=0 cores=0-7
/proc/2112/stat : 2112 (python) S 2106 2106 2080 0 -1 4202560 732 0 0 0 0 0 0 0 25 0 1 0 529473308 285474816 5601 33554432000 4194304 5683644 140733576205264 18446744073709551615 270338403855 0 0 16781312 514 4530277906923913215 0 0 17 7 0 0 0
/proc/2112/statm: 69696 5601 354 364 0 5614 0
[pid=2114] ppid=2112 vsize=1017940 CPUtime=0.63 cores=0-7
/proc/2114/stat : 2114 (gnovelty+2) R 2112 2114 2114 0 -1 4202496 454 0 0 0 63 0 0 0 25 0 1 0 529473308 1042370560 191 33554432000 134512640 135663704 4294307840 18446744073709551615 134525678 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/2114/statm: 254485 191 113 282 0 254201 0
[pid=2115] ppid=2106 vsize=289320 CPUtime=0 cores=0-7
/proc/2115/stat : 2115 (python) S 2106 2106 2080 0 -1 4202560 736 0 0 0 0 0 0 0 19 0 1 0 529473311 296263680 5688 33554432000 4194304 5683644 140733576205264 18446744073709551615 270338403910 0 0 16781312 514 4434018137813286911 0 0 17 6 0 0 0
/proc/2115/statm: 72330 5688 348 364 0 8245 0
[pid=2117] ppid=2115 vsize=1017940 CPUtime=0.59 cores=0-7
/proc/2117/stat : 2117 (gnovelty+2) R 2115 2117 2117 0 -1 4202496 451 0 0 0 59 0 0 0 22 0 1 0 529473312 1042370560 191 33554432000 134512640 135663704 4289508112 18446744073709551615 134524882 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/2117/statm: 254485 191 113 282 0 254201 0
[pid=2118] ppid=2106 vsize=299236 CPUtime=0 cores=0-7
/proc/2118/stat : 2118 (python) S 2106 2106 2080 0 -1 4202560 751 0 0 0 0 0 0 0 15 0 1 0 529473315 306417664 5622 33554432000 4194304 5683644 140733576205264 18446744073709551615 270338403910 0 0 16781312 514 8522978736209887489 0 0 17 0 0 0 0
/proc/2118/statm: 74809 5622 348 364 0 10721 0
[pid=2120] ppid=2118 vsize=1996 CPUtime=0.53 cores=0-7
/proc/2120/stat : 2120 (march_hi) R 2118 2120 2120 0 -1 4202496 588 0 0 0 53 0 0 0 22 0 1 0 529473315 2043904 316 33554432000 4194304 4955518 140733522434720 18446744073709551615 4225244 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/2120/statm: 499 316 106 186 0 312 0
[pid=2121] ppid=2106 vsize=309968 CPUtime=0 cores=0-7
/proc/2121/stat : 2121 (python) S 2106 2106 2080 0 -1 4202560 770 0 0 0 0 0 0 0 15 0 1 0 529473319 317407232 5713 33554432000 4194304 5683644 140733576205264 18446744073709551615 270338403910 0 0 16781312 514 4261870076153528577 0 0 17 6 0 0 0
/proc/2121/statm: 77492 5713 348 364 0 13401 0
[pid=2123] ppid=2121 vsize=1996 CPUtime=0.52 cores=0-7
/proc/2123/stat : 2123 (march_hi) R 2121 2123 2123 0 -1 4202496 586 0 0 0 52 0 0 0 22 0 1 0 529473319 2043904 314 33554432000 4194304 4955518 140734101326624 18446744073709551615 4297429 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/2123/statm: 499 314 106 186 0 312 0
[pid=2106/tid=2113] ppid=2104 vsize=361236 CPUtime=0 cores=0-7
/proc/2106/task/2113/stat : 2113 (python) S 2104 2106 2080 0 -1 4202560 28 932 0 0 0 0 0 0 25 0 9 0 529473308 369905664 7274 33554432000 4194304 5683644 140733576205264 18446744073709551615 270350207409 0 0 16781312 2 18446604453965985728 0 0 -1 0 0 0 0
[pid=2106/tid=2116] ppid=2104 vsize=361236 CPUtime=0 cores=0-7
/proc/2106/task/2116/stat : 2116 (python) S 2104 2106 2080 0 -1 4202560 22 932 0 0 0 0 0 0 20 0 9 0 529473311 369905664 7274 33554432000 4194304 5683644 140733576205264 18446744073709551615 270350207409 0 0 16781312 2 18446604453965985728 0 0 -1 6 0 0 0
[pid=2106/tid=2119] ppid=2104 vsize=361236 CPUtime=0 cores=0-7
/proc/2106/task/2119/stat : 2119 (python) S 2104 2106 2080 0 -1 4202560 21 932 0 0 0 0 0 0 20 0 9 0 529473315 369905664 7274 33554432000 4194304 5683644 140733576205264 18446744073709551615 270350207409 0 0 16781312 2 18446604453965985728 0 0 -1 0 0 0 0
[pid=2106/tid=2122] ppid=2104 vsize=361236 CPUtime=0 cores=0-7
/proc/2106/task/2122/stat : 2122 (python) S 2104 2106 2080 0 -1 4202560 20 932 0 0 0 0 0 0 20 0 9 0 529473319 369905664 7274 33554432000 4194304 5683644 140733576205264 18446744073709551615 270350207409 0 0 16781312 2 18446604453965985728 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3.12
Current children cumulated vsize (KiB) 3578416

Solver just ended. Dumping a history of the last processes samples

[startup+2.30082 s]
/proc/loadavg: 7.53 7.93 7.96 9/311 2135
/proc/meminfo: memFree=18051028/32951124 swapFree=67111356/67111528
[pid=2106] ppid=2104 vsize=361236 CPUtime=0.85 cores=0-7
/proc/2106/stat : 2106 (python) S 2104 2106 2080 0 -1 4202496 15949 932 1 0 72 13 0 0 20 0 9 0 529473222 369905664 7274 33554432000 4194304 5683644 140733576205264 18446744073709551615 270350210507 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/2106/statm: 90309 7274 1889 364 0 26206 0
[pid=2112] ppid=2106 vsize=278784 CPUtime=0 cores=0-7
/proc/2112/stat : 2112 (python) S 2106 2106 2080 0 -1 4202560 732 0 0 0 0 0 0 0 18 0 1 0 529473308 285474816 5601 33554432000 4194304 5683644 140733576205264 18446744073709551615 270338403855 0 0 16781312 514 4530277906923880708 0 0 17 7 0 0 0
/proc/2112/statm: 69696 5601 354 364 0 5614 0
[pid=2114] ppid=2112 vsize=1017940 CPUtime=1.43 cores=0-7
/proc/2114/stat : 2114 (gnovelty+2) R 2112 2114 2114 0 -1 4202496 454 0 0 0 143 0 0 0 25 0 1 0 529473308 1042370560 191 33554432000 134512640 135663704 4294307840 18446744073709551615 134525678 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/2114/statm: 254485 191 113 282 0 254201 0
[pid=2115] ppid=2106 vsize=289320 CPUtime=0 cores=0-7
/proc/2115/stat : 2115 (python) S 2106 2106 2080 0 -1 4202560 736 0 0 0 0 0 0 0 18 0 1 0 529473311 296263680 5688 33554432000 4194304 5683644 140733576205264 18446744073709551615 270338403910 0 0 16781312 514 4434018137813254402 0 0 17 6 0 0 0
/proc/2115/statm: 72330 5688 348 364 0 8245 0
[pid=2117] ppid=2115 vsize=1017940 CPUtime=1.39 cores=0-7
/proc/2117/stat : 2117 (gnovelty+2) R 2115 2117 2117 0 -1 4202496 451 0 0 0 139 0 0 0 25 0 1 0 529473312 1042370560 191 33554432000 134512640 135663704 4289508112 18446744073709551615 134525276 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/2117/statm: 254485 191 113 282 0 254201 0
[pid=2118] ppid=2106 vsize=299236 CPUtime=0 cores=0-7
/proc/2118/stat : 2118 (python) S 2106 2106 2080 0 -1 4202560 752 0 0 0 0 0 0 0 15 0 1 0 529473315 306417664 5622 33554432000 4194304 5683644 140733576205264 18446744073709551615 270338403910 0 0 16781312 514 8522978736209887489 0 0 17 0 0 0 0
/proc/2118/statm: 74809 5622 348 364 0 10721 0
[pid=2120] ppid=2118 vsize=2392 CPUtime=1.33 cores=0-7
/proc/2120/stat : 2120 (march_hi) R 2118 2120 2120 0 -1 4202496 669 0 0 0 133 0 0 0 25 0 1 0 529473315 2449408 395 33554432000 4194304 4955518 140733522434720 18446744073709551615 4297477 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/2120/statm: 598 395 106 186 0 411 0
[pid=2121] ppid=2106 vsize=309968 CPUtime=0 cores=0-7
/proc/2121/stat : 2121 (python) S 2106 2106 2080 0 -1 4202560 771 0 0 0 0 0 0 0 15 0 1 0 529473319 317407232 5713 33554432000 4194304 5683644 140733576205264 18446744073709551615 270338403910 0 0 16781312 514 4261870076153561087 0 0 17 6 0 0 0
/proc/2121/statm: 77492 5713 348 364 0 13401 0
[pid=2123] ppid=2121 vsize=2392 CPUtime=1.32 cores=0-7
/proc/2123/stat : 2123 (march_hi) R 2121 2123 2123 0 -1 4202496 668 0 0 0 132 0 0 0 25 0 1 0 529473319 2449408 394 33554432000 4194304 4955518 140734101326624 18446744073709551615 4226483 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/2123/statm: 598 394 106 186 0 411 0
[pid=2124] ppid=2106 vsize=320224 CPUtime=0 cores=0-7
/proc/2124/stat : 2124 (python) S 2106 2106 2080 0 -1 4202560 773 0 0 0 0 0 0 0 15 0 1 0 529473323 327909376 5717 33554432000 4194304 5683644 140733576205264 18446744073709551615 270338403910 0 0 16781312 514 3188909180287156484 0 0 17 6 0 0 0
/proc/2124/statm: 80056 5717 348 364 0 15962 0
[pid=2126] ppid=2124 vsize=2240 CPUtime=1.27 cores=0-7
/proc/2126/stat : 2126 (march_hi) R 2124 2126 2126 0 -1 4202496 664 0 0 0 127 0 0 0 25 0 1 0 529473323 2293760 391 33554432000 4194304 4955518 140735996721760 18446744073709551615 4413771 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/2126/statm: 560 391 106 186 0 373 0
[pid=2127] ppid=2106 vsize=330480 CPUtime=0 cores=0-7
/proc/2127/stat : 2127 (python) S 2106 2106 2080 0 -1 4202560 775 0 0 0 0 0 0 0 15 0 1 0 529473327 338411520 5721 33554432000 4194304 5683644 140733576205264 18446744073709551615 270338403910 0 0 16781312 514 4408871207374422015 0 0 17 6 0 0 0
/proc/2127/statm: 82620 5721 348 364 0 18523 0
[pid=2129] ppid=2127 vsize=2240 CPUtime=1.22 cores=0-7
/proc/2129/stat : 2129 (march_hi) R 2127 2129 2129 0 -1 4202496 662 0 0 0 122 0 0 0 19 0 1 0 529473327 2293760 388 33554432000 4194304 4955518 140735228613072 18446744073709551615 4224758 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/2129/statm: 560 388 106 186 0 373 0
[pid=2130] ppid=2106 vsize=340736 CPUtime=0 cores=0-7
/proc/2130/stat : 2130 (python) S 2106 2106 2080 0 -1 4202560 778 0 0 0 0 0 0 0 15 0 1 0 529473331 348913664 5725 33554432000 4194304 5683644 140733576205264 18446744073709551615 270338403910 0 0 16781312 514 12885524215876256003 0 0 17 4 0 0 0
/proc/2130/statm: 85184 5725 348 364 0 21084 0
[pid=2132] ppid=2130 vsize=2240 CPUtime=1.13 cores=0-7
/proc/2132/stat : 2132 (march_hi) R 2130 2132 2132 0 -1 4202496 658 0 0 0 113 0 0 0 25 0 1 0 529473331 2293760 382 33554432000 4194304 4955518 140733815113776 18446744073709551615 4208667 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/2132/statm: 560 382 106 186 0 373 0
[pid=2133] ppid=2106 vsize=350992 CPUtime=0 cores=0-7
/proc/2133/stat : 2133 (python) S 2106 2106 2080 0 -1 4202560 795 0 0 0 0 0 0 0 18 0 1 0 529473335 359415808 5735 33554432000 4194304 5683644 140733576205264 18446744073709551615 270338403910 0 0 16781312 514 693196730753089535 0 0 17 6 0 0 0
/proc/2133/statm: 87748 5735 354 364 0 23645 0
[pid=2135] ppid=2133 vsize=416280 CPUtime=1.16 cores=0-7
/proc/2135/stat : 2135 (adaptg2wsat2009) R 2133 2135 2135 0 -1 4202496 525 0 0 0 116 0 0 0 22 0 1 0 529473335 426270720 252 33554432000 134512640 135107411 4290088448 18446744073709551615 134531600 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/2135/statm: 104070 252 59 146 0 102946 0
[pid=2106/tid=2113] ppid=2104 vsize=361236 CPUtime=0 cores=0-7
/proc/2106/task/2113/stat : 2113 (python) S 2104 2106 2080 0 -1 4202560 28 932 0 0 0 0 0 0 25 0 9 0 529473308 369905664 7274 33554432000 4194304 5683644 140733576205264 18446744073709551615 270350207409 0 0 16781312 2 18446604453965985728 0 0 -1 0 0 0 0
[pid=2106/tid=2116] ppid=2104 vsize=361236 CPUtime=0 cores=0-7
/proc/2106/task/2116/stat : 2116 (python) S 2104 2106 2080 0 -1 4202560 22 932 0 0 0 0 0 0 20 0 9 0 529473311 369905664 7274 33554432000 4194304 5683644 140733576205264 18446744073709551615 270350207409 0 0 16781312 2 18446604453965985728 0 0 -1 6 0 0 0
[pid=2106/tid=2119] ppid=2104 vsize=361236 CPUtime=0 cores=0-7
/proc/2106/task/2119/stat : 2119 (python) S 2104 2106 2080 0 -1 4202560 21 932 0 0 0 0 0 0 20 0 9 0 529473315 369905664 7274 33554432000 4194304 5683644 140733576205264 18446744073709551615 270350207409 0 0 16781312 2 18446604453965985728 0 0 -1 0 0 0 0
[pid=2106/tid=2122] ppid=2104 vsize=361236 CPUtime=0 cores=0-7
/proc/2106/task/2122/stat : 2122 (python) S 2104 2106 2080 0 -1 4202560 20 932 0 0 0 0 0 0 20 0 9 0 529473319 369905664 7274 33554432000 4194304 5683644 140733576205264 18446744073709551615 270350207409 0 0 16781312 2 18446604453965985728 0 0 -1 4 0 0 0
[pid=2106/tid=2125] ppid=2104 vsize=361236 CPUtime=0 cores=0-7
/proc/2106/task/2125/stat : 2125 (python) S 2104 2106 2080 0 -1 4202560 26 932 0 0 0 0 0 0 22 0 9 0 529473323 369905664 7274 33554432000 4194304 5683644 140733576205264 18446744073709551615 270350207409 0 0 16781312 2 18446604453965985728 0 0 -1 4 0 0 0
[pid=2106/tid=2128] ppid=2104 vsize=361236 CPUtime=0 cores=0-7
/proc/2106/task/2128/stat : 2128 (python) S 2104 2106 2080 0 -1 4202560 23 932 0 0 0 0 0 0 20 0 9 0 529473327 369905664 7274 33554432000 4194304 5683644 140733576205264 18446744073709551615 270350207409 0 0 16781312 2 18446604453965985728 0 0 -1 4 0 0 0
[pid=2106/tid=2131] ppid=2104 vsize=361236 CPUtime=0 cores=0-7
/proc/2106/task/2131/stat : 2131 (python) S 2104 2106 2080 0 -1 4202560 27 932 0 0 0 0 0 0 20 0 9 0 529473331 369905664 7274 33554432000 4194304 5683644 140733576205264 18446744073709551615 270350207409 0 0 16781312 2 18446604453965985728 0 0 -1 4 0 0 0
[pid=2106/tid=2134] ppid=2104 vsize=361236 CPUtime=0 cores=0-7
/proc/2106/task/2134/stat : 2134 (python) S 2104 2106 2080 0 -1 4202560 30 932 0 0 0 0 0 0 20 0 9 0 529473335 369905664 7274 33554432000 4194304 5683644 140733576205264 18446744073709551615 270350207409 0 0 16781312 2 18446604453965985728 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 11.1
Current children cumulated vsize (KiB) 5344640

[startup+2.70174 s]
/proc/loadavg: 7.53 7.93 7.96 9/311 2135
/proc/meminfo: memFree=18051028/32951124 swapFree=67111356/67111528
[pid=2106] ppid=2104 vsize=361236 CPUtime=0.85 cores=0-7
/proc/2106/stat : 2106 (python) S 2104 2106 2080 0 -1 4202496 15949 932 1 0 72 13 0 0 20 0 9 0 529473222 369905664 7274 33554432000 4194304 5683644 140733576205264 18446744073709551615 270350210507 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/2106/statm: 90309 7274 1889 364 0 26206 0
[pid=2112] ppid=2106 vsize=278784 CPUtime=0 cores=0-7
/proc/2112/stat : 2112 (python) S 2106 2106 2080 0 -1 4202560 732 0 0 0 0 0 0 0 18 0 1 0 529473308 285474816 5601 33554432000 4194304 5683644 140733576205264 18446744073709551615 270338403855 0 0 16781312 514 4530277906923880708 0 0 17 7 0 0 0
/proc/2112/statm: 69696 5601 354 364 0 5614 0
[pid=2114] ppid=2112 vsize=1017940 CPUtime=1.83 cores=0-7
/proc/2114/stat : 2114 (gnovelty+2) R 2112 2114 2114 0 -1 4202496 454 0 0 0 183 0 0 0 25 0 1 0 529473308 1042370560 191 33554432000 134512640 135663704 4294307840 18446744073709551615 134525286 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/2114/statm: 254485 191 113 282 0 254201 0
[pid=2115] ppid=2106 vsize=289320 CPUtime=0 cores=0-7
/proc/2115/stat : 2115 (python) S 2106 2106 2080 0 -1 4202560 736 0 0 0 0 0 0 0 18 0 1 0 529473311 296263680 5688 33554432000 4194304 5683644 140733576205264 18446744073709551615 270338403910 0 0 16781312 514 4434018137813254402 0 0 17 6 0 0 0
/proc/2115/statm: 72330 5688 348 364 0 8245 0
[pid=2117] ppid=2115 vsize=1017940 CPUtime=1.8 cores=0-7
/proc/2117/stat : 2117 (gnovelty+2) R 2115 2117 2117 0 -1 4202496 451 0 0 0 180 0 0 0 25 0 1 0 529473312 1042370560 191 33554432000 134512640 135663704 4289508112 18446744073709551615 134524921 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/2117/statm: 254485 191 113 282 0 254201 0
[pid=2118] ppid=2106 vsize=299236 CPUtime=0 cores=0-7
/proc/2118/stat : 2118 (python) S 2106 2106 2080 0 -1 4202560 753 0 0 0 0 0 0 0 15 0 1 0 529473315 306417664 5622 33554432000 4194304 5683644 140733576205264 18446744073709551615 270338403910 0 0 16781312 514 8522978736209887489 0 0 17 0 0 0 0

################
# More data... #
################

[pid=2133] ppid=2106 vsize=350992 CPUtime=0 cores=0-7
/proc/2133/stat : 2133 (python) S 2106 2106 2080 0 -1 4202560 795 0 0 0 0 0 0 0 18 0 1 0 529473335 359415808 5735 33554432000 4194304 5683644 140733576205264 18446744073709551615 270338403910 0 0 16781312 514 693196730753089535 0 0 17 6 0 0 0
/proc/2133/statm: 87748 5735 354 364 0 23645 0
[pid=2135] ppid=2133 vsize=416280 CPUtime=1.56 cores=0-7
/proc/2135/stat : 2135 (adaptg2wsat2009) R 2133 2135 2135 0 -1 4202496 525 0 0 0 156 0 0 0 25 0 1 0 529473335 426270720 252 33554432000 134512640 135107411 4290088448 18446744073709551615 134531254 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/2135/statm: 104070 252 59 146 0 102946 0
[pid=2106/tid=2113] ppid=2104 vsize=361236 CPUtime=0 cores=0-7
/proc/2106/task/2113/stat : 2113 (python) S 2104 2106 2080 0 -1 4202560 28 932 0 0 0 0 0 0 25 0 9 0 529473308 369905664 7274 33554432000 4194304 5683644 140733576205264 18446744073709551615 270350207409 0 0 16781312 2 18446604453965985728 0 0 -1 0 0 0 0
[pid=2106/tid=2116] ppid=2104 vsize=361236 CPUtime=0 cores=0-7
/proc/2106/task/2116/stat : 2116 (python) S 2104 2106 2080 0 -1 4202560 22 932 0 0 0 0 0 0 20 0 9 0 529473311 369905664 7274 33554432000 4194304 5683644 140733576205264 18446744073709551615 270350207409 0 0 16781312 2 18446604453965985728 0 0 -1 6 0 0 0
[pid=2106/tid=2119] ppid=2104 vsize=361236 CPUtime=0 cores=0-7
/proc/2106/task/2119/stat : 2119 (python) S 2104 2106 2080 0 -1 4202560 21 932 0 0 0 0 0 0 20 0 9 0 529473315 369905664 7274 33554432000 4194304 5683644 140733576205264 18446744073709551615 270350207409 0 0 16781312 2 18446604453965985728 0 0 -1 0 0 0 0
[pid=2106/tid=2122] ppid=2104 vsize=361236 CPUtime=0 cores=0-7
/proc/2106/task/2122/stat : 2122 (python) S 2104 2106 2080 0 -1 4202560 20 932 0 0 0 0 0 0 20 0 9 0 529473319 369905664 7274 33554432000 4194304 5683644 140733576205264 18446744073709551615 270350207409 0 0 16781312 2 18446604453965985728 0 0 -1 4 0 0 0
[pid=2106/tid=2125] ppid=2104 vsize=361236 CPUtime=0 cores=0-7
/proc/2106/task/2125/stat : 2125 (python) S 2104 2106 2080 0 -1 4202560 26 932 0 0 0 0 0 0 22 0 9 0 529473323 369905664 7274 33554432000 4194304 5683644 140733576205264 18446744073709551615 270350207409 0 0 16781312 2 18446604453965985728 0 0 -1 4 0 0 0
[pid=2106/tid=2128] ppid=2104 vsize=361236 CPUtime=0 cores=0-7
/proc/2106/task/2128/stat : 2128 (python) S 2104 2106 2080 0 -1 4202560 23 932 0 0 0 0 0 0 20 0 9 0 529473327 369905664 7274 33554432000 4194304 5683644 140733576205264 18446744073709551615 270350207409 0 0 16781312 2 18446604453965985728 0 0 -1 4 0 0 0
[pid=2106/tid=2131] ppid=2104 vsize=361236 CPUtime=0 cores=0-7
/proc/2106/task/2131/stat : 2131 (python) S 2104 2106 2080 0 -1 4202560 27 932 0 0 0 0 0 0 20 0 9 0 529473331 369905664 7274 33554432000 4194304 5683644 140733576205264 18446744073709551615 270350207409 0 0 16781312 2 18446604453965985728 0 0 -1 4 0 0 0
[pid=2106/tid=2134] ppid=2104 vsize=361236 CPUtime=0 cores=0-7
/proc/2106/task/2134/stat : 2134 (python) S 2104 2106 2080 0 -1 4202560 30 932 0 0 0 0 0 0 20 0 9 0 529473335 369905664 7274 33554432000 4194304 5683644 140733576205264 18446744073709551615 270350207409 0 0 16781312 2 18446604453965985728 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 14.31
Current children cumulated vsize (KiB) 5345096

[startup+2.9017 s]
/proc/loadavg: 7.53 7.93 7.96 9/311 2135
/proc/meminfo: memFree=18051028/32951124 swapFree=67111356/67111528
[pid=2106] ppid=2104 vsize=361236 CPUtime=0.85 cores=0-7
/proc/2106/stat : 2106 (python) S 2104 2106 2080 0 -1 4202496 15949 932 1 0 72 13 0 0 20 0 9 0 529473222 369905664 7274 33554432000 4194304 5683644 140733576205264 18446744073709551615 270350210507 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/2106/statm: 90309 7274 1889 364 0 26206 0
[pid=2112] ppid=2106 vsize=278784 CPUtime=0 cores=0-7
/proc/2112/stat : 2112 (python) S 2106 2106 2080 0 -1 4202560 732 0 0 0 0 0 0 0 18 0 1 0 529473308 285474816 5601 33554432000 4194304 5683644 140733576205264 18446744073709551615 270338403855 0 0 16781312 514 4530277906923880708 0 0 17 7 0 0 0
/proc/2112/statm: 69696 5601 354 364 0 5614 0
[pid=2114] ppid=2112 vsize=1017940 CPUtime=2.03 cores=0-7
/proc/2114/stat : 2114 (gnovelty+2) R 2112 2114 2114 0 -1 4202496 454 0 0 0 203 0 0 0 25 0 1 0 529473308 1042370560 191 33554432000 134512640 135663704 4294307840 18446744073709551615 134524945 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/2114/statm: 254485 191 113 282 0 254201 0
[pid=2115] ppid=2106 vsize=289320 CPUtime=0 cores=0-7
/proc/2115/stat : 2115 (python) S 2106 2106 2080 0 -1 4202560 736 0 0 0 0 0 0 0 18 0 1 0 529473311 296263680 5688 33554432000 4194304 5683644 140733576205264 18446744073709551615 270338403910 0 0 16781312 514 4434018137813254402 0 0 17 6 0 0 0
/proc/2115/statm: 72330 5688 348 364 0 8245 0
[pid=2117] ppid=2115 vsize=1017940 CPUtime=2 cores=0-7
/proc/2117/stat : 2117 (gnovelty+2) R 2115 2117 2117 0 -1 4202496 451 0 0 0 200 0 0 0 25 0 1 0 529473312 1042370560 191 33554432000 134512640 135663704 4289508112 18446744073709551615 134545635 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/2117/statm: 254485 191 113 282 0 254201 0
[pid=2118] ppid=2106 vsize=299236 CPUtime=0 cores=0-7
/proc/2118/stat : 2118 (python) S 2106 2106 2080 0 -1 4202560 753 0 0 0 0 0 0 0 15 0 1 0 529473315 306417664 5622 33554432000 4194304 5683644 140733576205264 18446744073709551615 270338403910 0 0 16781312 514 8522978736209887489 0 0 17 0 0 0 0
/proc/2118/statm: 74809 5622 348 364 0 10721 0
[pid=2120] ppid=2118 vsize=2620 CPUtime=1.93 cores=0-7
/proc/2120/stat : 2120 (march_hi) R 2118 2120 2120 0 -1 4202496 707 0 0 0 193 0 0 0 25 0 1 0 529473315 2682880 433 33554432000 4194304 4955518 140733522434720 18446744073709551615 4208667 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/2120/statm: 655 433 106 186 0 468 0
[pid=2121] ppid=2106 vsize=309968 CPUtime=0 cores=0-7
/proc/2121/stat : 2121 (python) S 2106 2106 2080 0 -1 4202560 774 0 0 0 0 0 0 0 15 0 1 0 529473319 317407232 5713 33554432000 4194304 5683644 140733576205264 18446744073709551615 270338403910 0 0 16781312 514 8522974338163376385 0 0 17 6 0 0 0
/proc/2121/statm: 77492 5713 348 364 0 13401 0
[pid=2123] ppid=2121 vsize=2620 CPUtime=1.92 cores=0-7
/proc/2123/stat : 2123 (march_hi) R 2121 2123 2123 0 -1 4202496 705 0 0 0 192 0 0 0 25 0 1 0 529473319 2682880 431 33554432000 4194304 4955518 140734101326624 18446744073709551615 4224471 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/2123/statm: 655 431 106 186 0 468 0
[pid=2124] ppid=2106 vsize=320224 CPUtime=0 cores=0-7
/proc/2124/stat : 2124 (python) S 2106 2106 2080 0 -1 4202560 773 0 0 0 0 0 0 0 15 0 1 0 529473323 327909376 5717 33554432000 4194304 5683644 140733576205264 18446744073709551615 270338403910 0 0 16781312 514 3188909180287156484 0 0 17 6 0 0 0
/proc/2124/statm: 80056 5717 348 364 0 15962 0
[pid=2126] ppid=2124 vsize=2392 CPUtime=1.87 cores=0-7
/proc/2126/stat : 2126 (march_hi) R 2124 2126 2126 0 -1 4202496 701 0 0 0 187 0 0 0 25 0 1 0 529473323 2449408 428 33554432000 4194304 4955518 140735996721760 18446744073709551615 4297477 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/2126/statm: 598 428 106 186 0 411 0
[pid=2127] ppid=2106 vsize=330480 CPUtime=0 cores=0-7
/proc/2127/stat : 2127 (python) S 2106 2106 2080 0 -1 4202560 777 0 0 0 0 0 0 0 15 0 1 0 529473327 338411520 5721 33554432000 4194304 5683644 140733576205264 18446744073709551615 270338403910 0 0 16781312 514 13426567499625758979 0 0 17 6 0 0 0
/proc/2127/statm: 82620 5721 348 364 0 18523 0
[pid=2129] ppid=2127 vsize=2392 CPUtime=1.82 cores=0-7
/proc/2129/stat : 2129 (march_hi) R 2127 2129 2129 0 -1 4202496 700 0 0 0 182 0 0 0 20 0 1 0 529473327 2449408 426 33554432000 4194304 4955518 140735228613072 18446744073709551615 4208667 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/2129/statm: 598 426 106 186 0 411 0
[pid=2130] ppid=2106 vsize=340736 CPUtime=0 cores=0-7
/proc/2130/stat : 2130 (python) S 2106 2106 2080 0 -1 4202560 780 0 0 0 0 0 0 0 15 0 1 0 529473331 348913664 5725 33554432000 4194304 5683644 140733576205264 18446744073709551615 270338403910 0 0 16781312 514 12885524215876256003 0 0 17 4 0 0 0
/proc/2130/statm: 85184 5725 348 364 0 21084 0
[pid=2132] ppid=2130 vsize=2392 CPUtime=1.73 cores=0-7
/proc/2132/stat : 2132 (march_hi) R 2130 2132 2132 0 -1 4202496 697 0 0 0 173 0 0 0 25 0 1 0 529473331 2449408 421 33554432000 4194304 4955518 140733815113776 18446744073709551615 4297475 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/2132/statm: 598 421 106 186 0 411 0
[pid=2133] ppid=2106 vsize=350992 CPUtime=0 cores=0-7
/proc/2133/stat : 2133 (python) S 2106 2106 2080 0 -1 4202560 795 0 0 0 0 0 0 0 18 0 1 0 529473335 359415808 5735 33554432000 4194304 5683644 140733576205264 18446744073709551615 270338403910 0 0 16781312 514 693196730753089535 0 0 17 6 0 0 0
/proc/2133/statm: 87748 5735 354 364 0 23645 0
[pid=2135] ppid=2133 vsize=416280 CPUtime=1.76 cores=0-7
/proc/2135/stat : 2135 (adaptg2wsat2009) R 2133 2135 2135 0 -1 4202496 525 0 0 0 176 0 0 0 25 0 1 0 529473335 426270720 252 33554432000 134512640 135107411 4290088448 18446744073709551615 134531582 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/2135/statm: 104070 252 59 146 0 102946 0
[pid=2106/tid=2113] ppid=2104 vsize=361236 CPUtime=0 cores=0-7
/proc/2106/task/2113/stat : 2113 (python) S 2104 2106 2080 0 -1 4202560 28 932 0 0 0 0 0 0 25 0 9 0 529473308 369905664 7274 33554432000 4194304 5683644 140733576205264 18446744073709551615 270350207409 0 0 16781312 2 18446604453965985728 0 0 -1 0 0 0 0
[pid=2106/tid=2116] ppid=2104 vsize=361236 CPUtime=0 cores=0-7
/proc/2106/task/2116/stat : 2116 (python) S 2104 2106 2080 0 -1 4202560 22 932 0 0 0 0 0 0 20 0 9 0 529473311 369905664 7274 33554432000 4194304 5683644 140733576205264 18446744073709551615 270350207409 0 0 16781312 2 18446604453965985728 0 0 -1 6 0 0 0
[pid=2106/tid=2119] ppid=2104 vsize=361236 CPUtime=0 cores=0-7
/proc/2106/task/2119/stat : 2119 (python) S 2104 2106 2080 0 -1 4202560 21 932 0 0 0 0 0 0 20 0 9 0 529473315 369905664 7274 33554432000 4194304 5683644 140733576205264 18446744073709551615 270350207409 0 0 16781312 2 18446604453965985728 0 0 -1 0 0 0 0
[pid=2106/tid=2122] ppid=2104 vsize=361236 CPUtime=0 cores=0-7
/proc/2106/task/2122/stat : 2122 (python) S 2104 2106 2080 0 -1 4202560 20 932 0 0 0 0 0 0 20 0 9 0 529473319 369905664 7274 33554432000 4194304 5683644 140733576205264 18446744073709551615 270350207409 0 0 16781312 2 18446604453965985728 0 0 -1 4 0 0 0
[pid=2106/tid=2125] ppid=2104 vsize=361236 CPUtime=0 cores=0-7
/proc/2106/task/2125/stat : 2125 (python) S 2104 2106 2080 0 -1 4202560 26 932 0 0 0 0 0 0 22 0 9 0 529473323 369905664 7274 33554432000 4194304 5683644 140733576205264 18446744073709551615 270350207409 0 0 16781312 2 18446604453965985728 0 0 -1 4 0 0 0
[pid=2106/tid=2128] ppid=2104 vsize=361236 CPUtime=0 cores=0-7
/proc/2106/task/2128/stat : 2128 (python) S 2104 2106 2080 0 -1 4202560 23 932 0 0 0 0 0 0 20 0 9 0 529473327 369905664 7274 33554432000 4194304 5683644 140733576205264 18446744073709551615 270350207409 0 0 16781312 2 18446604453965985728 0 0 -1 4 0 0 0
[pid=2106/tid=2131] ppid=2104 vsize=361236 CPUtime=0 cores=0-7
/proc/2106/task/2131/stat : 2131 (python) S 2104 2106 2080 0 -1 4202560 27 932 0 0 0 0 0 0 20 0 9 0 529473331 369905664 7274 33554432000 4194304 5683644 140733576205264 18446744073709551615 270350207409 0 0 16781312 2 18446604453965985728 0 0 -1 4 0 0 0
[pid=2106/tid=2134] ppid=2104 vsize=361236 CPUtime=0 cores=0-7
/proc/2106/task/2134/stat : 2134 (python) S 2104 2106 2080 0 -1 4202560 30 932 0 0 0 0 0 0 20 0 9 0 529473335 369905664 7274 33554432000 4194304 5683644 140733576205264 18446744073709551615 270350207409 0 0 16781312 2 18446604453965985728 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 15.91
Current children cumulated vsize (KiB) 5345552

[startup+3.00168 s]
/proc/loadavg: 7.53 7.93 7.96 9/311 2135
/proc/meminfo: memFree=18051028/32951124 swapFree=67111356/67111528
[pid=2106] ppid=2104 vsize=361236 CPUtime=0.85 cores=0-7
/proc/2106/stat : 2106 (python) S 2104 2106 2080 0 -1 4202496 15949 932 1 0 72 13 0 0 20 0 9 0 529473222 369905664 7274 33554432000 4194304 5683644 140733576205264 18446744073709551615 270350210507 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/2106/statm: 90309 7274 1889 364 0 26206 0
[pid=2112] ppid=2106 vsize=278784 CPUtime=0 cores=0-7
/proc/2112/stat : 2112 (python) S 2106 2106 2080 0 -1 4202560 732 0 0 0 0 0 0 0 18 0 1 0 529473308 285474816 5601 33554432000 4194304 5683644 140733576205264 18446744073709551615 270338403855 0 0 16781312 514 4530277906923880708 0 0 17 7 0 0 0
/proc/2112/statm: 69696 5601 354 364 0 5614 0
[pid=2114] ppid=2112 vsize=1017940 CPUtime=2.13 cores=0-7
/proc/2114/stat : 2114 (gnovelty+2) R 2112 2114 2114 0 -1 4202496 454 0 0 0 213 0 0 0 25 0 1 0 529473308 1042370560 191 33554432000 134512640 135663704 4294307840 18446744073709551615 134524498 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/2114/statm: 254485 191 113 282 0 254201 0
[pid=2115] ppid=2106 vsize=289320 CPUtime=0 cores=0-7
/proc/2115/stat : 2115 (python) S 2106 2106 2080 0 -1 4202560 736 0 0 0 0 0 0 0 18 0 1 0 529473311 296263680 5688 33554432000 4194304 5683644 140733576205264 18446744073709551615 270338403910 0 0 16781312 514 4434018137813254402 0 0 17 6 0 0 0
/proc/2115/statm: 72330 5688 348 364 0 8245 0
[pid=2117] ppid=2115 vsize=1017940 CPUtime=2.1 cores=0-7
/proc/2117/stat : 2117 (gnovelty+2) R 2115 2117 2117 0 -1 4202496 451 0 0 0 210 0 0 0 25 0 1 0 529473312 1042370560 191 33554432000 134512640 135663704 4289508112 18446744073709551615 134525276 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/2117/statm: 254485 191 113 282 0 254201 0
[pid=2118] ppid=2106 vsize=299236 CPUtime=0 cores=0-7
/proc/2118/stat : 2118 (python) S 2106 2106 2080 0 -1 4202560 753 0 0 0 0 0 0 0 15 0 1 0 529473315 306417664 5622 33554432000 4194304 5683644 140733576205264 18446744073709551615 270338403910 0 0 16781312 514 8522978736209887489 0 0 17 0 0 0 0
/proc/2118/statm: 74809 5622 348 364 0 10721 0
[pid=2120] ppid=2118 vsize=2620 CPUtime=2.03 cores=0-7
/proc/2120/stat : 2120 (march_hi) R 2118 2120 2120 0 -1 4202496 712 0 0 0 203 0 0 0 25 0 1 0 529473315 2682880 438 33554432000 4194304 4955518 140733522434720 18446744073709551615 4297483 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/2120/statm: 655 438 106 186 0 468 0
[pid=2121] ppid=2106 vsize=309968 CPUtime=0 cores=0-7
/proc/2121/stat : 2121 (python) S 2106 2106 2080 0 -1 4202560 774 0 0 0 0 0 0 0 15 0 1 0 529473319 317407232 5713 33554432000 4194304 5683644 140733576205264 18446744073709551615 270338403910 0 0 16781312 514 8522974338163376385 0 0 17 6 0 0 0
/proc/2121/statm: 77492 5713 348 364 0 13401 0
[pid=2123] ppid=2121 vsize=2620 CPUtime=2.02 cores=0-7
/proc/2123/stat : 2123 (march_hi) R 2121 2123 2123 0 -1 4202496 711 0 0 0 202 0 0 0 25 0 1 0 529473319 2682880 437 33554432000 4194304 4955518 140734101326624 18446744073709551615 4206496 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/2123/statm: 655 437 106 186 0 468 0
[pid=2124] ppid=2106 vsize=320224 CPUtime=0 cores=0-7
/proc/2124/stat : 2124 (python) S 2106 2106 2080 0 -1 4202560 773 0 0 0 0 0 0 0 15 0 1 0 529473323 327909376 5717 33554432000 4194304 5683644 140733576205264 18446744073709551615 270338403910 0 0 16781312 514 3188909180287156484 0 0 17 6 0 0 0
/proc/2124/statm: 80056 5717 348 364 0 15962 0
[pid=2126] ppid=2124 vsize=2620 CPUtime=1.97 cores=0-7
/proc/2126/stat : 2126 (march_hi) R 2124 2126 2126 0 -1 4202496 707 0 0 0 197 0 0 0 25 0 1 0 529473323 2682880 434 33554432000 4194304 4955518 140735996721760 18446744073709551615 4224541 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/2126/statm: 655 434 106 186 0 468 0
[pid=2127] ppid=2106 vsize=330480 CPUtime=0 cores=0-7
/proc/2127/stat : 2127 (python) S 2106 2106 2080 0 -1 4202560 777 0 0 0 0 0 0 0 15 0 1 0 529473327 338411520 5721 33554432000 4194304 5683644 140733576205264 18446744073709551615 270338403910 0 0 16781312 514 13426567499625758979 0 0 17 6 0 0 0
/proc/2127/statm: 82620 5721 348 364 0 18523 0
[pid=2129] ppid=2127 vsize=2620 CPUtime=1.92 cores=0-7
/proc/2129/stat : 2129 (march_hi) R 2127 2129 2129 0 -1 4202496 706 0 0 0 192 0 0 0 21 0 1 0 529473327 2682880 432 33554432000 4194304 4955518 140735228613072 18446744073709551615 4237810 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/2129/statm: 655 432 106 186 0 468 0
[pid=2130] ppid=2106 vsize=340736 CPUtime=0 cores=0-7
/proc/2130/stat : 2130 (python) S 2106 2106 2080 0 -1 4202560 780 0 0 0 0 0 0 0 15 0 1 0 529473331 348913664 5725 33554432000 4194304 5683644 140733576205264 18446744073709551615 270338403910 0 0 16781312 514 12885524215876256003 0 0 17 4 0 0 0
/proc/2130/statm: 85184 5725 348 364 0 21084 0
[pid=2132] ppid=2130 vsize=2392 CPUtime=1.83 cores=0-7
/proc/2132/stat : 2132 (march_hi) R 2130 2132 2132 0 -1 4202496 703 0 0 0 183 0 0 0 25 0 1 0 529473331 2449408 427 33554432000 4194304 4955518 140733815113776 18446744073709551615 4313999 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/2132/statm: 598 427 106 186 0 411 0
[pid=2133] ppid=2106 vsize=350992 CPUtime=0 cores=0-7
/proc/2133/stat : 2133 (python) S 2106 2106 2080 0 -1 4202560 795 0 0 0 0 0 0 0 18 0 1 0 529473335 359415808 5735 33554432000 4194304 5683644 140733576205264 18446744073709551615 270338403910 0 0 16781312 514 693196730753089535 0 0 17 6 0 0 0
/proc/2133/statm: 87748 5735 354 364 0 23645 0
[pid=2135] ppid=2133 vsize=416280 CPUtime=1.86 cores=0-7
/proc/2135/stat : 2135 (adaptg2wsat2009) R 2133 2135 2135 0 -1 4202496 525 0 0 0 186 0 0 0 25 0 1 0 529473335 426270720 252 33554432000 134512640 135107411 4290088448 18446744073709551615 134539318 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/2135/statm: 104070 252 59 146 0 102946 0
[pid=2106/tid=2113] ppid=2104 vsize=361236 CPUtime=0 cores=0-7
/proc/2106/task/2113/stat : 2113 (python) S 2104 2106 2080 0 -1 4202560 28 932 0 0 0 0 0 0 25 0 9 0 529473308 369905664 7274 33554432000 4194304 5683644 140733576205264 18446744073709551615 270350207409 0 0 16781312 2 18446604453965985728 0 0 -1 0 0 0 0
[pid=2106/tid=2116] ppid=2104 vsize=361236 CPUtime=0 cores=0-7
/proc/2106/task/2116/stat : 2116 (python) S 2104 2106 2080 0 -1 4202560 22 932 0 0 0 0 0 0 20 0 9 0 529473311 369905664 7274 33554432000 4194304 5683644 140733576205264 18446744073709551615 270350207409 0 0 16781312 2 18446604453965985728 0 0 -1 6 0 0 0
[pid=2106/tid=2119] ppid=2104 vsize=361236 CPUtime=0 cores=0-7
/proc/2106/task/2119/stat : 2119 (python) S 2104 2106 2080 0 -1 4202560 21 932 0 0 0 0 0 0 20 0 9 0 529473315 369905664 7274 33554432000 4194304 5683644 140733576205264 18446744073709551615 270350207409 0 0 16781312 2 18446604453965985728 0 0 -1 0 0 0 0
[pid=2106/tid=2122] ppid=2104 vsize=361236 CPUtime=0 cores=0-7
/proc/2106/task/2122/stat : 2122 (python) S 2104 2106 2080 0 -1 4202560 20 932 0 0 0 0 0 0 20 0 9 0 529473319 369905664 7274 33554432000 4194304 5683644 140733576205264 18446744073709551615 270350207409 0 0 16781312 2 18446604453965985728 0 0 -1 4 0 0 0
[pid=2106/tid=2125] ppid=2104 vsize=361236 CPUtime=0 cores=0-7
/proc/2106/task/2125/stat : 2125 (python) S 2104 2106 2080 0 -1 4202560 26 932 0 0 0 0 0 0 22 0 9 0 529473323 369905664 7274 33554432000 4194304 5683644 140733576205264 18446744073709551615 270350207409 0 0 16781312 2 18446604453965985728 0 0 -1 4 0 0 0
[pid=2106/tid=2128] ppid=2104 vsize=361236 CPUtime=0 cores=0-7
/proc/2106/task/2128/stat : 2128 (python) S 2104 2106 2080 0 -1 4202560 23 932 0 0 0 0 0 0 20 0 9 0 529473327 369905664 7274 33554432000 4194304 5683644 140733576205264 18446744073709551615 270350207409 0 0 16781312 2 18446604453965985728 0 0 -1 4 0 0 0
[pid=2106/tid=2131] ppid=2104 vsize=361236 CPUtime=0 cores=0-7
/proc/2106/task/2131/stat : 2131 (python) S 2104 2106 2080 0 -1 4202560 27 932 0 0 0 0 0 0 20 0 9 0 529473331 369905664 7274 33554432000 4194304 5683644 140733576205264 18446744073709551615 270350207409 0 0 16781312 2 18446604453965985728 0 0 -1 4 0 0 0
[pid=2106/tid=2134] ppid=2104 vsize=361236 CPUtime=0 cores=0-7
/proc/2106/task/2134/stat : 2134 (python) S 2104 2106 2080 0 -1 4202560 30 932 0 0 0 0 0 0 20 0 9 0 529473335 369905664 7274 33554432000 4194304 5683644 140733576205264 18446744073709551615 270350207409 0 0 16781312 2 18446604453965985728 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 16.71
Current children cumulated vsize (KiB) 5346008

Child status: 0
Real time (s): 3.07795
CPU time (s): 17.2284
CPU user time (s): 17.0364
CPU system time (s): 0.19197
CPU usage (%): 559.736
Max. virtual memory (cumulated for all children) (KiB): 5346008

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 17.0364
system time used= 0.19197
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 33116
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3547
involuntary context switches= 347

runsolver used 0.004999 second user time and 0.026995 second system time

The end

Launcher Data 

Begin job on node143 at 2011-05-02 23:09:36
IDJOB=3321999
IDBENCH=82777
IDSOLVER=1712
FILE ID=node143/3321999-1304370576
RUNJOBID= node143-1304370576-2094
PBS_JOBID= 13181772
Free space on /tmp= 73552 MiB

SOLVER NAME= borg-sat 11.03.02-random
BENCH NAME= SAT11/random/medium/unif-k5-r21.3-v150-c3195-S1116496771-020.SATISFIABLE.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3321999-1304370576/watcher-3321999-1304370576 -o /tmp/evaluation-result-3321999-1304370576/solver-3321999-1304370576 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3321999-1304370576.cnf -seed 595080448 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 55b0e04e9e653549cf2eabcc194b78ff
RANDOM SEED=595080448

node143.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      18114968 kB
Buffers:        327288 kB
Cached:        1951488 kB
SwapCached:        168 kB
Active:       12839984 kB
Inactive:      1658132 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      18114968 kB
SwapTotal:    67111528 kB
SwapFree:     67111356 kB
Dirty:           31880 kB
Writeback:           0 kB
AnonPages:    12219208 kB
Mapped:          25204 kB
Slab:           230192 kB
PageTables:      43596 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 55243608 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73520 MiB
End job on node143 at 2011-05-02 23:09:39