Trace number 3385676

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-par-random (fixed)UNSAT 67.3608 9.24017

General information on the benchmark

Namerandom/medium/
unif-k3-r4.26-v350-c1491-S1733949620-064.UNKNOWN.cnf
MD5SUM60552051d2d5a0c0eefaeedea18e63df
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark7.26989
Satisfiable
(Un)Satisfiability was proved
Number of variables350
Number of clauses1491
Sum of the clauses size4473
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 31491
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.37/0.66	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.37/0.66	c INFO: solving HOME/instance-3385676-1305572154.cnf
0.37/0.66	c INFO: computing task features
0.37/0.67	c INFO: computed variable-clause graph statistics
0.37/0.67	c INFO: computed clause balance statistics
0.45/0.70	c INFO: computed variable balance statistics
0.45/0.72	c INFO: computed small-clause counts
0.45/0.72	c INFO: computed Horn-clause counts
0.45/0.72	c INFO: computed variable graph statistics
0.45/0.72	c INFO: collected features for HOME/instance-3385676-1305572154.cnf in 0.06 s
0.45/0.75	c INFO: running TNM@0 for 97 with 4999 remaining (b = 0.56)
0.45/0.78	c INFO: running march_hi@0 for 194 with 4999 remaining (b = 0.28)
0.54/0.81	c INFO: running march_hi@0 for 194 with 4999 remaining (b = 0.20)
0.54/0.84	c INFO: running march_hi@0 for 388 with 4999 remaining (b = 0.28)
0.54/0.87	c INFO: running gnovelty+2@0 for 97 with 4999 remaining (b = 0.07)
0.64/0.91	c INFO: running march_hi@0 for 485 with 4999 remaining (b = 0.30)
0.64/0.94	c INFO: running march_hi@0 for 388 with 4999 remaining (b = 0.23)
0.64/0.97	c INFO: running march_hi@0 for 388 with 4999 remaining (b = 0.20)
67.07/9.21	s UNSATISFIABLE

Verifier Data 

No possible verification on an UNSAT instance

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3385676-1305572154/watcher-3385676-1305572154 -o /tmp/evaluation-result-3385676-1305572154/solver-3385676-1305572154 -C 40000 -W 5100 -M 31000 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3385676-1305572154.cnf -seed 970951003 -budget 40000 -cores 8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.26 8.25 8.33 1/391 1117
/proc/meminfo: memFree=12650576/32950928 swapFree=57376972/67111528
[pid=1117] ppid=1115 vsize=15216 CPUtime=0 cores=0-7
/proc/1117/stat : 1117 (python) R 1115 1117 1091 0 -1 4202496 657 0 0 0 0 0 0 0 24 0 1 0 668815082 15581184 553 33554432000 4194304 5683644 140734176724240 18446744073709551615 4540219 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/1117/statm: 3804 553 312 364 0 291 0

[startup+0.0983821 s]
/proc/loadavg: 7.26 8.25 8.33 1/391 1117
/proc/meminfo: memFree=12650576/32950928 swapFree=57376972/67111528
[pid=1117] ppid=1115 vsize=85620 CPUtime=0.05 cores=0-7
/proc/1117/stat : 1117 (python) R 1115 1117 1091 0 -1 4202496 2630 0 0 0 4 1 0 0 25 0 1 0 668815082 87674880 2348 33554432000 4194304 5683644 140734176724240 18446744073709551615 208080230400 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/1117/statm: 21405 2348 713 364 0 1622 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 85620

[startup+0.100383 s]
/proc/loadavg: 7.26 8.25 8.33 1/391 1117
/proc/meminfo: memFree=12650576/32950928 swapFree=57376972/67111528
[pid=1117] ppid=1115 vsize=89768 CPUtime=0.06 cores=0-7
/proc/1117/stat : 1117 (python) R 1115 1117 1091 0 -1 4202496 2672 0 0 0 4 2 0 0 25 0 1 0 668815082 91922432 2388 33554432000 4194304 5683644 140734176724240 18446744073709551615 208080228197 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/1117/statm: 22442 2388 750 364 0 1622 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 89768

[startup+0.30045 s]
/proc/loadavg: 7.26 8.25 8.33 1/391 1117
/proc/meminfo: memFree=12650576/32950928 swapFree=57376972/67111528
[pid=1117] ppid=1115 vsize=135748 CPUtime=0.19 cores=0-7
/proc/1117/stat : 1117 (python) S 1115 1117 1091 0 -1 4202496 5965 932 1 0 13 6 0 0 18 0 1 0 668815082 139005952 4151 33554432000 4194304 5683644 140734176724240 18446744073709551615 208080228357 0 2147483391 16781312 2 0 0 0 17 2 0 0 0
/proc/1117/statm: 33937 4151 1032 364 0 3123 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 135748

[startup+0.700266 s]
/proc/loadavg: 7.26 8.25 8.33 1/391 1117
/proc/meminfo: memFree=12650576/32950928 swapFree=57376972/67111528
[pid=1117] ppid=1115 vsize=278264 CPUtime=0.45 cores=0-7
/proc/1117/stat : 1117 (python) R 1115 1117 1091 0 -1 4202496 9287 932 1 0 32 13 0 0 17 0 1 0 668815082 284942336 6954 33554432000 4194304 5683644 140734176724240 18446744073709551615 5003632 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/1117/statm: 69566 6954 1826 364 0 5490 0
Current children cumulated CPU time (s) 0.45
Current children cumulated vsize (KiB) 278264

[startup+1.50111 s]
/proc/loadavg: 7.26 8.25 8.33 10/416 1146
/proc/meminfo: memFree=12596180/32950928 swapFree=57376972/67111528
[pid=1117] ppid=1115 vsize=426600 CPUtime=0.72 cores=0-7
/proc/1117/stat : 1117 (python) S 1115 1117 1091 0 -1 4202496 15138 932 1 0 57 15 0 0 22 0 9 0 668815082 436838400 7413 33554432000 4194304 5683644 140734176724240 18446744073709551615 208092059083 0 0 16781312 2 18446744073709551615 0 0 17 1 0 0 0
/proc/1117/statm: 106650 7413 1889 364 0 42547 0
[pid=1123] ppid=1117 vsize=278452 CPUtime=0 cores=0-7
/proc/1123/stat : 1123 (python) S 1117 1117 1091 0 -1 4202560 716 0 0 0 0 0 0 0 18 0 1 0 668815158 285134848 5541 33554432000 4194304 5683644 140734176724240 18446744073709551615 208080252431 0 0 16781312 514 10339723789016760319 0 0 17 1 0 0 0
/proc/1123/statm: 69613 5541 347 364 0 5531 0
[pid=1125] ppid=1123 vsize=454896 CPUtime=0.73 cores=0-7
/proc/1125/stat : 1125 (TNM) R 1123 1125 1125 0 -1 4202496 413 0 0 0 73 0 0 0 21 0 1 0 668815158 465813504 150 33554432000 134512640 135008748 4286762272 18446744073709551615 134536493 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/1125/statm: 113724 150 46 122 0 112624 0
[pid=1126] ppid=1117 vsize=289284 CPUtime=0 cores=0-7
/proc/1126/stat : 1126 (python) S 1117 1117 1091 0 -1 4202560 752 0 0 0 0 0 0 0 15 0 1 0 668815161 296226816 5679 33554432000 4194304 5683644 140734176724240 18446744073709551615 208080252486 0 0 16781312 514 15589676307368083716 0 0 17 1 0 0 0
/proc/1126/statm: 72321 5679 348 364 0 8236 0
[pid=1128] ppid=1126 vsize=1808 CPUtime=0.7 cores=0-7
/proc/1128/stat : 1128 (march_hi) R 1126 1128 1128 0 -1 4202496 544 0 0 0 70 0 0 0 24 0 1 0 668815161 1851392 283 33554432000 4194304 4955518 140736106703968 18446744073709551615 4227764 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/1128/statm: 452 283 104 186 0 265 0
[pid=1129] ppid=1117 vsize=365076 CPUtime=0 cores=0-7
/proc/1129/stat : 1129 (python) S 1117 1117 1091 0 -1 4202560 713 0 0 0 0 0 0 0 15 0 1 0 668815164 373837824 5856 33554432000 4194304 5683644 140734176724240 18446744073709551615 208080252486 0 0 16781312 514 743626106438910215 0 0 17 7 0 0 0
/proc/1129/statm: 91269 5856 348 364 0 27181 0
[pid=1131] ppid=1129 vsize=1808 CPUtime=0.67 cores=0-7
/proc/1131/stat : 1131 (march_hi) R 1129 1131 1131 0 -1 4202496 535 0 0 0 67 0 0 0 24 0 1 0 668815164 1851392 283 33554432000 4194304 4955518 140737326969616 18446744073709551615 4227664 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/1131/statm: 452 283 104 186 0 265 0
[pid=1132] ppid=1117 vsize=375332 CPUtime=0 cores=0-7
/proc/1132/stat : 1132 (python) S 1117 1117 1091 0 -1 4202560 729 0 0 0 0 0 0 0 15 0 1 0 668815167 384339968 5817 33554432000 4194304 5683644 140734176724240 18446744073709551615 208080252486 0 0 16781312 514 2826650885260542209 0 0 17 7 0 0 0
/proc/1132/statm: 93833 5817 348 364 0 29742 0
[pid=1134] ppid=1132 vsize=1808 CPUtime=0.64 cores=0-7
/proc/1134/stat : 1134 (march_hi) R 1132 1134 1134 0 -1 4202496 539 0 0 0 64 0 0 0 22 0 1 0 668815167 1851392 283 33554432000 4194304 4955518 140734725207104 18446744073709551615 4238422 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/1134/statm: 452 283 104 186 0 265 0
[pid=1135] ppid=1117 vsize=385588 CPUtime=0 cores=0-7
/proc/1135/stat : 1135 (python) S 1117 1117 1091 0 -1 4202560 725 0 0 0 0 0 0 0 19 0 1 0 668815170 394842112 5822 33554432000 4194304 5683644 140734176724240 18446744073709551615 208080252486 0 0 16781312 514 2934380759672160255 0 0 17 1 0 0 0
/proc/1135/statm: 96397 5822 348 364 0 32303 0
[pid=1137] ppid=1135 vsize=1017800 CPUtime=0.61 cores=0-7
/proc/1137/stat : 1137 (gnovelty+2) R 1135 1137 1137 0 -1 4202496 423 0 0 0 61 0 0 0 22 0 1 0 668815170 1042227200 163 33554432000 134512640 135663704 4287950672 18446744073709551615 134547375 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/1137/statm: 254450 163 113 282 0 254166 0
[pid=1138] ppid=1117 vsize=395844 CPUtime=0 cores=0-7
/proc/1138/stat : 1138 (python) S 1117 1117 1091 0 -1 4202560 743 0 0 0 0 0 0 0 16 0 1 0 668815173 405344256 5946 33554432000 4194304 5683644 140734176724240 18446744073709551615 208080252486 0 0 16781312 514 5799532414673846531 0 0 17 7 0 0 0
/proc/1138/statm: 98961 5946 348 364 0 34864 0
[pid=1140] ppid=1138 vsize=1808 CPUtime=0.56 cores=0-7
/proc/1140/stat : 1140 (march_hi) R 1138 1140 1140 0 -1 4202496 542 0 0 0 56 0 0 0 25 0 1 0 668815173 1851392 283 33554432000 4194304 4955518 140737456647648 18446744073709551615 4209717 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/1140/statm: 452 283 104 186 0 265 0
[pid=1141] ppid=1117 vsize=406100 CPUtime=0 cores=0-7
/proc/1141/stat : 1141 (python) S 1117 1117 1091 0 -1 4202560 754 0 0 0 0 0 0 0 16 0 1 0 668815176 415846400 5846 33554432000 4194304 5683644 140734176724240 18446744073709551615 208080252486 0 0 16781312 514 11708875250342002946 0 0 17 2 0 0 0
/proc/1141/statm: 101525 5846 348 364 0 37425 0
[pid=1143] ppid=1141 vsize=1808 CPUtime=0.52 cores=0-7
/proc/1143/stat : 1143 (march_hi) R 1141 1143 1143 0 -1 4202496 539 0 0 0 52 0 0 0 25 0 1 0 668815177 1851392 279 33554432000 4194304 4955518 140733319715392 18446744073709551615 4261370 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/1143/statm: 452 279 104 186 0 265 0
[pid=1144] ppid=1117 vsize=416356 CPUtime=0 cores=0-7
/proc/1144/stat : 1144 (python) S 1117 1117 1091 0 -1 4202560 788 0 0 0 0 0 0 0 19 0 1 0 668815179 426348544 5874 33554432000 4194304 5683644 140734176724240 18446744073709551615 208080252486 0 0 16781312 514 232260840546337027 0 0 17 1 0 0 0
/proc/1144/statm: 104089 5874 354 364 0 39986 0
[pid=1146] ppid=1144 vsize=1808 CPUtime=0.51 cores=0-7
/proc/1146/stat : 1146 (march_hi) R 1144 1146 1146 0 -1 4202496 543 0 0 0 51 0 0 0 25 0 1 0 668815180 1851392 278 33554432000 4194304 4955518 140734895137696 18446744073709551615 4310472 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/1146/statm: 452 278 104 186 0 265 0
[pid=1117/tid=1124] ppid=1115 vsize=426600 CPUtime=0 cores=0-7
/proc/1117/task/1124/stat : 1124 (python) S 1115 1117 1091 0 -1 4202560 26 932 0 0 0 0 0 0 18 0 9 0 668815158 436838400 7413 33554432000 4194304 5683644 140734176724240 18446744073709551615 208092055985 0 0 16781312 2 18446604450493616256 0 0 -1 0 0 0 0
[pid=1117/tid=1127] ppid=1115 vsize=426600 CPUtime=0 cores=0-7
/proc/1117/task/1127/stat : 1127 (python) S 1115 1117 1091 0 -1 4202560 22 932 0 0 0 0 0 0 18 0 9 0 668815161 436838400 7413 33554432000 4194304 5683644 140734176724240 18446744073709551615 208092055985 0 0 16781312 2 18446604450493616256 0 0 -1 3 0 0 0
[pid=1117/tid=1130] ppid=1115 vsize=426600 CPUtime=0 cores=0-7
/proc/1117/task/1130/stat : 1130 (python) S 1115 1117 1091 0 -1 4202560 70 932 0 0 0 0 0 0 20 0 9 0 668815164 436838400 7413 33554432000 4194304 5683644 140734176724240 18446744073709551615 208092055985 0 0 16781312 2 18446604450493616256 0 0 -1 0 0 0 0
[pid=1117/tid=1133] ppid=1115 vsize=426600 CPUtime=0 cores=0-7
/proc/1117/task/1133/stat : 1133 (python) S 1115 1117 1091 0 -1 4202560 30 932 0 0 0 0 0 0 20 0 9 0 668815167 436838400 7413 33554432000 4194304 5683644 140734176724240 18446744073709551615 208092055985 0 0 16781312 2 18446604450493616256 0 0 -1 0 0 0 0
[pid=1117/tid=1136] ppid=1115 vsize=426600 CPUtime=0 cores=0-7
/proc/1117/task/1136/stat : 1136 (python) S 1115 1117 1091 0 -1 4202560 36 932 0 0 0 0 0 0 19 0 9 0 668815170 436838400 7413 33554432000 4194304 5683644 140734176724240 18446744073709551615 208092055985 0 0 16781312 2 18446604450493616256 0 0 -1 0 0 0 0
[pid=1117/tid=1139] ppid=1115 vsize=426600 CPUtime=0 cores=0-7
/proc/1117/task/1139/stat : 1139 (python) S 1115 1117 1091 0 -1 4202560 31 932 0 0 0 0 0 0 20 0 9 0 668815173 436838400 7413 33554432000 4194304 5683644 140734176724240 18446744073709551615 208092055985 0 0 16781312 2 18446604450493616256 0 0 -1 7 0 0 0
[pid=1117/tid=1142] ppid=1115 vsize=426600 CPUtime=0 cores=0-7
/proc/1117/task/1142/stat : 1142 (python) S 1115 1117 1091 0 -1 4202560 35 932 0 0 0 0 0 0 21 0 9 0 668815176 436838400 7413 33554432000 4194304 5683644 140734176724240 18446744073709551615 208092055985 0 0 16781312 2 18446604450493616256 0 0 -1 1 0 0 0
[pid=1117/tid=1145] ppid=1115 vsize=426600 CPUtime=0 cores=0-7
/proc/1117/task/1145/stat : 1145 (python) S 1115 1117 1091 0 -1 4202560 34 932 0 0 0 0 0 0 22 0 9 0 668815179 436838400 7413 33554432000 4194304 5683644 140734176724240 18446744073709551615 208092055985 0 0 16781312 2 18446604450493616256 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 5.66
Current children cumulated vsize (KiB) 4822176

[startup+3.10181 s]
/proc/loadavg: 7.26 8.25 8.33 9/416 1146
/proc/meminfo: memFree=12594568/32950928 swapFree=57376972/67111528
[pid=1117] ppid=1115 vsize=426600 CPUtime=0.72 cores=0-7
/proc/1117/stat : 1117 (python) S 1115 1117 1091 0 -1 4202496 15138 932 1 0 57 15 0 0 22 0 9 0 668815082 436838400 7413 33554432000 4194304 5683644 140734176724240 18446744073709551615 208092059083 0 0 16781312 2 18446744073709551615 0 0 17 1 0 0 0
/proc/1117/statm: 106650 7413 1889 364 0 42547 0
[pid=1123] ppid=1117 vsize=278452 CPUtime=0 cores=0-7
/proc/1123/stat : 1123 (python) S 1117 1117 1091 0 -1 4202560 739 0 0 0 0 0 0 0 18 0 1 0 668815158 285134848 5548 33554432000 4194304 5683644 140734176724240 18446744073709551615 208080252431 0 0 16781312 514 10339723789016727810 0 0 17 1 0 0 0
/proc/1123/statm: 69613 5548 354 364 0 5531 0
[pid=1125] ppid=1123 vsize=454896 CPUtime=2.33 cores=0-7
/proc/1125/stat : 1125 (TNM) R 1123 1125 1125 0 -1 4202496 413 0 0 0 233 0 0 0 25 0 1 0 668815158 465813504 150 33554432000 134512640 135008748 4286762272 18446744073709551615 134528628 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/1125/statm: 113724 150 46 122 0 112624 0
[pid=1126] ppid=1117 vsize=289284 CPUtime=0 cores=0-7
/proc/1126/stat : 1126 (python) S 1117 1117 1091 0 -1 4202560 756 0 0 0 0 0 0 0 15 0 1 0 668815161 296226816 5679 33554432000 4194304 5683644 140734176724240 18446744073709551615 208080252486 0 0 16781312 514 15589676307368083716 0 0 17 1 0 0 0
/proc/1126/statm: 72321 5679 348 364 0 8236 0
[pid=1128] ppid=1126 vsize=1948 CPUtime=2.3 cores=0-7
/proc/1128/stat : 1128 (march_hi) R 1126 1128 1128 0 -1 4202496 569 0 0 0 230 0 0 0 25 0 1 0 668815161 1994752 308 33554432000 4194304 4955518 140736106703968 18446744073709551615 4224608 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/1128/statm: 487 308 104 186 0 300 0
[pid=1129] ppid=1117 vsize=365076 CPUtime=0 cores=0-7
/proc/1129/stat : 1129 (python) S 1117 1117 1091 0 -1 4202560 718 0 0 0 0 0 0 0 15 0 1 0 668815164 373837824 5856 33554432000 4194304 5683644 140734176724240 18446744073709551615 208080252486 0 0 16781312 514 743626106438910215 0 0 17 5 0 0 0
/proc/1129/statm: 91269 5856 348 364 0 27181 0
[pid=1131] ppid=1129 vsize=1948 CPUtime=2.27 cores=0-7
/proc/1131/stat : 1131 (march_hi) R 1129 1131 1131 0 -1 4202496 561 0 0 0 227 0 0 0 25 0 1 0 668815164 1994752 309 33554432000 4194304 4955518 140737326969616 18446744073709551615 4209688 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/1131/statm: 487 309 104 186 0 300 0
[pid=1132] ppid=1117 vsize=375332 CPUtime=0 cores=0-7
/proc/1132/stat : 1132 (python) S 1117 1117 1091 0 -1 4202560 730 0 0 0 0 0 0 0 15 0 1 0 668815167 384339968 5817 33554432000 4194304 5683644 140734176724240 18446744073709551615 208080252486 0 0 16781312 514 18100767626039886081 0 0 17 7 0 0 0
/proc/1132/statm: 93833 5817 348 364 0 29742 0
[pid=1134] ppid=1132 vsize=1948 CPUtime=2.24 cores=0-7
/proc/1134/stat : 1134 (march_hi) R 1132 1134 1134 0 -1 4202496 565 0 0 0 224 0 0 0 25 0 1 0 668815167 1994752 309 33554432000 4194304 4955518 140734725207104 18446744073709551615 4209692 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/1134/statm: 487 309 104 186 0 300 0
[pid=1135] ppid=1117 vsize=385588 CPUtime=0 cores=0-7
/proc/1135/stat : 1135 (python) S 1117 1117 1091 0 -1 4202560 725 0 0 0 0 0 0 0 18 0 1 0 668815170 394842112 5822 33554432000 4194304 5683644 140734176724240 18446744073709551615 208080252486 0 0 16781312 514 2934380759672127747 0 0 17 1 0 0 0
/proc/1135/statm: 96397 5822 348 364 0 32303 0
[pid=1137] ppid=1135 vsize=1017800 CPUtime=2.21 cores=0-7
/proc/1137/stat : 1137 (gnovelty+2) R 1135 1137 1137 0 -1 4202496 423 0 0 0 221 0 0 0 25 0 1 0 668815170 1042227200 163 33554432000 134512640 135663704 4287950672 18446744073709551615 134524737 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/1137/statm: 254450 163 113 282 0 254166 0
[pid=1138] ppid=1117 vsize=395844 CPUtime=0 cores=0-7
/proc/1138/stat : 1138 (python) S 1117 1117 1091 0 -1 4202560 745 0 0 0 0 0 0 0 15 0 1 0 668815173 405344256 5946 33554432000 4194304 5683644 140734176724240 18446744073709551615 208080252486 0 0 16781312 514 5799532414673846531 0 0 17 7 0 0 0
/proc/1138/statm: 98961 5946 348 364 0 34864 0
[pid=1140] ppid=1138 vsize=1948 CPUtime=2.15 cores=0-7
/proc/1140/stat : 1140 (march_hi) R 1138 1140 1140 0 -1 4202496 567 0 0 0 215 0 0 0 25 0 1 0 668815173 1994752 308 33554432000 4194304 4955518 140737456647648 18446744073709551615 4286523 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/1140/statm: 487 308 104 186 0 300 0
[pid=1141] ppid=1117 vsize=406100 CPUtime=0 cores=0-7
/proc/1141/stat : 1141 (python) S 1117 1117 1091 0 -1 4202560 757 0 0 0 0 0 0 0 15 0 1 0 668815176 415846400 5846 33554432000 4194304 5683644 140734176724240 18446744073709551615 208080252486 0 0 16781312 514 11708875250342002946 0 0 17 2 0 0 0
/proc/1141/statm: 101525 5846 348 364 0 37425 0
[pid=1143] ppid=1141 vsize=1948 CPUtime=2.12 cores=0-7
/proc/1143/stat : 1143 (march_hi) R 1141 1143 1143 0 -1 4202496 568 0 0 0 212 0 0 0 25 0 1 0 668815177 1994752 308 33554432000 4194304 4955518 140733319715392 18446744073709551615 4209664 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/1143/statm: 487 308 104 186 0 300 0
[pid=1144] ppid=1117 vsize=416356 CPUtime=0 cores=0-7
/proc/1144/stat : 1144 (python) S 1117 1117 1091 0 -1 4202560 791 0 0 0 0 0 0 0 15 0 1 0 668815179 426348544 5874 33554432000 4194304 5683644 140734176724240 18446744073709551615 208080252486 0 0 16781312 514 232260840546337027 0 0 17 1 0 0 0
/proc/1144/statm: 104089 5874 354 364 0 39986 0
[pid=1146] ppid=1144 vsize=1948 CPUtime=2.11 cores=0-7
/proc/1146/stat : 1146 (march_hi) R 1144 1146 1146 0 -1 4202496 572 0 0 0 211 0 0 0 25 0 1 0 668815180 1994752 307 33554432000 4194304 4955518 140734895137696 18446744073709551615 4227659 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/1146/statm: 487 307 104 186 0 300 0
[pid=1117/tid=1124] ppid=1115 vsize=426600 CPUtime=0 cores=0-7
/proc/1117/task/1124/stat : 1124 (python) S 1115 1117 1091 0 -1 4202560 26 932 0 0 0 0 0 0 18 0 9 0 668815158 436838400 7413 33554432000 4194304 5683644 140734176724240 18446744073709551615 208092055985 0 0 16781312 2 18446604450493616256 0 0 -1 0 0 0 0
[pid=1117/tid=1127] ppid=1115 vsize=426600 CPUtime=0 cores=0-7
/proc/1117/task/1127/stat : 1127 (python) S 1115 1117 1091 0 -1 4202560 22 932 0 0 0 0 0 0 18 0 9 0 668815161 436838400 7413 33554432000 4194304 5683644 140734176724240 18446744073709551615 208092055985 0 0 16781312 2 18446604450493616256 0 0 -1 3 0 0 0
[pid=1117/tid=1130] ppid=1115 vsize=426600 CPUtime=0 cores=0-7
/proc/1117/task/1130/stat : 1130 (python) S 1115 1117 1091 0 -1 4202560 70 932 0 0 0 0 0 0 20 0 9 0 668815164 436838400 7413 33554432000 4194304 5683644 140734176724240 18446744073709551615 208092055985 0 0 16781312 2 18446604450493616256 0 0 -1 0 0 0 0
[pid=1117/tid=1133] ppid=1115 vsize=426600 CPUtime=0 cores=0-7
/proc/1117/task/1133/stat : 1133 (python) S 1115 1117 1091 0 -1 4202560 30 932 0 0 0 0 0 0 20 0 9 0 668815167 436838400 7413 33554432000 4194304 5683644 140734176724240 18446744073709551615 208092055985 0 0 16781312 2 18446604450493616256 0 0 -1 0 0 0 0
[pid=1117/tid=1136] ppid=1115 vsize=426600 CPUtime=0 cores=0-7

################
# More data... #
################

[pid=1144] ppid=1117 vsize=416356 CPUtime=0.32 cores=0-7
/proc/1144/stat : 1144 (python) R 1117 1117 1091 0 -1 4202560 880 0 0 0 26 6 0 0 16 0 1 0 668815179 426348544 5897 33554432000 4194304 5683644 140734176724240 18446744073709551615 208092062527 0 0 16781312 514 0 0 0 17 1 0 0 0
/proc/1144/statm: 104089 5897 377 364 0 39986 0
[pid=1146] ppid=1144 vsize=0 CPUtime=7.32 cores=0-7
/proc/1146/stat : 1146 (march_hi) R 1144 1146 1146 0 -1 4202500 638 0 0 0 732 0 0 0 25 0 1 0 668815180 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 1 0 0 0
/proc/1146/statm: 0 0 0 0 0 0 0
[pid=1117/tid=1124] ppid=1115 vsize=426600 CPUtime=0 cores=0-7
/proc/1117/task/1124/stat : 1124 (python) S 1115 1117 1091 0 -1 4202560 26 932 0 0 0 0 0 0 18 0 9 0 668815158 436838400 7413 33554432000 4194304 5683644 140734176724240 18446744073709551615 208092055985 0 0 16781312 2 18446604450493616256 0 0 -1 0 0 0 0
[pid=1117/tid=1127] ppid=1115 vsize=426600 CPUtime=0 cores=0-7
/proc/1117/task/1127/stat : 1127 (python) S 1115 1117 1091 0 -1 4202560 22 932 0 0 0 0 0 0 18 0 9 0 668815161 436838400 7413 33554432000 4194304 5683644 140734176724240 18446744073709551615 208092055985 0 0 16781312 2 18446604450493616256 0 0 -1 3 0 0 0
[pid=1117/tid=1130] ppid=1115 vsize=426600 CPUtime=0 cores=0-7
/proc/1117/task/1130/stat : 1130 (python) S 1115 1117 1091 0 -1 4202560 70 932 0 0 0 0 0 0 20 0 9 0 668815164 436838400 7413 33554432000 4194304 5683644 140734176724240 18446744073709551615 208092055985 0 0 16781312 2 18446604450493616256 0 0 -1 0 0 0 0
[pid=1117/tid=1133] ppid=1115 vsize=426600 CPUtime=0 cores=0-7
/proc/1117/task/1133/stat : 1133 (python) S 1115 1117 1091 0 -1 4202560 30 932 0 0 0 0 0 0 20 0 9 0 668815167 436838400 7413 33554432000 4194304 5683644 140734176724240 18446744073709551615 208092055985 0 0 16781312 2 18446604450493616256 0 0 -1 0 0 0 0
[pid=1117/tid=1136] ppid=1115 vsize=426600 CPUtime=0 cores=0-7
/proc/1117/task/1136/stat : 1136 (python) S 1115 1117 1091 0 -1 4202560 36 932 0 0 0 0 0 0 19 0 9 0 668815170 436838400 7413 33554432000 4194304 5683644 140734176724240 18446744073709551615 208092055985 0 0 16781312 2 18446604450493616256 0 0 -1 0 0 0 0
[pid=1117/tid=1139] ppid=1115 vsize=426600 CPUtime=0 cores=0-7
/proc/1117/task/1139/stat : 1139 (python) S 1115 1117 1091 0 -1 4202560 31 932 0 0 0 0 0 0 20 0 9 0 668815173 436838400 7413 33554432000 4194304 5683644 140734176724240 18446744073709551615 208092055985 0 0 16781312 2 18446604450493616256 0 0 -1 7 0 0 0
[pid=1117/tid=1142] ppid=1115 vsize=426600 CPUtime=0 cores=0-7
/proc/1117/task/1142/stat : 1142 (python) S 1115 1117 1091 0 -1 4202560 35 932 0 0 0 0 0 0 21 0 9 0 668815176 436838400 7413 33554432000 4194304 5683644 140734176724240 18446744073709551615 208092055985 0 0 16781312 2 18446604450493616256 0 0 -1 1 0 0 0
[pid=1117/tid=1145] ppid=1115 vsize=426600 CPUtime=0 cores=0-7
/proc/1117/task/1145/stat : 1145 (python) S 1115 1117 1091 0 -1 4202560 34 932 0 0 0 0 0 0 22 0 9 0 668815179 436838400 7413 33554432000 4194304 5683644 140734176724240 18446744073709551615 208092055985 0 0 16781312 2 18446604450493616256 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 63.13
Current children cumulated vsize (KiB) 4811328

[startup+9.10166 s]
/proc/loadavg: 7.93 8.36 8.36 15/416 1147
/proc/meminfo: memFree=12597376/32950928 swapFree=57376972/67111528
[pid=1117] ppid=1115 vsize=426600 CPUtime=0.72 cores=0-7
/proc/1117/stat : 1117 (python) S 1115 1117 1091 0 -1 4202496 15138 932 1 0 57 15 0 0 22 0 9 0 668815082 436838400 7413 33554432000 4194304 5683644 140734176724240 18446744073709551615 208092059083 0 0 16781312 2 18446744073709551615 0 0 17 1 0 0 0
/proc/1117/statm: 106650 7413 1889 364 0 42547 0
[pid=1123] ppid=1117 vsize=278452 CPUtime=0.01 cores=0-7
/proc/1123/stat : 1123 (python) S 1117 1117 1091 0 -1 4202560 906 0 0 0 0 1 0 0 18 0 1 0 668815158 285134848 5570 33554432000 4194304 5683644 140734176724240 18446744073709551615 208080252431 0 0 16781312 514 10339723789016727810 0 0 17 0 0 0 0
/proc/1123/statm: 69613 5570 376 364 0 5531 0
[pid=1125] ppid=1123 vsize=454896 CPUtime=8.33 cores=0-7
/proc/1125/stat : 1125 (TNM) R 1123 1125 1125 0 -1 4202496 413 0 0 0 833 0 0 0 25 0 1 0 668815158 465813504 150 33554432000 134512640 135008748 4286762272 18446744073709551615 134529136 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/1125/statm: 113724 150 46 122 0 112624 0
[pid=1126] ppid=1117 vsize=289284 CPUtime=0.98 cores=0-7
/proc/1126/stat : 1126 (python) R 1117 1117 1091 0 -1 4202560 923 0 0 0 84 14 0 0 16 0 1 0 668815161 296226816 5702 33554432000 4194304 5683644 140734176724240 18446744073709551615 208092062527 0 0 16781312 514 0 0 0 17 3 0 0 0
/proc/1126/statm: 72321 5702 371 364 0 8236 0
[pid=1128] ppid=1126 vsize=0 CPUtime=7.33 cores=0-7
/proc/1128/stat : 1128 (march_hi) R 1126 1128 1128 0 -1 4202500 634 0 0 0 733 0 0 0 25 0 1 0 668815161 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 3 0 0 0
/proc/1128/statm: 0 0 0 0 0 0 0
[pid=1129] ppid=1117 vsize=365076 CPUtime=0.93 cores=0-7
/proc/1129/stat : 1129 (python) R 1117 1117 1091 0 -1 4202560 812 0 0 0 81 12 0 0 16 0 1 0 668815164 373837824 5879 33554432000 4194304 5683644 140734176724240 18446744073709551615 208080252486 0 0 16781312 514 0 0 0 17 5 0 0 0
/proc/1129/statm: 91269 5879 371 364 0 27181 0
[pid=1131] ppid=1129 vsize=0 CPUtime=7.33 cores=0-7
/proc/1131/stat : 1131 (march_hi) R 1129 1131 1131 0 -1 4202500 626 0 0 0 733 0 0 0 25 0 1 0 668815164 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 5 0 0 0
/proc/1131/statm: 0 0 0 0 0 0 0
[pid=1132] ppid=1117 vsize=375332 CPUtime=0.87 cores=0-7
/proc/1132/stat : 1132 (python) R 1117 1117 1091 0 -1 4202560 811 0 0 0 76 11 0 0 16 0 1 0 668815167 384339968 5840 33554432000 4194304 5683644 140734176724240 18446744073709551615 208080252486 0 0 16781312 514 0 0 0 17 6 0 0 0
/proc/1132/statm: 93833 5840 371 364 0 29742 0
[pid=1134] ppid=1132 vsize=0 CPUtime=7.36 cores=0-7
/proc/1134/stat : 1134 (march_hi) R 1132 1134 1134 0 -1 4202500 630 0 0 0 736 0 0 0 25 0 1 0 668815167 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 6 0 0 0
/proc/1134/statm: 0 0 0 0 0 0 0
[pid=1135] ppid=1117 vsize=385588 CPUtime=0.01 cores=0-7
/proc/1135/stat : 1135 (python) S 1117 1117 1091 0 -1 4202560 806 0 0 0 1 0 0 0 18 0 1 0 668815170 394842112 5844 33554432000 4194304 5683644 140734176724240 18446744073709551615 208080252486 0 0 16781312 514 2934380759672127747 0 0 17 4 0 0 0
/proc/1135/statm: 96397 5844 370 364 0 32303 0
[pid=1137] ppid=1135 vsize=1017800 CPUtime=8.21 cores=0-7
/proc/1137/stat : 1137 (gnovelty+2) R 1135 1137 1137 0 -1 4202496 423 0 0 0 821 0 0 0 25 0 1 0 668815170 1042227200 163 33554432000 134512640 135663704 4287950672 18446744073709551615 134545644 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/1137/statm: 254450 163 113 282 0 254166 0
[pid=1138] ppid=1117 vsize=395844 CPUtime=0.61 cores=0-7
/proc/1138/stat : 1138 (python) R 1117 1117 1091 0 -1 4202560 822 0 0 0 53 8 0 0 16 0 1 0 668815173 405344256 5969 33554432000 4194304 5683644 140734176724240 18446744073709551615 4870088 0 0 16781312 514 0 0 0 17 7 0 0 0
/proc/1138/statm: 98961 5969 371 364 0 34864 0
[pid=1140] ppid=1138 vsize=0 CPUtime=7.44 cores=0-7
/proc/1140/stat : 1140 (march_hi) R 1138 1140 1140 0 -1 4202500 633 0 0 0 744 0 0 0 25 0 1 0 668815173 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 6 0 0 0
/proc/1140/statm: 0 0 0 0 0 0 0
[pid=1141] ppid=1117 vsize=406100 CPUtime=0.76 cores=0-7
/proc/1141/stat : 1141 (python) R 1117 1117 1091 0 -1 4202560 846 0 0 0 65 11 0 0 16 0 1 0 668815176 415846400 5870 33554432000 4194304 5683644 140734176724240 18446744073709551615 208092062527 0 0 16781312 514 0 0 0 17 2 0 0 0
/proc/1141/statm: 101525 5870 372 364 0 37425 0
[pid=1143] ppid=1141 vsize=0 CPUtime=7.34 cores=0-7
/proc/1143/stat : 1143 (march_hi) R 1141 1143 1143 0 -1 4202500 634 0 0 0 734 0 0 0 25 0 1 0 668815177 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 2 0 0 0
/proc/1143/statm: 0 0 0 0 0 0 0
[pid=1144] ppid=1117 vsize=416356 CPUtime=0.72 cores=0-7
/proc/1144/stat : 1144 (python) R 1117 1117 1091 0 -1 4202560 880 0 0 0 60 12 0 0 16 0 1 0 668815179 426348544 5897 33554432000 4194304 5683644 140734176724240 18446744073709551615 208080252486 0 0 16781312 514 0 0 0 17 1 0 0 0
/proc/1144/statm: 104089 5897 377 364 0 39986 0
[pid=1146] ppid=1144 vsize=0 CPUtime=7.32 cores=0-7
/proc/1146/stat : 1146 (march_hi) R 1144 1146 1146 0 -1 4202500 638 0 0 0 732 0 0 0 25 0 1 0 668815180 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 1 0 0 0
/proc/1146/statm: 0 0 0 0 0 0 0
[pid=1117/tid=1124] ppid=1115 vsize=426600 CPUtime=0 cores=0-7
/proc/1117/task/1124/stat : 1124 (python) S 1115 1117 1091 0 -1 4202560 26 932 0 0 0 0 0 0 18 0 9 0 668815158 436838400 7413 33554432000 4194304 5683644 140734176724240 18446744073709551615 208092055985 0 0 16781312 2 18446604450493616256 0 0 -1 0 0 0 0
[pid=1117/tid=1127] ppid=1115 vsize=426600 CPUtime=0 cores=0-7
/proc/1117/task/1127/stat : 1127 (python) S 1115 1117 1091 0 -1 4202560 22 932 0 0 0 0 0 0 18 0 9 0 668815161 436838400 7413 33554432000 4194304 5683644 140734176724240 18446744073709551615 208092055985 0 0 16781312 2 18446604450493616256 0 0 -1 3 0 0 0
[pid=1117/tid=1130] ppid=1115 vsize=426600 CPUtime=0 cores=0-7
/proc/1117/task/1130/stat : 1130 (python) S 1115 1117 1091 0 -1 4202560 70 932 0 0 0 0 0 0 20 0 9 0 668815164 436838400 7413 33554432000 4194304 5683644 140734176724240 18446744073709551615 208092055985 0 0 16781312 2 18446604450493616256 0 0 -1 0 0 0 0
[pid=1117/tid=1133] ppid=1115 vsize=426600 CPUtime=0 cores=0-7
/proc/1117/task/1133/stat : 1133 (python) S 1115 1117 1091 0 -1 4202560 30 932 0 0 0 0 0 0 20 0 9 0 668815167 436838400 7413 33554432000 4194304 5683644 140734176724240 18446744073709551615 208092055985 0 0 16781312 2 18446604450493616256 0 0 -1 0 0 0 0
[pid=1117/tid=1136] ppid=1115 vsize=426600 CPUtime=0 cores=0-7
/proc/1117/task/1136/stat : 1136 (python) S 1115 1117 1091 0 -1 4202560 36 932 0 0 0 0 0 0 19 0 9 0 668815170 436838400 7413 33554432000 4194304 5683644 140734176724240 18446744073709551615 208092055985 0 0 16781312 2 18446604450493616256 0 0 -1 0 0 0 0
[pid=1117/tid=1139] ppid=1115 vsize=426600 CPUtime=0 cores=0-7
/proc/1117/task/1139/stat : 1139 (python) S 1115 1117 1091 0 -1 4202560 31 932 0 0 0 0 0 0 20 0 9 0 668815173 436838400 7413 33554432000 4194304 5683644 140734176724240 18446744073709551615 208092055985 0 0 16781312 2 18446604450493616256 0 0 -1 7 0 0 0
[pid=1117/tid=1142] ppid=1115 vsize=426600 CPUtime=0 cores=0-7
/proc/1117/task/1142/stat : 1142 (python) S 1115 1117 1091 0 -1 4202560 35 932 0 0 0 0 0 0 21 0 9 0 668815176 436838400 7413 33554432000 4194304 5683644 140734176724240 18446744073709551615 208092055985 0 0 16781312 2 18446604450493616256 0 0 -1 1 0 0 0
[pid=1117/tid=1145] ppid=1115 vsize=426600 CPUtime=0 cores=0-7
/proc/1117/task/1145/stat : 1145 (python) S 1115 1117 1091 0 -1 4202560 34 932 0 0 0 0 0 0 22 0 9 0 668815179 436838400 7413 33554432000 4194304 5683644 140734176724240 18446744073709551615 208092055985 0 0 16781312 2 18446604450493616256 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 66.27
Current children cumulated vsize (KiB) 4811328

[startup+9.20165 s]
/proc/loadavg: 7.93 8.36 8.36 15/416 1147
/proc/meminfo: memFree=12597376/32950928 swapFree=57376972/67111528
[pid=1117] ppid=1115 vsize=426600 CPUtime=0.72 cores=0-7
/proc/1117/stat : 1117 (python) S 1115 1117 1091 0 -1 4202496 15138 932 1 0 57 15 0 0 22 0 9 0 668815082 436838400 7413 33554432000 4194304 5683644 140734176724240 18446744073709551615 208092059083 0 0 16781312 2 18446744073709551615 0 0 17 1 0 0 0
/proc/1117/statm: 106650 7413 1889 364 0 42547 0
[pid=1123] ppid=1117 vsize=278452 CPUtime=0.01 cores=0-7
/proc/1123/stat : 1123 (python) S 1117 1117 1091 0 -1 4202560 906 0 0 0 0 1 0 0 18 0 1 0 668815158 285134848 5570 33554432000 4194304 5683644 140734176724240 18446744073709551615 208080252431 0 0 16781312 514 10339723789016727810 0 0 17 0 0 0 0
/proc/1123/statm: 69613 5570 376 364 0 5531 0
[pid=1125] ppid=1123 vsize=454896 CPUtime=8.43 cores=0-7
/proc/1125/stat : 1125 (TNM) R 1123 1125 1125 0 -1 4202496 413 0 0 0 843 0 0 0 25 0 1 0 668815158 465813504 150 33554432000 134512640 135008748 4286762272 18446744073709551615 134536565 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/1125/statm: 113724 150 46 122 0 112624 0
[pid=1126] ppid=1117 vsize=289284 CPUtime=1.09 cores=0-7
/proc/1126/stat : 1126 (python) R 1117 1117 1091 0 -1 4202560 923 0 0 0 93 16 0 0 16 0 1 0 668815161 296226816 5702 33554432000 4194304 5683644 140734176724240 18446744073709551615 208092062527 0 0 16781312 514 0 0 0 17 3 0 0 0
/proc/1126/statm: 72321 5702 371 364 0 8236 0
[pid=1128] ppid=1126 vsize=0 CPUtime=7.33 cores=0-7
/proc/1128/stat : 1128 (march_hi) R 1126 1128 1128 0 -1 4202500 634 0 0 0 733 0 0 0 25 0 1 0 668815161 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 3 0 0 0
/proc/1128/statm: 0 0 0 0 0 0 0
[pid=1129] ppid=1117 vsize=365076 CPUtime=1.03 cores=0-7
/proc/1129/stat : 1129 (python) R 1117 1117 1091 0 -1 4202560 812 0 0 0 89 14 0 0 16 0 1 0 668815164 373837824 5879 33554432000 4194304 5683644 140734176724240 18446744073709551615 208092062527 0 0 16781312 514 0 0 0 17 5 0 0 0
/proc/1129/statm: 91269 5879 371 364 0 27181 0
[pid=1131] ppid=1129 vsize=0 CPUtime=7.33 cores=0-7
/proc/1131/stat : 1131 (march_hi) R 1129 1131 1131 0 -1 4202500 626 0 0 0 733 0 0 0 25 0 1 0 668815164 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 5 0 0 0
/proc/1131/statm: 0 0 0 0 0 0 0
[pid=1132] ppid=1117 vsize=375332 CPUtime=0.97 cores=0-7
/proc/1132/stat : 1132 (python) R 1117 1117 1091 0 -1 4202560 811 0 0 0 85 12 0 0 16 0 1 0 668815167 384339968 5840 33554432000 4194304 5683644 140734176724240 18446744073709551615 208092062527 0 0 16781312 514 0 0 0 17 6 0 0 0
/proc/1132/statm: 93833 5840 371 364 0 29742 0
[pid=1134] ppid=1132 vsize=0 CPUtime=7.36 cores=0-7
/proc/1134/stat : 1134 (march_hi) R 1132 1134 1134 0 -1 4202500 630 0 0 0 736 0 0 0 25 0 1 0 668815167 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 6 0 0 0
/proc/1134/statm: 0 0 0 0 0 0 0
[pid=1135] ppid=1117 vsize=385588 CPUtime=0.01 cores=0-7
/proc/1135/stat : 1135 (python) S 1117 1117 1091 0 -1 4202560 806 0 0 0 1 0 0 0 18 0 1 0 668815170 394842112 5844 33554432000 4194304 5683644 140734176724240 18446744073709551615 208080252486 0 0 16781312 514 2934380759672127747 0 0 17 4 0 0 0
/proc/1135/statm: 96397 5844 370 364 0 32303 0
[pid=1137] ppid=1135 vsize=1017800 CPUtime=8.31 cores=0-7
/proc/1137/stat : 1137 (gnovelty+2) R 1135 1137 1137 0 -1 4202496 423 0 0 0 831 0 0 0 25 0 1 0 668815170 1042227200 163 33554432000 134512640 135663704 4287950672 18446744073709551615 134525278 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/1137/statm: 254450 163 113 282 0 254166 0
[pid=1138] ppid=1117 vsize=395844 CPUtime=0.71 cores=0-7
/proc/1138/stat : 1138 (python) R 1117 1117 1091 0 -1 4202560 822 0 0 0 61 10 0 0 16 0 1 0 668815173 405344256 5969 33554432000 4194304 5683644 140734176724240 18446744073709551615 18446744073699065904 0 0 16781312 514 0 0 0 17 7 0 0 0
/proc/1138/statm: 98961 5969 371 364 0 34864 0
[pid=1140] ppid=1138 vsize=0 CPUtime=7.44 cores=0-7
/proc/1140/stat : 1140 (march_hi) R 1138 1140 1140 0 -1 4202500 633 0 0 0 744 0 0 0 25 0 1 0 668815173 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 0 0 0 0
/proc/1140/statm: 0 0 0 0 0 0 0
[pid=1141] ppid=1117 vsize=406100 CPUtime=0.85 cores=0-7
/proc/1141/stat : 1141 (python) R 1117 1117 1091 0 -1 4202560 846 0 0 0 73 12 0 0 16 0 1 0 668815176 415846400 5870 33554432000 4194304 5683644 140734176724240 18446744073709551615 208092062527 0 0 16781312 514 0 0 0 17 2 0 0 0
/proc/1141/statm: 101525 5870 372 364 0 37425 0
[pid=1143] ppid=1141 vsize=0 CPUtime=7.34 cores=0-7
/proc/1143/stat : 1143 (march_hi) R 1141 1143 1143 0 -1 4202500 634 0 0 0 734 0 0 0 25 0 1 0 668815177 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 2 0 0 0
/proc/1143/statm: 0 0 0 0 0 0 0
[pid=1144] ppid=1117 vsize=416356 CPUtime=0.82 cores=0-7
/proc/1144/stat : 1144 (python) R 1117 1117 1091 0 -1 4202560 880 0 0 0 69 13 0 0 16 0 1 0 668815179 426348544 5897 33554432000 4194304 5683644 140734176724240 18446744073709551615 208080252486 0 0 16781312 514 0 0 0 17 1 0 0 0
/proc/1144/statm: 104089 5897 377 364 0 39986 0
[pid=1146] ppid=1144 vsize=0 CPUtime=7.32 cores=0-7
/proc/1146/stat : 1146 (march_hi) R 1144 1146 1146 0 -1 4202500 638 0 0 0 732 0 0 0 25 0 1 0 668815180 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 1 0 0 0
/proc/1146/statm: 0 0 0 0 0 0 0
[pid=1117/tid=1124] ppid=1115 vsize=426600 CPUtime=0 cores=0-7
/proc/1117/task/1124/stat : 1124 (python) S 1115 1117 1091 0 -1 4202560 26 932 0 0 0 0 0 0 18 0 9 0 668815158 436838400 7413 33554432000 4194304 5683644 140734176724240 18446744073709551615 208092055985 0 0 16781312 2 18446604450493616256 0 0 -1 0 0 0 0
[pid=1117/tid=1127] ppid=1115 vsize=426600 CPUtime=0 cores=0-7
/proc/1117/task/1127/stat : 1127 (python) S 1115 1117 1091 0 -1 4202560 22 932 0 0 0 0 0 0 18 0 9 0 668815161 436838400 7413 33554432000 4194304 5683644 140734176724240 18446744073709551615 208092055985 0 0 16781312 2 18446604450493616256 0 0 -1 3 0 0 0
[pid=1117/tid=1130] ppid=1115 vsize=426600 CPUtime=0 cores=0-7
/proc/1117/task/1130/stat : 1130 (python) S 1115 1117 1091 0 -1 4202560 70 932 0 0 0 0 0 0 20 0 9 0 668815164 436838400 7413 33554432000 4194304 5683644 140734176724240 18446744073709551615 208092055985 0 0 16781312 2 18446604450493616256 0 0 -1 0 0 0 0
[pid=1117/tid=1133] ppid=1115 vsize=426600 CPUtime=0 cores=0-7
/proc/1117/task/1133/stat : 1133 (python) S 1115 1117 1091 0 -1 4202560 30 932 0 0 0 0 0 0 20 0 9 0 668815167 436838400 7413 33554432000 4194304 5683644 140734176724240 18446744073709551615 208092055985 0 0 16781312 2 18446604450493616256 0 0 -1 0 0 0 0
[pid=1117/tid=1136] ppid=1115 vsize=426600 CPUtime=0 cores=0-7
/proc/1117/task/1136/stat : 1136 (python) S 1115 1117 1091 0 -1 4202560 36 932 0 0 0 0 0 0 19 0 9 0 668815170 436838400 7413 33554432000 4194304 5683644 140734176724240 18446744073709551615 208092055985 0 0 16781312 2 18446604450493616256 0 0 -1 0 0 0 0
[pid=1117/tid=1139] ppid=1115 vsize=426600 CPUtime=0 cores=0-7
/proc/1117/task/1139/stat : 1139 (python) S 1115 1117 1091 0 -1 4202560 31 932 0 0 0 0 0 0 20 0 9 0 668815173 436838400 7413 33554432000 4194304 5683644 140734176724240 18446744073709551615 208092055985 0 0 16781312 2 18446604450493616256 0 0 -1 7 0 0 0
[pid=1117/tid=1142] ppid=1115 vsize=426600 CPUtime=0 cores=0-7
/proc/1117/task/1142/stat : 1142 (python) S 1115 1117 1091 0 -1 4202560 35 932 0 0 0 0 0 0 21 0 9 0 668815176 436838400 7413 33554432000 4194304 5683644 140734176724240 18446744073709551615 208092055985 0 0 16781312 2 18446604450493616256 0 0 -1 1 0 0 0
[pid=1117/tid=1145] ppid=1115 vsize=426600 CPUtime=0 cores=0-7
/proc/1117/task/1145/stat : 1145 (python) S 1115 1117 1091 0 -1 4202560 34 932 0 0 0 0 0 0 22 0 9 0 668815179 436838400 7413 33554432000 4194304 5683644 140734176724240 18446744073709551615 208092055985 0 0 16781312 2 18446604450493616256 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 67.07
Current children cumulated vsize (KiB) 4811328

Child status: 0
Real time (s): 9.24017
CPU time (s): 67.3608
CPU user time (s): 66.3239
CPU system time (s): 1.03684
CPU usage (%): 728.999
Max. virtual memory (cumulated for all children) (KiB): 4824740

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 66.3239
system time used= 1.03684
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 32968
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 6064
involuntary context switches= 3133

runsolver used 0.041993 second user time and 0.089986 second system time

The end

Launcher Data 

Begin job on node127 at 2011-05-16 20:55:54
IDJOB=3385676
IDBENCH=82941
IDSOLVER=1870
FILE ID=node127/3385676-1305572154
RUNJOBID= node127-1305572154-1105
PBS_JOBID= 13350154
Free space on /tmp= 73384 MiB

SOLVER NAME= borg-sat 11.03.02-par-random (fixed)
BENCH NAME= SAT11/random/medium/unif-k3-r4.26-v350-c1491-S1733949620-064.UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3385676-1305572154/watcher-3385676-1305572154 -o /tmp/evaluation-result-3385676-1305572154/solver-3385676-1305572154 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3385676-1305572154.cnf -seed 970951003 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 60552051d2d5a0c0eefaeedea18e63df
RANDOM SEED=970951003

node127.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.64
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.86
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.60
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      12650856 kB
Buffers:         73416 kB
Cached:         451796 kB
SwapCached:     117872 kB
Active:        5578724 kB
Inactive:     14495992 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      12650856 kB
SwapTotal:    67111528 kB
SwapFree:     57376972 kB
Dirty:           31968 kB
Writeback:           0 kB
AnonPages:    19438992 kB
Mapped:          25664 kB
Slab:            73248 kB
PageTables:      80884 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 84608796 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73352 MiB
End job on node127 at 2011-05-16 20:56:03