Trace number 3321926

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-randomUNSAT 174.864 23.4467

General information on the benchmark

Namerandom/medium/
unif-k3-r4.26-v400-c1704-S785747282-100.UNKNOWN.cnf
MD5SUMb444591b86255859f3a5d3b876e65166
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark22.3846
Satisfiable
(Un)Satisfiability was proved
Number of variables400
Number of clauses1704
Sum of the clauses size5112
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 31704
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.36/0.68	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.36/0.68	c INFO: solving HOME/instance-3321926-1304369616.cnf
0.36/0.68	c INFO: computing task features
0.36/0.69	c INFO: computed variable-clause graph statistics
0.36/0.69	c INFO: computed clause balance statistics
0.43/0.72	c INFO: computed variable balance statistics
0.43/0.74	c INFO: computed small-clause counts
0.43/0.74	c INFO: computed Horn-clause counts
0.43/0.74	c INFO: computed variable graph statistics
0.43/0.74	c INFO: collected features for HOME/instance-3321926-1304369616.cnf in 0.06 s
0.43/0.78	c INFO: running gnovelty+2@0 for 97 with 39999 remaining (b = 0.56)
0.54/0.82	c INFO: running march_hi@0 for 388 with 39999 remaining (b = 0.39)
0.54/0.86	c INFO: running march_hi@0 for 485 with 39999 remaining (b = 0.39)
0.54/0.90	c INFO: running march_hi@0 for 485 with 39999 remaining (b = 0.35)
0.63/0.93	c INFO: running march_hi@0 for 97 with 39999 remaining (b = 0.11)
0.63/0.97	c INFO: running TNM@0 for 97 with 39999 remaining (b = 0.07)
1.45/1.01	c INFO: running march_hi@0 for 485 with 39999 remaining (b = 0.24)
1.45/1.05	c INFO: running march_hi@0 for 485 with 39999 remaining (b = 0.21)
174.53/23.42	s UNSATISFIABLE

Verifier Data 

No possible verification on an UNSAT instance

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3321926-1304369616/watcher-3321926-1304369616 -o /tmp/evaluation-result-3321926-1304369616/solver-3321926-1304369616 -C 40000 -W 5100 -M 31000 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3321926-1304369616.cnf -seed 1719099220 -budget 40000 -cores 8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.87 8.50 8.22 2/257 18150
/proc/meminfo: memFree=23186376/32951132 swapFree=67111356/67111528
[pid=18150] ppid=18148 vsize=15388 CPUtime=0 cores=0-7
/proc/18150/stat : 18150 (python) R 18148 18150 17621 0 -1 4202496 813 0 0 0 0 0 0 0 20 0 1 0 548561303 15757312 698 33554432000 4194304 5683644 140737342934144 18446744073709551615 4540219 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/18150/statm: 3847 698 334 364 0 334 0

[startup+0.0878011 s]
/proc/loadavg: 7.87 8.50 8.22 2/257 18150
/proc/meminfo: memFree=23186376/32951132 swapFree=67111356/67111528
[pid=18150] ppid=18148 vsize=54540 CPUtime=0.05 cores=0-7
/proc/18150/stat : 18150 (python) R 18148 18150 17621 0 -1 4202496 2057 0 0 0 4 1 0 0 20 0 1 0 548561303 55848960 1814 33554432000 4194304 5683644 140737342934144 18446744073709551615 4540219 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/18150/statm: 13635 1814 492 364 0 1285 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 54540

[startup+0.10078 s]
/proc/loadavg: 7.87 8.50 8.22 2/257 18150
/proc/meminfo: memFree=23186376/32951132 swapFree=67111356/67111528
[pid=18150] ppid=18148 vsize=85624 CPUtime=0.06 cores=0-7
/proc/18150/stat : 18150 (python) S 18148 18150 17621 0 -1 4202496 2631 0 0 0 4 2 0 0 18 0 1 0 548561303 87678976 2348 33554432000 4194304 5683644 140737342934144 18446744073709551615 274664806400 0 2147483391 16781312 2 18446744071699109054 0 0 17 6 0 0 0
/proc/18150/statm: 21406 2348 713 364 0 1623 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 85624

[startup+0.300793 s]
/proc/loadavg: 7.87 8.50 8.22 2/257 18150
/proc/meminfo: memFree=23186376/32951132 swapFree=67111356/67111528
[pid=18150] ppid=18148 vsize=135752 CPUtime=0.19 cores=0-7
/proc/18150/stat : 18150 (python) R 18148 18150 17621 0 -1 4202496 5961 933 1 0 14 5 0 0 17 0 1 0 548561303 139010048 4151 33554432000 4194304 5683644 140737342934144 18446744073709551615 4886552 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/18150/statm: 33938 4151 1032 364 0 3124 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 135752

[startup+0.700674 s]
/proc/loadavg: 7.87 8.50 8.22 2/257 18150
/proc/meminfo: memFree=23186376/32951132 swapFree=67111356/67111528
[pid=18150] ppid=18148 vsize=278276 CPUtime=0.43 cores=0-7
/proc/18150/stat : 18150 (python) R 18148 18150 17621 0 -1 4202496 9295 933 1 0 31 12 0 0 16 0 1 0 548561303 284954624 6967 33554432000 4194304 5683644 140737342934144 18446744073709551615 4623600 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/18150/statm: 69569 6967 1826 364 0 5493 0
Current children cumulated CPU time (s) 0.43
Current children cumulated vsize (KiB) 278276

[startup+1.5015 s]
/proc/loadavg: 7.87 8.50 8.22 8/276 18173
/proc/meminfo: memFree=23136624/32951132 swapFree=67111356/67111528
[pid=18150] ppid=18148 vsize=426800 CPUtime=0.79 cores=0-7
/proc/18150/stat : 18150 (python) S 18148 18150 17621 0 -1 4202496 15910 933 1 0 65 14 0 0 21 0 9 0 548561303 437043200 7282 33554432000 4194304 5683644 140737342934144 18446744073709551615 274676635083 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/18150/statm: 106700 7282 1889 364 0 42597 0
[pid=18156] ppid=18150 vsize=278656 CPUtime=0 cores=0-7
/proc/18156/stat : 18156 (python) S 18150 18150 17621 0 -1 4202560 740 0 0 0 0 0 0 0 18 0 1 0 548561382 285343744 5577 33554432000 4194304 5683644 140737342934144 18446744073709551615 274664828431 0 0 16781312 514 12487280279662100479 0 0 17 7 0 0 0
/proc/18156/statm: 69664 5577 354 364 0 5582 0
[pid=18158] ppid=18156 vsize=1017800 CPUtime=0.71 cores=0-7
/proc/18158/stat : 18158 (gnovelty+2) R 18156 18158 18158 0 -1 4202496 434 0 0 0 71 0 0 0 21 0 1 0 548561382 1042227200 169 33554432000 134512640 135663704 4289279360 18446744073709551615 134524518 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/18158/statm: 254450 169 113 282 0 254166 0
[pid=18159] ppid=18150 vsize=289312 CPUtime=0 cores=0-7
/proc/18159/stat : 18159 (python) S 18150 18150 17621 0 -1 4202560 744 0 0 0 0 0 0 0 15 0 1 0 548561385 296255488 5685 33554432000 4194304 5683644 140737342934144 18446744073709551615 274664828486 0 0 16781312 514 10288416178418188545 0 0 17 6 0 0 0
/proc/18159/statm: 72328 5685 348 364 0 8243 0
[pid=18161] ppid=18159 vsize=1928 CPUtime=0.67 cores=0-7
/proc/18161/stat : 18161 (march_hi) R 18159 18161 18161 0 -1 4202496 570 0 0 0 67 0 0 0 21 0 1 0 548561386 1974272 306 33554432000 4194304 4955518 140737051817472 18446744073709551615 4227667 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/18161/statm: 482 306 104 186 0 295 0
[pid=18162] ppid=18150 vsize=299388 CPUtime=0 cores=0-7
/proc/18162/stat : 18162 (python) S 18150 18150 17621 0 -1 4202560 760 0 0 0 0 0 0 0 15 0 1 0 548561390 306573312 5627 33554432000 4194304 5683644 140737342934144 18446744073709551615 274664828486 0 0 16781312 514 4311484163967385859 0 0 17 0 0 0 0
/proc/18162/statm: 74847 5627 348 364 0 10759 0
[pid=18164] ppid=18162 vsize=1928 CPUtime=0.63 cores=0-7
/proc/18164/stat : 18164 (march_hi) R 18162 18164 18164 0 -1 4202496 572 0 0 0 63 0 0 0 25 0 1 0 548561390 1974272 306 33554432000 4194304 4955518 140736752777088 18446744073709551615 4261527 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/18164/statm: 482 306 104 186 0 295 0
[pid=18165] ppid=18150 vsize=309996 CPUtime=0 cores=0-7
/proc/18165/stat : 18165 (python) S 18150 18150 17621 0 -1 4202560 770 0 0 0 0 0 0 0 15 0 1 0 548561393 317435904 5719 33554432000 4194304 5683644 140737342934144 18446744073709551615 274664828486 0 0 16781312 514 4841928155625128193 0 0 17 0 0 0 0
/proc/18165/statm: 77499 5719 348 364 0 13408 0
[pid=18167] ppid=18165 vsize=1928 CPUtime=0.59 cores=0-7
/proc/18167/stat : 18167 (march_hi) R 18165 18167 18167 0 -1 4202496 570 0 0 0 59 0 0 0 22 0 1 0 548561394 1974272 306 33554432000 4194304 4955518 140735348557536 18446744073709551615 4209624 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/18167/statm: 482 306 104 186 0 295 0
[pid=18168] ppid=18150 vsize=320252 CPUtime=0 cores=0-7
/proc/18168/stat : 18168 (python) S 18150 18150 17621 0 -1 4202560 765 0 0 0 0 0 0 0 15 0 1 0 548561397 327938048 5723 33554432000 4194304 5683644 140737342934144 18446744073709551615 274664828486 0 0 16781312 514 8320703781071192322 0 0 17 1 0 0 0
/proc/18168/statm: 80063 5723 348 364 0 15969 0
[pid=18170] ppid=18168 vsize=1928 CPUtime=0.55 cores=0-7
/proc/18170/stat : 18170 (march_hi) R 18168 18170 18170 0 -1 4202496 571 0 0 0 55 0 0 0 22 0 1 0 548561398 1974272 306 33554432000 4194304 4955518 140736681956720 18446744073709551615 4227640 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/18170/statm: 482 306 104 186 0 295 0
[pid=18171] ppid=18150 vsize=330508 CPUtime=0 cores=0-7
/proc/18171/stat : 18171 (python) S 18150 18150 17621 0 -1 4202560 744 0 0 0 0 0 0 0 20 0 1 0 548561401 338440192 5723 33554432000 4194304 5683644 140737342934144 18446744073709551615 274664828486 0 0 16781312 514 13935325273693093887 0 0 17 1 0 0 0
/proc/18171/statm: 82627 5723 344 364 0 18530 0
[pid=18173] ppid=18171 vsize=454912 CPUtime=0.51 cores=0-7
/proc/18173/stat : 18173 (TNM) R 18171 18173 18173 0 -1 4202496 425 0 0 0 51 0 0 0 23 0 1 0 548561401 465829888 160 33554432000 134512640 135008748 4289124944 18446744073709551615 134529636 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/18173/statm: 113728 160 46 122 0 112628 0
[pid=18150/tid=18157] ppid=18148 vsize=426800 CPUtime=0 cores=0-7
/proc/18150/task/18157/stat : 18157 (python) S 18148 18150 17621 0 -1 4202560 26 933 0 0 0 0 0 0 17 0 9 0 548561382 437043200 7282 33554432000 4194304 5683644 140737342934144 18446744073709551615 274676631985 0 0 16781312 2 18446604453848674688 0 0 -1 7 0 0 0
[pid=18150/tid=18160] ppid=18148 vsize=426800 CPUtime=0 cores=0-7
/proc/18150/task/18160/stat : 18160 (python) S 18148 18150 17621 0 -1 4202560 24 933 0 0 0 0 0 0 19 0 9 0 548561386 437043200 7282 33554432000 4194304 5683644 140737342934144 18446744073709551615 274676631985 0 0 16781312 2 18446604453848674688 0 0 -1 6 0 0 0
[pid=18150/tid=18163] ppid=18148 vsize=426800 CPUtime=0 cores=0-7
/proc/18150/task/18163/stat : 18163 (python) S 18148 18150 17621 0 -1 4202560 25 933 0 0 0 0 0 0 21 0 9 0 548561390 437043200 7282 33554432000 4194304 5683644 140737342934144 18446744073709551615 274676631985 0 0 16781312 2 18446604453848674688 0 0 -1 0 0 0 0
[pid=18150/tid=18166] ppid=18148 vsize=426800 CPUtime=0 cores=0-7
/proc/18150/task/18166/stat : 18166 (python) S 18148 18150 17621 0 -1 4202560 22 933 0 0 0 0 0 0 20 0 9 0 548561394 437043200 7282 33554432000 4194304 5683644 140737342934144 18446744073709551615 274676631985 0 0 16781312 2 18446604453848674688 0 0 -1 0 0 0 0
[pid=18150/tid=18169] ppid=18148 vsize=426800 CPUtime=0 cores=0-7
/proc/18150/task/18169/stat : 18169 (python) S 18148 18150 17621 0 -1 4202560 26 933 0 0 0 0 0 0 19 0 9 0 548561397 437043200 7282 33554432000 4194304 5683644 140737342934144 18446744073709551615 274676631985 0 0 16781312 2 18446604453848674688 0 0 -1 0 0 0 0
[pid=18150/tid=18172] ppid=18148 vsize=426800 CPUtime=0 cores=0-7
/proc/18150/task/18172/stat : 18172 (python) S 18148 18150 17621 0 -1 4202560 21 933 0 0 0 0 0 0 18 0 9 0 548561401 437043200 7282 33554432000 4194304 5683644 140737342934144 18446744073709551615 274676631985 0 0 16781312 2 18446604453848674688 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4.45
Current children cumulated vsize (KiB) 3735336

[startup+3.10122 s]
/proc/loadavg: 7.87 8.50 8.22 9/282 18179
/proc/meminfo: memFree=23126284/32951132 swapFree=67111356/67111528
[pid=18150] ppid=18148 vsize=426800 CPUtime=0.79 cores=0-7
/proc/18150/stat : 18150 (python) S 18148 18150 17621 0 -1 4202496 15910 933 1 0 65 14 0 0 21 0 9 0 548561303 437043200 7282 33554432000 4194304 5683644 140737342934144 18446744073709551615 274676635083 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/18150/statm: 106700 7282 1889 364 0 42597 0
[pid=18156] ppid=18150 vsize=278656 CPUtime=0 cores=0-7
/proc/18156/stat : 18156 (python) S 18150 18150 17621 0 -1 4202560 740 0 0 0 0 0 0 0 18 0 1 0 548561382 285343744 5577 33554432000 4194304 5683644 140737342934144 18446744073709551615 274664828431 0 0 16781312 514 12487280279662067971 0 0 17 7 0 0 0
/proc/18156/statm: 69664 5577 354 364 0 5582 0
[pid=18158] ppid=18156 vsize=1017800 CPUtime=2.31 cores=0-7
/proc/18158/stat : 18158 (gnovelty+2) R 18156 18158 18158 0 -1 4202496 434 0 0 0 231 0 0 0 25 0 1 0 548561382 1042227200 169 33554432000 134512640 135663704 4289279360 18446744073709551615 134545767 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/18158/statm: 254450 169 113 282 0 254166 0
[pid=18159] ppid=18150 vsize=289312 CPUtime=0 cores=0-7
/proc/18159/stat : 18159 (python) S 18150 18150 17621 0 -1 4202560 747 0 0 0 0 0 0 0 15 0 1 0 548561385 296255488 5685 33554432000 4194304 5683644 140737342934144 18446744073709551615 274664828486 0 0 16781312 514 10288416178418188545 0 0 17 6 0 0 0
/proc/18159/statm: 72328 5685 348 364 0 8243 0
[pid=18161] ppid=18159 vsize=2084 CPUtime=2.27 cores=0-7
/proc/18161/stat : 18161 (march_hi) R 18159 18161 18161 0 -1 4202496 587 0 0 0 227 0 0 0 25 0 1 0 548561386 2134016 323 33554432000 4194304 4955518 140737051817472 18446744073709551615 4209717 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/18161/statm: 521 323 104 186 0 334 0
[pid=18162] ppid=18150 vsize=299388 CPUtime=0 cores=0-7
/proc/18162/stat : 18162 (python) S 18150 18150 17621 0 -1 4202560 762 0 0 0 0 0 0 0 15 0 1 0 548561390 306573312 5627 33554432000 4194304 5683644 140737342934144 18446744073709551615 274664828486 0 0 16781312 514 7723462808758648831 0 0 17 0 0 0 0
/proc/18162/statm: 74847 5627 348 364 0 10759 0
[pid=18164] ppid=18162 vsize=2084 CPUtime=2.23 cores=0-7
/proc/18164/stat : 18164 (march_hi) R 18162 18164 18164 0 -1 4202496 589 0 0 0 223 0 0 0 25 0 1 0 548561390 2134016 323 33554432000 4194304 4955518 140736752777088 18446744073709551615 4209664 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/18164/statm: 521 323 104 186 0 334 0
[pid=18165] ppid=18150 vsize=309996 CPUtime=0 cores=0-7
/proc/18165/stat : 18165 (python) S 18150 18150 17621 0 -1 4202560 772 0 0 0 0 0 0 0 15 0 1 0 548561393 317435904 5719 33554432000 4194304 5683644 140737342934144 18446744073709551615 274664828486 0 0 16781312 514 4841928155625128193 0 0 17 0 0 0 0
/proc/18165/statm: 77499 5719 348 364 0 13408 0
[pid=18167] ppid=18165 vsize=2084 CPUtime=2.19 cores=0-7
/proc/18167/stat : 18167 (march_hi) R 18165 18167 18167 0 -1 4202496 587 0 0 0 219 0 0 0 25 0 1 0 548561394 2134016 323 33554432000 4194304 4955518 140735348557536 18446744073709551615 4209701 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/18167/statm: 521 323 104 186 0 334 0
[pid=18168] ppid=18150 vsize=320252 CPUtime=0 cores=0-7
/proc/18168/stat : 18168 (python) S 18150 18150 17621 0 -1 4202560 768 0 0 0 0 0 0 0 15 0 1 0 548561397 327938048 5723 33554432000 4194304 5683644 140737342934144 18446744073709551615 274664828486 0 0 16781312 514 8320703781071192322 0 0 17 1 0 0 0
/proc/18168/statm: 80063 5723 348 364 0 15969 0
[pid=18170] ppid=18168 vsize=2084 CPUtime=2.14 cores=0-7
/proc/18170/stat : 18170 (march_hi) R 18168 18170 18170 0 -1 4202496 588 0 0 0 214 0 0 0 25 0 1 0 548561398 2134016 323 33554432000 4194304 4955518 140736681956720 18446744073709551615 4209740 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/18170/statm: 521 323 104 186 0 334 0
[pid=18171] ppid=18150 vsize=330508 CPUtime=0 cores=0-7
/proc/18171/stat : 18171 (python) S 18150 18150 17621 0 -1 4202560 763 0 0 0 0 0 0 0 18 0 1 0 548561401 338440192 5727 33554432000 4194304 5683644 140737342934144 18446744073709551615 274664828486 0 0 16781312 514 13935325273693061377 0 0 17 1 0 0 0
/proc/18171/statm: 82627 5727 348 364 0 18530 0
[pid=18173] ppid=18171 vsize=454912 CPUtime=2.11 cores=0-7
/proc/18173/stat : 18173 (TNM) R 18171 18173 18173 0 -1 4202496 425 0 0 0 211 0 0 0 25 0 1 0 548561401 465829888 160 33554432000 134512640 135008748 4289124944 18446744073709551615 134527173 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/18173/statm: 113728 160 46 122 0 112628 0
[pid=18174] ppid=18150 vsize=405868 CPUtime=0 cores=0-7
/proc/18174/stat : 18174 (python) S 18150 18150 17621 0 -1 4202560 782 0 0 0 0 0 0 0 15 0 1 0 548561405 415608832 5644 33554432000 4194304 5683644 140737342934144 18446744073709551615 274664828486 0 0 16781312 514 13835735358739808513 0 0 17 7 0 0 0
/proc/18174/statm: 101467 5644 348 364 0 37367 0
[pid=18176] ppid=18174 vsize=2084 CPUtime=2.06 cores=0-7
/proc/18176/stat : 18176 (march_hi) R 18174 18176 18176 0 -1 4202496 590 0 0 0 206 0 0 0 25 0 1 0 548561406 2134016 323 33554432000 4194304 4955518 140736305408336 18446744073709551615 4227841 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/18176/statm: 521 323 104 186 0 334 0
[pid=18177] ppid=18150 vsize=416556 CPUtime=0 cores=0-7
/proc/18177/stat : 18177 (python) S 18150 18150 17621 0 -1 4202560 825 0 0 0 0 0 0 0 15 0 1 0 548561409 426553344 5743 33554432000 4194304 5683644 140737342934144 18446744073709551615 274664828486 0 0 16781312 514 3951882289033478404 0 0 17 2 0 0 0
/proc/18177/statm: 104139 5743 354 364 0 40036 0
[pid=18179] ppid=18177 vsize=2084 CPUtime=2.03 cores=0-7
/proc/18179/stat : 18179 (march_hi) R 18177 18179 18179 0 -1 4202496 592 0 0 0 203 0 0 0 25 0 1 0 548561409 2134016 323 33554432000 4194304 4955518 140737277304736 18446744073709551615 4238368 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/18179/statm: 521 323 104 186 0 334 0
[pid=18150/tid=18157] ppid=18148 vsize=426800 CPUtime=0 cores=0-7
/proc/18150/task/18157/stat : 18157 (python) S 18148 18150 17621 0 -1 4202560 26 933 0 0 0 0 0 0 17 0 9 0 548561382 437043200 7282 33554432000 4194304 5683644 140737342934144 18446744073709551615 274676631985 0 0 16781312 2 18446604453848674688 0 0 -1 7 0 0 0
[pid=18150/tid=18160] ppid=18148 vsize=426800 CPUtime=0 cores=0-7
/proc/18150/task/18160/stat : 18160 (python) S 18148 18150 17621 0 -1 4202560 24 933 0 0 0 0 0 0 19 0 9 0 548561386 437043200 7282 33554432000 4194304 5683644 140737342934144 18446744073709551615 274676631985 0 0 16781312 2 18446604453848674688 0 0 -1 6 0 0 0
[pid=18150/tid=18163] ppid=18148 vsize=426800 CPUtime=0 cores=0-7
/proc/18150/task/18163/stat : 18163 (python) S 18148 18150 17621 0 -1 4202560 25 933 0 0 0 0 0 0 21 0 9 0 548561390 437043200 7282 33554432000 4194304 5683644 140737342934144 18446744073709551615 274676631985 0 0 16781312 2 18446604453848674688 0 0 -1 0 0 0 0
[pid=18150/tid=18166] ppid=18148 vsize=426800 CPUtime=0 cores=0-7
/proc/18150/task/18166/stat : 18166 (python) S 18148 18150 17621 0 -1 4202560 22 933 0 0 0 0 0 0 20 0 9 0 548561394 437043200 7282 33554432000 4194304 5683644 140737342934144 18446744073709551615 274676631985 0 0 16781312 2 18446604453848674688 0 0 -1 0 0 0 0
[pid=18150/tid=18169] ppid=18148 vsize=426800 CPUtime=0 cores=0-7
/proc/18150/task/18169/stat : 18169 (python) S 18148 18150 17621 0 -1 4202560 26 933 0 0 0 0 0 0 19 0 9 0 548561397 437043200 7282 33554432000 4194304 5683644 140737342934144 18446744073709551615 274676631985 0 0 16781312 2 18446604453848674688 0 0 -1 0 0 0 0
[pid=18150/tid=18172] ppid=18148 vsize=426800 CPUtime=0 cores=0-7
/proc/18150/task/18172/stat : 18172 (python) S 18148 18150 17621 0 -1 4202560 21 933 0 0 0 0 0 0 18 0 9 0 548561401 437043200 7282 33554432000 4194304 5683644 140737342934144 18446744073709551615 274676631985 0 0 16781312 2 18446604453848674688 0 0 -1 7 0 0 0
[pid=18150/tid=18175] ppid=18148 vsize=426800 CPUtime=0 cores=0-7
/proc/18150/task/18175/stat : 18175 (python) S 18148 18150 17621 0 -1 4202560 26 933 0 0 0 0 0 0 19 0 9 0 548561405 437043200 7282 33554432000 4194304 5683644 140737342934144 18446744073709551615 274676631985 0 0 16781312 2 18446604453848674688 0 0 -1 7 0 0 0
[pid=18150/tid=18178] ppid=18148 vsize=426800 CPUtime=0 cores=0-7
/proc/18150/task/18178/stat : 18178 (python) S 18148 18150 17621 0 -1 4202560 71 933 0 0 0 0 0 0 21 0 9 0 548561409 437043200 7282 33554432000 4194304 5683644 140737342934144 18446744073709551615 274676631985 0 0 16781312 2 18446604453848674688 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 18.13
Current children cumulated vsize (KiB) 4562552

[startup+6.30166 s]
/proc/loadavg: 8.12 8.54 8.23 9/282 18179
/proc/meminfo: memFree=23123184/32951132 swapFree=67111356/67111528
[pid=18150] ppid=18148 vsize=426800 CPUtime=0.79 cores=0-7
/proc/18150/stat : 18150 (python) S 18148 18150 17621 0 -1 4202496 15910 933 1 0 65 14 0 0 21 0 9 0 548561303 437043200 7282 33554432000 4194304 5683644 140737342934144 18446744073709551615 274676635083 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/18150/statm: 106700 7282 1889 364 0 42597 0

################
# More data... #
################

[pid=18177] ppid=18150 vsize=416556 CPUtime=0.05 cores=0-7
/proc/18177/stat : 18177 (python) S 18150 18150 17621 0 -1 4202560 1019 0 0 0 2 3 0 0 15 0 1 0 548561409 426553344 5766 33554432000 4194304 5683644 140737342934144 18446744073709551615 274664828486 0 0 16781312 514 3951882289033478404 0 0 17 2 0 0 0
/proc/18177/statm: 104139 5766 377 364 0 40036 0
[pid=18179] ppid=18177 vsize=2768 CPUtime=21.98 cores=0-7
/proc/18179/stat : 18179 (march_hi) R 18177 18179 18179 0 -1 4202496 737 0 0 0 2198 0 0 0 25 0 1 0 548561409 2834432 468 33554432000 4194304 4955518 140737277304736 18446744073709551615 4238968 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/18179/statm: 692 468 104 186 0 505 0
[pid=18150/tid=18157] ppid=18148 vsize=426800 CPUtime=0 cores=0-7
/proc/18150/task/18157/stat : 18157 (python) S 18148 18150 17621 0 -1 4202560 26 933 0 0 0 0 0 0 17 0 9 0 548561382 437043200 7282 33554432000 4194304 5683644 140737342934144 18446744073709551615 274676631985 0 0 16781312 2 18446604453848674688 0 0 -1 7 0 0 0
[pid=18150/tid=18160] ppid=18148 vsize=426800 CPUtime=0 cores=0-7
/proc/18150/task/18160/stat : 18160 (python) S 18148 18150 17621 0 -1 4202560 24 933 0 0 0 0 0 0 19 0 9 0 548561386 437043200 7282 33554432000 4194304 5683644 140737342934144 18446744073709551615 274676631985 0 0 16781312 2 18446604453848674688 0 0 -1 6 0 0 0
[pid=18150/tid=18163] ppid=18148 vsize=426800 CPUtime=0 cores=0-7
/proc/18150/task/18163/stat : 18163 (python) S 18148 18150 17621 0 -1 4202560 25 933 0 0 0 0 0 0 21 0 9 0 548561390 437043200 7282 33554432000 4194304 5683644 140737342934144 18446744073709551615 274676631985 0 0 16781312 2 18446604453848674688 0 0 -1 0 0 0 0
[pid=18150/tid=18166] ppid=18148 vsize=426800 CPUtime=0 cores=0-7
/proc/18150/task/18166/stat : 18166 (python) S 18148 18150 17621 0 -1 4202560 22 933 0 0 0 0 0 0 20 0 9 0 548561394 437043200 7282 33554432000 4194304 5683644 140737342934144 18446744073709551615 274676631985 0 0 16781312 2 18446604453848674688 0 0 -1 0 0 0 0
[pid=18150/tid=18169] ppid=18148 vsize=426800 CPUtime=0 cores=0-7
/proc/18150/task/18169/stat : 18169 (python) S 18148 18150 17621 0 -1 4202560 26 933 0 0 0 0 0 0 19 0 9 0 548561397 437043200 7282 33554432000 4194304 5683644 140737342934144 18446744073709551615 274676631985 0 0 16781312 2 18446604453848674688 0 0 -1 0 0 0 0
[pid=18150/tid=18172] ppid=18148 vsize=426800 CPUtime=0 cores=0-7
/proc/18150/task/18172/stat : 18172 (python) S 18148 18150 17621 0 -1 4202560 21 933 0 0 0 0 0 0 18 0 9 0 548561401 437043200 7282 33554432000 4194304 5683644 140737342934144 18446744073709551615 274676631985 0 0 16781312 2 18446604453848674688 0 0 -1 7 0 0 0
[pid=18150/tid=18175] ppid=18148 vsize=426800 CPUtime=0 cores=0-7
/proc/18150/task/18175/stat : 18175 (python) S 18148 18150 17621 0 -1 4202560 26 933 0 0 0 0 0 0 19 0 9 0 548561405 437043200 7282 33554432000 4194304 5683644 140737342934144 18446744073709551615 274676631985 0 0 16781312 2 18446604453848674688 0 0 -1 7 0 0 0
[pid=18150/tid=18178] ppid=18148 vsize=426800 CPUtime=0 cores=0-7
/proc/18150/task/18178/stat : 18178 (python) S 18148 18150 17621 0 -1 4202560 71 933 0 0 0 0 0 0 21 0 9 0 548561409 437043200 7282 33554432000 4194304 5683644 140737342934144 18446744073709551615 274676631985 0 0 16781312 2 18446604453848674688 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 172.2
Current children cumulated vsize (KiB) 4565948

[startup+23.3017 s]
/proc/loadavg: 8.23 8.54 8.24 9/282 18180
/proc/meminfo: memFree=23124576/32951132 swapFree=67111356/67111528
[pid=18150] ppid=18148 vsize=426800 CPUtime=0.79 cores=0-7
/proc/18150/stat : 18150 (python) S 18148 18150 17621 0 -1 4202496 15910 933 1 0 65 14 0 0 21 0 9 0 548561303 437043200 7282 33554432000 4194304 5683644 140737342934144 18446744073709551615 274676635083 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/18150/statm: 106700 7282 1889 364 0 42597 0
[pid=18156] ppid=18150 vsize=278656 CPUtime=0.04 cores=0-7
/proc/18156/stat : 18156 (python) S 18150 18150 17621 0 -1 4202560 909 0 0 0 2 2 0 0 18 0 1 0 548561382 285343744 5600 33554432000 4194304 5683644 140737342934144 18446744073709551615 274664828431 0 0 16781312 514 10592008926738219267 0 0 17 7 0 0 0
/proc/18156/statm: 69664 5600 377 364 0 5582 0
[pid=18158] ppid=18156 vsize=1017800 CPUtime=22.51 cores=0-7
/proc/18158/stat : 18158 (gnovelty+2) R 18156 18158 18158 0 -1 4202496 435 0 0 0 2251 0 0 0 25 0 1 0 548561382 1042227200 170 33554432000 134512640 135663704 4289279360 18446744073709551615 134545793 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/18158/statm: 254450 170 113 282 0 254166 0
[pid=18159] ppid=18150 vsize=289312 CPUtime=0.05 cores=0-7
/proc/18159/stat : 18159 (python) S 18150 18150 17621 0 -1 4202560 930 0 0 0 3 2 0 0 15 0 1 0 548561385 296255488 5708 33554432000 4194304 5683644 140737342934144 18446744073709551615 274664828486 0 0 16781312 514 10288416178418188545 0 0 17 6 0 0 0
/proc/18159/statm: 72328 5708 371 364 0 8243 0
[pid=18161] ppid=18159 vsize=2768 CPUtime=22.47 cores=0-7
/proc/18161/stat : 18161 (march_hi) R 18159 18161 18161 0 -1 4202496 737 0 0 0 2247 0 0 0 25 0 1 0 548561386 2834432 473 33554432000 4194304 4955518 140737051817472 18446744073709551615 4235347 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/18161/statm: 692 473 104 186 0 505 0
[pid=18162] ppid=18150 vsize=299388 CPUtime=0.04 cores=0-7
/proc/18162/stat : 18162 (python) S 18150 18150 17621 0 -1 4202560 930 0 0 0 2 2 0 0 15 0 1 0 548561390 306573312 5650 33554432000 4194304 5683644 140737342934144 18446744073709551615 274664828486 0 0 16781312 514 4311484163967385859 0 0 17 0 0 0 0
/proc/18162/statm: 74847 5650 371 364 0 10759 0
[pid=18164] ppid=18162 vsize=2288 CPUtime=16.68 cores=0-7
/proc/18164/stat : 18164 (march_hi) R 18162 18164 18164 0 -1 4202496 664 0 0 0 1645 23 0 0 25 0 1 0 548561390 2342912 398 33554432000 4194304 4955518 140736752777088 18446744073709551615 4227583 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/18164/statm: 572 398 104 186 0 385 0
[pid=18165] ppid=18150 vsize=309996 CPUtime=0.05 cores=0-7
/proc/18165/stat : 18165 (python) S 18150 18150 17621 0 -1 4202560 931 0 0 0 3 2 0 0 15 0 1 0 548561393 317435904 5742 33554432000 4194304 5683644 140737342934144 18446744073709551615 274664828486 0 0 16781312 514 4841928155625128193 0 0 17 0 0 0 0
/proc/18165/statm: 77499 5742 371 364 0 13408 0
[pid=18167] ppid=18165 vsize=2768 CPUtime=22.34 cores=0-7
/proc/18167/stat : 18167 (march_hi) R 18165 18167 18167 0 -1 4202496 735 0 0 0 2234 0 0 0 25 0 1 0 548561394 2834432 471 33554432000 4194304 4955518 140735348557536 18446744073709551615 4289863 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/18167/statm: 692 471 104 186 0 505 0
[pid=18168] ppid=18150 vsize=320252 CPUtime=0.05 cores=0-7
/proc/18168/stat : 18168 (python) S 18150 18150 17621 0 -1 4202560 967 0 0 0 3 2 0 0 15 0 1 0 548561397 327938048 5746 33554432000 4194304 5683644 140737342934144 18446744073709551615 274664828486 0 0 16781312 514 9454221379348955394 0 0 17 0 0 0 0
/proc/18168/statm: 80063 5746 371 364 0 15969 0
[pid=18170] ppid=18168 vsize=2768 CPUtime=22.22 cores=0-7
/proc/18170/stat : 18170 (march_hi) R 18168 18170 18170 0 -1 4202496 735 0 0 0 2221 1 0 0 25 0 1 0 548561398 2834432 470 33554432000 4194304 4955518 140736681956720 18446744073709551615 4238717 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/18170/statm: 692 470 104 186 0 505 0
[pid=18171] ppid=18150 vsize=330508 CPUtime=0.03 cores=0-7
/proc/18171/stat : 18171 (python) S 18150 18150 17621 0 -1 4202560 931 0 0 0 1 2 0 0 18 0 1 0 548561401 338440192 5750 33554432000 4194304 5683644 140737342934144 18446744073709551615 274664828486 0 0 16781312 514 10592008926738219265 0 0 17 1 0 0 0
/proc/18171/statm: 82627 5750 371 364 0 18530 0
[pid=18173] ppid=18171 vsize=454912 CPUtime=22.22 cores=0-7
/proc/18173/stat : 18173 (TNM) R 18171 18173 18173 0 -1 4202496 425 0 0 0 2222 0 0 0 25 0 1 0 548561401 465829888 160 33554432000 134512640 135008748 4289124944 18446744073709551615 134528632 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/18173/statm: 113728 160 46 122 0 112628 0
[pid=18174] ppid=18150 vsize=405868 CPUtime=0.05 cores=0-7
/proc/18174/stat : 18174 (python) S 18150 18150 17621 0 -1 4202560 987 0 0 0 3 2 0 0 15 0 1 0 548561405 415608832 5667 33554432000 4194304 5683644 140737342934144 18446744073709551615 274664828486 0 0 16781312 514 13835735358739808513 0 0 17 7 0 0 0
/proc/18174/statm: 101467 5667 371 364 0 37367 0
[pid=18176] ppid=18174 vsize=2768 CPUtime=21.98 cores=0-7
/proc/18176/stat : 18176 (march_hi) R 18174 18176 18176 0 -1 4202496 733 0 0 0 2198 0 0 0 25 0 1 0 548561406 2834432 466 33554432000 4194304 4955518 140736305408336 18446744073709551615 4238422 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/18176/statm: 692 466 104 186 0 505 0
[pid=18177] ppid=18150 vsize=416556 CPUtime=0.05 cores=0-7
/proc/18177/stat : 18177 (python) S 18150 18150 17621 0 -1 4202560 1019 0 0 0 2 3 0 0 15 0 1 0 548561409 426553344 5766 33554432000 4194304 5683644 140737342934144 18446744073709551615 274664828486 0 0 16781312 514 3951882289033478404 0 0 17 2 0 0 0
/proc/18177/statm: 104139 5766 377 364 0 40036 0
[pid=18179] ppid=18177 vsize=2768 CPUtime=22.17 cores=0-7
/proc/18179/stat : 18179 (march_hi) R 18177 18179 18179 0 -1 4202496 739 0 0 0 2217 0 0 0 25 0 1 0 548561409 2834432 470 33554432000 4194304 4955518 140737277304736 18446744073709551615 4209740 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/18179/statm: 692 470 104 186 0 505 0
[pid=18150/tid=18157] ppid=18148 vsize=426800 CPUtime=0 cores=0-7
/proc/18150/task/18157/stat : 18157 (python) S 18148 18150 17621 0 -1 4202560 26 933 0 0 0 0 0 0 17 0 9 0 548561382 437043200 7282 33554432000 4194304 5683644 140737342934144 18446744073709551615 274676631985 0 0 16781312 2 18446604453848674688 0 0 -1 7 0 0 0
[pid=18150/tid=18160] ppid=18148 vsize=426800 CPUtime=0 cores=0-7
/proc/18150/task/18160/stat : 18160 (python) S 18148 18150 17621 0 -1 4202560 24 933 0 0 0 0 0 0 19 0 9 0 548561386 437043200 7282 33554432000 4194304 5683644 140737342934144 18446744073709551615 274676631985 0 0 16781312 2 18446604453848674688 0 0 -1 6 0 0 0
[pid=18150/tid=18163] ppid=18148 vsize=426800 CPUtime=0 cores=0-7
/proc/18150/task/18163/stat : 18163 (python) S 18148 18150 17621 0 -1 4202560 25 933 0 0 0 0 0 0 21 0 9 0 548561390 437043200 7282 33554432000 4194304 5683644 140737342934144 18446744073709551615 274676631985 0 0 16781312 2 18446604453848674688 0 0 -1 0 0 0 0
[pid=18150/tid=18166] ppid=18148 vsize=426800 CPUtime=0 cores=0-7
/proc/18150/task/18166/stat : 18166 (python) S 18148 18150 17621 0 -1 4202560 22 933 0 0 0 0 0 0 20 0 9 0 548561394 437043200 7282 33554432000 4194304 5683644 140737342934144 18446744073709551615 274676631985 0 0 16781312 2 18446604453848674688 0 0 -1 0 0 0 0
[pid=18150/tid=18169] ppid=18148 vsize=426800 CPUtime=0 cores=0-7
/proc/18150/task/18169/stat : 18169 (python) S 18148 18150 17621 0 -1 4202560 26 933 0 0 0 0 0 0 19 0 9 0 548561397 437043200 7282 33554432000 4194304 5683644 140737342934144 18446744073709551615 274676631985 0 0 16781312 2 18446604453848674688 0 0 -1 0 0 0 0
[pid=18150/tid=18172] ppid=18148 vsize=426800 CPUtime=0 cores=0-7
/proc/18150/task/18172/stat : 18172 (python) S 18148 18150 17621 0 -1 4202560 21 933 0 0 0 0 0 0 18 0 9 0 548561401 437043200 7282 33554432000 4194304 5683644 140737342934144 18446744073709551615 274676631985 0 0 16781312 2 18446604453848674688 0 0 -1 7 0 0 0
[pid=18150/tid=18175] ppid=18148 vsize=426800 CPUtime=0 cores=0-7
/proc/18150/task/18175/stat : 18175 (python) S 18148 18150 17621 0 -1 4202560 26 933 0 0 0 0 0 0 19 0 9 0 548561405 437043200 7282 33554432000 4194304 5683644 140737342934144 18446744073709551615 274676631985 0 0 16781312 2 18446604453848674688 0 0 -1 7 0 0 0
[pid=18150/tid=18178] ppid=18148 vsize=426800 CPUtime=0 cores=0-7
/proc/18150/task/18178/stat : 18178 (python) S 18148 18150 17621 0 -1 4202560 71 933 0 0 0 0 0 0 21 0 9 0 548561409 437043200 7282 33554432000 4194304 5683644 140737342934144 18446744073709551615 274676631985 0 0 16781312 2 18446604453848674688 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 173.74
Current children cumulated vsize (KiB) 4566176

[startup+23.4017 s]
/proc/loadavg: 8.23 8.54 8.24 9/282 18180
/proc/meminfo: memFree=23124576/32951132 swapFree=67111356/67111528
[pid=18150] ppid=18148 vsize=426800 CPUtime=0.79 cores=0-7
/proc/18150/stat : 18150 (python) S 18148 18150 17621 0 -1 4202496 15910 933 1 0 65 14 0 0 21 0 9 0 548561303 437043200 7282 33554432000 4194304 5683644 140737342934144 18446744073709551615 274676635083 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/18150/statm: 106700 7282 1889 364 0 42597 0
[pid=18156] ppid=18150 vsize=278656 CPUtime=0.04 cores=0-7
/proc/18156/stat : 18156 (python) S 18150 18150 17621 0 -1 4202560 909 0 0 0 2 2 0 0 18 0 1 0 548561382 285343744 5600 33554432000 4194304 5683644 140737342934144 18446744073709551615 274664828431 0 0 16781312 514 10592008926738219267 0 0 17 7 0 0 0
/proc/18156/statm: 69664 5600 377 364 0 5582 0
[pid=18158] ppid=18156 vsize=1017800 CPUtime=22.61 cores=0-7
/proc/18158/stat : 18158 (gnovelty+2) R 18156 18158 18158 0 -1 4202496 435 0 0 0 2261 0 0 0 25 0 1 0 548561382 1042227200 170 33554432000 134512640 135663704 4289279360 18446744073709551615 134525255 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/18158/statm: 254450 170 113 282 0 254166 0
[pid=18159] ppid=18150 vsize=289312 CPUtime=0.05 cores=0-7
/proc/18159/stat : 18159 (python) S 18150 18150 17621 0 -1 4202560 932 0 0 0 3 2 0 0 15 0 1 0 548561385 296255488 5708 33554432000 4194304 5683644 140737342934144 18446744073709551615 274664828486 0 0 16781312 514 5602224949990228225 0 0 17 6 0 0 0
/proc/18159/statm: 72328 5708 371 364 0 8243 0
[pid=18161] ppid=18159 vsize=2768 CPUtime=22.57 cores=0-7
/proc/18161/stat : 18161 (march_hi) R 18159 18161 18161 0 -1 4202496 738 0 0 0 2257 0 0 0 25 0 1 0 548561386 2834432 474 33554432000 4194304 4955518 140737051817472 18446744073709551615 4235384 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/18161/statm: 692 474 104 186 0 505 0
[pid=18162] ppid=18150 vsize=299388 CPUtime=0.04 cores=0-7
/proc/18162/stat : 18162 (python) S 18150 18150 17621 0 -1 4202560 930 0 0 0 2 2 0 0 15 0 1 0 548561390 306573312 5650 33554432000 4194304 5683644 140737342934144 18446744073709551615 274664828486 0 0 16781312 514 4311484163967385859 0 0 17 0 0 0 0
/proc/18162/statm: 74847 5650 371 364 0 10759 0
[pid=18164] ppid=18162 vsize=2288 CPUtime=16.78 cores=0-7
/proc/18164/stat : 18164 (march_hi) R 18162 18164 18164 0 -1 4202496 664 0 0 0 1655 23 0 0 25 0 1 0 548561390 2342912 398 33554432000 4194304 4955518 140736752777088 18446744073709551615 4227654 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/18164/statm: 572 398 104 186 0 385 0
[pid=18165] ppid=18150 vsize=309996 CPUtime=0.05 cores=0-7
/proc/18165/stat : 18165 (python) S 18150 18150 17621 0 -1 4202560 931 0 0 0 3 2 0 0 15 0 1 0 548561393 317435904 5742 33554432000 4194304 5683644 140737342934144 18446744073709551615 274664828486 0 0 16781312 514 4841928155625128193 0 0 17 0 0 0 0
/proc/18165/statm: 77499 5742 371 364 0 13408 0
[pid=18167] ppid=18165 vsize=2768 CPUtime=22.43 cores=0-7
/proc/18167/stat : 18167 (march_hi) R 18165 18167 18167 0 -1 4202496 736 0 0 0 2243 0 0 0 25 0 1 0 548561394 2834432 472 33554432000 4194304 4955518 140735348557536 18446744073709551615 4295671 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/18167/statm: 692 472 104 186 0 505 0
[pid=18168] ppid=18150 vsize=320252 CPUtime=0.05 cores=0-7
/proc/18168/stat : 18168 (python) S 18150 18150 17621 0 -1 4202560 968 0 0 0 3 2 0 0 15 0 1 0 548561397 327938048 5746 33554432000 4194304 5683644 140737342934144 18446744073709551615 274664828486 0 0 16781312 514 8320703781071192322 0 0 17 0 0 0 0
/proc/18168/statm: 80063 5746 371 364 0 15969 0
[pid=18170] ppid=18168 vsize=2768 CPUtime=22.32 cores=0-7
/proc/18170/stat : 18170 (march_hi) R 18168 18170 18170 0 -1 4202496 736 0 0 0 2231 1 0 0 25 0 1 0 548561398 2834432 471 33554432000 4194304 4955518 140736681956720 18446744073709551615 4224656 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/18170/statm: 692 471 104 186 0 505 0
[pid=18171] ppid=18150 vsize=330508 CPUtime=0.03 cores=0-7
/proc/18171/stat : 18171 (python) S 18150 18150 17621 0 -1 4202560 931 0 0 0 1 2 0 0 18 0 1 0 548561401 338440192 5750 33554432000 4194304 5683644 140737342934144 18446744073709551615 274664828486 0 0 16781312 514 10592008926738219265 0 0 17 1 0 0 0
/proc/18171/statm: 82627 5750 371 364 0 18530 0
[pid=18173] ppid=18171 vsize=454912 CPUtime=22.32 cores=0-7
/proc/18173/stat : 18173 (TNM) R 18171 18173 18173 0 -1 4202496 425 0 0 0 2232 0 0 0 25 0 1 0 548561401 465829888 160 33554432000 134512640 135008748 4289124944 18446744073709551615 134529586 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/18173/statm: 113728 160 46 122 0 112628 0
[pid=18174] ppid=18150 vsize=405868 CPUtime=0.05 cores=0-7
/proc/18174/stat : 18174 (python) S 18150 18150 17621 0 -1 4202560 987 0 0 0 3 2 0 0 15 0 1 0 548561405 415608832 5667 33554432000 4194304 5683644 140737342934144 18446744073709551615 274664828486 0 0 16781312 514 13835735358739808513 0 0 17 7 0 0 0
/proc/18174/statm: 101467 5667 371 364 0 37367 0
[pid=18176] ppid=18174 vsize=2768 CPUtime=22.08 cores=0-7
/proc/18176/stat : 18176 (march_hi) R 18174 18176 18176 0 -1 4202496 734 0 0 0 2208 0 0 0 25 0 1 0 548561406 2834432 467 33554432000 4194304 4955518 140736305408336 18446744073709551615 4224651 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/18176/statm: 692 467 104 186 0 505 0
[pid=18177] ppid=18150 vsize=416556 CPUtime=0.05 cores=0-7
/proc/18177/stat : 18177 (python) S 18150 18150 17621 0 -1 4202560 1019 0 0 0 2 3 0 0 15 0 1 0 548561409 426553344 5766 33554432000 4194304 5683644 140737342934144 18446744073709551615 274664828486 0 0 16781312 514 3951882289033478404 0 0 17 2 0 0 0
/proc/18177/statm: 104139 5766 377 364 0 40036 0
[pid=18179] ppid=18177 vsize=2768 CPUtime=22.27 cores=0-7
/proc/18179/stat : 18179 (march_hi) R 18177 18179 18179 0 -1 4202496 740 0 0 0 2227 0 0 0 25 0 1 0 548561409 2834432 471 33554432000 4194304 4955518 140737277304736 18446744073709551615 4238735 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/18179/statm: 692 471 104 186 0 505 0
[pid=18150/tid=18157] ppid=18148 vsize=426800 CPUtime=0 cores=0-7
/proc/18150/task/18157/stat : 18157 (python) S 18148 18150 17621 0 -1 4202560 26 933 0 0 0 0 0 0 17 0 9 0 548561382 437043200 7282 33554432000 4194304 5683644 140737342934144 18446744073709551615 274676631985 0 0 16781312 2 18446604453848674688 0 0 -1 7 0 0 0
[pid=18150/tid=18160] ppid=18148 vsize=426800 CPUtime=0 cores=0-7
/proc/18150/task/18160/stat : 18160 (python) S 18148 18150 17621 0 -1 4202560 24 933 0 0 0 0 0 0 19 0 9 0 548561386 437043200 7282 33554432000 4194304 5683644 140737342934144 18446744073709551615 274676631985 0 0 16781312 2 18446604453848674688 0 0 -1 6 0 0 0
[pid=18150/tid=18163] ppid=18148 vsize=426800 CPUtime=0 cores=0-7
/proc/18150/task/18163/stat : 18163 (python) S 18148 18150 17621 0 -1 4202560 25 933 0 0 0 0 0 0 21 0 9 0 548561390 437043200 7282 33554432000 4194304 5683644 140737342934144 18446744073709551615 274676631985 0 0 16781312 2 18446604453848674688 0 0 -1 0 0 0 0
[pid=18150/tid=18166] ppid=18148 vsize=426800 CPUtime=0 cores=0-7
/proc/18150/task/18166/stat : 18166 (python) S 18148 18150 17621 0 -1 4202560 22 933 0 0 0 0 0 0 20 0 9 0 548561394 437043200 7282 33554432000 4194304 5683644 140737342934144 18446744073709551615 274676631985 0 0 16781312 2 18446604453848674688 0 0 -1 0 0 0 0
[pid=18150/tid=18169] ppid=18148 vsize=426800 CPUtime=0 cores=0-7
/proc/18150/task/18169/stat : 18169 (python) S 18148 18150 17621 0 -1 4202560 26 933 0 0 0 0 0 0 19 0 9 0 548561397 437043200 7282 33554432000 4194304 5683644 140737342934144 18446744073709551615 274676631985 0 0 16781312 2 18446604453848674688 0 0 -1 0 0 0 0
[pid=18150/tid=18172] ppid=18148 vsize=426800 CPUtime=0 cores=0-7
/proc/18150/task/18172/stat : 18172 (python) S 18148 18150 17621 0 -1 4202560 21 933 0 0 0 0 0 0 18 0 9 0 548561401 437043200 7282 33554432000 4194304 5683644 140737342934144 18446744073709551615 274676631985 0 0 16781312 2 18446604453848674688 0 0 -1 7 0 0 0
[pid=18150/tid=18175] ppid=18148 vsize=426800 CPUtime=0 cores=0-7
/proc/18150/task/18175/stat : 18175 (python) S 18148 18150 17621 0 -1 4202560 26 933 0 0 0 0 0 0 19 0 9 0 548561405 437043200 7282 33554432000 4194304 5683644 140737342934144 18446744073709551615 274676631985 0 0 16781312 2 18446604453848674688 0 0 -1 7 0 0 0
[pid=18150/tid=18178] ppid=18148 vsize=426800 CPUtime=0 cores=0-7
/proc/18150/task/18178/stat : 18178 (python) S 18148 18150 17621 0 -1 4202560 71 933 0 0 0 0 0 0 21 0 9 0 548561409 437043200 7282 33554432000 4194304 5683644 140737342934144 18446744073709551615 274676631985 0 0 16781312 2 18446604453848674688 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 174.53
Current children cumulated vsize (KiB) 4566176

Child status: 0
Real time (s): 23.4467
CPU time (s): 174.864
CPU user time (s): 174.22
CPU system time (s): 0.644901
CPU usage (%): 745.796
Max. virtual memory (cumulated for all children) (KiB): 4566176

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 174.22
system time used= 0.644901
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 34589
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 5520
involuntary context switches= 3344

runsolver used 0.072988 second user time and 0.13098 second system time

The end

Launcher Data 

Begin job on node131 at 2011-05-02 22:53:36
IDJOB=3321926
IDBENCH=82704
IDSOLVER=1712
FILE ID=node131/3321926-1304369616
RUNJOBID= node131-1304366465-17635
PBS_JOBID= 13181740
Free space on /tmp= 72848 MiB

SOLVER NAME= borg-sat 11.03.02-random
BENCH NAME= SAT11/random/medium/unif-k3-r4.26-v400-c1704-S785747282-100.UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3321926-1304369616/watcher-3321926-1304369616 -o /tmp/evaluation-result-3321926-1304369616/solver-3321926-1304369616 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3321926-1304369616.cnf -seed 1719099220 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= b444591b86255859f3a5d3b876e65166
RANDOM SEED=1719099220

node131.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951132 kB
MemFree:      23186540 kB
Buffers:        315968 kB
Cached:        2103916 kB
SwapCached:        168 kB
Active:        7432304 kB
Inactive:      1977604 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951132 kB
LowFree:      23186540 kB
SwapTotal:    67111528 kB
SwapFree:     67111356 kB
Dirty:           31592 kB
Writeback:           0 kB
AnonPages:     6990860 kB
Mapped:          26328 kB
Slab:           265520 kB
PageTables:      24676 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587092 kB
Committed_AS: 19727204 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296000 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72820 MiB
End job on node131 at 2011-05-02 22:54:00