Trace number 3378336

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-par-random (fixed)? 3450.12 1138.47

General information on the benchmark

Namerandom/medium/
unif-k5-r21.3-v150-c3195-S375894551-007.UNKNOWN.cnf
MD5SUMa88511669158afb29f3ddcebdff7b380
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables150
Number of clauses3195
Sum of the clauses size15975
Maximum clause length5
Minimum clause length5
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 53195
Number of clauses of size over 50

Solver Data 

0.30/0.45	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.30/0.45	c INFO: solving HOME/instance-3378336-1305464792.cnf
0.30/0.45	c INFO: computing task features
0.30/0.47	c INFO: computed variable-clause graph statistics
0.30/0.47	c INFO: computed clause balance statistics
0.40/0.55	c INFO: computed variable balance statistics
0.40/0.59	c INFO: computed small-clause counts
0.40/0.59	c INFO: computed Horn-clause counts
0.50/0.60	c INFO: computed variable graph statistics
0.50/0.60	c INFO: collected features for HOME/instance-3378336-1305464792.cnf in 0.14 s
0.50/0.61	c INFO: running gnovelty+2@0 for 97 with 1199 remaining (b = 0.62)
0.50/0.62	c INFO: running gnovelty+2@0 for 97 with 1199 remaining (b = 0.08)
0.50/0.62	c INFO: running march_hi@0 for 679 with 1199 remaining (b = 0.34)
0.50/0.64	c INFO: running march_hi@0 for 388 with 1199 remaining (b = 0.21)
299.86/100.89	c INFO: running march_hi@0 for 582 with 1099 remaining (b = 0.25)
485.04/154.01	c INFO: running march_hi@0 for 485 with 1046 remaining (b = 0.20)
1350.51/442.45	c INFO: running march_hi@98 for 97 with 757 remaining (b = 0.05)
1864.07/609.88	c INFO: running march_hi@193 for 291 with 590 remaining (b = 0.14)
2351.59/772.32	c INFO: running march_hi@0 for 291 with 428 remaining (b = 0.13)
2632.94/866.12	c INFO: running march_hi@390 for 334 with 334 remaining (b = 0.15)
2872.06/945.89	c INFO: running march_hi@102 for 97 with 254 remaining (b = 0.05)
2992.36/985.97	c INFO: running march_hi@874 for 97 with 214 remaining (b = 0.05)
3449.93/1138.44	s UNKNOWN

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3378336-1305464792/watcher-3378336-1305464792 -o /tmp/evaluation-result-3378336-1305464792/solver-3378336-1305464792 -C 4800 -W 1300 -M 15500 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3378336-1305464792.cnf -seed 1826794127 -budget 4800 -cores 4 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.04 8.26 7.71 7/356 32138
/proc/meminfo: memFree=11183688/32951124 swapFree=66050672/67111528
[pid=32138] ppid=32136 vsize=16244 CPUtime=0.01 cores=0,2,4,6
/proc/32138/stat : 32138 (python) R 32136 32138 30970 0 -1 4202496 1050 0 0 0 1 0 0 0 25 0 1 0 658077061 16633856 923 33554432000 4194304 5683644 140735136629312 18446744073709551615 255377301248 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/32138/statm: 4061 923 381 364 0 548 0

[startup+0.088612 s]
/proc/loadavg: 8.04 8.26 7.71 7/356 32138
/proc/meminfo: memFree=11183688/32951124 swapFree=66050672/67111528
[pid=32138] ppid=32136 vsize=99376 CPUtime=0.05 cores=0,2,4,6
/proc/32138/stat : 32138 (python) R 32136 32138 30970 0 -1 4202496 2866 0 0 0 4 1 0 0 25 0 1 0 658077061 101761024 2565 33554432000 4194304 5683644 140735136629312 18446744073709551615 4335968 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/32138/statm: 24844 2565 818 364 0 1695 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 99376

[startup+0.100651 s]
/proc/loadavg: 8.04 8.26 7.71 7/356 32138
/proc/meminfo: memFree=11183688/32951124 swapFree=66050672/67111528
[pid=32138] ppid=32136 vsize=104616 CPUtime=0.07 cores=0,2,4,6
/proc/32138/stat : 32138 (python) R 32136 32138 30970 0 -1 4202496 3142 0 0 0 5 2 0 0 25 0 1 0 658077061 107126784 2822 33554432000 4194304 5683644 140735136629312 18446744073709551615 255376959218 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/32138/statm: 26154 2822 847 364 0 1902 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 104616

[startup+0.300607 s]
/proc/loadavg: 8.04 8.26 7.71 7/356 32138
/proc/meminfo: memFree=11183688/32951124 swapFree=66050672/67111528
[pid=32138] ppid=32136 vsize=198916 CPUtime=0.21 cores=0,2,4,6
/proc/32138/stat : 32138 (python) R 32136 32138 30970 0 -1 4202496 7021 933 1 0 15 6 0 0 18 0 1 0 658077061 203689984 5053 33554432000 4194304 5683644 140735136629312 18446744073709551615 255376956693 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/32138/statm: 49729 5053 1466 364 0 3756 0
Current children cumulated CPU time (s) 0.21
Current children cumulated vsize (KiB) 198916

[startup+0.700499 s]
/proc/loadavg: 8.04 8.26 7.71 7/356 32138
/proc/meminfo: memFree=11183688/32951124 swapFree=66050672/67111528
[pid=32138] ppid=32136 vsize=320164 CPUtime=0.53 cores=0,2,4,6
/proc/32138/stat : 32138 (python) S 32136 32138 30970 0 -1 4202496 12350 933 1 0 43 10 0 0 22 0 5 0 658077061 327847936 7230 33554432000 4194304 5683644 140735136629312 18446744073709551615 255389128139 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/32138/statm: 80041 7230 1873 364 0 15950 0
Current children cumulated CPU time (s) 0.53
Current children cumulated vsize (KiB) 320164

[startup+1.50135 s]
/proc/loadavg: 8.04 8.26 7.71 10/369 32155
/proc/meminfo: memFree=11147244/32951124 swapFree=66050672/67111528
[pid=32138] ppid=32136 vsize=320164 CPUtime=0.53 cores=0,2,4,6
/proc/32138/stat : 32138 (python) S 32136 32138 30970 0 -1 4202496 12350 933 1 0 43 10 0 0 22 0 5 0 658077061 327847936 7230 33554432000 4194304 5683644 140735136629312 18446744073709551615 255389128139 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/32138/statm: 80041 7230 1873 364 0 15950 0
[pid=32144] ppid=32138 vsize=278680 CPUtime=0 cores=0,2,4,6
/proc/32144/stat : 32144 (python) S 32138 32138 30970 0 -1 4202560 739 0 0 0 0 0 0 0 20 0 1 0 658077122 285368320 5589 33554432000 4194304 5683644 140735136629312 18446744073709551615 255377321487 0 0 16781312 514 7151865746140692479 0 0 17 6 0 0 0
/proc/32144/statm: 69670 5589 354 364 0 5588 0
[pid=32146] ppid=32144 vsize=1017940 CPUtime=0.5 cores=0,2,4,6
/proc/32146/stat : 32146 (gnovelty+2) R 32144 32146 32146 0 -1 4202496 454 0 0 0 50 0 0 0 23 0 1 0 658077122 1042370560 191 33554432000 134512640 135663704 4287337040 18446744073709551615 134525678 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/32146/statm: 254485 191 113 282 0 254201 0
[pid=32147] ppid=32138 vsize=289308 CPUtime=0 cores=0,2,4,6
/proc/32147/stat : 32147 (python) S 32138 32138 30970 0 -1 4202560 735 0 0 0 0 0 0 0 19 0 1 0 658077123 296251392 5685 33554432000 4194304 5683644 140735136629312 18446744073709551615 255377321542 0 0 16781312 514 15369171724318801919 0 0 17 4 0 0 0
/proc/32147/statm: 72327 5685 348 364 0 8242 0
[pid=32149] ppid=32147 vsize=1017940 CPUtime=0.86 cores=0,2,4,6
/proc/32149/stat : 32149 (gnovelty+2) R 32147 32149 32149 0 -1 4202496 455 0 0 0 86 0 0 0 23 0 1 0 658077123 1042370560 192 33554432000 134512640 135663704 4288097936 18446744073709551615 134525213 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/32149/statm: 254485 192 113 282 0 254201 0
[pid=32150] ppid=32138 vsize=299056 CPUtime=0 cores=0,2,4,6
/proc/32150/stat : 32150 (python) S 32138 32138 30970 0 -1 4202560 756 0 0 0 0 0 0 0 15 0 1 0 658077124 306233344 5577 33554432000 4194304 5683644 140735136629312 18446744073709551615 255377321542 0 0 16781312 514 8128451973931303168 0 0 17 4 0 0 0
/proc/32150/statm: 74764 5577 348 364 0 10676 0
[pid=32152] ppid=32150 vsize=2240 CPUtime=0.85 cores=0,2,4,6
/proc/32152/stat : 32152 (march_hi) R 32150 32152 32152 0 -1 4202496 634 0 0 0 85 0 0 0 22 0 1 0 658077124 2293760 369 33554432000 4194304 4955518 140733473444336 18446744073709551615 4224450 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/32152/statm: 560 369 106 186 0 373 0
[pid=32153] ppid=32138 vsize=309920 CPUtime=0 cores=0,2,4,6
/proc/32153/stat : 32153 (python) S 32138 32138 30970 0 -1 4202560 758 0 0 0 0 0 0 0 15 0 1 0 658077125 317358080 5701 33554432000 4194304 5683644 140735136629312 18446744073709551615 255377321542 0 0 16781312 514 16202829961713647876 0 0 17 4 0 0 0
/proc/32153/statm: 77480 5701 348 364 0 13389 0
[pid=32155] ppid=32153 vsize=1992 CPUtime=0.38 cores=0,2,4,6
/proc/32155/stat : 32155 (march_hi) R 32153 32155 32155 0 -1 4202496 576 0 0 0 38 0 0 0 24 0 1 0 658077125 2039808 307 33554432000 4194304 4955518 140735924085792 18446744073709551615 4208656 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/32155/statm: 498 307 106 186 0 311 0
[pid=32138/tid=32145] ppid=32136 vsize=320164 CPUtime=0 cores=0,2,4,6
/proc/32138/task/32145/stat : 32145 (python) S 32136 32138 30970 0 -1 4202560 26 933 0 0 0 0 0 0 21 0 5 0 658077122 327847936 7230 33554432000 4194304 5683644 140735136629312 18446744073709551615 255389125041 0 0 16781312 2 18446604440278456128 0 0 -1 2 0 0 0
[pid=32138/tid=32148] ppid=32136 vsize=320164 CPUtime=0 cores=0,2,4,6
/proc/32138/task/32148/stat : 32148 (python) S 32136 32138 30970 0 -1 4202560 25 933 0 0 0 0 0 0 20 0 5 0 658077123 327847936 7230 33554432000 4194304 5683644 140735136629312 18446744073709551615 255389125041 0 0 16781312 2 18446604440278456128 0 0 -1 6 0 0 0
[pid=32138/tid=32151] ppid=32136 vsize=320164 CPUtime=0 cores=0,2,4,6
/proc/32138/task/32151/stat : 32151 (python) S 32136 32138 30970 0 -1 4202560 26 933 0 0 0 0 0 0 20 0 5 0 658077124 327847936 7230 33554432000 4194304 5683644 140735136629312 18446744073709551615 255389125041 0 0 16781312 2 18446604440278456128 0 0 -1 4 0 0 0
[pid=32138/tid=32154] ppid=32136 vsize=320164 CPUtime=0 cores=0,2,4,6
/proc/32138/task/32154/stat : 32154 (python) S 32136 32138 30970 0 -1 4202560 30 933 0 0 0 0 0 0 22 0 5 0 658077125 327847936 7230 33554432000 4194304 5683644 140735136629312 18446744073709551615 255389125041 0 0 16781312 2 18446604440278456128 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3.12
Current children cumulated vsize (KiB) 3537240

[startup+3.10105 s]
/proc/loadavg: 8.12 8.27 7.72 10/369 32155
/proc/meminfo: memFree=11145624/32951124 swapFree=66050672/67111528
[pid=32138] ppid=32136 vsize=320164 CPUtime=0.53 cores=0,2,4,6
/proc/32138/stat : 32138 (python) S 32136 32138 30970 0 -1 4202496 12350 933 1 0 43 10 0 0 22 0 5 0 658077061 327847936 7230 33554432000 4194304 5683644 140735136629312 18446744073709551615 255389128139 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/32138/statm: 80041 7230 1873 364 0 15950 0
[pid=32144] ppid=32138 vsize=278680 CPUtime=0 cores=0,2,4,6
/proc/32144/stat : 32144 (python) S 32138 32138 30970 0 -1 4202560 739 0 0 0 0 0 0 0 18 0 1 0 658077122 285368320 5589 33554432000 4194304 5683644 140735136629312 18446744073709551615 255377321487 0 0 16781312 514 7151865746140659968 0 0 17 6 0 0 0
/proc/32144/statm: 69670 5589 354 364 0 5588 0
[pid=32146] ppid=32144 vsize=1017940 CPUtime=1.3 cores=0,2,4,6
/proc/32146/stat : 32146 (gnovelty+2) R 32144 32146 32146 0 -1 4202496 454 0 0 0 130 0 0 0 25 0 1 0 658077122 1042370560 191 33554432000 134512640 135663704 4287337040 18446744073709551615 134525237 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/32146/statm: 254485 191 113 282 0 254201 0
[pid=32147] ppid=32138 vsize=289308 CPUtime=0 cores=0,2,4,6
/proc/32147/stat : 32147 (python) S 32138 32138 30970 0 -1 4202560 735 0 0 0 0 0 0 0 18 0 1 0 658077123 296251392 5685 33554432000 4194304 5683644 140735136629312 18446744073709551615 255377321542 0 0 16781312 514 15369171724318769409 0 0 17 4 0 0 0
/proc/32147/statm: 72327 5685 348 364 0 8242 0
[pid=32149] ppid=32147 vsize=1017940 CPUtime=2.45 cores=0,2,4,6
/proc/32149/stat : 32149 (gnovelty+2) R 32147 32149 32149 0 -1 4202496 455 0 0 0 245 0 0 0 25 0 1 0 658077123 1042370560 192 33554432000 134512640 135663704 4288097936 18446744073709551615 134525278 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/32149/statm: 254485 192 113 282 0 254201 0
[pid=32150] ppid=32138 vsize=299056 CPUtime=0 cores=0,2,4,6
/proc/32150/stat : 32150 (python) S 32138 32138 30970 0 -1 4202560 760 0 0 0 0 0 0 0 15 0 1 0 658077124 306233344 5577 33554432000 4194304 5683644 140735136629312 18446744073709551615 255377321542 0 0 16781312 514 8128451973931303168 0 0 17 4 0 0 0
/proc/32150/statm: 74764 5577 348 364 0 10676 0
[pid=32152] ppid=32150 vsize=2620 CPUtime=2.45 cores=0,2,4,6
/proc/32152/stat : 32152 (march_hi) R 32150 32152 32152 0 -1 4202496 730 0 0 0 245 0 0 0 25 0 1 0 658077124 2682880 465 33554432000 4194304 4955518 140733473444336 18446744073709551615 4226557 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/32152/statm: 655 465 106 186 0 468 0
[pid=32153] ppid=32138 vsize=309920 CPUtime=0 cores=0,2,4,6
/proc/32153/stat : 32153 (python) S 32138 32138 30970 0 -1 4202560 759 0 0 0 0 0 0 0 15 0 1 0 658077125 317358080 5701 33554432000 4194304 5683644 140735136629312 18446744073709551615 255377321542 0 0 16781312 514 2949092775007584516 0 0 17 4 0 0 0
/proc/32153/statm: 77480 5701 348 364 0 13389 0
[pid=32155] ppid=32153 vsize=2240 CPUtime=1.18 cores=0,2,4,6
/proc/32155/stat : 32155 (march_hi) R 32153 32155 32155 0 -1 4202496 658 0 0 0 118 0 0 0 25 0 1 0 658077125 2293760 388 33554432000 4194304 4955518 140735924085792 18446744073709551615 4297483 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/32155/statm: 560 388 106 186 0 373 0
[pid=32138/tid=32145] ppid=32136 vsize=320164 CPUtime=0 cores=0,2,4,6
/proc/32138/task/32145/stat : 32145 (python) S 32136 32138 30970 0 -1 4202560 26 933 0 0 0 0 0 0 21 0 5 0 658077122 327847936 7230 33554432000 4194304 5683644 140735136629312 18446744073709551615 255389125041 0 0 16781312 2 18446604440278456128 0 0 -1 2 0 0 0
[pid=32138/tid=32148] ppid=32136 vsize=320164 CPUtime=0 cores=0,2,4,6
/proc/32138/task/32148/stat : 32148 (python) S 32136 32138 30970 0 -1 4202560 25 933 0 0 0 0 0 0 20 0 5 0 658077123 327847936 7230 33554432000 4194304 5683644 140735136629312 18446744073709551615 255389125041 0 0 16781312 2 18446604440278456128 0 0 -1 6 0 0 0
[pid=32138/tid=32151] ppid=32136 vsize=320164 CPUtime=0 cores=0,2,4,6
/proc/32138/task/32151/stat : 32151 (python) S 32136 32138 30970 0 -1 4202560 26 933 0 0 0 0 0 0 20 0 5 0 658077124 327847936 7230 33554432000 4194304 5683644 140735136629312 18446744073709551615 255389125041 0 0 16781312 2 18446604440278456128 0 0 -1 4 0 0 0
[pid=32138/tid=32154] ppid=32136 vsize=320164 CPUtime=0 cores=0,2,4,6
/proc/32138/task/32154/stat : 32154 (python) S 32136 32138 30970 0 -1 4202560 30 933 0 0 0 0 0 0 22 0 5 0 658077125 327847936 7230 33554432000 4194304 5683644 140735136629312 18446744073709551615 255389125041 0 0 16781312 2 18446604440278456128 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 7.91
Current children cumulated vsize (KiB) 3537868

[startup+6.30046 s]
/proc/loadavg: 8.12 8.27 7.72 10/369 32155
/proc/meminfo: memFree=11140872/32951124 swapFree=66050672/67111528
[pid=32138] ppid=32136 vsize=320164 CPUtime=0.53 cores=0,2,4,6
/proc/32138/stat : 32138 (python) S 32136 32138 30970 0 -1 4202496 12350 933 1 0 43 10 0 0 22 0 5 0 658077061 327847936 7230 33554432000 4194304 5683644 140735136629312 18446744073709551615 255389128139 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/32138/statm: 80041 7230 1873 364 0 15950 0
[pid=32144] ppid=32138 vsize=278680 CPUtime=0 cores=0,2,4,6
/proc/32144/stat : 32144 (python) S 32138 32138 30970 0 -1 4202560 904 0 0 0 0 0 0 0 18 0 1 0 658077122 285368320 5612 33554432000 4194304 5683644 140735136629312 18446744073709551615 255377321487 0 0 16781312 514 7151865746140659968 0 0 17 6 0 0 0
/proc/32144/statm: 69670 5612 377 364 0 5588 0
[pid=32146] ppid=32144 vsize=1017940 CPUtime=2.89 cores=0,2,4,6
/proc/32146/stat : 32146 (gnovelty+2) R 32144 32146 32146 0 -1 4202496 454 0 0 0 289 0 0 0 25 0 1 0 658077122 1042370560 191 33554432000 134512640 135663704 4287337040 18446744073709551615 134544186 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/32146/statm: 254485 191 113 282 0 254201 0
[pid=32147] ppid=32138 vsize=289308 CPUtime=0 cores=0,2,4,6
/proc/32147/stat : 32147 (python) S 32138 32138 30970 0 -1 4202560 900 0 0 0 0 0 0 0 18 0 1 0 658077123 296251392 5708 33554432000 4194304 5683644 140735136629312 18446744073709551615 255377321542 0 0 16781312 514 15369171724318769409 0 0 17 4 0 0 0
/proc/32147/statm: 72327 5708 371 364 0 8242 0
[pid=32149] ppid=32147 vsize=1017940 CPUtime=5.59 cores=0,2,4,6
/proc/32149/stat : 32149 (gnovelty+2) R 32147 32149 32149 0 -1 4202496 455 0 0 0 559 0 0 0 25 0 1 0 658077123 1042370560 192 33554432000 134512640 135663704 4288097936 18446744073709551615 134524561 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/32149/statm: 254485 192 113 282 0 254201 0
[pid=32150] ppid=32138 vsize=299056 CPUtime=0.01 cores=0,2,4,6
/proc/32150/stat : 32150 (python) S 32138 32138 30970 0 -1 4202560 911 0 0 0 0 1 0 0 15 0 1 0 658077124 306233344 5600 33554432000 4194304 5683644 140735136629312 18446744073709551615 255377321542 0 0 16781312 514 8128451973931303168 0 0 17 4 0 0 0
/proc/32150/statm: 74764 5600 371 364 0 10676 0
[pid=32152] ppid=32150 vsize=3472 CPUtime=5.59 cores=0,2,4,6
/proc/32152/stat : 32152 (march_hi) R 32150 32152 32152 0 -1 4202496 916 0 0 0 559 0 0 0 25 0 1 0 658077124 3555328 651 33554432000 4194304 4955518 140733473444336 18446744073709551615 4297472 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/32152/statm: 868 651 106 186 0 681 0
[pid=32153] ppid=32138 vsize=309920 CPUtime=0 cores=0,2,4,6
/proc/32153/stat : 32153 (python) S 32138 32138 30970 0 -1 4202560 919 0 0 0 0 0 0 0 15 0 1 0 658077125 317358080 5724 33554432000 4194304 5683644 140735136629312 18446744073709551615 255377321542 0 0 16781312 514 16202829961713647876 0 0 17 4 0 0 0
/proc/32153/statm: 77480 5724 371 364 0 13389 0
[pid=32155] ppid=32153 vsize=2620 CPUtime=2.76 cores=0,2,4,6
/proc/32155/stat : 32155 (march_hi) R 32153 32155 32155 0 -1 4202496 755 0 0 0 276 0 0 0 25 0 1 0 658077125 2682880 485 33554432000 4194304 4955518 140735924085792 18446744073709551615 4297337 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/32155/statm: 655 485 106 186 0 468 0
[pid=32138/tid=32145] ppid=32136 vsize=320164 CPUtime=0 cores=0,2,4,6
/proc/32138/task/32145/stat : 32145 (python) S 32136 32138 30970 0 -1 4202560 26 933 0 0 0 0 0 0 21 0 5 0 658077122 327847936 7230 33554432000 4194304 5683644 140735136629312 18446744073709551615 255389125041 0 0 16781312 2 18446604440278456128 0 0 -1 2 0 0 0
[pid=32138/tid=32148] ppid=32136 vsize=320164 CPUtime=0 cores=0,2,4,6
/proc/32138/task/32148/stat : 32148 (python) S 32136 32138 30970 0 -1 4202560 25 933 0 0 0 0 0 0 20 0 5 0 658077123 327847936 7230 33554432000 4194304 5683644 140735136629312 18446744073709551615 255389125041 0 0 16781312 2 18446604440278456128 0 0 -1 6 0 0 0
[pid=32138/tid=32151] ppid=32136 vsize=320164 CPUtime=0 cores=0,2,4,6
/proc/32138/task/32151/stat : 32151 (python) S 32136 32138 30970 0 -1 4202560 26 933 0 0 0 0 0 0 20 0 5 0 658077124 327847936 7230 33554432000 4194304 5683644 140735136629312 18446744073709551615 255389125041 0 0 16781312 2 18446604440278456128 0 0 -1 4 0 0 0
[pid=32138/tid=32154] ppid=32136 vsize=320164 CPUtime=0 cores=0,2,4,6
/proc/32138/task/32154/stat : 32154 (python) S 32136 32138 30970 0 -1 4202560 30 933 0 0 0 0 0 0 22 0 5 0 658077125 327847936 7230 33554432000 4194304 5683644 140735136629312 18446744073709551615 255389125041 0 0 16781312 2 18446604440278456128 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 17.37
Current children cumulated vsize (KiB) 3539100

[startup+12.7013 s]
/proc/loadavg: 8.26 8.30 7.73 10/369 32155
/proc/meminfo: memFree=11137184/32951124 swapFree=66050672/67111528
[pid=32138] ppid=32136 vsize=320164 CPUtime=0.53 cores=0,2,4,6
/proc/32138/stat : 32138 (python) S 32136 32138 30970 0 -1 4202496 12350 933 1 0 43 10 0 0 22 0 5 0 658077061 327847936 7230 33554432000 4194304 5683644 140735136629312 18446744073709551615 255389128139 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/32138/statm: 80041 7230 1873 364 0 15950 0
[pid=32144] ppid=32138 vsize=278680 CPUtime=0.02 cores=0,2,4,6
/proc/32144/stat : 32144 (python) S 32138 32138 30970 0 -1 4202560 908 0 0 0 1 1 0 0 18 0 1 0 658077122 285368320 5612 33554432000 4194304 5683644 140735136629312 18446744073709551615 255377321487 0 0 16781312 514 7777241567445614848 0 0 17 6 0 0 0
/proc/32144/statm: 69670 5612 377 364 0 5588 0
[pid=32146] ppid=32144 vsize=1017940 CPUtime=6.09 cores=0,2,4,6
/proc/32146/stat : 32146 (gnovelty+2) R 32144 32146 32146 0 -1 4202496 454 0 0 0 609 0 0 0 25 0 1 0 658077122 1042370560 191 33554432000 134512640 135663704 4287337040 18446744073709551615 134524888 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/32146/statm: 254485 191 113 282 0 254201 0
[pid=32147] ppid=32138 vsize=289308 CPUtime=0.02 cores=0,2,4,6

################
# More data... #
################

[pid=32147/tid=32167] ppid=32138 vsize=289308 CPUtime=0 cores=0,2,4,6
/proc/32147/task/32167/stat : 32167 (python) S 32138 32138 30970 0 -1 4202560 51 0 0 0 0 0 0 0 19 0 2 0 658087150 296251392 5738 33554432000 4194304 5683644 140735136629312 18446744073709551615 255389125041 0 0 16781312 514 18446604443606205504 0 0 -1 4 0 0 0
[pid=32150] ppid=32138 vsize=299056 CPUtime=3.11 cores=0,2,4,6
/proc/32150/stat : 32150 (python) S 32138 32138 30970 0 -1 4202560 1157 0 0 0 164 147 0 0 16 0 2 0 658077124 306233344 5630 33554432000 4194304 5683644 140735136629312 18446744073709551615 255377321542 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/32150/statm: 74764 5630 400 364 0 10676 0
[pid=32152] ppid=32150 vsize=208508 CPUtime=939.79 cores=0,2,4,6
/proc/32152/stat : 32152 (march_hi) R 32150 32152 32152 0 -1 4202496 44387 0 0 0 93969 10 0 0 25 0 1 0 658077124 213512192 44122 33554432000 4194304 4955518 140733473444336 18446744073709551615 4244738 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/32152/statm: 52127 44122 106 186 0 51940 0
[pid=32150/tid=32206] ppid=32138 vsize=299056 CPUtime=0 cores=0,2,4,6
/proc/32150/task/32206/stat : 32206 (python) S 32138 32138 30970 0 -1 4202560 46 0 0 0 0 0 0 0 16 0 2 0 658154293 306233344 5630 33554432000 4194304 5683644 140735136629312 18446744073709551615 255389125041 0 0 16781312 514 18446604437397998464 0 0 -1 4 0 0 0
[pid=32153] ppid=32138 vsize=309920 CPUtime=3.08 cores=0,2,4,6
/proc/32153/stat : 32153 (python) S 32138 32138 30970 0 -1 4202560 1158 0 0 0 167 141 0 0 15 0 2 0 658077125 317358080 5754 33554432000 4194304 5683644 140735136629312 18446744073709551615 255377321542 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/32153/statm: 77480 5754 400 364 0 13389 0
[pid=32155] ppid=32153 vsize=208508 CPUtime=855.48 cores=0,2,4,6
/proc/32155/stat : 32155 (march_hi) R 32153 32155 32155 0 -1 4202496 40445 0 0 0 85539 9 0 0 25 0 1 0 658077125 213512192 40175 33554432000 4194304 4955518 140735924085792 18446744073709551615 4296845 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/32155/statm: 52127 40175 106 186 0 51940 0
[pid=32153/tid=32188] ppid=32138 vsize=309920 CPUtime=0 cores=0,2,4,6
/proc/32153/task/32188/stat : 32188 (python) S 32138 32138 30970 0 -1 4202560 46 0 0 0 0 0 0 0 15 0 2 0 658121306 317358080 5754 33554432000 4194304 5683644 140735136629312 18446744073709551615 255389125041 0 0 16781312 514 18446604436419463232 0 0 -1 2 0 0 0
[pid=32168] ppid=32138 vsize=320176 CPUtime=2.82 cores=0,2,4,6
/proc/32168/stat : 32168 (python) S 32138 32138 30970 0 -1 4202560 1160 0 0 0 152 130 0 0 15 0 2 0 658087151 327860224 5758 33554432000 4194304 5683644 140735136629312 18446744073709551615 255377321542 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/32168/statm: 80044 5758 400 364 0 15950 0
[pid=32170] ppid=32168 vsize=142208 CPUtime=680.7 cores=0,2,4,6
/proc/32170/stat : 32170 (march_hi) R 32168 32170 32170 0 -1 4202496 32771 0 0 0 68062 8 0 0 25 0 1 0 658087151 145620992 32502 33554432000 4194304 4955518 140733854295424 18446744073709551615 4208724 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/32170/statm: 35552 32502 106 186 0 35365 0
[pid=32168/tid=32214] ppid=32138 vsize=320176 CPUtime=0 cores=0,2,4,6
/proc/32168/task/32214/stat : 32214 (python) S 32138 32138 30970 0 -1 4202560 46 0 0 0 0 0 0 0 16 0 2 0 658171650 327860224 5758 33554432000 4194304 5683644 140735136629312 18446744073709551615 255389125041 0 0 16781312 514 18446604448118698048 0 0 -1 4 0 0 0
[pid=32173] ppid=32138 vsize=329908 CPUtime=2.7 cores=0,2,4,6
/proc/32173/stat : 32173 (python) S 32138 32138 30970 0 -1 4202560 1152 0 0 0 147 123 0 0 15 0 2 0 658092462 337825792 5663 33554432000 4194304 5683644 140735136629312 18446744073709551615 255377321542 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/32173/statm: 82477 5663 400 364 0 18380 0
[pid=32175] ppid=32173 vsize=208508 CPUtime=757.99 cores=0,2,4,6
/proc/32175/stat : 32175 (march_hi) R 32173 32175 32175 0 -1 4202496 36385 0 0 0 75788 11 0 0 25 0 1 0 658092462 213512192 36119 33554432000 4194304 4955518 140734105722048 18446744073709551615 4314840 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/32175/statm: 52127 36119 106 186 0 51940 0
[pid=32173/tid=32210] ppid=32138 vsize=329908 CPUtime=0 cores=0,2,4,6
/proc/32173/task/32210/stat : 32210 (python) S 32138 32138 30970 0 -1 4202560 45 0 0 0 0 0 0 0 16 0 2 0 658163673 337825792 5663 33554432000 4194304 5683644 140735136629312 18446744073709551615 255389125041 0 0 16781312 514 18446604438724700992 0 0 -1 4 0 0 0
[pid=32138/tid=32145] ppid=32136 vsize=340776 CPUtime=0 cores=0,2,4,6
/proc/32138/task/32145/stat : 32145 (python) S 32136 32138 30970 0 -1 4202560 26 933 0 0 0 0 0 0 21 0 7 0 658077122 348954624 7293 33554432000 4194304 5683644 140735136629312 18446744073709551615 255389125041 0 0 16781312 2 18446604440278456128 0 0 -1 2 0 0 0
[pid=32138/tid=32148] ppid=32136 vsize=340776 CPUtime=0 cores=0,2,4,6
/proc/32138/task/32148/stat : 32148 (python) S 32136 32138 30970 0 -1 4202560 25 933 0 0 0 0 0 0 20 0 7 0 658077123 348954624 7293 33554432000 4194304 5683644 140735136629312 18446744073709551615 255389125041 0 0 16781312 2 18446604440278456128 0 0 -1 6 0 0 0
[pid=32138/tid=32151] ppid=32136 vsize=340776 CPUtime=0 cores=0,2,4,6
/proc/32138/task/32151/stat : 32151 (python) S 32136 32138 30970 0 -1 4202560 30 933 0 0 0 0 0 0 18 0 7 0 658077124 348954624 7293 33554432000 4194304 5683644 140735136629312 18446744073709551615 255389125041 0 0 16781312 2 18446604440278456128 0 0 -1 4 0 0 0
[pid=32138/tid=32154] ppid=32136 vsize=340776 CPUtime=0 cores=0,2,4,6
/proc/32138/task/32154/stat : 32154 (python) S 32136 32138 30970 0 -1 4202560 35 933 0 0 0 0 0 0 18 0 7 0 658077125 348954624 7293 33554432000 4194304 5683644 140735136629312 18446744073709551615 255389125041 0 0 16781312 2 18446604440278456128 0 0 -1 4 0 0 0
[pid=32138/tid=32169] ppid=32136 vsize=340776 CPUtime=0 cores=0,2,4,6
/proc/32138/task/32169/stat : 32169 (python) S 32136 32138 30970 0 -1 4202560 27 933 0 0 0 0 0 0 18 0 7 0 658087151 348954624 7293 33554432000 4194304 5683644 140735136629312 18446744073709551615 255389125041 0 0 16781312 2 18446604440278456128 0 0 -1 4 0 0 0
[pid=32138/tid=32174] ppid=32136 vsize=340776 CPUtime=0 cores=0,2,4,6
/proc/32138/task/32174/stat : 32174 (python) S 32136 32138 30970 0 -1 4202560 28 933 0 0 0 0 0 0 18 0 7 0 658092462 348954624 7293 33554432000 4194304 5683644 140735136629312 18446744073709551615 255389125041 0 0 16781312 2 18446604440278456128 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3448.33
Current children cumulated vsize (KiB) 4981680

[startup+1138.3 s]
/proc/loadavg: 9.37 9.27 8.78 7/369 32246
/proc/meminfo: memFree=10576804/32951124 swapFree=66050672/67111528
[pid=32138] ppid=32136 vsize=340776 CPUtime=0.58 cores=0,2,4,6
/proc/32138/stat : 32138 (python) S 32136 32138 30970 0 -1 4202496 14602 933 1 0 48 10 0 0 18 0 7 0 658077061 348954624 7293 33554432000 4194304 5683644 140735136629312 18446744073709551615 255389128139 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/32138/statm: 85194 7293 1878 364 0 21097 0
[pid=32144] ppid=32138 vsize=288924 CPUtime=0.39 cores=0,2,4,6
/proc/32144/stat : 32144 (python) S 32138 32138 30970 0 -1 4202560 1193 0 0 0 20 19 0 0 19 0 2 0 658077122 295858176 5656 33554432000 4194304 5683644 140735136629312 18446744073709551615 255389128139 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/32144/statm: 72231 5656 416 364 0 8149 0
[pid=32146] ppid=32144 vsize=1017940 CPUtime=102.55 cores=0,2,4,6
/proc/32146/stat : 32146 (gnovelty+2) T 32144 32146 32146 0 -1 4202496 454 0 0 0 10255 0 0 0 25 0 1 0 658077122 1042370560 191 33554432000 134512640 135663704 4287337040 18446744073709551615 134525691 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/32146/statm: 254485 191 113 282 0 254201 0
[pid=32144/tid=32172] ppid=32138 vsize=288924 CPUtime=0 cores=0,2,4,6
/proc/32144/task/32172/stat : 32172 (python) S 32138 32138 30970 0 -1 4202560 44 0 0 0 0 0 0 0 19 0 2 0 658092461 295858176 5656 33554432000 4194304 5683644 140735136629312 18446744073709551615 255389125041 0 0 16781312 514 18446604437397997568 0 0 -1 6 0 0 0
[pid=32147] ppid=32138 vsize=289308 CPUtime=0.24 cores=0,2,4,6
/proc/32147/stat : 32147 (python) S 32138 32138 30970 0 -1 4202560 1097 0 0 0 15 9 0 0 19 0 2 0 658077123 296251392 5738 33554432000 4194304 5683644 140735136629312 18446744073709551615 255389128139 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/32147/statm: 72327 5738 400 364 0 8242 0
[pid=32149] ppid=32147 vsize=1017940 CPUtime=98.9 cores=0,2,4,6
/proc/32149/stat : 32149 (gnovelty+2) T 32147 32149 32149 0 -1 4202496 455 0 0 0 9890 0 0 0 25 0 1 0 658077123 1042370560 192 33554432000 134512640 135663704 4288097936 18446744073709551615 134524507 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/32149/statm: 254485 192 113 282 0 254201 0
[pid=32147/tid=32167] ppid=32138 vsize=289308 CPUtime=0 cores=0,2,4,6
/proc/32147/task/32167/stat : 32167 (python) S 32138 32138 30970 0 -1 4202560 51 0 0 0 0 0 0 0 19 0 2 0 658087150 296251392 5738 33554432000 4194304 5683644 140735136629312 18446744073709551615 255389125041 0 0 16781312 514 18446604443606205504 0 0 -1 4 0 0 0
[pid=32150] ppid=32138 vsize=299056 CPUtime=3.11 cores=0,2,4,6
/proc/32150/stat : 32150 (python) S 32138 32138 30970 0 -1 4202560 1157 0 0 0 164 147 0 0 15 0 2 0 658077124 306233344 5630 33554432000 4194304 5683644 140735136629312 18446744073709551615 255377321542 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/32150/statm: 74764 5630 400 364 0 10676 0
[pid=32152] ppid=32150 vsize=208508 CPUtime=940.19 cores=0,2,4,6
/proc/32152/stat : 32152 (march_hi) R 32150 32152 32152 0 -1 4202496 44409 0 0 0 94009 10 0 0 25 0 1 0 658077124 213512192 44144 33554432000 4194304 4955518 140733473444336 18446744073709551615 4206520 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/32152/statm: 52127 44144 106 186 0 51940 0
[pid=32150/tid=32206] ppid=32138 vsize=299056 CPUtime=0 cores=0,2,4,6
/proc/32150/task/32206/stat : 32206 (python) S 32138 32138 30970 0 -1 4202560 46 0 0 0 0 0 0 0 16 0 2 0 658154293 306233344 5630 33554432000 4194304 5683644 140735136629312 18446744073709551615 255389125041 0 0 16781312 514 18446604437397998464 0 0 -1 4 0 0 0
[pid=32153] ppid=32138 vsize=309920 CPUtime=3.08 cores=0,2,4,6
/proc/32153/stat : 32153 (python) S 32138 32138 30970 0 -1 4202560 1158 0 0 0 167 141 0 0 15 0 2 0 658077125 317358080 5754 33554432000 4194304 5683644 140735136629312 18446744073709551615 255377321542 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/32153/statm: 77480 5754 400 364 0 13389 0
[pid=32155] ppid=32153 vsize=208508 CPUtime=855.68 cores=0,2,4,6
/proc/32155/stat : 32155 (march_hi) R 32153 32155 32155 0 -1 4202496 40456 0 0 0 85559 9 0 0 25 0 1 0 658077125 213512192 40186 33554432000 4194304 4955518 140735924085792 18446744073709551615 4208669 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/32155/statm: 52127 40186 106 186 0 51940 0
[pid=32153/tid=32188] ppid=32138 vsize=309920 CPUtime=0 cores=0,2,4,6
/proc/32153/task/32188/stat : 32188 (python) S 32138 32138 30970 0 -1 4202560 46 0 0 0 0 0 0 0 15 0 2 0 658121306 317358080 5754 33554432000 4194304 5683644 140735136629312 18446744073709551615 255389125041 0 0 16781312 514 18446604436419463232 0 0 -1 2 0 0 0
[pid=32168] ppid=32138 vsize=320176 CPUtime=2.82 cores=0,2,4,6
/proc/32168/stat : 32168 (python) R 32138 32138 30970 0 -1 4202560 1160 0 0 0 152 130 0 0 15 0 2 0 658087151 327860224 5758 33554432000 4194304 5683644 140735136629312 18446744073709551615 255377344602 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/32168/statm: 80044 5758 400 364 0 15950 0
[pid=32170] ppid=32168 vsize=142208 CPUtime=680.9 cores=0,2,4,6
/proc/32170/stat : 32170 (march_hi) R 32168 32170 32170 0 -1 4202496 32777 0 0 0 68082 8 0 0 25 0 1 0 658087151 145620992 32508 33554432000 4194304 4955518 140733854295424 18446744073709551615 4285880 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/32170/statm: 35552 32508 106 186 0 35365 0
[pid=32168/tid=32214] ppid=32138 vsize=320176 CPUtime=0 cores=0,2,4,6
/proc/32168/task/32214/stat : 32214 (python) S 32138 32138 30970 0 -1 4202560 46 0 0 0 0 0 0 0 16 0 2 0 658171650 327860224 5758 33554432000 4194304 5683644 140735136629312 18446744073709551615 255389125041 0 0 16781312 514 18446604448118698048 0 0 -1 4 0 0 0
[pid=32173] ppid=32138 vsize=329908 CPUtime=2.71 cores=0,2,4,6
/proc/32173/stat : 32173 (python) S 32138 32138 30970 0 -1 4202560 1152 0 0 0 147 124 0 0 15 0 2 0 658092462 337825792 5663 33554432000 4194304 5683644 140735136629312 18446744073709551615 255377321542 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/32173/statm: 82477 5663 400 364 0 18380 0
[pid=32175] ppid=32173 vsize=208508 CPUtime=758.38 cores=0,2,4,6
/proc/32175/stat : 32175 (march_hi) R 32173 32175 32175 0 -1 4202496 36406 0 0 0 75827 11 0 0 25 0 1 0 658092462 213512192 36140 33554432000 4194304 4955518 140734105722048 18446744073709551615 4208576 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/32175/statm: 52127 36140 106 186 0 51940 0
[pid=32173/tid=32210] ppid=32138 vsize=329908 CPUtime=0 cores=0,2,4,6
/proc/32173/task/32210/stat : 32210 (python) S 32138 32138 30970 0 -1 4202560 45 0 0 0 0 0 0 0 16 0 2 0 658163673 337825792 5663 33554432000 4194304 5683644 140735136629312 18446744073709551615 255389125041 0 0 16781312 514 18446604438724700992 0 0 -1 4 0 0 0
[pid=32138/tid=32145] ppid=32136 vsize=340776 CPUtime=0 cores=0,2,4,6
/proc/32138/task/32145/stat : 32145 (python) S 32136 32138 30970 0 -1 4202560 26 933 0 0 0 0 0 0 21 0 7 0 658077122 348954624 7293 33554432000 4194304 5683644 140735136629312 18446744073709551615 255389125041 0 0 16781312 2 18446604440278456128 0 0 -1 2 0 0 0
[pid=32138/tid=32148] ppid=32136 vsize=340776 CPUtime=0 cores=0,2,4,6
/proc/32138/task/32148/stat : 32148 (python) S 32136 32138 30970 0 -1 4202560 25 933 0 0 0 0 0 0 20 0 7 0 658077123 348954624 7293 33554432000 4194304 5683644 140735136629312 18446744073709551615 255389125041 0 0 16781312 2 18446604440278456128 0 0 -1 6 0 0 0
[pid=32138/tid=32151] ppid=32136 vsize=340776 CPUtime=0 cores=0,2,4,6
/proc/32138/task/32151/stat : 32151 (python) S 32136 32138 30970 0 -1 4202560 30 933 0 0 0 0 0 0 18 0 7 0 658077124 348954624 7293 33554432000 4194304 5683644 140735136629312 18446744073709551615 255389125041 0 0 16781312 2 18446604440278456128 0 0 -1 4 0 0 0
[pid=32138/tid=32154] ppid=32136 vsize=340776 CPUtime=0 cores=0,2,4,6
/proc/32138/task/32154/stat : 32154 (python) S 32136 32138 30970 0 -1 4202560 35 933 0 0 0 0 0 0 18 0 7 0 658077125 348954624 7293 33554432000 4194304 5683644 140735136629312 18446744073709551615 255389125041 0 0 16781312 2 18446604440278456128 0 0 -1 4 0 0 0
[pid=32138/tid=32169] ppid=32136 vsize=340776 CPUtime=0 cores=0,2,4,6
/proc/32138/task/32169/stat : 32169 (python) S 32136 32138 30970 0 -1 4202560 27 933 0 0 0 0 0 0 18 0 7 0 658087151 348954624 7293 33554432000 4194304 5683644 140735136629312 18446744073709551615 255389125041 0 0 16781312 2 18446604440278456128 0 0 -1 4 0 0 0
[pid=32138/tid=32174] ppid=32136 vsize=340776 CPUtime=0 cores=0,2,4,6
/proc/32138/task/32174/stat : 32174 (python) S 32136 32138 30970 0 -1 4202560 28 933 0 0 0 0 0 0 18 0 7 0 658092462 348954624 7293 33554432000 4194304 5683644 140735136629312 18446744073709551615 255389125041 0 0 16781312 2 18446604440278456128 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3449.53
Current children cumulated vsize (KiB) 4981680

[startup+1138.4 s]
/proc/loadavg: 9.37 9.27 8.78 10/375 32262
/proc/meminfo: memFree=10553440/32951124 swapFree=66050672/67111528
[pid=32138] ppid=32136 vsize=340776 CPUtime=202.72 cores=0,2,4,6
/proc/32138/stat : 32138 (python) S 32136 32138 30970 0 -1 4202496 14613 4180 1 0 49 10 20183 30 17 0 7 0 658077061 348954624 7293 33554432000 4194304 5683644 140735136629312 18446744073709551615 255389131583 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/32138/statm: 85194 7293 1878 364 0 21097 0
[pid=32150] ppid=32138 vsize=299056 CPUtime=3.11 cores=0,2,4,6
/proc/32150/stat : 32150 (python) S 32138 32138 30970 0 -1 4202560 1157 0 0 0 164 147 0 0 15 0 2 0 658077124 306233344 5630 33554432000 4194304 5683644 140735136629312 18446744073709551615 255377321542 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/32150/statm: 74764 5630 400 364 0 10676 0
[pid=32152] ppid=32150 vsize=208508 CPUtime=940.3 cores=0,2,4,6
/proc/32152/stat : 32152 (march_hi) R 32150 32152 32152 0 -1 4202496 44413 0 0 0 94020 10 0 0 25 0 1 0 658077124 213512192 44148 33554432000 4194304 4955518 140733473444336 18446744073709551615 4297056 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/32152/statm: 52127 44148 106 186 0 51940 0
[pid=32150/tid=32206] ppid=32138 vsize=299056 CPUtime=0 cores=0,2,4,6
/proc/32150/task/32206/stat : 32206 (python) S 32138 32138 30970 0 -1 4202560 46 0 0 0 0 0 0 0 16 0 2 0 658154293 306233344 5630 33554432000 4194304 5683644 140735136629312 18446744073709551615 255389125041 0 0 16781312 514 18446604437397998464 0 0 -1 4 0 0 0
[pid=32153] ppid=32138 vsize=309920 CPUtime=3.08 cores=0,2,4,6
/proc/32153/stat : 32153 (python) S 32138 32138 30970 0 -1 4202560 1158 0 0 0 167 141 0 0 15 0 2 0 658077125 317358080 5754 33554432000 4194304 5683644 140735136629312 18446744073709551615 255377321542 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/32153/statm: 77480 5754 400 364 0 13389 0
[pid=32155] ppid=32153 vsize=208508 CPUtime=855.78 cores=0,2,4,6
/proc/32155/stat : 32155 (march_hi) R 32153 32155 32155 0 -1 4202496 40460 0 0 0 85569 9 0 0 25 0 1 0 658077125 213512192 40190 33554432000 4194304 4955518 140735924085792 18446744073709551615 4297477 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/32155/statm: 52127 40190 106 186 0 51940 0
[pid=32153/tid=32188] ppid=32138 vsize=309920 CPUtime=0 cores=0,2,4,6
/proc/32153/task/32188/stat : 32188 (python) S 32138 32138 30970 0 -1 4202560 46 0 0 0 0 0 0 0 15 0 2 0 658121306 317358080 5754 33554432000 4194304 5683644 140735136629312 18446744073709551615 255389125041 0 0 16781312 514 18446604436419463232 0 0 -1 2 0 0 0
[pid=32168] ppid=32138 vsize=320176 CPUtime=2.85 cores=0,2,4,6
/proc/32168/stat : 32168 (python) S 32138 32138 30970 0 -1 4202560 1164 0 0 0 154 131 0 0 16 0 2 0 658087151 327860224 5758 33554432000 4194304 5683644 140735136629312 18446744073709551615 255389131583 0 0 16781824 2 18446744073709551615 0 0 17 4 0 0 0
/proc/32168/statm: 80044 5758 400 364 0 15950 0
[pid=32170] ppid=32168 vsize=142208 CPUtime=680.91 cores=0,2,4,6
/proc/32170/stat : 32170 (march_hi) R 32168 32170 32170 0 -1 4202496 32777 0 0 0 68083 8 0 0 25 0 1 0 658087151 145620992 32508 33554432000 4194304 4955518 140733854295424 18446744073709551615 4208669 256 0 16781312 0 0 0 0 17 0 0 0 0
/proc/32170/statm: 35552 32508 106 186 0 35365 0
[pid=32168/tid=32214] ppid=32138 vsize=320176 CPUtime=0 cores=0,2,4,6
/proc/32168/task/32214/stat : 32214 (python) S 32138 32138 30970 0 -1 4202560 46 0 0 0 0 0 0 0 15 0 2 0 658171650 327860224 5758 33554432000 4194304 5683644 140735136629312 18446744073709551615 255389125041 0 0 16781824 2 18446604448118698048 0 0 -1 4 0 0 0
[pid=32173] ppid=32138 vsize=329908 CPUtime=2.71 cores=0,2,4,6
/proc/32173/stat : 32173 (python) S 32138 32138 30970 0 -1 4202560 1152 0 0 0 147 124 0 0 15 0 2 0 658092462 337825792 5663 33554432000 4194304 5683644 140735136629312 18446744073709551615 255377321542 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/32173/statm: 82477 5663 400 364 0 18380 0
[pid=32175] ppid=32173 vsize=208508 CPUtime=758.47 cores=0,2,4,6
/proc/32175/stat : 32175 (march_hi) R 32173 32175 32175 0 -1 4202496 36411 0 0 0 75836 11 0 0 25 0 1 0 658092462 213512192 36145 33554432000 4194304 4955518 140734105722048 18446744073709551615 4224471 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/32175/statm: 52127 36145 106 186 0 51940 0
[pid=32173/tid=32210] ppid=32138 vsize=329908 CPUtime=0 cores=0,2,4,6
/proc/32173/task/32210/stat : 32210 (python) S 32138 32138 30970 0 -1 4202560 45 0 0 0 0 0 0 0 16 0 2 0 658163673 337825792 5663 33554432000 4194304 5683644 140735136629312 18446744073709551615 255389125041 0 0 16781312 514 18446604438724700992 0 0 -1 4 0 0 0
[pid=32138/tid=32145] ppid=32136 vsize=340776 CPUtime=202.13 cores=0,2,4,6
/proc/32138/task/32145/stat : 32145 (python) S 32136 32138 30970 0 -1 4202560 26 4180 0 0 0 0 20183 30 21 0 7 0 658077122 348954624 7293 33554432000 4194304 5683644 140735136629312 18446744073709551615 255389125041 0 0 16781312 2 18446604440278456128 0 0 -1 2 0 0 0
[pid=32138/tid=32148] ppid=32136 vsize=340776 CPUtime=202.13 cores=0,2,4,6
/proc/32138/task/32148/stat : 32148 (python) S 32136 32138 30970 0 -1 4202560 25 4180 0 0 0 0 20183 30 20 0 7 0 658077123 348954624 7293 33554432000 4194304 5683644 140735136629312 18446744073709551615 255389125041 0 0 16781312 2 18446604440278456128 0 0 -1 6 0 0 0
[pid=32138/tid=32151] ppid=32136 vsize=340776 CPUtime=202.13 cores=0,2,4,6
/proc/32138/task/32151/stat : 32151 (python) S 32136 32138 30970 0 -1 4202560 30 4180 0 0 0 0 20183 30 18 0 7 0 658077124 348954624 7293 33554432000 4194304 5683644 140735136629312 18446744073709551615 255389125041 0 0 16781312 2 18446604440278456128 0 0 -1 4 0 0 0
[pid=32138/tid=32154] ppid=32136 vsize=340776 CPUtime=202.13 cores=0,2,4,6
/proc/32138/task/32154/stat : 32154 (python) S 32136 32138 30970 0 -1 4202560 35 4180 0 0 0 0 20183 30 18 0 7 0 658077125 348954624 7293 33554432000 4194304 5683644 140735136629312 18446744073709551615 255389125041 0 0 16781312 2 18446604440278456128 0 0 -1 4 0 0 0
[pid=32138/tid=32169] ppid=32136 vsize=340776 CPUtime=202.13 cores=0,2,4,6
/proc/32138/task/32169/stat : 32169 (python) S 32136 32138 30970 0 -1 4202560 27 4180 0 0 0 0 20183 30 18 0 7 0 658087151 348954624 7293 33554432000 4194304 5683644 140735136629312 18446744073709551615 255389125041 0 0 16781312 2 18446604440278456128 0 0 -1 4 0 0 0
[pid=32138/tid=32174] ppid=32136 vsize=340776 CPUtime=202.13 cores=0,2,4,6
/proc/32138/task/32174/stat : 32174 (python) S 32136 32138 30970 0 -1 4202560 28 4180 0 0 0 0 20183 30 18 0 7 0 658092462 348954624 7293 33554432000 4194304 5683644 140735136629312 18446744073709551615 255389125041 0 0 16781312 2 18446604440278456128 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3449.93
Current children cumulated vsize (KiB) 2367568

Child status: 0
Real time (s): 1138.47
CPU time (s): 3450.12
CPU user time (s): 3443.83
CPU system time (s): 6.29504
CPU usage (%): 303.05
Max. virtual memory (cumulated for all children) (KiB): 4981684

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3443.83
system time used= 6.29504
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 181608
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 7119
involuntary context switches= 58194

runsolver used 4.22536 second user time and 9.10661 second system time

The end

Launcher Data 

Begin job on node135 at 2011-05-15 15:06:32
IDJOB=3378336
IDBENCH=82745
IDSOLVER=1859
FILE ID=node135/3378336-1305464792
RUNJOBID= node135-1305462647-30988
PBS_JOBID= 13324970
Free space on /tmp= 73312 MiB

SOLVER NAME= borg-sat 11.03.02-par-random (fixed)
BENCH NAME= SAT11/random/medium/unif-k5-r21.3-v150-c3195-S375894551-007.UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3378336-1305464792/watcher-3378336-1305464792 -o /tmp/evaluation-result-3378336-1305464792/solver-3378336-1305464792 -C 4800 -W 1300 -M 15500  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3378336-1305464792.cnf -seed 1826794127 -budget 4800 -cores 4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= a88511669158afb29f3ddcebdff7b380
RANDOM SEED=1826794127

node135.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 6640.14
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.78
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      11184960 kB
Buffers:        300616 kB
Cached:        6357648 kB
SwapCached:      50684 kB
Active:       10642992 kB
Inactive:     10857584 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      11184960 kB
SwapTotal:    67111528 kB
SwapFree:     66050672 kB
Dirty:           33384 kB
Writeback:           0 kB
AnonPages:    14796808 kB
Mapped:          28428 kB
Slab:           145380 kB
PageTables:      55828 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 82372132 kB
VmallocTotal: 34359738367 kB
VmallocUsed:     33868 kB
VmallocChunk: 34359703231 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73280 MiB
End job on node135 at 2011-05-15 15:25:30