Trace number 3322191

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-randomUNSAT 4560.91 751.933

General information on the benchmark

Namerandom/medium/
unif-k3-r4.26-v500-c2130-S1205196501-095.UNKNOWN.cnf
MD5SUMb1bf2be38e1cea16efc5e7effa1a10c7
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark757.265
Satisfiable
(Un)Satisfiability was proved
Number of variables500
Number of clauses2130
Sum of the clauses size6390
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 32130
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.37/0.63	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.37/0.63	c INFO: solving HOME/instance-3322191-1304375681.cnf
0.37/0.63	c INFO: computing task features
0.37/0.64	c INFO: computed variable-clause graph statistics
0.37/0.64	c INFO: computed clause balance statistics
0.37/0.68	c INFO: computed variable balance statistics
0.45/0.71	c INFO: computed small-clause counts
0.45/0.71	c INFO: computed Horn-clause counts
0.45/0.71	c INFO: computed variable graph statistics
0.45/0.71	c INFO: collected features for HOME/instance-3322191-1304375681.cnf in 0.08 s
0.45/0.75	c INFO: running gnovelty+2@0 for 97 with 39999 remaining (b = 0.57)
0.45/0.79	c INFO: running march_hi@0 for 388 with 39999 remaining (b = 0.35)
0.55/0.83	c INFO: running march_hi@0 for 388 with 39999 remaining (b = 0.31)
0.55/0.86	c INFO: running march_hi@0 for 97 with 39999 remaining (b = 0.10)
0.65/0.90	c INFO: running gnovelty+2@0 for 97 with 39999 remaining (b = 0.07)
0.65/0.94	c INFO: running march_hi@0 for 485 with 39999 remaining (b = 0.26)
0.65/0.98	c INFO: running march_hi@0 for 485 with 39999 remaining (b = 0.23)
1.57/1.02	c INFO: running march_hi@0 for 388 with 39999 remaining (b = 0.17)
649.72/101.00	c INFO: running march_hi@0 for 388 with 39899 remaining (b = 0.15)
653.97/101.66	c INFO: running march_hi@0 for 97 with 39899 remaining (b = 0.05)
939.68/149.24	c INFO: running kcnfs-2006@0 for 582 with 39851 remaining (b = 0.19)
1376.04/221.98	c INFO: running march_hi@97 for 97 with 39778 remaining (b = 0.04)
1969.06/320.77	c INFO: running march_hi@196 for 194 with 39679 remaining (b = 0.08)
2409.62/394.19	c INFO: running march_hi@0 for 97 with 39606 remaining (b = 0.04)
3072.90/504.69	c INFO: running march_hi@96 for 97 with 39495 remaining (b = 0.04)
3116.08/511.89	c INFO: running march_hi@0 for 97 with 39488 remaining (b = 0.04)
3128.68/513.92	c INFO: running march_hi@585 for 97 with 39486 remaining (b = 0.07)
3455.22/568.37	c INFO: running march_hi@0 for 97 with 39432 remaining (b = 0.05)
3516.50/578.60	c INFO: running march_hi@100 for 97 with 39422 remaining (b = 0.05)
3850.32/633.54	c INFO: running march_hi@192 for 291 with 39367 remaining (b = 0.16)
3969.71/653.43	c INFO: running march_hi@100 for 291 with 39347 remaining (b = 0.14)
4022.54/662.29	c INFO: running march_hi@974 for 388 with 39338 remaining (b = 0.17)
4081.33/672.05	c INFO: running march_hi@392 for 97 with 39328 remaining (b = 0.07)
4155.09/684.32	c INFO: running march_hi@198 for 194 with 39316 remaining (b = 0.11)
4173.75/687.47	c INFO: running march_hi@582 for 97 with 39313 remaining (b = 0.05)
4560.78/751.91	s UNSATISFIABLE

Verifier Data 

No possible verification on an UNSAT instance

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3322191-1304375681/watcher-3322191-1304375681 -o /tmp/evaluation-result-3322191-1304375681/solver-3322191-1304375681 -C 40000 -W 5100 -M 31000 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3322191-1304375681.cnf -seed 502575091 -budget 40000 -cores 8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.11 8.57 9.12 3/269 18106
/proc/meminfo: memFree=6469748/32951124 swapFree=67051472/67111528
[pid=18106] ppid=18104 vsize=15756 CPUtime=0 cores=0-7
/proc/18106/stat : 18106 (python) S 18104 18106 17290 0 -1 4202496 840 0 0 0 0 0 0 0 17 0 1 0 549170892 16134144 723 33554432000 4194304 5683644 140733494302928 18446744073709551615 218370955264 0 2147483391 16781312 2 18446744071699199166 0 0 17 2 0 0 0
/proc/18106/statm: 3939 723 334 364 0 426 0

[startup+0.027141 s]
/proc/loadavg: 7.11 8.57 9.12 3/269 18106
/proc/meminfo: memFree=6469748/32951124 swapFree=67051472/67111528
[pid=18106] ppid=18104 vsize=16400 CPUtime=0.01 cores=0-7
/proc/18106/stat : 18106 (python) R 18104 18106 17290 0 -1 4202496 1118 0 0 0 1 0 0 0 17 0 1 0 549170892 16793600 985 33554432000 4194304 5683644 140733494302928 18446744073709551615 218370953061 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/18106/statm: 4100 985 409 364 0 587 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 16400

[startup+0.101141 s]
/proc/loadavg: 7.11 8.57 9.12 3/269 18106
/proc/meminfo: memFree=6469748/32951124 swapFree=67051472/67111528
[pid=18106] ppid=18104 vsize=93964 CPUtime=0.05 cores=0-7
/proc/18106/stat : 18106 (python) R 18104 18106 17290 0 -1 4202496 2697 0 0 0 4 1 0 0 17 0 1 0 549170892 96219136 2407 33554432000 4194304 5683644 140733494302928 18446744073709551615 218370955264 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/18106/statm: 23491 2407 764 364 0 1623 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 93964

[startup+0.301093 s]
/proc/loadavg: 7.11 8.57 9.12 3/269 18106
/proc/meminfo: memFree=6469748/32951124 swapFree=67051472/67111528
[pid=18106] ppid=18104 vsize=135752 CPUtime=0.18 cores=0-7
/proc/18106/stat : 18106 (python) S 18104 18106 17290 0 -1 4202496 5965 931 1 0 13 5 0 0 18 0 1 0 549170892 139010048 4151 33554432000 4194304 5683644 140733494302928 18446744073709551615 218370953221 0 2147483391 16781312 2 18446744071699199166 0 0 17 2 0 0 0
/proc/18106/statm: 33938 4151 1032 364 0 3124 0
Current children cumulated CPU time (s) 0.18
Current children cumulated vsize (KiB) 135752

[startup+0.701018 s]
/proc/loadavg: 7.11 8.57 9.12 3/269 18106
/proc/meminfo: memFree=6469748/32951124 swapFree=67051472/67111528
[pid=18106] ppid=18104 vsize=278428 CPUtime=0.45 cores=0-7
/proc/18106/stat : 18106 (python) R 18104 18106 17290 0 -1 4202496 9329 931 1 0 36 9 0 0 17 0 1 0 549170892 285110272 6996 33554432000 4194304 5683644 140733494302928 18446744073709551615 47661497873239 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/18106/statm: 69607 6996 1827 364 0 5531 0
Current children cumulated CPU time (s) 0.45
Current children cumulated vsize (KiB) 278428

[startup+1.50084 s]
/proc/loadavg: 7.11 8.57 9.12 11/289 18130
/proc/meminfo: memFree=6416224/32951124 swapFree=67051472/67111528
[pid=18106] ppid=18104 vsize=426792 CPUtime=0.78 cores=0-7
/proc/18106/stat : 18106 (python) S 18104 18106 17290 0 -1 4202496 15871 931 1 0 66 12 0 0 23 0 9 0 549170892 437035008 7289 33554432000 4194304 5683644 140733494302928 18446744073709551615 218382783947 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/18106/statm: 106698 7289 1889 364 0 42595 0
[pid=18112] ppid=18106 vsize=278616 CPUtime=0 cores=0-7
/proc/18112/stat : 18112 (python) S 18106 18106 17290 0 -1 4202560 734 0 0 0 0 0 0 0 18 0 1 0 549170968 285302784 5592 33554432000 4194304 5683644 140733494302928 18446744073709551615 218370977295 0 0 16781312 514 2762351445268234239 0 0 17 7 0 0 0
/proc/18112/statm: 69654 5592 354 364 0 5572 0
[pid=18114] ppid=18112 vsize=1017800 CPUtime=0.74 cores=0-7
/proc/18114/stat : 18114 (gnovelty+2) R 18112 18114 18114 0 -1 4202496 447 0 0 0 74 0 0 0 21 0 1 0 549170968 1042227200 178 33554432000 134512640 135663704 4292720640 18446744073709551615 134524697 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/18114/statm: 254450 178 113 282 0 254166 0
[pid=18115] ppid=18106 vsize=289344 CPUtime=0 cores=0-7
/proc/18115/stat : 18115 (python) S 18106 18106 17290 0 -1 4202560 747 0 0 0 0 0 0 0 15 0 1 0 549170972 296288256 5693 33554432000 4194304 5683644 140733494302928 18446744073709551615 218370977350 0 0 16781312 514 3161003575174201600 0 0 17 4 0 0 0
/proc/18115/statm: 72336 5693 348 364 0 8251 0
[pid=18117] ppid=18115 vsize=2320 CPUtime=0.69 cores=0-7
/proc/18117/stat : 18117 (march_hi) R 18115 18117 18117 0 -1 4202496 657 0 0 0 69 0 0 0 22 0 1 0 549170972 2375680 395 33554432000 4194304 4955518 140735040681200 18446744073709551615 4209695 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/18117/statm: 580 395 104 186 0 393 0
[pid=18118] ppid=18106 vsize=299312 CPUtime=0 cores=0-7
/proc/18118/stat : 18118 (python) S 18106 18106 17290 0 -1 4202560 764 0 0 0 0 0 0 0 16 0 1 0 549170976 306495488 5625 33554432000 4194304 5683644 140733494302928 18446744073709551615 218370977350 0 0 16781312 514 3554967387499364608 0 0 17 1 0 0 0
/proc/18118/statm: 74828 5625 348 364 0 10740 0
[pid=18120] ppid=18118 vsize=2320 CPUtime=0.65 cores=0-7
/proc/18120/stat : 18120 (march_hi) R 18118 18120 18120 0 -1 4202496 659 0 0 0 65 0 0 0 25 0 1 0 549170976 2375680 393 33554432000 4194304 4955518 140736861417616 18446744073709551615 4210833 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/18120/statm: 580 393 104 186 0 393 0
[pid=18121] ppid=18106 vsize=309988 CPUtime=0 cores=0-7
/proc/18121/stat : 18121 (python) S 18106 18106 17290 0 -1 4202560 768 0 0 0 0 0 0 0 16 0 1 0 549170979 317427712 5717 33554432000 4194304 5683644 140733494302928 18446744073709551615 218370977350 0 0 16781312 514 3554958591406342400 0 0 17 4 0 0 0
/proc/18121/statm: 77497 5717 348 364 0 13406 0
[pid=18123] ppid=18121 vsize=2320 CPUtime=0.62 cores=0-7
/proc/18123/stat : 18123 (march_hi) R 18121 18123 18123 0 -1 4202496 659 0 0 0 62 0 0 0 22 0 1 0 549170980 2375680 392 33554432000 4194304 4955518 140735778803280 18446744073709551615 4209701 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/18123/statm: 580 392 104 186 0 393 0
[pid=18124] ppid=18106 vsize=320244 CPUtime=0 cores=0-7
/proc/18124/stat : 18124 (python) S 18106 18106 17290 0 -1 4202560 763 0 0 0 0 0 0 0 19 0 1 0 549170983 327929856 5721 33554432000 4194304 5683644 140733494302928 18446744073709551615 218370977350 0 0 16781312 514 2021060980699561983 0 0 17 0 0 0 0
/proc/18124/statm: 80061 5721 348 364 0 15967 0
[pid=18126] ppid=18124 vsize=1017800 CPUtime=0.41 cores=0-7
/proc/18126/stat : 18126 (gnovelty+2) R 18124 18126 18126 0 -1 4202496 442 0 0 0 41 0 0 0 21 0 1 0 549170984 1042227200 178 33554432000 134512640 135663704 4292560624 18446744073709551615 134524553 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/18126/statm: 254450 178 113 282 0 254166 0
[pid=18127] ppid=18106 vsize=330500 CPUtime=0 cores=0-7
/proc/18127/stat : 18127 (python) S 18106 18106 17290 0 -1 4202560 770 0 0 0 0 0 0 0 18 0 1 0 549170987 338432000 5725 33554432000 4194304 5683644 140733494302928 18446744073709551615 218370977350 0 0 16781312 514 13801338236976464132 0 0 17 1 0 0 0
/proc/18127/statm: 82625 5725 348 364 0 18528 0
[pid=18129] ppid=18106 vsize=340756 CPUtime=0 cores=0-7
/proc/18129/stat : 18129 (python) S 18106 18106 17290 0 -1 4202560 780 0 0 0 0 0 0 0 18 0 1 0 549170991 348934144 5729 33554432000 4194304 5683644 140733494302928 18446744073709551615 218370977350 0 0 16781312 514 15515872688865247490 0 0 17 1 0 0 0
/proc/18129/statm: 85189 5729 348 364 0 21089 0
[pid=18106/tid=18113] ppid=18104 vsize=426792 CPUtime=0 cores=0-7
/proc/18106/task/18113/stat : 18113 (python) S 18104 18106 17290 0 -1 4202560 25 931 0 0 0 0 0 0 18 0 9 0 549170968 437035008 7289 33554432000 4194304 5683644 140733494302928 18446744073709551615 218382780849 0 0 16781312 2 18446604436739027392 0 0 -1 0 0 0 0
[pid=18106/tid=18116] ppid=18104 vsize=426792 CPUtime=0 cores=0-7
/proc/18106/task/18116/stat : 18116 (python) S 18104 18106 17290 0 -1 4202560 25 931 0 0 0 0 0 0 20 0 9 0 549170972 437035008 7289 33554432000 4194304 5683644 140733494302928 18446744073709551615 218382780849 0 0 16781312 2 18446604436739027392 0 0 -1 4 0 0 0
[pid=18106/tid=18119] ppid=18104 vsize=426792 CPUtime=0 cores=0-7
/proc/18106/task/18119/stat : 18119 (python) S 18104 18106 17290 0 -1 4202560 25 931 0 0 0 0 0 0 22 0 9 0 549170976 437035008 7289 33554432000 4194304 5683644 140733494302928 18446744073709551615 218382780849 0 0 16781312 2 18446604436739027392 0 0 -1 0 0 0 0
[pid=18106/tid=18122] ppid=18104 vsize=426792 CPUtime=0 cores=0-7
/proc/18106/task/18122/stat : 18122 (python) S 18104 18106 17290 0 -1 4202560 20 931 0 0 0 0 0 0 20 0 9 0 549170980 437035008 7289 33554432000 4194304 5683644 140733494302928 18446744073709551615 218382780849 0 0 16781312 2 18446604436739027392 0 0 -1 0 0 0 0
[pid=18106/tid=18125] ppid=18104 vsize=426792 CPUtime=0 cores=0-7
/proc/18106/task/18125/stat : 18125 (python) S 18104 18106 17290 0 -1 4202560 26 931 0 0 0 0 0 0 20 0 9 0 549170984 437035008 7289 33554432000 4194304 5683644 140733494302928 18446744073709551615 218382780849 0 0 16781312 2 18446604436739027392 0 0 -1 0 0 0 0
[pid=18106/tid=18128] ppid=18104 vsize=426792 CPUtime=0 cores=0-7
/proc/18106/task/18128/stat : 18128 (python) S 18104 18106 17290 0 -1 4202560 42 931 0 0 0 0 0 0 21 0 9 0 549170988 437035008 7289 33554432000 4194304 5683644 140733494302928 18446744073709551615 218382780849 0 0 16781312 2 18446604436739027392 0 0 -1 0 0 0 0
[pid=18106/tid=18130] ppid=18104 vsize=426792 CPUtime=0 cores=0-7
/proc/18106/task/18130/stat : 18130 (python) S 18104 18106 17290 0 -1 4202560 24 931 0 0 0 0 0 0 22 0 9 0 549170991 437035008 7289 33554432000 4194304 5683644 140733494302928 18446744073709551615 218382780849 0 0 16781312 2 18446604436739027392 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3.89
Current children cumulated vsize (KiB) 4638112

[startup+3.10156 s]
/proc/loadavg: 7.11 8.57 9.12 11/294 18135
/proc/meminfo: memFree=6407132/32951124 swapFree=67051472/67111528
[pid=18106] ppid=18104 vsize=426792 CPUtime=0.78 cores=0-7
/proc/18106/stat : 18106 (python) S 18104 18106 17290 0 -1 4202496 15871 931 1 0 66 12 0 0 23 0 9 0 549170892 437035008 7289 33554432000 4194304 5683644 140733494302928 18446744073709551615 218382783947 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/18106/statm: 106698 7289 1889 364 0 42595 0
[pid=18112] ppid=18106 vsize=278616 CPUtime=0 cores=0-7
/proc/18112/stat : 18112 (python) S 18106 18106 17290 0 -1 4202560 734 0 0 0 0 0 0 0 18 0 1 0 549170968 285302784 5592 33554432000 4194304 5683644 140733494302928 18446744073709551615 218370977295 0 0 16781312 514 2762351445268201728 0 0 17 7 0 0 0
/proc/18112/statm: 69654 5592 354 364 0 5572 0
[pid=18114] ppid=18112 vsize=1017800 CPUtime=2.34 cores=0-7
/proc/18114/stat : 18114 (gnovelty+2) R 18112 18114 18114 0 -1 4202496 447 0 0 0 234 0 0 0 25 0 1 0 549170968 1042227200 178 33554432000 134512640 135663704 4292720640 18446744073709551615 134525688 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/18114/statm: 254450 178 113 282 0 254166 0
[pid=18115] ppid=18106 vsize=289344 CPUtime=0 cores=0-7
/proc/18115/stat : 18115 (python) S 18106 18106 17290 0 -1 4202560 747 0 0 0 0 0 0 0 15 0 1 0 549170972 296288256 5693 33554432000 4194304 5683644 140733494302928 18446744073709551615 218370977350 0 0 16781312 514 3161003575174201600 0 0 17 4 0 0 0
/proc/18115/statm: 72336 5693 348 364 0 8251 0
[pid=18117] ppid=18115 vsize=2824 CPUtime=2.28 cores=0-7
/proc/18117/stat : 18117 (march_hi) R 18115 18117 18117 0 -1 4202496 728 0 0 0 228 0 0 0 25 0 1 0 549170972 2891776 466 33554432000 4194304 4955518 140735040681200 18446744073709551615 4224628 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/18117/statm: 706 466 104 186 0 519 0
[pid=18118] ppid=18106 vsize=299312 CPUtime=0 cores=0-7
/proc/18118/stat : 18118 (python) S 18106 18106 17290 0 -1 4202560 769 0 0 0 0 0 0 0 15 0 1 0 549170976 306495488 5625 33554432000 4194304 5683644 140733494302928 18446744073709551615 218370977350 0 0 16781312 514 14597564425637429504 0 0 17 1 0 0 0
/proc/18118/statm: 74828 5625 348 364 0 10740 0
[pid=18120] ppid=18118 vsize=2824 CPUtime=2.24 cores=0-7
/proc/18120/stat : 18120 (march_hi) R 18118 18120 18120 0 -1 4202496 731 0 0 0 224 0 0 0 25 0 1 0 549170976 2891776 465 33554432000 4194304 4955518 140736861417616 18446744073709551615 4227800 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/18120/statm: 706 465 104 186 0 519 0
[pid=18121] ppid=18106 vsize=309988 CPUtime=0 cores=0-7
/proc/18121/stat : 18121 (python) S 18106 18106 17290 0 -1 4202560 773 0 0 0 0 0 0 0 15 0 1 0 549170979 317427712 5717 33554432000 4194304 5683644 140733494302928 18446744073709551615 218370977350 0 0 16781312 514 3554958591406342400 0 0 17 4 0 0 0
/proc/18121/statm: 77497 5717 348 364 0 13406 0
[pid=18123] ppid=18121 vsize=2824 CPUtime=2.22 cores=0-7
/proc/18123/stat : 18123 (march_hi) R 18121 18123 18123 0 -1 4202496 730 0 0 0 222 0 0 0 25 0 1 0 549170980 2891776 463 33554432000 4194304 4955518 140735778803280 18446744073709551615 4227906 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/18123/statm: 706 463 104 186 0 519 0
[pid=18124] ppid=18106 vsize=320244 CPUtime=0 cores=0-7
/proc/18124/stat : 18124 (python) S 18106 18106 17290 0 -1 4202560 763 0 0 0 0 0 0 0 18 0 1 0 549170983 327929856 5721 33554432000 4194304 5683644 140733494302928 18446744073709551615 218370977350 0 0 16781312 514 2021060980699529472 0 0 17 0 0 0 0
/proc/18124/statm: 80061 5721 348 364 0 15967 0
[pid=18126] ppid=18124 vsize=1017800 CPUtime=1.21 cores=0-7
/proc/18126/stat : 18126 (gnovelty+2) R 18124 18126 18126 0 -1 4202496 442 0 0 0 121 0 0 0 25 0 1 0 549170984 1042227200 178 33554432000 134512640 135663704 4292560624 18446744073709551615 134564723 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/18126/statm: 254450 178 113 282 0 254166 0
[pid=18127] ppid=18106 vsize=330500 CPUtime=0 cores=0-7
/proc/18127/stat : 18127 (python) S 18106 18106 17290 0 -1 4202560 774 0 0 0 0 0 0 0 15 0 1 0 549170987 338432000 5725 33554432000 4194304 5683644 140733494302928 18446744073709551615 218370977350 0 0 16781312 514 13801338236976464132 0 0 17 1 0 0 0
/proc/18127/statm: 82625 5725 348 364 0 18528 0
[pid=18134] ppid=18127 vsize=2824 CPUtime=2.06 cores=0-7
/proc/18134/stat : 18134 (march_hi) R 18127 18134 18134 0 -1 4202496 722 0 0 0 206 0 0 0 25 0 1 0 549170996 2891776 459 33554432000 4194304 4955518 140737321710736 18446744073709551615 4314874 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/18134/statm: 706 459 104 186 0 519 0
[pid=18129] ppid=18106 vsize=340756 CPUtime=0 cores=0-7
/proc/18129/stat : 18129 (python) S 18106 18106 17290 0 -1 4202560 782 0 0 0 0 0 0 0 15 0 1 0 549170991 348934144 5729 33554432000 4194304 5683644 140733494302928 18446744073709551615 218370977350 0 0 16781312 514 15515872688865247490 0 0 17 1 0 0 0
/proc/18129/statm: 85189 5729 348 364 0 21089 0
[pid=18131] ppid=18129 vsize=2388 CPUtime=1.01 cores=0-7
/proc/18131/stat : 18131 (march_hi) R 18129 18131 18131 0 -1 4202496 673 0 0 0 101 0 0 0 25 0 1 0 549170993 2445312 408 33554432000 4194304 4955518 140737250266512 18446744073709551615 4261411 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/18131/statm: 597 408 104 186 0 410 0
[pid=18132] ppid=18106 vsize=351012 CPUtime=0 cores=0-7
/proc/18132/stat : 18132 (python) S 18106 18106 17290 0 -1 4202560 818 0 0 0 0 0 0 0 15 0 1 0 549170995 359436288 5748 33554432000 4194304 5683644 140733494302928 18446744073709551615 218370977350 0 0 16781312 514 13745571007215665408 0 0 17 1 0 0 0
/proc/18132/statm: 87753 5748 354 364 0 23650 0
[pid=18135] ppid=18132 vsize=2388 CPUtime=0.96 cores=0-7
/proc/18135/stat : 18135 (march_hi) R 18132 18135 18135 0 -1 4202496 676 0 0 0 96 0 0 0 25 0 1 0 549170996 2445312 406 33554432000 4194304 4955518 140737084351328 18446744073709551615 4224656 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/18135/statm: 597 406 104 186 0 410 0
[pid=18106/tid=18113] ppid=18104 vsize=426792 CPUtime=0 cores=0-7
/proc/18106/task/18113/stat : 18113 (python) S 18104 18106 17290 0 -1 4202560 25 931 0 0 0 0 0 0 18 0 9 0 549170968 437035008 7289 33554432000 4194304 5683644 140733494302928 18446744073709551615 218382780849 0 0 16781312 2 18446604436739027392 0 0 -1 0 0 0 0
[pid=18106/tid=18116] ppid=18104 vsize=426792 CPUtime=0 cores=0-7
/proc/18106/task/18116/stat : 18116 (python) S 18104 18106 17290 0 -1 4202560 25 931 0 0 0 0 0 0 20 0 9 0 549170972 437035008 7289 33554432000 4194304 5683644 140733494302928 18446744073709551615 218382780849 0 0 16781312 2 18446604436739027392 0 0 -1 4 0 0 0
[pid=18106/tid=18119] ppid=18104 vsize=426792 CPUtime=0 cores=0-7
/proc/18106/task/18119/stat : 18119 (python) S 18104 18106 17290 0 -1 4202560 25 931 0 0 0 0 0 0 22 0 9 0 549170976 437035008 7289 33554432000 4194304 5683644 140733494302928 18446744073709551615 218382780849 0 0 16781312 2 18446604436739027392 0 0 -1 0 0 0 0
[pid=18106/tid=18122] ppid=18104 vsize=426792 CPUtime=0 cores=0-7
/proc/18106/task/18122/stat : 18122 (python) S 18104 18106 17290 0 -1 4202560 20 931 0 0 0 0 0 0 20 0 9 0 549170980 437035008 7289 33554432000 4194304 5683644 140733494302928 18446744073709551615 218382780849 0 0 16781312 2 18446604436739027392 0 0 -1 0 0 0 0
[pid=18106/tid=18125] ppid=18104 vsize=426792 CPUtime=0 cores=0-7
/proc/18106/task/18125/stat : 18125 (python) S 18104 18106 17290 0 -1 4202560 26 931 0 0 0 0 0 0 20 0 9 0 549170984 437035008 7289 33554432000 4194304 5683644 140733494302928 18446744073709551615 218382780849 0 0 16781312 2 18446604436739027392 0 0 -1 0 0 0 0
[pid=18106/tid=18128] ppid=18104 vsize=426792 CPUtime=0 cores=0-7
/proc/18106/task/18128/stat : 18128 (python) S 18104 18106 17290 0 -1 4202560 42 931 0 0 0 0 0 0 21 0 9 0 549170988 437035008 7289 33554432000 4194304 5683644 140733494302928 18446744073709551615 218382780849 0 0 16781312 2 18446604436739027392 0 0 -1 0 0 0 0
[pid=18106/tid=18130] ppid=18104 vsize=426792 CPUtime=0 cores=0-7
/proc/18106/task/18130/stat : 18130 (python) S 18104 18106 17290 0 -1 4202560 24 931 0 0 0 0 0 0 22 0 9 0 549170991 437035008 7289 33554432000 4194304 5683644 140733494302928 18446744073709551615 218382780849 0 0 16781312 2 18446604436739027392 0 0 -1 0 0 0 0
[pid=18106/tid=18133] ppid=18104 vsize=426792 CPUtime=0 cores=0-7
/proc/18106/task/18133/stat : 18133 (python) S 18104 18106 17290 0 -1 4202560 63 931 0 0 0 0 0 0 23 0 9 0 549170995 437035008 7289 33554432000 4194304 5683644 140733494302928 18446744073709551615 218382780849 0 0 16781312 2 18446604436739027392 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 15.1
Current children cumulated vsize (KiB) 4998236

[startup+6.30099 s]
/proc/loadavg: 7.34 8.59 9.12 11/294 18135
/proc/meminfo: memFree=6402176/32951124 swapFree=67051472/67111528
[pid=18106] ppid=18104 vsize=426792 CPUtime=0.78 cores=0-7

################
# More data... #
################

/proc/18106/task/18119/stat : 18119 (python) S 18104 18106 17290 0 -1 4202560 28 931 0 0 0 0 0 0 18 0 11 0 549170976 458248192 7367 33554432000 4194304 5683644 140733494302928 18446744073709551615 218382780849 0 0 16781312 2 18446604436739027392 0 0 -1 0 0 0 0
[pid=18106/tid=18122] ppid=18104 vsize=447508 CPUtime=0 cores=0-7
/proc/18106/task/18122/stat : 18122 (python) S 18104 18106 17290 0 -1 4202560 30 931 0 0 0 0 0 0 18 0 11 0 549170980 458248192 7367 33554432000 4194304 5683644 140733494302928 18446744073709551615 218382780849 0 0 16781312 2 18446604436739027392 0 0 -1 0 0 0 0
[pid=18106/tid=18125] ppid=18104 vsize=447508 CPUtime=0 cores=0-7
/proc/18106/task/18125/stat : 18125 (python) S 18104 18106 17290 0 -1 4202560 26 931 0 0 0 0 0 0 20 0 11 0 549170984 458248192 7367 33554432000 4194304 5683644 140733494302928 18446744073709551615 218382780849 0 0 16781312 2 18446604436739027392 0 0 -1 0 0 0 0
[pid=18106/tid=18128] ppid=18104 vsize=447508 CPUtime=0 cores=0-7
/proc/18106/task/18128/stat : 18128 (python) S 18104 18106 17290 0 -1 4202560 46 931 0 0 0 0 0 0 18 0 11 0 549170988 458248192 7367 33554432000 4194304 5683644 140733494302928 18446744073709551615 218382780849 0 0 16781312 2 18446604436739027392 0 0 -1 0 0 0 0
[pid=18106/tid=18130] ppid=18104 vsize=447508 CPUtime=0 cores=0-7
/proc/18106/task/18130/stat : 18130 (python) S 18104 18106 17290 0 -1 4202560 24 931 0 0 0 0 0 0 22 0 11 0 549170991 458248192 7367 33554432000 4194304 5683644 140733494302928 18446744073709551615 218382780849 0 0 16781312 2 18446604436739027392 0 0 -1 0 0 0 0
[pid=18106/tid=18133] ppid=18104 vsize=447508 CPUtime=0 cores=0-7
/proc/18106/task/18133/stat : 18133 (python) S 18104 18106 17290 0 -1 4202560 66 931 0 0 0 0 0 0 18 0 11 0 549170995 458248192 7367 33554432000 4194304 5683644 140733494302928 18446744073709551615 218382780849 0 0 16781312 2 18446604436739027392 0 0 -1 0 0 0 0
[pid=18106/tid=18141] ppid=18104 vsize=447508 CPUtime=0 cores=0-7
/proc/18106/task/18141/stat : 18141 (python) S 18104 18106 17290 0 -1 4202560 32 931 0 0 0 0 0 0 18 0 11 0 549180993 458248192 7367 33554432000 4194304 5683644 140733494302928 18446744073709551615 218382780849 0 0 16781312 2 18446604436739027392 0 0 -1 0 0 0 0
[pid=18106/tid=18147] ppid=18104 vsize=447508 CPUtime=0 cores=0-7
/proc/18106/task/18147/stat : 18147 (python) S 18104 18106 17290 0 -1 4202560 28 931 0 0 0 0 0 0 20 0 11 0 549185818 458248192 7367 33554432000 4194304 5683644 140733494302928 18446744073709551615 218382780849 0 0 16781312 2 18446604436739027392 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4555.88
Current children cumulated vsize (KiB) 6742936

[startup+751.501 s]
/proc/loadavg: 10.08 9.99 9.65 13/308 18169
/proc/meminfo: memFree=6019252/32951124 swapFree=67051472/67111528
[pid=18106] ppid=18104 vsize=447508 CPUtime=1.56 cores=0-7
/proc/18106/stat : 18106 (python) S 18104 18106 17290 0 -1 4202496 18905 931 1 0 144 12 0 0 18 0 11 0 549170892 458248192 7367 33554432000 4194304 5683644 140733494302928 18446744073709551615 218382783947 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/18106/statm: 111877 7367 1894 364 0 47768 0
[pid=18112] ppid=18106 vsize=288860 CPUtime=0.2 cores=0-7
/proc/18112/stat : 18112 (python) S 18106 18106 17290 0 -1 4202560 1083 0 0 0 10 10 0 0 19 0 2 0 549170968 295792640 5653 33554432000 4194304 5683644 140733494302928 18446744073709551615 218382783947 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/18112/statm: 72215 5653 410 364 0 8133 0
[pid=18114] ppid=18112 vsize=1017800 CPUtime=100.2 cores=0-7
/proc/18114/stat : 18114 (gnovelty+2) T 18112 18114 18114 0 -1 4202496 447 0 0 0 10020 0 0 0 25 0 1 0 549170968 1042227200 178 33554432000 134512640 135663704 4292720640 18446744073709551615 134524918 0 0 16781312 0 18446744071562691360 0 0 17 5 0 0 0
/proc/18114/statm: 254450 178 113 282 0 254166 0
[pid=18112/tid=18139] ppid=18106 vsize=288860 CPUtime=0 cores=0-7
/proc/18112/task/18139/stat : 18139 (python) S 18106 18106 17290 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 549180988 295792640 5653 33554432000 4194304 5683644 140733494302928 18446744073709551615 218382780849 0 0 16781312 514 18446604453555853312 0 0 -1 7 0 0 0
[pid=18115] ppid=18106 vsize=289344 CPUtime=1.65 cores=0-7
/proc/18115/stat : 18115 (python) S 18106 18106 17290 0 -1 4202560 1161 0 0 0 90 75 0 0 15 0 2 0 549170972 296288256 5747 33554432000 4194304 5683644 140733494302928 18446744073709551615 218370977350 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/18115/statm: 72336 5747 401 364 0 8251 0
[pid=18117] ppid=18115 vsize=76216 CPUtime=528.99 cores=0-7
/proc/18117/stat : 18117 (march_hi) R 18115 18117 18117 0 -1 4202496 15769 0 0 0 52889 10 0 0 25 0 1 0 549170972 78045184 15507 33554432000 4194304 4955518 140735040681200 18446744073709551615 4227502 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/18117/statm: 19054 15507 104 186 0 18867 0
[pid=18115/tid=18162] ppid=18106 vsize=289344 CPUtime=0 cores=0-7
/proc/18115/task/18162/stat : 18162 (python) S 18106 18106 17290 0 -1 4202560 46 0 0 0 0 0 0 0 15 0 2 0 549227725 296288256 5747 33554432000 4194304 5683644 140733494302928 18446744073709551615 218382780849 0 0 16781312 514 18446604453555852416 0 0 -1 7 0 0 0
[pid=18118] ppid=18106 vsize=364848 CPUtime=1.7 cores=0-7
/proc/18118/stat : 18118 (python) S 18106 18106 17290 0 -1 4202560 1164 0 0 0 90 80 0 0 15 0 2 0 549170976 373604352 5680 33554432000 4194304 5683644 140733494302928 18446744073709551615 218370977350 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/18118/statm: 91212 5680 400 364 0 27124 0
[pid=18120] ppid=18118 vsize=90916 CPUtime=646.55 cores=0-7
/proc/18120/stat : 18120 (march_hi) R 18118 18120 18120 0 -1 4202496 18657 0 0 0 64641 14 0 0 25 0 1 0 549170976 93097984 18391 33554432000 4194304 4955518 140736861417616 18446744073709551615 4209776 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/18120/statm: 22729 18391 104 186 0 22542 0
[pid=18118/tid=18156] ppid=18106 vsize=364848 CPUtime=0 cores=0-7
/proc/18118/task/18156/stat : 18156 (python) S 18106 18106 17290 0 -1 4202560 46 0 0 0 0 0 0 0 15 0 2 0 549210307 373604352 5680 33554432000 4194304 5683644 140733494302928 18446744073709551615 218382780849 0 0 16781312 514 18446604452016486272 0 0 -1 0 0 0 0
[pid=18121] ppid=18106 vsize=309988 CPUtime=1.67 cores=0-7
/proc/18121/stat : 18121 (python) S 18106 18106 17290 0 -1 4202560 1181 0 0 0 93 74 0 0 15 0 2 0 549170979 317427712 5770 33554432000 4194304 5683644 140733494302928 18446744073709551615 218370977350 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/18121/statm: 77497 5770 400 364 0 13406 0
[pid=18123] ppid=18121 vsize=90916 CPUtime=627.41 cores=0-7
/proc/18123/stat : 18123 (march_hi) R 18121 18123 18123 0 -1 4202496 18288 0 0 0 62732 9 0 0 25 0 1 0 549170980 93097984 18021 33554432000 4194304 4955518 140735778803280 18446744073709551615 4298062 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/18123/statm: 22729 18021 104 186 0 22542 0
[pid=18121/tid=18143] ppid=18106 vsize=309988 CPUtime=0 cores=0-7
/proc/18121/task/18143/stat : 18143 (python) S 18106 18106 17290 0 -1 4202560 52 0 0 0 0 0 0 0 15 0 2 0 549181053 317427712 5770 33554432000 4194304 5683644 140733494302928 18446744073709551615 218382780849 0 0 16781312 514 18446604453555851520 0 0 -1 1 0 0 0
[pid=18124] ppid=18106 vsize=320244 CPUtime=0.29 cores=0-7
/proc/18124/stat : 18124 (python) S 18106 18106 17290 0 -1 4202560 1147 0 0 0 16 13 0 0 19 0 2 0 549170983 327929856 5774 33554432000 4194304 5683644 140733494302928 18446744073709551615 218382783947 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/18124/statm: 80061 5774 400 364 0 15967 0
[pid=18126] ppid=18124 vsize=1017800 CPUtime=97.85 cores=0-7
/proc/18126/stat : 18126 (gnovelty+2) T 18124 18126 18126 0 -1 4202496 442 0 0 0 9785 0 0 0 25 0 1 0 549170984 1042227200 178 33554432000 134512640 135663704 4292560624 18446744073709551615 134524833 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/18126/statm: 254450 178 113 282 0 254166 0
[pid=18124/tid=18145] ppid=18106 vsize=320244 CPUtime=0 cores=0-7
/proc/18124/task/18145/stat : 18145 (python) S 18106 18106 17290 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 549185813 327929856 5774 33554432000 4194304 5683644 140733494302928 18446744073709551615 218382780849 0 0 16781312 514 18446604449088290880 0 0 -1 1 0 0 0
[pid=18127] ppid=18106 vsize=396036 CPUtime=3.8 cores=0-7
/proc/18127/stat : 18127 (python) R 18106 18106 17290 0 -1 4202560 1199 0 0 0 268 112 0 0 18 0 2 0 549170987 405540864 5780 33554432000 4194304 5683644 140733494302928 18446744073709551615 218382787391 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/18127/statm: 99009 5780 400 364 0 34912 0
[pid=18134] ppid=18127 vsize=0 CPUtime=688.72 cores=0-7
/proc/18134/stat : 18134 (march_hi) R 18127 18134 18134 0 -1 4202500 19681 0 0 0 68866 6 0 0 25 0 1 0 549170996 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 4 0 0 0
/proc/18134/statm: 0 0 0 0 0 0 0
[pid=18127/tid=18160] ppid=18106 vsize=396036 CPUtime=0 cores=0-7
/proc/18127/task/18160/stat : 18160 (python) S 18106 18106 17290 0 -1 4202560 49 0 0 0 0 0 0 0 15 0 2 0 549222077 405540864 5780 33554432000 4194304 5683644 140733494302928 18446744073709551615 218382780849 0 0 16781312 514 18446604436739029184 0 0 -1 3 0 0 0
[pid=18129] ppid=18106 vsize=340756 CPUtime=1.63 cores=0-7
/proc/18129/stat : 18129 (python) S 18106 18106 17290 0 -1 4202560 1048 0 0 0 84 79 0 0 15 0 1 0 549170991 348934144 5752 33554432000 4194304 5683644 140733494302928 18446744073709551615 218370977350 0 0 16781312 514 1808635055040332034 0 0 17 0 0 0 0
/proc/18129/statm: 85189 5752 371 364 0 21089 0
[pid=18131] ppid=18129 vsize=76216 CPUtime=465.64 cores=0-7
/proc/18131/stat : 18131 (march_hi) R 18129 18131 18131 0 -1 4202496 14278 0 0 0 46558 6 0 0 25 0 1 0 549170993 78045184 14013 33554432000 4194304 4955518 140737250266512 18446744073709551615 4224648 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/18131/statm: 19054 14013 104 186 0 18867 0
[pid=18132] ppid=18106 vsize=416548 CPUtime=1.65 cores=0-7
/proc/18132/stat : 18132 (python) S 18106 18106 17290 0 -1 4202560 1256 0 0 0 84 81 0 0 15 0 2 0 549170995 426545152 5804 33554432000 4194304 5683644 140733494302928 18446744073709551615 218370977350 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/18132/statm: 104137 5804 407 364 0 40034 0
[pid=18135] ppid=18132 vsize=76216 CPUtime=441.31 cores=0-7
/proc/18135/stat : 18135 (march_hi) R 18132 18135 18135 0 -1 4202496 13586 0 0 0 44129 2 0 0 25 0 1 0 549170996 78045184 13316 33554432000 4194304 4955518 140737084351328 18446744073709551615 4290176 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/18135/statm: 19054 13316 104 186 0 18867 0
[pid=18132/tid=18167] ppid=18106 vsize=416548 CPUtime=0 cores=0-7
/proc/18132/task/18167/stat : 18167 (python) S 18106 18106 17290 0 -1 4202560 47 0 0 0 0 0 0 0 16 0 2 0 549236232 426545152 5804 33554432000 4194304 5683644 140733494302928 18446744073709551615 218382780849 0 0 16781312 514 18446604451827701888 0 0 -1 1 0 0 0
[pid=18140] ppid=18106 vsize=426804 CPUtime=1.46 cores=0-7
/proc/18140/stat : 18140 (python) S 18106 18106 17290 0 -1 4202560 1217 0 0 0 77 69 0 0 15 0 2 0 549180993 437047296 5802 33554432000 4194304 5683644 140733494302928 18446744073709551615 218370977350 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/18140/statm: 106701 5802 400 364 0 42595 0
[pid=18142] ppid=18140 vsize=76216 CPUtime=519.63 cores=0-7
/proc/18142/stat : 18142 (march_hi) R 18140 18142 18142 0 -1 4202496 15633 0 0 0 51955 8 0 0 25 0 1 0 549180993 78045184 15363 33554432000 4194304 4955518 140735537499488 18446744073709551615 4227884 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/18142/statm: 19054 15363 104 186 0 18867 0
[pid=18140/tid=18164] ppid=18106 vsize=426804 CPUtime=0 cores=0-7
/proc/18140/task/18164/stat : 18164 (python) S 18106 18106 17290 0 -1 4202560 47 0 0 0 0 0 0 0 15 0 2 0 549228748 437047296 5802 33554432000 4194304 5683644 140733494302928 18446744073709551615 218382780849 0 0 16781312 514 18446604448595486656 0 0 -1 0 0 0 0
[pid=18146] ppid=18106 vsize=437252 CPUtime=1.19 cores=0-7
/proc/18146/stat : 18146 (python) S 18106 18106 17290 0 -1 4202560 1045 0 0 0 64 55 0 0 18 0 1 0 549185817 447746048 5814 33554432000 4194304 5683644 140733494302928 18446744073709551615 218370977350 0 0 16781312 514 1808635055040332036 0 0 17 0 0 0 0
/proc/18146/statm: 109313 5814 371 364 0 45204 0
[pid=18148] ppid=18146 vsize=182452 CPUtime=425.18 cores=0-7
/proc/18148/stat : 18148 (kcnfs-2006) R 18146 18148 18148 0 -1 4202496 596 0 0 0 42518 0 0 0 25 0 1 0 549185818 186830848 331 33554432000 134512640 135163436 4290014752 18446744073709551615 134595249 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/18148/statm: 45613 331 77 159 0 45453 0
[pid=18106/tid=18113] ppid=18104 vsize=447508 CPUtime=0 cores=0-7
/proc/18106/task/18113/stat : 18113 (python) S 18104 18106 17290 0 -1 4202560 25 931 0 0 0 0 0 0 18 0 11 0 549170968 458248192 7367 33554432000 4194304 5683644 140733494302928 18446744073709551615 218382780849 0 0 16781312 2 18446604436739027392 0 0 -1 0 0 0 0
[pid=18106/tid=18116] ppid=18104 vsize=447508 CPUtime=0 cores=0-7
/proc/18106/task/18116/stat : 18116 (python) S 18104 18106 17290 0 -1 4202560 29 931 0 0 0 0 0 0 18 0 11 0 549170972 458248192 7367 33554432000 4194304 5683644 140733494302928 18446744073709551615 218382780849 0 0 16781312 2 18446604436739027392 0 0 -1 4 0 0 0
[pid=18106/tid=18119] ppid=18104 vsize=447508 CPUtime=0 cores=0-7
/proc/18106/task/18119/stat : 18119 (python) S 18104 18106 17290 0 -1 4202560 28 931 0 0 0 0 0 0 18 0 11 0 549170976 458248192 7367 33554432000 4194304 5683644 140733494302928 18446744073709551615 218382780849 0 0 16781312 2 18446604436739027392 0 0 -1 0 0 0 0
[pid=18106/tid=18122] ppid=18104 vsize=447508 CPUtime=0 cores=0-7
/proc/18106/task/18122/stat : 18122 (python) S 18104 18106 17290 0 -1 4202560 30 931 0 0 0 0 0 0 18 0 11 0 549170980 458248192 7367 33554432000 4194304 5683644 140733494302928 18446744073709551615 218382780849 0 0 16781312 2 18446604436739027392 0 0 -1 0 0 0 0
[pid=18106/tid=18125] ppid=18104 vsize=447508 CPUtime=0 cores=0-7
/proc/18106/task/18125/stat : 18125 (python) S 18104 18106 17290 0 -1 4202560 26 931 0 0 0 0 0 0 20 0 11 0 549170984 458248192 7367 33554432000 4194304 5683644 140733494302928 18446744073709551615 218382780849 0 0 16781312 2 18446604436739027392 0 0 -1 0 0 0 0
[pid=18106/tid=18128] ppid=18104 vsize=447508 CPUtime=0 cores=0-7
/proc/18106/task/18128/stat : 18128 (python) S 18104 18106 17290 0 -1 4202560 46 931 0 0 0 0 0 0 18 0 11 0 549170988 458248192 7367 33554432000 4194304 5683644 140733494302928 18446744073709551615 218382780849 0 0 16781312 2 18446604436739027392 0 0 -1 0 0 0 0
[pid=18106/tid=18130] ppid=18104 vsize=447508 CPUtime=0 cores=0-7
/proc/18106/task/18130/stat : 18130 (python) S 18104 18106 17290 0 -1 4202560 24 931 0 0 0 0 0 0 22 0 11 0 549170991 458248192 7367 33554432000 4194304 5683644 140733494302928 18446744073709551615 218382780849 0 0 16781312 2 18446604436739027392 0 0 -1 0 0 0 0
[pid=18106/tid=18133] ppid=18104 vsize=447508 CPUtime=0 cores=0-7
/proc/18106/task/18133/stat : 18133 (python) S 18104 18106 17290 0 -1 4202560 66 931 0 0 0 0 0 0 18 0 11 0 549170995 458248192 7367 33554432000 4194304 5683644 140733494302928 18446744073709551615 218382780849 0 0 16781312 2 18446604436739027392 0 0 -1 0 0 0 0
[pid=18106/tid=18141] ppid=18104 vsize=447508 CPUtime=0 cores=0-7
/proc/18106/task/18141/stat : 18141 (python) S 18104 18106 17290 0 -1 4202560 32 931 0 0 0 0 0 0 18 0 11 0 549180993 458248192 7367 33554432000 4194304 5683644 140733494302928 18446744073709551615 218382780849 0 0 16781312 2 18446604436739027392 0 0 -1 0 0 0 0
[pid=18106/tid=18147] ppid=18104 vsize=447508 CPUtime=0 cores=0-7
/proc/18106/task/18147/stat : 18147 (python) S 18104 18106 17290 0 -1 4202560 28 931 0 0 0 0 0 0 20 0 11 0 549185818 458248192 7367 33554432000 4194304 5683644 140733494302928 18446744073709551615 218382780849 0 0 16781312 2 18446604436739027392 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4558.28
Current children cumulated vsize (KiB) 6742936

[startup+751.902 s]
/proc/loadavg: 10.08 9.99 9.65 13/308 18169
/proc/meminfo: memFree=6019252/32951124 swapFree=67051472/67111528
[pid=18106] ppid=18104 vsize=447508 CPUtime=2688.38 cores=0-7
/proc/18106/stat : 18106 (python) S 18104 18106 17290 0 -1 4202496 18914 72443 1 0 144 12 268268 414 17 0 11 0 549170892 458248192 7367 33554432000 4194304 5683644 140733494302928 18446744073709551615 218382787391 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/18106/statm: 111877 7367 1894 364 0 47768 0
[pid=18115] ppid=18106 vsize=289344 CPUtime=1.65 cores=0-7
/proc/18115/stat : 18115 (python) S 18106 18106 17290 0 -1 4202560 1161 0 0 0 90 75 0 0 15 0 2 0 549170972 296288256 5747 33554432000 4194304 5683644 140733494302928 18446744073709551615 218370977350 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/18115/statm: 72336 5747 401 364 0 8251 0
[pid=18117] ppid=18115 vsize=76216 CPUtime=529.19 cores=0-7
/proc/18117/stat : 18117 (march_hi) R 18115 18117 18117 0 -1 4202496 15774 0 0 0 52909 10 0 0 25 0 1 0 549170972 78045184 15512 33554432000 4194304 4955518 140735040681200 18446744073709551615 4290007 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/18117/statm: 19054 15512 104 186 0 18867 0
[pid=18115/tid=18162] ppid=18106 vsize=289344 CPUtime=0 cores=0-7
/proc/18115/task/18162/stat : 18162 (python) S 18106 18106 17290 0 -1 4202560 46 0 0 0 0 0 0 0 15 0 2 0 549227725 296288256 5747 33554432000 4194304 5683644 140733494302928 18446744073709551615 218382780849 0 0 16781312 514 18446604453555852416 0 0 -1 7 0 0 0
[pid=18118] ppid=18106 vsize=364848 CPUtime=1.7 cores=0-7
/proc/18118/stat : 18118 (python) S 18106 18106 17290 0 -1 4202560 1168 0 0 0 90 80 0 0 15 0 2 0 549170976 373604352 5680 33554432000 4194304 5683644 140733494302928 18446744073709551615 218382787391 0 0 16781824 2 18446744073709551615 0 0 17 5 0 0 0
/proc/18118/statm: 91212 5680 400 364 0 27124 0
[pid=18120] ppid=18118 vsize=0 CPUtime=646.95 cores=0-7
/proc/18120/stat : 18120 (march_hi) R 18118 18120 18120 0 -1 4203524 18666 0 0 0 64681 14 0 0 25 0 1 0 549170976 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 3 0 0 0
/proc/18120/statm: 0 0 0 0 0 0 0
[pid=18118/tid=18156] ppid=18106 vsize=364848 CPUtime=0 cores=0-7
/proc/18118/task/18156/stat : 18156 (python) S 18106 18106 17290 0 -1 4202560 46 0 0 0 0 0 0 0 15 0 2 0 549210307 373604352 5680 33554432000 4194304 5683644 140733494302928 18446744073709551615 218382780849 0 0 16781824 2 18446604452016486272 0 0 -1 0 0 0 0
[pid=18127] ppid=18106 vsize=0 CPUtime=692.91 cores=0-7
/proc/18127/stat : 18127 (python) Z 18106 18106 17290 0 -1 4202588 1278 19681 0 0 301 118 68866 6 19 0 1 0 549170987 0 0 33554432000 0 0 0 0 0 0 0 16781824 2 18446744073709551615 0 0 17 4 0 0 0
/proc/18127/statm: 0 0 0 0 0 0 0
[pid=18106/tid=18113] ppid=18104 vsize=447508 CPUtime=2686.82 cores=0-7
/proc/18106/task/18113/stat : 18113 (python) S 18104 18106 17290 0 -1 4202560 25 72443 0 0 0 0 268268 414 18 0 11 0 549170968 458248192 7367 33554432000 4194304 5683644 140733494302928 18446744073709551615 218382780849 0 0 16781312 2 18446604436739027392 0 0 -1 0 0 0 0
[pid=18106/tid=18116] ppid=18104 vsize=447508 CPUtime=2686.82 cores=0-7
/proc/18106/task/18116/stat : 18116 (python) S 18104 18106 17290 0 -1 4202560 29 72443 0 0 0 0 268268 414 18 0 11 0 549170972 458248192 7367 33554432000 4194304 5683644 140733494302928 18446744073709551615 218382780849 0 0 16781312 2 18446604436739027392 0 0 -1 4 0 0 0
[pid=18106/tid=18119] ppid=18104 vsize=447508 CPUtime=2686.82 cores=0-7
/proc/18106/task/18119/stat : 18119 (python) S 18104 18106 17290 0 -1 4202560 28 72443 0 0 0 0 268268 414 18 0 11 0 549170976 458248192 7367 33554432000 4194304 5683644 140733494302928 18446744073709551615 218382780849 0 0 16781312 2 18446604436739027392 0 0 -1 0 0 0 0
[pid=18106/tid=18122] ppid=18104 vsize=447508 CPUtime=2686.82 cores=0-7
/proc/18106/task/18122/stat : 18122 (python) S 18104 18106 17290 0 -1 4202560 30 72443 0 0 0 0 268268 414 18 0 11 0 549170980 458248192 7367 33554432000 4194304 5683644 140733494302928 18446744073709551615 218382780849 0 0 16781312 2 18446604436739027392 0 0 -1 0 0 0 0
[pid=18106/tid=18125] ppid=18104 vsize=447508 CPUtime=2686.82 cores=0-7
/proc/18106/task/18125/stat : 18125 (python) S 18104 18106 17290 0 -1 4202560 26 72443 0 0 0 0 268268 414 20 0 11 0 549170984 458248192 7367 33554432000 4194304 5683644 140733494302928 18446744073709551615 218382780849 0 0 16781312 2 18446604436739027392 0 0 -1 0 0 0 0
[pid=18106/tid=18128] ppid=18104 vsize=447508 CPUtime=2686.82 cores=0-7
/proc/18106/task/18128/stat : 18128 (python) S 18104 18106 17290 0 -1 4202560 46 72443 0 0 0 0 268268 414 18 0 11 0 549170988 458248192 7367 33554432000 4194304 5683644 140733494302928 18446744073709551615 218382780849 0 0 16781312 2 18446604436739027392 0 0 -1 0 0 0 0
[pid=18106/tid=18130] ppid=18104 vsize=447508 CPUtime=2686.82 cores=0-7
/proc/18106/task/18130/stat : 18130 (python) S 18104 18106 17290 0 -1 4202560 24 72443 0 0 0 0 268268 414 22 0 11 0 549170991 458248192 7367 33554432000 4194304 5683644 140733494302928 18446744073709551615 218382780849 0 0 16781312 2 18446604436739027392 0 0 -1 0 0 0 0
[pid=18106/tid=18133] ppid=18104 vsize=447508 CPUtime=2686.82 cores=0-7
/proc/18106/task/18133/stat : 18133 (python) S 18104 18106 17290 0 -1 4202560 66 72443 0 0 0 0 268268 414 18 0 11 0 549170995 458248192 7367 33554432000 4194304 5683644 140733494302928 18446744073709551615 218382780849 0 0 16781312 2 18446604436739027392 0 0 -1 0 0 0 0
[pid=18106/tid=18141] ppid=18104 vsize=447508 CPUtime=2686.82 cores=0-7
/proc/18106/task/18141/stat : 18141 (python) S 18104 18106 17290 0 -1 4202560 32 72443 0 0 0 0 268268 414 18 0 11 0 549180993 458248192 7367 33554432000 4194304 5683644 140733494302928 18446744073709551615 218382780849 0 0 16781312 2 18446604436739027392 0 0 -1 0 0 0 0
[pid=18106/tid=18147] ppid=18104 vsize=447508 CPUtime=2686.82 cores=0-7
/proc/18106/task/18147/stat : 18147 (python) S 18104 18106 17290 0 -1 4202560 28 72443 0 0 0 0 268268 414 20 0 11 0 549185818 458248192 7367 33554432000 4194304 5683644 140733494302928 18446744073709551615 218382780849 0 0 16781312 2 18446604436739027392 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4560.78
Current children cumulated vsize (KiB) 1177916

Child status: 0
Real time (s): 751.933
CPU time (s): 4560.91
CPU user time (s): 4553.55
CPU system time (s): 7.35188
CPU usage (%): 606.557
Max. virtual memory (cumulated for all children) (KiB): 6833856

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4553.55
system time used= 7.35188
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 153138
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 12057
involuntary context switches= 37260

runsolver used 3.63645 second user time and 9.2096 second system time

The end

Launcher Data 

Begin job on node101 at 2011-05-03 00:34:41
IDJOB=3322191
IDBENCH=82969
IDSOLVER=1712
FILE ID=node101/3322191-1304375681
RUNJOBID= node101-1304370010-17304
PBS_JOBID= 13181771
Free space on /tmp= 73084 MiB

SOLVER NAME= borg-sat 11.03.02-random
BENCH NAME= SAT11/random/medium/unif-k3-r4.26-v500-c2130-S1205196501-095.UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3322191-1304375681/watcher-3322191-1304375681 -o /tmp/evaluation-result-3322191-1304375681/solver-3322191-1304375681 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3322191-1304375681.cnf -seed 502575091 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= b1bf2be38e1cea16efc5e7effa1a10c7
RANDOM SEED=502575091

node101.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.841
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.841
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.841
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.841
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.841
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.841
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.841
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.841
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:       6470152 kB
Buffers:        258048 kB
Cached:        2422096 kB
SwapCached:      23472 kB
Active:       23883256 kB
Inactive:      2250336 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:       6470152 kB
SwapTotal:    67111528 kB
SwapFree:     67051472 kB
Dirty:           31832 kB
Writeback:           0 kB
AnonPages:    23452744 kB
Mapped:          22248 kB
Slab:           222892 kB
PageTables:      58916 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 35853572 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73052 MiB
End job on node101 at 2011-05-03 00:47:13