Trace number 3378169

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-par-random (fixed)? 4752.88 1201.73

General information on the benchmark

Namerandom/large/
unif-k3-r4.2-v40000-c168000-S471691933-060-UNKNOWN.cnf
MD5SUM91da78a39fd68b6c63602d278464956f
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables40000
Number of clauses168000
Sum of the clauses size504000
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 3168000
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.29/1.67	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.29/1.68	c INFO: solving HOME/instance-3378169-1305463315.cnf
0.29/1.68	c INFO: computing task features
0.87/2.27	c INFO: computed variable-clause graph statistics
0.87/2.29	c INFO: computed clause balance statistics
3.88/5.25	c INFO: computed variable balance statistics
6.27/7.68	c INFO: computed small-clause counts
6.27/7.70	c INFO: computed Horn-clause counts
8.37/9.71	c INFO: computed variable graph statistics
8.37/9.71	c INFO: collected features for HOME/instance-3378169-1305463315.cnf in 8.00 s
8.37/9.71	c INFO: running hybridGM3@0 for 97 with 1191 remaining (b = 0.35)
8.37/9.73	c INFO: running hybridGM3@0 for 97 with 1191 remaining (b = 0.21)
8.37/9.74	c INFO: running hybridGM3@0 for 97 with 1191 remaining (b = 0.14)
8.37/9.75	c INFO: running hybridGM3@0 for 194 with 1191 remaining (b = 0.18)
409.55/110.34	c INFO: running hybridGM3@0 for 97 with 1091 remaining (b = 0.08)
409.55/110.36	c INFO: running hybridGM3@0 for 97 with 1091 remaining (b = 0.08)
409.55/110.38	c INFO: running hybridGM3@0 for 97 with 1091 remaining (b = 0.08)
789.36/205.57	c INFO: running hybridGM3@99 for 97 with 996 remaining (b = 0.08)
789.36/205.59	c INFO: running hybridGM3@100 for 97 with 996 remaining (b = 0.08)
789.76/205.60	c INFO: running hybridGM3@93 for 97 with 996 remaining (b = 0.08)
805.32/209.58	c INFO: running hybridGM3@100 for 97 with 992 remaining (b = 0.08)
1185.46/304.80	c INFO: running TNM@0 for 97 with 896 remaining (b = 0.10)
1185.46/304.84	c INFO: running hybridGM3@0 for 97 with 896 remaining (b = 0.07)
1193.42/306.80	c INFO: running hybridGM3@0 for 194 with 894 remaining (b = 0.09)
1193.42/306.83	c INFO: running hybridGM3@192 for 97 with 894 remaining (b = 0.04)
1573.06/402.06	c INFO: running hybridGM3@0 for 194 with 799 remaining (b = 0.07)
1584.96/405.05	c INFO: running hybridGM3@294 for 97 with 796 remaining (b = 0.03)
1586.99/405.55	c INFO: running hybridGM3@99 for 97 with 796 remaining (b = 0.03)
1965.74/500.78	c INFO: running TNM@0 for 97 with 700 remaining (b = 0.03)
1971.70/502.30	c INFO: running hybridGM3@0 for 194 with 699 remaining (b = 0.05)
2001.52/509.78	c INFO: running hybridGM3@101 for 97 with 691 remaining (b = 0.02)
2352.90/598.02	c INFO: running hybridGM3@99 for 97 with 603 remaining (b = 0.02)
2364.81/601.04	c INFO: running hybridGM3@0 for 194 with 600 remaining (b = 0.04)
2380.68/605.01	c INFO: running hybridGM3@297 for 97 with 596 remaining (b = 0.02)
2755.56/699.29	c INFO: running TNM@98 for 502 with 502 remaining (b = 0.08)
2759.51/700.25	c INFO: running TNM@0 for 97 with 501 remaining (b = 0.02)
2779.37/705.29	c INFO: running hybridGM3@0 for 194 with 496 remaining (b = 0.03)
3148.59/798.07	c INFO: running hybridGM3@94 for 97 with 403 remaining (b = 0.01)
3178.44/805.54	c INFO: running TNM@198 for 396 with 396 remaining (b = 0.05)
3551.60/899.33	c INFO: running TNM@0 for 97 with 302 remaining (b = 0.01)
3563.11/902.27	c INFO: running hybridGM3@395 for 97 with 299 remaining (b = 0.01)
3950.13/999.54	c INFO: running hybridGM3@0 for 202 with 202 remaining (b = 0.02)
3950.46/999.63	c INFO: running hybridGM3@398 for 97 with 202 remaining (b = 0.01)
4336.24/1096.89	c INFO: running TNM@0 for 104 with 104 remaining (b = 0.01)
4752.80/1201.70	s UNKNOWN

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3378169-1305463315/watcher-3378169-1305463315 -o /tmp/evaluation-result-3378169-1305463315/solver-3378169-1305463315 -C 4800 -W 1300 -M 15500 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3378169-1305463315.cnf -seed 2037844210 -budget 4800 -cores 4 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.12 3.83 3.85 5/304 18195
/proc/meminfo: memFree=20573016/32951124 swapFree=66457188/67111528
[pid=18195] ppid=18192 vsize=15776 CPUtime=0 cores=0,2,4,6
/proc/18195/stat : 18195 (python) R 18192 18195 18093 0 -1 4202496 899 0 0 0 0 0 0 0 25 0 1 0 657929677 16154624 780 33554432000 4194304 5683644 140735315942128 18446744073709551615 232335553221 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/18195/statm: 3944 782 345 364 0 431 0

[startup+0.840947 s]
/proc/loadavg: 3.12 3.83 3.85 5/304 18195
/proc/meminfo: memFree=20573016/32951124 swapFree=66457188/67111528
[pid=18195] ppid=18192 vsize=85364 CPUtime=0.05 cores=0,2,4,6
/proc/18195/stat : 18195 (python) D 18192 18195 18093 0 -1 4202496 2583 0 0 0 4 1 0 0 18 0 1 0 657929677 87412736 2308 33554432000 4194304 5683644 140735315942128 18446744073709551615 232335898167 0 0 16781312 2 18446744071562154983 0 0 17 6 0 0 0
/proc/18195/statm: 21341 2308 707 364 0 1558 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 85364

[startup+0.900936 s]
/proc/loadavg: 3.12 3.83 3.85 5/304 18195
/proc/meminfo: memFree=20573016/32951124 swapFree=66457188/67111528
[pid=18195] ppid=18192 vsize=85364 CPUtime=0.05 cores=0,2,4,6
/proc/18195/stat : 18195 (python) D 18192 18195 18093 0 -1 4202496 2583 0 0 0 4 1 0 0 18 0 1 0 657929677 87412736 2308 33554432000 4194304 5683644 140735315942128 18446744073709551615 232335898167 0 0 16781312 2 18446744071562154983 0 0 17 6 0 0 0
/proc/18195/statm: 21341 2308 707 364 0 1558 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 85364

[startup+1.00092 s]
/proc/loadavg: 3.12 3.83 3.85 5/304 18195
/proc/meminfo: memFree=20573016/32951124 swapFree=66457188/67111528
[pid=18195] ppid=18192 vsize=85364 CPUtime=0.05 cores=0,2,4,6
/proc/18195/stat : 18195 (python) D 18192 18195 18093 0 -1 4202496 2583 0 0 0 4 1 0 0 18 0 1 0 657929677 87412736 2308 33554432000 4194304 5683644 140735315942128 18446744073709551615 232335898167 0 0 16781312 2 18446744071562154983 0 0 17 6 0 0 0
/proc/18195/statm: 21341 2308 707 364 0 1558 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 85364

[startup+1.1009 s]
/proc/loadavg: 3.12 3.83 3.85 5/304 18195
/proc/meminfo: memFree=20573016/32951124 swapFree=66457188/67111528
[pid=18195] ppid=18192 vsize=85364 CPUtime=0.05 cores=0,2,4,6
/proc/18195/stat : 18195 (python) D 18192 18195 18093 0 -1 4202496 2583 0 0 0 4 1 0 0 18 0 1 0 657929677 87412736 2308 33554432000 4194304 5683644 140735315942128 18446744073709551615 232335898167 0 0 16781312 2 18446744071562154983 0 0 17 6 0 0 0
/proc/18195/statm: 21341 2308 707 364 0 1558 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 85364

[startup+1.50081 s]
/proc/loadavg: 3.12 3.83 3.85 5/304 18195
/proc/meminfo: memFree=20573016/32951124 swapFree=66457188/67111528
[pid=18195] ppid=18192 vsize=157384 CPUtime=0.22 cores=0,2,4,6
/proc/18195/stat : 18195 (python) S 18192 18195 18093 0 -1 4202496 6586 936 1 0 17 5 0 0 18 0 1 0 657929677 161161216 4695 33554432000 4194304 5683644 140735315942128 18446744073709551615 232335890432 0 2147483391 16781312 2 18446744071699453118 0 0 17 6 0 0 120
/proc/18195/statm: 39346 4695 1257 364 0 3454 0
Current children cumulated CPU time (s) 0.22
Current children cumulated vsize (KiB) 157384

[startup+3.10055 s]
/proc/loadavg: 3.27 3.85 3.86 6/305 18201
/proc/meminfo: memFree=20503492/32951124 swapFree=66457188/67111528
[pid=18195] ppid=18192 vsize=317988 CPUtime=1.77 cores=0,2,4,6
/proc/18195/stat : 18195 (python) R 18192 18195 18093 0 -1 4202496 23796 936 1 0 168 9 0 0 21 0 1 0 657929677 325619712 16881 33554432000 4194304 5683644 140735315942128 18446744073709551615 4940555 0 0 16781312 2 0 0 0 17 4 0 0 120
/proc/18195/statm: 79497 16881 1826 364 0 15421 0
Current children cumulated CPU time (s) 1.77
Current children cumulated vsize (KiB) 317988
heavy processes:

[startup+6.31099 s]
/proc/loadavg: 3.27 3.85 3.86 6/305 18201
/proc/meminfo: memFree=20502036/32951124 swapFree=66457188/67111528
[pid=18195] ppid=18192 vsize=317988 CPUtime=4.98 cores=0,2,4,6
/proc/18195/stat : 18195 (python) R 18192 18195 18093 0 -1 4202496 23797 936 1 0 489 9 0 0 25 0 1 0 657929677 325619712 16882 33554432000 4194304 5683644 140735315942128 18446744073709551615 4570176 0 0 16781312 2 0 0 0 17 4 0 0 120
/proc/18195/statm: 79497 16882 1827 364 0 15421 0
Current children cumulated CPU time (s) 4.98
Current children cumulated vsize (KiB) 317988
heavy processes:

[startup+12.7008 s]
/proc/loadavg: 3.41 3.87 3.86 9/317 18216
/proc/meminfo: memFree=20358596/32951124 swapFree=66457188/67111528
[pid=18195] ppid=18192 vsize=355896 CPUtime=8.42 cores=0,2,4,6
/proc/18195/stat : 18195 (python) S 18192 18195 18093 0 -1 4202496 26562 936 1 0 832 10 0 0 24 0 5 0 657929677 364437504 16162 33554432000 4194304 5683644 140735315942128 18446744073709551615 232347719115 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 120
/proc/18195/statm: 88974 16162 1873 364 0 24883 0
[pid=18202] ppid=18195 vsize=314884 CPUtime=0 cores=0,2,4,6
/proc/18202/stat : 18202 (python) S 18195 18195 18093 0 -1 4202560 734 0 0 0 0 0 0 0 15 0 1 0 657930649 322441216 14626 33554432000 4194304 5683644 140735315942128 18446744073709551615 232335912463 0 0 16781312 514 546941068415828228 0 0 17 6 0 0 0
/proc/18202/statm: 78721 14626 353 364 0 14639 0
[pid=18205] ppid=18202 vsize=276240 CPUtime=2.97 cores=0,2,4,6
/proc/18205/stat : 18205 (hybridGM3) R 18202 18205 18205 0 -1 4202496 8562 0 0 0 296 1 0 0 25 0 1 0 657930650 282869760 8297 33554432000 134512640 135204385 4290228624 18446744073709551615 134536952 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/18205/statm: 69060 8297 64 169 0 68890 0
[pid=18207] ppid=18195 vsize=325140 CPUtime=0 cores=0,2,4,6
/proc/18207/stat : 18207 (python) S 18195 18195 18093 0 -1 4202560 737 0 0 0 0 0 0 0 15 0 1 0 657930650 332943360 14624 33554432000 4194304 5683644 140735315942128 18446744073709551615 232335912518 0 0 16781312 514 10815319742634492161 0 0 17 4 0 0 0
/proc/18207/statm: 81285 14624 347 364 0 17200 0
[pid=18209] ppid=18207 vsize=276240 CPUtime=2.93 cores=0,2,4,6
/proc/18209/stat : 18209 (hybridGM3) R 18207 18209 18209 0 -1 4202496 8556 0 0 0 292 1 0 0 25 0 1 0 657930651 282869760 8295 33554432000 134512640 135204385 4294620304 18446744073709551615 134537483 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/18209/statm: 69060 8295 64 169 0 68890 0
[pid=18210] ppid=18195 vsize=335396 CPUtime=0 cores=0,2,4,6
/proc/18210/stat : 18210 (python) S 18195 18195 18093 0 -1 4202560 743 0 0 0 0 0 0 0 15 0 1 0 657930651 343445504 14628 33554432000 4194304 5683644 140735315942128 18446744073709551615 232335912518 0 0 16781312 514 15819461043433734403 0 0 17 2 0 0 0
/proc/18210/statm: 83849 14628 347 364 0 19761 0
[pid=18212] ppid=18210 vsize=276244 CPUtime=2.94 cores=0,2,4,6
/proc/18212/stat : 18212 (hybridGM3) R 18210 18212 18212 0 -1 4202496 8561 0 0 0 293 1 0 0 25 0 1 0 657930652 282873856 8300 33554432000 134512640 135204385 4294502704 18446744073709551615 134545874 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/18212/statm: 69061 8300 64 169 0 68891 0
[pid=18214] ppid=18195 vsize=345652 CPUtime=0 cores=0,2,4,6
/proc/18214/stat : 18214 (python) S 18195 18195 18093 0 -1 4202560 751 0 0 0 0 0 0 0 15 0 1 0 657930653 353947648 14632 33554432000 4194304 5683644 140735315942128 18446744073709551615 232335912518 0 0 16781312 514 12851316210112889092 0 0 17 4 0 0 0
/proc/18214/statm: 86413 14632 347 364 0 22322 0
[pid=18216] ppid=18214 vsize=276244 CPUtime=2.93 cores=0,2,4,6
/proc/18216/stat : 18216 (hybridGM3) R 18214 18216 18216 0 -1 4202496 8560 0 0 0 293 0 0 0 25 0 1 0 657930653 282873856 8300 33554432000 134512640 135204385 4287212080 18446744073709551615 134545968 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/18216/statm: 69061 8300 64 169 0 68891 0
[pid=18195/tid=18204] ppid=18192 vsize=355896 CPUtime=0 cores=0,2,4,6
/proc/18195/task/18204/stat : 18204 (python) S 18192 18195 18093 0 -1 4202560 28 936 0 0 0 0 0 0 25 0 5 0 657930649 364437504 16162 33554432000 4194304 5683644 140735315942128 18446744073709551615 232347716017 0 0 16781312 2 18446604453684229440 0 0 -1 2 0 0 0
[pid=18195/tid=18208] ppid=18192 vsize=355896 CPUtime=0 cores=0,2,4,6
/proc/18195/task/18208/stat : 18208 (python) S 18192 18195 18093 0 -1 4202560 25 936 0 0 0 0 0 0 20 0 5 0 657930651 364437504 16162 33554432000 4194304 5683644 140735315942128 18446744073709551615 232347716017 0 0 16781312 2 18446604453684229440 0 0 -1 4 0 0 0
[pid=18195/tid=18211] ppid=18192 vsize=355896 CPUtime=0 cores=0,2,4,6
/proc/18195/task/18211/stat : 18211 (python) S 18192 18195 18093 0 -1 4202560 25 936 0 0 0 0 0 0 22 0 5 0 657930652 364437504 16162 33554432000 4194304 5683644 140735315942128 18446744073709551615 232347716017 0 0 16781312 2 18446604453684229440 0 0 -1 4 0 0 0
[pid=18195/tid=18215] ppid=18192 vsize=355896 CPUtime=0 cores=0,2,4,6
/proc/18195/task/18215/stat : 18215 (python) S 18192 18195 18093 0 -1 4202560 30 936 0 0 0 0 0 0 25 0 5 0 657930653 364437504 16162 33554432000 4194304 5683644 140735315942128 18446744073709551615 232347716017 0 0 16781312 2 18446604453684229440 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 20.19
Current children cumulated vsize (KiB) 2781936

[startup+25.5015 s]
/proc/loadavg: 4.49 4.08 3.93 9/317 18217
/proc/meminfo: memFree=20357568/32951124 swapFree=66457188/67111528
[pid=18195] ppid=18192 vsize=355896 CPUtime=8.42 cores=0,2,4,6
/proc/18195/stat : 18195 (python) S 18192 18195 18093 0 -1 4202496 26562 936 1 0 832 10 0 0 24 0 5 0 657929677 364437504 16162 33554432000 4194304 5683644 140735315942128 18446744073709551615 232347719115 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 120
/proc/18195/statm: 88974 16162 1873 364 0 24883 0
[pid=18202] ppid=18195 vsize=314884 CPUtime=0.02 cores=0,2,4,6
/proc/18202/stat : 18202 (python) S 18195 18195 18093 0 -1 4202560 893 0 0 0 1 1 0 0 15 0 1 0 657930649 322441216 14649 33554432000 4194304 5683644 140735315942128 18446744073709551615 232335912463 0 0 16781312 514 15790693416909635844 0 0 17 6 0 0 0
/proc/18202/statm: 78721 14649 376 364 0 14639 0
[pid=18205] ppid=18202 vsize=276240 CPUtime=15.77 cores=0,2,4,6
/proc/18205/stat : 18205 (hybridGM3) R 18202 18205 18205 0 -1 4202496 8566 0 0 0 1576 1 0 0 25 0 1 0 657930650 282869760 8301 33554432000 134512640 135204385 4290228624 18446744073709551615 134545844 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/18205/statm: 69060 8301 64 169 0 68890 0
[pid=18207] ppid=18195 vsize=325140 CPUtime=0.02 cores=0,2,4,6
/proc/18207/stat : 18207 (python) S 18195 18195 18093 0 -1 4202560 916 0 0 0 1 1 0 0 15 0 1 0 657930650 332943360 14647 33554432000 4194304 5683644 140735315942128 18446744073709551615 232335912518 0 0 16781312 514 15790693416909635841 0 0 17 4 0 0 0
/proc/18207/statm: 81285 14647 370 364 0 17200 0
[pid=18209] ppid=18207 vsize=276240 CPUtime=15.58 cores=0,2,4,6
/proc/18209/stat : 18209 (hybridGM3) R 18207 18209 18209 0 -1 4202496 8558 0 0 0 1557 1 0 0 25 0 1 0 657930651 282869760 8297 33554432000 134512640 135204385 4294620304 18446744073709551615 134537123 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/18209/statm: 69060 8297 64 169 0 68890 0
[pid=18210] ppid=18195 vsize=335396 CPUtime=0.02 cores=0,2,4,6
/proc/18210/stat : 18210 (python) S 18195 18195 18093 0 -1 4202560 907 0 0 0 1 1 0 0 15 0 1 0 657930651 343445504 14651 33554432000 4194304 5683644 140735315942128 18446744073709551615 232335912518 0 0 16781312 514 15790693416909635843 0 0 17 2 0 0 0
/proc/18210/statm: 83849 14651 370 364 0 19761 0
[pid=18212] ppid=18210 vsize=276244 CPUtime=15.72 cores=0,2,4,6
/proc/18212/stat : 18212 (hybridGM3) R 18210 18212 18212 0 -1 4202496 8561 0 0 0 1571 1 0 0 25 0 1 0 657930652 282873856 8300 33554432000 134512640 135204385 4294502704 18446744073709551615 134536744 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/18212/statm: 69061 8300 64 169 0 68891 0
[pid=18214] ppid=18195 vsize=345652 CPUtime=0.02 cores=0,2,4,6
/proc/18214/stat : 18214 (python) S 18195 18195 18093 0 -1 4202560 915 0 0 0 1 1 0 0 15 0 1 0 657930653 353947648 14655 33554432000 4194304 5683644 140735315942128 18446744073709551615 232335912518 0 0 16781312 514 15790693416909635844 0 0 17 4 0 0 0
/proc/18214/statm: 86413 14655 370 364 0 22322 0
[pid=18216] ppid=18214 vsize=276244 CPUtime=15.67 cores=0,2,4,6
/proc/18216/stat : 18216 (hybridGM3) R 18214 18216 18216 0 -1 4202496 8560 0 0 0 1567 0 0 0 25 0 1 0 657930653 282873856 8300 33554432000 134512640 135204385 4287212080 18446744073709551615 134536993 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/18216/statm: 69061 8300 64 169 0 68891 0
[pid=18195/tid=18204] ppid=18192 vsize=355896 CPUtime=0 cores=0,2,4,6
/proc/18195/task/18204/stat : 18204 (python) S 18192 18195 18093 0 -1 4202560 28 936 0 0 0 0 0 0 25 0 5 0 657930649 364437504 16162 33554432000 4194304 5683644 140735315942128 18446744073709551615 232347716017 0 0 16781312 2 18446604453684229440 0 0 -1 2 0 0 0
[pid=18195/tid=18208] ppid=18192 vsize=355896 CPUtime=0 cores=0,2,4,6
/proc/18195/task/18208/stat : 18208 (python) S 18192 18195 18093 0 -1 4202560 25 936 0 0 0 0 0 0 20 0 5 0 657930651 364437504 16162 33554432000 4194304 5683644 140735315942128 18446744073709551615 232347716017 0 0 16781312 2 18446604453684229440 0 0 -1 4 0 0 0
[pid=18195/tid=18211] ppid=18192 vsize=355896 CPUtime=0 cores=0,2,4,6
/proc/18195/task/18211/stat : 18211 (python) S 18192 18195 18093 0 -1 4202560 25 936 0 0 0 0 0 0 22 0 5 0 657930652 364437504 16162 33554432000 4194304 5683644 140735315942128 18446744073709551615 232347716017 0 0 16781312 2 18446604453684229440 0 0 -1 4 0 0 0
[pid=18195/tid=18215] ppid=18192 vsize=355896 CPUtime=0 cores=0,2,4,6
/proc/18195/task/18215/stat : 18215 (python) S 18192 18195 18093 0 -1 4202560 30 936 0 0 0 0 0 0 25 0 5 0 657930653 364437504 16162 33554432000 4194304 5683644 140735315942128 18446744073709551615 232347716017 0 0 16781312 2 18446604453684229440 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 71.24
Current children cumulated vsize (KiB) 2781936

[startup+51.101 s]
/proc/loadavg: 5.83 4.43 4.05 9/317 18217
/proc/meminfo: memFree=20357080/32951124 swapFree=66457188/67111528
[pid=18195] ppid=18192 vsize=355896 CPUtime=8.42 cores=0,2,4,6
/proc/18195/stat : 18195 (python) S 18192 18195 18093 0 -1 4202496 26562 936 1 0 832 10 0 0 24 0 5 0 657929677 364437504 16162 33554432000 4194304 5683644 140735315942128 18446744073709551615 232347719115 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 120
/proc/18195/statm: 88974 16162 1873 364 0 24883 0
[pid=18202] ppid=18195 vsize=314884 CPUtime=0.08 cores=0,2,4,6
/proc/18202/stat : 18202 (python) S 18195 18195 18093 0 -1 4202560 904 0 0 0 5 3 0 0 15 0 1 0 657930649 322441216 14649 33554432000 4194304 5683644 140735315942128 18446744073709551615 232335912463 0 0 16781312 514 15790693416909635844 0 0 17 6 0 0 0
/proc/18202/statm: 78721 14649 376 364 0 14639 0
[pid=18205] ppid=18202 vsize=276240 CPUtime=41.37 cores=0,2,4,6
/proc/18205/stat : 18205 (hybridGM3) R 18202 18205 18205 0 -1 4202496 8566 0 0 0 4136 1 0 0 25 0 1 0 657930650 282869760 8301 33554432000 134512640 135204385 4290228624 18446744073709551615 134545968 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/18205/statm: 69060 8301 64 169 0 68890 0
[pid=18207] ppid=18195 vsize=325140 CPUtime=0.09 cores=0,2,4,6
/proc/18207/stat : 18207 (python) S 18195 18195 18093 0 -1 4202560 929 0 0 0 4 5 0 0 15 0 1 0 657930650 332943360 14647 33554432000 4194304 5683644 140735315942128 18446744073709551615 232335912518 0 0 16781312 514 15790693416909635841 0 0 17 4 0 0 0
/proc/18207/statm: 81285 14647 370 364 0 17200 0
[pid=18209] ppid=18207 vsize=276240 CPUtime=40.86 cores=0,2,4,6
/proc/18209/stat : 18209 (hybridGM3) R 18207 18209 18209 0 -1 4202496 8561 0 0 0 4085 1 0 0 25 0 1 0 657930651 282869760 8300 33554432000 134512640 135204385 4294620304 18446744073709551615 134546082 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/18209/statm: 69060 8300 64 169 0 68890 0
[pid=18210] ppid=18195 vsize=335396 CPUtime=0.09 cores=0,2,4,6
/proc/18210/stat : 18210 (python) S 18195 18195 18093 0 -1 4202560 920 0 0 0 4 5 0 0 16 0 1 0 657930651 343445504 14651 33554432000 4194304 5683644 140735315942128 18446744073709551615 232335912518 0 0 16781312 514 15790693416909635843 0 0 17 2 0 0 0
/proc/18210/statm: 83849 14651 370 364 0 19761 0
[pid=18212] ppid=18210 vsize=276244 CPUtime=41.24 cores=0,2,4,6
/proc/18212/stat : 18212 (hybridGM3) R 18210 18212 18212 0 -1 4202496 8565 0 0 0 4123 1 0 0 25 0 1 0 657930652 282873856 8304 33554432000 134512640 135204385 4294502704 18446744073709551615 134536887 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/18212/statm: 69061 8304 64 169 0 68891 0
[pid=18214] ppid=18195 vsize=345652 CPUtime=0.09 cores=0,2,4,6

################
# More data... #
################

[pid=18285] ppid=18195 vsize=355908 CPUtime=1.58 cores=0,2,4,6
/proc/18285/stat : 18285 (python) S 18195 18195 18093 0 -1 4202560 1154 0 0 0 85 73 0 0 18 0 2 0 657960157 364449792 14689 33554432000 4194304 5683644 140735315942128 18446744073709551615 232335912518 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/18285/statm: 88977 14689 399 364 0 24883 0
[pid=18287] ppid=18285 vsize=467024 CPUtime=602.04 cores=0,2,4,6
/proc/18287/stat : 18287 (TNM) R 18285 18287 18287 0 -1 4202496 6817 0 0 0 60202 2 0 0 25 0 1 0 657960158 478232576 6558 33554432000 134512640 135008748 4293190928 18446744073709551615 134527526 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/18287/statm: 116756 6558 46 122 0 115656 0
[pid=18285/tid=18308] ppid=18195 vsize=355908 CPUtime=0 cores=0,2,4,6
/proc/18285/task/18308/stat : 18308 (python) S 18195 18195 18093 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 657970182 364449792 14689 33554432000 4194304 5683644 140735315942128 18446744073709551615 232347716017 0 0 16781312 514 18446604449919296832 0 0 -1 4 0 0 0
[pid=18288] ppid=18195 vsize=366164 CPUtime=0.49 cores=0,2,4,6
/proc/18288/stat : 18288 (python) S 18195 18195 18093 0 -1 4202560 1149 0 0 0 26 23 0 0 16 0 2 0 657960162 374951936 14693 33554432000 4194304 5683644 140735315942128 18446744073709551615 232347719115 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/18288/statm: 91541 14693 399 364 0 27444 0
[pid=18291] ppid=18288 vsize=276240 CPUtime=195.7 cores=0,2,4,6
/proc/18291/stat : 18291 (hybridGM3) T 18288 18291 18291 0 -1 4202496 8565 0 0 0 19569 1 0 0 25 0 1 0 657960163 282869760 8306 33554432000 134512640 135204385 4294867008 18446744073709551615 134537322 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/18291/statm: 69060 8306 64 169 0 68890 0
[pid=18288/tid=18309] ppid=18195 vsize=366164 CPUtime=0 cores=0,2,4,6
/proc/18288/task/18309/stat : 18309 (python) S 18195 18195 18093 0 -1 4202560 50 0 0 0 0 0 0 0 15 0 2 0 657970232 374951936 14693 33554432000 4194304 5683644 140735315942128 18446744073709551615 232347716017 0 0 16781312 514 18446604449919297728 0 0 -1 2 0 0 0
[pid=18292] ppid=18195 vsize=376420 CPUtime=1.26 cores=0,2,4,6
/proc/18292/stat : 18292 (python) S 18195 18195 18093 0 -1 4202560 1156 0 0 0 68 58 0 0 15 0 2 0 657960358 385454080 14697 33554432000 4194304 5683644 140735315942128 18446744073709551615 232347719115 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/18292/statm: 94105 14697 399 364 0 30005 0
[pid=18295] ppid=18292 vsize=276236 CPUtime=485.85 cores=0,2,4,6
/proc/18295/stat : 18295 (hybridGM3) T 18292 18295 18295 0 -1 4202496 8560 0 0 0 48581 4 0 0 25 0 1 0 657960358 282865664 8300 33554432000 134512640 135204385 4288016336 18446744073709551615 134537331 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/18295/statm: 69059 8300 64 169 0 68889 0
[pid=18292/tid=18322] ppid=18195 vsize=376420 CPUtime=0 cores=0,2,4,6
/proc/18292/task/18322/stat : 18322 (python) S 18195 18195 18093 0 -1 4202560 50 0 0 0 0 0 0 0 15 0 2 0 657980655 385454080 14697 33554432000 4194304 5683644 140735315942128 18446744073709551615 232347716017 0 0 16781312 514 18446604449460671744 0 0 -1 2 0 0 0
[pid=18304] ppid=18195 vsize=386676 CPUtime=0.74 cores=0,2,4,6
/proc/18304/stat : 18304 (python) S 18195 18195 18093 0 -1 4202560 1202 0 0 0 39 35 0 0 15 0 2 0 657969884 395956224 14707 33554432000 4194304 5683644 140735315942128 18446744073709551615 232347719115 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/18304/statm: 96669 14707 405 364 0 32566 0
[pid=18306] ppid=18304 vsize=276240 CPUtime=296.85 cores=0,2,4,6
/proc/18306/stat : 18306 (hybridGM3) T 18304 18306 18306 0 -1 4202496 8577 0 0 0 29682 3 0 0 25 0 1 0 657969884 282869760 8308 33554432000 134512640 135204385 4290118224 18446744073709551615 134537292 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/18306/statm: 69060 8308 64 169 0 68890 0
[pid=18304/tid=18325] ppid=18195 vsize=386676 CPUtime=0 cores=0,2,4,6
/proc/18304/task/18325/stat : 18325 (python) S 18195 18195 18093 0 -1 4202560 52 0 0 0 0 0 0 0 15 0 2 0 657989479 395956224 14707 33554432000 4194304 5683644 140735315942128 18446744073709551615 232347716017 0 0 16781312 514 18446604453808748672 0 0 -1 0 0 0 0
[pid=18315] ppid=18195 vsize=396932 CPUtime=0.25 cores=0,2,4,6
/proc/18315/stat : 18315 (python) S 18195 18195 18093 0 -1 4202560 1145 0 0 0 12 13 0 0 19 0 2 0 657979756 406458368 14711 33554432000 4194304 5683644 140735315942128 18446744073709551615 232347719115 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/18315/statm: 99233 14711 405 364 0 35127 0
[pid=18317] ppid=18315 vsize=467024 CPUtime=99.74 cores=0,2,4,6
/proc/18317/stat : 18317 (TNM) T 18315 18317 18317 0 -1 4202496 6825 0 0 0 9973 1 0 0 25 0 1 0 657979757 478232576 6558 33554432000 134512640 135008748 4290865824 18446744073709551615 134528974 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/18317/statm: 116756 6558 46 122 0 115656 0
[pid=18315/tid=18337] ppid=18195 vsize=396932 CPUtime=0 cores=0,2,4,6
/proc/18315/task/18337/stat : 18337 (python) S 18195 18195 18093 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 657989781 406458368 14711 33554432000 4194304 5683644 140735315942128 18446744073709551615 232347716017 0 0 16781312 514 18446604449919295936 0 0 -1 2 0 0 0
[pid=18318] ppid=18195 vsize=407188 CPUtime=0.51 cores=0,2,4,6
/proc/18318/stat : 18318 (python) S 18195 18195 18093 0 -1 4202560 1149 0 0 0 29 22 0 0 16 0 2 0 657979908 416960512 14709 33554432000 4194304 5683644 140735315942128 18446744073709551615 232347719115 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/18318/statm: 101797 14709 399 364 0 37688 0
[pid=18320] ppid=18318 vsize=276236 CPUtime=198.87 cores=0,2,4,6
/proc/18320/stat : 18320 (hybridGM3) T 18318 18320 18320 0 -1 4202496 8569 0 0 0 19885 2 0 0 25 0 1 0 657979908 282865664 8303 33554432000 134512640 135204385 4288842544 18446744073709551615 134536929 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/18320/statm: 69059 8303 64 169 0 68889 0
[pid=18318/tid=18406] ppid=18195 vsize=407188 CPUtime=0 cores=0,2,4,6
/proc/18318/task/18406/stat : 18406 (python) S 18195 18195 18093 0 -1 4202560 48 0 0 0 0 0 0 0 16 0 2 0 658000206 416960512 14709 33554432000 4194304 5683644 140735315942128 18446744073709551615 232347716017 0 0 16781312 514 18446604444527001920 0 0 -1 0 0 0 0
[pid=18338] ppid=18195 vsize=417444 CPUtime=0.76 cores=0,2,4,6
/proc/18338/stat : 18338 (python) S 18195 18195 18093 0 -1 4202560 1177 0 0 0 42 34 0 0 15 0 2 0 657989782 427462656 14713 33554432000 4194304 5683644 140735315942128 18446744073709551615 232347719115 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/18338/statm: 104361 14713 399 364 0 40249 0
[pid=18340] ppid=18338 vsize=276244 CPUtime=295.44 cores=0,2,4,6
/proc/18340/stat : 18340 (hybridGM3) T 18338 18340 18340 0 -1 4202496 8574 0 0 0 29540 4 0 0 25 0 1 0 657989782 282873856 8304 33554432000 134512640 135204385 4293564496 18446744073709551615 134545975 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/18340/statm: 69061 8304 64 169 0 68891 0
[pid=18338/tid=18412] ppid=18195 vsize=417444 CPUtime=0 cores=0,2,4,6
/proc/18338/task/18412/stat : 18412 (python) S 18195 18195 18093 0 -1 4202560 48 0 0 0 0 0 0 0 15 0 2 0 658009483 427462656 14713 33554432000 4194304 5683644 140735315942128 18446744073709551615 232347716017 0 0 16781312 514 18446604448246612160 0 0 -1 0 0 0 0
[pid=18387] ppid=18195 vsize=427700 CPUtime=1.33 cores=0,2,4,6
/proc/18387/stat : 18387 (python) S 18195 18195 18093 0 -1 4202560 1185 0 0 0 67 66 0 0 18 0 2 0 657999702 437964800 14717 33554432000 4194304 5683644 140735315942128 18446744073709551615 232335912518 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/18387/statm: 106925 14717 399 364 0 42810 0
[pid=18389] ppid=18387 vsize=467024 CPUtime=495.7 cores=0,2,4,6
/proc/18389/stat : 18389 (TNM) R 18387 18389 18389 0 -1 4202496 6828 0 0 0 49567 3 0 0 25 0 1 0 657999703 478232576 6558 33554432000 134512640 135008748 4290006160 18446744073709551615 134527729 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/18389/statm: 116756 6558 46 122 0 115656 0
[pid=18387/tid=18426] ppid=18195 vsize=427700 CPUtime=0 cores=0,2,4,6
/proc/18387/task/18426/stat : 18426 (python) S 18195 18195 18093 0 -1 4202560 52 0 0 0 0 0 0 0 19 0 2 0 658010231 437964800 14717 33554432000 4194304 5683644 140735315942128 18446744073709551615 232347716017 0 0 16781312 514 18446604445513897792 0 0 -1 6 0 0 0
[pid=18407] ppid=18195 vsize=437956 CPUtime=0.51 cores=0,2,4,6
/proc/18407/stat : 18407 (python) S 18195 18195 18093 0 -1 4202560 1166 0 0 0 28 23 0 0 16 0 2 0 658000207 448466944 14721 33554432000 4194304 5683644 140735315942128 18446744073709551615 232347719115 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/18407/statm: 109489 14721 399 364 0 45371 0
[pid=18409] ppid=18407 vsize=276240 CPUtime=196.44 cores=0,2,4,6
/proc/18409/stat : 18409 (hybridGM3) T 18407 18409 18409 0 -1 4202496 8569 0 0 0 19643 1 0 0 25 0 1 0 658000208 282869760 8302 33554432000 134512640 135204385 4288902176 18446744073709551615 134536993 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/18409/statm: 69060 8302 64 169 0 68890 0
[pid=18407/tid=18436] ppid=18195 vsize=437956 CPUtime=0 cores=0,2,4,6
/proc/18407/task/18436/stat : 18436 (python) S 18195 18195 18093 0 -1 4202560 50 0 0 0 0 0 0 0 16 0 2 0 658019904 448466944 14721 33554432000 4194304 5683644 140735315942128 18446744073709551615 232347716017 0 0 16781312 514 18446604449169236224 0 0 -1 0 0 0 0
[pid=18433] ppid=18195 vsize=448212 CPUtime=0.27 cores=0,2,4,6
/proc/18433/stat : 18433 (python) S 18195 18195 18093 0 -1 4202560 1149 0 0 0 14 13 0 0 19 0 2 0 658019611 458969088 14725 33554432000 4194304 5683644 140735315942128 18446744073709551615 232347719115 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/18433/statm: 112053 14725 399 364 0 47932 0
[pid=18435] ppid=18433 vsize=467024 CPUtime=99.72 cores=0,2,4,6
/proc/18435/stat : 18435 (TNM) T 18433 18435 18435 0 -1 4202496 6832 0 0 0 9971 1 0 0 25 0 1 0 658019611 478232576 6558 33554432000 134512640 135008748 4292127088 18446744073709551615 134527477 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/18435/statm: 116756 6558 46 122 0 115656 0
[pid=18433/tid=18455] ppid=18195 vsize=448212 CPUtime=0 cores=0,2,4,6
/proc/18433/task/18455/stat : 18455 (python) S 18195 18195 18093 0 -1 4202560 50 0 0 0 0 0 0 0 19 0 2 0 658029639 458969088 14725 33554432000 4194304 5683644 140735315942128 18446744073709551615 232347716017 0 0 16781312 514 18446604447028230016 0 0 -1 0 0 0 0
[pid=18452] ppid=18195 vsize=458468 CPUtime=0.53 cores=0,2,4,6
/proc/18452/stat : 18452 (python) S 18195 18195 18093 0 -1 4202560 1079 0 0 0 27 26 0 0 16 0 1 0 658029632 469471232 14707 33554432000 4194304 5683644 140735315942128 18446744073709551615 232335912518 0 0 16781312 514 15790693416909635843 0 0 17 6 0 0 0
/proc/18452/statm: 114617 14707 378 364 0 50493 0
[pid=18454] ppid=18452 vsize=276236 CPUtime=194.08 cores=0,2,4,6
/proc/18454/stat : 18454 (hybridGM3) R 18452 18454 18454 0 -1 4202496 8577 0 0 0 19404 4 0 0 25 0 1 0 658029632 282865664 8303 33554432000 134512640 135204385 4291154624 18446744073709551615 134537548 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/18454/statm: 69059 8303 64 169 0 68889 0
[pid=18463] ppid=18195 vsize=468724 CPUtime=0.27 cores=0,2,4,6
/proc/18463/stat : 18463 (python) S 18195 18195 18093 0 -1 4202560 1031 0 0 0 14 13 0 0 18 0 1 0 658039367 479973376 14711 33554432000 4194304 5683644 140735315942128 18446744073709551615 232335912518 0 0 16781312 514 15790693416909635842 0 0 17 0 0 0 0
/proc/18463/statm: 117181 14711 378 364 0 53054 0
[pid=18465] ppid=18463 vsize=467024 CPUtime=104.3 cores=0,2,4,6
/proc/18465/stat : 18465 (TNM) R 18463 18465 18465 0 -1 4202496 6831 0 0 0 10427 3 0 0 25 0 1 0 658039368 478232576 6557 33554432000 134512640 135008748 4289487792 18446744073709551615 134529125 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/18465/statm: 116756 6557 46 122 0 115656 0
[pid=18195/tid=18204] ppid=18192 vsize=478968 CPUtime=0 cores=0,2,4,6
/proc/18195/task/18204/stat : 18204 (python) S 18192 18195 18093 0 -1 4202560 33 936 0 0 0 0 0 0 18 0 17 0 657930649 490463232 16235 33554432000 4194304 5683644 140735315942128 18446744073709551615 232347716017 0 0 16781312 2 18446604453684229440 0 0 -1 4 0 0 0
[pid=18195/tid=18208] ppid=18192 vsize=478968 CPUtime=0 cores=0,2,4,6
/proc/18195/task/18208/stat : 18208 (python) S 18192 18195 18093 0 -1 4202560 35 936 0 0 0 0 0 0 16 0 17 0 657930651 490463232 16235 33554432000 4194304 5683644 140735315942128 18446744073709551615 232347716017 0 0 16781312 2 18446604453684229440 0 0 -1 4 0 0 0
[pid=18195/tid=18211] ppid=18192 vsize=478968 CPUtime=0 cores=0,2,4,6
/proc/18195/task/18211/stat : 18211 (python) S 18192 18195 18093 0 -1 4202560 39 936 0 0 0 0 0 0 18 0 17 0 657930652 490463232 16235 33554432000 4194304 5683644 140735315942128 18446744073709551615 232347716017 0 0 16781312 2 18446604453684229440 0 0 -1 2 0 0 0
[pid=18195/tid=18215] ppid=18192 vsize=478968 CPUtime=0 cores=0,2,4,6
/proc/18195/task/18215/stat : 18215 (python) S 18192 18195 18093 0 -1 4202560 31 936 0 0 0 0 0 0 18 0 17 0 657930653 490463232 16235 33554432000 4194304 5683644 140735315942128 18446744073709551615 232347716017 0 0 16781312 2 18446604453684229440 0 0 -1 4 0 0 0
[pid=18195/tid=18286] ppid=18192 vsize=478968 CPUtime=0 cores=0,2,4,6
/proc/18195/task/18286/stat : 18286 (python) S 18192 18195 18093 0 -1 4202560 31 936 0 0 0 0 0 0 18 0 17 0 657960158 490463232 16235 33554432000 4194304 5683644 140735315942128 18446744073709551615 232347716017 0 0 16781312 2 18446604453684229440 0 0 -1 2 0 0 0
[pid=18195/tid=18290] ppid=18192 vsize=478968 CPUtime=0 cores=0,2,4,6
/proc/18195/task/18290/stat : 18290 (python) S 18192 18195 18093 0 -1 4202560 32 936 0 0 0 0 0 0 18 0 17 0 657960163 490463232 16235 33554432000 4194304 5683644 140735315942128 18446744073709551615 232347716017 0 0 16781312 2 18446604453684229440 0 0 -1 2 0 0 0
[pid=18195/tid=18293] ppid=18192 vsize=478968 CPUtime=0 cores=0,2,4,6
/proc/18195/task/18293/stat : 18293 (python) S 18192 18195 18093 0 -1 4202560 41 936 0 0 0 0 0 0 18 0 17 0 657960358 490463232 16235 33554432000 4194304 5683644 140735315942128 18446744073709551615 232347716017 0 0 16781312 2 18446604453684229440 0 0 -1 2 0 0 0
[pid=18195/tid=18305] ppid=18192 vsize=478968 CPUtime=0 cores=0,2,4,6
/proc/18195/task/18305/stat : 18305 (python) S 18192 18195 18093 0 -1 4202560 30 936 0 0 0 0 0 0 18 0 17 0 657969884 490463232 16235 33554432000 4194304 5683644 140735315942128 18446744073709551615 232347716017 0 0 16781312 2 18446604453684229440 0 0 -1 2 0 0 0
[pid=18195/tid=18316] ppid=18192 vsize=478968 CPUtime=0 cores=0,2,4,6
/proc/18195/task/18316/stat : 18316 (python) S 18192 18195 18093 0 -1 4202560 23 936 0 0 0 0 0 0 20 0 17 0 657979756 490463232 16235 33554432000 4194304 5683644 140735315942128 18446744073709551615 232347716017 0 0 16781312 2 18446604453684229440 0 0 -1 0 0 0 0
[pid=18195/tid=18319] ppid=18192 vsize=478968 CPUtime=0 cores=0,2,4,6
/proc/18195/task/18319/stat : 18319 (python) S 18192 18195 18093 0 -1 4202560 26 936 0 0 0 0 0 0 20 0 17 0 657979908 490463232 16235 33554432000 4194304 5683644 140735315942128 18446744073709551615 232347716017 0 0 16781312 2 18446604453684229440 0 0 -1 0 0 0 0
[pid=18195/tid=18339] ppid=18192 vsize=478968 CPUtime=0 cores=0,2,4,6
/proc/18195/task/18339/stat : 18339 (python) S 18192 18195 18093 0 -1 4202560 34 936 0 0 0 0 0 0 18 0 17 0 657989782 490463232 16235 33554432000 4194304 5683644 140735315942128 18446744073709551615 232347716017 0 0 16781312 2 18446604453684229440 0 0 -1 0 0 0 0
[pid=18195/tid=18388] ppid=18192 vsize=478968 CPUtime=0 cores=0,2,4,6
/proc/18195/task/18388/stat : 18388 (python) S 18192 18195 18093 0 -1 4202560 29 936 0 0 0 0 0 0 18 0 17 0 657999703 490463232 16235 33554432000 4194304 5683644 140735315942128 18446744073709551615 232347716017 0 0 16781312 2 18446604453684229440 0 0 -1 0 0 0 0
[pid=18195/tid=18408] ppid=18192 vsize=478968 CPUtime=0 cores=0,2,4,6
/proc/18195/task/18408/stat : 18408 (python) S 18192 18195 18093 0 -1 4202560 27 936 0 0 0 0 0 0 20 0 17 0 658000208 490463232 16235 33554432000 4194304 5683644 140735315942128 18446744073709551615 232347716017 0 0 16781312 2 18446604453684229440 0 0 -1 0 0 0 0
[pid=18195/tid=18434] ppid=18192 vsize=478968 CPUtime=0 cores=0,2,4,6
/proc/18195/task/18434/stat : 18434 (python) S 18192 18195 18093 0 -1 4202560 31 936 0 0 0 0 0 0 20 0 17 0 658019611 490463232 16235 33554432000 4194304 5683644 140735315942128 18446744073709551615 232347716017 0 0 16781312 2 18446604453684229440 0 0 -1 0 0 0 0
[pid=18195/tid=18453] ppid=18192 vsize=478968 CPUtime=0 cores=0,2,4,6
/proc/18195/task/18453/stat : 18453 (python) S 18192 18195 18093 0 -1 4202560 27 936 0 0 0 0 0 0 20 0 17 0 658029632 490463232 16235 33554432000 4194304 5683644 140735315942128 18446744073709551615 232347716017 0 0 16781312 2 18446604453684229440 0 0 -1 0 0 0 0
[pid=18195/tid=18464] ppid=18192 vsize=478968 CPUtime=0 cores=0,2,4,6
/proc/18195/task/18464/stat : 18464 (python) S 18192 18195 18093 0 -1 4202560 28 936 0 0 0 0 0 0 20 0 17 0 658039367 490463232 16235 33554432000 4194304 5683644 140735315942128 18446744073709551615 232347716017 0 0 16781312 2 18446604453684229440 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4751.73
Current children cumulated vsize (KiB) 12131836

[startup+1201.7 s]
/proc/loadavg: 8.16 8.18 7.03 9/395 18576
/proc/meminfo: memFree=19648924/32951124 swapFree=66457188/67111528
[pid=18195] ppid=18192 vsize=478968 CPUtime=4648.05 cores=0,2,4,6
/proc/18195/stat : 18195 (python) S 18192 18195 18093 0 -1 4202496 38583 140392 1 0 859 16 463321 609 17 0 17 0 657929677 490463232 16235 33554432000 4194304 5683644 140735315942128 18446744073709551615 232347722559 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 120
/proc/18195/statm: 119742 16235 1898 364 0 55615 0
[pid=18463] ppid=18195 vsize=0 CPUtime=104.75 cores=0,2,4,6
/proc/18463/stat : 18463 (python) R 18195 18195 18093 0 -1 4202564 1081 6831 0 0 14 13 10445 3 15 0 1 0 658039367 0 0 33554432000 0 0 0 0 0 0 0 16781824 2 18446744073709551615 0 0 17 4 0 0 0
/proc/18463/statm: 0 0 0 0 0 0 0
[pid=18195/tid=18204] ppid=18192 vsize=478968 CPUtime=4639.3 cores=0,2,4,6
/proc/18195/task/18204/stat : 18204 (python) S 18192 18195 18093 0 -1 4202560 33 140392 0 0 0 0 463321 609 18 0 17 0 657930649 490463232 16235 33554432000 4194304 5683644 140735315942128 18446744073709551615 232347716017 0 0 16781312 2 18446604453684229440 0 0 -1 4 0 0 0
[pid=18195/tid=18208] ppid=18192 vsize=478968 CPUtime=4639.3 cores=0,2,4,6
/proc/18195/task/18208/stat : 18208 (python) S 18192 18195 18093 0 -1 4202560 35 140392 0 0 0 0 463321 609 16 0 17 0 657930651 490463232 16235 33554432000 4194304 5683644 140735315942128 18446744073709551615 232347716017 0 0 16781312 2 18446604453684229440 0 0 -1 4 0 0 0
[pid=18195/tid=18211] ppid=18192 vsize=478968 CPUtime=4639.3 cores=0,2,4,6
/proc/18195/task/18211/stat : 18211 (python) S 18192 18195 18093 0 -1 4202560 39 140392 0 0 0 0 463321 609 18 0 17 0 657930652 490463232 16235 33554432000 4194304 5683644 140735315942128 18446744073709551615 232347716017 0 0 16781312 2 18446604453684229440 0 0 -1 2 0 0 0
[pid=18195/tid=18215] ppid=18192 vsize=478968 CPUtime=4639.3 cores=0,2,4,6
/proc/18195/task/18215/stat : 18215 (python) S 18192 18195 18093 0 -1 4202560 31 140392 0 0 0 0 463321 609 18 0 17 0 657930653 490463232 16235 33554432000 4194304 5683644 140735315942128 18446744073709551615 232347716017 0 0 16781312 2 18446604453684229440 0 0 -1 4 0 0 0
[pid=18195/tid=18286] ppid=18192 vsize=478968 CPUtime=4639.3 cores=0,2,4,6
/proc/18195/task/18286/stat : 18286 (python) S 18192 18195 18093 0 -1 4202560 31 140392 0 0 0 0 463321 609 18 0 17 0 657960158 490463232 16235 33554432000 4194304 5683644 140735315942128 18446744073709551615 232347716017 0 0 16781312 2 18446604453684229440 0 0 -1 2 0 0 0
[pid=18195/tid=18290] ppid=18192 vsize=478968 CPUtime=4639.3 cores=0,2,4,6
/proc/18195/task/18290/stat : 18290 (python) S 18192 18195 18093 0 -1 4202560 32 140392 0 0 0 0 463321 609 18 0 17 0 657960163 490463232 16235 33554432000 4194304 5683644 140735315942128 18446744073709551615 232347716017 0 0 16781312 2 18446604453684229440 0 0 -1 2 0 0 0
[pid=18195/tid=18293] ppid=18192 vsize=478968 CPUtime=4639.3 cores=0,2,4,6
/proc/18195/task/18293/stat : 18293 (python) S 18192 18195 18093 0 -1 4202560 41 140392 0 0 0 0 463321 609 18 0 17 0 657960358 490463232 16235 33554432000 4194304 5683644 140735315942128 18446744073709551615 232347716017 0 0 16781312 2 18446604453684229440 0 0 -1 2 0 0 0
[pid=18195/tid=18305] ppid=18192 vsize=478968 CPUtime=4639.3 cores=0,2,4,6
/proc/18195/task/18305/stat : 18305 (python) S 18192 18195 18093 0 -1 4202560 30 140392 0 0 0 0 463321 609 18 0 17 0 657969884 490463232 16235 33554432000 4194304 5683644 140735315942128 18446744073709551615 232347716017 0 0 16781312 2 18446604453684229440 0 0 -1 2 0 0 0
[pid=18195/tid=18316] ppid=18192 vsize=478968 CPUtime=4639.3 cores=0,2,4,6
/proc/18195/task/18316/stat : 18316 (python) S 18192 18195 18093 0 -1 4202560 23 140392 0 0 0 0 463321 609 20 0 17 0 657979756 490463232 16235 33554432000 4194304 5683644 140735315942128 18446744073709551615 232347716017 0 0 16781312 2 18446604453684229440 0 0 -1 0 0 0 0
[pid=18195/tid=18319] ppid=18192 vsize=478968 CPUtime=4639.3 cores=0,2,4,6
/proc/18195/task/18319/stat : 18319 (python) S 18192 18195 18093 0 -1 4202560 26 140392 0 0 0 0 463321 609 20 0 17 0 657979908 490463232 16235 33554432000 4194304 5683644 140735315942128 18446744073709551615 232347716017 0 0 16781312 2 18446604453684229440 0 0 -1 0 0 0 0
[pid=18195/tid=18339] ppid=18192 vsize=478968 CPUtime=4639.3 cores=0,2,4,6
/proc/18195/task/18339/stat : 18339 (python) S 18192 18195 18093 0 -1 4202560 34 140392 0 0 0 0 463321 609 18 0 17 0 657989782 490463232 16235 33554432000 4194304 5683644 140735315942128 18446744073709551615 232347716017 0 0 16781312 2 18446604453684229440 0 0 -1 0 0 0 0
[pid=18195/tid=18388] ppid=18192 vsize=478968 CPUtime=4639.3 cores=0,2,4,6
/proc/18195/task/18388/stat : 18388 (python) S 18192 18195 18093 0 -1 4202560 29 140392 0 0 0 0 463321 609 18 0 17 0 657999703 490463232 16235 33554432000 4194304 5683644 140735315942128 18446744073709551615 232347716017 0 0 16781312 2 18446604453684229440 0 0 -1 0 0 0 0
[pid=18195/tid=18408] ppid=18192 vsize=478968 CPUtime=4744.08 cores=0,2,4,6
/proc/18195/task/18408/stat : 18408 (python) S 18192 18195 18093 0 -1 4202560 27 148304 0 0 0 0 473781 627 20 0 17 0 658000208 490463232 16235 33554432000 4194304 5683644 140735315942128 18446744073709551615 232347716017 0 0 16781312 2 18446604453684229440 0 0 -1 0 0 0 0
[pid=18195/tid=18434] ppid=18192 vsize=478968 CPUtime=4744.08 cores=0,2,4,6
/proc/18195/task/18434/stat : 18434 (python) S 18192 18195 18093 0 -1 4202560 31 148304 0 0 0 0 473781 627 20 0 17 0 658019611 490463232 16235 33554432000 4194304 5683644 140735315942128 18446744073709551615 232347716017 0 0 16781312 2 18446604453684229440 0 0 -1 0 0 0 0
[pid=18195/tid=18453] ppid=18192 vsize=478968 CPUtime=4744.08 cores=0,2,4,6
/proc/18195/task/18453/stat : 18453 (python) S 18192 18195 18093 0 -1 4202560 27 148304 0 0 0 0 473781 627 20 0 17 0 658029632 490463232 16235 33554432000 4194304 5683644 140735315942128 18446744073709551615 232347716017 0 0 16781312 2 18446604453684229440 0 0 -1 0 0 0 0
[pid=18195/tid=18464] ppid=18192 vsize=478968 CPUtime=4744.08 cores=0,2,4,6
/proc/18195/task/18464/stat : 18464 (python) S 18192 18195 18093 0 -1 4202560 28 148304 0 0 0 0 473781 627 20 0 17 0 658039367 490463232 16235 33554432000 4194304 5683644 140735315942128 18446744073709551615 232347716017 0 0 16781312 2 18446604453684229440 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4752.8
Current children cumulated vsize (KiB) 478968

Child status: 0
Real time (s): 1201.73
CPU time (s): 4752.88
CPU user time (s): 4746.43
CPU system time (s): 6.44502
CPU usage (%): 395.502
Max. virtual memory (cumulated for all children) (KiB): 12131840

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4746.43
system time used= 6.44502
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 195056
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 7542
involuntary context switches= 74658

runsolver used 6.21105 second user time and 17.0014 second system time

The end

Launcher Data 

Begin job on node132 at 2011-05-15 14:41:55
IDJOB=3378169
IDBENCH=82578
IDSOLVER=1859
FILE ID=node132/3378169-1305463315
RUNJOBID= node132-1305463312-18111
PBS_JOBID= 13324991
Free space on /tmp= 73332 MiB

SOLVER NAME= borg-sat 11.03.02-par-random (fixed)
BENCH NAME= SAT11/random/large/unif-k3-r4.2-v40000-c168000-S471691933-060-UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3378169-1305463315/watcher-3378169-1305463315 -o /tmp/evaluation-result-3378169-1305463315/solver-3378169-1305463315 -C 4800 -W 1300 -M 15500  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3378169-1305463315.cnf -seed 2037844210 -budget 4800 -cores 4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 91da78a39fd68b6c63602d278464956f
RANDOM SEED=2037844210

node132.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      20573048 kB
Buffers:        301476 kB
Cached:        5972024 kB
SwapCached:       6904 kB
Active:        5628876 kB
Inactive:      6429312 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      20573048 kB
SwapTotal:    67111528 kB
SwapFree:     66457188 kB
Dirty:           68112 kB
Writeback:           0 kB
AnonPages:     5782832 kB
Mapped:          25728 kB
Slab:           226232 kB
PageTables:      29312 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 38380432 kB
VmallocTotal: 34359738367 kB
VmallocUsed:     33868 kB
VmallocChunk: 34359703231 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73284 MiB
End job on node132 at 2011-05-15 15:01:57