Trace number 3317163

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-random? (TO) 4800.14 1208.82

General information on the benchmark

Namerandom/large/
unif-k3-r4.2-v25000-c105000-S30704505-092-UNKNOWN.cnf
MD5SUM15b86e0c1384321ea7bbac2466a811a7
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark318.072
Satisfiable
(Un)Satisfiability was proved
Number of variables25000
Number of clauses105000
Sum of the clauses size315000
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 3105000
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.35/0.67	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.35/0.67	c INFO: solving HOME/instance-3317163-1304267872.cnf
0.35/0.67	c INFO: computing task features
0.72/1.03	c INFO: computed variable-clause graph statistics
0.72/1.05	c INFO: computed clause balance statistics
2.53/2.89	c INFO: computed variable balance statistics
4.03/4.38	c INFO: computed small-clause counts
4.03/4.39	c INFO: computed Horn-clause counts
4.93/5.22	c INFO: computed variable graph statistics
4.93/5.22	c INFO: collected features for HOME/instance-3317163-1304267872.cnf in 4.53 s
4.93/5.24	c INFO: running hybridGM3@0 for 97 with 4795 remaining (b = 0.40)
4.93/5.27	c INFO: running hybridGM3@0 for 97 with 4795 remaining (b = 0.25)
5.02/5.30	c INFO: running hybridGM3@0 for 97 with 4795 remaining (b = 0.17)
5.02/5.33	c INFO: running hybridGM3@0 for 194 with 4795 remaining (b = 0.23)
407.15/106.00	c INFO: running hybridGM3@0 for 97 with 4694 remaining (b = 0.10)
407.15/106.04	c INFO: running hybridGM3@0 for 97 with 4694 remaining (b = 0.10)
407.15/106.08	c INFO: running hybridGM3@0 for 97 with 4694 remaining (b = 0.10)
786.92/201.16	c INFO: running hybridGM3@99 for 97 with 4599 remaining (b = 0.10)
787.37/201.21	c INFO: running hybridGM3@100 for 97 with 4599 remaining (b = 0.10)
787.37/201.24	c INFO: running TNM@0 for 97 with 4599 remaining (b = 0.12)
790.38/202.22	c INFO: running hybridGM3@95 for 97 with 4598 remaining (b = 0.10)
1183.39/300.42	c INFO: running hybridGM3@100 for 97 with 4500 remaining (b = 0.10)
1190.99/302.32	c INFO: running hybridGM3@0 for 194 with 4498 remaining (b = 0.17)
1190.99/302.38	c INFO: running hybridGM3@0 for 194 with 4498 remaining (b = 0.13)
1191.35/302.41	c INFO: running hybridGM3@0 for 194 with 4498 remaining (b = 0.10)
1570.54/397.60	c INFO: running TNM@196 for 194 with 4403 remaining (b = 0.08)
1971.33/498.28	c INFO: running TNM@0 for 97 with 4302 remaining (b = 0.05)
1975.71/499.35	c INFO: running hybridGM3@100 for 97 with 4301 remaining (b = 0.04)
1991.65/503.34	c INFO: running hybridGM3@95 for 97 with 4297 remaining (b = 0.04)
2336.57/589.94	c INFO: running hybridGM3@100 for 97 with 4210 remaining (b = 0.04)
2370.45/598.48	c INFO: running hybridGM3@0 for 194 with 4202 remaining (b = 0.07)
2374.83/599.55	c INFO: running hybridGM3@298 for 97 with 4201 remaining (b = 0.03)
2378.81/600.53	c INFO: running hybridGM3@0 for 194 with 4200 remaining (b = 0.05)
2719.71/686.13	c INFO: running TNM@392 for 194 with 4114 remaining (b = 0.05)
2753.97/694.73	c INFO: running hybridGM3@396 for 97 with 4105 remaining (b = 0.02)
3132.82/789.89	c INFO: running hybridGM3@0 for 194 with 4010 remaining (b = 0.04)
3155.10/795.43	c INFO: running hybridGM3@99 for 97 with 4005 remaining (b = 0.02)
3163.08/797.48	c INFO: running hybridGM3@94 for 97 with 4003 remaining (b = 0.02)
3501.66/882.46	c INFO: running TNM@487 for 97 with 3918 remaining (b = 0.03)
3542.31/892.64	c INFO: running hybridGM3@0 for 194 with 3908 remaining (b = 0.03)
3558.22/896.61	c INFO: running hybridGM3@296 for 97 with 3904 remaining (b = 0.02)
3900.78/982.66	c INFO: running TNM@581 for 97 with 3818 remaining (b = 0.03)
3937.05/991.79	c INFO: running hybridGM3@396 for 97 with 3808 remaining (b = 0.01)
3941.43/992.86	c INFO: running TNM@0 for 97 with 3807 remaining (b = 0.02)
4279.94/1077.85	c INFO: running TNM@676 for 970 with 3722 remaining (b = 0.15)
4326.91/1089.61	c INFO: running gnovelty+2@0 for 97 with 3711 remaining (b = 0.02)
4340.02/1092.98	c INFO: running hybridGM3@101 for 97 with 3707 remaining (b = 0.02)
4340.44/1093.06	c INFO: running hybridGM3@0 for 194 with 3707 remaining (b = 0.03)
4725.47/1189.92	c INFO: running TNM@0 for 97 with 3610 remaining (b = 0.01)
4730.21/1191.18	c INFO: running TNM@0 for 97 with 3609 remaining (b = 0.01)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3317163-1304267872/watcher-3317163-1304267872 -o /tmp/evaluation-result-3317163-1304267872/solver-3317163-1304267872 -C 4800 -W 1300 -M 15500 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3317163-1304267872.cnf -seed 886541200 -budget 4800 -cores 4 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.29 6.94 3.69 5/216 13871
/proc/meminfo: memFree=29829628/32951124 swapFree=67111516/67111528
[pid=13871] ppid=13869 vsize=15384 CPUtime=0 cores=1,3,5,7
/proc/13871/stat : 13871 (python) R 13869 13871 13600 0 -1 4202496 790 0 0 0 0 0 0 0 25 0 1 0 538388200 15753216 678 33554432000 4194304 5683644 140736985884928 18446744073709551615 4540219 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/13871/statm: 3846 678 322 364 0 333 0

[startup+0.025779 s]
/proc/loadavg: 8.29 6.94 3.69 5/216 13871
/proc/meminfo: memFree=29829628/32951124 swapFree=67111516/67111528
[pid=13871] ppid=13869 vsize=16404 CPUtime=0.01 cores=1,3,5,7
/proc/13871/stat : 13871 (python) R 13869 13871 13600 0 -1 4202496 1115 0 0 0 1 0 0 0 25 0 1 0 538388200 16797696 983 33554432000 4194304 5683644 140736985884928 18446744073709551615 5214752 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/13871/statm: 4101 983 407 364 0 588 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 16404

[startup+0.100763 s]
/proc/loadavg: 8.29 6.94 3.69 5/216 13871
/proc/meminfo: memFree=29829628/32951124 swapFree=67111516/67111528
[pid=13871] ppid=13869 vsize=87708 CPUtime=0.06 cores=1,3,5,7
/proc/13871/stat : 13871 (python) S 13869 13871 13600 0 -1 4202496 2639 0 0 0 4 2 0 0 17 0 1 0 538388200 89812992 2354 33554432000 4194304 5683644 140736985884928 18446744073709551615 270613108736 0 2147483391 16781312 2 18446744071699199166 0 0 17 1 0 0 0
/proc/13871/statm: 21927 2354 717 364 0 1623 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 87708

[startup+0.300774 s]
/proc/loadavg: 8.29 6.94 3.69 5/216 13871
/proc/meminfo: memFree=29829628/32951124 swapFree=67111516/67111528
[pid=13871] ppid=13869 vsize=135752 CPUtime=0.17 cores=1,3,5,7
/proc/13871/stat : 13871 (python) R 13869 13871 13600 0 -1 4202496 5964 934 1 0 13 4 0 0 17 0 1 0 538388200 139010048 4151 33554432000 4194304 5683644 140736985884928 18446744073709551615 4620076 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/13871/statm: 33938 4151 1032 364 0 3124 0
Current children cumulated CPU time (s) 0.17
Current children cumulated vsize (KiB) 135752

[startup+0.700683 s]
/proc/loadavg: 8.29 6.94 3.69 5/216 13871
/proc/meminfo: memFree=29829628/32951124 swapFree=67111516/67111528
[pid=13871] ppid=13869 vsize=281920 CPUtime=0.42 cores=1,3,5,7
/proc/13871/stat : 13871 (python) R 13869 13871 13600 0 -1 4202496 10122 934 1 0 32 10 0 0 15 0 1 0 538388200 288686080 7804 33554432000 4194304 5683644 140736985884928 18446744073709551615 4445115 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/13871/statm: 70480 7804 1761 364 0 6404 0
Current children cumulated CPU time (s) 0.42
Current children cumulated vsize (KiB) 281920

[startup+1.50051 s]
/proc/loadavg: 8.29 6.94 3.69 7/217 13876
/proc/meminfo: memFree=29794384/32951124 swapFree=67111516/67111528
[pid=13871] ppid=13869 vsize=302960 CPUtime=1.23 cores=1,3,5,7
/proc/13871/stat : 13871 (python) R 13869 13871 13600 0 -1 4202496 18309 934 1 0 111 12 0 0 16 0 1 0 538388200 310231040 13124 33554432000 4194304 5683644 140736985884928 18446744073709551615 270616519349 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/13871/statm: 75740 13124 1826 364 0 11664 0
Current children cumulated CPU time (s) 1.23
Current children cumulated vsize (KiB) 302960

[startup+3.10023 s]
/proc/loadavg: 8.29 6.94 3.69 6/217 13876
/proc/meminfo: memFree=29782604/32951124 swapFree=67111516/67111528
[pid=13871] ppid=13869 vsize=302960 CPUtime=2.83 cores=1,3,5,7
/proc/13871/stat : 13871 (python) R 13869 13871 13600 0 -1 4202496 18310 934 1 0 271 12 0 0 18 0 1 0 538388200 310231040 13125 33554432000 4194304 5683644 140736985884928 18446744073709551615 47132669167460 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/13871/statm: 75740 13125 1827 364 0 11664 0
Current children cumulated CPU time (s) 2.83
Current children cumulated vsize (KiB) 302960

[startup+6.30064 s]
/proc/loadavg: 8.03 6.90 3.70 9/229 13888
/proc/meminfo: memFree=29735260/32951124 swapFree=67111516/67111528
[pid=13871] ppid=13869 vsize=342044 CPUtime=5.06 cores=1,3,5,7
/proc/13871/stat : 13871 (python) S 13869 13871 13600 0 -1 4202496 21241 934 1 0 493 13 0 0 20 0 5 0 538388200 350253056 12707 33554432000 4194304 5683644 140736985884928 18446744073709551615 270624937419 0 0 16781312 2 18446744073709551615 0 0 17 7 0 0 0
/proc/13871/statm: 85511 12707 1881 364 0 21420 0
[pid=13877] ppid=13871 vsize=301032 CPUtime=0 cores=1,3,5,7
/proc/13877/stat : 13877 (python) S 13871 13871 13600 0 -1 4202560 742 0 0 0 0 0 0 0 20 0 1 0 538388724 308256768 11163 33554432000 4194304 5683644 140736985884928 18446744073709551615 270613130767 0 0 16781312 514 1448922683482832895 0 0 17 1 0 0 0
/proc/13877/statm: 75258 11163 353 364 0 11176 0
[pid=13879] ppid=13877 vsize=268420 CPUtime=1.04 cores=1,3,5,7
/proc/13879/stat : 13879 (hybridGM3) R 13877 13879 13879 0 -1 4202496 7133 0 0 0 103 1 0 0 25 0 1 0 538388725 274862080 6871 33554432000 134512640 135204385 4291132816 18446744073709551615 134536895 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/13879/statm: 67105 6871 64 169 0 66935 0
[pid=13880] ppid=13871 vsize=311288 CPUtime=0 cores=1,3,5,7
/proc/13880/stat : 13880 (python) S 13871 13871 13600 0 -1 4202560 748 0 0 0 0 0 0 0 20 0 1 0 538388727 318758912 11161 33554432000 4194304 5683644 140736985884928 18446744073709551615 270613130822 0 0 16781312 514 745945251339829247 0 0 17 5 0 0 0
/proc/13880/statm: 77822 11161 347 364 0 13737 0
[pid=13882] ppid=13880 vsize=268424 CPUtime=0.99 cores=1,3,5,7
/proc/13882/stat : 13882 (hybridGM3) R 13880 13882 13882 0 -1 4202496 7132 0 0 0 99 0 0 0 25 0 1 0 538388728 274866176 6869 33554432000 134512640 135204385 4292943456 18446744073709551615 134547415 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/13882/statm: 67106 6869 64 169 0 66936 0
[pid=13883] ppid=13871 vsize=321544 CPUtime=0 cores=1,3,5,7
/proc/13883/stat : 13883 (python) S 13871 13871 13600 0 -1 4202560 746 0 0 0 0 0 0 0 15 0 1 0 538388730 329261056 11165 33554432000 4194304 5683644 140736985884928 18446744073709551615 270613130822 0 0 16781312 514 745949099630526463 0 0 17 5 0 0 0
/proc/13883/statm: 80386 11165 347 364 0 16298 0
[pid=13885] ppid=13883 vsize=268424 CPUtime=0.97 cores=1,3,5,7
/proc/13885/stat : 13885 (hybridGM3) R 13883 13885 13885 0 -1 4202496 7130 0 0 0 97 0 0 0 23 0 1 0 538388731 274866176 6868 33554432000 134512640 135204385 4293557472 18446744073709551615 134547654 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/13885/statm: 67106 6868 64 169 0 66936 0
[pid=13886] ppid=13871 vsize=331800 CPUtime=0 cores=1,3,5,7
/proc/13886/stat : 13886 (python) S 13871 13871 13600 0 -1 4202560 761 0 0 0 0 0 0 0 15 0 1 0 538388734 339763200 11169 33554432000 4194304 5683644 140736985884928 18446744073709551615 270613130822 0 0 16781312 514 745952947921223679 0 0 17 7 0 0 0
/proc/13886/statm: 82950 11169 347 364 0 18859 0
[pid=13888] ppid=13886 vsize=268424 CPUtime=0.95 cores=1,3,5,7
/proc/13888/stat : 13888 (hybridGM3) R 13886 13888 13888 0 -1 4202496 7131 0 0 0 94 1 0 0 23 0 1 0 538388734 274866176 6868 33554432000 134512640 135204385 4290498704 18446744073709551615 134537203 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/13888/statm: 67106 6868 64 169 0 66936 0
[pid=13871/tid=13878] ppid=13869 vsize=342044 CPUtime=0 cores=1,3,5,7
/proc/13871/task/13878/stat : 13878 (python) S 13869 13871 13600 0 -1 4202560 26 934 0 0 0 0 0 0 25 0 5 0 538388725 350253056 12707 33554432000 4194304 5683644 140736985884928 18446744073709551615 270624934321 0 0 16781312 2 18446604469192408128 0 0 -1 3 0 0 0
[pid=13871/tid=13881] ppid=13869 vsize=342044 CPUtime=0 cores=1,3,5,7
/proc/13871/task/13881/stat : 13881 (python) S 13869 13871 13600 0 -1 4202560 23 934 0 0 0 0 0 0 25 0 5 0 538388728 350253056 12707 33554432000 4194304 5683644 140736985884928 18446744073709551615 270624934321 0 0 16781312 2 18446604469192408128 0 0 -1 1 0 0 0
[pid=13871/tid=13884] ppid=13869 vsize=342044 CPUtime=0 cores=1,3,5,7
/proc/13871/task/13884/stat : 13884 (python) S 13869 13871 13600 0 -1 4202560 23 934 0 0 0 0 0 0 20 0 5 0 538388731 350253056 12707 33554432000 4194304 5683644 140736985884928 18446744073709551615 270624934321 0 0 16781312 2 18446604469192408128 0 0 -1 5 0 0 0
[pid=13871/tid=13887] ppid=13869 vsize=342044 CPUtime=0 cores=1,3,5,7
/proc/13871/task/13887/stat : 13887 (python) S 13869 13871 13600 0 -1 4202560 23 934 0 0 0 0 0 0 20 0 5 0 538388734 350253056 12707 33554432000 4194304 5683644 140736985884928 18446744073709551615 270624934321 0 0 16781312 2 18446604469192408128 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 9.01
Current children cumulated vsize (KiB) 2681400

[startup+12.7015 s]
/proc/loadavg: 8.02 6.92 3.72 9/229 13888
/proc/meminfo: memFree=29658168/32951124 swapFree=67111516/67111528
[pid=13871] ppid=13869 vsize=342044 CPUtime=5.06 cores=1,3,5,7
/proc/13871/stat : 13871 (python) S 13869 13871 13600 0 -1 4202496 21241 934 1 0 493 13 0 0 20 0 5 0 538388200 350253056 12707 33554432000 4194304 5683644 140736985884928 18446744073709551615 270624937419 0 0 16781312 2 18446744073709551615 0 0 17 7 0 0 0
/proc/13871/statm: 85511 12707 1881 364 0 21420 0
[pid=13877] ppid=13871 vsize=301032 CPUtime=0 cores=1,3,5,7
/proc/13877/stat : 13877 (python) S 13871 13871 13600 0 -1 4202560 903 0 0 0 0 0 0 0 18 0 1 0 538388724 308256768 11186 33554432000 4194304 5683644 140736985884928 18446744073709551615 270613130767 0 0 16781312 514 1448922683482800390 0 0 17 1 0 0 0
/proc/13877/statm: 75258 11186 376 364 0 11176 0
[pid=13879] ppid=13877 vsize=268420 CPUtime=7.44 cores=1,3,5,7
/proc/13879/stat : 13879 (hybridGM3) R 13877 13879 13879 0 -1 4202496 7133 0 0 0 743 1 0 0 25 0 1 0 538388725 274862080 6871 33554432000 134512640 135204385 4291132816 18446744073709551615 134536744 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/13879/statm: 67105 6871 64 169 0 66935 0
[pid=13880] ppid=13871 vsize=311288 CPUtime=0 cores=1,3,5,7
/proc/13880/stat : 13880 (python) S 13871 13871 13600 0 -1 4202560 917 0 0 0 0 0 0 0 18 0 1 0 538388727 318758912 11184 33554432000 4194304 5683644 140736985884928 18446744073709551615 270613130822 0 0 16781312 514 745945251339796743 0 0 17 5 0 0 0
/proc/13880/statm: 77822 11184 370 364 0 13737 0
[pid=13882] ppid=13880 vsize=268424 CPUtime=7.34 cores=1,3,5,7
/proc/13882/stat : 13882 (hybridGM3) R 13880 13882 13882 0 -1 4202496 7133 0 0 0 734 0 0 0 25 0 1 0 538388728 274866176 6870 33554432000 134512640 135204385 4292943456 18446744073709551615 134547403 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/13882/statm: 67106 6870 64 169 0 66936 0
[pid=13883] ppid=13871 vsize=321544 CPUtime=0 cores=1,3,5,7
/proc/13883/stat : 13883 (python) S 13871 13871 13600 0 -1 4202560 908 0 0 0 0 0 0 0 15 0 1 0 538388730 329261056 11188 33554432000 4194304 5683644 140736985884928 18446744073709551615 270613130822 0 0 16781312 514 745949099630493960 0 0 17 5 0 0 0
/proc/13883/statm: 80386 11188 370 364 0 16298 0
[pid=13885] ppid=13883 vsize=268424 CPUtime=7.35 cores=1,3,5,7
/proc/13885/stat : 13885 (hybridGM3) R 13883 13885 13885 0 -1 4202496 7132 0 0 0 735 0 0 0 25 0 1 0 538388731 274866176 6870 33554432000 134512640 135204385 4293557472 18446744073709551615 134537143 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/13885/statm: 67106 6870 64 169 0 66936 0
[pid=13886] ppid=13871 vsize=331800 CPUtime=0 cores=1,3,5,7
/proc/13886/stat : 13886 (python) S 13871 13871 13600 0 -1 4202560 941 0 0 0 0 0 0 0 15 0 1 0 538388734 339763200 11192 33554432000 4194304 5683644 140736985884928 18446744073709551615 270613130822 0 0 16781312 514 745952947921191176 0 0 17 7 0 0 0
/proc/13886/statm: 82950 11192 370 364 0 18859 0
[pid=13888] ppid=13886 vsize=268424 CPUtime=7.34 cores=1,3,5,7
/proc/13888/stat : 13888 (hybridGM3) R 13886 13888 13888 0 -1 4202496 7136 0 0 0 733 1 0 0 25 0 1 0 538388734 274866176 6873 33554432000 134512640 135204385 4290498704 18446744073709551615 134536641 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/13888/statm: 67106 6873 64 169 0 66936 0
[pid=13871/tid=13878] ppid=13869 vsize=342044 CPUtime=0 cores=1,3,5,7
/proc/13871/task/13878/stat : 13878 (python) S 13869 13871 13600 0 -1 4202560 26 934 0 0 0 0 0 0 25 0 5 0 538388725 350253056 12707 33554432000 4194304 5683644 140736985884928 18446744073709551615 270624934321 0 0 16781312 2 18446604469192408128 0 0 -1 3 0 0 0
[pid=13871/tid=13881] ppid=13869 vsize=342044 CPUtime=0 cores=1,3,5,7
/proc/13871/task/13881/stat : 13881 (python) S 13869 13871 13600 0 -1 4202560 23 934 0 0 0 0 0 0 25 0 5 0 538388728 350253056 12707 33554432000 4194304 5683644 140736985884928 18446744073709551615 270624934321 0 0 16781312 2 18446604469192408128 0 0 -1 1 0 0 0
[pid=13871/tid=13884] ppid=13869 vsize=342044 CPUtime=0 cores=1,3,5,7
/proc/13871/task/13884/stat : 13884 (python) S 13869 13871 13600 0 -1 4202560 23 934 0 0 0 0 0 0 20 0 5 0 538388731 350253056 12707 33554432000 4194304 5683644 140736985884928 18446744073709551615 270624934321 0 0 16781312 2 18446604469192408128 0 0 -1 5 0 0 0
[pid=13871/tid=13887] ppid=13869 vsize=342044 CPUtime=0 cores=1,3,5,7
/proc/13871/task/13887/stat : 13887 (python) S 13869 13871 13600 0 -1 4202560 23 934 0 0 0 0 0 0 20 0 5 0 538388734 350253056 12707 33554432000 4194304 5683644 140736985884928 18446744073709551615 270624934321 0 0 16781312 2 18446604469192408128 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 34.53
Current children cumulated vsize (KiB) 2681400

[startup+25.5012 s]
/proc/loadavg: 8.09 6.99 3.80 9/229 13889
/proc/meminfo: memFree=29658456/32951124 swapFree=67111516/67111528
[pid=13871] ppid=13869 vsize=342044 CPUtime=5.06 cores=1,3,5,7
/proc/13871/stat : 13871 (python) S 13869 13871 13600 0 -1 4202496 21241 934 1 0 493 13 0 0 20 0 5 0 538388200 350253056 12707 33554432000 4194304 5683644 140736985884928 18446744073709551615 270624937419 0 0 16781312 2 18446744073709551615 0 0 17 7 0 0 0
/proc/13871/statm: 85511 12707 1881 364 0 21420 0
[pid=13877] ppid=13871 vsize=301032 CPUtime=0.02 cores=1,3,5,7
/proc/13877/stat : 13877 (python) S 13871 13871 13600 0 -1 4202560 913 0 0 0 1 1 0 0 18 0 1 0 538388724 308256768 11186 33554432000 4194304 5683644 140736985884928 18446744073709551615 270613130767 0 0 16781312 514 16929646725797216518 0 0 17 1 0 0 0
/proc/13877/statm: 75258 11186 376 364 0 11176 0
[pid=13879] ppid=13877 vsize=268420 CPUtime=20.24 cores=1,3,5,7
/proc/13879/stat : 13879 (hybridGM3) R 13877 13879 13879 0 -1 4202496 7135 0 0 0 2023 1 0 0 25 0 1 0 538388725 274862080 6873 33554432000 134512640 135204385 4291132816 18446744073709551615 134547471 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/13879/statm: 67105 6873 64 169 0 66935 0
[pid=13880] ppid=13871 vsize=311288 CPUtime=0.02 cores=1,3,5,7
/proc/13880/stat : 13880 (python) S 13871 13871 13600 0 -1 4202560 923 0 0 0 1 1 0 0 18 0 1 0 538388727 318758912 11184 33554432000 4194304 5683644 140736985884928 18446744073709551615 270613130822 0 0 16781312 514 16929646725797216519 0 0 17 5 0 0 0
/proc/13880/statm: 77822 11184 370 364 0 13737 0
[pid=13882] ppid=13880 vsize=268424 CPUtime=20.04 cores=1,3,5,7
/proc/13882/stat : 13882 (hybridGM3) R 13880 13882 13882 0 -1 4202496 7133 0 0 0 2004 0 0 0 25 0 1 0 538388728 274866176 6870 33554432000 134512640 135204385 4292943456 18446744073709551615 134546131 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/13882/statm: 67106 6870 64 169 0 66936 0
[pid=13883] ppid=13871 vsize=321544 CPUtime=0.02 cores=1,3,5,7
/proc/13883/stat : 13883 (python) S 13871 13871 13600 0 -1 4202560 910 0 0 0 1 1 0 0 15 0 1 0 538388730 329261056 11188 33554432000 4194304 5683644 140736985884928 18446744073709551615 270613130822 0 0 16781312 514 16929646725797216520 0 0 17 5 0 0 0
/proc/13883/statm: 80386 11188 370 364 0 16298 0
[pid=13885] ppid=13883 vsize=268424 CPUtime=20.12 cores=1,3,5,7
/proc/13885/stat : 13885 (hybridGM3) R 13883 13885 13885 0 -1 4202496 7132 0 0 0 2012 0 0 0 25 0 1 0 538388731 274866176 6870 33554432000 134512640 135204385 4293557472 18446744073709551615 134545851 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/13885/statm: 67106 6870 64 169 0 66936 0
[pid=13886] ppid=13871 vsize=331800 CPUtime=0.01 cores=1,3,5,7
/proc/13886/stat : 13886 (python) S 13871 13871 13600 0 -1 4202560 946 0 0 0 0 1 0 0 15 0 1 0 538388734 339763200 11192 33554432000 4194304 5683644 140736985884928 18446744073709551615 270613130822 0 0 16781312 514 16929646725797216520 0 0 17 7 0 0 0
/proc/13886/statm: 82950 11192 370 364 0 18859 0
[pid=13888] ppid=13886 vsize=268424 CPUtime=20.13 cores=1,3,5,7
/proc/13888/stat : 13888 (hybridGM3) R 13886 13888 13888 0 -1 4202496 7136 0 0 0 2012 1 0 0 25 0 1 0 538388734 274866176 6873 33554432000 134512640 135204385 4290498704 18446744073709551615 134536993 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/13888/statm: 67106 6873 64 169 0 66936 0
[pid=13871/tid=13878] ppid=13869 vsize=342044 CPUtime=0 cores=1,3,5,7
/proc/13871/task/13878/stat : 13878 (python) S 13869 13871 13600 0 -1 4202560 26 934 0 0 0 0 0 0 25 0 5 0 538388725 350253056 12707 33554432000 4194304 5683644 140736985884928 18446744073709551615 270624934321 0 0 16781312 2 18446604469192408128 0 0 -1 3 0 0 0
[pid=13871/tid=13881] ppid=13869 vsize=342044 CPUtime=0 cores=1,3,5,7
/proc/13871/task/13881/stat : 13881 (python) S 13869 13871 13600 0 -1 4202560 23 934 0 0 0 0 0 0 25 0 5 0 538388728 350253056 12707 33554432000 4194304 5683644 140736985884928 18446744073709551615 270624934321 0 0 16781312 2 18446604469192408128 0 0 -1 1 0 0 0
[pid=13871/tid=13884] ppid=13869 vsize=342044 CPUtime=0 cores=1,3,5,7
/proc/13871/task/13884/stat : 13884 (python) S 13869 13871 13600 0 -1 4202560 23 934 0 0 0 0 0 0 20 0 5 0 538388731 350253056 12707 33554432000 4194304 5683644 140736985884928 18446744073709551615 270624934321 0 0 16781312 2 18446604469192408128 0 0 -1 5 0 0 0

################
# More data... #
################

/proc/13885/stat : 13885 (hybridGM3) T 13883 13885 13885 0 -1 4202496 7134 0 0 0 29493 0 0 0 25 0 1 0 538388731 274866176 6872 33554432000 134512640 135204385 4293557472 18446744073709551615 134537357 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/13885/statm: 67106 6872 64 169 0 66936 0
[pid=13883/tid=13901] ppid=13871 vsize=321544 CPUtime=0 cores=1,3,5,7
/proc/13883/task/13901/stat : 13901 (python) S 13871 13871 13600 0 -1 4202560 52 0 0 0 0 0 0 0 15 0 2 0 538398804 329261056 11218 33554432000 4194304 5683644 140736985884928 18446744073709551615 270624934321 0 0 16781312 514 18446604461676307648 0 0 -1 5 0 0 0
[pid=13886] ppid=13871 vsize=331800 CPUtime=0.45 cores=1,3,5,7
/proc/13886/stat : 13886 (python) S 13871 13871 13600 0 -1 4202560 1183 0 0 0 22 23 0 0 15 0 2 0 538388734 339763200 11222 33554432000 4194304 5683644 140736985884928 18446744073709551615 270624937419 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/13886/statm: 82950 11222 399 364 0 18859 0
[pid=13888] ppid=13886 vsize=268424 CPUtime=291.67 cores=1,3,5,7
/proc/13888/stat : 13888 (hybridGM3) T 13886 13888 13888 0 -1 4202496 7138 0 0 0 29166 1 0 0 25 0 1 0 538388734 274866176 6875 33554432000 134512640 135204385 4290498704 18446744073709551615 134536663 0 0 16781312 0 18446744071562691360 0 0 17 7 0 0 0
/proc/13888/statm: 67106 6875 64 169 0 66936 0
[pid=13886/tid=13914] ppid=13871 vsize=331800 CPUtime=0 cores=1,3,5,7
/proc/13886/task/13914/stat : 13914 (python) S 13871 13871 13600 0 -1 4202560 48 0 0 0 0 0 0 0 15 0 2 0 538408419 339763200 11222 33554432000 4194304 5683644 140736985884928 18446744073709551615 270624934321 0 0 16781312 514 18446604461676308544 0 0 -1 7 0 0 0
[pid=13911] ppid=13871 vsize=342056 CPUtime=1.35 cores=1,3,5,7
/proc/13911/stat : 13911 (python) S 13871 13871 13600 0 -1 4202560 1180 0 0 0 72 63 0 0 18 0 2 0 538408324 350265344 11226 33554432000 4194304 5683644 140736985884928 18446744073709551615 270613130822 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/13911/statm: 85514 11226 399 364 0 21420 0
[pid=13913] ppid=13911 vsize=464784 CPUtime=813.59 cores=1,3,5,7
/proc/13913/stat : 13913 (TNM) R 13911 13913 13913 0 -1 4202496 4400 0 0 0 81358 1 0 0 25 0 1 0 538408324 475938816 4135 33554432000 134512640 135008748 4293057040 18446744073709551615 134527503 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/13913/statm: 116196 4135 46 122 0 115096 0
[pid=13911/tid=13927] ppid=13871 vsize=342056 CPUtime=0 cores=1,3,5,7
/proc/13911/task/13927/stat : 13927 (python) S 13871 13871 13600 0 -1 4202560 49 0 0 0 0 0 0 0 18 0 2 0 538418239 350265344 11226 33554432000 4194304 5683644 140736985884928 18446744073709551615 270624934321 0 0 16781312 514 18446604471110599680 0 0 -1 7 0 0 0
[pid=13928] ppid=13871 vsize=352312 CPUtime=0.79 cores=1,3,5,7
/proc/13928/stat : 13928 (python) S 13871 13871 13600 0 -1 4202560 1194 0 0 0 45 34 0 0 15 0 2 0 538418433 360767488 11230 33554432000 4194304 5683644 140736985884928 18446744073709551615 270624937419 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/13928/statm: 88078 11230 399 364 0 23981 0
[pid=13930] ppid=13928 vsize=268420 CPUtime=485.43 cores=1,3,5,7
/proc/13930/stat : 13930 (hybridGM3) T 13928 13930 13930 0 -1 4202496 7142 0 0 0 48543 0 0 0 25 0 1 0 538418433 274862080 6874 33554432000 134512640 135204385 4288622288 18446744073709551615 134547471 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/13930/statm: 67105 6874 64 169 0 66935 0
[pid=13928/tid=13953] ppid=13871 vsize=352312 CPUtime=0 cores=1,3,5,7
/proc/13928/task/13953/stat : 13953 (python) S 13871 13871 13600 0 -1 4202560 48 0 0 0 0 0 0 0 15 0 2 0 538438025 360767488 11230 33554432000 4194304 5683644 140736985884928 18446744073709551615 270624934321 0 0 16781312 514 18446604469192407232 0 0 -1 7 0 0 0
[pid=13931] ppid=13871 vsize=362568 CPUtime=0.5 cores=1,3,5,7
/proc/13931/stat : 13931 (python) S 13871 13871 13600 0 -1 4202560 1226 0 0 0 28 22 0 0 15 0 2 0 538418438 371269632 11240 33554432000 4194304 5683644 140736985884928 18446744073709551615 270624937419 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/13931/statm: 90642 11240 405 364 0 26542 0
[pid=13933] ppid=13931 vsize=268424 CPUtime=292.87 cores=1,3,5,7
/proc/13933/stat : 13933 (hybridGM3) T 13931 13933 13933 0 -1 4202496 7145 0 0 0 29286 1 0 0 25 0 1 0 538418438 274866176 6875 33554432000 134512640 135204385 4290392592 18446744073709551615 134536993 0 0 16781312 0 18446744071562691360 0 0 17 7 0 0 0
/proc/13933/statm: 67106 6875 64 169 0 66936 0
[pid=13931/tid=13958] ppid=13871 vsize=362568 CPUtime=0 cores=1,3,5,7
/proc/13931/task/13958/stat : 13958 (python) S 13871 13871 13600 0 -1 4202560 46 0 0 0 0 0 0 0 15 0 2 0 538438531 371269632 11240 33554432000 4194304 5683644 140736985884928 18446744073709551615 270624934321 0 0 16781312 514 18446604469192406336 0 0 -1 7 0 0 0
[pid=13934] ppid=13871 vsize=372824 CPUtime=0.49 cores=1,3,5,7
/proc/13934/stat : 13934 (python) S 13871 13871 13600 0 -1 4202560 1216 0 0 0 24 25 0 0 15 0 2 0 538418441 381771776 11244 33554432000 4194304 5683644 140736985884928 18446744073709551615 270624937419 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/13934/statm: 93206 11244 405 364 0 29103 0
[pid=13936] ppid=13934 vsize=268424 CPUtime=293.73 cores=1,3,5,7
/proc/13936/stat : 13936 (hybridGM3) T 13934 13936 13936 0 -1 4202496 7145 0 0 0 29372 1 0 0 25 0 1 0 538418442 274866176 6874 33554432000 134512640 135204385 4289997424 18446744073709551615 134537272 0 0 16781312 0 18446744071562691360 0 0 17 5 0 0 0
/proc/13936/statm: 67106 6874 64 169 0 66936 0
[pid=13934/tid=13957] ppid=13871 vsize=372824 CPUtime=0 cores=1,3,5,7
/proc/13934/task/13957/stat : 13957 (python) S 13871 13871 13600 0 -1 4202560 48 0 0 0 0 0 0 0 15 0 2 0 538438132 381771776 11244 33554432000 4194304 5683644 140736985884928 18446744073709551615 270624934321 0 0 16781312 514 18446604460790717184 0 0 -1 3 0 0 0
[pid=13954] ppid=13871 vsize=383080 CPUtime=0.17 cores=1,3,5,7
/proc/13954/stat : 13954 (python) S 13871 13871 13600 0 -1 4202560 1115 0 0 0 7 10 0 0 19 0 2 0 538438028 392273920 11242 33554432000 4194304 5683644 140736985884928 18446744073709551615 270624937419 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/13954/statm: 95770 11242 399 364 0 31664 0
[pid=13956] ppid=13954 vsize=460952 CPUtime=98.35 cores=1,3,5,7
/proc/13956/stat : 13956 (TNM) T 13954 13956 13956 0 -1 4202496 4403 0 0 0 9835 0 0 0 25 0 1 0 538438029 472014848 4133 33554432000 134512640 135008748 4292176240 18446744073709551615 134529475 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/13956/statm: 115238 4133 46 122 0 114138 0
[pid=13954/tid=13965] ppid=13871 vsize=383080 CPUtime=0 cores=1,3,5,7
/proc/13954/task/13965/stat : 13965 (python) S 13871 13871 13600 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 538448045 392273920 11242 33554432000 4194304 5683644 140736985884928 18446744073709551615 270624934321 0 0 16781312 514 18446604471139169408 0 0 -1 3 0 0 0
[pid=13966] ppid=13871 vsize=393336 CPUtime=0.8 cores=1,3,5,7
/proc/13966/stat : 13966 (python) S 13871 13871 13600 0 -1 4202560 1197 0 0 0 43 37 0 0 15 0 2 0 538448048 402776064 11246 33554432000 4194304 5683644 140736985884928 18446744073709551615 270624937419 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/13966/statm: 98334 11246 399 364 0 34225 0
[pid=13968] ppid=13966 vsize=268424 CPUtime=489.81 cores=1,3,5,7
/proc/13968/stat : 13968 (hybridGM3) T 13966 13968 13968 0 -1 4202496 7147 0 0 0 48979 2 0 0 25 0 1 0 538448049 274866176 6877 33554432000 134512640 135204385 4291850304 18446744073709551615 134545968 0 0 16781312 0 18446744071562691360 0 0 17 7 0 0 0
/proc/13968/statm: 67106 6877 64 169 0 66936 0
[pid=13966/tid=14032] ppid=13871 vsize=393336 CPUtime=0 cores=1,3,5,7
/proc/13966/task/14032/stat : 14032 (python) S 13871 13871 13600 0 -1 4202560 49 0 0 0 0 0 0 0 15 0 2 0 538467739 402776064 11246 33554432000 4194304 5683644 140736985884928 18446744073709551615 270624934321 0 0 16781312 514 18446604460790716288 0 0 -1 3 0 0 0
[pid=13969] ppid=13871 vsize=403592 CPUtime=0.45 cores=1,3,5,7
/proc/13969/stat : 13969 (python) S 13871 13871 13600 0 -1 4202560 1197 0 0 0 23 22 0 0 16 0 2 0 538448253 413278208 11250 33554432000 4194304 5683644 140736985884928 18446744073709551615 270624937419 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/13969/statm: 100898 11250 399 364 0 36786 0
[pid=13971] ppid=13969 vsize=268428 CPUtime=291.63 cores=1,3,5,7
/proc/13971/stat : 13971 (hybridGM3) T 13969 13971 13971 0 -1 4202496 7142 0 0 0 29162 1 0 0 25 0 1 0 538448254 274870272 6874 33554432000 134512640 135204385 4288125584 18446744073709551615 134547676 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/13971/statm: 67107 6874 64 169 0 66937 0
[pid=13969/tid=14033] ppid=13871 vsize=403592 CPUtime=0 cores=1,3,5,7
/proc/13969/task/14033/stat : 14033 (python) S 13871 13871 13600 0 -1 4202560 47 0 0 0 0 0 0 0 15 0 2 0 538467944 413278208 11250 33554432000 4194304 5683644 140736985884928 18446744073709551615 270624934321 0 0 16781312 514 18446604460790714496 0 0 -1 3 0 0 0
[pid=14029] ppid=13871 vsize=413848 CPUtime=0.32 cores=1,3,5,7
/proc/14029/stat : 14029 (python) S 13871 13871 13600 0 -1 4202560 1200 0 0 0 17 15 0 0 16 0 2 0 538467189 423780352 11254 33554432000 4194304 5683644 140736985884928 18446744073709551615 270624937419 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/14029/statm: 103462 11254 399 364 0 39347 0
[pid=14031] ppid=14029 vsize=268420 CPUtime=199.3 cores=1,3,5,7
/proc/14031/stat : 14031 (hybridGM3) T 14029 14031 14031 0 -1 4202496 7144 0 0 0 19929 1 0 0 25 0 1 0 538467190 274862080 6872 33554432000 134512640 135204385 4288286288 18446744073709551615 134536663 0 0 16781312 0 18446744071562691360 0 0 17 7 0 0 0
/proc/14031/statm: 67105 6872 64 169 0 66935 0
[pid=14029/tid=14043] ppid=13871 vsize=413848 CPUtime=0 cores=1,3,5,7
/proc/14029/task/14043/stat : 14043 (python) S 13871 13871 13600 0 -1 4202560 48 0 0 0 0 0 0 0 16 0 2 0 538487482 423780352 11254 33554432000 4194304 5683644 140736985884928 18446744073709551615 270624934321 0 0 16781312 514 18446604461676309440 0 0 -1 3 0 0 0
[pid=14038] ppid=13871 vsize=424104 CPUtime=0.49 cores=1,3,5,7
/proc/14038/stat : 14038 (python) S 13871 13871 13600 0 -1 4202560 1216 0 0 0 26 23 0 0 15 0 2 0 538477464 434282496 11258 33554432000 4194304 5683644 140736985884928 18446744073709551615 270624937419 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/14038/statm: 106026 11258 399 364 0 41908 0
[pid=14040] ppid=14038 vsize=268424 CPUtime=295.05 cores=1,3,5,7
/proc/14040/stat : 14040 (hybridGM3) T 14038 14040 14040 0 -1 4202496 7146 0 0 0 29504 1 0 0 25 0 1 0 538477465 274866176 6873 33554432000 134512640 135204385 4292047872 18446744073709551615 134546089 0 0 16781312 0 18446744071562691360 0 0 17 5 0 0 0
/proc/14040/statm: 67106 6873 64 169 0 66936 0
[pid=14038/tid=14051] ppid=13871 vsize=424104 CPUtime=0 cores=1,3,5,7
/proc/14038/task/14051/stat : 14051 (python) S 13871 13871 13600 0 -1 4202560 48 0 0 0 0 0 0 0 15 0 2 0 538497157 434282496 11258 33554432000 4194304 5683644 140736985884928 18446744073709551615 270624934321 0 0 16781312 514 18446604454223470656 0 0 -1 3 0 0 0
[pid=14044] ppid=13871 vsize=434360 CPUtime=0.17 cores=1,3,5,7
/proc/14044/stat : 14044 (python) S 13871 13871 13600 0 -1 4202560 1182 0 0 0 9 8 0 0 19 0 2 0 538487486 444784640 11262 33554432000 4194304 5683644 140736985884928 18446744073709551615 270624937419 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/14044/statm: 108590 11262 399 364 0 44469 0
[pid=14046] ppid=14044 vsize=460952 CPUtime=99.71 cores=1,3,5,7
/proc/14046/stat : 14046 (TNM) T 14044 14046 14046 0 -1 4202496 4408 0 0 0 9971 0 0 0 25 0 1 0 538487487 472014848 4134 33554432000 134512640 135008748 4291033872 18446744073709551615 134524720 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/14046/statm: 115238 4134 46 122 0 114138 0
[pid=14044/tid=14055] ppid=13871 vsize=434360 CPUtime=0 cores=1,3,5,7
/proc/14044/task/14055/stat : 14055 (python) S 13871 13871 13600 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 538497502 444784640 11262 33554432000 4194304 5683644 140736985884928 18446744073709551615 270624934321 0 0 16781312 514 18446604471145243648 0 0 -1 1 0 0 0
[pid=14052] ppid=13871 vsize=444616 CPUtime=0.16 cores=1,3,5,7
/proc/14052/stat : 14052 (python) S 13871 13871 13600 0 -1 4202560 1184 0 0 0 8 8 0 0 19 0 2 0 538497161 455286784 11273 33554432000 4194304 5683644 140736985884928 18446744073709551615 270624937419 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/14052/statm: 111154 11273 406 364 0 47030 0
[pid=14054] ppid=14052 vsize=1025020 CPUtime=97.53 cores=1,3,5,7
/proc/14054/stat : 14054 (gnovelty+2) T 14052 14054 14054 0 -1 4202496 2635 0 0 0 9753 0 0 0 25 0 1 0 538497162 1049620480 2326 33554432000 134512640 135663704 4292408032 18446744073709551615 134546181 0 0 16781312 0 18446744071562691360 0 0 17 7 0 0 0
/proc/14054/statm: 256255 2326 113 282 0 255971 0
[pid=14052/tid=14062] ppid=13871 vsize=444616 CPUtime=0 cores=1,3,5,7
/proc/14052/task/14062/stat : 14062 (python) S 13871 13871 13600 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 538507188 455286784 11273 33554432000 4194304 5683644 140736985884928 18446744073709551615 270624934321 0 0 16781312 514 18446604464099614784 0 0 -1 7 0 0 0
[pid=14056] ppid=13871 vsize=454872 CPUtime=0.18 cores=1,3,5,7
/proc/14056/stat : 14056 (python) S 13871 13871 13600 0 -1 4202560 1069 0 0 0 10 8 0 0 15 0 1 0 538497506 465788928 11248 33554432000 4194304 5683644 140736985884928 18446744073709551615 270613130822 0 0 16781312 514 16929646725797216516 0 0 17 3 0 0 0
/proc/14056/statm: 113718 11248 378 364 0 49591 0
[pid=14058] ppid=14056 vsize=268428 CPUtime=114.61 cores=1,3,5,7
/proc/14058/stat : 14058 (hybridGM3) R 14056 14058 14058 0 -1 4202496 7151 0 0 0 11460 1 0 0 25 0 1 0 538497507 274870272 6872 33554432000 134512640 135204385 4292744688 18446744073709551615 134536744 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/14058/statm: 67107 6872 64 169 0 66937 0
[pid=14063] ppid=13871 vsize=465128 CPUtime=0.02 cores=1,3,5,7
/proc/14063/stat : 14063 (python) S 13871 13871 13600 0 -1 4202560 1027 0 0 0 1 1 0 0 18 0 1 0 538507192 476291072 11246 33554432000 4194304 5683644 140736985884928 18446744073709551615 270613130822 0 0 16781312 514 16929646725797216519 0 0 17 3 0 0 0
/proc/14063/statm: 116282 11246 372 364 0 52152 0
[pid=14065] ppid=14063 vsize=460952 CPUtime=18.67 cores=1,3,5,7
/proc/14065/stat : 14065 (TNM) R 14063 14065 14065 0 -1 4202496 4410 0 0 0 1867 0 0 0 25 0 1 0 538507193 472014848 4135 33554432000 134512640 135008748 4294062288 18446744073709551615 134528456 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/14065/statm: 115238 4135 46 122 0 114138 0
[pid=14066] ppid=13871 vsize=475384 CPUtime=0.02 cores=1,3,5,7
/proc/14066/stat : 14066 (python) S 13871 13871 13600 0 -1 4202560 1029 0 0 0 1 1 0 0 18 0 1 0 538507318 486793216 11249 33554432000 4194304 5683644 140736985884928 18446744073709551615 270613130822 0 0 16781312 514 16929646725797216519 0 0 17 3 0 0 0
/proc/14066/statm: 118846 11249 371 364 0 54713 0
[pid=14068] ppid=14066 vsize=460952 CPUtime=17.52 cores=1,3,5,7
/proc/14068/stat : 14068 (TNM) R 14066 14068 14068 0 -1 4202496 4406 0 0 0 1751 1 0 0 25 0 1 0 538507318 472014848 4134 33554432000 134512640 135008748 4288900592 18446744073709551615 134528467 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/14068/statm: 115238 4134 46 122 0 114138 0
[pid=13871/tid=13878] ppid=13869 vsize=485628 CPUtime=0 cores=1,3,5,7
/proc/13871/task/13878/stat : 13878 (python) S 13869 13871 13600 0 -1 4202560 29 934 0 0 0 0 0 0 18 0 19 0 538388725 497283072 12792 33554432000 4194304 5683644 140736985884928 18446744073709551615 270624934321 0 0 16781312 2 18446604469192408128 0 0 -1 3 0 0 0
[pid=13871/tid=13881] ppid=13869 vsize=485628 CPUtime=0 cores=1,3,5,7
/proc/13871/task/13881/stat : 13881 (python) S 13869 13871 13600 0 -1 4202560 27 934 0 0 0 0 0 0 15 0 19 0 538388728 497283072 12792 33554432000 4194304 5683644 140736985884928 18446744073709551615 270624934321 0 0 16781312 2 18446604469192408128 0 0 -1 1 0 0 0
[pid=13871/tid=13884] ppid=13869 vsize=485628 CPUtime=0 cores=1,3,5,7
/proc/13871/task/13884/stat : 13884 (python) S 13869 13871 13600 0 -1 4202560 28 934 0 0 0 0 0 0 18 0 19 0 538388731 497283072 12792 33554432000 4194304 5683644 140736985884928 18446744073709551615 270624934321 0 0 16781312 2 18446604469192408128 0 0 -1 5 0 0 0
[pid=13871/tid=13887] ppid=13869 vsize=485628 CPUtime=0 cores=1,3,5,7
/proc/13871/task/13887/stat : 13887 (python) S 13869 13871 13600 0 -1 4202560 26 934 0 0 0 0 0 0 18 0 19 0 538388734 497283072 12792 33554432000 4194304 5683644 140736985884928 18446744073709551615 270624934321 0 0 16781312 2 18446604469192408128 0 0 -1 7 0 0 0
[pid=13871/tid=13912] ppid=13869 vsize=485628 CPUtime=0 cores=1,3,5,7
/proc/13871/task/13912/stat : 13912 (python) S 13869 13871 13600 0 -1 4202560 49 934 0 0 0 0 0 0 18 0 19 0 538408324 497283072 12792 33554432000 4194304 5683644 140736985884928 18446744073709551615 270624934321 0 0 16781312 2 18446604469192408128 0 0 -1 3 0 0 0
[pid=13871/tid=13929] ppid=13869 vsize=485628 CPUtime=0 cores=1,3,5,7
/proc/13871/task/13929/stat : 13929 (python) S 13869 13871 13600 0 -1 4202560 42 934 0 0 0 0 0 0 18 0 19 0 538418433 497283072 12792 33554432000 4194304 5683644 140736985884928 18446744073709551615 270624934321 0 0 16781312 2 18446604469192408128 0 0 -1 3 0 0 0
[pid=13871/tid=13932] ppid=13869 vsize=485628 CPUtime=0 cores=1,3,5,7
/proc/13871/task/13932/stat : 13932 (python) S 13869 13871 13600 0 -1 4202560 28 934 0 0 0 0 0 0 18 0 19 0 538418438 497283072 12792 33554432000 4194304 5683644 140736985884928 18446744073709551615 270624934321 0 0 16781312 2 18446604469192408128 0 0 -1 7 0 0 0
[pid=13871/tid=13935] ppid=13869 vsize=485628 CPUtime=0 cores=1,3,5,7
/proc/13871/task/13935/stat : 13935 (python) S 13869 13871 13600 0 -1 4202560 86 934 0 0 0 0 0 0 18 0 19 0 538418442 497283072 12792 33554432000 4194304 5683644 140736985884928 18446744073709551615 270624934321 0 0 16781312 2 18446604469192408128 0 0 -1 3 0 0 0
[pid=13871/tid=13955] ppid=13869 vsize=485628 CPUtime=0 cores=1,3,5,7
/proc/13871/task/13955/stat : 13955 (python) S 13869 13871 13600 0 -1 4202560 25 934 0 0 0 0 0 0 20 0 19 0 538438029 497283072 12792 33554432000 4194304 5683644 140736985884928 18446744073709551615 270624934321 0 0 16781312 2 18446604469192408128 0 0 -1 3 0 0 0
[pid=13871/tid=13967] ppid=13869 vsize=485628 CPUtime=0 cores=1,3,5,7
/proc/13871/task/13967/stat : 13967 (python) S 13869 13871 13600 0 -1 4202560 36 934 0 0 0 0 0 0 18 0 19 0 538448048 497283072 12792 33554432000 4194304 5683644 140736985884928 18446744073709551615 270624934321 0 0 16781312 2 18446604469192408128 0 0 -1 3 0 0 0
[pid=13871/tid=13970] ppid=13869 vsize=485628 CPUtime=0 cores=1,3,5,7
/proc/13871/task/13970/stat : 13970 (python) S 13869 13871 13600 0 -1 4202560 35 934 0 0 0 0 0 0 18 0 19 0 538448254 497283072 12792 33554432000 4194304 5683644 140736985884928 18446744073709551615 270624934321 0 0 16781312 2 18446604469192408128 0 0 -1 3 0 0 0
[pid=13871/tid=14030] ppid=13869 vsize=485628 CPUtime=0 cores=1,3,5,7
/proc/13871/task/14030/stat : 14030 (python) S 13869 13871 13600 0 -1 4202560 29 934 0 0 0 0 0 0 20 0 19 0 538467190 497283072 12792 33554432000 4194304 5683644 140736985884928 18446744073709551615 270624934321 0 0 16781312 2 18446604469192408128 0 0 -1 3 0 0 0
[pid=13871/tid=14039] ppid=13869 vsize=485628 CPUtime=0 cores=1,3,5,7
/proc/13871/task/14039/stat : 14039 (python) S 13869 13871 13600 0 -1 4202560 35 934 0 0 0 0 0 0 18 0 19 0 538477465 497283072 12792 33554432000 4194304 5683644 140736985884928 18446744073709551615 270624934321 0 0 16781312 2 18446604469192408128 0 0 -1 3 0 0 0
[pid=13871/tid=14045] ppid=13869 vsize=485628 CPUtime=0 cores=1,3,5,7
/proc/13871/task/14045/stat : 14045 (python) S 13869 13871 13600 0 -1 4202560 31 934 0 0 0 0 0 0 20 0 19 0 538487486 497283072 12792 33554432000 4194304 5683644 140736985884928 18446744073709551615 270624934321 0 0 16781312 2 18446604469192408128 0 0 -1 3 0 0 0
[pid=13871/tid=14053] ppid=13869 vsize=485628 CPUtime=0 cores=1,3,5,7
/proc/13871/task/14053/stat : 14053 (python) S 13869 13871 13600 0 -1 4202560 30 934 0 0 0 0 0 0 20 0 19 0 538497162 497283072 12792 33554432000 4194304 5683644 140736985884928 18446744073709551615 270624934321 0 0 16781312 2 18446604469192408128 0 0 -1 3 0 0 0
[pid=13871/tid=14057] ppid=13869 vsize=485628 CPUtime=0 cores=1,3,5,7
/proc/13871/task/14057/stat : 14057 (python) S 13869 13871 13600 0 -1 4202560 31 934 0 0 0 0 0 0 20 0 19 0 538497506 497283072 12792 33554432000 4194304 5683644 140736985884928 18446744073709551615 270624934321 0 0 16781312 2 18446604469192408128 0 0 -1 3 0 0 0
[pid=13871/tid=14064] ppid=13869 vsize=485628 CPUtime=0 cores=1,3,5,7
/proc/13871/task/14064/stat : 14064 (python) S 13869 13871 13600 0 -1 4202560 27 934 0 0 0 0 0 0 20 0 19 0 538507192 497283072 12792 33554432000 4194304 5683644 140736985884928 18446744073709551615 270624934321 0 0 16781312 2 18446604469192408128 0 0 -1 3 0 0 0
[pid=13871/tid=14067] ppid=13869 vsize=485628 CPUtime=0 cores=1,3,5,7
/proc/13871/task/14067/stat : 14067 (python) S 13869 13871 13600 0 -1 4202560 28 934 0 0 0 0 0 0 20 0 19 0 538507318 497283072 12792 33554432000 4194304 5683644 140736985884928 18446744073709551615 270624934321 0 0 16781312 2 18446604469192408128 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4800.14
Current children cumulated vsize (KiB) 14038312

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 13871 and gives
#  childrusage.ru_utime.tv_sec=6
#  childrusage.ru_utime.tv_usec=181060
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=199969
# CPU time returned by wait4() is 6.38103
# while last known CPU time is 4800.14
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1208.82
CPU time (s): 4800.14
CPU user time (s): 4796.12
CPU system time (s): 4.02
CPU usage (%): 397.093
Max. virtual memory (cumulated for all children) (KiB): 14038312

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 6.18106
system time used= 0.199969
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 37513
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3021
involuntary context switches= 86

runsolver used 5.20521 second user time and 13.016 second system time

The end

Launcher Data 

Begin job on node108 at 2011-05-01 18:37:52
IDJOB=3317163
IDBENCH=82628
IDSOLVER=1705
FILE ID=node108/3317163-1304267872
RUNJOBID= node108-1304267294-13619
PBS_JOBID= 13173970
Free space on /tmp= 73040 MiB

SOLVER NAME= borg-sat 11.03.02-random
BENCH NAME= SAT11/random/large/unif-k3-r4.2-v25000-c105000-S30704505-092-UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3317163-1304267872/watcher-3317163-1304267872 -o /tmp/evaluation-result-3317163-1304267872/solver-3317163-1304267872 -C 4800 -W 1300 -M 15500  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3317163-1304267872.cnf -seed 886541200 -budget 4800 -cores 4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 15b86e0c1384321ea7bbac2466a811a7
RANDOM SEED=886541200

node108.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.64
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      29829908 kB
Buffers:        641588 kB
Cached:        1633468 kB
SwapCached:         12 kB
Active:         608344 kB
Inactive:      2099184 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      29829908 kB
SwapTotal:    67111528 kB
SwapFree:     67111516 kB
Dirty:           33404 kB
Writeback:           0 kB
AnonPages:      432308 kB
Mapped:          21004 kB
Slab:           341308 kB
PageTables:      12972 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:  4410564 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73004 MiB
End job on node108 at 2011-05-01 18:58:03