Trace number 3321773

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-random? (MO) 10165.5 1282.72

General information on the benchmark

Namerandom/large/
unif-k7-r85-v300-c25500-S966156467-066-UNKNOWN.cnf
MD5SUM5297bd1d2a420892cfb1fb6d32ccacad
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables300
Number of clauses25500
Sum of the clauses size178500
Maximum clause length7
Minimum clause length7
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 525500

Solver Data 

0.40/5.51	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.40/5.51	c INFO: solving HOME/instance-3321773-1307741589.cnf
0.40/5.51	c INFO: computing task features
0.51/5.68	c INFO: computed variable-clause graph statistics
0.51/5.69	c INFO: computed clause balance statistics
1.40/6.56	c INFO: computed variable balance statistics
1.80/6.92	c INFO: computed small-clause counts
1.80/6.92	c INFO: computed Horn-clause counts
1.80/6.95	c INFO: computed variable graph statistics
1.80/6.95	c INFO: collected features for HOME/instance-3321773-1307741589.cnf in 1.44 s
1.88/7.01	c INFO: running gnovelty+2@0 for 97 with 39998 remaining (b = 0.37)
1.88/7.04	c INFO: running gnovelty+2@0 for 97 with 39998 remaining (b = 0.13)
1.88/7.08	c INFO: running adaptg2wsat2009++@0 for 97 with 39998 remaining (b = 0.08)
1.98/7.12	c INFO: running adaptg2wsat2009++@0 for 97 with 39998 remaining (b = 0.07)
1.98/7.16	c INFO: running adaptg2wsat2009++@0 for 97 with 39998 remaining (b = 0.05)
2.07/7.20	c INFO: running gnovelty+2@0 for 97 with 39998 remaining (b = 0.04)
2.07/7.24	c INFO: running FH@0 for 97 with 39998 remaining (b = 0.03)
2.07/7.28	c INFO: running adaptg2wsat2009++@0 for 97 with 39998 remaining (b = 0.03)
793.79/106.24	c INFO: running adaptg2wsat2009++@0 for 97 with 39899 remaining (b = 0.02)
795.23/106.49	c INFO: running FH@0 for 97 with 39899 remaining (b = 0.02)
801.71/107.21	c INFO: running hybridGM3@0 for 194 with 39898 remaining (b = 0.04)
801.71/107.26	c INFO: running gnovelty+2@0 for 97 with 39898 remaining (b = 0.02)
802.31/107.32	c INFO: running hybridGM3@0 for 194 with 39898 remaining (b = 0.03)
802.31/107.37	c INFO: running adaptg2wsat2009++@0 for 97 with 39898 remaining (b = 0.01)
802.80/107.43	c INFO: running hybridGM3@0 for 194 with 39898 remaining (b = 0.03)
803.10/107.50	c INFO: running hybridGM3@0 for 194 with 39898 remaining (b = 0.02)
1593.42/206.44	c INFO: running TNM@0 for 1552 with 39799 remaining (b = 0.19)
1594.85/206.70	c INFO: running FH@0 for 97 with 39798 remaining (b = 0.01)
1601.37/207.50	c INFO: running adaptg2wsat2009++@99 for 97 with 39798 remaining (b = 0.01)
1602.06/207.60	c INFO: running hybridGM3@0 for 194 with 39797 remaining (b = 0.02)
2361.29/302.74	c INFO: running hybridGM3@99 for 97 with 39702 remaining (b = 0.01)
2367.70/303.60	c INFO: running hybridGM3@100 for 97 with 39701 remaining (b = 0.01)
2370.04/303.85	c INFO: running hybridGM3@100 for 97 with 39701 remaining (b = 0.01)
2370.81/303.96	c INFO: running hybridGM3@100 for 97 with 39701 remaining (b = 0.01)
2386.71/305.93	c INFO: running hybridGM3@0 for 194 with 39699 remaining (b = 0.02)
2409.01/308.73	c INFO: running TNM@0 for 1552 with 39696 remaining (b = 0.15)
3160.18/402.96	c INFO: running hybridGM3@295 for 97 with 39602 remaining (b = 0.01)
3175.38/404.82	c INFO: running hybridGM3@296 for 97 with 39600 remaining (b = 0.01)
3176.92/405.09	c INFO: running adaptg2wsat2009++@0 for 97 with 39600 remaining (b = 0.01)
3177.71/405.19	c INFO: running adaptg2wsat2009++@0 for 97 with 39600 remaining (b = 0.01)
3216.76/410.02	c INFO: running adaptg2wsat2009++@0 for 97 with 39595 remaining (b = 0.01)
3912.14/497.22	c INFO: running adaptg2wsat2009++@98 for 97 with 39508 remaining (b = 0.01)
3935.19/500.12	c INFO: running gnovelty+2@0 for 97 with 39505 remaining (b = 0.01)
3937.61/500.42	c INFO: running hybridGM3@295 for 97 with 39505 remaining (b = 0.01)
3944.73/501.36	c INFO: running hybridGM3@396 for 97 with 39504 remaining (b = 0.01)
3945.52/501.47	c INFO: running iPAWS@0 for 97 with 39504 remaining (b = 0.01)
3983.74/506.28	c INFO: running hybridGM3@397 for 97 with 39499 remaining (b = 0.01)
4679.01/593.48	c INFO: running hybridGM3@101 for 97 with 39412 remaining (b = 0.01)
4713.27/597.72	c INFO: running hybridGM3@392 for 97 with 39407 remaining (b = 0.01)
4719.62/598.59	c INFO: running hybridGM3@0 for 194 with 39406 remaining (b = 0.01)
4726.82/599.41	c INFO: running TNM@0 for 1552 with 39406 remaining (b = 0.11)
4737.93/600.81	c INFO: running FH@0 for 291 with 39404 remaining (b = 0.02)
4759.39/603.51	c INFO: running adaptg2wsat2009++@100 for 97 with 39402 remaining (b = 0.01)
5493.74/695.74	c INFO: running FH@99 for 291 with 39309 remaining (b = 0.02)
5504.88/697.12	c INFO: running iPAWS@0 for 97 with 39308 remaining (b = 0.01)
5581.27/706.77	c INFO: running adaptg2wsat2009++@101 for 97 with 39298 remaining (b = 0.01)
6302.88/797.36	c INFO: running adaptg2wsat2009++@93 for 97 with 39208 remaining (b = 0.01)
6317.23/799.15	c INFO: running hybridGM3@98 for 97 with 39206 remaining (b = 0.01)
6356.24/804.01	c INFO: running adaptg2wsat2009++@193 for 97 with 39201 remaining (b = 0.01)
7042.75/890.30	c INFO: running FH@0 for 97 with 39115 remaining (b = 0.01)
7076.99/894.60	c INFO: running iPAWS@0 for 97 with 39110 remaining (b = 0.01)
7115.17/899.40	c INFO: running hybridGM3@0 for 194 with 39106 remaining (b = 0.01)
7130.28/901.25	c INFO: running adaptg2wsat2009++@482 for 194 with 39104 remaining (b = 0.02)
7808.03/986.32	c INFO: running NCVWr@0 for 485 with 39019 remaining (b = 0.03)
7834.31/989.64	c INFO: running FH@199 for 194 with 39015 remaining (b = 0.01)
7923.48/1000.88	c INFO: running gnovelty+2@0 for 97 with 39004 remaining (b = 0.01)
8679.98/1095.88	c INFO: running hybridGM3@97 for 97 with 38909 remaining (b = 0.01)
8702.27/1098.66	c INFO: running adaptg2wsat2009++@772 for 97 with 38906 remaining (b = 0.01)
8722.24/1101.19	c INFO: running hybridGM3@0 for 194 with 38904 remaining (b = 0.01)
9365.85/1182.07	c INFO: running FH@300 for 97 with 38823 remaining (b = 0.01)
9460.50/1193.91	c INFO: running FH@100 for 291 with 38811 remaining (b = 0.02)
9485.94/1197.14	c INFO: running hybridGM3@294 for 194 with 38808 remaining (b = 0.01)
10163.83/1282.35	c INFO: running TNM@0 for 1552 with 38723 remaining (b = 0.08)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 988)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3321773-1307741589/watcher-3321773-1307741589 -o /tmp/evaluation-result-3321773-1307741589/solver-3321773-1307741589 -C 40000 -W 5100 -M 31000 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3321773-1307741589.cnf -seed 951405007 -budget 40000 -cores 8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.00 0.00 0.00 1/170 859
/proc/meminfo: memFree=31822220/32950928 swapFree=67079488/67111528
[pid=859] ppid=857 vsize=11804 CPUtime=0 cores=0-7
/proc/859/stat : 859 (runsolver) S 857 859 813 0 -1 4202560 42 0 0 0 0 0 0 0 19 0 1 0 885758932 12087296 51 33554432000 4194304 5436572 140735012650592 18446744073709551615 4883175 0 2147483391 4096 24578 18446744071699977015 0 0 17 3 0 0 0
/proc/859/statm: 2951 51 31 304 0 2643 0

[startup+0.0417729 s]
/proc/loadavg: 0.00 0.00 0.00 1/170 859
/proc/meminfo: memFree=31822220/32950928 swapFree=67079488/67111528
[pid=859] ppid=857 vsize=14820 CPUtime=0 cores=0-7
/proc/859/stat : 859 (python) S 857 859 813 0 -1 4202496 513 0 0 0 0 0 0 0 20 0 1 0 885758932 15175680 419 33554432000 4194304 5683644 140734844098576 18446744073709551615 274473963365 0 2147483391 4096 0 18446744071699215550 0 0 17 3 0 0 0
/proc/859/statm: 3705 419 259 364 0 192 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 14820

[startup+0.10076 s]
/proc/loadavg: 0.00 0.00 0.00 1/170 859
/proc/meminfo: memFree=31822220/32950928 swapFree=67079488/67111528
[pid=859] ppid=857 vsize=15080 CPUtime=0 cores=0-7
/proc/859/stat : 859 (python) S 857 859 813 0 -1 4202496 651 0 0 0 0 0 0 0 20 0 1 0 885758932 15441920 545 33554432000 4194304 5683644 140734844098576 18446744073709551615 274473965568 0 2147483391 16781312 2 18446744071699215550 0 0 17 6 0 0 0
/proc/859/statm: 3770 545 312 364 0 257 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 15080

[startup+0.300724 s]
/proc/loadavg: 0.00 0.00 0.00 1/170 859
/proc/meminfo: memFree=31822220/32950928 swapFree=67079488/67111528
[pid=859] ppid=857 vsize=15184 CPUtime=0 cores=0-7
/proc/859/stat : 859 (python) S 857 859 813 0 -1 4202496 735 0 0 0 0 0 0 0 18 0 1 0 885758932 15548416 622 33554432000 4194304 5683644 140734844098576 18446744073709551615 274473965568 0 2147483391 16781312 2 18446744071699215550 0 0 17 6 0 0 0
/proc/859/statm: 3796 622 322 364 0 283 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 15184

[startup+0.700731 s]
/proc/loadavg: 0.00 0.00 0.00 1/170 859
/proc/meminfo: memFree=31822220/32950928 swapFree=67079488/67111528
[pid=859] ppid=857 vsize=16244 CPUtime=0.01 cores=0-7
/proc/859/stat : 859 (python) S 857 859 813 0 -1 4202496 1001 0 0 0 1 0 0 0 15 0 1 0 885758932 16633856 872 33554432000 4194304 5683644 140734844098576 18446744073709551615 274473965568 0 2147483391 16781312 2 18446744071699215550 0 0 17 6 0 0 0
/proc/859/statm: 4061 872 371 364 0 548 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 16244

[startup+1.50051 s]
/proc/loadavg: 0.00 0.00 0.00 1/171 860
/proc/meminfo: memFree=31819608/32950928 swapFree=67079488/67111528
[pid=859] ppid=857 vsize=29792 CPUtime=0.03 cores=0-7
/proc/859/stat : 859 (python) S 857 859 813 0 -1 4202496 1416 0 0 0 3 0 0 0 15 0 1 0 885758932 30507008 1258 33554432000 4194304 5683644 140734844098576 18446744073709551615 274473965568 0 2147483391 16781312 2 18446744071699215550 0 0 17 6 0 0 0
/proc/859/statm: 7448 1258 443 364 0 818 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 29792

[startup+3.10031 s]
/proc/loadavg: 0.00 0.00 0.00 1/171 860
/proc/meminfo: memFree=31814400/32950928 swapFree=67079488/67111528
[pid=859] ppid=857 vsize=135752 CPUtime=0.2 cores=0-7
/proc/859/stat : 859 (python) S 857 859 813 0 -1 4202496 5966 934 1 0 15 5 0 0 15 0 1 0 885758932 139010048 4151 33554432000 4194304 5683644 140734844098576 18446744073709551615 274473963525 0 2147483391 16781312 2 18446744071699215550 0 0 17 6 0 0 0
/proc/859/statm: 33938 4151 1032 364 0 3124 0
Current children cumulated CPU time (s) 0.2
Current children cumulated vsize (KiB) 135752
heavy processes:

[startup+6.30073 s]
/proc/loadavg: 0.00 0.00 0.00 1/171 864
/proc/meminfo: memFree=31800276/32950928 swapFree=67079488/67111528
[pid=859] ppid=857 vsize=285676 CPUtime=1.2 cores=0-7
/proc/859/stat : 859 (python) R 857 859 813 0 -1 4202496 12376 934 1 0 109 11 0 0 16 0 1 0 885758932 292532224 8803 33554432000 4194304 5683644 140734844098576 18446744073709551615 274473627616 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/859/statm: 71419 8803 1826 364 0 7343 0
Current children cumulated CPU time (s) 1.2
Current children cumulated vsize (KiB) 285676
heavy processes:

[startup+12.7015 s]
/proc/loadavg: 0.79 0.17 0.05 9/195 889
/proc/meminfo: memFree=31728672/32950928 swapFree=67079488/67111528
[pid=859] ppid=857 vsize=362416 CPUtime=2.15 cores=0-7
/proc/859/stat : 859 (python) S 857 859 813 0 -1 4202496 18648 934 1 0 202 13 0 0 20 0 9 0 885758932 371113984 7570 33554432000 4194304 5683644 140734844098576 18446744073709551615 274485794251 0 0 16781312 2 18446744073709551615 0 0 17 7 0 0 0
/proc/859/statm: 90604 7570 1891 364 0 26501 0
[pid=865] ppid=859 vsize=280696 CPUtime=0 cores=0-7
/proc/865/stat : 865 (python) S 859 859 813 0 -1 4202560 877 0 0 0 0 0 0 0 18 0 1 0 885759633 287432704 5984 33554432000 4194304 5683644 140734844098576 18446744073709551615 274473987599 0 0 16781312 514 4498903617503199496 0 0 17 0 0 0 0
/proc/865/statm: 70174 5984 378 364 0 6092 0
[pid=867] ppid=865 vsize=1019708 CPUtime=5.65 cores=0-7
/proc/867/stat : 867 (gnovelty+2) R 865 867 867 0 -1 4202496 954 0 0 0 565 0 0 0 25 0 1 0 885759634 1044180992 690 33554432000 134512640 135663704 4291512448 18446744073709551615 134524868 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/867/statm: 254927 690 113 282 0 254643 0
[pid=868] ppid=859 vsize=291020 CPUtime=0 cores=0-7
/proc/868/stat : 868 (python) S 859 859 813 0 -1 4202560 892 0 0 0 0 0 0 0 18 0 1 0 885759637 298004480 5982 33554432000 4194304 5683644 140734844098576 18446744073709551615 274473987654 0 0 16781312 514 4604021052287189256 0 0 17 7 0 0 0
/proc/868/statm: 72755 5982 372 364 0 8670 0
[pid=870] ppid=868 vsize=1019708 CPUtime=5.64 cores=0-7
/proc/870/stat : 870 (gnovelty+2) R 868 870 870 0 -1 4202496 951 0 0 0 564 0 0 0 25 0 1 0 885759637 1044180992 690 33554432000 134512640 135663704 4286732240 18446744073709551615 134524548 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/870/statm: 254927 690 113 282 0 254643 0
[pid=871] ppid=859 vsize=301208 CPUtime=0 cores=0-7
/proc/871/stat : 871 (python) S 859 859 813 0 -1 4202560 913 0 0 0 0 0 0 0 18 0 1 0 885759641 308436992 6002 33554432000 4194304 5683644 140734844098576 18446744073709551615 274473987654 0 0 16781312 514 4476706401883750664 0 0 17 0 0 0 0
/proc/871/statm: 75302 6002 371 364 0 11214 0
[pid=874] ppid=871 vsize=420220 CPUtime=5.6 cores=0-7
/proc/874/stat : 874 (adaptg2wsat2009) R 871 874 874 0 -1 4202496 1665 0 0 0 560 0 0 0 25 0 1 0 885759641 430305280 1400 33554432000 134512640 135107411 4289124112 18446744073709551615 134531584 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/874/statm: 105055 1400 59 146 0 103931 0
[pid=875] ppid=859 vsize=311532 CPUtime=0 cores=0-7
/proc/875/stat : 875 (python) S 859 859 813 0 -1 4202560 926 0 0 0 0 0 0 0 18 0 1 0 885759644 319008768 6006 33554432000 4194304 5683644 140734844098576 18446744073709551615 274473987654 0 0 16781312 514 5629753800571977989 0 0 17 1 0 0 0
/proc/875/statm: 77883 6006 371 364 0 13792 0
[pid=877] ppid=875 vsize=420220 CPUtime=5.57 cores=0-7
/proc/877/stat : 877 (adaptg2wsat2009) R 875 877 877 0 -1 4202496 1665 0 0 0 557 0 0 0 25 0 1 0 885759645 430305280 1400 33554432000 134512640 135107411 4290512688 18446744073709551615 134532277 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/877/statm: 105055 1400 59 146 0 103931 0
[pid=878] ppid=859 vsize=321720 CPUtime=0 cores=0-7
/proc/878/stat : 878 (python) S 859 859 813 0 -1 4202560 944 0 0 0 0 0 0 0 18 0 1 0 885759648 329441280 6011 33554432000 4194304 5683644 140734844098576 18446744073709551615 274473987654 0 0 16781312 514 18429991369087877384 0 0 17 3 0 0 0
/proc/878/statm: 80430 6011 372 364 0 16336 0
[pid=880] ppid=878 vsize=420220 CPUtime=5.52 cores=0-7
/proc/880/stat : 880 (adaptg2wsat2009) R 878 880 880 0 -1 4202496 1666 0 0 0 552 0 0 0 25 0 1 0 885759649 430305280 1399 33554432000 134512640 135107411 4294380352 18446744073709551615 134532318 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/880/statm: 105055 1399 59 146 0 103931 0
[pid=881] ppid=859 vsize=332616 CPUtime=0 cores=0-7
/proc/881/stat : 881 (python) S 859 859 813 0 -1 4202560 954 0 0 0 0 0 0 0 18 0 1 0 885759652 340598784 6023 33554432000 4194304 5683644 140734844098576 18446744073709551615 274473987654 0 0 16781312 514 4498907465793896712 0 0 17 7 0 0 0
/proc/881/statm: 83154 6023 372 364 0 19057 0
[pid=883] ppid=881 vsize=1019708 CPUtime=5.48 cores=0-7
/proc/883/stat : 883 (gnovelty+2) R 881 883 883 0 -1 4202496 955 0 0 0 548 0 0 0 25 0 1 0 885759653 1044180992 689 33554432000 134512640 135663704 4293647968 18446744073709551615 134524548 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/883/statm: 254927 689 113 282 0 254643 0
[pid=884] ppid=859 vsize=342940 CPUtime=0 cores=0-7
/proc/884/stat : 884 (python) S 859 859 813 0 -1 4202560 964 0 0 0 0 0 0 0 18 0 1 0 885759656 351170560 6043 33554432000 4194304 5683644 140734844098576 18446744073709551615 274473987654 0 0 16781312 514 4466686002664014088 0 0 17 0 0 0 0
/proc/884/statm: 85735 6043 371 364 0 21635 0
[pid=886] ppid=884 vsize=249868 CPUtime=5.43 cores=0-7
/proc/886/stat : 886 (FH) R 884 886 886 0 -1 4202496 1529 0 0 0 543 0 0 0 25 0 1 0 885759658 255864832 1263 33554432000 134512640 134936988 4286800512 18446744073709551615 134545269 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/886/statm: 62467 1263 41 104 0 61971 0
[pid=887] ppid=859 vsize=352624 CPUtime=0 cores=0-7
/proc/887/stat : 887 (python) S 859 859 813 0 -1 4202560 989 0 0 0 0 0 0 0 18 0 1 0 885759660 361086976 6054 33554432000 4194304 5683644 140734844098576 18446744073709551615 274473987654 0 0 16781312 514 13059924077349667080 0 0 17 7 0 0 0
/proc/887/statm: 88156 6054 378 364 0 24053 0
[pid=889] ppid=887 vsize=420220 CPUtime=5.31 cores=0-7
/proc/889/stat : 889 (adaptg2wsat2009) R 887 889 889 0 -1 4202496 1669 0 0 0 531 0 0 0 25 0 1 0 885759663 430305280 1399 33554432000 134512640 135107411 4290411952 18446744073709551615 134532364 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/889/statm: 105055 1399 59 146 0 103931 0
[pid=859/tid=866] ppid=857 vsize=362416 CPUtime=0 cores=0-7
/proc/859/task/866/stat : 866 (python) S 857 859 813 0 -1 4202560 23 934 0 0 0 0 0 0 18 0 9 0 885759633 371113984 7570 33554432000 4194304 5683644 140734844098576 18446744073709551615 274485791153 0 0 16781312 2 18446604454223471552 0 0 -1 1 0 0 0
[pid=859/tid=869] ppid=857 vsize=362416 CPUtime=0 cores=0-7
/proc/859/task/869/stat : 869 (python) S 857 859 813 0 -1 4202560 23 934 0 0 0 0 0 0 20 0 9 0 885759637 371113984 7570 33554432000 4194304 5683644 140734844098576 18446744073709551615 274485791153 0 0 16781312 2 18446604454223471552 0 0 -1 3 0 0 0
[pid=859/tid=872] ppid=857 vsize=362416 CPUtime=0 cores=0-7
/proc/859/task/872/stat : 872 (python) S 857 859 813 0 -1 4202560 27 934 0 0 0 0 0 0 21 0 9 0 885759641 371113984 7570 33554432000 4194304 5683644 140734844098576 18446744073709551615 274485791153 0 0 16781312 2 18446604454223471552 0 0 -1 7 0 0 0
[pid=859/tid=876] ppid=857 vsize=362416 CPUtime=0 cores=0-7
/proc/859/task/876/stat : 876 (python) S 857 859 813 0 -1 4202560 21 934 0 0 0 0 0 0 23 0 9 0 885759645 371113984 7570 33554432000 4194304 5683644 140734844098576 18446744073709551615 274485791153 0 0 16781312 2 18446604454223471552 0 0 -1 7 0 0 0
[pid=859/tid=879] ppid=857 vsize=362416 CPUtime=0 cores=0-7
/proc/859/task/879/stat : 879 (python) S 857 859 813 0 -1 4202560 27 934 0 0 0 0 0 0 25 0 9 0 885759649 371113984 7570 33554432000 4194304 5683644 140734844098576 18446744073709551615 274485791153 0 0 16781312 2 18446604454223471552 0 0 -1 7 0 0 0
[pid=859/tid=882] ppid=857 vsize=362416 CPUtime=0 cores=0-7
/proc/859/task/882/stat : 882 (python) S 857 859 813 0 -1 4202560 24 934 0 0 0 0 0 0 25 0 9 0 885759653 371113984 7570 33554432000 4194304 5683644 140734844098576 18446744073709551615 274485791153 0 0 16781312 2 18446604454223471552 0 0 -1 3 0 0 0
[pid=859/tid=885] ppid=857 vsize=362416 CPUtime=0 cores=0-7
/proc/859/task/885/stat : 885 (python) S 857 859 813 0 -1 4202560 27 934 0 0 0 0 0 0 19 0 9 0 885759656 371113984 7570 33554432000 4194304 5683644 140734844098576 18446744073709551615 274485791153 0 0 16781312 2 18446604454223471552 0 0 -1 7 0 0 0
[pid=859/tid=888] ppid=857 vsize=362416 CPUtime=0 cores=0-7
/proc/859/task/888/stat : 888 (python) S 857 859 813 0 -1 4202560 80 934 0 0 0 0 0 0 20 0 9 0 885759660 371113984 7570 33554432000 4194304 5683644 140734844098576 18446744073709551615 274485791153 0 0 16781312 2 18446604454223471552 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 46.35
Current children cumulated vsize (KiB) 7886644

[startup+25.5013 s]
/proc/loadavg: 1.90 0.42 0.14 9/195 889
/proc/meminfo: memFree=31728856/32950928 swapFree=67079488/67111528
[pid=859] ppid=857 vsize=362416 CPUtime=2.15 cores=0-7
/proc/859/stat : 859 (python) S 857 859 813 0 -1 4202496 18648 934 1 0 202 13 0 0 20 0 9 0 885758932 371113984 7570 33554432000 4194304 5683644 140734844098576 18446744073709551615 274485794251 0 0 16781312 2 18446744073709551615 0 0 17 7 0 0 0
/proc/859/statm: 90604 7570 1891 364 0 26501 0
[pid=865] ppid=859 vsize=280696 CPUtime=0.01 cores=0-7
/proc/865/stat : 865 (python) S 859 859 813 0 -1 4202560 883 0 0 0 1 0 0 0 18 0 1 0 885759633 287432704 5984 33554432000 4194304 5683644 140734844098576 18446744073709551615 274473987599 0 0 16781312 514 7086361237109309704 0 0 17 0 0 0 0
/proc/865/statm: 70174 5984 378 364 0 6092 0
[pid=867] ppid=865 vsize=1019708 CPUtime=18.41 cores=0-7
/proc/867/stat : 867 (gnovelty+2) R 865 867 867 0 -1 4202496 954 0 0 0 1841 0 0 0 25 0 1 0 885759634 1044180992 690 33554432000 134512640 135663704 4291512448 18446744073709551615 134524897 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/867/statm: 254927 690 113 282 0 254643 0
[pid=868] ppid=859 vsize=291020 CPUtime=0.02 cores=0-7
/proc/868/stat : 868 (python) S 859 859 813 0 -1 4202560 898 0 0 0 1 1 0 0 18 0 1 0 885759637 298004480 5982 33554432000 4194304 5683644 140734844098576 18446744073709551615 274473987654 0 0 16781312 514 7086361237109309704 0 0 17 7 0 0 0
/proc/868/statm: 72755 5982 372 364 0 8670 0
[pid=870] ppid=868 vsize=1019708 CPUtime=18.44 cores=0-7
/proc/870/stat : 870 (gnovelty+2) R 868 870 870 0 -1 4202496 951 0 0 0 1844 0 0 0 25 0 1 0 885759637 1044180992 690 33554432000 134512640 135663704 4286732240 18446744073709551615 134524916 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/870/statm: 254927 690 113 282 0 254643 0
[pid=871] ppid=859 vsize=301208 CPUtime=0.02 cores=0-7
/proc/871/stat : 871 (python) S 859 859 813 0 -1 4202560 918 0 0 0 1 1 0 0 18 0 1 0 885759641 308436992 6003 33554432000 4194304 5683644 140734844098576 18446744073709551615 274473987654 0 0 16781312 514 7086361237109309704 0 0 17 0 0 0 0
/proc/871/statm: 75302 6003 372 364 0 11214 0
[pid=874] ppid=871 vsize=420220 CPUtime=18.4 cores=0-7
/proc/874/stat : 874 (adaptg2wsat2009) R 871 874 874 0 -1 4202496 1665 0 0 0 1840 0 0 0 25 0 1 0 885759641 430305280 1400 33554432000 134512640 135107411 4289124112 18446744073709551615 134531435 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/874/statm: 105055 1400 59 146 0 103931 0
[pid=875] ppid=859 vsize=311532 CPUtime=0.02 cores=0-7
/proc/875/stat : 875 (python) S 859 859 813 0 -1 4202560 932 0 0 0 1 1 0 0 18 0 1 0 885759644 319008768 6007 33554432000 4194304 5683644 140734844098576 18446744073709551615 274473987654 0 0 16781312 514 7086361237109309701 0 0 17 1 0 0 0
/proc/875/statm: 77883 6007 372 364 0 13792 0
[pid=877] ppid=875 vsize=420220 CPUtime=18.37 cores=0-7
/proc/877/stat : 877 (adaptg2wsat2009) R 875 877 877 0 -1 4202496 1665 0 0 0 1837 0 0 0 25 0 1 0 885759645 430305280 1400 33554432000 134512640 135107411 4290512688 18446744073709551615 134531584 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/877/statm: 105055 1400 59 146 0 103931 0
[pid=878] ppid=859 vsize=321720 CPUtime=0.02 cores=0-7
/proc/878/stat : 878 (python) S 859 859 813 0 -1 4202560 948 0 0 0 1 1 0 0 18 0 1 0 885759648 329441280 6011 33554432000 4194304 5683644 140734844098576 18446744073709551615 274473987654 0 0 16781312 514 7086361237109309704 0 0 17 3 0 0 0
/proc/878/statm: 80430 6011 372 364 0 16336 0
[pid=880] ppid=878 vsize=420220 CPUtime=18.3 cores=0-7

################
# More data... #
################

[pid=962] ppid=859 vsize=561896 CPUtime=0.15 cores=0-7
/proc/962/stat : 962 (python) S 859 859 813 0 -1 4202560 1187 0 0 0 8 7 0 0 19 0 2 0 885808944 575381504 6637 33554432000 4194304 5683644 140734844098576 18446744073709551615 274485794251 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/962/statm: 140474 6637 407 364 0 76329 0
[pid=964] ppid=962 vsize=1019708 CPUtime=98.97 cores=0-7
/proc/964/stat : 964 (gnovelty+2) T 962 964 964 0 -1 4202496 970 0 0 0 9897 0 0 0 25 0 1 0 885808945 1044180992 690 33554432000 134512640 135663704 4286926704 18446744073709551615 134525260 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/964/statm: 254927 690 113 282 0 254643 0
[pid=962/tid=976] ppid=859 vsize=561896 CPUtime=0 cores=0-7
/proc/962/task/976/stat : 976 (python) S 859 859 813 0 -1 4202560 92 0 0 0 0 0 0 0 19 0 2 0 885818864 575381504 6637 33554432000 4194304 5683644 140734844098576 18446744073709551615 274485791153 0 0 16781312 514 18446604471160750272 0 0 -1 4 0 0 0
[pid=966] ppid=859 vsize=572152 CPUtime=0.15 cores=0-7
/proc/966/stat : 966 (python) S 859 859 813 0 -1 4202560 1181 0 0 0 7 8 0 0 19 0 2 0 885809079 585883648 6641 33554432000 4194304 5683644 140734844098576 18446744073709551615 274485794251 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/966/statm: 143038 6641 407 364 0 78890 0
[pid=968] ppid=966 vsize=335996 CPUtime=99.05 cores=0-7
/proc/968/stat : 968 (iPAWS) T 966 968 968 0 -1 4202496 1814 0 0 0 9905 0 0 0 25 0 1 0 885809080 344059904 1535 33554432000 134512640 135114423 4292082176 18446744073709551615 134517024 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/968/statm: 83999 1535 59 147 0 83851 0
[pid=966/tid=980] ppid=859 vsize=572152 CPUtime=0 cores=0-7
/proc/966/task/980/stat : 980 (python) S 859 859 813 0 -1 4202560 96 0 0 0 0 0 0 0 19 0 2 0 885819004 585883648 6641 33554432000 4194304 5683644 140734844098576 18446744073709551615 274485791153 0 0 16781312 514 18446604466080981376 0 0 -1 1 0 0 0
[pid=972] ppid=859 vsize=582408 CPUtime=0.46 cores=0-7
/proc/972/stat : 972 (python) S 859 859 813 0 -1 4202560 1203 0 0 0 24 22 0 0 18 0 2 0 885818791 596385792 6691 33554432000 4194304 5683644 140734844098576 18446744073709551615 274485794251 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/972/statm: 145602 6691 406 364 0 81451 0
[pid=975] ppid=972 vsize=268420 CPUtime=296.23 cores=0-7
/proc/975/stat : 975 (hybridGM3) T 972 975 975 0 -1 4202496 5409 0 0 0 29623 0 0 0 25 0 1 0 885818792 274862080 5126 33554432000 134512640 135204385 4294341808 18446744073709551615 134538041 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/975/statm: 67105 5126 63 169 0 66935 0
[pid=972/tid=990] ppid=859 vsize=582408 CPUtime=0 cores=0-7
/proc/972/task/990/stat : 990 (python) S 859 859 813 0 -1 4202560 103 0 0 0 0 0 0 0 18 0 2 0 885838838 596385792 6691 33554432000 4194304 5683644 140734844098576 18446744073709551615 274485791153 0 0 16781312 514 18446604466195669184 0 0 -1 0 0 0 0
[pid=977] ppid=859 vsize=593088 CPUtime=1.08 cores=0-7
/proc/977/stat : 977 (python) S 859 859 813 0 -1 4202560 1094 0 0 0 59 49 0 0 18 0 1 0 885818874 607322112 6615 33554432000 4194304 5683644 140734844098576 18446744073709551615 274473987654 0 0 16781312 514 7086361237109309702 0 0 17 1 0 0 0
/proc/977/statm: 148272 6615 373 364 0 84118 0
[pid=979] ppid=977 vsize=458348 CPUtime=682.63 cores=0-7
/proc/979/stat : 979 (TNM) R 977 979 979 0 -1 4202496 1524 0 0 0 68262 1 0 0 25 0 1 0 885818874 469348352 1240 33554432000 134512640 135008748 4294041216 18446744073709551615 134528574 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/979/statm: 114587 1240 46 122 0 113487 0
[pid=983] ppid=859 vsize=603592 CPUtime=0.15 cores=0-7
/proc/983/stat : 983 (python) S 859 859 813 0 -1 4202560 1249 0 0 0 8 7 0 0 19 0 2 0 885828644 618078208 6743 33554432000 4194304 5683644 140734844098576 18446744073709551615 274485794251 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/983/statm: 150898 6743 401 364 0 86741 0
[pid=985] ppid=983 vsize=335996 CPUtime=99.42 cores=0-7
/proc/985/stat : 985 (iPAWS) T 983 985 985 0 -1 4202496 1817 0 0 0 9941 1 0 0 25 0 1 0 885828645 344059904 1535 33554432000 134512640 135114423 4292026736 18446744073709551615 134517054 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/985/statm: 83999 1535 59 147 0 83851 0
[pid=983/tid=989] ppid=859 vsize=603592 CPUtime=0 cores=0-7
/proc/983/task/989/stat : 989 (python) S 859 859 813 0 -1 4202560 45 0 0 0 0 0 0 0 19 0 2 0 885838659 618078208 6743 33554432000 4194304 5683644 140734844098576 18446744073709551615 274485791153 0 0 16781312 514 18446604469472506304 0 0 -1 0 0 0 0
[pid=993] ppid=859 vsize=613604 CPUtime=0.15 cores=0-7
/proc/993/stat : 993 (python) S 859 859 813 0 -1 4202560 1196 0 0 0 7 8 0 0 19 0 2 0 885847962 628330496 6797 33554432000 4194304 5683644 140734844098576 18446744073709551615 274485794251 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/993/statm: 153401 6797 400 364 0 89241 0
[pid=995] ppid=993 vsize=249872 CPUtime=98.9 cores=0-7
/proc/995/stat : 995 (FH) T 993 995 995 0 -1 4202496 1548 0 0 0 9890 0 0 0 25 0 1 0 885847963 255868928 1264 33554432000 134512640 134936988 4286869280 18446744073709551615 134554594 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/995/statm: 62468 1264 41 104 0 61972 0
[pid=993/tid=1008] ppid=859 vsize=613604 CPUtime=0 cores=0-7
/proc/993/task/1008/stat : 1008 (python) S 859 859 813 0 -1 4202560 101 0 0 0 0 0 0 0 19 0 2 0 885857886 628330496 6797 33554432000 4194304 5683644 140734844098576 18446744073709551615 274485791153 0 0 16781312 514 18446604469472508096 0 0 -1 0 0 0 0
[pid=996] ppid=859 vsize=623860 CPUtime=0.16 cores=0-7
/proc/996/stat : 996 (python) S 859 859 813 0 -1 4202560 1197 0 0 0 9 7 0 0 19 0 2 0 885848392 638832640 6879 33554432000 4194304 5683644 140734844098576 18446744073709551615 274485794251 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/996/statm: 155965 6879 401 364 0 91802 0
[pid=998] ppid=996 vsize=335996 CPUtime=101.85 cores=0-7
/proc/998/stat : 998 (iPAWS) T 996 998 998 0 -1 4202496 1818 0 0 0 10185 0 0 0 25 0 1 0 885848393 344059904 1535 33554432000 134512640 135114423 4293651376 18446744073709551615 134516770 0 0 16781312 0 18446744071562691360 0 0 17 7 0 0 0
/proc/998/statm: 83999 1535 59 147 0 83851 0
[pid=996/tid=1009] ppid=859 vsize=623860 CPUtime=0 cores=0-7
/proc/996/task/1009/stat : 1009 (python) S 859 859 813 0 -1 4202560 99 0 0 0 0 0 0 0 19 0 2 0 885859010 638832640 6879 33554432000 4194304 5683644 140734844098576 18446744073709551615 274485791153 0 0 16781312 514 18446604458815756992 0 0 -1 7 0 0 0
[pid=1000] ppid=859 vsize=634116 CPUtime=0.63 cores=0-7
/proc/1000/stat : 1000 (python) S 859 859 813 0 -1 4202560 1258 0 0 0 36 27 0 0 18 0 2 0 885848872 649334784 6815 33554432000 4194304 5683644 140734844098576 18446744073709551615 274473987654 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/1000/statm: 158529 6815 406 364 0 94363 0
[pid=1002] ppid=1000 vsize=268424 CPUtime=382.24 cores=0-7
/proc/1002/stat : 1002 (hybridGM3) R 1000 1002 1002 0 -1 4202496 5418 0 0 0 38224 0 0 0 25 0 1 0 885848874 274866176 5126 33554432000 134512640 135204385 4290812720 18446744073709551615 134538047 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/1002/statm: 67106 5126 63 169 0 66936 0
[pid=1000/tid=1016] ppid=859 vsize=634116 CPUtime=0 cores=0-7
/proc/1000/task/1016/stat : 1016 (python) S 859 859 813 0 -1 4202560 105 0 0 0 0 0 0 0 18 0 2 0 885868509 649334784 6815 33554432000 4194304 5683644 140734844098576 18446744073709551615 274485791153 0 0 16781312 514 18446604469122318464 0 0 -1 1 0 0 0
[pid=1005] ppid=859 vsize=644372 CPUtime=0.48 cores=0-7
/proc/1005/stat : 1005 (python) S 859 859 813 0 -1 4202560 1032 0 0 0 23 25 0 0 18 0 1 0 885857564 659836928 6907 33554432000 4194304 5683644 140734844098576 18446744073709551615 274473987654 0 0 16781312 514 7086361237109309702 0 0 17 3 0 0 0
/proc/1005/statm: 161093 6907 379 364 0 96924 0
[pid=1007] ppid=1005 vsize=419776 CPUtime=295.32 cores=0-7
/proc/1007/stat : 1007 (NCVWr) R 1005 1007 1007 0 -1 4202496 1567 0 0 0 29531 1 0 0 25 0 1 0 885857565 429850624 1281 33554432000 134512640 135113558 4290799936 18446744073709551615 134533845 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/1007/statm: 104944 1281 58 147 0 103819 0
[pid=1010] ppid=859 vsize=654628 CPUtime=0.17 cores=0-7
/proc/1010/stat : 1010 (python) S 859 859 813 0 -1 4202560 1265 0 0 0 9 8 0 0 19 0 2 0 885859021 670339072 7001 33554432000 4194304 5683644 140734844098576 18446744073709551615 274485794251 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/1010/statm: 163657 7001 406 364 0 99485 0
[pid=1012] ppid=1010 vsize=1019708 CPUtime=99.85 cores=0-7
/proc/1012/stat : 1012 (gnovelty+2) T 1010 1012 1012 0 -1 4202496 978 0 0 0 9985 0 0 0 25 0 1 0 885859021 1044180992 690 33554432000 134512640 135663704 4290340880 18446744073709551615 134525276 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/1012/statm: 254927 690 113 282 0 254643 0
[pid=1010/tid=1017] ppid=859 vsize=654628 CPUtime=0 cores=0-7
/proc/1010/task/1017/stat : 1017 (python) S 859 859 813 0 -1 4202560 110 0 0 0 0 0 0 0 19 0 2 0 885869041 670339072 7001 33554432000 4194304 5683644 140734844098576 18446744073709551615 274485791153 0 0 16781312 514 18446604466853905472 0 0 -1 0 0 0 0
[pid=1018] ppid=859 vsize=664884 CPUtime=0.29 cores=0-7
/proc/1018/stat : 1018 (python) S 859 859 813 0 -1 4202560 1050 0 0 0 16 13 0 0 18 0 1 0 885869052 680841216 6870 33554432000 4194304 5683644 140734844098576 18446744073709551615 274473987654 0 0 16781312 514 7086361237109309701 0 0 17 3 0 0 0
/proc/1018/statm: 166221 6870 378 364 0 102046 0
[pid=1020] ppid=1018 vsize=268424 CPUtime=177.06 cores=0-7
/proc/1020/stat : 1020 (hybridGM3) R 1018 1020 1020 0 -1 4202496 5413 0 0 0 17704 2 0 0 25 0 1 0 885869052 274866176 5125 33554432000 134512640 135204385 4286643360 18446744073709551615 134538480 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/1020/statm: 67106 5125 63 169 0 66936 0
[pid=1026] ppid=859 vsize=675140 CPUtime=0 cores=0-7
/proc/1026/stat : 1026 (python) S 859 859 813 0 -1 4202560 916 0 0 0 0 0 0 0 19 0 1 0 885887167 691343360 6810 33554432000 4194304 5683644 140734844098576 18446744073709551615 274473987654 0 0 16781312 514 6906710112396640255 0 0 17 3 0 0 0
/proc/1026/statm: 168785 6810 345 364 0 104607 0
[pid=1028] ppid=1026 vsize=454088 CPUtime=0.15 cores=0-7
/proc/1028/stat : 1028 (TNM) R 1026 1028 1028 0 -1 4202496 1292 0 0 0 15 0 0 0 21 0 1 0 885887168 464986112 996 33554432000 134512640 135008748 4294436016 18446744073709551615 134523384 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/1028/statm: 113522 996 45 122 0 112422 0
[pid=859/tid=866] ppid=857 vsize=685384 CPUtime=0 cores=0-7
/proc/859/task/866/stat : 866 (python) S 857 859 813 0 -1 4202560 23 934 0 0 0 0 0 0 18 0 34 0 885759633 701833216 8411 33554432000 4194304 5683644 140734844098576 18446744073709551615 274485791153 0 0 16781312 2 18446604454223471552 0 0 -1 1 0 0 0
[pid=859/tid=869] ppid=857 vsize=685384 CPUtime=0 cores=0-7
/proc/859/task/869/stat : 869 (python) S 857 859 813 0 -1 4202560 23 934 0 0 0 0 0 0 20 0 34 0 885759637 701833216 8411 33554432000 4194304 5683644 140734844098576 18446744073709551615 274485791153 0 0 16781312 2 18446604454223471552 0 0 -1 3 0 0 0
[pid=859/tid=872] ppid=857 vsize=685384 CPUtime=0 cores=0-7
/proc/859/task/872/stat : 872 (python) S 857 859 813 0 -1 4202560 37 934 0 0 0 0 0 0 18 0 34 0 885759641 701833216 8411 33554432000 4194304 5683644 140734844098576 18446744073709551615 274485791153 0 0 16781312 2 18446604454223471552 0 0 -1 7 0 0 0
[pid=859/tid=876] ppid=857 vsize=685384 CPUtime=0 cores=0-7
/proc/859/task/876/stat : 876 (python) S 857 859 813 0 -1 4202560 26 934 0 0 0 0 0 0 18 0 34 0 885759645 701833216 8411 33554432000 4194304 5683644 140734844098576 18446744073709551615 274485791153 0 0 16781312 2 18446604454223471552 0 0 -1 7 0 0 0
[pid=859/tid=879] ppid=857 vsize=685384 CPUtime=0 cores=0-7
/proc/859/task/879/stat : 879 (python) S 857 859 813 0 -1 4202560 36 934 0 0 0 0 0 0 18 0 34 0 885759649 701833216 8411 33554432000 4194304 5683644 140734844098576 18446744073709551615 274485791153 0 0 16781312 2 18446604454223471552 0 0 -1 7 0 0 0
[pid=859/tid=882] ppid=857 vsize=685384 CPUtime=0 cores=0-7
/proc/859/task/882/stat : 882 (python) S 857 859 813 0 -1 4202560 24 934 0 0 0 0 0 0 25 0 34 0 885759653 701833216 8411 33554432000 4194304 5683644 140734844098576 18446744073709551615 274485791153 0 0 16781312 2 18446604454223471552 0 0 -1 3 0 0 0
[pid=859/tid=885] ppid=857 vsize=685384 CPUtime=0 cores=0-7
/proc/859/task/885/stat : 885 (python) S 857 859 813 0 -1 4202560 32 934 0 0 0 0 0 0 18 0 34 0 885759656 701833216 8411 33554432000 4194304 5683644 140734844098576 18446744073709551615 274485791153 0 0 16781312 2 18446604454223471552 0 0 -1 7 0 0 0
[pid=859/tid=888] ppid=857 vsize=685384 CPUtime=0 cores=0-7
/proc/859/task/888/stat : 888 (python) S 857 859 813 0 -1 4202560 84 934 0 0 0 0 0 0 18 0 34 0 885759660 701833216 8411 33554432000 4194304 5683644 140734844098576 18446744073709551615 274485791153 0 0 16781312 2 18446604454223471552 0 0 -1 7 0 0 0
[pid=859/tid=894] ppid=857 vsize=685384 CPUtime=0 cores=0-7
/proc/859/task/894/stat : 894 (python) S 857 859 813 0 -1 4202560 60 934 0 0 0 0 0 0 18 0 34 0 885769557 701833216 8411 33554432000 4194304 5683644 140734844098576 18446744073709551615 274485791153 0 0 16781312 2 18446604454223471552 0 0 -1 7 0 0 0
[pid=859/tid=898] ppid=857 vsize=685384 CPUtime=0 cores=0-7
/proc/859/task/898/stat : 898 (python) S 857 859 813 0 -1 4202560 47 934 0 0 0 0 0 0 18 0 34 0 885769582 701833216 8411 33554432000 4194304 5683644 140734844098576 18446744073709551615 274485791153 0 0 16781312 2 18446604454223471552 0 0 -1 7 0 0 0
[pid=859/tid=903] ppid=857 vsize=685384 CPUtime=0 cores=0-7
/proc/859/task/903/stat : 903 (python) S 857 859 813 0 -1 4202560 47 934 0 0 0 0 0 0 18 0 34 0 885769654 701833216 8411 33554432000 4194304 5683644 140734844098576 18446744073709551615 274485791153 0 0 16781312 2 18446604454223471552 0 0 -1 4 0 0 0
[pid=859/tid=907] ppid=857 vsize=685384 CPUtime=0 cores=0-7
/proc/859/task/907/stat : 907 (python) S 857 859 813 0 -1 4202560 24 934 0 0 0 0 0 0 20 0 34 0 885769659 701833216 8411 33554432000 4194304 5683644 140734844098576 18446744073709551615 274485791153 0 0 16781312 2 18446604454223471552 0 0 -1 0 0 0 0
[pid=859/tid=912] ppid=857 vsize=685384 CPUtime=0 cores=0-7
/proc/859/task/912/stat : 912 (python) S 857 859 813 0 -1 4202560 41 934 0 0 0 0 0 0 18 0 34 0 885769664 701833216 8411 33554432000 4194304 5683644 140734844098576 18446744073709551615 274485791153 0 0 16781312 2 18446604454223471552 0 0 -1 7 0 0 0
[pid=859/tid=916] ppid=857 vsize=685384 CPUtime=0 cores=0-7
/proc/859/task/916/stat : 916 (python) S 857 859 813 0 -1 4202560 30 934 0 0 0 0 0 0 18 0 34 0 885769670 701833216 8411 33554432000 4194304 5683644 140734844098576 18446744073709551615 274485791153 0 0 16781312 2 18446604454223471552 0 0 -1 1 0 0 0
[pid=859/tid=920] ppid=857 vsize=685384 CPUtime=0 cores=0-7
/proc/859/task/920/stat : 920 (python) S 857 859 813 0 -1 4202560 45 934 0 0 0 0 0 0 18 0 34 0 885769676 701833216 8411 33554432000 4194304 5683644 140734844098576 18446744073709551615 274485791153 0 0 16781312 2 18446604454223471552 0 0 -1 3 0 0 0
[pid=859/tid=923] ppid=857 vsize=685384 CPUtime=0 cores=0-7
/proc/859/task/923/stat : 923 (python) S 857 859 813 0 -1 4202560 34 934 0 0 0 0 0 0 18 0 34 0 885769683 701833216 8411 33554432000 4194304 5683644 140734844098576 18446744073709551615 274485791153 0 0 16781312 2 18446604454223471552 0 0 -1 7 0 0 0
[pid=859/tid=930] ppid=857 vsize=685384 CPUtime=0 cores=0-7
/proc/859/task/930/stat : 930 (python) S 857 859 813 0 -1 4202560 27 934 0 0 0 0 0 0 20 0 34 0 885779576 701833216 8411 33554432000 4194304 5683644 140734844098576 18446744073709551615 274485791153 0 0 16781312 2 18446604454223471552 0 0 -1 0 0 0 0
[pid=859/tid=934] ppid=857 vsize=685384 CPUtime=0 cores=0-7
/proc/859/task/934/stat : 934 (python) S 857 859 813 0 -1 4202560 128 934 0 0 0 0 0 0 18 0 34 0 885779603 701833216 8411 33554432000 4194304 5683644 140734844098576 18446744073709551615 274485791153 0 0 16781312 2 18446604454223471552 0 0 -1 7 0 0 0
[pid=859/tid=939] ppid=857 vsize=685384 CPUtime=0 cores=0-7
/proc/859/task/939/stat : 939 (python) S 857 859 813 0 -1 4202560 39 934 0 0 0 0 0 0 19 0 34 0 885779693 701833216 8411 33554432000 4194304 5683644 140734844098576 18446744073709551615 274485791153 0 0 16781312 2 18446604454223471552 0 0 -1 7 0 0 0
[pid=859/tid=951] ppid=857 vsize=685384 CPUtime=0 cores=0-7
/proc/859/task/951/stat : 951 (python) S 857 859 813 0 -1 4202560 54 934 0 0 0 0 0 0 18 0 34 0 885789525 701833216 8411 33554432000 4194304 5683644 140734844098576 18446744073709551615 274485791153 0 0 16781312 2 18446604454223471552 0 0 -1 0 0 0 0
[pid=859/tid=954] ppid=857 vsize=685384 CPUtime=0 cores=0-7
/proc/859/task/954/stat : 954 (python) S 857 859 813 0 -1 4202560 37 934 0 0 0 0 0 0 20 0 34 0 885789806 701833216 8411 33554432000 4194304 5683644 140734844098576 18446744073709551615 274485791153 0 0 16781312 2 18446604454223471552 0 0 -1 7 0 0 0
[pid=859/tid=963] ppid=857 vsize=685384 CPUtime=0 cores=0-7
/proc/859/task/963/stat : 963 (python) S 857 859 813 0 -1 4202560 49 934 0 0 0 0 0 0 20 0 34 0 885808945 701833216 8411 33554432000 4194304 5683644 140734844098576 18446744073709551615 274485791153 0 0 16781312 2 18446604454223471552 0 0 -1 0 0 0 0
[pid=859/tid=967] ppid=857 vsize=685384 CPUtime=0 cores=0-7
/proc/859/task/967/stat : 967 (python) S 857 859 813 0 -1 4202560 42 934 0 0 0 0 0 0 19 0 34 0 885809079 701833216 8411 33554432000 4194304 5683644 140734844098576 18446744073709551615 274485791153 0 0 16781312 2 18446604454223471552 0 0 -1 7 0 0 0
[pid=859/tid=974] ppid=857 vsize=685384 CPUtime=0 cores=0-7
/proc/859/task/974/stat : 974 (python) S 857 859 813 0 -1 4202560 46 934 0 0 0 0 0 0 18 0 34 0 885818792 701833216 8411 33554432000 4194304 5683644 140734844098576 18446744073709551615 274485791153 0 0 16781312 2 18446604454223471552 0 0 -1 0 0 0 0
[pid=859/tid=978] ppid=857 vsize=685384 CPUtime=0 cores=0-7
/proc/859/task/978/stat : 978 (python) S 857 859 813 0 -1 4202560 25 934 0 0 0 0 0 0 20 0 34 0 885818874 701833216 8411 33554432000 4194304 5683644 140734844098576 18446744073709551615 274485791153 0 0 16781312 2 18446604454223471552 0 0 -1 7 0 0 0
[pid=859/tid=984] ppid=857 vsize=685384 CPUtime=0 cores=0-7
/proc/859/task/984/stat : 984 (python) S 857 859 813 0 -1 4202560 28 934 0 0 0 0 0 0 20 0 34 0 885828644 701833216 8411 33554432000 4194304 5683644 140734844098576 18446744073709551615 274485791153 0 0 16781312 2 18446604454223471552 0 0 -1 0 0 0 0
[pid=859/tid=994] ppid=857 vsize=685384 CPUtime=0 cores=0-7
/proc/859/task/994/stat : 994 (python) S 857 859 813 0 -1 4202560 46 934 0 0 0 0 0 0 20 0 34 0 885847962 701833216 8411 33554432000 4194304 5683644 140734844098576 18446744073709551615 274485791153 0 0 16781312 2 18446604454223471552 0 0 -1 0 0 0 0
[pid=859/tid=997] ppid=857 vsize=685384 CPUtime=0 cores=0-7
/proc/859/task/997/stat : 997 (python) S 857 859 813 0 -1 4202560 34 934 0 0 0 0 0 0 20 0 34 0 885848392 701833216 8411 33554432000 4194304 5683644 140734844098576 18446744073709551615 274485791153 0 0 16781312 2 18446604454223471552 0 0 -1 0 0 0 0
[pid=859/tid=1001] ppid=857 vsize=685384 CPUtime=0 cores=0-7
/proc/859/task/1001/stat : 1001 (python) S 857 859 813 0 -1 4202560 48 934 0 0 0 0 0 0 18 0 34 0 885848873 701833216 8411 33554432000 4194304 5683644 140734844098576 18446744073709551615 274485791153 0 0 16781312 2 18446604454223471552 0 0 -1 2 0 0 0
[pid=859/tid=1006] ppid=857 vsize=685384 CPUtime=0 cores=0-7
/proc/859/task/1006/stat : 1006 (python) S 857 859 813 0 -1 4202560 36 934 0 0 0 0 0 0 20 0 34 0 885857565 701833216 8411 33554432000 4194304 5683644 140734844098576 18446744073709551615 274485791153 0 0 16781312 2 18446604454223471552 0 0 -1 3 0 0 0
[pid=859/tid=1011] ppid=857 vsize=685384 CPUtime=0 cores=0-7
/proc/859/task/1011/stat : 1011 (python) S 857 859 813 0 -1 4202560 34 934 0 0 0 0 0 0 20 0 34 0 885859021 701833216 8411 33554432000 4194304 5683644 140734844098576 18446744073709551615 274485791153 0 0 16781312 2 18446604454223471552 0 0 -1 3 0 0 0
[pid=859/tid=1019] ppid=857 vsize=685384 CPUtime=0 cores=0-7
/proc/859/task/1019/stat : 1019 (python) S 857 859 813 0 -1 4202560 37 934 0 0 0 0 0 0 20 0 34 0 885869052 701833216 8411 33554432000 4194304 5683644 140734844098576 18446744073709551615 274485791153 0 0 16781312 2 18446604454223471552 0 0 -1 3 0 0 0
[pid=859/tid=1027] ppid=857 vsize=685384 CPUtime=0 cores=0-7
/proc/859/task/1027/stat : 1027 (python) S 857 859 813 0 -1 4202560 39 934 0 0 0 0 0 0 20 0 34 0 885887168 701833216 8411 33554432000 4194304 5683644 140734844098576 18446744073709551615 274485791153 0 0 16781312 2 18446604454223471552 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 10165.5
Current children cumulated vsize (KiB) 32535500

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 859 and gives
#  childrusage.ru_utime.tv_sec=6
#  childrusage.ru_utime.tv_usec=584998
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=277957
# CPU time returned by wait4() is 6.86296
# while last known CPU time is 10165.5
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1282.72
CPU time (s): 10165.5
CPU user time (s): 10157.8
CPU system time (s): 7.7
CPU usage (%): 792.499
Max. virtual memory (cumulated for all children) (KiB): 32535500

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 6.585
system time used= 0.277957
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 74157
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3453
involuntary context switches= 102

runsolver used 12.1192 second user time and 26.004 second system time

The end

Launcher Data 

Begin job on node125 at 2011-06-10 23:33:09
IDJOB=3321773
IDBENCH=82551
IDSOLVER=1712
FILE ID=node125/3321773-1307741589
RUNJOBID= node125-1307741589-827
PBS_JOBID= 13550781
Free space on /tmp= 74028 MiB

SOLVER NAME= borg-sat 11.03.02-random
BENCH NAME= SAT11/random/large/unif-k7-r85-v300-c25500-S966156467-066-UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3321773-1307741589/watcher-3321773-1307741589 -o /tmp/evaluation-result-3321773-1307741589/solver-3321773-1307741589 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3321773-1307741589.cnf -seed 951405007 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 5297bd1d2a420892cfb1fb6d32ccacad
RANDOM SEED=951405007

node125.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5266.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      31824444 kB
Buffers:        240000 kB
Cached:         654360 kB
SwapCached:       3400 kB
Active:         412284 kB
Inactive:       518040 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      31824444 kB
SwapTotal:    67111528 kB
SwapFree:     67079488 kB
Dirty:           32672 kB
Writeback:           0 kB
AnonPages:       34460 kB
Mapped:          13556 kB
Slab:           132108 kB
PageTables:       4256 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   182968 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73992 MiB
End job on node125 at 2011-06-10 23:54:37