Trace number 3378197

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-par-random (fixed)? (MO) 2380.77 600.633

General information on the benchmark

Namerandom/large/
unif-k7-r85-v300-c25500-S376724493-075-UNKNOWN.cnf
MD5SUMb318fd1a86aee981aadb17224d952a44
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables300
Number of clauses25500
Sum of the clauses size178500
Maximum clause length7
Minimum clause length7
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 525500

Solver Data 

0.32/0.46	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.32/0.46	c INFO: solving HOME/instance-3378197-1305463531.cnf
0.32/0.46	c INFO: computing task features
0.51/0.63	c INFO: computed variable-clause graph statistics
0.51/0.64	c INFO: computed clause balance statistics
1.40/1.54	c INFO: computed variable balance statistics
1.81/1.90	c INFO: computed small-clause counts
1.81/1.90	c INFO: computed Horn-clause counts
1.81/1.93	c INFO: computed variable graph statistics
1.81/1.93	c INFO: collected features for HOME/instance-3378197-1305463531.cnf in 1.46 s
1.81/1.94	c INFO: running gnovelty+2@0 for 97 with 1198 remaining (b = 0.37)
1.81/1.95	c INFO: running gnovelty+2@0 for 97 with 1198 remaining (b = 0.13)
1.81/1.96	c INFO: running adaptg2wsat2009++@0 for 97 with 1198 remaining (b = 0.08)
1.81/1.97	c INFO: running adaptg2wsat2009++@0 for 97 with 1198 remaining (b = 0.07)
401.43/102.27	c INFO: running adaptg2wsat2009++@0 for 97 with 1098 remaining (b = 0.05)
401.43/102.29	c INFO: running gnovelty+2@0 for 97 with 1098 remaining (b = 0.04)
401.43/102.30	c INFO: running FH@0 for 97 with 1098 remaining (b = 0.03)
401.78/102.31	c INFO: running adaptg2wsat2009++@0 for 97 with 1098 remaining (b = 0.03)
800.66/202.60	c INFO: running adaptg2wsat2009++@0 for 97 with 997 remaining (b = 0.02)
800.66/202.67	c INFO: running FH@0 for 97 with 997 remaining (b = 0.02)
800.66/202.69	c INFO: running hybridGM3@0 for 194 with 997 remaining (b = 0.04)
816.92/206.75	c INFO: running gnovelty+2@0 for 97 with 993 remaining (b = 0.02)
1195.82/302.03	c INFO: running hybridGM3@0 for 194 with 898 remaining (b = 0.03)
1199.39/302.95	c INFO: running adaptg2wsat2009++@0 for 97 with 897 remaining (b = 0.01)
1216.04/307.13	c INFO: running hybridGM3@0 for 194 with 893 remaining (b = 0.03)
1598.07/403.28	c INFO: running hybridGM3@0 for 194 with 797 remaining (b = 0.02)
1606.38/405.38	c INFO: running hybridGM3@101 for 97 with 795 remaining (b = 0.01)
1984.45/500.68	c INFO: running TNM@0 for 699 with 699 remaining (b = 0.08)
1992.83/502.78	c INFO: running hybridGM3@100 for 97 with 697 remaining (b = 0.01)
1996.75/503.81	c INFO: running hybridGM3@97 for 97 with 696 remaining (b = 0.01)
2370.79/598.09	c INFO: running hybridGM3@296 for 97 with 602 remaining (b = 0.01)
2375.13/599.12	c INFO: running hybridGM3@192 for 97 with 601 remaining (b = 0.01)
2378.30/599.97	c INFO: running FH@0 for 97 with 600 remaining (b = 0.01)
2380.77/600.61	c INFO: running adaptg2wsat2009++@0 for 97 with 599 remaining (b = 0.01)
2380.77/600.61	Traceback (most recent call last):
2380.77/600.61	  File "HOME/solve", line 33, in <module>
2380.77/600.61	    plac.call(main)
2380.77/600.61	  File "/home/evaluation/evaluation/tools64/lib/python2.7/site-packages/plac-0.8.1-py2.7.egg/plac_core.py", line 311, in call
2380.77/600.61	    cmd, result = parser_from(obj).consume(arglist)
2380.77/600.61	  File "/home/evaluation/evaluation/tools64/lib/python2.7/site-packages/plac-0.8.1-py2.7.egg/plac_core.py", line 192, in consume
2380.77/600.61	    return cmd, self.func(*(args + varargs + extraopts), **kwargs)
2380.77/600.61	  File "HOME/borg/build/lib/borg/tools/solve.py", line 84, in main
2380.77/600.61	    (_, answer, _) = solver(input_path, budget / cores, cores)
2380.77/600.61	  File "HOME/borg/build/lib/borg/bilevel.py", line 202, in __call__
2380.77/600.61	    solver.go(max_cost * borg.defaults.machine_speed)
2380.77/600.61	  File "HOME/borg/build/lib/borg/solvers.py", line 179, in go
2380.77/600.61	    self._process.start()
2380.77/600.61	  File "/home/evaluation/evaluation/tools64/lib/python2.7/multiprocessing/process.py", line 94, in start
2380.77/600.61	    assert self._popen is None, 'cannot start a process twice'
2380.77/600.61	AssertionError: cannot start a process twice

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3378197-1305463531/watcher-3378197-1305463531 -o /tmp/evaluation-result-3378197-1305463531/solver-3378197-1305463531 -C 4800 -W 1300 -M 15500 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3378197-1305463531.cnf -seed 748228360 -budget 4800 -cores 4 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.12 7.39 5.62 5/425 2570
/proc/meminfo: memFree=26631068/32950928 swapFree=60199044/67111528
[pid=2570] ppid=2568 vsize=15756 CPUtime=0 cores=1,3,5,7
/proc/2570/stat : 2570 (python) S 2568 2570 2082 0 -1 4202496 838 0 0 0 0 0 0 0 25 0 1 0 657951928 16134144 723 33554432000 4194304 5683644 140734455610336 18446744073709551615 268272687104 0 2147483391 16781312 2 18446744071699199166 0 0 17 5 0 0 0
/proc/2570/statm: 3939 723 334 364 0 426 0

[startup+0.0903701 s]
/proc/loadavg: 8.12 7.39 5.62 5/425 2570
/proc/meminfo: memFree=26631068/32950928 swapFree=60199044/67111528
[pid=2570] ppid=2568 vsize=99376 CPUtime=0.06 cores=1,3,5,7
/proc/2570/stat : 2570 (python) R 2568 2570 2082 0 -1 4202496 2864 0 0 0 5 1 0 0 25 0 1 0 657951928 101761024 2564 33554432000 4194304 5683644 140734455610336 18446744073709551615 268272687104 0 2147483391 16781312 2 0 0 0 17 5 0 0 0
/proc/2570/statm: 24844 2564 818 364 0 1695 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 99376

[startup+0.100367 s]
/proc/loadavg: 8.12 7.39 5.62 5/425 2570
/proc/meminfo: memFree=26631068/32950928 swapFree=60199044/67111528
[pid=2570] ppid=2568 vsize=104232 CPUtime=0.07 cores=1,3,5,7
/proc/2570/stat : 2570 (python) R 2568 2570 2082 0 -1 4202496 3065 0 0 0 5 2 0 0 25 0 1 0 657951928 106733568 2748 33554432000 4194304 5683644 140734455610336 18446744073709551615 4620076 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/2570/statm: 26057 2749 847 364 0 1805 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 104232

[startup+0.300412 s]
/proc/loadavg: 8.12 7.39 5.62 5/425 2570
/proc/meminfo: memFree=26631068/32950928 swapFree=60199044/67111528
[pid=2570] ppid=2568 vsize=187692 CPUtime=0.23 cores=1,3,5,7
/proc/2570/stat : 2570 (python) S 2568 2570 2082 0 -1 4202496 6824 936 1 0 17 6 0 0 25 0 1 0 657951928 192196608 4884 33554432000 4194304 5683644 140734455610336 18446744073709551615 268267765383 0 2147483391 16781312 2 18446744071699199166 0 0 17 5 0 0 0
/proc/2570/statm: 47564 4886 1399 364 0 3724 0
Current children cumulated CPU time (s) 0.23
Current children cumulated vsize (KiB) 187692

[startup+0.70026 s]
/proc/loadavg: 8.12 7.39 5.62 5/425 2570
/proc/meminfo: memFree=26631068/32950928 swapFree=60199044/67111528
[pid=2570] ppid=2568 vsize=285640 CPUtime=0.6 cores=1,3,5,7
/proc/2570/stat : 2570 (python) R 2568 2570 2082 0 -1 4202496 12494 936 1 0 51 9 0 0 17 0 1 0 657951928 292495360 8794 33554432000 4194304 5683644 140734455610336 18446744073709551615 47295143030453 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/2570/statm: 71410 8794 1826 364 0 7334 0
Current children cumulated CPU time (s) 0.6
Current children cumulated vsize (KiB) 285640

[startup+1.50012 s]
/proc/loadavg: 8.12 7.39 5.62 6/426 2575
/proc/meminfo: memFree=26601176/32950928 swapFree=60199044/67111528
[pid=2570] ppid=2568 vsize=285640 CPUtime=1.4 cores=1,3,5,7
/proc/2570/stat : 2570 (python) R 2568 2570 2082 0 -1 4202496 12494 936 1 0 131 9 0 0 19 0 1 0 657951928 292495360 8794 33554432000 4194304 5683644 140734455610336 18446744073709551615 4294353 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/2570/statm: 71410 8794 1826 364 0 7334 0
Current children cumulated CPU time (s) 1.4
Current children cumulated vsize (KiB) 285640

[startup+3.10083 s]
/proc/loadavg: 7.87 7.35 5.62 9/438 2588
/proc/meminfo: memFree=26578520/32950928 swapFree=60199044/67111528
[pid=2570] ppid=2568 vsize=321292 CPUtime=1.87 cores=1,3,5,7
/proc/2570/stat : 2570 (python) S 2568 2570 2082 0 -1 4202496 15262 936 1 0 177 10 0 0 25 0 5 0 657951928 329003008 7530 33554432000 4194304 5683644 140734455610336 18446744073709551615 268284515787 0 0 16781312 2 18446744073709551615 0 0 17 1 0 0 0
/proc/2570/statm: 80323 7530 1875 364 0 16232 0
[pid=2577] ppid=2570 vsize=280764 CPUtime=0 cores=1,3,5,7
/proc/2577/stat : 2577 (python) S 2570 2570 2082 0 -1 4202560 721 0 0 0 0 0 0 0 18 0 1 0 657952123 287502336 5978 33554432000 4194304 5683644 140734455610336 18446744073709551615 268272709135 0 0 16781312 514 4239743504156164360 0 0 17 5 0 0 0
/proc/2577/statm: 70191 5978 355 364 0 6109 0
[pid=2579] ppid=2577 vsize=1019708 CPUtime=1.13 cores=1,3,5,7
/proc/2579/stat : 2579 (gnovelty+2) R 2577 2579 2579 0 -1 4202496 951 0 0 0 113 0 0 0 25 0 1 0 657952123 1044180992 689 33554432000 134512640 135663704 4291964048 18446744073709551615 134525258 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/2579/statm: 254927 689 113 282 0 254643 0
[pid=2580] ppid=2570 vsize=291088 CPUtime=0 cores=1,3,5,7
/proc/2580/stat : 2580 (python) S 2570 2570 2082 0 -1 4202560 737 0 0 0 0 0 0 0 18 0 1 0 657952124 298074112 5976 33554432000 4194304 5683644 140734455610336 18446744073709551615 268272709190 0 0 16781312 514 10317008703420596487 0 0 17 1 0 0 0
/proc/2580/statm: 72772 5976 349 364 0 8687 0
[pid=2582] ppid=2580 vsize=1019708 CPUtime=1.14 cores=1,3,5,7
/proc/2582/stat : 2582 (gnovelty+2) R 2580 2582 2582 0 -1 4202496 952 0 0 0 114 0 0 0 25 0 1 0 657952124 1044180992 690 33554432000 134512640 135663704 4289500688 18446744073709551615 134525286 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/2582/statm: 254927 690 113 282 0 254643 0
[pid=2583] ppid=2570 vsize=301276 CPUtime=0 cores=1,3,5,7
/proc/2583/stat : 2583 (python) S 2570 2570 2082 0 -1 4202560 734 0 0 0 0 0 0 0 18 0 1 0 657952125 308506624 5997 33554432000 4194304 5683644 140734455610336 18446744073709551615 268272709190 0 0 16781312 514 12702975323973615615 0 0 17 1 0 0 0
/proc/2583/statm: 75319 5997 349 364 0 11231 0
[pid=2585] ppid=2583 vsize=419820 CPUtime=1.13 cores=1,3,5,7
/proc/2585/stat : 2585 (adaptg2wsat2009) R 2583 2585 2585 0 -1 4202496 1440 0 0 0 113 0 0 0 25 0 1 0 657952125 429895680 1173 33554432000 134512640 135107411 4292513856 18446744073709551615 134523208 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/2585/statm: 104955 1173 49 146 0 103831 0
[pid=2586] ppid=2570 vsize=312140 CPUtime=0 cores=1,3,5,7
/proc/2586/stat : 2586 (python) S 2570 2570 2082 0 -1 4202560 741 0 0 0 0 0 0 0 18 0 1 0 657952126 319631360 6001 33554432000 4194304 5683644 140734455610336 18446744073709551615 268272709190 0 0 16781312 514 10852747943077740543 0 0 17 1 0 0 0
/proc/2586/statm: 78035 6001 349 364 0 13944 0
[pid=2588] ppid=2586 vsize=419820 CPUtime=1.12 cores=1,3,5,7
/proc/2588/stat : 2588 (adaptg2wsat2009) R 2586 2588 2588 0 -1 4202496 1435 0 0 0 112 0 0 0 25 0 1 0 657952126 429895680 1172 33554432000 134512640 135107411 4287321792 18446744073709551615 134523360 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/2588/statm: 104955 1172 49 146 0 103831 0
[pid=2570/tid=2578] ppid=2568 vsize=321292 CPUtime=0 cores=1,3,5,7
/proc/2570/task/2578/stat : 2578 (python) S 2568 2570 2082 0 -1 4202560 23 936 0 0 0 0 0 0 21 0 5 0 657952123 329003008 7530 33554432000 4194304 5683644 140734455610336 18446744073709551615 268284512689 0 0 16781312 2 18446604456494737472 0 0 -1 1 0 0 0
[pid=2570/tid=2581] ppid=2568 vsize=321292 CPUtime=0 cores=1,3,5,7
/proc/2570/task/2581/stat : 2581 (python) S 2568 2570 2082 0 -1 4202560 23 936 0 0 0 0 0 0 23 0 5 0 657952124 329003008 7530 33554432000 4194304 5683644 140734455610336 18446744073709551615 268284512689 0 0 16781312 2 18446604456494737472 0 0 -1 1 0 0 0
[pid=2570/tid=2584] ppid=2568 vsize=321292 CPUtime=0 cores=1,3,5,7
/proc/2570/task/2584/stat : 2584 (python) S 2568 2570 2082 0 -1 4202560 20 936 0 0 0 0 0 0 25 0 5 0 657952125 329003008 7530 33554432000 4194304 5683644 140734455610336 18446744073709551615 268284512689 0 0 16781312 2 18446604456494737472 0 0 -1 3 0 0 0
[pid=2570/tid=2587] ppid=2568 vsize=321292 CPUtime=0 cores=1,3,5,7
/proc/2570/task/2587/stat : 2587 (python) S 2568 2570 2082 0 -1 4202560 27 936 0 0 0 0 0 0 25 0 5 0 657952126 329003008 7530 33554432000 4194304 5683644 140734455610336 18446744073709551615 268284512689 0 0 16781312 2 18446604456494737472 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 6.39
Current children cumulated vsize (KiB) 4385616

[startup+6.30127 s]
/proc/loadavg: 7.87 7.35 5.62 9/438 2588
/proc/meminfo: memFree=26578700/32950928 swapFree=60199044/67111528
[pid=2570] ppid=2568 vsize=321292 CPUtime=1.87 cores=1,3,5,7
/proc/2570/stat : 2570 (python) S 2568 2570 2082 0 -1 4202496 15262 936 1 0 177 10 0 0 25 0 5 0 657951928 329003008 7530 33554432000 4194304 5683644 140734455610336 18446744073709551615 268284515787 0 0 16781312 2 18446744073709551615 0 0 17 1 0 0 0
/proc/2570/statm: 80323 7530 1875 364 0 16232 0
[pid=2577] ppid=2570 vsize=280764 CPUtime=0.01 cores=1,3,5,7
/proc/2577/stat : 2577 (python) S 2570 2570 2082 0 -1 4202560 881 0 0 0 1 0 0 0 18 0 1 0 657952123 287502336 6001 33554432000 4194304 5683644 140734455610336 18446744073709551615 268272709135 0 0 16781312 514 4239743504156164360 0 0 17 5 0 0 0
/proc/2577/statm: 70191 6001 378 364 0 6109 0
[pid=2579] ppid=2577 vsize=1019708 CPUtime=4.29 cores=1,3,5,7
/proc/2579/stat : 2579 (gnovelty+2) R 2577 2579 2579 0 -1 4202496 951 0 0 0 429 0 0 0 25 0 1 0 657952123 1044180992 689 33554432000 134512640 135663704 4291964048 18446744073709551615 134525715 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/2579/statm: 254927 689 113 282 0 254643 0
[pid=2580] ppid=2570 vsize=291088 CPUtime=0.01 cores=1,3,5,7
/proc/2580/stat : 2580 (python) S 2570 2570 2082 0 -1 4202560 898 0 0 0 1 0 0 0 18 0 1 0 657952124 298074112 5999 33554432000 4194304 5683644 140734455610336 18446744073709551615 268272709190 0 0 16781312 514 10317008703420596487 0 0 17 1 0 0 0
/proc/2580/statm: 72772 5999 372 364 0 8687 0
[pid=2582] ppid=2580 vsize=1019708 CPUtime=4.32 cores=1,3,5,7
/proc/2582/stat : 2582 (gnovelty+2) R 2580 2582 2582 0 -1 4202496 952 0 0 0 432 0 0 0 25 0 1 0 657952124 1044180992 690 33554432000 134512640 135663704 4289500688 18446744073709551615 134525678 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/2582/statm: 254927 690 113 282 0 254643 0
[pid=2583] ppid=2570 vsize=301276 CPUtime=0 cores=1,3,5,7
/proc/2583/stat : 2583 (python) S 2570 2570 2082 0 -1 4202560 888 0 0 0 0 0 0 0 18 0 1 0 657952125 308506624 6020 33554432000 4194304 5683644 140734455610336 18446744073709551615 268272709190 0 0 16781312 514 12702975323973583108 0 0 17 1 0 0 0
/proc/2583/statm: 75319 6020 372 364 0 11231 0
[pid=2585] ppid=2583 vsize=420220 CPUtime=4.31 cores=1,3,5,7
/proc/2585/stat : 2585 (adaptg2wsat2009) R 2583 2585 2585 0 -1 4202496 1666 0 0 0 431 0 0 0 25 0 1 0 657952125 430305280 1399 33554432000 134512640 135107411 4292513856 18446744073709551615 134531428 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/2585/statm: 105055 1399 59 146 0 103931 0
[pid=2586] ppid=2570 vsize=312140 CPUtime=0.01 cores=1,3,5,7
/proc/2586/stat : 2586 (python) S 2570 2570 2082 0 -1 4202560 902 0 0 0 0 1 0 0 18 0 1 0 657952126 319631360 6023 33554432000 4194304 5683644 140734455610336 18446744073709551615 268272709190 0 0 16781312 514 10852747943077708038 0 0 17 3 0 0 0
/proc/2586/statm: 78035 6023 371 364 0 13944 0
[pid=2588] ppid=2586 vsize=420220 CPUtime=4.28 cores=1,3,5,7
/proc/2588/stat : 2588 (adaptg2wsat2009) R 2586 2588 2588 0 -1 4202496 1663 0 0 0 428 0 0 0 25 0 1 0 657952126 430305280 1400 33554432000 134512640 135107411 4287321792 18446744073709551615 134531232 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/2588/statm: 105055 1400 59 146 0 103931 0
[pid=2570/tid=2578] ppid=2568 vsize=321292 CPUtime=0 cores=1,3,5,7
/proc/2570/task/2578/stat : 2578 (python) S 2568 2570 2082 0 -1 4202560 23 936 0 0 0 0 0 0 21 0 5 0 657952123 329003008 7530 33554432000 4194304 5683644 140734455610336 18446744073709551615 268284512689 0 0 16781312 2 18446604456494737472 0 0 -1 1 0 0 0
[pid=2570/tid=2581] ppid=2568 vsize=321292 CPUtime=0 cores=1,3,5,7
/proc/2570/task/2581/stat : 2581 (python) S 2568 2570 2082 0 -1 4202560 23 936 0 0 0 0 0 0 23 0 5 0 657952124 329003008 7530 33554432000 4194304 5683644 140734455610336 18446744073709551615 268284512689 0 0 16781312 2 18446604456494737472 0 0 -1 1 0 0 0
[pid=2570/tid=2584] ppid=2568 vsize=321292 CPUtime=0 cores=1,3,5,7
/proc/2570/task/2584/stat : 2584 (python) S 2568 2570 2082 0 -1 4202560 20 936 0 0 0 0 0 0 25 0 5 0 657952125 329003008 7530 33554432000 4194304 5683644 140734455610336 18446744073709551615 268284512689 0 0 16781312 2 18446604456494737472 0 0 -1 3 0 0 0
[pid=2570/tid=2587] ppid=2568 vsize=321292 CPUtime=0 cores=1,3,5,7
/proc/2570/task/2587/stat : 2587 (python) S 2568 2570 2082 0 -1 4202560 27 936 0 0 0 0 0 0 25 0 5 0 657952126 329003008 7530 33554432000 4194304 5683644 140734455610336 18446744073709551615 268284512689 0 0 16781312 2 18446604456494737472 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 19.1
Current children cumulated vsize (KiB) 4386416

[startup+12.7011 s]
/proc/loadavg: 7.89 7.37 5.64 10/438 2588
/proc/meminfo: memFree=26574504/32950928 swapFree=60199044/67111528
[pid=2570] ppid=2568 vsize=321292 CPUtime=1.87 cores=1,3,5,7
/proc/2570/stat : 2570 (python) S 2568 2570 2082 0 -1 4202496 15262 936 1 0 177 10 0 0 25 0 5 0 657951928 329003008 7530 33554432000 4194304 5683644 140734455610336 18446744073709551615 268284515787 0 0 16781312 2 18446744073709551615 0 0 17 1 0 0 0
/proc/2570/statm: 80323 7530 1875 364 0 16232 0
[pid=2577] ppid=2570 vsize=280764 CPUtime=0.03 cores=1,3,5,7
/proc/2577/stat : 2577 (python) S 2570 2570 2082 0 -1 4202560 884 0 0 0 2 1 0 0 18 0 1 0 657952123 287502336 6001 33554432000 4194304 5683644 140734455610336 18446744073709551615 268272709135 0 0 16781312 514 13762472695662870792 0 0 17 5 0 0 0
/proc/2577/statm: 70191 6001 378 364 0 6109 0
[pid=2579] ppid=2577 vsize=1019708 CPUtime=10.6 cores=1,3,5,7
/proc/2579/stat : 2579 (gnovelty+2) R 2577 2579 2579 0 -1 4202496 951 0 0 0 1060 0 0 0 25 0 1 0 657952123 1044180992 689 33554432000 134512640 135663704 4291964048 18446744073709551615 134524534 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/2579/statm: 254927 689 113 282 0 254643 0
[pid=2580] ppid=2570 vsize=291088 CPUtime=0.02 cores=1,3,5,7
/proc/2580/stat : 2580 (python) S 2570 2570 2082 0 -1 4202560 903 0 0 0 1 1 0 0 18 0 1 0 657952124 298074112 5999 33554432000 4194304 5683644 140734455610336 18446744073709551615 268272709190 0 0 16781312 514 13762472695662870791 0 0 17 1 0 0 0
/proc/2580/statm: 72772 5999 372 364 0 8687 0
[pid=2582] ppid=2580 vsize=1019708 CPUtime=10.71 cores=1,3,5,7
/proc/2582/stat : 2582 (gnovelty+2) R 2580 2582 2582 0 -1 4202496 952 0 0 0 1071 0 0 0 25 0 1 0 657952124 1044180992 690 33554432000 134512640 135663704 4289500688 18446744073709551615 134525722 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/2582/statm: 254927 690 113 282 0 254643 0
[pid=2583] ppid=2570 vsize=301276 CPUtime=0.02 cores=1,3,5,7
/proc/2583/stat : 2583 (python) S 2570 2570 2082 0 -1 4202560 890 0 0 0 1 1 0 0 18 0 1 0 657952125 308506624 6020 33554432000 4194304 5683644 140734455610336 18446744073709551615 268272709190 0 0 16781312 514 13762472695662870788 0 0 17 1 0 0 0
/proc/2583/statm: 75319 6020 372 364 0 11231 0
[pid=2585] ppid=2583 vsize=420220 CPUtime=10.69 cores=1,3,5,7
/proc/2585/stat : 2585 (adaptg2wsat2009) R 2583 2585 2585 0 -1 4202496 1666 0 0 0 1069 0 0 0 25 0 1 0 657952125 430305280 1399 33554432000 134512640 135107411 4292513856 18446744073709551615 134531822 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/2585/statm: 105055 1399 59 146 0 103931 0
[pid=2586] ppid=2570 vsize=312140 CPUtime=0.03 cores=1,3,5,7
/proc/2586/stat : 2586 (python) S 2570 2570 2082 0 -1 4202560 912 0 0 0 1 2 0 0 18 0 1 0 657952126 319631360 6024 33554432000 4194304 5683644 140734455610336 18446744073709551615 268272709190 0 0 16781312 514 13762472695662870790 0 0 17 3 0 0 0
/proc/2586/statm: 78035 6024 372 364 0 13944 0
[pid=2588] ppid=2586 vsize=420220 CPUtime=10.65 cores=1,3,5,7
/proc/2588/stat : 2588 (adaptg2wsat2009) R 2586 2588 2588 0 -1 4202496 1663 0 0 0 1065 0 0 0 25 0 1 0 657952126 430305280 1400 33554432000 134512640 135107411 4287321792 18446744073709551615 134531935 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/2588/statm: 105055 1400 59 146 0 103931 0
[pid=2570/tid=2578] ppid=2568 vsize=321292 CPUtime=0 cores=1,3,5,7
/proc/2570/task/2578/stat : 2578 (python) S 2568 2570 2082 0 -1 4202560 23 936 0 0 0 0 0 0 21 0 5 0 657952123 329003008 7530 33554432000 4194304 5683644 140734455610336 18446744073709551615 268284512689 0 0 16781312 2 18446604456494737472 0 0 -1 1 0 0 0
[pid=2570/tid=2581] ppid=2568 vsize=321292 CPUtime=0 cores=1,3,5,7
/proc/2570/task/2581/stat : 2581 (python) S 2568 2570 2082 0 -1 4202560 23 936 0 0 0 0 0 0 23 0 5 0 657952124 329003008 7530 33554432000 4194304 5683644 140734455610336 18446744073709551615 268284512689 0 0 16781312 2 18446604456494737472 0 0 -1 1 0 0 0
[pid=2570/tid=2584] ppid=2568 vsize=321292 CPUtime=0 cores=1,3,5,7
/proc/2570/task/2584/stat : 2584 (python) S 2568 2570 2082 0 -1 4202560 20 936 0 0 0 0 0 0 25 0 5 0 657952125 329003008 7530 33554432000 4194304 5683644 140734455610336 18446744073709551615 268284512689 0 0 16781312 2 18446604456494737472 0 0 -1 3 0 0 0
[pid=2570/tid=2587] ppid=2568 vsize=321292 CPUtime=0 cores=1,3,5,7
/proc/2570/task/2587/stat : 2587 (python) S 2568 2570 2082 0 -1 4202560 27 936 0 0 0 0 0 0 25 0 5 0 657952126 329003008 7530 33554432000 4194304 5683644 140734455610336 18446744073709551615 268284512689 0 0 16781312 2 18446604456494737472 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 44.62
Current children cumulated vsize (KiB) 4386416

[startup+25.5008 s]
/proc/loadavg: 7.98 7.41 5.67 9/438 2588
/proc/meminfo: memFree=26574924/32950928 swapFree=60199044/67111528
[pid=2570] ppid=2568 vsize=321292 CPUtime=1.87 cores=1,3,5,7

################
# More data... #
################

[pid=2583/tid=2603] ppid=2570 vsize=301276 CPUtime=0 cores=1,3,5,7
/proc/2583/task/2603/stat : 2603 (python) S 2570 2570 2082 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 657962155 308506624 6049 33554432000 4194304 5683644 140734455610336 18446744073709551615 268284512689 0 0 16781312 514 18446604460165302464 0 0 -1 1 0 0 0
[pid=2586] ppid=2570 vsize=312140 CPUtime=0.29 cores=1,3,5,7
/proc/2586/stat : 2586 (python) S 2570 2570 2082 0 -1 4202560 1095 0 0 0 15 14 0 0 19 0 2 0 657952126 319631360 6053 33554432000 4194304 5683644 140734455610336 18446744073709551615 268284515787 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/2586/statm: 78035 6053 400 364 0 13944 0
[pid=2588] ppid=2586 vsize=420220 CPUtime=99.69 cores=1,3,5,7
/proc/2588/stat : 2588 (adaptg2wsat2009) T 2586 2588 2588 0 -1 4202496 1663 0 0 0 9969 0 0 0 25 0 1 0 657952126 430305280 1400 33554432000 134512640 135107411 4287321792 18446744073709551615 134532416 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/2588/statm: 105055 1400 59 146 0 103931 0
[pid=2586/tid=2606] ppid=2570 vsize=312140 CPUtime=0 cores=1,3,5,7
/proc/2586/task/2606/stat : 2606 (python) S 2570 2570 2082 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 657962156 319631360 6053 33554432000 4194304 5683644 140734455610336 18446744073709551615 268284512689 0 0 16781312 514 18446604464029480128 0 0 -1 7 0 0 0
[pid=2605] ppid=2570 vsize=321864 CPUtime=0.31 cores=1,3,5,7
/proc/2605/stat : 2605 (python) S 2570 2570 2082 0 -1 4202560 1080 0 0 0 17 14 0 0 19 0 2 0 657962156 329588736 6057 33554432000 4194304 5683644 140734455610336 18446744073709551615 268284515787 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/2605/statm: 80466 6057 400 364 0 16372 0
[pid=2608] ppid=2605 vsize=420220 CPUtime=99.98 cores=1,3,5,7
/proc/2608/stat : 2608 (adaptg2wsat2009) T 2605 2608 2608 0 -1 4202496 1664 0 0 0 9998 0 0 0 25 0 1 0 657962157 430305280 1400 33554432000 134512640 135107411 4292076368 18446744073709551615 134531246 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/2608/statm: 105055 1400 59 146 0 103931 0
[pid=2605/tid=2624] ppid=2570 vsize=321864 CPUtime=0 cores=1,3,5,7
/proc/2605/task/2624/stat : 2624 (python) S 2570 2570 2082 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 657972187 329588736 6057 33554432000 4194304 5683644 140734455610336 18446744073709551615 268284512689 0 0 16781312 514 18446604460165300672 0 0 -1 3 0 0 0
[pid=2609] ppid=2570 vsize=332284 CPUtime=0.31 cores=1,3,5,7
/proc/2609/stat : 2609 (python) S 2570 2570 2082 0 -1 4202560 1094 0 0 0 15 16 0 0 19 0 2 0 657962157 340258816 6063 33554432000 4194304 5683644 140734455610336 18446744073709551615 268284515787 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/2609/statm: 83071 6063 400 364 0 18974 0
[pid=2612] ppid=2609 vsize=1019708 CPUtime=100.12 cores=1,3,5,7
/proc/2612/stat : 2612 (gnovelty+2) T 2609 2612 2612 0 -1 4202496 952 0 0 0 10012 0 0 0 25 0 1 0 657962158 1044180992 689 33554432000 134512640 135663704 4288720160 18446744073709551615 134524897 0 0 16781312 0 18446744071562691360 0 0 17 5 0 0 0
/proc/2612/statm: 254927 689 113 282 0 254643 0
[pid=2609/tid=2628] ppid=2570 vsize=332284 CPUtime=0 cores=1,3,5,7
/proc/2609/task/2628/stat : 2628 (python) S 2570 2570 2082 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 657972195 340258816 6063 33554432000 4194304 5683644 140734455610336 18446744073709551615 268284512689 0 0 16781312 514 18446604457396920576 0 0 -1 5 0 0 0
[pid=2613] ppid=2570 vsize=342392 CPUtime=0.3 cores=1,3,5,7
/proc/2613/stat : 2613 (python) S 2570 2570 2082 0 -1 4202560 1100 0 0 0 15 15 0 0 18 0 2 0 657962159 350609408 6108 33554432000 4194304 5683644 140734455610336 18446744073709551615 268284515787 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/2613/statm: 85598 6108 400 364 0 21498 0
[pid=2615] ppid=2613 vsize=249868 CPUtime=100.04 cores=1,3,5,7
/proc/2615/stat : 2615 (FH) T 2613 2615 2615 0 -1 4202496 1525 0 0 0 10004 0 0 0 25 0 1 0 657962159 255864832 1263 33554432000 134512640 134936988 4289053616 18446744073709551615 134547031 0 0 16781312 0 18446744071562691360 0 0 17 5 0 0 0
/proc/2615/statm: 62467 1263 41 104 0 61971 0
[pid=2613/tid=2629] ppid=2570 vsize=342392 CPUtime=0 cores=1,3,5,7
/proc/2613/task/2629/stat : 2629 (python) S 2570 2570 2082 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 657972195 350609408 6108 33554432000 4194304 5683644 140734455610336 18446744073709551615 268284512689 0 0 16781312 514 18446604467168484416 0 0 -1 1 0 0 0
[pid=2616] ppid=2570 vsize=353256 CPUtime=0.33 cores=1,3,5,7
/proc/2616/stat : 2616 (python) S 2570 2570 2082 0 -1 4202560 1140 0 0 0 17 16 0 0 19 0 2 0 657962160 361734144 6118 33554432000 4194304 5683644 140734455610336 18446744073709551615 268284515787 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/2616/statm: 88314 6118 406 364 0 24211 0
[pid=2618] ppid=2616 vsize=420220 CPUtime=101.6 cores=1,3,5,7
/proc/2618/stat : 2618 (adaptg2wsat2009) T 2616 2618 2618 0 -1 4202496 1670 0 0 0 10160 0 0 0 25 0 1 0 657962160 430305280 1399 33554432000 134512640 135107411 4286617824 18446744073709551615 134531656 0 0 16781312 0 18446744071562691360 0 0 17 7 0 0 0
/proc/2618/statm: 105055 1399 59 146 0 103931 0
[pid=2616/tid=2636] ppid=2570 vsize=353256 CPUtime=0 cores=1,3,5,7
/proc/2616/task/2636/stat : 2636 (python) S 2570 2570 2082 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 657972602 361734144 6118 33554432000 4194304 5683644 140734455610336 18446744073709551615 268284512689 0 0 16781312 514 18446604460832047552 0 0 -1 7 0 0 0
[pid=2625] ppid=2570 vsize=363028 CPUtime=0.31 cores=1,3,5,7
/proc/2625/stat : 2625 (python) S 2570 2570 2082 0 -1 4202560 1139 0 0 0 14 17 0 0 19 0 2 0 657972189 371740672 6236 33554432000 4194304 5683644 140734455610336 18446744073709551615 268284515787 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/2625/statm: 90757 6236 405 364 0 26651 0
[pid=2627] ppid=2625 vsize=420220 CPUtime=100.33 cores=1,3,5,7
/proc/2627/stat : 2627 (adaptg2wsat2009) T 2625 2627 2627 0 -1 4202496 1670 0 0 0 10033 0 0 0 25 0 1 0 657972189 430305280 1400 33554432000 134512640 135107411 4294359136 18446744073709551615 134531709 0 0 16781312 0 18446744071562691360 0 0 17 5 0 0 0
/proc/2627/statm: 105055 1400 59 146 0 103931 0
[pid=2625/tid=2704] ppid=2570 vsize=363028 CPUtime=0 cores=1,3,5,7
/proc/2625/task/2704/stat : 2704 (python) S 2570 2570 2082 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 657982223 371740672 6236 33554432000 4194304 5683644 140734455610336 18446744073709551615 268284512689 0 0 16781312 514 18446604454223471552 0 0 -1 7 0 0 0
[pid=2630] ppid=2570 vsize=373476 CPUtime=0.32 cores=1,3,5,7
/proc/2630/stat : 2630 (python) S 2570 2570 2082 0 -1 4202560 1117 0 0 0 17 15 0 0 19 0 2 0 657972196 382439424 6235 33554432000 4194304 5683644 140734455610336 18446744073709551615 268284515787 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/2630/statm: 93369 6235 400 364 0 29260 0
[pid=2632] ppid=2630 vsize=249868 CPUtime=99.32 cores=1,3,5,7
/proc/2632/stat : 2632 (FH) T 2630 2632 2632 0 -1 4202496 1528 0 0 0 9932 0 0 0 25 0 1 0 657972197 255864832 1263 33554432000 134512640 134936988 4287468256 18446744073709551615 134554229 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/2632/statm: 62467 1263 41 104 0 61971 0
[pid=2630/tid=2700] ppid=2570 vsize=373476 CPUtime=0 cores=1,3,5,7
/proc/2630/task/2700/stat : 2700 (python) S 2570 2570 2082 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 657982130 382439424 6235 33554432000 4194304 5683644 140734455610336 18446744073709551615 268284512689 0 0 16781312 514 18446604459609777216 0 0 -1 7 0 0 0
[pid=2633] ppid=2570 vsize=383852 CPUtime=0.94 cores=1,3,5,7
/proc/2633/stat : 2633 (python) S 2570 2570 2082 0 -1 4202560 1181 0 0 0 49 45 0 0 18 0 2 0 657972198 393064448 6239 33554432000 4194304 5683644 140734455610336 18446744073709551615 268284515787 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/2633/statm: 95963 6239 400 364 0 31851 0
[pid=2635] ppid=2633 vsize=268428 CPUtime=294.51 cores=1,3,5,7
/proc/2635/stat : 2635 (hybridGM3) T 2633 2635 2635 0 -1 4202496 5395 0 0 0 29451 0 0 0 25 0 1 0 657972198 274870272 5127 33554432000 134512640 135204385 4289813120 18446744073709551615 134549166 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/2635/statm: 67107 5127 63 169 0 66937 0
[pid=2633/tid=2767] ppid=2570 vsize=383852 CPUtime=0 cores=1,3,5,7
/proc/2633/task/2767/stat : 2767 (python) S 2570 2570 2082 0 -1 4202560 50 0 0 0 0 0 0 0 18 0 2 0 657992466 393064448 6239 33554432000 4194304 5683644 140734455610336 18446744073709551615 268284512689 0 0 16781312 514 18446604460832050240 0 0 -1 3 0 0 0
[pid=2637] ppid=2570 vsize=394048 CPUtime=0.31 cores=1,3,5,7
/proc/2637/stat : 2637 (python) S 2570 2570 2082 0 -1 4202560 1142 0 0 0 14 17 0 0 19 0 2 0 657972604 403505152 6243 33554432000 4194304 5683644 140734455610336 18446744073709551615 268284515787 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/2637/statm: 98512 6243 400 364 0 34397 0
[pid=2639] ppid=2637 vsize=1019708 CPUtime=99.61 cores=1,3,5,7
/proc/2639/stat : 2639 (gnovelty+2) T 2637 2639 2639 0 -1 4202496 958 0 0 0 9961 0 0 0 25 0 1 0 657972604 1044180992 690 33554432000 134512640 135663704 4287010576 18446744073709551615 134525265 0 0 16781312 0 18446744071562691360 0 0 17 7 0 0 0
/proc/2639/statm: 254927 690 113 282 0 254643 0
[pid=2637/tid=2708] ppid=2570 vsize=394048 CPUtime=0 cores=1,3,5,7
/proc/2637/task/2708/stat : 2708 (python) S 2570 2570 2082 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 657982641 403505152 6243 33554432000 4194304 5683644 140734455610336 18446744073709551615 268284512689 0 0 16781312 514 18446604460832049344 0 0 -1 7 0 0 0
[pid=2701] ppid=2570 vsize=404572 CPUtime=0.95 cores=1,3,5,7
/proc/2701/stat : 2701 (python) S 2570 2570 2082 0 -1 4202560 1178 0 0 0 50 45 0 0 18 0 2 0 657982132 414281728 6247 33554432000 4194304 5683644 140734455610336 18446744073709551615 268272709190 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/2701/statm: 101143 6247 400 364 0 37025 0
[pid=2703] ppid=2701 vsize=268424 CPUtime=293.65 cores=1,3,5,7
/proc/2703/stat : 2703 (hybridGM3) R 2701 2703 2703 0 -1 4202496 5397 0 0 0 29365 0 0 0 25 0 1 0 657982132 274866176 5127 33554432000 134512640 135204385 4288804912 18446744073709551615 134538041 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/2703/statm: 67106 5127 63 169 0 66936 0
[pid=2701/tid=2838] ppid=2570 vsize=404572 CPUtime=0 cores=1,3,5,7
/proc/2701/task/2838/stat : 2838 (python) S 2570 2570 2082 0 -1 4202560 47 0 0 0 0 0 0 0 18 0 2 0 658002205 414281728 6247 33554432000 4194304 5683644 140734455610336 18446744073709551615 268284512689 0 0 16781312 514 18446604464029481920 0 0 -1 7 0 0 0
[pid=2705] ppid=2570 vsize=414308 CPUtime=0.32 cores=1,3,5,7
/proc/2705/stat : 2705 (python) S 2570 2570 2082 0 -1 4202560 1152 0 0 0 16 16 0 0 19 0 2 0 657982224 424251392 6268 33554432000 4194304 5683644 140734455610336 18446744073709551615 268284515787 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/2705/statm: 103577 6268 408 364 0 39456 0
[pid=2707] ppid=2705 vsize=420220 CPUtime=97.55 cores=1,3,5,7
/proc/2707/stat : 2707 (adaptg2wsat2009) T 2705 2707 2707 0 -1 4202496 1670 0 0 0 9755 0 0 0 25 0 1 0 657982224 430305280 1399 33554432000 134512640 135107411 4290719280 18446744073709551615 134531942 0 0 16781312 0 18446744071562691360 0 0 17 7 0 0 0
/proc/2707/statm: 105055 1399 59 146 0 103931 0
[pid=2705/tid=2763] ppid=2570 vsize=414308 CPUtime=0 cores=1,3,5,7
/proc/2705/task/2763/stat : 2763 (python) S 2570 2570 2082 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 657992255 424251392 6268 33554432000 4194304 5683644 140734455610336 18446744073709551615 268284512689 0 0 16781312 514 18446604467168481728 0 0 -1 3 0 0 0
[pid=2709] ppid=2570 vsize=425296 CPUtime=0.92 cores=1,3,5,7
/proc/2709/stat : 2709 (python) S 2570 2570 2082 0 -1 4202560 1238 0 0 0 48 44 0 0 18 0 2 0 657982642 435503104 6272 33554432000 4194304 5683644 140734455610336 18446744073709551615 268272709190 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/2709/statm: 106324 6272 408 364 0 42200 0
[pid=2711] ppid=2709 vsize=268424 CPUtime=293.03 cores=1,3,5,7
/proc/2711/stat : 2711 (hybridGM3) R 2709 2711 2711 0 -1 4202496 5402 0 0 0 29303 0 0 0 25 0 1 0 657982643 274866176 5127 33554432000 134512640 135204385 4290463184 18446744073709551615 134538375 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/2711/statm: 67106 5127 63 169 0 66936 0
[pid=2709/tid=2839] ppid=2570 vsize=425296 CPUtime=0 cores=1,3,5,7
/proc/2709/task/2839/stat : 2839 (python) S 2570 2570 2082 0 -1 4202560 47 0 0 0 0 0 0 0 18 0 2 0 658002309 435503104 6272 33554432000 4194304 5683644 140734455610336 18446744073709551615 268284512689 0 0 16781312 514 18446604468994026176 0 0 -1 3 0 0 0
[pid=2764] ppid=2570 vsize=435396 CPUtime=0.62 cores=1,3,5,7
/proc/2764/stat : 2764 (python) S 2570 2570 2082 0 -1 4202560 1208 0 0 0 33 29 0 0 19 0 2 0 657992257 445845504 6329 33554432000 4194304 5683644 140734455610336 18446744073709551615 268284515787 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/2764/statm: 108849 6329 408 364 0 44722 0
[pid=2766] ppid=2764 vsize=268424 CPUtime=196.01 cores=1,3,5,7
/proc/2766/stat : 2766 (hybridGM3) T 2764 2766 2766 0 -1 4202496 5403 0 0 0 19601 0 0 0 25 0 1 0 657992257 274866176 5126 33554432000 134512640 135204385 4290526912 18446744073709551615 134538041 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/2766/statm: 67106 5126 63 169 0 66936 0
[pid=2764/tid=2858] ppid=2570 vsize=435396 CPUtime=0 cores=1,3,5,7
/proc/2764/task/2858/stat : 2858 (python) S 2570 2570 2082 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 658011925 445845504 6329 33554432000 4194304 5683644 140734455610336 18446744073709551615 268284512689 0 0 16781312 514 18446604471136364608 0 0 -1 1 0 0 0
[pid=2835] ppid=2570 vsize=445940 CPUtime=0.32 cores=1,3,5,7
/proc/2835/stat : 2835 (python) S 2570 2570 2082 0 -1 4202560 1054 0 0 0 18 14 0 0 18 0 1 0 658001997 456642560 6306 33554432000 4194304 5683644 140734455610336 18446744073709551615 268272709190 0 0 16781312 514 13762472695662870788 0 0 17 3 0 0 0
/proc/2835/statm: 111485 6306 380 364 0 47355 0
[pid=2837] ppid=2835 vsize=458352 CPUtime=96.27 cores=1,3,5,7
/proc/2837/stat : 2837 (TNM) R 2835 2837 2837 0 -1 4202496 1517 0 0 0 9627 0 0 0 25 0 1 0 658001998 469352448 1239 33554432000 134512640 135008748 4290795616 18446744073709551615 134529176 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/2837/statm: 114588 1239 46 122 0 113488 0
[pid=2859] ppid=2570 vsize=456216 CPUtime=0 cores=1,3,5,7
/proc/2859/stat : 2859 (python) S 2570 2570 2082 0 -1 4202560 824 0 0 0 0 0 0 0 19 0 1 0 658011926 467165184 6287 33554432000 4194304 5683644 140734455610336 18446744073709551615 268272709190 0 0 16781312 514 812869500465577983 0 0 17 3 0 0 0
/proc/2859/statm: 114054 6287 347 364 0 49921 0
[pid=2861] ppid=2859 vsize=247956 CPUtime=0.51 cores=1,3,5,7
/proc/2861/stat : 2861 (FH) R 2859 2861 2861 0 -1 4202496 1257 0 0 0 51 0 0 0 22 0 1 0 658011929 253906944 986 33554432000 134512640 134936988 4293631984 18446744073709551615 134523704 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/2861/statm: 61989 986 37 104 0 61493 0
[pid=2570/tid=2578] ppid=2568 vsize=465824 CPUtime=0 cores=1,3,5,7
/proc/2570/task/2578/stat : 2578 (python) S 2568 2570 2082 0 -1 4202560 23 936 0 0 0 0 0 0 21 0 19 0 657952123 477003776 7855 33554432000 4194304 5683644 140734455610336 18446744073709551615 268284512689 0 0 16781312 2 18446604456494737472 0 0 -1 1 0 0 0
[pid=2570/tid=2581] ppid=2568 vsize=465824 CPUtime=0 cores=1,3,5,7
/proc/2570/task/2581/stat : 2581 (python) S 2568 2570 2082 0 -1 4202560 23 936 0 0 0 0 0 0 23 0 19 0 657952124 477003776 7855 33554432000 4194304 5683644 140734455610336 18446744073709551615 268284512689 0 0 16781312 2 18446604456494737472 0 0 -1 1 0 0 0
[pid=2570/tid=2584] ppid=2568 vsize=465824 CPUtime=0 cores=1,3,5,7
/proc/2570/task/2584/stat : 2584 (python) S 2568 2570 2082 0 -1 4202560 20 936 0 0 0 0 0 0 25 0 19 0 657952125 477003776 7855 33554432000 4194304 5683644 140734455610336 18446744073709551615 268284512689 0 0 16781312 2 18446604456494737472 0 0 -1 3 0 0 0
[pid=2570/tid=2587] ppid=2568 vsize=465824 CPUtime=0 cores=1,3,5,7
/proc/2570/task/2587/stat : 2587 (python) S 2568 2570 2082 0 -1 4202560 27 936 0 0 0 0 0 0 25 0 19 0 657952126 477003776 7855 33554432000 4194304 5683644 140734455610336 18446744073709551615 268284512689 0 0 16781312 2 18446604456494737472 0 0 -1 1 0 0 0
[pid=2570/tid=2607] ppid=2568 vsize=465824 CPUtime=0 cores=1,3,5,7
/proc/2570/task/2607/stat : 2607 (python) S 2568 2570 2082 0 -1 4202560 23 936 0 0 0 0 0 0 20 0 19 0 657962157 477003776 7855 33554432000 4194304 5683644 140734455610336 18446744073709551615 268284512689 0 0 16781312 2 18446604456494737472 0 0 -1 3 0 0 0
[pid=2570/tid=2610] ppid=2568 vsize=465824 CPUtime=0 cores=1,3,5,7
/proc/2570/task/2610/stat : 2610 (python) S 2568 2570 2082 0 -1 4202560 24 936 0 0 0 0 0 0 22 0 19 0 657962158 477003776 7855 33554432000 4194304 5683644 140734455610336 18446744073709551615 268284512689 0 0 16781312 2 18446604456494737472 0 0 -1 5 0 0 0
[pid=2570/tid=2614] ppid=2568 vsize=465824 CPUtime=0 cores=1,3,5,7
/proc/2570/task/2614/stat : 2614 (python) S 2568 2570 2082 0 -1 4202560 36 936 0 0 0 0 0 0 24 0 19 0 657962159 477003776 7855 33554432000 4194304 5683644 140734455610336 18446744073709551615 268284512689 0 0 16781312 2 18446604456494737472 0 0 -1 7 0 0 0
[pid=2570/tid=2617] ppid=2568 vsize=465824 CPUtime=0 cores=1,3,5,7
/proc/2570/task/2617/stat : 2617 (python) S 2568 2570 2082 0 -1 4202560 26 936 0 0 0 0 0 0 25 0 19 0 657962160 477003776 7855 33554432000 4194304 5683644 140734455610336 18446744073709551615 268284512689 0 0 16781312 2 18446604456494737472 0 0 -1 7 0 0 0
[pid=2570/tid=2626] ppid=2568 vsize=465824 CPUtime=0 cores=1,3,5,7
/proc/2570/task/2626/stat : 2626 (python) S 2568 2570 2082 0 -1 4202560 20 936 0 0 0 0 0 0 20 0 19 0 657972189 477003776 7855 33554432000 4194304 5683644 140734455610336 18446744073709551615 268284512689 0 0 16781312 2 18446604456494737472 0 0 -1 7 0 0 0
[pid=2570/tid=2631] ppid=2568 vsize=465824 CPUtime=0 cores=1,3,5,7
/proc/2570/task/2631/stat : 2631 (python) S 2568 2570 2082 0 -1 4202560 23 936 0 0 0 0 0 0 21 0 19 0 657972196 477003776 7855 33554432000 4194304 5683644 140734455610336 18446744073709551615 268284512689 0 0 16781312 2 18446604456494737472 0 0 -1 7 0 0 0
[pid=2570/tid=2634] ppid=2568 vsize=465824 CPUtime=0 cores=1,3,5,7
/proc/2570/task/2634/stat : 2634 (python) S 2568 2570 2082 0 -1 4202560 29 936 0 0 0 0 0 0 18 0 19 0 657972198 477003776 7855 33554432000 4194304 5683644 140734455610336 18446744073709551615 268284512689 0 0 16781312 2 18446604456494737472 0 0 -1 3 0 0 0
[pid=2570/tid=2638] ppid=2568 vsize=465824 CPUtime=0 cores=1,3,5,7
/proc/2570/task/2638/stat : 2638 (python) S 2568 2570 2082 0 -1 4202560 27 936 0 0 0 0 0 0 20 0 19 0 657972604 477003776 7855 33554432000 4194304 5683644 140734455610336 18446744073709551615 268284512689 0 0 16781312 2 18446604456494737472 0 0 -1 3 0 0 0
[pid=2570/tid=2702] ppid=2568 vsize=465824 CPUtime=0 cores=1,3,5,7
/proc/2570/task/2702/stat : 2702 (python) S 2568 2570 2082 0 -1 4202560 31 936 0 0 0 0 0 0 18 0 19 0 657982132 477003776 7855 33554432000 4194304 5683644 140734455610336 18446744073709551615 268284512689 0 0 16781312 2 18446604456494737472 0 0 -1 3 0 0 0
[pid=2570/tid=2706] ppid=2568 vsize=465824 CPUtime=0 cores=1,3,5,7
/proc/2570/task/2706/stat : 2706 (python) S 2568 2570 2082 0 -1 4202560 28 936 0 0 0 0 0 0 20 0 19 0 657982224 477003776 7855 33554432000 4194304 5683644 140734455610336 18446744073709551615 268284512689 0 0 16781312 2 18446604456494737472 0 0 -1 3 0 0 0
[pid=2570/tid=2710] ppid=2568 vsize=465824 CPUtime=0 cores=1,3,5,7
/proc/2570/task/2710/stat : 2710 (python) S 2568 2570 2082 0 -1 4202560 29 936 0 0 0 0 0 0 18 0 19 0 657982643 477003776 7855 33554432000 4194304 5683644 140734455610336 18446744073709551615 268284512689 0 0 16781312 2 18446604456494737472 0 0 -1 3 0 0 0
[pid=2570/tid=2765] ppid=2568 vsize=465824 CPUtime=0 cores=1,3,5,7
/proc/2570/task/2765/stat : 2765 (python) S 2568 2570 2082 0 -1 4202560 26 936 0 0 0 0 0 0 20 0 19 0 657992257 477003776 7855 33554432000 4194304 5683644 140734455610336 18446744073709551615 268284512689 0 0 16781312 2 18446604456494737472 0 0 -1 3 0 0 0
[pid=2570/tid=2836] ppid=2568 vsize=465824 CPUtime=0 cores=1,3,5,7
/proc/2570/task/2836/stat : 2836 (python) S 2568 2570 2082 0 -1 4202560 29 936 0 0 0 0 0 0 20 0 19 0 658001998 477003776 7855 33554432000 4194304 5683644 140734455610336 18446744073709551615 268284512689 0 0 16781312 2 18446604456494737472 0 0 -1 3 0 0 0
[pid=2570/tid=2860] ppid=2568 vsize=465824 CPUtime=0 cores=1,3,5,7
/proc/2570/task/2860/stat : 2860 (python) S 2568 2570 2082 0 -1 4202560 26 936 0 0 0 0 0 0 20 0 19 0 658011927 477003776 7855 33554432000 4194304 5683644 140734455610336 18446744073709551615 268284512689 0 0 16781312 2 18446604456494737472 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2380.77
Current children cumulated vsize (KiB) 15987160

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 2570 and gives
#  childrusage.ru_utime.tv_sec=689
#  childrusage.ru_utime.tv_usec=775138
#  childrusage.ru_stime.tv_sec=3
#  childrusage.ru_stime.tv_usec=870411
# CPU time returned by wait4() is 693.646
# while last known CPU time is 2380.77
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 600.633
CPU time (s): 2380.77
CPU user time (s): 2377.04
CPU system time (s): 3.73
CPU usage (%): 396.377
Max. virtual memory (cumulated for all children) (KiB): 15987160

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 689.775
system time used= 3.87041
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 66124
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 7891
involuntary context switches= 5864

runsolver used 4.50531 second user time and 10.4964 second system time

The end

Launcher Data 

Begin job on node122 at 2011-05-15 14:45:31
IDJOB=3378197
IDBENCH=82606
IDSOLVER=1859
FILE ID=node122/3378197-1305463531
RUNJOBID= node122-1305462946-2101
PBS_JOBID= 13324977
Free space on /tmp= 73416 MiB

SOLVER NAME= borg-sat 11.03.02-par-random (fixed)
BENCH NAME= SAT11/random/large/unif-k7-r85-v300-c25500-S376724493-075-UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3378197-1305463531/watcher-3378197-1305463531 -o /tmp/evaluation-result-3378197-1305463531/solver-3378197-1305463531 -C 4800 -W 1300 -M 15500  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3378197-1305463531.cnf -seed 748228360 -budget 4800 -cores 4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= b318fd1a86aee981aadb17224d952a44
RANDOM SEED=748228360

node122.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.64
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.97
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      26631224 kB
Buffers:        310340 kB
Cached:        3927896 kB
SwapCached:      50104 kB
Active:        1951028 kB
Inactive:      4120052 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      26631224 kB
SwapTotal:    67111528 kB
SwapFree:     60199044 kB
Dirty:           33092 kB
Writeback:           0 kB
AnonPages:     1793940 kB
Mapped:          27336 kB
Slab:           131600 kB
PageTables:      49236 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 95921776 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73372 MiB
End job on node122 at 2011-05-15 14:55:34