Trace number 3378264

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-par-random (fixed)? 3137.99 1176.66

General information on the benchmark

Namerandom/large/
unif-k3-r4.2-v15000-c63000-S594553190-015-UNKNOWN.cnf
MD5SUM0a98d6d9a7bdb797305aed69a94f9a69
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark355.73
Satisfiable
(Un)Satisfiability was proved
Number of variables15000
Number of clauses63000
Sum of the clauses size189000
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 363000
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.28/0.46	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.28/0.46	c INFO: solving HOME/instance-3378264-1305464361.cnf
0.28/0.46	c INFO: computing task features
0.47/0.68	c INFO: computed variable-clause graph statistics
0.47/0.69	c INFO: computed clause balance statistics
1.67/1.86	c INFO: computed variable balance statistics
2.67/2.81	c INFO: computed small-clause counts
2.67/2.82	c INFO: computed Horn-clause counts
2.97/3.16	c INFO: computed variable graph statistics
2.97/3.16	c INFO: collected features for HOME/instance-3378264-1305464361.cnf in 2.69 s
2.97/3.17	c INFO: running hybridGM3@0 for 97 with 1197 remaining (b = 0.46)
2.97/3.18	c INFO: running hybridGM3@0 for 97 with 1197 remaining (b = 0.28)
2.97/3.19	c INFO: running hybridGM3@0 for 97 with 1197 remaining (b = 0.20)
2.97/3.20	c INFO: running hybridGM3@0 for 194 with 1197 remaining (b = 0.28)
332.67/122.18	c INFO: running hybridGM3@0 for 97 with 1078 remaining (b = 0.13)
440.85/163.02	c INFO: running hybridGM3@0 for 97 with 1037 remaining (b = 0.13)
498.55/182.38	c INFO: running hybridGM3@0 for 97 with 1018 remaining (b = 0.13)
713.33/266.36	c INFO: running hybridGM3@102 for 97 with 934 remaining (b = 0.13)
726.55/271.70	c INFO: running hybridGM3@99 for 97 with 928 remaining (b = 0.13)
765.86/287.48	c INFO: running hybridGM3@97 for 97 with 912 remaining (b = 0.13)
975.95/368.03	c INFO: running TNM@0 for 97 with 832 remaining (b = 0.15)
1053.93/397.83	c INFO: running hybridGM3@0 for 194 with 802 remaining (b = 0.21)
1106.74/421.23	c INFO: running hybridGM3@0 for 97 with 779 remaining (b = 0.08)
1169.55/450.17	c INFO: running hybridGM3@0 for 194 with 750 remaining (b = 0.12)
1479.47/563.75	c INFO: running gnovelty+2@0 for 97 with 636 remaining (b = 0.05)
1531.81/582.35	c INFO: running hybridGM3@95 for 97 with 618 remaining (b = 0.06)
1797.31/676.50	c INFO: running hybridGM3@98 for 97 with 523 remaining (b = 0.06)
1834.90/691.61	c INFO: running hybridGM3@97 for 97 with 508 remaining (b = 0.06)
1916.09/724.46	c INFO: running hybridGM3@0 for 194 with 476 remaining (b = 0.09)
1971.72/743.91	c INFO: running TNM@94 for 291 with 456 remaining (b = 0.12)
2103.68/797.01	c INFO: running TNM@0 for 403 with 403 remaining (b = 0.13)
2236.30/850.11	c INFO: running hybridGM3@0 for 194 with 350 remaining (b = 0.07)
2841.01/1059.39	c INFO: running hybridGM3@292 for 141 with 141 remaining (b = 0.03)
2843.98/1060.20	c INFO: running hybridGM3@100 for 140 with 140 remaining (b = 0.03)
3137.81/1176.63	s UNKNOWN

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3378264-1305464361/watcher-3378264-1305464361 -o /tmp/evaluation-result-3378264-1305464361/solver-3378264-1305464361 -C 4800 -W 1300 -M 15500 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3378264-1305464361.cnf -seed 972692168 -budget 4800 -cores 4 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 11.25 10.72 8.99 9/489 17771
/proc/meminfo: memFree=24551328/32951124 swapFree=53501244/67111528
[pid=17771] ppid=17769 vsize=16240 CPUtime=0 cores=0,2,4,6
/proc/17771/stat : 17771 (python) R 17769 17771 16982 0 -1 4202496 1050 0 0 0 0 0 0 0 25 0 1 0 658038748 16629760 922 33554432000 4194304 5683644 140736017534672 18446744073709551615 4596048 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/17771/statm: 4060 922 381 364 0 547 0

[startup+0.0485071 s]
/proc/loadavg: 11.25 10.72 8.99 9/489 17771
/proc/meminfo: memFree=24551328/32951124 swapFree=53501244/67111528
[pid=17771] ppid=17769 vsize=29788 CPUtime=0.02 cores=0,2,4,6
/proc/17771/stat : 17771 (python) S 17769 17771 16982 0 -1 4202496 1440 0 0 0 2 0 0 0 25 0 1 0 658038748 30502912 1283 33554432000 4194304 5683644 140736017534672 18446744073709551615 216634513408 0 2147483391 16781312 2 18446744071699199166 0 0 17 6 0 0 0
/proc/17771/statm: 7447 1283 443 364 0 817 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 29788

[startup+0.101468 s]
/proc/loadavg: 11.25 10.72 8.99 9/489 17771
/proc/meminfo: memFree=24551328/32951124 swapFree=53501244/67111528
[pid=17771] ppid=17769 vsize=104616 CPUtime=0.05 cores=0,2,4,6
/proc/17771/stat : 17771 (python) S 17769 17771 16982 0 -1 4202496 3099 0 0 0 4 1 0 0 25 0 1 0 658038748 107126784 2779 33554432000 4194304 5683644 140736017534672 18446744073709551615 216634513408 0 2147483391 16781312 2 18446744071699199166 0 0 17 6 0 0 0
/proc/17771/statm: 26154 2779 847 364 0 1902 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 104616

[startup+0.300462 s]
/proc/loadavg: 11.25 10.72 8.99 9/489 17771
/proc/meminfo: memFree=24551328/32951124 swapFree=53501244/67111528
[pid=17771] ppid=17769 vsize=196852 CPUtime=0.2 cores=0,2,4,6
/proc/17771/stat : 17771 (python) R 17769 17771 16982 0 -1 4202496 6956 933 1 0 15 5 0 0 25 0 1 0 658038748 201576448 5007 33554432000 4194304 5683644 140736017534672 18446744073709551615 216634511205 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/17771/statm: 49213 5007 1446 364 0 3757 0
Current children cumulated CPU time (s) 0.2
Current children cumulated vsize (KiB) 196852

[startup+0.70039 s]
/proc/loadavg: 11.25 10.72 8.99 9/489 17771
/proc/meminfo: memFree=24551328/32951124 swapFree=53501244/67111528
[pid=17771] ppid=17769 vsize=292748 CPUtime=0.57 cores=0,2,4,6
/proc/17771/stat : 17771 (python) R 17769 17771 16982 0 -1 4202496 14666 933 1 0 50 7 0 0 25 0 1 0 658038748 299773952 10572 33554432000 4194304 5683644 140736017534672 18446744073709551615 4602349 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/17771/statm: 73187 10572 1826 364 0 9111 0
Current children cumulated CPU time (s) 0.57
Current children cumulated vsize (KiB) 292748

[startup+1.50028 s]
/proc/loadavg: 11.15 10.71 9.00 9/490 17776
/proc/meminfo: memFree=24514120/32951124 swapFree=53501244/67111528
[pid=17771] ppid=17769 vsize=292748 CPUtime=1.37 cores=0,2,4,6
/proc/17771/stat : 17771 (python) R 17769 17771 16982 0 -1 4202496 14666 933 1 0 130 7 0 0 25 0 1 0 658038748 299773952 10572 33554432000 4194304 5683644 140736017534672 18446744073709551615 46967890560597 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/17771/statm: 73187 10572 1826 364 0 9111 0
Current children cumulated CPU time (s) 1.37
Current children cumulated vsize (KiB) 292748

[startup+3.101 s]
/proc/loadavg: 11.15 10.71 9.00 9/490 17776
/proc/meminfo: memFree=24513056/32951124 swapFree=53501244/67111528
[pid=17771] ppid=17769 vsize=292748 CPUtime=2.97 cores=0,2,4,6
/proc/17771/stat : 17771 (python) R 17769 17771 16982 0 -1 4202496 14673 933 1 0 290 7 0 0 25 0 1 0 658038748 299773952 10579 33554432000 4194304 5683644 140736017534672 18446744073709551615 46967887792268 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/17771/statm: 73187 10579 1833 364 0 9111 0
Current children cumulated CPU time (s) 2.97
Current children cumulated vsize (KiB) 292748

[startup+6.30141 s]
/proc/loadavg: 11.15 10.71 9.00 13/502 17788
/proc/meminfo: memFree=24413812/32951124 swapFree=53501244/67111528
[pid=17771] ppid=17769 vsize=326332 CPUtime=3.07 cores=0,2,4,6
/proc/17771/stat : 17771 (python) S 17769 17771 16982 0 -1 4202496 17400 933 1 0 298 9 0 0 25 0 5 0 658038748 334163968 8780 33554432000 4194304 5683644 140736017534672 18446744073709551615 216646342091 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/17771/statm: 81583 8780 1881 364 0 17492 0
[pid=17777] ppid=17771 vsize=285804 CPUtime=0 cores=0,2,4,6
/proc/17777/stat : 17777 (python) S 17771 17771 16982 0 -1 4202560 730 0 0 0 0 0 0 0 18 0 1 0 658039065 292663296 7104 33554432000 4194304 5683644 140736017534672 18446744073709551615 216634535439 0 0 16781312 514 6729574665993289987 0 0 17 6 0 0 0
/proc/17777/statm: 71451 7104 355 364 0 7369 0
[pid=17779] ppid=17777 vsize=268420 CPUtime=3.05 cores=0,2,4,6
/proc/17779/stat : 17779 (hybridGM3) R 17777 17779 17779 0 -1 4202496 6186 0 0 0 305 0 0 0 25 0 1 0 658039065 274862080 5922 33554432000 134512640 135204385 4292194864 18446744073709551615 134536986 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/17779/statm: 67105 5922 64 169 0 66935 0
[pid=17780] ppid=17771 vsize=295792 CPUtime=0 cores=0,2,4,6
/proc/17780/stat : 17780 (python) S 17771 17771 16982 0 -1 4202560 734 0 0 0 0 0 0 0 18 0 1 0 658039066 302891008 7237 33554432000 4194304 5683644 140736017534672 18446744073709551615 216634535494 0 0 16781312 514 8513909414548177156 0 0 17 2 0 0 0
/proc/17780/statm: 73948 7237 349 364 0 9863 0
[pid=17784] ppid=17780 vsize=268420 CPUtime=1.49 cores=0,2,4,6
/proc/17784/stat : 17784 (hybridGM3) R 17780 17784 17784 0 -1 4202496 6181 0 0 0 149 0 0 0 25 0 1 0 658039067 274862080 5921 33554432000 134512640 135204385 4291564400 18446744073709551615 134537403 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/17784/statm: 67105 5921 64 169 0 66935 0
[pid=17782] ppid=17771 vsize=305832 CPUtime=0 cores=0,2,4,6
/proc/17782/stat : 17782 (python) S 17771 17771 16982 0 -1 4202560 739 0 0 0 0 0 0 0 18 0 1 0 658039067 313171968 7239 33554432000 4194304 5683644 140736017534672 18446744073709551615 216634535494 0 0 16781312 514 4602463319188537603 0 0 17 0 0 0 0
/proc/17782/statm: 76458 7239 347 364 0 12370 0
[pid=17787] ppid=17782 vsize=268424 CPUtime=1.51 cores=0,2,4,6
/proc/17787/stat : 17787 (hybridGM3) R 17782 17787 17787 0 -1 4202496 6186 0 0 0 151 0 0 0 25 0 1 0 658039069 274866176 5923 33554432000 134512640 135204385 4294038256 18446744073709551615 134547435 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/17787/statm: 67106 5923 64 169 0 66936 0
[pid=17785] ppid=17771 vsize=316808 CPUtime=0 cores=0,2,4,6
/proc/17785/stat : 17785 (python) S 17771 17771 16982 0 -1 4202560 750 0 0 0 0 0 0 0 18 0 1 0 658039068 324411392 7245 33554432000 4194304 5683644 140736017534672 18446744073709551615 216634535494 0 0 16781312 514 12894531140253090052 0 0 17 0 0 0 0
/proc/17785/statm: 79202 7245 349 364 0 15111 0
[pid=17788] ppid=17785 vsize=268420 CPUtime=3.08 cores=0,2,4,6
/proc/17788/stat : 17788 (hybridGM3) R 17785 17788 17788 0 -1 4202496 6183 0 0 0 308 0 0 0 25 0 1 0 658039069 274862080 5922 33554432000 134512640 135204385 4291913008 18446744073709551615 134537224 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/17788/statm: 67105 5922 64 169 0 66935 0
[pid=17771/tid=17778] ppid=17769 vsize=326332 CPUtime=0 cores=0,2,4,6
/proc/17771/task/17778/stat : 17778 (python) S 17769 17771 16982 0 -1 4202560 27 933 0 0 0 0 0 0 25 0 5 0 658039065 334163968 8780 33554432000 4194304 5683644 140736017534672 18446744073709551615 216646338993 0 0 16781312 2 18446604444655083648 0 0 -1 6 0 0 0
[pid=17771/tid=17781] ppid=17769 vsize=326332 CPUtime=0 cores=0,2,4,6
/proc/17771/task/17781/stat : 17781 (python) S 17769 17771 16982 0 -1 4202560 35 933 0 0 0 0 0 0 25 0 5 0 658039066 334163968 8780 33554432000 4194304 5683644 140736017534672 18446744073709551615 216646338993 0 0 16781312 2 18446604444655083648 0 0 -1 0 0 0 0
[pid=17771/tid=17783] ppid=17769 vsize=326332 CPUtime=0 cores=0,2,4,6
/proc/17771/task/17783/stat : 17783 (python) S 17769 17771 16982 0 -1 4202560 34 933 0 0 0 0 0 0 25 0 5 0 658039067 334163968 8780 33554432000 4194304 5683644 140736017534672 18446744073709551615 216646338993 0 0 16781312 2 18446604444655083648 0 0 -1 0 0 0 0
[pid=17771/tid=17786] ppid=17769 vsize=326332 CPUtime=0 cores=0,2,4,6
/proc/17771/task/17786/stat : 17786 (python) S 17769 17771 16982 0 -1 4202560 18 933 0 0 0 0 0 0 25 0 5 0 658039069 334163968 8780 33554432000 4194304 5683644 140736017534672 18446744073709551615 216646338993 0 0 16781312 2 18446604444655083648 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 12.2
Current children cumulated vsize (KiB) 2604252

[startup+12.7013 s]
/proc/loadavg: 11.13 10.72 9.02 12/502 17789
/proc/meminfo: memFree=24411720/32951124 swapFree=53501244/67111528
[pid=17771] ppid=17769 vsize=326332 CPUtime=3.07 cores=0,2,4,6
/proc/17771/stat : 17771 (python) S 17769 17771 16982 0 -1 4202496 17400 933 1 0 298 9 0 0 25 0 5 0 658038748 334163968 8780 33554432000 4194304 5683644 140736017534672 18446744073709551615 216646342091 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/17771/statm: 81583 8780 1881 364 0 17492 0
[pid=17777] ppid=17771 vsize=285804 CPUtime=0.01 cores=0,2,4,6
/proc/17777/stat : 17777 (python) S 17771 17771 16982 0 -1 4202560 891 0 0 0 0 1 0 0 18 0 1 0 658039065 292663296 7127 33554432000 4194304 5683644 140736017534672 18446744073709551615 216634535439 0 0 16781312 514 6729574665993289987 0 0 17 6 0 0 0
/proc/17777/statm: 71451 7127 378 364 0 7369 0
[pid=17779] ppid=17777 vsize=268420 CPUtime=9.33 cores=0,2,4,6
/proc/17779/stat : 17779 (hybridGM3) R 17777 17779 17779 0 -1 4202496 6186 0 0 0 933 0 0 0 25 0 1 0 658039065 274862080 5922 33554432000 134512640 135204385 4292194864 18446744073709551615 134537322 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/17779/statm: 67105 5922 64 169 0 66935 0
[pid=17780] ppid=17771 vsize=295792 CPUtime=0.01 cores=0,2,4,6
/proc/17780/stat : 17780 (python) S 17771 17771 16982 0 -1 4202560 910 0 0 0 0 1 0 0 18 0 1 0 658039066 302891008 7260 33554432000 4194304 5683644 140736017534672 18446744073709551615 216634535494 0 0 16781312 514 8513909414548177156 0 0 17 2 0 0 0
/proc/17780/statm: 73948 7260 372 364 0 9863 0
[pid=17784] ppid=17780 vsize=268420 CPUtime=4.69 cores=0,2,4,6
/proc/17784/stat : 17784 (hybridGM3) R 17780 17784 17784 0 -1 4202496 6181 0 0 0 469 0 0 0 25 0 1 0 658039067 274862080 5921 33554432000 134512640 135204385 4291564400 18446744073709551615 134546089 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/17784/statm: 67105 5921 64 169 0 66935 0
[pid=17782] ppid=17771 vsize=305832 CPUtime=0.02 cores=0,2,4,6
/proc/17782/stat : 17782 (python) S 17771 17771 16982 0 -1 4202560 905 0 0 0 1 1 0 0 18 0 1 0 658039067 313171968 7262 33554432000 4194304 5683644 140736017534672 18446744073709551615 216634535494 0 0 16781312 514 4602463319188537603 0 0 17 0 0 0 0
/proc/17782/statm: 76458 7262 370 364 0 12370 0
[pid=17787] ppid=17782 vsize=268424 CPUtime=4.71 cores=0,2,4,6
/proc/17787/stat : 17787 (hybridGM3) R 17782 17787 17787 0 -1 4202496 6186 0 0 0 471 0 0 0 25 0 1 0 658039069 274866176 5923 33554432000 134512640 135204385 4294038256 18446744073709551615 134546073 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/17787/statm: 67106 5923 64 169 0 66936 0
[pid=17785] ppid=17771 vsize=316808 CPUtime=0.02 cores=0,2,4,6
/proc/17785/stat : 17785 (python) S 17771 17771 16982 0 -1 4202560 921 0 0 0 1 1 0 0 18 0 1 0 658039068 324411392 7268 33554432000 4194304 5683644 140736017534672 18446744073709551615 216634535494 0 0 16781312 514 12894531140253090052 0 0 17 0 0 0 0
/proc/17785/statm: 79202 7268 372 364 0 15111 0
[pid=17788] ppid=17785 vsize=268420 CPUtime=9.44 cores=0,2,4,6
/proc/17788/stat : 17788 (hybridGM3) R 17785 17788 17788 0 -1 4202496 6183 0 0 0 944 0 0 0 25 0 1 0 658039069 274862080 5922 33554432000 134512640 135204385 4291913008 18446744073709551615 134536663 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/17788/statm: 67105 5922 64 169 0 66935 0
[pid=17771/tid=17778] ppid=17769 vsize=326332 CPUtime=0 cores=0,2,4,6
/proc/17771/task/17778/stat : 17778 (python) S 17769 17771 16982 0 -1 4202560 27 933 0 0 0 0 0 0 25 0 5 0 658039065 334163968 8780 33554432000 4194304 5683644 140736017534672 18446744073709551615 216646338993 0 0 16781312 2 18446604444655083648 0 0 -1 6 0 0 0
[pid=17771/tid=17781] ppid=17769 vsize=326332 CPUtime=0 cores=0,2,4,6
/proc/17771/task/17781/stat : 17781 (python) S 17769 17771 16982 0 -1 4202560 35 933 0 0 0 0 0 0 25 0 5 0 658039066 334163968 8780 33554432000 4194304 5683644 140736017534672 18446744073709551615 216646338993 0 0 16781312 2 18446604444655083648 0 0 -1 0 0 0 0
[pid=17771/tid=17783] ppid=17769 vsize=326332 CPUtime=0 cores=0,2,4,6
/proc/17771/task/17783/stat : 17783 (python) S 17769 17771 16982 0 -1 4202560 34 933 0 0 0 0 0 0 25 0 5 0 658039067 334163968 8780 33554432000 4194304 5683644 140736017534672 18446744073709551615 216646338993 0 0 16781312 2 18446604444655083648 0 0 -1 0 0 0 0
[pid=17771/tid=17786] ppid=17769 vsize=326332 CPUtime=0 cores=0,2,4,6
/proc/17771/task/17786/stat : 17786 (python) S 17769 17771 16982 0 -1 4202560 18 933 0 0 0 0 0 0 25 0 5 0 658039069 334163968 8780 33554432000 4194304 5683644 140736017534672 18446744073709551615 216646338993 0 0 16781312 2 18446604444655083648 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 31.3
Current children cumulated vsize (KiB) 2604252

[startup+25.501 s]
/proc/loadavg: 11.11 10.73 9.04 12/502 17789
/proc/meminfo: memFree=24412092/32951124 swapFree=53501244/67111528
[pid=17771] ppid=17769 vsize=326332 CPUtime=3.07 cores=0,2,4,6
/proc/17771/stat : 17771 (python) S 17769 17771 16982 0 -1 4202496 17400 933 1 0 298 9 0 0 25 0 5 0 658038748 334163968 8780 33554432000 4194304 5683644 140736017534672 18446744073709551615 216646342091 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/17771/statm: 81583 8780 1881 364 0 17492 0
[pid=17777] ppid=17771 vsize=285804 CPUtime=0.05 cores=0,2,4,6
/proc/17777/stat : 17777 (python) S 17771 17771 16982 0 -1 4202560 897 0 0 0 2 3 0 0 18 0 1 0 658039065 292663296 7127 33554432000 4194304 5683644 140736017534672 18446744073709551615 216634535439 0 0 16781312 514 10176745375159779587 0 0 17 6 0 0 0
/proc/17777/statm: 71451 7127 378 364 0 7369 0
[pid=17779] ppid=17777 vsize=268420 CPUtime=18.98 cores=0,2,4,6
/proc/17779/stat : 17779 (hybridGM3) R 17777 17779 17779 0 -1 4202496 6186 0 0 0 1898 0 0 0 25 0 1 0 658039065 274862080 5922 33554432000 134512640 135204385 4292194864 18446744073709551615 134537573 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/17779/statm: 67105 5922 64 169 0 66935 0
[pid=17780] ppid=17771 vsize=295792 CPUtime=0.06 cores=0,2,4,6
/proc/17780/stat : 17780 (python) S 17771 17771 16982 0 -1 4202560 916 0 0 0 3 3 0 0 18 0 1 0 658039066 302891008 7260 33554432000 4194304 5683644 140736017534672 18446744073709551615 216634535494 0 0 16781312 514 10176745375159779588 0 0 17 2 0 0 0
/proc/17780/statm: 73948 7260 372 364 0 9863 0
[pid=17784] ppid=17780 vsize=268420 CPUtime=11.09 cores=0,2,4,6
/proc/17784/stat : 17784 (hybridGM3) R 17780 17784 17784 0 -1 4202496 6181 0 0 0 1109 0 0 0 25 0 1 0 658039067 274862080 5921 33554432000 134512640 135204385 4291564400 18446744073709551615 134536986 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/17784/statm: 67105 5921 64 169 0 66935 0
[pid=17782] ppid=17771 vsize=305832 CPUtime=0.05 cores=0,2,4,6
/proc/17782/stat : 17782 (python) S 17771 17771 16982 0 -1 4202560 912 0 0 0 2 3 0 0 18 0 1 0 658039067 313171968 7262 33554432000 4194304 5683644 140736017534672 18446744073709551615 216634535494 0 0 16781312 514 10176745375159779587 0 0 17 0 0 0 0
/proc/17782/statm: 76458 7262 370 364 0 12370 0
[pid=17787] ppid=17782 vsize=268424 CPUtime=14.07 cores=0,2,4,6
/proc/17787/stat : 17787 (hybridGM3) R 17782 17787 17787 0 -1 4202496 6187 0 0 0 1407 0 0 0 25 0 1 0 658039069 274866176 5924 33554432000 134512640 135204385 4294038256 18446744073709551615 134545880 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/17787/statm: 67106 5924 64 169 0 66936 0
[pid=17785] ppid=17771 vsize=316808 CPUtime=0.05 cores=0,2,4,6
/proc/17785/stat : 17785 (python) S 17771 17771 16982 0 -1 4202560 926 0 0 0 3 2 0 0 18 0 1 0 658039068 324411392 7268 33554432000 4194304 5683644 140736017534672 18446744073709551615 216634535494 0 0 16781312 514 10176745375159779588 0 0 17 0 0 0 0
/proc/17785/statm: 79202 7268 372 364 0 15111 0
[pid=17788] ppid=17785 vsize=268420 CPUtime=22.16 cores=0,2,4,6
/proc/17788/stat : 17788 (hybridGM3) R 17785 17788 17788 0 -1 4202496 6183 0 0 0 2215 1 0 0 25 0 1 0 658039069 274862080 5922 33554432000 134512640 135204385 4291913008 18446744073709551615 134536663 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/17788/statm: 67105 5922 64 169 0 66935 0
[pid=17771/tid=17778] ppid=17769 vsize=326332 CPUtime=0 cores=0,2,4,6
/proc/17771/task/17778/stat : 17778 (python) S 17769 17771 16982 0 -1 4202560 27 933 0 0 0 0 0 0 25 0 5 0 658039065 334163968 8780 33554432000 4194304 5683644 140736017534672 18446744073709551615 216646338993 0 0 16781312 2 18446604444655083648 0 0 -1 6 0 0 0
[pid=17771/tid=17781] ppid=17769 vsize=326332 CPUtime=0 cores=0,2,4,6
/proc/17771/task/17781/stat : 17781 (python) S 17769 17771 16982 0 -1 4202560 35 933 0 0 0 0 0 0 25 0 5 0 658039066 334163968 8780 33554432000 4194304 5683644 140736017534672 18446744073709551615 216646338993 0 0 16781312 2 18446604444655083648 0 0 -1 0 0 0 0
[pid=17771/tid=17783] ppid=17769 vsize=326332 CPUtime=0 cores=0,2,4,6
/proc/17771/task/17783/stat : 17783 (python) S 17769 17771 16982 0 -1 4202560 34 933 0 0 0 0 0 0 25 0 5 0 658039067 334163968 8780 33554432000 4194304 5683644 140736017534672 18446744073709551615 216646338993 0 0 16781312 2 18446604444655083648 0 0 -1 0 0 0 0

################
# More data... #
################

/proc/17779/statm: 67105 5924 64 169 0 66935 0
[pid=17777/tid=17809] ppid=17771 vsize=296048 CPUtime=0 cores=0,2,4,6
/proc/17777/task/17809/stat : 17809 (python) S 17771 17771 16982 0 -1 4202560 44 0 0 0 0 0 0 0 18 0 2 0 658055050 303153152 7171 33554432000 4194304 5683644 140736017534672 18446744073709551615 216646338993 0 0 16781312 514 18446604441594642560 0 0 -1 6 0 0 0
[pid=17780] ppid=17771 vsize=295792 CPUtime=1.52 cores=0,2,4,6
/proc/17780/stat : 17780 (python) S 17771 17771 16982 0 -1 4202560 1144 0 0 0 77 75 0 0 18 0 2 0 658039066 302891008 7289 33554432000 4194304 5683644 140736017534672 18446744073709551615 216646342091 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/17780/statm: 73948 7289 400 364 0 9863 0
[pid=17784] ppid=17780 vsize=268420 CPUtime=292.4 cores=0,2,4,6
/proc/17784/stat : 17784 (hybridGM3) T 17780 17784 17784 0 -1 4202496 6184 0 0 0 29240 0 0 0 25 0 1 0 658039067 274862080 5924 33554432000 134512640 135204385 4291564400 18446744073709551615 134536646 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/17784/statm: 67105 5924 64 169 0 66935 0
[pid=17780/tid=17802] ppid=17771 vsize=295792 CPUtime=0 cores=0,2,4,6
/proc/17780/task/17802/stat : 17802 (python) S 17771 17771 16982 0 -1 4202560 47 0 0 0 0 0 0 0 18 0 2 0 658050966 302891008 7289 33554432000 4194304 5683644 140736017534672 18446744073709551615 216646338993 0 0 16781312 514 18446604446305057664 0 0 -1 2 0 0 0
[pid=17782] ppid=17771 vsize=305832 CPUtime=1.31 cores=0,2,4,6
/proc/17782/stat : 17782 (python) S 17771 17771 16982 0 -1 4202560 1151 0 0 0 71 60 0 0 18 0 2 0 658039067 313171968 7292 33554432000 4194304 5683644 140736017534672 18446744073709551615 216646342091 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/17782/statm: 76458 7292 399 364 0 12370 0
[pid=17787] ppid=17782 vsize=268424 CPUtime=197.38 cores=0,2,4,6
/proc/17787/stat : 17787 (hybridGM3) T 17782 17787 17787 0 -1 4202496 6189 0 0 0 19737 1 0 0 25 0 1 0 658039069 274866176 5926 33554432000 134512640 135204385 4294038256 18446744073709551615 134537363 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/17787/statm: 67106 5926 64 169 0 66936 0
[pid=17782/tid=17810] ppid=17771 vsize=305832 CPUtime=0 cores=0,2,4,6
/proc/17782/task/17810/stat : 17810 (python) S 17771 17771 16982 0 -1 4202560 47 0 0 0 0 0 0 0 18 0 2 0 658056986 313171968 7292 33554432000 4194304 5683644 140736017534672 18446744073709551615 216646338993 0 0 16781312 514 18446604441099385856 0 0 -1 0 0 0 0
[pid=17785] ppid=17771 vsize=316808 CPUtime=1.42 cores=0,2,4,6
/proc/17785/stat : 17785 (python) S 17771 17771 16982 0 -1 4202560 1160 0 0 0 75 67 0 0 18 0 2 0 658039068 324411392 7297 33554432000 4194304 5683644 140736017534672 18446744073709551615 216646342091 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/17785/statm: 79202 7297 400 364 0 15111 0
[pid=17788] ppid=17785 vsize=268420 CPUtime=291.22 cores=0,2,4,6
/proc/17788/stat : 17788 (hybridGM3) T 17785 17788 17788 0 -1 4202496 6186 0 0 0 29119 3 0 0 25 0 1 0 658039069 274862080 5925 33554432000 134512640 135204385 4291913008 18446744073709551615 134536821 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/17788/statm: 67105 5925 64 169 0 66935 0
[pid=17785/tid=17818] ppid=17771 vsize=316808 CPUtime=0 cores=0,2,4,6
/proc/17785/task/17818/stat : 17818 (python) S 17771 17771 16982 0 -1 4202560 44 0 0 0 0 0 0 0 18 0 2 0 658065383 324411392 7297 33554432000 4194304 5683644 140736017534672 18446744073709551615 216646338993 0 0 16781312 514 18446604447325000640 0 0 -1 0 0 0 0
[pid=17825] ppid=17771 vsize=326500 CPUtime=2.31 cores=0,2,4,6
/proc/17825/stat : 17825 (python) R 17771 17771 16982 0 -1 4202560 1155 0 0 0 118 113 0 0 18 0 2 0 658075552 334336000 7301 33554432000 4194304 5683644 140736017534672 18446744073709551615 216634558599 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/17825/statm: 81625 7301 400 364 0 17531 0
[pid=17827] ppid=17825 vsize=457020 CPUtime=391.42 cores=0,2,4,6
/proc/17827/stat : 17827 (TNM) R 17825 17827 17827 0 -1 4202496 2775 0 0 0 39141 1 0 0 25 0 1 0 658075552 467988480 2516 33554432000 134512640 135008748 4287857376 18446744073709551615 134529338 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/17827/statm: 114255 2516 46 122 0 113155 0
[pid=17825/tid=17854] ppid=17771 vsize=326504 CPUtime=0 cores=0,2,4,6
/proc/17825/task/17854/stat : 17854 (python) S 17771 17771 16982 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 658095122 334340096 7301 33554432000 4194304 5683644 140736017534672 18446744073709551615 216646338993 0 0 16781312 514 18446604443177312384 0 0 -1 0 0 0 0
[pid=17829] ppid=17771 vsize=337396 CPUtime=1.48 cores=0,2,4,6
/proc/17829/stat : 17829 (python) S 17771 17771 16982 0 -1 4202560 1162 0 0 0 74 74 0 0 16 0 2 0 658078531 345493504 7305 33554432000 4194304 5683644 140736017534672 18446744073709551615 216646342091 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/17829/statm: 84349 7305 400 364 0 20252 0
[pid=17831] ppid=17829 vsize=268420 CPUtime=293.29 cores=0,2,4,6
/proc/17831/stat : 17831 (hybridGM3) T 17829 17831 17831 0 -1 4202496 6187 0 0 0 29327 2 0 0 25 0 1 0 658078543 274862080 5925 33554432000 134512640 135204385 4294464560 18446744073709551615 134547589 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/17831/statm: 67105 5925 64 169 0 66935 0
[pid=17829/tid=17996] ppid=17771 vsize=337396 CPUtime=0 cores=0,2,4,6
/proc/17829/task/17996/stat : 17996 (python) S 17771 17771 16982 0 -1 4202560 46 0 0 0 0 0 0 0 15 0 2 0 658107908 345493504 7305 33554432000 4194304 5683644 140736017534672 18446744073709551615 216646338993 0 0 16781312 514 18446604440892580224 0 0 -1 6 0 0 0
[pid=17832] ppid=17771 vsize=347168 CPUtime=1.17 cores=0,2,4,6
/proc/17832/stat : 17832 (python) S 17771 17771 16982 0 -1 4202560 1155 0 0 0 62 55 0 0 16 0 2 0 658080872 355500032 7386 33554432000 4194304 5683644 140736017534672 18446744073709551615 216646342091 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/17832/statm: 86792 7386 399 364 0 22692 0
[pid=17835] ppid=17832 vsize=268424 CPUtime=198.67 cores=0,2,4,6
/proc/17835/stat : 17835 (hybridGM3) T 17832 17835 17835 0 -1 4202496 6184 0 0 0 19867 0 0 0 25 0 1 0 658080872 274866176 5923 33554432000 134512640 135204385 4294704736 18446744073709551615 134537123 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/17835/statm: 67106 5923 64 169 0 66936 0
[pid=17832/tid=17859] ppid=17771 vsize=347168 CPUtime=0 cores=0,2,4,6
/proc/17832/task/17859/stat : 17859 (python) S 17771 17771 16982 0 -1 4202560 45 0 0 0 0 0 0 0 15 0 2 0 658096983 355500032 7386 33554432000 4194304 5683644 140736017534672 18446744073709551615 216646338993 0 0 16781312 514 18446604453976596928 0 0 -1 6 0 0 0
[pid=17838] ppid=17771 vsize=357424 CPUtime=1.89 cores=0,2,4,6
/proc/17838/stat : 17838 (python) S 17771 17771 16982 0 -1 4202560 1202 0 0 0 98 91 0 0 15 0 2 0 658083765 366002176 7395 33554432000 4194304 5683644 140736017534672 18446744073709551615 216634535494 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/17838/statm: 89356 7395 405 364 0 25253 0
[pid=17840] ppid=17838 vsize=268420 CPUtime=350.71 cores=0,2,4,6
/proc/17840/stat : 17840 (hybridGM3) R 17838 17840 17840 0 -1 4202496 6191 0 0 0 35069 2 0 0 25 0 1 0 658083766 274862080 5927 33554432000 134512640 135204385 4289909360 18446744073709551615 134547471 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/17840/statm: 67105 5927 64 169 0 66935 0
[pid=17838/tid=17994] ppid=17771 vsize=357424 CPUtime=0 cores=0,2,4,6
/proc/17838/task/17994/stat : 17994 (python) S 17771 17771 16982 0 -1 4202560 50 0 0 0 0 0 0 0 15 0 2 0 658106398 366002176 7395 33554432000 4194304 5683644 140736017534672 18446744073709551615 216646338993 0 0 16781312 514 18446604441099384064 0 0 -1 0 0 0 0
[pid=17855] ppid=17771 vsize=368264 CPUtime=0.57 cores=0,2,4,6
/proc/17855/stat : 17855 (python) S 17771 17771 16982 0 -1 4202560 1164 0 0 0 29 28 0 0 19 0 2 0 658095123 377102336 7401 33554432000 4194304 5683644 140736017534672 18446744073709551615 216646342091 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/17855/statm: 92066 7401 406 364 0 27960 0
[pid=17857] ppid=17855 vsize=1021956 CPUtime=97.2 cores=0,2,4,6
/proc/17857/stat : 17857 (gnovelty+2) T 17855 17857 17857 0 -1 4202496 1714 0 0 0 9717 3 0 0 25 0 1 0 658095124 1046482944 1448 33554432000 134512640 135663704 4287175200 18446744073709551615 134525678 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/17857/statm: 255489 1448 113 282 0 255205 0
[pid=17855/tid=17998] ppid=17771 vsize=368264 CPUtime=0 cores=0,2,4,6
/proc/17855/task/17998/stat : 17998 (python) S 17771 17771 16982 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 658111193 377102336 7401 33554432000 4194304 5683644 140736017534672 18446744073709551615 216646338993 0 0 16781312 514 18446604436068323712 0 0 -1 0 0 0 0
[pid=17999] ppid=17771 vsize=377936 CPUtime=1.63 cores=0,2,4,6
/proc/17999/stat : 17999 (python) S 17771 17771 16982 0 -1 4202560 1168 0 0 0 79 84 0 0 15 0 2 0 658111194 387006464 7422 33554432000 4194304 5683644 140736017534672 18446744073709551615 216634535494 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/17999/statm: 94484 7422 399 364 0 30375 0
[pid=18001] ppid=17999 vsize=268424 CPUtime=259.37 cores=0,2,4,6
/proc/18001/stat : 18001 (hybridGM3) R 17999 18001 18001 0 -1 4202496 6190 0 0 0 25934 3 0 0 25 0 1 0 658111195 274866176 5927 33554432000 134512640 135204385 4293473472 18446744073709551615 134537357 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/18001/statm: 67106 5927 64 169 0 66936 0
[pid=17999/tid=18026] ppid=17771 vsize=377936 CPUtime=0 cores=0,2,4,6
/proc/17999/task/18026/stat : 18026 (python) S 17771 17771 16982 0 -1 4202560 46 0 0 0 0 0 0 0 17 0 2 0 658144768 387006464 7422 33554432000 4194304 5683644 140736017534672 18446744073709551615 216646338993 0 0 16781312 514 18446604448006923328 0 0 -1 4 0 0 0
[pid=18011] ppid=17771 vsize=388372 CPUtime=1.37 cores=0,2,4,6
/proc/18011/stat : 18011 (python) S 17771 17771 16982 0 -1 4202560 1003 0 0 0 72 65 0 0 18 0 1 0 658118449 397692928 7417 33554432000 4194304 5683644 140736017534672 18446744073709551615 216634535494 0 0 16781312 514 10176745375159779585 0 0 17 0 0 0 0
/proc/18011/statm: 97093 7417 370 364 0 32981 0
[pid=18013] ppid=18011 vsize=457020 CPUtime=256.35 cores=0,2,4,6
/proc/18013/stat : 18013 (TNM) R 18011 18013 18013 0 -1 4202496 2780 0 0 0 25632 3 0 0 25 0 1 0 658118459 467988480 2515 33554432000 134512640 135008748 4287263024 18446744073709551615 134527320 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/18013/statm: 114255 2515 46 122 0 113155 0
[pid=18016] ppid=17771 vsize=398840 CPUtime=0.76 cores=0,2,4,6
/proc/18016/stat : 18016 (python) S 17771 17771 16982 0 -1 4202560 1162 0 0 0 40 36 0 0 16 0 2 0 658123760 408412160 7452 33554432000 4194304 5683644 140736017534672 18446744073709551615 216646342091 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/18016/statm: 99710 7452 400 364 0 35595 0
[pid=18018] ppid=18016 vsize=268424 CPUtime=196.81 cores=0,2,4,6
/proc/18018/stat : 18018 (hybridGM3) T 18016 18018 18018 0 -1 4202496 6194 0 0 0 19681 0 0 0 25 0 1 0 658123760 274866176 5925 33554432000 134512640 135204385 4292408032 18446744073709551615 134536744 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/18018/statm: 67106 5925 64 169 0 66936 0
[pid=18016/tid=18024] ppid=17771 vsize=398840 CPUtime=0 cores=0,2,4,6
/proc/18016/task/18024/stat : 18024 (python) S 17771 17771 16982 0 -1 4202560 46 0 0 0 0 0 0 0 16 0 2 0 658144686 408412160 7452 33554432000 4194304 5683644 140736017534672 18446744073709551615 216646338993 0 0 16781312 514 18446604444824864704 0 0 -1 0 0 0 0
[pid=17771/tid=17778] ppid=17769 vsize=408872 CPUtime=0 cores=0,2,4,6
/proc/17771/task/17778/stat : 17778 (python) S 17769 17771 16982 0 -1 4202560 30 933 0 0 0 0 0 0 18 0 13 0 658039065 418684928 8952 33554432000 4194304 5683644 140736017534672 18446744073709551615 216646338993 0 0 16781312 2 18446604444655083648 0 0 -1 6 0 0 0
[pid=17771/tid=17781] ppid=17769 vsize=408872 CPUtime=0 cores=0,2,4,6
/proc/17771/task/17781/stat : 17781 (python) S 17769 17771 16982 0 -1 4202560 38 933 0 0 0 0 0 0 18 0 13 0 658039066 418684928 8952 33554432000 4194304 5683644 140736017534672 18446744073709551615 216646338993 0 0 16781312 2 18446604444655083648 0 0 -1 0 0 0 0
[pid=17771/tid=17783] ppid=17769 vsize=408872 CPUtime=0 cores=0,2,4,6
/proc/17771/task/17783/stat : 17783 (python) S 17769 17771 16982 0 -1 4202560 35 933 0 0 0 0 0 0 18 0 13 0 658039067 418684928 8952 33554432000 4194304 5683644 140736017534672 18446744073709551615 216646338993 0 0 16781312 2 18446604444655083648 0 0 -1 0 0 0 0
[pid=17771/tid=17786] ppid=17769 vsize=408872 CPUtime=0 cores=0,2,4,6
/proc/17771/task/17786/stat : 17786 (python) S 17769 17771 16982 0 -1 4202560 20 933 0 0 0 0 0 0 18 0 13 0 658039069 418684928 8952 33554432000 4194304 5683644 140736017534672 18446744073709551615 216646338993 0 0 16781312 2 18446604444655083648 0 0 -1 0 0 0 0
[pid=17771/tid=17826] ppid=17769 vsize=408872 CPUtime=0 cores=0,2,4,6
/proc/17771/task/17826/stat : 17826 (python) S 17769 17771 16982 0 -1 4202560 36 933 0 0 0 0 0 0 18 0 13 0 658075552 418684928 8952 33554432000 4194304 5683644 140736017534672 18446744073709551615 216646338993 0 0 16781312 2 18446604444655083648 0 0 -1 0 0 0 0
[pid=17771/tid=17830] ppid=17769 vsize=408872 CPUtime=0 cores=0,2,4,6
/proc/17771/task/17830/stat : 17830 (python) S 17769 17771 16982 0 -1 4202560 33 933 0 0 0 0 0 0 18 0 13 0 658078531 418684928 8952 33554432000 4194304 5683644 140736017534672 18446744073709551615 216646338993 0 0 16781312 2 18446604444655083648 0 0 -1 0 0 0 0
[pid=17771/tid=17833] ppid=17769 vsize=408872 CPUtime=0 cores=0,2,4,6
/proc/17771/task/17833/stat : 17833 (python) S 17769 17771 16982 0 -1 4202560 31 933 0 0 0 0 0 0 18 0 13 0 658080872 418684928 8952 33554432000 4194304 5683644 140736017534672 18446744073709551615 216646338993 0 0 16781312 2 18446604444655083648 0 0 -1 0 0 0 0
[pid=17771/tid=17839] ppid=17769 vsize=408872 CPUtime=0 cores=0,2,4,6
/proc/17771/task/17839/stat : 17839 (python) S 17769 17771 16982 0 -1 4202560 33 933 0 0 0 0 0 0 18 0 13 0 658083765 418684928 8952 33554432000 4194304 5683644 140736017534672 18446744073709551615 216646338993 0 0 16781312 2 18446604444655083648 0 0 -1 0 0 0 0
[pid=17771/tid=17856] ppid=17769 vsize=408872 CPUtime=0 cores=0,2,4,6
/proc/17771/task/17856/stat : 17856 (python) S 17769 17771 16982 0 -1 4202560 22 933 0 0 0 0 0 0 20 0 13 0 658095123 418684928 8952 33554432000 4194304 5683644 140736017534672 18446744073709551615 216646338993 0 0 16781312 2 18446604444655083648 0 0 -1 0 0 0 0
[pid=17771/tid=18000] ppid=17769 vsize=408872 CPUtime=0 cores=0,2,4,6
/proc/17771/task/18000/stat : 18000 (python) S 17769 17771 16982 0 -1 4202560 29 933 0 0 0 0 0 0 18 0 13 0 658111194 418684928 8952 33554432000 4194304 5683644 140736017534672 18446744073709551615 216646338993 0 0 16781312 2 18446604444655083648 0 0 -1 0 0 0 0
[pid=17771/tid=18012] ppid=17769 vsize=408872 CPUtime=0 cores=0,2,4,6
/proc/17771/task/18012/stat : 18012 (python) S 17769 17771 16982 0 -1 4202560 28 933 0 0 0 0 0 0 20 0 13 0 658118449 418684928 8952 33554432000 4194304 5683644 140736017534672 18446744073709551615 216646338993 0 0 16781312 2 18446604444655083648 0 0 -1 0 0 0 0
[pid=17771/tid=18017] ppid=17769 vsize=408872 CPUtime=0 cores=0,2,4,6
/proc/17771/task/18017/stat : 18017 (python) S 17769 17771 16982 0 -1 4202560 28 933 0 0 0 0 0 0 20 0 13 0 658123760 418684928 8952 33554432000 4194304 5683644 140736017534672 18446744073709551615 216646338993 0 0 16781312 2 18446604444655083648 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3137.39
Current children cumulated vsize (KiB) 8877044

[startup+1176.6 s]
/proc/loadavg: 11.17 11.18 10.56 12/525 18029
/proc/meminfo: memFree=24275344/32951124 swapFree=53501244/67111528
[pid=17771] ppid=17769 vsize=408872 CPUtime=2266.32 cores=0,2,4,6
/proc/17771/stat : 17771 (python) S 17769 17771 16982 0 -1 4202496 25304 59511 1 0 314 11 225697 610 17 0 13 0 658038748 418684928 8952 33554432000 4194304 5683644 140736017534672 18446744073709551615 216646345535 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/17771/statm: 102218 8952 1898 364 0 38103 0
[pid=17838] ppid=17771 vsize=357424 CPUtime=1.89 cores=0,2,4,6
/proc/17838/stat : 17838 (python) S 17771 17771 16982 0 -1 4202560 1206 0 0 0 98 91 0 0 15 0 2 0 658083765 366002176 7395 33554432000 4194304 5683644 140736017534672 18446744073709551615 216646345535 0 0 16781824 2 18446744073709551615 0 0 17 0 0 0 0
/proc/17838/statm: 89356 7395 405 364 0 25253 0
[pid=17840] ppid=17838 vsize=268420 CPUtime=350.73 cores=0,2,4,6
/proc/17840/stat : 17840 (hybridGM3) R 17838 17840 17840 0 -1 4202496 6191 0 0 0 35071 2 0 0 25 0 1 0 658083766 274862080 5927 33554432000 134512640 135204385 4289909360 18446744073709551615 134536922 256 0 16781312 0 0 0 0 17 2 0 0 0
/proc/17840/statm: 67105 5927 64 169 0 66935 0
[pid=17838/tid=17994] ppid=17771 vsize=357424 CPUtime=0 cores=0,2,4,6
/proc/17838/task/17994/stat : 17994 (python) S 17771 17771 16982 0 -1 4202560 50 0 0 0 0 0 0 0 15 0 2 0 658106398 366002176 7395 33554432000 4194304 5683644 140736017534672 18446744073709551615 216646338993 0 0 16781824 2 18446604441099384064 0 0 -1 0 0 0 0
[pid=17999] ppid=17771 vsize=377936 CPUtime=1.63 cores=0,2,4,6
/proc/17999/stat : 17999 (python) S 17771 17771 16982 0 -1 4202560 1168 0 0 0 79 84 0 0 15 0 2 0 658111194 387006464 7422 33554432000 4194304 5683644 140736017534672 18446744073709551615 216634535494 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/17999/statm: 94484 7422 399 364 0 30375 0
[pid=18001] ppid=17999 vsize=268424 CPUtime=259.45 cores=0,2,4,6
/proc/18001/stat : 18001 (hybridGM3) R 17999 18001 18001 0 -1 4202496 6190 0 0 0 25942 3 0 0 25 0 1 0 658111195 274866176 5927 33554432000 134512640 135204385 4293473472 18446744073709551615 134545851 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/18001/statm: 67106 5927 64 169 0 66936 0
[pid=17999/tid=18026] ppid=17771 vsize=377936 CPUtime=0 cores=0,2,4,6
/proc/17999/task/18026/stat : 18026 (python) S 17771 17771 16982 0 -1 4202560 46 0 0 0 0 0 0 0 17 0 2 0 658144768 387006464 7422 33554432000 4194304 5683644 140736017534672 18446744073709551615 216646338993 0 0 16781312 514 18446604448006923328 0 0 -1 4 0 0 0
[pid=18011] ppid=17771 vsize=388372 CPUtime=1.37 cores=0,2,4,6
/proc/18011/stat : 18011 (python) S 17771 17771 16982 0 -1 4202560 1003 0 0 0 72 65 0 0 18 0 1 0 658118449 397692928 7417 33554432000 4194304 5683644 140736017534672 18446744073709551615 216634535494 0 0 16781312 514 10176745375159779585 0 0 17 0 0 0 0
/proc/18011/statm: 97093 7417 370 364 0 32981 0
[pid=18013] ppid=18011 vsize=457020 CPUtime=256.42 cores=0,2,4,6
/proc/18013/stat : 18013 (TNM) R 18011 18013 18013 0 -1 4202496 2780 0 0 0 25639 3 0 0 25 0 1 0 658118459 467988480 2515 33554432000 134512640 135008748 4287263024 18446744073709551615 134529328 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/18013/statm: 114255 2515 46 122 0 113155 0
[pid=17771/tid=17778] ppid=17769 vsize=408872 CPUtime=2263.07 cores=0,2,4,6
/proc/17771/task/17778/stat : 17778 (python) S 17769 17771 16982 0 -1 4202560 30 59511 0 0 0 0 225697 610 18 0 13 0 658039065 418684928 8952 33554432000 4194304 5683644 140736017534672 18446744073709551615 216646338993 0 0 16781312 2 18446604444655083648 0 0 -1 6 0 0 0
[pid=17771/tid=17781] ppid=17769 vsize=408872 CPUtime=2263.07 cores=0,2,4,6
/proc/17771/task/17781/stat : 17781 (python) S 17769 17771 16982 0 -1 4202560 38 59511 0 0 0 0 225697 610 18 0 13 0 658039066 418684928 8952 33554432000 4194304 5683644 140736017534672 18446744073709551615 216646338993 0 0 16781312 2 18446604444655083648 0 0 -1 0 0 0 0
[pid=17771/tid=17783] ppid=17769 vsize=408872 CPUtime=2263.07 cores=0,2,4,6
/proc/17771/task/17783/stat : 17783 (python) S 17769 17771 16982 0 -1 4202560 35 59511 0 0 0 0 225697 610 18 0 13 0 658039067 418684928 8952 33554432000 4194304 5683644 140736017534672 18446744073709551615 216646338993 0 0 16781312 2 18446604444655083648 0 0 -1 0 0 0 0
[pid=17771/tid=17786] ppid=17769 vsize=408872 CPUtime=2263.07 cores=0,2,4,6
/proc/17771/task/17786/stat : 17786 (python) S 17769 17771 16982 0 -1 4202560 20 59511 0 0 0 0 225697 610 18 0 13 0 658039069 418684928 8952 33554432000 4194304 5683644 140736017534672 18446744073709551615 216646338993 0 0 16781312 2 18446604444655083648 0 0 -1 0 0 0 0
[pid=17771/tid=17826] ppid=17769 vsize=408872 CPUtime=2263.07 cores=0,2,4,6
/proc/17771/task/17826/stat : 17826 (python) S 17769 17771 16982 0 -1 4202560 36 59511 0 0 0 0 225697 610 18 0 13 0 658075552 418684928 8952 33554432000 4194304 5683644 140736017534672 18446744073709551615 216646338993 0 0 16781312 2 18446604444655083648 0 0 -1 0 0 0 0
[pid=17771/tid=17830] ppid=17769 vsize=408872 CPUtime=2263.07 cores=0,2,4,6
/proc/17771/task/17830/stat : 17830 (python) S 17769 17771 16982 0 -1 4202560 33 59511 0 0 0 0 225697 610 18 0 13 0 658078531 418684928 8952 33554432000 4194304 5683644 140736017534672 18446744073709551615 216646338993 0 0 16781312 2 18446604444655083648 0 0 -1 0 0 0 0
[pid=17771/tid=17833] ppid=17769 vsize=408872 CPUtime=2263.07 cores=0,2,4,6
/proc/17771/task/17833/stat : 17833 (python) S 17769 17771 16982 0 -1 4202560 31 59511 0 0 0 0 225697 610 18 0 13 0 658080872 418684928 8952 33554432000 4194304 5683644 140736017534672 18446744073709551615 216646338993 0 0 16781312 2 18446604444655083648 0 0 -1 0 0 0 0
[pid=17771/tid=17839] ppid=17769 vsize=408872 CPUtime=2263.07 cores=0,2,4,6
/proc/17771/task/17839/stat : 17839 (python) S 17769 17771 16982 0 -1 4202560 33 59511 0 0 0 0 225697 610 18 0 13 0 658083765 418684928 8952 33554432000 4194304 5683644 140736017534672 18446744073709551615 216646338993 0 0 16781312 2 18446604444655083648 0 0 -1 0 0 0 0
[pid=17771/tid=17856] ppid=17769 vsize=408872 CPUtime=2263.07 cores=0,2,4,6
/proc/17771/task/17856/stat : 17856 (python) S 17769 17771 16982 0 -1 4202560 22 59511 0 0 0 0 225697 610 20 0 13 0 658095123 418684928 8952 33554432000 4194304 5683644 140736017534672 18446744073709551615 216646338993 0 0 16781312 2 18446604444655083648 0 0 -1 0 0 0 0
[pid=17771/tid=18000] ppid=17769 vsize=408872 CPUtime=2263.07 cores=0,2,4,6
/proc/17771/task/18000/stat : 18000 (python) S 17769 17771 16982 0 -1 4202560 29 59511 0 0 0 0 225697 610 18 0 13 0 658111194 418684928 8952 33554432000 4194304 5683644 140736017534672 18446744073709551615 216646338993 0 0 16781312 2 18446604444655083648 0 0 -1 0 0 0 0
[pid=17771/tid=18012] ppid=17769 vsize=408872 CPUtime=2263.07 cores=0,2,4,6
/proc/17771/task/18012/stat : 18012 (python) S 17769 17771 16982 0 -1 4202560 28 59511 0 0 0 0 225697 610 20 0 13 0 658118449 418684928 8952 33554432000 4194304 5683644 140736017534672 18446744073709551615 216646338993 0 0 16781312 2 18446604444655083648 0 0 -1 0 0 0 0
[pid=17771/tid=18017] ppid=17769 vsize=408872 CPUtime=2263.07 cores=0,2,4,6
/proc/17771/task/18017/stat : 18017 (python) S 17769 17771 16982 0 -1 4202560 28 59511 0 0 0 0 225697 610 20 0 13 0 658123760 418684928 8952 33554432000 4194304 5683644 140736017534672 18446744073709551615 216646338993 0 0 16781312 2 18446604444655083648 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3137.81
Current children cumulated vsize (KiB) 2526468

Child status: 0
Real time (s): 1176.66
CPU time (s): 3137.99
CPU user time (s): 3129.24
CPU system time (s): 8.75267
CPU usage (%): 266.687
Max. virtual memory (cumulated for all children) (KiB): 8877048

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3129.24
system time used= 8.75267
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 108993
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 8464
involuntary context switches= 36213

runsolver used 7.34288 second user time and 18.2512 second system time

The end

Launcher Data 

Begin job on node103 at 2011-05-15 14:59:21
IDJOB=3378264
IDBENCH=82673
IDSOLVER=1859
FILE ID=node103/3378264-1305464361
RUNJOBID= node103-1305462668-17000
PBS_JOBID= 13324971
Free space on /tmp= 72928 MiB

SOLVER NAME= borg-sat 11.03.02-par-random (fixed)
BENCH NAME= SAT11/random/large/unif-k3-r4.2-v15000-c63000-S594553190-015-UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3378264-1305464361/watcher-3378264-1305464361 -o /tmp/evaluation-result-3378264-1305464361/solver-3378264-1305464361 -C 4800 -W 1300 -M 15500  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3378264-1305464361.cnf -seed 972692168 -budget 4800 -cores 4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 0a98d6d9a7bdb797305aed69a94f9a69
RANDOM SEED=972692168

node103.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.71
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      24551484 kB
Buffers:        329376 kB
Cached:        4206352 kB
SwapCached:     340184 kB
Active:        2875512 kB
Inactive:      5214804 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      24551484 kB
SwapTotal:    67111528 kB
SwapFree:     53501244 kB
Dirty:           33224 kB
Writeback:           0 kB
AnonPages:     3225032 kB
Mapped:          27380 kB
Slab:           164432 kB
PageTables:      74668 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 142037720 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72900 MiB
End job on node103 at 2011-05-15 15:18:58