Trace number 3385354

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-par-random (fixed)SAT 71.9201 10.391

General information on the benchmark

Namerandom/large/
unif-k5-r20-v750-c15000-S1787347746-067-UNKNOWN.cnf
MD5SUM327a5393de6dbdcaf85af71880caf3c5
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark13.8569
Satisfiable
(Un)Satisfiability was proved
Number of variables750
Number of clauses15000
Sum of the clauses size75000
Maximum clause length5
Minimum clause length5
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 515000
Number of clauses of size over 50

Solver Data 

0.35/0.67	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.35/0.67	c INFO: solving HOME/instance-3385354-1305565666.cnf
0.35/0.67	c INFO: computing task features
0.43/0.75	c INFO: computed variable-clause graph statistics
0.43/0.75	c INFO: computed clause balance statistics
0.84/1.16	c INFO: computed variable balance statistics
1.03/1.37	c INFO: computed small-clause counts
1.03/1.37	c INFO: computed Horn-clause counts
1.03/1.39	c INFO: computed variable graph statistics
1.03/1.39	c INFO: collected features for HOME/instance-3385354-1305565666.cnf in 0.71 s
1.13/1.42	c INFO: running gnovelty+2@0 for 97 with 4999 remaining (b = 0.42)
1.13/1.45	c INFO: running gnovelty+2@0 for 97 with 4999 remaining (b = 0.15)
1.13/1.48	c INFO: running adaptg2wsat2009++@0 for 97 with 4999 remaining (b = 0.10)
1.23/1.51	c INFO: running adaptg2wsat2009++@0 for 97 with 4999 remaining (b = 0.08)
1.23/1.54	c INFO: running adaptg2wsat2009++@0 for 97 with 4999 remaining (b = 0.06)
1.23/1.57	c INFO: running gnovelty+2@0 for 97 with 4999 remaining (b = 0.06)
1.32/1.60	c INFO: running FH@0 for 97 with 4999 remaining (b = 0.04)
1.32/1.64	c INFO: running adaptg2wsat2009++@0 for 97 with 4999 remaining (b = 0.04)
71.23/10.37	s SATISFIABLE
71.23/10.37	v -1 2 3 -4 5 -6 7 -8 9 10 11 -12 -13 -14 15 -16 -17 -18 19 20 -21 22 -23 24 25 26 27 28 29 -30 -31 32 -33 -34 -35 -36 -37 38 -39 40 -41 42 43 -44 -45 -46 47 48 49 -50 -51 -52 53 -54 -55 56 57 -58 -59 -60 61 -62 -63 64 65 -66 67 68 69 -70 71 72 73 -74 75 76 77 78 79 -80 -81 -82 -83 84 -85 86 -87 -88 -89 90 -91 -92 93 -94 -95 96 -97 -98 -99 -100 101 102 103 -104 -105 106 107 108 109 110 111 112 -113 114 -115 116 117 -118 -119 120 121 -122 -123 124 -125 -126 127 128 129 -130 -131 -132 133 134 -135 -136 137 -138 139 -140 141 142 143 144 145 -146 -147 148 149 150 151 152 153 154 155 156 -157 -158 159 -160 161 162 -163 164 -165 -166 -167 168 -169 170 171 -172 -173 -174 -175 -176 -177 178 179 180 -181 182 -183 -184 -185 186 -187 -188 -189 -190 191 -192 193 194 -195 -196 197 198 199 200 -201 202 203 -204 205 -206 207 -208 -209 210 211 212 -213 -214 215 216 217 -218 219 220 -221 -222 223 -224 -225 226 227 -228 229 230 231 232 233 -234 235 -236 -237 -238 239 240 -241 242 -243 244 245 -246 -247 248 -249 250 -251 -252 253 -254 -255 256 257 258 259 260 261 262 -263 -264 -265 266 -267 -268 269 -270 -271 -272 -273 -274 -275 276 -277 -278 -279 -280 -281 282 -283 -284 -285 -286 287 288 -289 290 291 292 293 294 -295 296 -297 298 -299 -300 -301 -302 -303 -304 305 306 307 308 -309 -310 311 -312 -313 314 -315 316 317 318 319 320 -321 322 323 324 -325 -326 -327 -328 329 -330 331 332 -333 -334 335 336 -337 338 339 340 341 342 343 344 -345 -346 -347 -348 -349 350 -351 -352 353 354 355 -356 -357 -358 -359 360 361 362 -363 -364 -365 366 367 -368 -369 -370 -371 372 -373 374 -375 -376 377 -378 379 380 381 -382 -383 -384 385 -386 -387 388 -389 -390 -391 392 393 -394 395 -396 -397 398 -399 400 -401 402 403 404 -405 406 -407 -408 409 -410 411 -412 413 -414 415 -416 417 418 419 -420 421 -422 -423 -424 425 426 -427 -428 -429 430 -431 432 -433 434 -435 436 437 -438 439 -440 -441 -442 -443 444 445 446 447 -448 -449 -450 -451 452 -453 454 455 -456 -457 458 459 460 461 462 -463 -464 -465 -466 467 468 -469 -470 -471 472 -473 474 475 -476 -477 -478 479 -480 -481 482 483 -484 -485 486 -487 488 489 490 -491 -492 -493 494 495 496 -497 -498 -499 -500 -501 -502 -503 504 -505 -506 -507 508 -509 510 511 512 -513 514 515 516 -517 -518 519 -520 521 -522 523 524 -525 -526 -527 528 -529 -530 531 -532 -533 534 -535 -536 -537 538 -539 -540 -541 542 -543 544 -545 546 -547 -548 549 550 -551 -552 -553 554 555 -556 557 558 559 560 561 -562 -563 564 -565 566 -567 -568 569 -570 -571 -572 -573 -574 -575 -576 577 578 -579 580 581 582 583 584 -585 -586 587 -588 -589 590 -591 -592 -593 594 595 596 -597 -598 599 -600 601 602 603 604 -605 606 -607 -608 609 -610 -611 612 613 614 -615 616 -617 -618 -619 -620 -621 -622 -623 624 -625 626 627 628 -629 630 -631 632 633 -634 -635 636 637 638 -639 -640 641 -642 -643 -644 -645 -646 647 -648 649 -650 -651 -652 -653 -654 -655 656 -657 -658 659 -660 -661 662 -663 -664 -665 666 -667 668 669 -670 -671 672 673 674 675 676 -677 678 -679 680 681 -682 683 -684 685 686 -687 -688 689 -690 -691 692 693 -694 -695 -696 -697 698 699 700 -701 702 703 704 705 706 707 708 709 710 -711 712 -713 714 -715 716 -717 -718 719 -720 721 -722 723 -724 725 726 727 728 -729 730 731 -732 -733 -734 735 736 737 738 739 -740 -741 -742 743 744 745 746 747 748 -749 -750 0

Verifier Data 

OK

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3385354-1305565666/watcher-3385354-1305565666 -o /tmp/evaluation-result-3385354-1305565666/solver-3385354-1305565666 -C 40000 -W 5100 -M 31000 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3385354-1305565666.cnf -seed 1978747136 -budget 40000 -cores 8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.77 7.54 4.33 2/345 3308
/proc/meminfo: memFree=12943760/32950928 swapFree=54713412/67111528
[pid=3308] ppid=3306 vsize=15184 CPUtime=0 cores=0-7
/proc/3308/stat : 3308 (python) S 3306 3308 3087 0 -1 4202496 712 0 0 0 0 0 0 0 18 0 1 0 668165403 15548416 604 33554432000 4194304 5683644 140734671900688 18446744073709551615 235594864640 0 2147483391 16781312 2 18446744071699215550 0 0 17 2 0 0 0
/proc/3308/statm: 3796 604 319 364 0 283 0

[startup+0.0502669 s]
/proc/loadavg: 8.77 7.54 4.33 2/345 3308
/proc/meminfo: memFree=12943760/32950928 swapFree=54713412/67111528
[pid=3308] ppid=3306 vsize=18884 CPUtime=0.02 cores=0-7
/proc/3308/stat : 3308 (python) S 3306 3308 3087 0 -1 4202496 1288 0 0 0 2 0 0 0 17 0 1 0 668165403 19337216 1141 33554432000 4194304 5683644 140734671900688 18446744073709551615 235589942919 0 2147483391 16781312 2 18446744071699215550 0 0 17 2 0 0 0
/proc/3308/statm: 5243 1141 421 364 0 690 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 18884

[startup+0.100241 s]
/proc/loadavg: 8.77 7.54 4.33 2/345 3308
/proc/meminfo: memFree=12943760/32950928 swapFree=54713412/67111528
[pid=3308] ppid=3306 vsize=87704 CPUtime=0.06 cores=0-7
/proc/3308/stat : 3308 (python) R 3306 3308 3087 0 -1 4202496 2637 0 0 0 4 2 0 0 17 0 1 0 668165403 89808896 2354 33554432000 4194304 5683644 140734671900688 18446744073709551615 235594862437 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/3308/statm: 21926 2354 717 364 0 1622 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 87704

[startup+0.300165 s]
/proc/loadavg: 8.77 7.54 4.33 2/345 3308
/proc/meminfo: memFree=12943760/32950928 swapFree=54713412/67111528
[pid=3308] ppid=3306 vsize=135752 CPUtime=0.18 cores=0-7
/proc/3308/stat : 3308 (python) S 3306 3308 3087 0 -1 4202496 5962 935 1 0 12 6 0 0 18 0 1 0 668165403 139010048 4152 33554432000 4194304 5683644 140734671900688 18446744073709551615 235594862597 0 2147483391 16781312 2 18446744071699215550 0 0 17 2 0 0 0
/proc/3308/statm: 33938 4152 1032 364 0 3124 0
Current children cumulated CPU time (s) 0.18
Current children cumulated vsize (KiB) 135752

[startup+0.701144 s]
/proc/loadavg: 8.77 7.54 4.33 2/345 3308
/proc/meminfo: memFree=12943760/32950928 swapFree=54713412/67111528
[pid=3308] ppid=3306 vsize=279752 CPUtime=0.43 cores=0-7
/proc/3308/stat : 3308 (python) R 3306 3308 3087 0 -1 4202496 9584 935 1 0 31 12 0 0 17 0 1 0 668165403 286466048 7267 33554432000 4194304 5683644 140734671900688 18446744073709551615 4602441 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/3308/statm: 69938 7267 1761 364 0 5862 0
Current children cumulated CPU time (s) 0.43
Current children cumulated vsize (KiB) 279752

[startup+1.50099 s]
/proc/loadavg: 8.77 7.54 4.33 3/346 3313
/proc/meminfo: memFree=12918580/32950928 swapFree=54713412/67111528
[pid=3308] ppid=3306 vsize=311320 CPUtime=1.23 cores=0-7
/proc/3308/stat : 3308 (python) R 3306 3308 3087 0 -1 4202496 13309 935 1 0 109 14 0 0 22 0 4 0 668165403 318791680 7603 33554432000 4194304 5683644 140734671900688 18446744073709551615 235598275253 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/3308/statm: 77830 7603 1880 364 0 13742 0
Current children cumulated CPU time (s) 1.23
Current children cumulated vsize (KiB) 311320

[startup+3.10164 s]
/proc/loadavg: 8.77 7.54 4.33 9/370 3337
/proc/meminfo: memFree=12867424/32950928 swapFree=54713412/67111528
[pid=3308] ppid=3306 vsize=362736 CPUtime=1.37 cores=0-7
/proc/3308/stat : 3308 (python) S 3306 3308 3087 0 -1 4202496 17213 935 1 0 122 15 0 0 25 0 9 0 668165403 371441664 7651 33554432000 4194304 5683644 140734671900688 18446744073709551615 235606693323 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/3308/statm: 90684 7651 1891 364 0 26581 0
[pid=3314] ppid=3308 vsize=280428 CPUtime=0 cores=0-7
/proc/3314/stat : 3314 (python) S 3308 3308 3087 0 -1 4202560 737 0 0 0 0 0 0 0 18 0 1 0 668165545 287158272 6014 33554432000 4194304 5683644 140734671900688 18446744073709551615 235594886671 0 0 16781312 514 18328216724530233604 0 0 17 7 0 0 0
/proc/3314/statm: 70107 6014 354 364 0 6025 0
[pid=3316] ppid=3314 vsize=1018340 CPUtime=1.67 cores=0-7
/proc/3316/stat : 3316 (gnovelty+2) R 3314 3316 3316 0 -1 4202496 679 0 0 0 167 0 0 0 25 0 1 0 668165546 1042780160 415 33554432000 134512640 135663704 4291393168 18446744073709551615 134525286 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/3316/statm: 254585 415 113 282 0 254301 0
[pid=3317] ppid=3308 vsize=290820 CPUtime=0 cores=0-7
/proc/3317/stat : 3317 (python) S 3308 3308 3087 0 -1 4202560 742 0 0 0 0 0 0 0 18 0 1 0 668165548 297799680 6046 33554432000 4194304 5683644 140734671900688 18446744073709551615 235594886726 0 0 16781312 514 18328212876239536386 0 0 17 2 0 0 0
/proc/3317/statm: 72705 6046 348 364 0 8620 0
[pid=3319] ppid=3317 vsize=1018340 CPUtime=1.64 cores=0-7
/proc/3319/stat : 3319 (gnovelty+2) R 3317 3319 3319 0 -1 4202496 678 0 0 0 164 0 0 0 25 0 1 0 668165549 1042780160 415 33554432000 134512640 135663704 4288962496 18446744073709551615 134525286 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/3319/statm: 254585 415 113 282 0 254301 0
[pid=3320] ppid=3308 vsize=301076 CPUtime=0 cores=0-7
/proc/3320/stat : 3320 (python) S 3308 3308 3087 0 -1 4202560 737 0 0 0 0 0 0 0 18 0 1 0 668165551 308301824 6067 33554432000 4194304 5683644 140734671900688 18446744073709551615 235594886726 0 0 16781312 514 4605111492944068607 0 0 17 7 0 0 0
/proc/3320/statm: 75269 6067 348 364 0 11181 0
[pid=3322] ppid=3320 vsize=418504 CPUtime=1.61 cores=0-7
/proc/3322/stat : 3322 (adaptg2wsat2009) R 3320 3322 3322 0 -1 4202496 1184 0 0 0 161 0 0 0 25 0 1 0 668165552 428548096 916 33554432000 134512640 135107411 4290092000 18446744073709551615 134537981 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/3322/statm: 104626 916 59 146 0 103502 0
[pid=3323] ppid=3308 vsize=311332 CPUtime=0 cores=0-7
/proc/3323/stat : 3323 (python) S 3308 3308 3087 0 -1 4202560 745 0 0 0 0 0 0 0 18 0 1 0 668165554 318803968 6071 33554432000 4194304 5683644 140734671900688 18446744073709551615 235594886726 0 0 16781312 514 4219477305833029631 0 0 17 6 0 0 0
/proc/3323/statm: 77833 6071 348 364 0 13742 0
[pid=3325] ppid=3323 vsize=418504 CPUtime=1.56 cores=0-7
/proc/3325/stat : 3325 (adaptg2wsat2009) R 3323 3325 3325 0 -1 4202496 1178 0 0 0 156 0 0 0 25 0 1 0 668165554 428548096 916 33554432000 134512640 135107411 4293246288 18446744073709551615 134531741 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/3325/statm: 104626 916 59 146 0 103502 0
[pid=3326] ppid=3308 vsize=321588 CPUtime=0 cores=0-7
/proc/3326/stat : 3326 (python) S 3308 3308 3087 0 -1 4202560 754 0 0 0 0 0 0 0 18 0 1 0 668165557 329306112 6075 33554432000 4194304 5683644 140734671900688 18446744073709551615 235594886726 0 0 16781312 514 4606852844484558847 0 0 17 0 0 0 0
/proc/3326/statm: 80397 6075 348 364 0 16303 0
[pid=3328] ppid=3326 vsize=418504 CPUtime=1.55 cores=0-7
/proc/3328/stat : 3328 (adaptg2wsat2009) R 3326 3328 3328 0 -1 4202496 1183 0 0 0 155 0 0 0 25 0 1 0 668165558 428548096 916 33554432000 134512640 135107411 4291807376 18446744073709551615 134532224 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/3328/statm: 104626 916 59 146 0 103502 0
[pid=3329] ppid=3308 vsize=331844 CPUtime=0 cores=0-7
/proc/3329/stat : 3329 (python) S 3308 3308 3087 0 -1 4202560 760 0 0 0 0 0 0 0 18 0 1 0 668165560 339808256 6079 33554432000 4194304 5683644 140734671900688 18446744073709551615 235594886726 0 0 16781312 514 7458172918086729987 0 0 17 6 0 0 0
/proc/3329/statm: 82961 6079 348 364 0 18864 0
[pid=3331] ppid=3329 vsize=1018340 CPUtime=1.52 cores=0-7
/proc/3331/stat : 3331 (gnovelty+2) R 3329 3331 3331 0 -1 4202496 678 0 0 0 152 0 0 0 25 0 1 0 668165561 1042780160 414 33554432000 134512640 135663704 4289454768 18446744073709551615 134524548 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/3331/statm: 254585 414 113 282 0 254301 0
[pid=3332] ppid=3308 vsize=342236 CPUtime=0 cores=0-7
/proc/3332/stat : 3332 (python) S 3308 3308 3087 0 -1 4202560 767 0 0 0 0 0 0 0 18 0 1 0 668165564 350449664 6100 33554432000 4194304 5683644 140734671900688 18446744073709551615 235594886726 0 0 16781312 514 302242831508963327 0 0 17 6 0 0 0
/proc/3332/statm: 85559 6100 348 364 0 21459 0
[pid=3334] ppid=3332 vsize=248652 CPUtime=1.48 cores=0-7
/proc/3334/stat : 3334 (FH) R 3332 3334 3334 0 -1 4202496 1127 0 0 0 148 0 0 0 25 0 1 0 668165564 254619648 860 33554432000 134512640 134936988 4288635472 18446744073709551615 134553261 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/3334/statm: 62163 860 41 104 0 61667 0
[pid=3335] ppid=3308 vsize=352492 CPUtime=0 cores=0-7
/proc/3335/stat : 3335 (python) S 3308 3308 3087 0 -1 4202560 804 0 0 0 0 0 0 0 18 0 1 0 668165567 360951808 6110 33554432000 4194304 5683644 140734671900688 18446744073709551615 235594886726 0 0 16781312 514 11380978892706676735 0 0 17 6 0 0 0
/proc/3335/statm: 88123 6110 354 364 0 24020 0
[pid=3337] ppid=3335 vsize=418504 CPUtime=1.42 cores=0-7
/proc/3337/stat : 3337 (adaptg2wsat2009) R 3335 3337 3337 0 -1 4202496 1188 0 0 0 142 0 0 0 25 0 1 0 668165568 428548096 917 33554432000 134512640 135107411 4290498432 18446744073709551615 134531428 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/3337/statm: 104626 917 59 146 0 103502 0
[pid=3308/tid=3315] ppid=3306 vsize=362736 CPUtime=0 cores=0-7
/proc/3308/task/3315/stat : 3315 (python) S 3306 3308 3087 0 -1 4202560 26 935 0 0 0 0 0 0 19 0 9 0 668165545 371441664 7651 33554432000 4194304 5683644 140734671900688 18446744073709551615 235606690225 0 0 16781312 2 18446604453906918208 0 0 -1 6 0 0 0
[pid=3308/tid=3318] ppid=3306 vsize=362736 CPUtime=0 cores=0-7
/proc/3308/task/3318/stat : 3318 (python) S 3306 3308 3087 0 -1 4202560 24 935 0 0 0 0 0 0 21 0 9 0 668165548 371441664 7651 33554432000 4194304 5683644 140734671900688 18446744073709551615 235606690225 0 0 16781312 2 18446604453906918208 0 0 -1 2 0 0 0
[pid=3308/tid=3321] ppid=3306 vsize=362736 CPUtime=0 cores=0-7
/proc/3308/task/3321/stat : 3321 (python) S 3306 3308 3087 0 -1 4202560 22 935 0 0 0 0 0 0 22 0 9 0 668165551 371441664 7651 33554432000 4194304 5683644 140734671900688 18446744073709551615 235606690225 0 0 16781312 2 18446604453906918208 0 0 -1 0 0 0 0
[pid=3308/tid=3324] ppid=3306 vsize=362736 CPUtime=0 cores=0-7
/proc/3308/task/3324/stat : 3324 (python) S 3306 3308 3087 0 -1 4202560 25 935 0 0 0 0 0 0 24 0 9 0 668165554 371441664 7651 33554432000 4194304 5683644 140734671900688 18446744073709551615 235606690225 0 0 16781312 2 18446604453906918208 0 0 -1 4 0 0 0
[pid=3308/tid=3327] ppid=3306 vsize=362736 CPUtime=0 cores=0-7
/proc/3308/task/3327/stat : 3327 (python) S 3306 3308 3087 0 -1 4202560 25 935 0 0 0 0 0 0 20 0 9 0 668165557 371441664 7651 33554432000 4194304 5683644 140734671900688 18446744073709551615 235606690225 0 0 16781312 2 18446604453906918208 0 0 -1 0 0 0 0
[pid=3308/tid=3330] ppid=3306 vsize=362736 CPUtime=0 cores=0-7
/proc/3308/task/3330/stat : 3330 (python) S 3306 3308 3087 0 -1 4202560 25 935 0 0 0 0 0 0 22 0 9 0 668165561 371441664 7651 33554432000 4194304 5683644 140734671900688 18446744073709551615 235606690225 0 0 16781312 2 18446604453906918208 0 0 -1 0 0 0 0
[pid=3308/tid=3333] ppid=3306 vsize=362736 CPUtime=0 cores=0-7
/proc/3308/task/3333/stat : 3333 (python) S 3306 3308 3087 0 -1 4202560 26 935 0 0 0 0 0 0 24 0 9 0 668165564 371441664 7651 33554432000 4194304 5683644 140734671900688 18446744073709551615 235606690225 0 0 16781312 2 18446604453906918208 0 0 -1 6 0 0 0
[pid=3308/tid=3336] ppid=3306 vsize=362736 CPUtime=0 cores=0-7
/proc/3308/task/3336/stat : 3336 (python) S 3306 3308 3087 0 -1 4202560 28 935 0 0 0 0 0 0 25 0 9 0 668165568 371441664 7651 33554432000 4194304 5683644 140734671900688 18446744073709551615 235606690225 0 0 16781312 2 18446604453906918208 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 13.82
Current children cumulated vsize (KiB) 7872240

[startup+6.30108 s]
/proc/loadavg: 8.79 7.56 4.36 9/370 3337
/proc/meminfo: memFree=12867424/32950928 swapFree=54713412/67111528
[pid=3308] ppid=3306 vsize=362736 CPUtime=1.37 cores=0-7
/proc/3308/stat : 3308 (python) S 3306 3308 3087 0 -1 4202496 17213 935 1 0 122 15 0 0 25 0 9 0 668165403 371441664 7651 33554432000 4194304 5683644 140734671900688 18446744073709551615 235606693323 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/3308/statm: 90684 7651 1891 364 0 26581 0
[pid=3314] ppid=3308 vsize=280428 CPUtime=0.01 cores=0-7
/proc/3314/stat : 3314 (python) S 3308 3308 3087 0 -1 4202560 901 0 0 0 0 1 0 0 18 0 1 0 668165545 287158272 6037 33554432000 4194304 5683644 140734671900688 18446744073709551615 235594886671 0 0 16781312 514 18328216724530233604 0 0 17 7 0 0 0
/proc/3314/statm: 70107 6037 377 364 0 6025 0
[pid=3316] ppid=3314 vsize=1018340 CPUtime=4.87 cores=0-7
/proc/3316/stat : 3316 (gnovelty+2) R 3314 3316 3316 0 -1 4202496 679 0 0 0 487 0 0 0 25 0 1 0 668165546 1042780160 415 33554432000 134512640 135663704 4291393168 18446744073709551615 134545699 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/3316/statm: 254585 415 113 282 0 254301 0
[pid=3317] ppid=3308 vsize=290820 CPUtime=0 cores=0-7
/proc/3317/stat : 3317 (python) S 3308 3308 3087 0 -1 4202560 899 0 0 0 0 0 0 0 18 0 1 0 668165548 297799680 6069 33554432000 4194304 5683644 140734671900688 18446744073709551615 235594886726 0 0 16781312 514 18328212876239536386 0 0 17 2 0 0 0
/proc/3317/statm: 72705 6069 371 364 0 8620 0
[pid=3319] ppid=3317 vsize=1018340 CPUtime=4.82 cores=0-7
/proc/3319/stat : 3319 (gnovelty+2) R 3317 3319 3319 0 -1 4202496 678 0 0 0 482 0 0 0 25 0 1 0 668165549 1042780160 415 33554432000 134512640 135663704 4288962496 18446744073709551615 134524548 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/3319/statm: 254585 415 113 282 0 254301 0
[pid=3320] ppid=3308 vsize=301076 CPUtime=0.01 cores=0-7
/proc/3320/stat : 3320 (python) S 3308 3308 3087 0 -1 4202560 886 0 0 0 0 1 0 0 18 0 1 0 668165551 308301824 6089 33554432000 4194304 5683644 140734671900688 18446744073709551615 235594886726 0 0 16781312 514 4605111492944036100 0 0 17 7 0 0 0
/proc/3320/statm: 75269 6089 370 364 0 11181 0
[pid=3322] ppid=3320 vsize=418504 CPUtime=4.81 cores=0-7
/proc/3322/stat : 3322 (adaptg2wsat2009) R 3320 3322 3322 0 -1 4202496 1184 0 0 0 481 0 0 0 25 0 1 0 668165552 428548096 916 33554432000 134512640 135107411 4290092000 18446744073709551615 134532349 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/3322/statm: 104626 916 59 146 0 103502 0
[pid=3323] ppid=3308 vsize=311332 CPUtime=0 cores=0-7
/proc/3323/stat : 3323 (python) S 3308 3308 3087 0 -1 4202560 922 0 0 0 0 0 0 0 18 0 1 0 668165554 318803968 6094 33554432000 4194304 5683644 140734671900688 18446744073709551615 235594886726 0 0 16781312 514 4219477305832997121 0 0 17 6 0 0 0
/proc/3323/statm: 77833 6094 371 364 0 13742 0
[pid=3325] ppid=3323 vsize=418504 CPUtime=4.69 cores=0-7
/proc/3325/stat : 3325 (adaptg2wsat2009) R 3323 3325 3325 0 -1 4202496 1178 0 0 0 469 0 0 0 25 0 1 0 668165554 428548096 916 33554432000 134512640 135107411 4293246288 18446744073709551615 134531600 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/3325/statm: 104626 916 59 146 0 103502 0
[pid=3326] ppid=3308 vsize=321588 CPUtime=0.01 cores=0-7
/proc/3326/stat : 3326 (python) S 3308 3308 3087 0 -1 4202560 938 0 0 0 0 1 0 0 18 0 1 0 668165557 329306112 6097 33554432000 4194304 5683644 140734671900688 18446744073709551615 235594886726 0 0 16781312 514 4606852844484526339 0 0 17 0 0 0 0
/proc/3326/statm: 80397 6097 370 364 0 16303 0
[pid=3328] ppid=3326 vsize=418504 CPUtime=4.75 cores=0-7
/proc/3328/stat : 3328 (adaptg2wsat2009) R 3326 3328 3328 0 -1 4202496 1183 0 0 0 475 0 0 0 25 0 1 0 668165558 428548096 916 33554432000 134512640 135107411 4291807376 18446744073709551615 134531561 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/3328/statm: 104626 916 59 146 0 103502 0
[pid=3329] ppid=3308 vsize=331844 CPUtime=0.01 cores=0-7
/proc/3329/stat : 3329 (python) S 3308 3308 3087 0 -1 4202560 942 0 0 0 0 1 0 0 18 0 1 0 668165560 339808256 6102 33554432000 4194304 5683644 140734671900688 18446744073709551615 235594886726 0 0 16781312 514 7458172918086729987 0 0 17 6 0 0 0
/proc/3329/statm: 82961 6102 371 364 0 18864 0
[pid=3331] ppid=3329 vsize=1018340 CPUtime=4.72 cores=0-7
/proc/3331/stat : 3331 (gnovelty+2) R 3329 3331 3331 0 -1 4202496 678 0 0 0 472 0 0 0 25 0 1 0 668165561 1042780160 414 33554432000 134512640 135663704 4289454768 18446744073709551615 134524916 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/3331/statm: 254585 414 113 282 0 254301 0
[pid=3332] ppid=3308 vsize=342236 CPUtime=0 cores=0-7
/proc/3332/stat : 3332 (python) S 3308 3308 3087 0 -1 4202560 956 0 0 0 0 0 0 0 18 0 1 0 668165564 350449664 6123 33554432000 4194304 5683644 140734671900688 18446744073709551615 235594886726 0 0 16781312 514 302242831508930817 0 0 17 6 0 0 0
/proc/3332/statm: 85559 6123 371 364 0 21459 0
[pid=3334] ppid=3332 vsize=248652 CPUtime=4.66 cores=0-7
/proc/3334/stat : 3334 (FH) R 3332 3334 3334 0 -1 4202496 1127 0 0 0 466 0 0 0 25 0 1 0 668165564 254619648 860 33554432000 134512640 134936988 4288635472 18446744073709551615 134553536 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/3334/statm: 62163 860 41 104 0 61667 0
[pid=3335] ppid=3308 vsize=352492 CPUtime=0 cores=0-7
/proc/3335/stat : 3335 (python) S 3308 3308 3087 0 -1 4202560 1000 0 0 0 0 0 0 0 18 0 1 0 668165567 360951808 6133 33554432000 4194304 5683644 140734671900688 18446744073709551615 235594886726 0 0 16781312 514 11380978892706644227 0 0 17 6 0 0 0
/proc/3335/statm: 88123 6133 377 364 0 24020 0
[pid=3337] ppid=3335 vsize=418504 CPUtime=4.55 cores=0-7
/proc/3337/stat : 3337 (adaptg2wsat2009) R 3335 3337 3337 0 -1 4202496 1188 0 0 0 455 0 0 0 25 0 1 0 668165568 428548096 917 33554432000 134512640 135107411 4290498432 18446744073709551615 134532313 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/3337/statm: 104626 917 59 146 0 103502 0

################
# More data... #
################

[pid=3335] ppid=3308 vsize=352492 CPUtime=0 cores=0-7
/proc/3335/stat : 3335 (python) S 3308 3308 3087 0 -1 4202560 1000 0 0 0 0 0 0 0 18 0 1 0 668165567 360951808 6133 33554432000 4194304 5683644 140734671900688 18446744073709551615 235594886726 0 0 16781312 514 11380978892706644227 0 0 17 6 0 0 0
/proc/3335/statm: 88123 6133 377 364 0 24020 0
[pid=3337] ppid=3335 vsize=418504 CPUtime=7.75 cores=0-7
/proc/3337/stat : 3337 (adaptg2wsat2009) R 3335 3337 3337 0 -1 4202496 1188 0 0 0 775 0 0 0 25 0 1 0 668165568 428548096 917 33554432000 134512640 135107411 4290498432 18446744073709551615 134531435 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/3337/statm: 104626 917 59 146 0 103502 0
[pid=3308/tid=3315] ppid=3306 vsize=362736 CPUtime=0 cores=0-7
/proc/3308/task/3315/stat : 3315 (python) S 3306 3308 3087 0 -1 4202560 26 935 0 0 0 0 0 0 19 0 9 0 668165545 371441664 7651 33554432000 4194304 5683644 140734671900688 18446744073709551615 235606690225 0 0 16781312 2 18446604453906918208 0 0 -1 6 0 0 0
[pid=3308/tid=3318] ppid=3306 vsize=362736 CPUtime=0 cores=0-7
/proc/3308/task/3318/stat : 3318 (python) S 3306 3308 3087 0 -1 4202560 24 935 0 0 0 0 0 0 21 0 9 0 668165548 371441664 7651 33554432000 4194304 5683644 140734671900688 18446744073709551615 235606690225 0 0 16781312 2 18446604453906918208 0 0 -1 2 0 0 0
[pid=3308/tid=3321] ppid=3306 vsize=362736 CPUtime=0 cores=0-7
/proc/3308/task/3321/stat : 3321 (python) S 3306 3308 3087 0 -1 4202560 22 935 0 0 0 0 0 0 22 0 9 0 668165551 371441664 7651 33554432000 4194304 5683644 140734671900688 18446744073709551615 235606690225 0 0 16781312 2 18446604453906918208 0 0 -1 0 0 0 0
[pid=3308/tid=3324] ppid=3306 vsize=362736 CPUtime=0 cores=0-7
/proc/3308/task/3324/stat : 3324 (python) S 3306 3308 3087 0 -1 4202560 25 935 0 0 0 0 0 0 24 0 9 0 668165554 371441664 7651 33554432000 4194304 5683644 140734671900688 18446744073709551615 235606690225 0 0 16781312 2 18446604453906918208 0 0 -1 4 0 0 0
[pid=3308/tid=3327] ppid=3306 vsize=362736 CPUtime=0 cores=0-7
/proc/3308/task/3327/stat : 3327 (python) S 3306 3308 3087 0 -1 4202560 25 935 0 0 0 0 0 0 20 0 9 0 668165557 371441664 7651 33554432000 4194304 5683644 140734671900688 18446744073709551615 235606690225 0 0 16781312 2 18446604453906918208 0 0 -1 0 0 0 0
[pid=3308/tid=3330] ppid=3306 vsize=362736 CPUtime=0 cores=0-7
/proc/3308/task/3330/stat : 3330 (python) S 3306 3308 3087 0 -1 4202560 25 935 0 0 0 0 0 0 22 0 9 0 668165561 371441664 7651 33554432000 4194304 5683644 140734671900688 18446744073709551615 235606690225 0 0 16781312 2 18446604453906918208 0 0 -1 0 0 0 0
[pid=3308/tid=3333] ppid=3306 vsize=362736 CPUtime=0 cores=0-7
/proc/3308/task/3333/stat : 3333 (python) S 3306 3308 3087 0 -1 4202560 26 935 0 0 0 0 0 0 24 0 9 0 668165564 371441664 7651 33554432000 4194304 5683644 140734671900688 18446744073709551615 235606690225 0 0 16781312 2 18446604453906918208 0 0 -1 6 0 0 0
[pid=3308/tid=3336] ppid=3306 vsize=362736 CPUtime=0 cores=0-7
/proc/3308/task/3336/stat : 3336 (python) S 3306 3308 3087 0 -1 4202560 28 935 0 0 0 0 0 0 25 0 9 0 668165568 371441664 7651 33554432000 4194304 5683644 140734671900688 18446744073709551615 235606690225 0 0 16781312 2 18446604453906918208 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 64.84
Current children cumulated vsize (KiB) 7872240

[startup+9.91344 s]
/proc/loadavg: 8.73 7.57 4.37 9/370 3337
/proc/meminfo: memFree=12866812/32950928 swapFree=54713412/67111528
[pid=3308] ppid=3306 vsize=362736 CPUtime=1.37 cores=0-7
/proc/3308/stat : 3308 (python) S 3306 3308 3087 0 -1 4202496 17213 935 1 0 122 15 0 0 25 0 9 0 668165403 371441664 7651 33554432000 4194304 5683644 140734671900688 18446744073709551615 235606693323 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/3308/statm: 90684 7651 1891 364 0 26581 0
[pid=3314] ppid=3308 vsize=280428 CPUtime=0.01 cores=0-7
/proc/3314/stat : 3314 (python) S 3308 3308 3087 0 -1 4202560 901 0 0 0 0 1 0 0 18 0 1 0 668165545 287158272 6037 33554432000 4194304 5683644 140734671900688 18446744073709551615 235594886671 0 0 16781312 514 18328216724530233604 0 0 17 7 0 0 0
/proc/3314/statm: 70107 6037 377 364 0 6025 0
[pid=3316] ppid=3314 vsize=1018340 CPUtime=8.48 cores=0-7
/proc/3316/stat : 3316 (gnovelty+2) R 3314 3316 3316 0 -1 4202496 679 0 0 0 848 0 0 0 25 0 1 0 668165546 1042780160 415 33554432000 134512640 135663704 4291393168 18446744073709551615 134525255 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/3316/statm: 254585 415 113 282 0 254301 0
[pid=3317] ppid=3308 vsize=290820 CPUtime=0 cores=0-7
/proc/3317/stat : 3317 (python) S 3308 3308 3087 0 -1 4202560 899 0 0 0 0 0 0 0 18 0 1 0 668165548 297799680 6069 33554432000 4194304 5683644 140734671900688 18446744073709551615 235594886726 0 0 16781312 514 18328212876239536386 0 0 17 2 0 0 0
/proc/3317/statm: 72705 6069 371 364 0 8620 0
[pid=3319] ppid=3317 vsize=1018340 CPUtime=8.43 cores=0-7
/proc/3319/stat : 3319 (gnovelty+2) R 3317 3319 3319 0 -1 4202496 678 0 0 0 843 0 0 0 25 0 1 0 668165549 1042780160 415 33554432000 134512640 135663704 4288962496 18446744073709551615 134524882 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/3319/statm: 254585 415 113 282 0 254301 0
[pid=3320] ppid=3308 vsize=301076 CPUtime=0.01 cores=0-7
/proc/3320/stat : 3320 (python) S 3308 3308 3087 0 -1 4202560 886 0 0 0 0 1 0 0 18 0 1 0 668165551 308301824 6089 33554432000 4194304 5683644 140734671900688 18446744073709551615 235594886726 0 0 16781312 514 4605111492944036100 0 0 17 7 0 0 0
/proc/3320/statm: 75269 6089 370 364 0 11181 0
[pid=3322] ppid=3320 vsize=418504 CPUtime=8.42 cores=0-7
/proc/3322/stat : 3322 (adaptg2wsat2009) R 3320 3322 3322 0 -1 4202496 1184 0 0 0 842 0 0 0 25 0 1 0 668165552 428548096 916 33554432000 134512640 135107411 4290092000 18446744073709551615 134531428 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/3322/statm: 104626 916 59 146 0 103502 0
[pid=3323] ppid=3308 vsize=311332 CPUtime=0 cores=0-7
/proc/3323/stat : 3323 (python) S 3308 3308 3087 0 -1 4202560 922 0 0 0 0 0 0 0 18 0 1 0 668165554 318803968 6094 33554432000 4194304 5683644 140734671900688 18446744073709551615 235594886726 0 0 16781312 514 4219477305832997121 0 0 17 6 0 0 0
/proc/3323/statm: 77833 6094 371 364 0 13742 0
[pid=3325] ppid=3323 vsize=418504 CPUtime=8.25 cores=0-7
/proc/3325/stat : 3325 (adaptg2wsat2009) R 3323 3325 3325 0 -1 4202496 1178 0 0 0 825 0 0 0 25 0 1 0 668165554 428548096 916 33554432000 134512640 135107411 4293246288 18446744073709551615 134532264 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/3325/statm: 104626 916 59 146 0 103502 0
[pid=3326] ppid=3308 vsize=321588 CPUtime=0.01 cores=0-7
/proc/3326/stat : 3326 (python) S 3308 3308 3087 0 -1 4202560 938 0 0 0 0 1 0 0 18 0 1 0 668165557 329306112 6097 33554432000 4194304 5683644 140734671900688 18446744073709551615 235594886726 0 0 16781312 514 4606852844484526339 0 0 17 0 0 0 0
/proc/3326/statm: 80397 6097 370 364 0 16303 0
[pid=3328] ppid=3326 vsize=418504 CPUtime=8.36 cores=0-7
/proc/3328/stat : 3328 (adaptg2wsat2009) R 3326 3328 3328 0 -1 4202496 1183 0 0 0 836 0 0 0 25 0 1 0 668165558 428548096 916 33554432000 134512640 135107411 4291807376 18446744073709551615 134531709 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/3328/statm: 104626 916 59 146 0 103502 0
[pid=3329] ppid=3308 vsize=331844 CPUtime=0.01 cores=0-7
/proc/3329/stat : 3329 (python) S 3308 3308 3087 0 -1 4202560 942 0 0 0 0 1 0 0 18 0 1 0 668165560 339808256 6102 33554432000 4194304 5683644 140734671900688 18446744073709551615 235594886726 0 0 16781312 514 7458172918086729987 0 0 17 6 0 0 0
/proc/3329/statm: 82961 6102 371 364 0 18864 0
[pid=3331] ppid=3329 vsize=1018340 CPUtime=8.33 cores=0-7
/proc/3331/stat : 3331 (gnovelty+2) R 3329 3331 3331 0 -1 4202496 678 0 0 0 833 0 0 0 25 0 1 0 668165561 1042780160 414 33554432000 134512640 135663704 4289454768 18446744073709551615 134524888 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/3331/statm: 254585 414 113 282 0 254301 0
[pid=3332] ppid=3308 vsize=342236 CPUtime=0 cores=0-7
/proc/3332/stat : 3332 (python) S 3308 3308 3087 0 -1 4202560 956 0 0 0 0 0 0 0 18 0 1 0 668165564 350449664 6123 33554432000 4194304 5683644 140734671900688 18446744073709551615 235594886726 0 0 16781312 514 302242831508930817 0 0 17 6 0 0 0
/proc/3332/statm: 85559 6123 371 364 0 21459 0
[pid=3334] ppid=3332 vsize=248652 CPUtime=8.27 cores=0-7
/proc/3334/stat : 3334 (FH) R 3332 3334 3334 0 -1 4202496 1127 0 0 0 827 0 0 0 25 0 1 0 668165564 254619648 860 33554432000 134512640 134936988 4288635472 18446744073709551615 134555012 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/3334/statm: 62163 860 41 104 0 61667 0
[pid=3335] ppid=3308 vsize=352492 CPUtime=0 cores=0-7
/proc/3335/stat : 3335 (python) S 3308 3308 3087 0 -1 4202560 1000 0 0 0 0 0 0 0 18 0 1 0 668165567 360951808 6133 33554432000 4194304 5683644 140734671900688 18446744073709551615 235594886726 0 0 16781312 514 11380978892706644227 0 0 17 6 0 0 0
/proc/3335/statm: 88123 6133 377 364 0 24020 0
[pid=3337] ppid=3335 vsize=418504 CPUtime=8.16 cores=0-7
/proc/3337/stat : 3337 (adaptg2wsat2009) R 3335 3337 3337 0 -1 4202496 1188 0 0 0 816 0 0 0 25 0 1 0 668165568 428548096 917 33554432000 134512640 135107411 4290498432 18446744073709551615 134531810 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/3337/statm: 104626 917 59 146 0 103502 0
[pid=3308/tid=3315] ppid=3306 vsize=362736 CPUtime=0 cores=0-7
/proc/3308/task/3315/stat : 3315 (python) S 3306 3308 3087 0 -1 4202560 26 935 0 0 0 0 0 0 19 0 9 0 668165545 371441664 7651 33554432000 4194304 5683644 140734671900688 18446744073709551615 235606690225 0 0 16781312 2 18446604453906918208 0 0 -1 6 0 0 0
[pid=3308/tid=3318] ppid=3306 vsize=362736 CPUtime=0 cores=0-7
/proc/3308/task/3318/stat : 3318 (python) S 3306 3308 3087 0 -1 4202560 24 935 0 0 0 0 0 0 21 0 9 0 668165548 371441664 7651 33554432000 4194304 5683644 140734671900688 18446744073709551615 235606690225 0 0 16781312 2 18446604453906918208 0 0 -1 2 0 0 0
[pid=3308/tid=3321] ppid=3306 vsize=362736 CPUtime=0 cores=0-7
/proc/3308/task/3321/stat : 3321 (python) S 3306 3308 3087 0 -1 4202560 22 935 0 0 0 0 0 0 22 0 9 0 668165551 371441664 7651 33554432000 4194304 5683644 140734671900688 18446744073709551615 235606690225 0 0 16781312 2 18446604453906918208 0 0 -1 0 0 0 0
[pid=3308/tid=3324] ppid=3306 vsize=362736 CPUtime=0 cores=0-7
/proc/3308/task/3324/stat : 3324 (python) S 3306 3308 3087 0 -1 4202560 25 935 0 0 0 0 0 0 24 0 9 0 668165554 371441664 7651 33554432000 4194304 5683644 140734671900688 18446744073709551615 235606690225 0 0 16781312 2 18446604453906918208 0 0 -1 4 0 0 0
[pid=3308/tid=3327] ppid=3306 vsize=362736 CPUtime=0 cores=0-7
/proc/3308/task/3327/stat : 3327 (python) S 3306 3308 3087 0 -1 4202560 25 935 0 0 0 0 0 0 20 0 9 0 668165557 371441664 7651 33554432000 4194304 5683644 140734671900688 18446744073709551615 235606690225 0 0 16781312 2 18446604453906918208 0 0 -1 0 0 0 0
[pid=3308/tid=3330] ppid=3306 vsize=362736 CPUtime=0 cores=0-7
/proc/3308/task/3330/stat : 3330 (python) S 3306 3308 3087 0 -1 4202560 25 935 0 0 0 0 0 0 22 0 9 0 668165561 371441664 7651 33554432000 4194304 5683644 140734671900688 18446744073709551615 235606690225 0 0 16781312 2 18446604453906918208 0 0 -1 0 0 0 0
[pid=3308/tid=3333] ppid=3306 vsize=362736 CPUtime=0 cores=0-7
/proc/3308/task/3333/stat : 3333 (python) S 3306 3308 3087 0 -1 4202560 26 935 0 0 0 0 0 0 24 0 9 0 668165564 371441664 7651 33554432000 4194304 5683644 140734671900688 18446744073709551615 235606690225 0 0 16781312 2 18446604453906918208 0 0 -1 6 0 0 0
[pid=3308/tid=3336] ppid=3306 vsize=362736 CPUtime=0 cores=0-7
/proc/3308/task/3336/stat : 3336 (python) S 3306 3308 3087 0 -1 4202560 28 935 0 0 0 0 0 0 25 0 9 0 668165568 371441664 7651 33554432000 4194304 5683644 140734671900688 18446744073709551615 235606690225 0 0 16781312 2 18446604453906918208 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 68.11
Current children cumulated vsize (KiB) 7872240

[startup+10.3014 s]
/proc/loadavg: 8.73 7.57 4.37 9/370 3337
/proc/meminfo: memFree=12866812/32950928 swapFree=54713412/67111528
[pid=3308] ppid=3306 vsize=362736 CPUtime=1.37 cores=0-7
/proc/3308/stat : 3308 (python) S 3306 3308 3087 0 -1 4202496 17213 935 1 0 122 15 0 0 25 0 9 0 668165403 371441664 7651 33554432000 4194304 5683644 140734671900688 18446744073709551615 235606693323 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/3308/statm: 90684 7651 1891 364 0 26581 0
[pid=3314] ppid=3308 vsize=280428 CPUtime=0.01 cores=0-7
/proc/3314/stat : 3314 (python) S 3308 3308 3087 0 -1 4202560 901 0 0 0 0 1 0 0 18 0 1 0 668165545 287158272 6037 33554432000 4194304 5683644 140734671900688 18446744073709551615 235594886671 0 0 16781312 514 18328216724530233604 0 0 17 7 0 0 0
/proc/3314/statm: 70107 6037 377 364 0 6025 0
[pid=3316] ppid=3314 vsize=1018340 CPUtime=8.87 cores=0-7
/proc/3316/stat : 3316 (gnovelty+2) R 3314 3316 3316 0 -1 4202496 679 0 0 0 887 0 0 0 25 0 1 0 668165546 1042780160 415 33554432000 134512640 135663704 4291393168 18446744073709551615 134524548 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/3316/statm: 254585 415 113 282 0 254301 0
[pid=3317] ppid=3308 vsize=290820 CPUtime=0 cores=0-7
/proc/3317/stat : 3317 (python) S 3308 3308 3087 0 -1 4202560 899 0 0 0 0 0 0 0 18 0 1 0 668165548 297799680 6069 33554432000 4194304 5683644 140734671900688 18446744073709551615 235594886726 0 0 16781312 514 18328212876239536386 0 0 17 2 0 0 0
/proc/3317/statm: 72705 6069 371 364 0 8620 0
[pid=3319] ppid=3317 vsize=1018340 CPUtime=8.82 cores=0-7
/proc/3319/stat : 3319 (gnovelty+2) R 3317 3319 3319 0 -1 4202496 678 0 0 0 882 0 0 0 25 0 1 0 668165549 1042780160 415 33554432000 134512640 135663704 4288962496 18446744073709551615 134525260 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/3319/statm: 254585 415 113 282 0 254301 0
[pid=3320] ppid=3308 vsize=301076 CPUtime=0.01 cores=0-7
/proc/3320/stat : 3320 (python) S 3308 3308 3087 0 -1 4202560 886 0 0 0 0 1 0 0 18 0 1 0 668165551 308301824 6089 33554432000 4194304 5683644 140734671900688 18446744073709551615 235594886726 0 0 16781312 514 4605111492944036100 0 0 17 7 0 0 0
/proc/3320/statm: 75269 6089 370 364 0 11181 0
[pid=3322] ppid=3320 vsize=418504 CPUtime=8.81 cores=0-7
/proc/3322/stat : 3322 (adaptg2wsat2009) R 3320 3322 3322 0 -1 4202496 1184 0 0 0 881 0 0 0 25 0 1 0 668165552 428548096 916 33554432000 134512640 135107411 4290092000 18446744073709551615 134531561 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/3322/statm: 104626 916 59 146 0 103502 0
[pid=3323] ppid=3308 vsize=311332 CPUtime=0 cores=0-7
/proc/3323/stat : 3323 (python) S 3308 3308 3087 0 -1 4202560 922 0 0 0 0 0 0 0 18 0 1 0 668165554 318803968 6094 33554432000 4194304 5683644 140734671900688 18446744073709551615 235594886726 0 0 16781312 514 4219477305832997121 0 0 17 6 0 0 0
/proc/3323/statm: 77833 6094 371 364 0 13742 0
[pid=3325] ppid=3323 vsize=418504 CPUtime=8.64 cores=0-7
/proc/3325/stat : 3325 (adaptg2wsat2009) R 3323 3325 3325 0 -1 4202496 1178 0 0 0 864 0 0 0 25 0 1 0 668165554 428548096 916 33554432000 134512640 135107411 4293246288 18446744073709551615 134531600 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/3325/statm: 104626 916 59 146 0 103502 0
[pid=3326] ppid=3308 vsize=321588 CPUtime=0.01 cores=0-7
/proc/3326/stat : 3326 (python) S 3308 3308 3087 0 -1 4202560 938 0 0 0 0 1 0 0 18 0 1 0 668165557 329306112 6097 33554432000 4194304 5683644 140734671900688 18446744073709551615 235594886726 0 0 16781312 514 4606852844484526339 0 0 17 0 0 0 0
/proc/3326/statm: 80397 6097 370 364 0 16303 0
[pid=3328] ppid=3326 vsize=418504 CPUtime=8.75 cores=0-7
/proc/3328/stat : 3328 (adaptg2wsat2009) R 3326 3328 3328 0 -1 4202496 1183 0 0 0 875 0 0 0 25 0 1 0 668165558 428548096 916 33554432000 134512640 135107411 4291807376 18446744073709551615 134531561 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/3328/statm: 104626 916 59 146 0 103502 0
[pid=3329] ppid=3308 vsize=331844 CPUtime=0.01 cores=0-7
/proc/3329/stat : 3329 (python) S 3308 3308 3087 0 -1 4202560 942 0 0 0 0 1 0 0 18 0 1 0 668165560 339808256 6102 33554432000 4194304 5683644 140734671900688 18446744073709551615 235594886726 0 0 16781312 514 7458172918086729987 0 0 17 6 0 0 0
/proc/3329/statm: 82961 6102 371 364 0 18864 0
[pid=3331] ppid=3329 vsize=1018340 CPUtime=8.72 cores=0-7
/proc/3331/stat : 3331 (gnovelty+2) R 3329 3331 3331 0 -1 4202496 678 0 0 0 872 0 0 0 25 0 1 0 668165561 1042780160 414 33554432000 134512640 135663704 4289454768 18446744073709551615 134524897 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/3331/statm: 254585 414 113 282 0 254301 0
[pid=3332] ppid=3308 vsize=342236 CPUtime=0 cores=0-7
/proc/3332/stat : 3332 (python) S 3308 3308 3087 0 -1 4202560 956 0 0 0 0 0 0 0 18 0 1 0 668165564 350449664 6123 33554432000 4194304 5683644 140734671900688 18446744073709551615 235594886726 0 0 16781312 514 302242831508930817 0 0 17 6 0 0 0
/proc/3332/statm: 85559 6123 371 364 0 21459 0
[pid=3334] ppid=3332 vsize=248652 CPUtime=8.66 cores=0-7
/proc/3334/stat : 3334 (FH) R 3332 3334 3334 0 -1 4202496 1127 0 0 0 866 0 0 0 25 0 1 0 668165564 254619648 860 33554432000 134512640 134936988 4288635472 18446744073709551615 134544965 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/3334/statm: 62163 860 41 104 0 61667 0
[pid=3335] ppid=3308 vsize=352492 CPUtime=0 cores=0-7
/proc/3335/stat : 3335 (python) S 3308 3308 3087 0 -1 4202560 1000 0 0 0 0 0 0 0 18 0 1 0 668165567 360951808 6133 33554432000 4194304 5683644 140734671900688 18446744073709551615 235594886726 0 0 16781312 514 11380978892706644227 0 0 17 6 0 0 0
/proc/3335/statm: 88123 6133 377 364 0 24020 0
[pid=3337] ppid=3335 vsize=418504 CPUtime=8.55 cores=0-7
/proc/3337/stat : 3337 (adaptg2wsat2009) R 3335 3337 3337 0 -1 4202496 1188 0 0 0 855 0 0 0 25 0 1 0 668165568 428548096 917 33554432000 134512640 135107411 4290498432 18446744073709551615 134531613 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/3337/statm: 104626 917 59 146 0 103502 0
[pid=3308/tid=3315] ppid=3306 vsize=362736 CPUtime=0 cores=0-7
/proc/3308/task/3315/stat : 3315 (python) S 3306 3308 3087 0 -1 4202560 26 935 0 0 0 0 0 0 19 0 9 0 668165545 371441664 7651 33554432000 4194304 5683644 140734671900688 18446744073709551615 235606690225 0 0 16781312 2 18446604453906918208 0 0 -1 6 0 0 0
[pid=3308/tid=3318] ppid=3306 vsize=362736 CPUtime=0 cores=0-7
/proc/3308/task/3318/stat : 3318 (python) S 3306 3308 3087 0 -1 4202560 24 935 0 0 0 0 0 0 21 0 9 0 668165548 371441664 7651 33554432000 4194304 5683644 140734671900688 18446744073709551615 235606690225 0 0 16781312 2 18446604453906918208 0 0 -1 2 0 0 0
[pid=3308/tid=3321] ppid=3306 vsize=362736 CPUtime=0 cores=0-7
/proc/3308/task/3321/stat : 3321 (python) S 3306 3308 3087 0 -1 4202560 22 935 0 0 0 0 0 0 22 0 9 0 668165551 371441664 7651 33554432000 4194304 5683644 140734671900688 18446744073709551615 235606690225 0 0 16781312 2 18446604453906918208 0 0 -1 0 0 0 0
[pid=3308/tid=3324] ppid=3306 vsize=362736 CPUtime=0 cores=0-7
/proc/3308/task/3324/stat : 3324 (python) S 3306 3308 3087 0 -1 4202560 25 935 0 0 0 0 0 0 24 0 9 0 668165554 371441664 7651 33554432000 4194304 5683644 140734671900688 18446744073709551615 235606690225 0 0 16781312 2 18446604453906918208 0 0 -1 4 0 0 0
[pid=3308/tid=3327] ppid=3306 vsize=362736 CPUtime=0 cores=0-7
/proc/3308/task/3327/stat : 3327 (python) S 3306 3308 3087 0 -1 4202560 25 935 0 0 0 0 0 0 20 0 9 0 668165557 371441664 7651 33554432000 4194304 5683644 140734671900688 18446744073709551615 235606690225 0 0 16781312 2 18446604453906918208 0 0 -1 0 0 0 0
[pid=3308/tid=3330] ppid=3306 vsize=362736 CPUtime=0 cores=0-7
/proc/3308/task/3330/stat : 3330 (python) S 3306 3308 3087 0 -1 4202560 25 935 0 0 0 0 0 0 22 0 9 0 668165561 371441664 7651 33554432000 4194304 5683644 140734671900688 18446744073709551615 235606690225 0 0 16781312 2 18446604453906918208 0 0 -1 0 0 0 0
[pid=3308/tid=3333] ppid=3306 vsize=362736 CPUtime=0 cores=0-7
/proc/3308/task/3333/stat : 3333 (python) S 3306 3308 3087 0 -1 4202560 26 935 0 0 0 0 0 0 24 0 9 0 668165564 371441664 7651 33554432000 4194304 5683644 140734671900688 18446744073709551615 235606690225 0 0 16781312 2 18446604453906918208 0 0 -1 6 0 0 0
[pid=3308/tid=3336] ppid=3306 vsize=362736 CPUtime=0 cores=0-7
/proc/3308/task/3336/stat : 3336 (python) S 3306 3308 3087 0 -1 4202560 28 935 0 0 0 0 0 0 25 0 9 0 668165568 371441664 7651 33554432000 4194304 5683644 140734671900688 18446744073709551615 235606690225 0 0 16781312 2 18446604453906918208 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 71.23
Current children cumulated vsize (KiB) 7872240

Child status: 0
Real time (s): 10.391
CPU time (s): 71.9201
CPU user time (s): 71.6341
CPU system time (s): 0.285956
CPU usage (%): 692.138
Max. virtual memory (cumulated for all children) (KiB): 7872244

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 71.6341
system time used= 0.285956
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 38888
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3447
involuntary context switches= 491

runsolver used 0.041993 second user time and 0.089986 second system time

The end

Launcher Data 

Begin job on node120 at 2011-05-16 19:07:46
IDJOB=3385354
IDBENCH=82619
IDSOLVER=1870
FILE ID=node120/3385354-1305565666
RUNJOBID= node120-1305564964-3102
PBS_JOBID= 13350130
Free space on /tmp= 73508 MiB

SOLVER NAME= borg-sat 11.03.02-par-random (fixed)
BENCH NAME= SAT11/random/large/unif-k5-r20-v750-c15000-S1787347746-067-UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3385354-1305565666/watcher-3385354-1305565666 -o /tmp/evaluation-result-3385354-1305565666/solver-3385354-1305565666 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3385354-1305565666.cnf -seed 1978747136 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 327a5393de6dbdcaf85af71880caf3c5
RANDOM SEED=1978747136

node120.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.78
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      12943792 kB
Buffers:        120832 kB
Cached:        1481128 kB
SwapCached:      32584 kB
Active:        6618652 kB
Inactive:     13143600 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      12943792 kB
SwapTotal:    67111528 kB
SwapFree:     54713412 kB
Dirty:           32168 kB
Writeback:           0 kB
AnonPages:    18133592 kB
Mapped:          19800 kB
Slab:            95392 kB
PageTables:      77820 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 66193704 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73480 MiB
End job on node120 at 2011-05-16 19:07:57