Trace number 3276281

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio parSAT 190.683 23.8893

General information on the benchmark

Namecrafted/anton/SRHD-SGI/
srhd-sgi-m37-q446.25-n35-p15-s25120921.cnf
MD5SUM4b4e8a8187c1b8536d6b504b16289d38
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark0.081987
Satisfiable
(Un)Satisfiability was proved
Number of variables1106
Number of clauses129272
Sum of the clauses size259580
Maximum clause length37
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 2129237
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 535

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 8 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	[5] plingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 0
0.00/0.00	Starting clasp 1.3.6 on core(s) 1
0.00/0.00	Starting TNM 2009 on core(s) 2
0.00/0.00	Starting march_hi 2009 on core(s) 3
0.00/0.00	Starting plingeling 276-6264d55-100731 on core(s) 4 5 6 7
189.94/23.88	s SATISFIABLE
189.94/23.88	v 1 -2 -3 -4 -5 -6 -7 -8 -9 -10 -11 -12 -13 -14 -15 -16 -17 -18 -19 -20 -21 -22 -23 -24 -25 -26 -27 -28 -29 30 -31 -32 -33 -34 -35 -36 -37 -38 -39 -40 -41 -42 -43 -44 -45 -46 -47 -48 -49 -50 -51 -52 -53 -54 -55 -56 -57 -58 -59 -60 -61 -62 -63 -64 -65 -66 -67 68 -69 -70 -71 -72 -73 -74 -75 -76 -77 -78 -79 -80 -81 -82 -83 -84 -85 -86 -87 -88 -89 -90 -91 -92 -93 -94 -95 -96 -97 -98 -99 -100 -101 -102 -103 -104 -105 106 -107 -108 -109 -110 -111 -112 -113 -114 -115 -116 -117 -118 -119 -120 -121 -122 -123 -124 -125 -126 -127 -128 -129 -130 -131 -132 -133 -134 -135 136 -137 -138 -139 -140 -141 -142 -143 -144 -145 -146 -147 -148 -149 -150 -151 -152 -153 -154 -155 -156 -157 -158 -159 -160 -161 -162 -163 -164 -165 166 -167 -168 -169 -170 -171 -172 -173 -174 -175 -176 -177 -178 -179 -180 -181 -182 -183 -184 -185 -186 -187 -188 -189 -190 -191 -192 -193 -194 -195 -196 -197 -198 -199 -200 -201 -202 -203 204 -205 -206 -207 -208 -209 -210 -211 -212 -213 -214 -215 -216 -217 -218 -219 -220 -221 -222 -223 -224 -225 -226 -227 -228 -229 -230 -231 -232 -233 234 -235 -236 -237 -238 -239 -240 -241 -242 -243 -244 -245 -246 -247 -248 -249 -250 -251 -252 -253 -254 -255 -256 -257 -258 -259 -260 -261 -262 -263 -264 265 -266 -267 -268 -269 -270 -271 -272 -273 -274 -275 -276 -277 -278 -279 -280 -281 -282 -283 -284 -285 -286 -287 -288 -289 -290 -291 -292 -293 -294 -295 -296 -297 -298 -299 -300 -301 -302 303 -304 -305 -306 -307 -308 -309 -310 -311 -312 -313 -314 -315 -316 -317 -318 -319 -320 -321 -322 -323 -324 -325 -326 -327 -328 -329 -330 -331 -332 -333 -334 -335 -336 -337 -338 -339 340 -341 -342 -343 -344 -345 -346 -347 -348 -349 -350 -351 -352 -353 -354 -355 -356 -357 -358 -359 -360 -361 -362 -363 -364 -365 -366 -367 -368 -369 -370 -371 -372 -373 -374 375 -376 -377 -378 -379 -380 -381 -382 -383 -384 -385 -386 -387 -388 -389 -390 -391 -392 -393 -394 -395 -396 -397 -398 -399 -400 -401 -402 -403 -404 -405 -406 407 -408 -409 -410 -411 -412 -413 -414 -415 -416 -417 -418 -419 -420 -421 -422 -423 -424 -425 -426 -427 -428 -429 -430 -431 -432 -433 -434 -435 -436 -437 -438 -439 440 -441 -442 -443 -444 -445 -446 -447 -448 -449 -450 -451 -452 -453 -454 -455 -456 -457 -458 -459 -460 -461 -462 -463 -464 -465 -466 -467 -468 -469 -470 -471 -472 -473 474 -475 -476 -477 -478 -479 -480 -481 -482 -483 -484 -485 -486 -487 -488 -489 -490 -491 -492 -493 -494 -495 -496 -497 -498 -499 -500 -501 -502 -503 -504 -505 506 -507 -508 -509 -510 -511 -512 -513 -514 -515 -516 -517 -518 -519 -520 -521 -522 -523 -524 -525 -526 -527 -528 -529 -530 -531 -532 -533 -534 -535 -536 -537 -538 -539 -540 541 -542 -543 -544 -545 -546 -547 -548 -549 -550 -551 -552 -553 -554 -555 -556 -557 -558 -559 -560 -561 -562 -563 -564 -565 -566 -567 -568 -569 -570 -571 -572 -573 574 -575 -576 -577 -578 -579 -580 -581 -582 -583 -584 -585 -586 -587 -588 -589 -590 -591 -592 -593 -594 -595 -596 -597 -598 -599 -600 -601 -602 -603 604 -605 -606 -607 -608 -609 -610 -611 -612 -613 -614 -615 -616 -617 -618 -619 -620 -621 -622 -623 -624 -625 -626 -627 -628 -629 -630 -631 -632 -633 -634 -635 -636 637 -638 -639 -640 -641 -642 -643 -644 -645 -646 -647 -648 -649 -650 -651 -652 -653 -654 -655 -656 -657 -658 -659 -660 -661 -662 -663 -664 -665 -666 -667 -668 -669 -670 -671 -672 -673 -674 -675 676 -677 -678 -679 -680 -681 -682 -683 -684 -685 -686 -687 -688 -689 -690 -691 -692 -693 -694 -695 -696 -697 -698 -699 -700 -701 -702 -703 -704 -705 -706 -707 708 -709 -710 -711 -712 -713 -714 -715 -716 -717 -718 -719 -720 -721 -722 -723 -724 -725 -726 -727 -728 -729 -730 -731 -732 -733 -734 -735 736 -737 -738 -739 -740 -741 -742 -743 -744 -745 -746 -747 -748 -749 -750 -751 -752 -753 -754 -755 -756 -757 -758 -759 -760 -761 -762 -763 -764 -765 -766 767 -768 -769 -770 -771 -772 -773 -774 -775 -776 -777 -778 -779 -780 -781 -782 -783 -784 -785 -786 -787 -788 -789 -790 -791 -792 -793 -794 -795 -796 -797 -798 -799 -800 -801 -802 803 -804 -805 -806 -807 -808 -809 -810 -811 -812 -813 -814 -815 -816 -817 -818 -819 -820 -821 -822 -823 -824 -825 -826 -827 -828 -829 -830 -831 -832 833 -834 -835 -836 -837 -838 -839 -840 -841 -842 -843 -844 -845 -846 -847 -848 -849 -850 -851 -852 -853 -854 -855 -856 -857 -858 -859 -860 861 -862 -863 -864 -865 -866 -867 -868 -869 -870 -871 -872 -873 -874 -875 -876 -877 -878 -879 -880 -881 -882 -883 -884 -885 -886 -887 -888 -889 -890 -891 892 -893 -894 -895 -896 -897 -898 -899 -900 -901 -902 -903 -904 -905 -906 -907 -908 -909 -910 -911 -912 -913 -914 -915 -916 -917 -918 -919 -920 -921 -922 923 -924 -925 -926 -927 -928 -929 -930 -931 -932 -933 -934 -935 -936 -937 -938 -939 -940 -941 -942 -943 -944 -945 -946 -947 -948 -949 -950 -951 -952 -953 954 -955 -956 -957 -958 -959 -960 -961 -962 -963 -964 -965 -966 -967 -968 -969 -970 -971 -972 -973 -974 -975 -976 -977 -978 -979 -980 -981 -982 -983 -984 -985 986 -987 -988 -989 -990 -991 -992 -993 -994 -995 -996 -997 -998 -999 -1000 -1001 -1002 -1003 -1004 -1005 -1006 -1007 -1008 -1009 -1010 -1011 -1012 -1013 -1014 -1015 -1016 -1017 -1018 1019 -1020 -1021 -1022 -1023 -1024 -1025 -1026 -1027 -1028 -1029 -1030 -1031 -1032 -1033 -1034 -1035 -1036 -1037 -1038 -1039 -1040 -1041 -1042 -1043 -1044 -1045 -1046 -1047 1048 -1049 -1050 -1051 -1052 -1053 -1054 -1055 -1056 -1057 -1058 -1059 -1060 -1061 -1062 -1063 -1064 -1065 -1066 -1067 -1068 -1069 -1070 -1071 -1072 -1073 -1074 -1075 -1076 1077 -1078 -1079 -1080 -1081 -1082 -1083 -1084 -1085 -1086 -1087 -1088 -1089 -1090 -1091 -1092 -1093 -1094 -1095 -1096 -1097 -1098 -1099 -1100 -1101 -1102 -1103 -1104 -1105 1106 
189.94/23.88	v 0 
189.94/23.88	solver [3] TNM 2009 answered
189.94/23.88	Done

Verifier Data 

OK

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3276281-1304175691/watcher-3276281-1304175691 -o /tmp/evaluation-result-3276281-1304175691/solver-3276281-1304175691 -C 40000 -W 5100 -M 31000 ppfolio HOME/instance-3276281-1304175691.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.99 7.98 7.97 2/170 10576
/proc/meminfo: memFree=30925316/32950928 swapFree=67111404/67111528
[pid=10576] ppid=10574 vsize=18324 CPUtime=0 cores=0-7
/proc/10576/stat : 10576 (ppfolio) R 10574 10576 10344 0 -1 4202496 520 0 0 0 0 0 0 0 25 0 1 0 529167910 18763776 389 33554432000 4194304 4287625 140734894322032 18446744073709551615 235594886671 0 0 4096 65536 0 0 0 17 6 0 0 0
/proc/10576/statm: 4581 389 341 23 0 91 0

[startup+0.0168839 s]
/proc/loadavg: 7.99 7.98 7.97 2/170 10576
/proc/meminfo: memFree=30925316/32950928 swapFree=67111404/67111528
[pid=10576] ppid=10574 vsize=18324 CPUtime=0 cores=0-7
/proc/10576/stat : 10576 (ppfolio) S 10574 10576 10344 0 -1 4202496 521 0 0 0 0 0 0 0 25 0 1 0 529167910 18763776 389 33554432000 4194304 4287625 140734894322032 18446744073709551615 235594886671 0 0 4096 65536 4004078442466246655 0 0 17 4 0 0 0
/proc/10576/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.195751 s]
/proc/loadavg: 7.99 7.98 7.97 2/170 10576
/proc/meminfo: memFree=30925316/32950928 swapFree=67111404/67111528
[pid=10576] ppid=10574 vsize=18324 CPUtime=0 cores=0-7
/proc/10576/stat : 10576 (ppfolio) S 10574 10576 10344 0 -1 4202496 521 0 0 0 0 0 0 0 25 0 1 0 529167910 18763776 389 33554432000 4194304 4287625 140734894322032 18446744073709551615 235594886671 0 0 4096 65536 4004078442466246655 0 0 17 4 0 0 0
/proc/10576/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.300838 s]
/proc/loadavg: 7.99 7.98 7.97 2/170 10576
/proc/meminfo: memFree=30925316/32950928 swapFree=67111404/67111528
[pid=10576] ppid=10574 vsize=18324 CPUtime=0 cores=0-7
/proc/10576/stat : 10576 (ppfolio) S 10574 10576 10344 0 -1 4202496 521 0 0 0 0 0 0 0 23 0 1 0 529167910 18763776 389 33554432000 4194304 4287625 140734894322032 18446744073709551615 235594886671 0 0 4096 65536 4004078442466246655 0 0 17 4 0 0 0
/proc/10576/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.700766 s]
/proc/loadavg: 7.99 7.98 7.97 2/170 10576
/proc/meminfo: memFree=30925316/32950928 swapFree=67111404/67111528
[pid=10576] ppid=10574 vsize=18324 CPUtime=0 cores=0-7
/proc/10576/stat : 10576 (ppfolio) S 10574 10576 10344 0 -1 4202496 521 0 0 0 0 0 0 0 20 0 1 0 529167910 18763776 389 33554432000 4194304 4287625 140734894322032 18446744073709551615 235594886671 0 0 4096 65536 4004078442466246655 0 0 17 4 0 0 0
/proc/10576/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50062 s]
/proc/loadavg: 7.99 7.98 7.97 9/180 10591
/proc/meminfo: memFree=30845364/32950928 swapFree=67111404/67111528
[pid=10576] ppid=10574 vsize=18324 CPUtime=0 cores=0-7
/proc/10576/stat : 10576 (ppfolio) S 10574 10576 10344 0 -1 4202496 521 0 0 0 0 0 0 0 15 0 1 0 529167910 18763776 389 33554432000 4194304 4287625 140734894322032 18446744073709551615 235594886671 0 0 4096 65536 4004078442466246655 0 0 17 4 0 0 0
/proc/10576/statm: 4581 389 341 23 0 91 0
[pid=10577] ppid=10576 vsize=43964 CPUtime=1.49 cores=0
/proc/10577/stat : 10577 (cryptominisat) R 10576 10576 10344 0 -1 4202496 9085 0 0 0 148 1 0 0 20 0 1 0 529167910 45019136 6386 33554432000 4194304 4587354 140735461949120 18446744073709551615 4236561 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/10577/statm: 10991 6386 326 96 0 7553 0
[pid=10578] ppid=10576 vsize=23048 CPUtime=1.49 cores=1
/proc/10578/stat : 10578 (clasp) R 10576 10576 10344 0 -1 4202496 3944 0 0 0 149 0 0 0 20 0 1 0 529167910 23601152 3100 33554432000 4194304 4785740 140735915405872 18446744073709551615 4287008 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/10578/statm: 5762 3100 340 145 0 2807 0
[pid=10579] ppid=10576 vsize=462824 CPUtime=1.49 cores=2
/proc/10579/stat : 10579 (TNM) R 10576 10576 10344 0 -1 4202496 3233 0 0 0 149 0 0 0 20 0 1 0 529167911 473931776 3130 33554432000 134512640 134534564 4292022224 18446744073709551615 134528957 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/10579/statm: 115706 3130 95 6 0 114372 0
[pid=10580] ppid=10576 vsize=24748 CPUtime=1.49 cores=3
/proc/10580/stat : 10580 (march_hi) R 10576 10576 10344 0 -1 4202496 10430 0 0 0 148 1 0 0 20 0 1 0 529167911 25341952 2567 33554432000 4194304 4331988 140736741012736 18446744073709551615 4237144 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/10580/statm: 6187 2567 174 34 0 4629 0
[pid=10581] ppid=10576 vsize=142816 CPUtime=5.71 cores=4-7
/proc/10581/stat : 10581 (plingeling) S 10576 10576 10344 0 -1 4202496 9744 1250 0 0 570 1 0 0 25 0 5 0 529167911 146243584 7512 33554432000 4194304 4356188 140734156698912 18446744073709551615 235606669285 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/10581/statm: 35704 7512 162 40 0 34248 0
[pid=10581/tid=10588] ppid=10576 vsize=142816 CPUtime=1.41 cores=4-7
/proc/10581/task/10588/stat : 10588 (plingeling) R 10576 10576 10344 0 -1 4202560 1128 1250 0 0 141 0 0 0 25 0 5 0 529167919 146243584 7512 33554432000 4194304 4356188 140734156698912 18446744073709551615 4211182 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=10581/tid=10589] ppid=10576 vsize=142816 CPUtime=1.4 cores=4-7
/proc/10581/task/10589/stat : 10589 (plingeling) R 10576 10576 10344 0 -1 4202560 729 1250 0 0 140 0 0 0 25 0 5 0 529167919 146243584 7512 33554432000 4194304 4356188 140734156698912 18446744073709551615 4270872 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=10581/tid=10590] ppid=10576 vsize=142816 CPUtime=1.41 cores=4-7
/proc/10581/task/10590/stat : 10590 (plingeling) R 10576 10576 10344 0 -1 4202560 1156 1250 0 0 141 0 0 0 25 0 5 0 529167919 146243584 7512 33554432000 4194304 4356188 140734156698912 18446744073709551615 4210544 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=10581/tid=10591] ppid=10576 vsize=142816 CPUtime=1.4 cores=4-7
/proc/10581/task/10591/stat : 10591 (plingeling) R 10576 10576 10344 0 -1 4202560 2112 1250 0 0 140 0 0 0 25 0 5 0 529167919 146243584 7512 33554432000 4194304 4356188 140734156698912 18446744073709551615 4331305 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 11.67
Current children cumulated vsize (KiB) 715724

[startup+3.10135 s]
/proc/loadavg: 7.99 7.98 7.97 9/180 10591
/proc/meminfo: memFree=30833956/32950928 swapFree=67111404/67111528
[pid=10576] ppid=10574 vsize=18324 CPUtime=0 cores=0-7
/proc/10576/stat : 10576 (ppfolio) S 10574 10576 10344 0 -1 4202496 521 0 0 0 0 0 0 0 15 0 1 0 529167910 18763776 389 33554432000 4194304 4287625 140734894322032 18446744073709551615 235594886671 0 0 4096 65536 4004078442466246655 0 0 17 4 0 0 0
/proc/10576/statm: 4581 389 341 23 0 91 0
[pid=10577] ppid=10576 vsize=1343288 CPUtime=3.09 cores=0
/proc/10577/stat : 10577 (cryptominisat) R 10576 10576 10344 0 -1 4202496 10561 0 0 0 308 1 0 0 25 0 1 0 529167910 1375526912 6350 33554432000 4194304 4587354 140735461949120 18446744073709551615 4450826 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/10577/statm: 335822 6350 337 96 0 332384 0
[pid=10578] ppid=10576 vsize=32804 CPUtime=3.09 cores=1
/proc/10578/stat : 10578 (clasp) R 10576 10576 10344 0 -1 4202496 6366 0 0 0 309 0 0 0 25 0 1 0 529167910 33591296 5522 33554432000 4194304 4785740 140735915405872 18446744073709551615 4287008 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/10578/statm: 8201 5522 340 145 0 5246 0
[pid=10579] ppid=10576 vsize=462824 CPUtime=3.09 cores=2
/proc/10579/stat : 10579 (TNM) R 10576 10576 10344 0 -1 4202496 3233 0 0 0 309 0 0 0 25 0 1 0 529167911 473931776 3130 33554432000 134512640 134534564 4292022224 18446744073709551615 134528661 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/10579/statm: 115706 3130 95 6 0 114372 0
[pid=10580] ppid=10576 vsize=24880 CPUtime=3.09 cores=3
/proc/10580/stat : 10580 (march_hi) R 10576 10576 10344 0 -1 4202496 10466 0 0 0 308 1 0 0 25 0 1 0 529167911 25477120 2603 33554432000 4194304 4331988 140736741012736 18446744073709551615 4237176 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/10580/statm: 6220 2603 174 34 0 4662 0
[pid=10581] ppid=10576 vsize=149984 CPUtime=12.1 cores=4-7
/proc/10581/stat : 10581 (plingeling) S 10576 10576 10344 0 -1 4202496 11536 1250 0 0 1209 1 0 0 25 0 5 0 529167911 153583616 9304 33554432000 4194304 4356188 140734156698912 18446744073709551615 235606669285 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/10581/statm: 37496 9304 162 40 0 36040 0
[pid=10581/tid=10588] ppid=10576 vsize=149984 CPUtime=3.01 cores=4-7
/proc/10581/task/10588/stat : 10588 (plingeling) R 10576 10576 10344 0 -1 4202560 1641 1250 0 0 301 0 0 0 25 0 5 0 529167919 153583616 9304 33554432000 4194304 4356188 140734156698912 18446744073709551615 4234340 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=10581/tid=10589] ppid=10576 vsize=149984 CPUtime=2.99 cores=4-7
/proc/10581/task/10589/stat : 10589 (plingeling) R 10576 10576 10344 0 -1 4202560 1176 1250 0 0 299 0 0 0 25 0 5 0 529167919 153583616 9304 33554432000 4194304 4356188 140734156698912 18446744073709551615 4234087 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=10581/tid=10590] ppid=10576 vsize=149984 CPUtime=3.01 cores=4-7
/proc/10581/task/10590/stat : 10590 (plingeling) R 10576 10576 10344 0 -1 4202560 1284 1250 0 0 301 0 0 0 25 0 5 0 529167919 153583616 9304 33554432000 4194304 4356188 140734156698912 18446744073709551615 4210596 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=10581/tid=10591] ppid=10576 vsize=149984 CPUtime=3 cores=4-7
/proc/10581/task/10591/stat : 10591 (plingeling) R 10576 10576 10344 0 -1 4202560 2816 1250 0 0 300 0 0 0 25 0 5 0 529167919 153583616 9304 33554432000 4194304 4356188 140734156698912 18446744073709551615 4273720 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 24.46
Current children cumulated vsize (KiB) 2032104

[startup+6.30079 s]
/proc/loadavg: 7.99 7.98 7.97 9/180 10591
/proc/meminfo: memFree=30804676/32950928 swapFree=67111404/67111528
[pid=10576] ppid=10574 vsize=18324 CPUtime=0 cores=0-7
/proc/10576/stat : 10576 (ppfolio) S 10574 10576 10344 0 -1 4202496 521 0 0 0 0 0 0 0 15 0 1 0 529167910 18763776 389 33554432000 4194304 4287625 140734894322032 18446744073709551615 235594886671 0 0 4096 65536 4004078442466246655 0 0 17 4 0 0 0
/proc/10576/statm: 4581 389 341 23 0 91 0
[pid=10577] ppid=10576 vsize=1364412 CPUtime=6.29 cores=0
/proc/10577/stat : 10577 (cryptominisat) R 10576 10576 10344 0 -1 4202496 15682 0 0 0 627 2 0 0 25 0 1 0 529167910 1397157888 11471 33554432000 4194304 4587354 140735461949120 18446744073709551615 4388350 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/10577/statm: 341103 11471 337 96 0 337665 0
[pid=10578] ppid=10576 vsize=45804 CPUtime=6.29 cores=1
/proc/10578/stat : 10578 (clasp) R 10576 10576 10344 0 -1 4202496 9493 0 0 0 628 1 0 0 25 0 1 0 529167910 46903296 8649 33554432000 4194304 4785740 140735915405872 18446744073709551615 4287241 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/10578/statm: 11451 8649 340 145 0 8496 0
[pid=10579] ppid=10576 vsize=462824 CPUtime=6.29 cores=2
/proc/10579/stat : 10579 (TNM) R 10576 10576 10344 0 -1 4202496 3233 0 0 0 629 0 0 0 25 0 1 0 529167911 473931776 3130 33554432000 134512640 134534564 4292022224 18446744073709551615 134530379 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/10579/statm: 115706 3130 95 6 0 114372 0
[pid=10580] ppid=10576 vsize=25180 CPUtime=6.29 cores=3
/proc/10580/stat : 10580 (march_hi) R 10576 10576 10344 0 -1 4202496 10517 0 0 0 628 1 0 0 25 0 1 0 529167911 25784320 2654 33554432000 4194304 4331988 140736741012736 18446744073709551615 4246730 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/10580/statm: 6295 2654 174 34 0 4737 0
[pid=10581] ppid=10576 vsize=156932 CPUtime=24.88 cores=4-7
/proc/10581/stat : 10581 (plingeling) S 10576 10576 10344 0 -1 4202496 13273 1250 0 0 2487 1 0 0 25 0 5 0 529167911 160698368 11041 33554432000 4194304 4356188 140734156698912 18446744073709551615 235606669285 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/10581/statm: 39233 11041 162 40 0 37777 0
[pid=10581/tid=10588] ppid=10576 vsize=156932 CPUtime=6.21 cores=4-7
/proc/10581/task/10588/stat : 10588 (plingeling) R 10576 10576 10344 0 -1 4202560 1897 1250 0 0 621 0 0 0 25 0 5 0 529167919 160698368 11041 33554432000 4194304 4356188 140734156698912 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=10581/tid=10589] ppid=10576 vsize=156932 CPUtime=6.17 cores=4-7
/proc/10581/task/10589/stat : 10589 (plingeling) R 10576 10576 10344 0 -1 4202560 1884 1250 0 0 617 0 0 0 25 0 5 0 529167919 160698368 11041 33554432000 4194304 4356188 140734156698912 18446744073709551615 4331076 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=10581/tid=10590] ppid=10576 vsize=156932 CPUtime=6.21 cores=4-7
/proc/10581/task/10590/stat : 10590 (plingeling) R 10576 10576 10344 0 -1 4202560 1798 1250 0 0 621 0 0 0 25 0 5 0 529167919 160698368 11041 33554432000 4194304 4356188 140734156698912 18446744073709551615 4330862 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=10581/tid=10591] ppid=10576 vsize=156932 CPUtime=6.2 cores=4-7
/proc/10581/task/10591/stat : 10591 (plingeling) R 10576 10576 10344 0 -1 4202560 3075 1250 0 0 620 0 0 0 25 0 5 0 529167919 160698368 11041 33554432000 4194304 4356188 140734156698912 18446744073709551615 4331062 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 50.04
Current children cumulated vsize (KiB) 2073476

[startup+12.7007 s]
/proc/loadavg: 7.99 7.98 7.97 9/180 10592
/proc/meminfo: memFree=30770856/32950928 swapFree=67111404/67111528
[pid=10576] ppid=10574 vsize=18324 CPUtime=0 cores=0-7
/proc/10576/stat : 10576 (ppfolio) S 10574 10576 10344 0 -1 4202496 521 0 0 0 0 0 0 0 15 0 1 0 529167910 18763776 389 33554432000 4194304 4287625 140734894322032 18446744073709551615 235594886671 0 0 4096 65536 4004078442466246655 0 0 17 4 0 0 0
/proc/10576/statm: 4581 389 341 23 0 91 0
[pid=10577] ppid=10576 vsize=1390992 CPUtime=12.69 cores=0
/proc/10577/stat : 10577 (cryptominisat) R 10576 10576 10344 0 -1 4202496 17947 0 0 0 1267 2 0 0 25 0 1 0 529167910 1424375808 11746 33554432000 4194304 4587354 140735461949120 18446744073709551615 4365241 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/10577/statm: 347748 11746 337 96 0 344310 0
[pid=10578] ppid=10576 vsize=51912 CPUtime=12.69 cores=1
/proc/10578/stat : 10578 (clasp) R 10576 10576 10344 0 -1 4202496 10953 0 0 0 1268 1 0 0 25 0 1 0 529167910 53157888 10109 33554432000 4194304 4785740 140735915405872 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/10578/statm: 12978 10109 340 145 0 10023 0
[pid=10579] ppid=10576 vsize=462824 CPUtime=12.69 cores=2
/proc/10579/stat : 10579 (TNM) R 10576 10576 10344 0 -1 4202496 3233 0 0 0 1269 0 0 0 25 0 1 0 529167911 473931776 3130 33554432000 134512640 134534564 4292022224 18446744073709551615 134528993 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/10579/statm: 115706 3130 95 6 0 114372 0
[pid=10580] ppid=10576 vsize=25548 CPUtime=12.69 cores=3
/proc/10580/stat : 10580 (march_hi) R 10576 10576 10344 0 -1 4202496 10559 0 0 0 1268 1 0 0 25 0 1 0 529167911 26161152 2696 33554432000 4194304 4331988 140736741012736 18446744073709551615 4226474 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/10580/statm: 6387 2696 174 34 0 4829 0
[pid=10581] ppid=10576 vsize=162820 CPUtime=50.45 cores=4-7
/proc/10581/stat : 10581 (plingeling) S 10576 10576 10344 0 -1 4202496 16024 1250 0 0 5043 2 0 0 25 0 5 0 529167911 166727680 12768 33554432000 4194304 4356188 140734156698912 18446744073709551615 235606669285 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/10581/statm: 40705 12768 162 40 0 39249 0
[pid=10581/tid=10588] ppid=10576 vsize=162820 CPUtime=12.61 cores=4-7
/proc/10581/task/10588/stat : 10588 (plingeling) R 10576 10576 10344 0 -1 4202560 1897 1250 0 0 1261 0 0 0 25 0 5 0 529167919 166727680 12768 33554432000 4194304 4356188 140734156698912 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=10581/tid=10589] ppid=10576 vsize=162820 CPUtime=12.53 cores=4-7
/proc/10581/task/10589/stat : 10589 (plingeling) R 10576 10576 10344 0 -1 4202560 2397 1250 0 0 1253 0 0 0 25 0 5 0 529167919 166727680 12768 33554432000 4194304 4356188 140734156698912 18446744073709551615 4331028 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=10581/tid=10590] ppid=10576 vsize=162820 CPUtime=12.61 cores=4-7
/proc/10581/task/10590/stat : 10590 (plingeling) R 10576 10576 10344 0 -1 4202560 2693 1250 0 0 1261 0 0 0 25 0 5 0 529167919 166727680 12768 33554432000 4194304 4356188 140734156698912 18446744073709551615 4282491 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=10581/tid=10591] ppid=10576 vsize=162820 CPUtime=12.6 cores=4-7
/proc/10581/task/10591/stat : 10591 (plingeling) R 10576 10576 10344 0 -1 4202560 4418 1250 0 0 1260 0 0 0 25 0 5 0 529167919 166727680 12768 33554432000 4194304 4356188 140734156698912 18446744073709551615 4331074 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 101.21
Current children cumulated vsize (KiB) 2112420

Solver just ended. Dumping a history of the last processes samples

[startup+19.1005 s]
/proc/loadavg: 8.07 8.00 7.98 9/180 10592
/proc/meminfo: memFree=30738004/32950928 swapFree=67111404/67111528
[pid=10576] ppid=10574 vsize=18324 CPUtime=0 cores=0-7
/proc/10576/stat : 10576 (ppfolio) S 10574 10576 10344 0 -1 4202496 521 0 0 0 0 0 0 0 15 0 1 0 529167910 18763776 389 33554432000 4194304 4287625 140734894322032 18446744073709551615 235594886671 0 0 4096 65536 4004078442466246655 0 0 17 4 0 0 0
/proc/10576/statm: 4581 389 341 23 0 91 0

################
# More data... #
################

[pid=10581/tid=10588] ppid=10576 vsize=173060 CPUtime=19.01 cores=4-7
/proc/10581/task/10588/stat : 10588 (plingeling) R 10576 10576 10344 0 -1 4202560 1897 1250 0 0 1901 0 0 0 25 0 5 0 529167919 177213440 15328 33554432000 4194304 4356188 140734156698912 18446744073709551615 4331188 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=10581/tid=10589] ppid=10576 vsize=173060 CPUtime=18.9 cores=4-7
/proc/10581/task/10589/stat : 10589 (plingeling) R 10576 10576 10344 0 -1 4202560 2397 1250 0 0 1890 0 0 0 25 0 5 0 529167919 177213440 15328 33554432000 4194304 4356188 140734156698912 18446744073709551615 4331328 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=10581/tid=10590] ppid=10576 vsize=173060 CPUtime=19 cores=4-7
/proc/10581/task/10590/stat : 10590 (plingeling) R 10576 10576 10344 0 -1 4202560 3973 1250 0 0 1900 0 0 0 25 0 5 0 529167919 177213440 15328 33554432000 4194304 4356188 140734156698912 18446744073709551615 4270872 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=10581/tid=10591] ppid=10576 vsize=173060 CPUtime=19 cores=4-7
/proc/10581/task/10591/stat : 10591 (plingeling) R 10576 10576 10344 0 -1 4202560 8770 1250 0 0 1899 1 0 0 25 0 5 0 529167919 177213440 15328 33554432000 4194304 4356188 140734156698912 18446744073709551615 4244483 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 152.38
Current children cumulated vsize (KiB) 2145792

[startup+22.301 s]
/proc/loadavg: 8.07 8.00 7.98 9/180 10592
/proc/meminfo: memFree=30724804/32950928 swapFree=67111404/67111528
[pid=10576] ppid=10574 vsize=18324 CPUtime=0 cores=0-7
/proc/10576/stat : 10576 (ppfolio) S 10574 10576 10344 0 -1 4202496 521 0 0 0 0 0 0 0 15 0 1 0 529167910 18763776 389 33554432000 4194304 4287625 140734894322032 18446744073709551615 235594886671 0 0 4096 65536 4004078442466246655 0 0 17 4 0 0 0
/proc/10576/statm: 4581 389 341 23 0 91 0
[pid=10577] ppid=10576 vsize=1411836 CPUtime=22.28 cores=0
/proc/10577/stat : 10577 (cryptominisat) R 10576 10576 10344 0 -1 4202496 23361 0 0 0 2226 2 0 0 25 0 1 0 529167910 1445720064 17159 33554432000 4194304 4587354 140735461949120 18446744073709551615 4365356 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/10577/statm: 352959 17159 337 96 0 349521 0
[pid=10578] ppid=10576 vsize=61472 CPUtime=22.29 cores=1
/proc/10578/stat : 10578 (clasp) R 10576 10576 10344 0 -1 4202496 13212 0 0 0 2227 2 0 0 25 0 1 0 529167910 62947328 12368 33554432000 4194304 4785740 140735915405872 18446744073709551615 4287244 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/10578/statm: 15368 12368 340 145 0 12413 0
[pid=10579] ppid=10576 vsize=462824 CPUtime=22.29 cores=2
/proc/10579/stat : 10579 (TNM) R 10576 10576 10344 0 -1 4202496 3233 0 0 0 2229 0 0 0 25 0 1 0 529167911 473931776 3130 33554432000 134512640 134534564 4292022224 18446744073709551615 134528957 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/10579/statm: 115706 3130 95 6 0 114372 0
[pid=10580] ppid=10576 vsize=26356 CPUtime=22.29 cores=3
/proc/10580/stat : 10580 (march_hi) R 10576 10576 10344 0 -1 4202496 10792 0 0 0 2228 1 0 0 25 0 1 0 529167911 26988544 2929 33554432000 4194304 4331988 140736741012736 18446744073709551615 4237136 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/10580/statm: 6589 2929 174 34 0 5031 0
[pid=10581] ppid=10576 vsize=178692 CPUtime=88.8 cores=4-7
/proc/10581/stat : 10581 (plingeling) S 10576 10576 10344 0 -1 4202496 24088 1250 0 0 8877 3 0 0 25 0 5 0 529167911 182980608 16736 33554432000 4194304 4356188 140734156698912 18446744073709551615 235606669285 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/10581/statm: 44673 16736 162 40 0 43217 0
[pid=10581/tid=10588] ppid=10576 vsize=178692 CPUtime=22.21 cores=4-7
/proc/10581/task/10588/stat : 10588 (plingeling) R 10576 10576 10344 0 -1 4202560 2921 1250 0 0 2221 0 0 0 25 0 5 0 529167919 182980608 16736 33554432000 4194304 4356188 140734156698912 18446744073709551615 4331350 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=10581/tid=10589] ppid=10576 vsize=178692 CPUtime=22.08 cores=4-7
/proc/10581/task/10589/stat : 10589 (plingeling) R 10576 10576 10344 0 -1 4202560 2397 1250 0 0 2208 0 0 0 25 0 5 0 529167919 182980608 16736 33554432000 4194304 4356188 140734156698912 18446744073709551615 4332007 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=10581/tid=10590] ppid=10576 vsize=178692 CPUtime=22.2 cores=4-7
/proc/10581/task/10590/stat : 10590 (plingeling) R 10576 10576 10344 0 -1 4202560 3973 1250 0 0 2220 0 0 0 25 0 5 0 529167919 182980608 16736 33554432000 4194304 4356188 140734156698912 18446744073709551615 4238570 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=10581/tid=10591] ppid=10576 vsize=178692 CPUtime=22.2 cores=4-7
/proc/10581/task/10591/stat : 10591 (plingeling) R 10576 10576 10344 0 -1 4202560 10178 1250 0 0 2219 1 0 0 25 0 5 0 529167919 182980608 16736 33554432000 4194304 4356188 140734156698912 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 177.95
Current children cumulated vsize (KiB) 2159504

[startup+23.1068 s]
/proc/loadavg: 8.07 8.00 7.98 9/180 10592
/proc/meminfo: memFree=30727376/32950928 swapFree=67111404/67111528
[pid=10576] ppid=10574 vsize=18324 CPUtime=0 cores=0-7
/proc/10576/stat : 10576 (ppfolio) S 10574 10576 10344 0 -1 4202496 521 0 0 0 0 0 0 0 15 0 1 0 529167910 18763776 389 33554432000 4194304 4287625 140734894322032 18446744073709551615 235594886671 0 0 4096 65536 4004078442466246655 0 0 17 4 0 0 0
/proc/10576/statm: 4581 389 341 23 0 91 0
[pid=10577] ppid=10576 vsize=1411836 CPUtime=23.09 cores=0
/proc/10577/stat : 10577 (cryptominisat) R 10576 10576 10344 0 -1 4202496 23361 0 0 0 2307 2 0 0 25 0 1 0 529167910 1445720064 17159 33554432000 4194304 4587354 140735461949120 18446744073709551615 4238600 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/10577/statm: 352959 17159 337 96 0 349521 0
[pid=10578] ppid=10576 vsize=61788 CPUtime=23.09 cores=1
/proc/10578/stat : 10578 (clasp) R 10576 10576 10344 0 -1 4202496 13309 0 0 0 2307 2 0 0 25 0 1 0 529167910 63270912 12465 33554432000 4194304 4785740 140735915405872 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/10578/statm: 15447 12465 340 145 0 12492 0
[pid=10579] ppid=10576 vsize=462824 CPUtime=23.09 cores=2
/proc/10579/stat : 10579 (TNM) R 10576 10576 10344 0 -1 4202496 3233 0 0 0 2309 0 0 0 25 0 1 0 529167911 473931776 3130 33554432000 134512640 134534564 4292022224 18446744073709551615 134528726 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/10579/statm: 115706 3130 95 6 0 114372 0
[pid=10580] ppid=10576 vsize=26356 CPUtime=23.09 cores=3
/proc/10580/stat : 10580 (march_hi) R 10576 10576 10344 0 -1 4202496 10799 0 0 0 2308 1 0 0 25 0 1 0 529167911 26988544 2936 33554432000 4194304 4331988 140736741012736 18446744073709551615 4237168 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/10580/statm: 6589 2936 174 34 0 5031 0
[pid=10581] ppid=10576 vsize=174596 CPUtime=92.02 cores=4-7
/proc/10581/stat : 10581 (plingeling) S 10576 10576 10344 0 -1 4202496 24088 1250 0 0 9199 3 0 0 25 0 5 0 529167911 178786304 15712 33554432000 4194304 4356188 140734156698912 18446744073709551615 235606669285 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/10581/statm: 43649 15712 162 40 0 42193 0
[pid=10581/tid=10588] ppid=10576 vsize=174596 CPUtime=23.02 cores=4-7
/proc/10581/task/10588/stat : 10588 (plingeling) R 10576 10576 10344 0 -1 4202560 2921 1250 0 0 2302 0 0 0 25 0 5 0 529167919 178786304 15712 33554432000 4194304 4356188 140734156698912 18446744073709551615 4331311 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=10581/tid=10589] ppid=10576 vsize=174596 CPUtime=22.88 cores=4-7
/proc/10581/task/10589/stat : 10589 (plingeling) R 10576 10576 10344 0 -1 4202560 2397 1250 0 0 2288 0 0 0 25 0 5 0 529167919 178786304 15712 33554432000 4194304 4356188 140734156698912 18446744073709551615 4336558 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=10581/tid=10590] ppid=10576 vsize=174596 CPUtime=23.01 cores=4-7
/proc/10581/task/10590/stat : 10590 (plingeling) R 10576 10576 10344 0 -1 4202560 3973 1250 0 0 2301 0 0 0 25 0 5 0 529167919 178786304 15712 33554432000 4194304 4356188 140734156698912 18446744073709551615 4244402 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=10581/tid=10591] ppid=10576 vsize=174596 CPUtime=23 cores=4-7
/proc/10581/task/10591/stat : 10591 (plingeling) R 10576 10576 10344 0 -1 4202560 10178 1250 0 0 2299 1 0 0 25 0 5 0 529167919 178786304 15712 33554432000 4194304 4356188 140734156698912 18446744073709551615 4331055 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 184.38
Current children cumulated vsize (KiB) 2155724

[startup+23.5008 s]
/proc/loadavg: 8.07 8.00 7.98 9/180 10592
/proc/meminfo: memFree=30727376/32950928 swapFree=67111404/67111528
[pid=10576] ppid=10574 vsize=18324 CPUtime=0 cores=0-7
/proc/10576/stat : 10576 (ppfolio) S 10574 10576 10344 0 -1 4202496 521 0 0 0 0 0 0 0 15 0 1 0 529167910 18763776 389 33554432000 4194304 4287625 140734894322032 18446744073709551615 235594886671 0 0 4096 65536 4004078442466246655 0 0 17 4 0 0 0
/proc/10576/statm: 4581 389 341 23 0 91 0
[pid=10577] ppid=10576 vsize=1411836 CPUtime=23.48 cores=0
/proc/10577/stat : 10577 (cryptominisat) R 10576 10576 10344 0 -1 4202496 23361 0 0 0 2346 2 0 0 25 0 1 0 529167910 1445720064 17159 33554432000 4194304 4587354 140735461949120 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/10577/statm: 352959 17159 337 96 0 349521 0
[pid=10578] ppid=10576 vsize=61788 CPUtime=23.49 cores=1
/proc/10578/stat : 10578 (clasp) R 10576 10576 10344 0 -1 4202496 13316 0 0 0 2347 2 0 0 25 0 1 0 529167910 63270912 12472 33554432000 4194304 4785740 140735915405872 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/10578/statm: 15447 12472 340 145 0 12492 0
[pid=10579] ppid=10576 vsize=462824 CPUtime=23.49 cores=2
/proc/10579/stat : 10579 (TNM) R 10576 10576 10344 0 -1 4202496 3233 0 0 0 2349 0 0 0 25 0 1 0 529167911 473931776 3130 33554432000 134512640 134534564 4292022224 18446744073709551615 134529640 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/10579/statm: 115706 3130 95 6 0 114372 0
[pid=10580] ppid=10576 vsize=26356 CPUtime=23.49 cores=3
/proc/10580/stat : 10580 (march_hi) R 10576 10576 10344 0 -1 4202496 10803 0 0 0 2348 1 0 0 25 0 1 0 529167911 26988544 2940 33554432000 4194304 4331988 140736741012736 18446744073709551615 4226457 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/10580/statm: 6589 2940 174 34 0 5031 0
[pid=10581] ppid=10576 vsize=174596 CPUtime=93.59 cores=4-7
/proc/10581/stat : 10581 (plingeling) S 10576 10576 10344 0 -1 4202496 24088 1250 0 0 9356 3 0 0 25 0 5 0 529167911 178786304 15712 33554432000 4194304 4356188 140734156698912 18446744073709551615 235606669285 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/10581/statm: 43649 15712 162 40 0 42193 0
[pid=10581/tid=10588] ppid=10576 vsize=174596 CPUtime=23.41 cores=4-7
/proc/10581/task/10588/stat : 10588 (plingeling) R 10576 10576 10344 0 -1 4202560 2921 1250 0 0 2341 0 0 0 25 0 5 0 529167919 178786304 15712 33554432000 4194304 4356188 140734156698912 18446744073709551615 4332046 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=10581/tid=10589] ppid=10576 vsize=174596 CPUtime=23.27 cores=4-7
/proc/10581/task/10589/stat : 10589 (plingeling) R 10576 10576 10344 0 -1 4202560 2397 1250 0 0 2327 0 0 0 25 0 5 0 529167919 178786304 15712 33554432000 4194304 4356188 140734156698912 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=10581/tid=10590] ppid=10576 vsize=174596 CPUtime=23.4 cores=4-7
/proc/10581/task/10590/stat : 10590 (plingeling) R 10576 10576 10344 0 -1 4202560 3973 1250 0 0 2340 0 0 0 25 0 5 0 529167919 178786304 15712 33554432000 4194304 4356188 140734156698912 18446744073709551615 4332023 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=10581/tid=10591] ppid=10576 vsize=174596 CPUtime=23.4 cores=4-7
/proc/10581/task/10591/stat : 10591 (plingeling) R 10576 10576 10344 0 -1 4202560 10178 1250 0 0 2339 1 0 0 25 0 5 0 529167919 178786304 15712 33554432000 4194304 4356188 140734156698912 18446744073709551615 4331060 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 187.54
Current children cumulated vsize (KiB) 2155724

[startup+23.7007 s]
/proc/loadavg: 8.07 8.00 7.98 9/180 10592
/proc/meminfo: memFree=30727376/32950928 swapFree=67111404/67111528
[pid=10576] ppid=10574 vsize=18324 CPUtime=0 cores=0-7
/proc/10576/stat : 10576 (ppfolio) S 10574 10576 10344 0 -1 4202496 521 0 0 0 0 0 0 0 15 0 1 0 529167910 18763776 389 33554432000 4194304 4287625 140734894322032 18446744073709551615 235594886671 0 0 4096 65536 4004078442466246655 0 0 17 4 0 0 0
/proc/10576/statm: 4581 389 341 23 0 91 0
[pid=10577] ppid=10576 vsize=1411836 CPUtime=23.68 cores=0
/proc/10577/stat : 10577 (cryptominisat) R 10576 10576 10344 0 -1 4202496 23361 0 0 0 2366 2 0 0 25 0 1 0 529167910 1445720064 17159 33554432000 4194304 4587354 140735461949120 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/10577/statm: 352959 17159 337 96 0 349521 0
[pid=10578] ppid=10576 vsize=61788 CPUtime=23.69 cores=1
/proc/10578/stat : 10578 (clasp) R 10576 10576 10344 0 -1 4202496 13316 0 0 0 2367 2 0 0 25 0 1 0 529167910 63270912 12472 33554432000 4194304 4785740 140735915405872 18446744073709551615 4287053 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/10578/statm: 15447 12472 340 145 0 12492 0
[pid=10579] ppid=10576 vsize=462824 CPUtime=23.69 cores=2
/proc/10579/stat : 10579 (TNM) R 10576 10576 10344 0 -1 4202496 3233 0 0 0 2369 0 0 0 25 0 1 0 529167911 473931776 3130 33554432000 134512640 134534564 4292022224 18446744073709551615 134530551 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/10579/statm: 115706 3130 95 6 0 114372 0
[pid=10580] ppid=10576 vsize=26356 CPUtime=23.69 cores=3
/proc/10580/stat : 10580 (march_hi) R 10576 10576 10344 0 -1 4202496 10804 0 0 0 2368 1 0 0 25 0 1 0 529167911 26988544 2941 33554432000 4194304 4331988 140736741012736 18446744073709551615 4228247 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/10580/statm: 6589 2941 174 34 0 5031 0
[pid=10581] ppid=10576 vsize=174596 CPUtime=94.39 cores=4-7
/proc/10581/stat : 10581 (plingeling) S 10576 10576 10344 0 -1 4202496 24088 1250 0 0 9436 3 0 0 25 0 5 0 529167911 178786304 15712 33554432000 4194304 4356188 140734156698912 18446744073709551615 235606669285 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/10581/statm: 43649 15712 162 40 0 42193 0
[pid=10581/tid=10588] ppid=10576 vsize=174596 CPUtime=23.61 cores=4-7
/proc/10581/task/10588/stat : 10588 (plingeling) R 10576 10576 10344 0 -1 4202560 2921 1250 0 0 2361 0 0 0 25 0 5 0 529167919 178786304 15712 33554432000 4194304 4356188 140734156698912 18446744073709551615 4210554 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=10581/tid=10589] ppid=10576 vsize=174596 CPUtime=23.47 cores=4-7
/proc/10581/task/10589/stat : 10589 (plingeling) R 10576 10576 10344 0 -1 4202560 2397 1250 0 0 2347 0 0 0 25 0 5 0 529167919 178786304 15712 33554432000 4194304 4356188 140734156698912 18446744073709551615 4331984 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=10581/tid=10590] ppid=10576 vsize=174596 CPUtime=23.6 cores=4-7
/proc/10581/task/10590/stat : 10590 (plingeling) R 10576 10576 10344 0 -1 4202560 3973 1250 0 0 2360 0 0 0 25 0 5 0 529167919 178786304 15712 33554432000 4194304 4356188 140734156698912 18446744073709551615 4331055 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=10581/tid=10591] ppid=10576 vsize=174596 CPUtime=23.6 cores=4-7
/proc/10581/task/10591/stat : 10591 (plingeling) R 10576 10576 10344 0 -1 4202560 10178 1250 0 0 2359 1 0 0 25 0 5 0 529167919 178786304 15712 33554432000 4194304 4356188 140734156698912 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 189.14
Current children cumulated vsize (KiB) 2155724

[startup+23.8007 s]
/proc/loadavg: 8.07 8.00 7.98 9/180 10592
/proc/meminfo: memFree=30727376/32950928 swapFree=67111404/67111528
[pid=10576] ppid=10574 vsize=18324 CPUtime=0 cores=0-7
/proc/10576/stat : 10576 (ppfolio) S 10574 10576 10344 0 -1 4202496 521 0 0 0 0 0 0 0 15 0 1 0 529167910 18763776 389 33554432000 4194304 4287625 140734894322032 18446744073709551615 235594886671 0 0 4096 65536 4004078442466246655 0 0 17 4 0 0 0
/proc/10576/statm: 4581 389 341 23 0 91 0
[pid=10577] ppid=10576 vsize=1411836 CPUtime=23.78 cores=0
/proc/10577/stat : 10577 (cryptominisat) R 10576 10576 10344 0 -1 4202496 23361 0 0 0 2376 2 0 0 25 0 1 0 529167910 1445720064 17159 33554432000 4194304 4587354 140735461949120 18446744073709551615 4238421 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/10577/statm: 352959 17159 337 96 0 349521 0
[pid=10578] ppid=10576 vsize=61788 CPUtime=23.79 cores=1
/proc/10578/stat : 10578 (clasp) R 10576 10576 10344 0 -1 4202496 13319 0 0 0 2377 2 0 0 25 0 1 0 529167910 63270912 12475 33554432000 4194304 4785740 140735915405872 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/10578/statm: 15447 12475 340 145 0 12492 0
[pid=10579] ppid=10576 vsize=462824 CPUtime=23.79 cores=2
/proc/10579/stat : 10579 (TNM) R 10576 10576 10344 0 -1 4202496 3233 0 0 0 2379 0 0 0 25 0 1 0 529167911 473931776 3130 33554432000 134512640 134534564 4292022224 18446744073709551615 134530344 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/10579/statm: 115706 3130 95 6 0 114372 0
[pid=10580] ppid=10576 vsize=26356 CPUtime=23.79 cores=3
/proc/10580/stat : 10580 (march_hi) R 10576 10576 10344 0 -1 4202496 10805 0 0 0 2378 1 0 0 25 0 1 0 529167911 26988544 2942 33554432000 4194304 4331988 140736741012736 18446744073709551615 4226499 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/10580/statm: 6589 2942 174 34 0 5031 0
[pid=10581] ppid=10576 vsize=174596 CPUtime=94.79 cores=4-7
/proc/10581/stat : 10581 (plingeling) S 10576 10576 10344 0 -1 4202496 24088 1250 0 0 9476 3 0 0 25 0 5 0 529167911 178786304 15712 33554432000 4194304 4356188 140734156698912 18446744073709551615 235606669285 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/10581/statm: 43649 15712 162 40 0 42193 0
[pid=10581/tid=10588] ppid=10576 vsize=174596 CPUtime=23.71 cores=4-7
/proc/10581/task/10588/stat : 10588 (plingeling) R 10576 10576 10344 0 -1 4202560 2921 1250 0 0 2371 0 0 0 25 0 5 0 529167919 178786304 15712 33554432000 4194304 4356188 140734156698912 18446744073709551615 4331069 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=10581/tid=10589] ppid=10576 vsize=174596 CPUtime=23.57 cores=4-7
/proc/10581/task/10589/stat : 10589 (plingeling) R 10576 10576 10344 0 -1 4202560 2397 1250 0 0 2357 0 0 0 25 0 5 0 529167919 178786304 15712 33554432000 4194304 4356188 140734156698912 18446744073709551615 4234276 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=10581/tid=10590] ppid=10576 vsize=174596 CPUtime=23.7 cores=4-7
/proc/10581/task/10590/stat : 10590 (plingeling) R 10576 10576 10344 0 -1 4202560 3973 1250 0 0 2370 0 0 0 25 0 5 0 529167919 178786304 15712 33554432000 4194304 4356188 140734156698912 18446744073709551615 4281672 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=10581/tid=10591] ppid=10576 vsize=174596 CPUtime=23.7 cores=4-7
/proc/10581/task/10591/stat : 10591 (plingeling) R 10576 10576 10344 0 -1 4202560 10178 1250 0 0 2369 1 0 0 25 0 5 0 529167919 178786304 15712 33554432000 4194304 4356188 140734156698912 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 189.94
Current children cumulated vsize (KiB) 2155724

Child status: 0
Real time (s): 23.8893
CPU time (s): 190.683
CPU user time (s): 190.557
CPU system time (s): 0.12598
CPU usage (%): 798.195
Max. virtual memory (cumulated for all children) (KiB): 3417628

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 190.557
system time used= 0.12598
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 76649
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 462
involuntary context switches= 946

runsolver used 0.035994 second user time and 0.096985 second system time

The end

Launcher Data 

Begin job on node120 at 2011-04-30 17:01:31
IDJOB=3276281
IDBENCH=88202
IDSOLVER=1638
FILE ID=node120/3276281-1304175691
RUNJOBID= node120-1304175549-10358
PBS_JOBID= 13170974
Free space on /tmp= 73168 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT11/crafted/anton/SRHD-SGI/srhd-sgi-m37-q446.25-n35-p15-s25120921.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3276281-1304175691/watcher-3276281-1304175691 -o /tmp/evaluation-result-3276281-1304175691/solver-3276281-1304175691 -C 40000 -W 5100 -M 31000  ppfolio HOME/instance-3276281-1304175691.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 4b4e8a8187c1b8536d6b504b16289d38
RANDOM SEED=538235371

node120.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.78
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      30925472 kB
Buffers:        541000 kB
Cached:        1055496 kB
SwapCached:          8 kB
Active:         665604 kB
Inactive:       994380 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      30925472 kB
SwapTotal:    67111528 kB
SwapFree:     67111404 kB
Dirty:           11492 kB
Writeback:           0 kB
AnonPages:       64312 kB
Mapped:          14188 kB
Slab:           297344 kB
PageTables:       4460 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   186476 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73156 MiB
End job on node120 at 2011-04-30 17:01:55