Trace number 3299546

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
claspmt 2.0-R4095SAT 4335.28 1085.49

General information on the benchmark

NameCRAFTED/rbsat/crafted/unforced/
rbsat-v945c61409g3.cnf
MD5SUM4de3b21cb74a7ec60763201555524736
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark1.9317
Satisfiable
(Un)Satisfiability was proved
Number of variables945
Number of clauses61409
Sum of the clauses size123673
Maximum clause length21
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 261364
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 545

Solver Data 

0.00/0.00	c clasp version 2.0.0-RC2
0.00/0.00	c Reading from ...054464/instance-3299546-1304054464.cnf
0.09/0.18	c Solving...
4335.12/1085.42	c Answer: 1
4335.12/1085.42	v -1 -2 -3 -4 -5 -6 -7 -8 -9 -10 -11 -12 -13 -14 -15 -16 -17 -18 -19 -20
4335.12/1085.42	v 21 -22 -23 -24 -25 -26 27 -28 -29 -30 -31 -32 -33 -34 -35 -36 -37 -38 -39
4335.12/1085.42	v -40 -41 -42 -43 -44 -45 -46 47 -48 -49 -50 -51 -52 -53 -54 -55 -56 -57
4335.12/1085.42	v -58 -59 -60 -61 -62 -63 -64 -65 -66 -67 -68 -69 -70 -71 -72 -73 -74 -75
4335.12/1085.42	v -76 -77 78 -79 -80 -81 -82 -83 -84 -85 -86 -87 -88 -89 -90 -91 -92 -93
4335.12/1085.42	v -94 -95 -96 -97 -98 99 -100 -101 -102 -103 -104 -105 -106 -107 -108 -109
4335.12/1085.42	v -110 -111 -112 -113 -114 -115 -116 -117 -118 -119 -120 -121 122 -123 -124
4335.12/1085.42	v -125 -126 -127 -128 -129 -130 -131 -132 -133 -134 -135 -136 -137 -138 -139
4335.12/1085.42	v -140 -141 -142 -143 144 -145 -146 -147 -148 -149 -150 -151 -152 -153 154
4335.12/1085.42	v -155 -156 -157 -158 -159 -160 -161 -162 -163 -164 -165 -166 -167 -168 -169
4335.12/1085.42	v -170 -171 -172 -173 -174 -175 -176 -177 -178 -179 -180 -181 -182 -183 -184
4335.12/1085.42	v -185 -186 -187 -188 189 -190 -191 -192 -193 -194 -195 -196 197 -198 -199
4335.12/1085.42	v -200 -201 -202 -203 -204 -205 -206 -207 -208 -209 -210 -211 -212 -213 -214
4335.12/1085.42	v -215 216 -217 -218 -219 -220 -221 -222 -223 -224 -225 -226 -227 -228 -229
4335.12/1085.42	v -230 -231 -232 -233 -234 -235 -236 -237 -238 239 -240 -241 -242 -243 -244
4335.12/1085.42	v -245 -246 -247 -248 -249 -250 -251 -252 -253 -254 -255 -256 -257 -258 -259
4335.12/1085.42	v -260 -261 -262 -263 264 -265 -266 -267 -268 -269 -270 -271 -272 -273 -274
4335.12/1085.42	v -275 -276 -277 -278 -279 -280 -281 -282 -283 -284 -285 -286 -287 -288 -289
4335.12/1085.42	v -290 -291 292 -293 -294 -295 -296 -297 -298 -299 -300 -301 -302 -303 -304
4335.12/1085.42	v 305 -306 -307 -308 -309 -310 -311 -312 -313 -314 -315 -316 -317 -318 -319
4335.12/1085.42	v -320 -321 -322 -323 -324 325 -326 -327 -328 -329 -330 -331 -332 -333 -334
4335.12/1085.42	v -335 -336 -337 -338 -339 -340 -341 -342 -343 -344 345 -346 -347 -348 -349
4335.12/1085.42	v -350 -351 -352 -353 -354 -355 -356 -357 -358 -359 -360 -361 -362 -363 -364
4335.12/1085.42	v -365 -366 -367 -368 -369 -370 -371 -372 -373 -374 375 -376 -377 -378 -379
4335.12/1085.42	v -380 -381 -382 -383 -384 -385 -386 -387 388 -389 -390 -391 -392 -393 -394
4335.12/1085.42	v -395 -396 -397 -398 -399 -400 -401 -402 -403 -404 405 -406 -407 -408 -409
4335.12/1085.42	v -410 -411 -412 -413 -414 -415 -416 -417 -418 -419 -420 -421 -422 423 -424
4335.12/1085.42	v -425 -426 -427 -428 -429 -430 -431 -432 -433 -434 -435 -436 -437 -438 -439
4335.12/1085.42	v -440 -441 -442 -443 -444 -445 -446 -447 -448 -449 -450 -451 -452 -453 -454
4335.12/1085.42	v -455 -456 -457 -458 -459 -460 -461 462 -463 -464 -465 -466 -467 468 -469
4335.12/1085.42	v -470 -471 -472 -473 -474 -475 -476 -477 -478 -479 -480 -481 -482 -483 -484
4335.12/1085.42	v -485 -486 -487 -488 -489 -490 -491 -492 -493 -494 -495 -496 -497 -498 -499
4335.12/1085.42	v -500 501 -502 -503 -504 -505 -506 -507 508 -509 -510 -511 -512 -513 -514
4335.12/1085.42	v -515 -516 -517 -518 -519 -520 -521 -522 -523 -524 -525 -526 -527 -528 -529
4335.12/1085.42	v -530 -531 -532 -533 -534 -535 536 -537 -538 -539 -540 -541 -542 -543 -544
4335.12/1085.42	v -545 -546 -547 -548 -549 -550 -551 -552 -553 -554 -555 -556 -557 -558 -559
4335.12/1085.42	v -560 -561 -562 -563 -564 565 -566 -567 -568 -569 -570 -571 -572 -573 -574
4335.12/1085.42	v -575 -576 -577 578 -579 -580 -581 -582 -583 -584 -585 -586 -587 -588 -589
4335.12/1085.42	v -590 -591 -592 -593 -594 -595 596 -597 -598 -599 -600 -601 -602 -603 -604
4335.12/1085.42	v -605 -606 -607 -608 -609 -610 -611 -612 -613 -614 -615 -616 -617 -618 -619
4335.12/1085.42	v -620 -621 -622 -623 -624 -625 626 -627 -628 -629 -630 -631 -632 -633 634
4335.12/1085.42	v -635 -636 -637 -638 -639 -640 -641 -642 -643 -644 -645 -646 -647 -648 -649
4335.12/1085.42	v -650 -651 -652 -653 -654 655 -656 -657 -658 -659 -660 -661 -662 -663 -664
4335.12/1085.42	v -665 -666 -667 -668 -669 -670 -671 -672 -673 -674 -675 -676 -677 -678 -679
4335.12/1085.42	v 680 -681 -682 -683 -684 -685 -686 -687 -688 -689 -690 -691 -692 -693 -694
4335.12/1085.42	v -695 -696 -697 -698 -699 -700 -701 -702 -703 -704 -705 -706 -707 -708 -709
4335.12/1085.42	v 710 -711 -712 -713 -714 -715 -716 -717 -718 -719 -720 -721 -722 -723 -724
4335.12/1085.42	v -725 -726 -727 -728 -729 -730 -731 -732 733 -734 -735 -736 -737 -738 -739
4335.12/1085.42	v -740 -741 -742 -743 -744 745 -746 -747 -748 -749 -750 -751 -752 -753 -754
4335.12/1085.42	v -755 -756 757 -758 -759 -760 -761 -762 -763 -764 -765 -766 -767 -768 -769
4335.12/1085.42	v -770 -771 -772 -773 -774 -775 -776 -777 -778 -779 -780 -781 -782 -783 -784
4335.12/1085.42	v -785 -786 -787 -788 -789 -790 -791 -792 -793 -794 -795 -796 797 -798 -799
4335.12/1085.42	v -800 -801 -802 -803 -804 -805 806 -807 -808 -809 -810 -811 -812 -813 -814
4335.12/1085.42	v -815 -816 -817 -818 -819 820 -821 -822 -823 -824 -825 -826 -827 -828 -829
4335.12/1085.42	v -830 -831 -832 -833 -834 -835 -836 -837 -838 -839 -840 -841 -842 -843 -844
4335.12/1085.42	v -845 -846 -847 -848 -849 -850 -851 -852 -853 -854 -855 856 -857 -858 -859
4335.12/1085.42	v -860 -861 -862 -863 -864 -865 -866 -867 -868 -869 -870 -871 -872 -873 -874
4335.12/1085.42	v -875 -876 -877 -878 -879 -880 881 -882 -883 -884 -885 -886 -887 -888 -889
4335.12/1085.42	v -890 -891 -892 -893 -894 -895 896 -897 -898 -899 -900 -901 -902 -903 -904
4335.12/1085.42	v -905 -906 -907 -908 -909 -910 911 -912 -913 -914 -915 -916 -917 -918 -919
4335.12/1085.42	v -920 -921 -922 -923 -924 -925 -926 -927 -928 -929 -930 -931 -932 -933 -934
4335.12/1085.42	v -935 936 -937 -938 -939 -940 -941 -942 -943 -944 -945 0
4335.12/1085.48	s SATISFIABLE
4335.12/1085.48	
4335.12/1085.48	c Models        : 1+    
4335.12/1085.48	c Time          : 1085.421s (Solving: 1085.24s 1st Model: 1085.24s Unsat: 0.00s)
4335.12/1085.48	c CPU Time      : 4335.210s

Verifier Data 

OK

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3299546-1304054464/watcher-3299546-1304054464 -o /tmp/evaluation-result-3299546-1304054464/solver-3299546-1304054464 -C 4800 -W 1300 -M 15500 HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3299546-1304054464.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.64 8.08 7.88 2/179 5553
/proc/meminfo: memFree=25102168/32951124 swapFree=67111352/67111528
[pid=5553] ppid=5551 vsize=21532 CPUtime=0 cores=1,3,5,7
/proc/5553/stat : 5553 (claspmt) R 5551 5553 5436 0 -1 4202496 661 0 0 0 0 0 0 0 25 0 1 0 517044576 22048768 584 33554432000 4194304 4964704 140737325171808 18446744073709551615 4599599 0 0 4096 18946 0 0 0 17 1 0 0 0
/proc/5553/statm: 5383 585 385 189 0 257 0

[startup+0.0624441 s]
/proc/loadavg: 7.64 8.08 7.88 2/179 5553
/proc/meminfo: memFree=25102168/32951124 swapFree=67111352/67111528
[pid=5553] ppid=5551 vsize=24796 CPUtime=0.05 cores=1,3,5,7
/proc/5553/stat : 5553 (claspmt) R 5551 5553 5436 0 -1 4202496 1685 0 0 0 5 0 0 0 25 0 1 0 517044576 25391104 1429 33554432000 4194304 4964704 140737325171808 18446744073709551615 4607590 0 0 4096 18946 0 0 0 17 1 0 0 0
/proc/5553/statm: 6199 1429 398 189 0 1073 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 24796

[startup+0.100423 s]
/proc/loadavg: 7.64 8.08 7.88 2/179 5553
/proc/meminfo: memFree=25102168/32951124 swapFree=67111352/67111528
[pid=5553] ppid=5551 vsize=24928 CPUtime=0.09 cores=1,3,5,7
/proc/5553/stat : 5553 (claspmt) R 5551 5553 5436 0 -1 4202496 1720 0 0 0 9 0 0 0 25 0 1 0 517044576 25526272 1464 33554432000 4194304 4964704 140737325171808 18446744073709551615 4600372 0 0 4096 18946 0 0 0 17 1 0 0 0
/proc/5553/statm: 6232 1464 399 189 0 1106 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 24928

[startup+0.637486 s]
/proc/loadavg: 7.64 8.08 7.88 2/179 5553
/proc/meminfo: memFree=25102168/32951124 swapFree=67111352/67111528
[pid=5553] ppid=5551 vsize=239136 CPUtime=3.38 cores=1,3,5,7
/proc/5553/stat : 5553 (claspmt) R 5551 5553 5436 0 -1 4202496 5101 0 0 0 337 1 0 0 19 0 4 0 517044576 244875264 4724 33554432000 4194304 4964704 140737325171808 18446744073709551615 4627204 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/5553/statm: 59784 4724 458 189 0 54133 0
Current children cumulated CPU time (s) 3.38
Current children cumulated vsize (KiB) 239136

[startup+1.09121 s]
/proc/loadavg: 7.64 8.08 7.88 2/179 5553
/proc/meminfo: memFree=25102168/32951124 swapFree=67111352/67111528
[pid=5553] ppid=5551 vsize=239268 CPUtime=3.78 cores=1,3,5,7
/proc/5553/stat : 5553 (claspmt) R 5551 5553 5436 0 -1 4202496 5468 0 0 0 377 1 0 0 19 0 4 0 517044576 245010432 5091 33554432000 4194304 4964704 140737325171808 18446744073709551615 4362293 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/5553/statm: 59817 5091 458 189 0 54166 0
Current children cumulated CPU time (s) 3.78
Current children cumulated vsize (KiB) 239268

[startup+1.50014 s]
/proc/loadavg: 7.64 8.08 7.88 2/179 5553
/proc/meminfo: memFree=25102168/32951124 swapFree=67111352/67111528
[pid=5553] ppid=5551 vsize=240228 CPUtime=5.42 cores=1,3,5,7
/proc/5553/stat : 5553 (claspmt) R 5551 5553 5436 0 -1 4202496 6386 0 0 0 540 2 0 0 19 0 4 0 517044576 245993472 6009 33554432000 4194304 4964704 140737325171808 18446744073709551615 4627299 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/5553/statm: 60057 6009 458 189 0 54406 0
Current children cumulated CPU time (s) 5.42
Current children cumulated vsize (KiB) 240228

[startup+3.10084 s]
/proc/loadavg: 7.64 8.08 7.88 9/188 5587
/proc/meminfo: memFree=25061152/32951124 swapFree=67111352/67111528
[pid=5553] ppid=5551 vsize=240992 CPUtime=11.81 cores=1,3,5,7
/proc/5553/stat : 5553 (claspmt) R 5551 5553 5436 0 -1 4202496 7438 0 0 0 1179 2 0 0 24 0 4 0 517044576 246775808 7061 33554432000 4194304 4964704 140737325171808 18446744073709551615 4320928 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/5553/statm: 60248 7061 460 189 0 54597 0
[pid=5553/tid=5555] ppid=5551 vsize=240992 CPUtime=2.91 cores=1,3,5,7
/proc/5553/task/5555/stat : 5555 (claspmt) R 5551 5553 5436 0 -1 4202560 1539 0 0 0 290 1 0 0 23 0 4 0 517044595 246775808 7061 33554432000 4194304 4964704 140737325171808 18446744073709551615 4668488 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=5553/tid=5556] ppid=5551 vsize=240992 CPUtime=2.91 cores=1,3,5,7
/proc/5553/task/5556/stat : 5556 (claspmt) R 5551 5553 5436 0 -1 4202560 1410 0 0 0 291 0 0 0 25 0 4 0 517044595 246775808 7061 33554432000 4194304 4964704 140737325171808 18446744073709551615 4320951 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=5553/tid=5557] ppid=5551 vsize=240992 CPUtime=2.9 cores=1,3,5,7
/proc/5553/task/5557/stat : 5557 (claspmt) R 5551 5553 5436 0 -1 4202560 1517 0 0 0 290 0 0 0 25 0 4 0 517044595 246775808 7061 33554432000 4194304 4964704 140737325171808 18446744073709551615 4670215 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 11.81
Current children cumulated vsize (KiB) 240992

[startup+6.30026 s]
/proc/loadavg: 7.67 8.08 7.88 9/188 5587
/proc/meminfo: memFree=25045036/32951124 swapFree=67111352/67111528
[pid=5553] ppid=5551 vsize=241528 CPUtime=24.59 cores=1,3,5,7
/proc/5553/stat : 5553 (claspmt) R 5551 5553 5436 0 -1 4202496 8935 0 0 0 2456 3 0 0 25 0 4 0 517044576 247324672 8558 33554432000 4194304 4964704 140737325171808 18446744073709551615 4332327 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/5553/statm: 60382 8558 460 189 0 54731 0
[pid=5553/tid=5555] ppid=5551 vsize=241528 CPUtime=6.1 cores=1,3,5,7
/proc/5553/task/5555/stat : 5555 (claspmt) R 5551 5553 5436 0 -1 4202560 1810 0 0 0 609 1 0 0 25 0 4 0 517044595 247324672 8558 33554432000 4194304 4964704 140737325171808 18446744073709551615 4668946 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=5553/tid=5556] ppid=5551 vsize=241528 CPUtime=6.1 cores=1,3,5,7
/proc/5553/task/5556/stat : 5556 (claspmt) R 5551 5553 5436 0 -1 4202560 1944 0 0 0 610 0 0 0 25 0 4 0 517044595 247324672 8558 33554432000 4194304 4964704 140737325171808 18446744073709551615 4670250 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=5553/tid=5557] ppid=5551 vsize=241528 CPUtime=6.09 cores=1,3,5,7
/proc/5553/task/5557/stat : 5557 (claspmt) R 5551 5553 5436 0 -1 4202560 1761 0 0 0 609 0 0 0 25 0 4 0 517044595 247324672 8558 33554432000 4194304 4964704 140737325171808 18446744073709551615 4670248 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 24.59
Current children cumulated vsize (KiB) 241528

[startup+12.7071 s]
/proc/loadavg: 7.69 8.07 7.88 9/188 5587
/proc/meminfo: memFree=25006376/32951124 swapFree=67111352/67111528
[pid=5553] ppid=5551 vsize=247376 CPUtime=50.18 cores=1,3,5,7
/proc/5553/stat : 5553 (claspmt) R 5551 5553 5436 0 -1 4202496 13471 0 0 0 5013 5 0 0 25 0 4 0 517044576 253313024 13094 33554432000 4194304 4964704 140737325171808 18446744073709551615 4320909 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/5553/statm: 61844 13094 460 189 0 56193 0
[pid=5553/tid=5555] ppid=5551 vsize=247376 CPUtime=12.5 cores=1,3,5,7
/proc/5553/task/5555/stat : 5555 (claspmt) R 5551 5553 5436 0 -1 4202560 3715 0 0 0 1249 1 0 0 25 0 4 0 517044595 253313024 13094 33554432000 4194304 4964704 140737325171808 18446744073709551615 246516531802 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=5553/tid=5556] ppid=5551 vsize=247376 CPUtime=12.51 cores=1,3,5,7
/proc/5553/task/5556/stat : 5556 (claspmt) R 5551 5553 5436 0 -1 4202560 3288 0 0 0 1250 1 0 0 25 0 4 0 517044595 253313024 13094 33554432000 4194304 4964704 140737325171808 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=5553/tid=5557] ppid=5551 vsize=247376 CPUtime=12.5 cores=1,3,5,7
/proc/5553/task/5557/stat : 5557 (claspmt) R 5551 5553 5436 0 -1 4202560 2431 0 0 0 1250 0 0 0 25 0 4 0 517044595 253313024 13094 33554432000 4194304 4964704 140737325171808 18446744073709551615 4627204 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 50.18
Current children cumulated vsize (KiB) 247376

[startup+25.5008 s]
/proc/loadavg: 7.76 8.07 7.88 9/188 5588
/proc/meminfo: memFree=24974636/32951124 swapFree=67111352/67111528
[pid=5553] ppid=5551 vsize=252052 CPUtime=101.28 cores=1,3,5,7
/proc/5553/stat : 5553 (claspmt) R 5551 5553 5436 0 -1 4202496 18432 0 0 0 10119 9 0 0 25 0 4 0 517044576 258101248 18055 33554432000 4194304 4964704 140737325171808 18446744073709551615 4668925 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/5553/statm: 63013 18055 460 189 0 57362 0
[pid=5553/tid=5555] ppid=5551 vsize=252052 CPUtime=25.3 cores=1,3,5,7
/proc/5553/task/5555/stat : 5555 (claspmt) R 5551 5553 5436 0 -1 4202560 5520 0 0 0 2527 3 0 0 25 0 4 0 517044595 258101248 18055 33554432000 4194304 4964704 140737325171808 18446744073709551615 4669056 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=5553/tid=5556] ppid=5551 vsize=252052 CPUtime=25.3 cores=1,3,5,7
/proc/5553/task/5556/stat : 5556 (claspmt) R 5551 5553 5436 0 -1 4202560 4544 0 0 0 2529 1 0 0 25 0 4 0 517044595 258101248 18055 33554432000 4194304 4964704 140737325171808 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=5553/tid=5557] ppid=5551 vsize=252052 CPUtime=25.3 cores=1,3,5,7
/proc/5553/task/5557/stat : 5557 (claspmt) R 5551 5553 5436 0 -1 4202560 3641 0 0 0 2529 1 0 0 25 0 4 0 517044595 258101248 18055 33554432000 4194304 4964704 140737325171808 18446744073709551615 4627290 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 101.28
Current children cumulated vsize (KiB) 252052

[startup+51.1011 s]
/proc/loadavg: 7.97 8.09 7.89 9/188 5588
/proc/meminfo: memFree=24896944/32951124 swapFree=67111352/67111528
[pid=5553] ppid=5551 vsize=263912 CPUtime=203.57 cores=1,3,5,7
/proc/5553/stat : 5553 (claspmt) R 5551 5553 5436 0 -1 4202496 28614 0 0 0 20340 17 0 0 25 0 4 0 517044576 270245888 27762 33554432000 4194304 4964704 140737325171808 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/5553/statm: 65978 27762 460 189 0 60327 0
[pid=5553/tid=5555] ppid=5551 vsize=263912 CPUtime=50.9 cores=1,3,5,7
/proc/5553/task/5555/stat : 5555 (claspmt) R 5551 5553 5436 0 -1 4202560 8816 0 0 0 5085 5 0 0 25 0 4 0 517044595 270245888 27762 33554432000 4194304 4964704 140737325171808 18446744073709551615 4627290 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=5553/tid=5556] ppid=5551 vsize=263912 CPUtime=50.91 cores=1,3,5,7
/proc/5553/task/5556/stat : 5556 (claspmt) R 5551 5553 5436 0 -1 4202560 6591 0 0 0 5089 2 0 0 25 0 4 0 517044595 270245888 27762 33554432000 4194304 4964704 140737325171808 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=5553/tid=5557] ppid=5551 vsize=263912 CPUtime=50.91 cores=1,3,5,7
/proc/5553/task/5557/stat : 5557 (claspmt) R 5551 5553 5436 0 -1 4202560 5908 0 0 0 5087 4 0 0 25 0 4 0 517044595 270245888 27762 33554432000 4194304 4964704 140737325171808 18446744073709551615 4321016 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 203.57
Current children cumulated vsize (KiB) 263912

[startup+102.301 s]
/proc/loadavg: 8.16 8.12 7.91 9/188 5590
/proc/meminfo: memFree=24832820/32951124 swapFree=67111352/67111528
[pid=5553] ppid=5551 vsize=267820 CPUtime=408.06 cores=1,3,5,7
/proc/5553/stat : 5553 (claspmt) R 5551 5553 5436 0 -1 4202496 37736 0 0 0 40780 26 0 0 25 0 4 0 517044576 274247680 36664 33554432000 4194304 4964704 140737325171808 18446744073709551615 4320996 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/5553/statm: 66955 36664 460 189 0 61304 0
[pid=5553/tid=5555] ppid=5551 vsize=267820 CPUtime=102.09 cores=1,3,5,7
/proc/5553/task/5555/stat : 5555 (claspmt) R 5551 5553 5436 0 -1 4202560 12198 0 0 0 10200 9 0 0 25 0 4 0 517044595 274247680 36664 33554432000 4194304 4964704 140737325171808 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=5553/tid=5556] ppid=5551 vsize=267820 CPUtime=102.1 cores=1,3,5,7
/proc/5553/task/5556/stat : 5556 (claspmt) R 5551 5553 5436 0 -1 4202560 8183 0 0 0 10207 3 0 0 25 0 4 0 517044595 274247680 36664 33554432000 4194304 4964704 140737325171808 18446744073709551615 4670454 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=5553/tid=5557] ppid=5551 vsize=267820 CPUtime=102.1 cores=1,3,5,7
/proc/5553/task/5557/stat : 5557 (claspmt) R 5551 5553 5436 0 -1 4202560 7831 0 0 0 10204 6 0 0 25 0 4 0 517044595 274247680 36664 33554432000 4194304 4964704 140737325171808 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 408.06
Current children cumulated vsize (KiB) 267820

[startup+162.307 s]
/proc/loadavg: 8.18 8.13 7.92 10/188 5591
/proc/meminfo: memFree=24779856/32951124 swapFree=67111352/67111528
[pid=5553] ppid=5551 vsize=269932 CPUtime=647.76 cores=1,3,5,7
/proc/5553/stat : 5553 (claspmt) R 5551 5553 5436 0 -1 4202496 45271 0 0 0 64737 39 0 0 25 0 4 0 517044576 276410368 44040 33554432000 4194304 4964704 140737325171808 18446744073709551615 4320924 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/5553/statm: 67483 44040 460 189 0 61832 0
[pid=5553/tid=5555] ppid=5551 vsize=269932 CPUtime=162.1 cores=1,3,5,7
/proc/5553/task/5555/stat : 5555 (claspmt) R 5551 5553 5436 0 -1 4202560 17988 0 0 0 16190 20 0 0 25 0 4 0 517044595 276410368 44040 33554432000 4194304 4964704 140737325171808 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=5553/tid=5556] ppid=5551 vsize=269932 CPUtime=162.11 cores=1,3,5,7
/proc/5553/task/5556/stat : 5556 (claspmt) R 5551 5553 5436 0 -1 4202560 9314 0 0 0 16207 4 0 0 25 0 4 0 517044595 276410368 44040 33554432000 4194304 4964704 140737325171808 18446744073709551615 4670193 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=5553/tid=5557] ppid=5551 vsize=269932 CPUtime=162.1 cores=1,3,5,7
/proc/5553/task/5557/stat : 5557 (claspmt) R 5551 5553 5436 0 -1 4202560 7846 0 0 0 16204 6 0 0 25 0 4 0 517044595 276410368 44040 33554432000 4194304 4964704 140737325171808 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 647.76
Current children cumulated vsize (KiB) 269932

[startup+222.301 s]
/proc/loadavg: 8.18 8.14 7.93 9/188 5593
/proc/meminfo: memFree=24743496/32951124 swapFree=67111352/67111528
[pid=5553] ppid=5551 vsize=280248 CPUtime=887.42 cores=1,3,5,7
/proc/5553/stat : 5553 (claspmt) R 5551 5553 5436 0 -1 4202496 51524 0 0 0 88697 45 0 0 25 0 4 0 517044576 286973952 50186 33554432000 4194304 4964704 140737325171808 18446744073709551615 4325338 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/5553/statm: 70062 50186 460 189 0 64411 0
[pid=5553/tid=5555] ppid=5551 vsize=280248 CPUtime=222.09 cores=1,3,5,7
/proc/5553/task/5555/stat : 5555 (claspmt) R 5551 5553 5436 0 -1 4202560 19892 0 0 0 22188 21 0 0 25 0 4 0 517044595 286973952 50186 33554432000 4194304 4964704 140737325171808 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=5553/tid=5556] ppid=5551 vsize=280248 CPUtime=222.11 cores=1,3,5,7
/proc/5553/task/5556/stat : 5556 (claspmt) R 5551 5553 5436 0 -1 4202560 13122 0 0 0 22203 8 0 0 25 0 4 0 517044595 286973952 50186 33554432000 4194304 4964704 140737325171808 18446744073709551615 4670252 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=5553/tid=5557] ppid=5551 vsize=280248 CPUtime=222.1 cores=1,3,5,7
/proc/5553/task/5557/stat : 5557 (claspmt) R 5551 5553 5436 0 -1 4202560 7960 0 0 0 22204 6 0 0 25 0 4 0 517044595 286973952 50186 33554432000 4194304 4964704 140737325171808 18446744073709551615 4668488 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 887.42
Current children cumulated vsize (KiB) 280248

[startup+282.301 s]
/proc/loadavg: 8.17 8.14 7.94 10/188 5595
/proc/meminfo: memFree=24721140/32951124 swapFree=67111352/67111528
[pid=5553] ppid=5551 vsize=281504 CPUtime=1127.08 cores=1,3,5,7
/proc/5553/stat : 5553 (claspmt) R 5551 5553 5436 0 -1 4202496 54959 0 0 0 112659 49 0 0 25 0 4 0 517044576 288260096 53381 33554432000 4194304 4964704 140737325171808 18446744073709551615 4659143 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/5553/statm: 70376 53381 460 189 0 64725 0
[pid=5553/tid=5555] ppid=5551 vsize=281504 CPUtime=282.08 cores=1,3,5,7

################
# More data... #
################

/proc/5553/task/5557/stat : 5557 (claspmt) R 5551 5553 5436 0 -1 4202560 13093 0 0 0 88199 13 0 0 25 0 4 0 517044595 515493888 75898 33554432000 4194304 4964704 140737325171808 18446744073709551615 4670215 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3523.82
Current children cumulated vsize (KiB) 503412

[startup+942.3 s]
/proc/loadavg: 8.30 8.24 8.08 9/188 5612
/proc/meminfo: memFree=24548016/32951124 swapFree=67111352/67111528
[pid=5553] ppid=5551 vsize=505376 CPUtime=3763.49 cores=1,3,5,7
/proc/5553/stat : 5553 (claspmt) R 5551 5553 5436 0 -1 4202496 81204 0 0 0 376272 77 0 0 25 0 4 0 517044576 517505024 78453 33554432000 4194304 4964704 140737325171808 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/5553/statm: 126344 78453 460 189 0 120693 0
[pid=5553/tid=5555] ppid=5551 vsize=505376 CPUtime=942.06 cores=1,3,5,7
/proc/5553/task/5555/stat : 5555 (claspmt) R 5551 5553 5436 0 -1 4202560 27050 0 0 0 94179 27 0 0 25 0 4 0 517044595 517505024 78453 33554432000 4194304 4964704 140737325171808 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=5553/tid=5556] ppid=5551 vsize=505376 CPUtime=942.12 cores=1,3,5,7
/proc/5553/task/5556/stat : 5556 (claspmt) R 5551 5553 5436 0 -1 4202560 21335 0 0 0 94196 16 0 0 25 0 4 0 517044595 517505024 78453 33554432000 4194304 4964704 140737325171808 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=5553/tid=5557] ppid=5551 vsize=505376 CPUtime=942.11 cores=1,3,5,7
/proc/5553/task/5557/stat : 5557 (claspmt) R 5551 5553 5436 0 -1 4202560 13192 0 0 0 94198 13 0 0 25 0 4 0 517044595 517505024 78453 33554432000 4194304 4964704 140737325171808 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3763.49
Current children cumulated vsize (KiB) 505376

[startup+1002.3 s]
/proc/loadavg: 8.31 8.25 8.10 9/188 5614
/proc/meminfo: memFree=24540544/32951124 swapFree=67111352/67111528
[pid=5553] ppid=5551 vsize=505528 CPUtime=4003.17 cores=1,3,5,7
/proc/5553/stat : 5553 (claspmt) R 5551 5553 5436 0 -1 4202496 81646 0 0 0 400239 78 0 0 25 0 4 0 517044576 517660672 78669 33554432000 4194304 4964704 140737325171808 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/5553/statm: 126382 78669 460 189 0 120731 0
[pid=5553/tid=5555] ppid=5551 vsize=505528 CPUtime=1002.07 cores=1,3,5,7
/proc/5553/task/5555/stat : 5555 (claspmt) R 5551 5553 5436 0 -1 4202560 27405 0 0 0 100179 28 0 0 25 0 4 0 517044595 517660672 78669 33554432000 4194304 4964704 140737325171808 18446744073709551615 4627204 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=5553/tid=5556] ppid=5551 vsize=505528 CPUtime=1002.12 cores=1,3,5,7
/proc/5553/task/5556/stat : 5556 (claspmt) R 5551 5553 5436 0 -1 4202560 21371 0 0 0 100196 16 0 0 25 0 4 0 517044595 517660672 78669 33554432000 4194304 4964704 140737325171808 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=5553/tid=5557] ppid=5551 vsize=505528 CPUtime=1002.11 cores=1,3,5,7
/proc/5553/task/5557/stat : 5557 (claspmt) R 5551 5553 5436 0 -1 4202560 13239 0 0 0 100198 13 0 0 25 0 4 0 517044595 517660672 78669 33554432000 4194304 4964704 140737325171808 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4003.17
Current children cumulated vsize (KiB) 505528

[startup+1062.3 s]
/proc/loadavg: 8.24 8.24 8.10 9/188 5615
/proc/meminfo: memFree=24531344/32951124 swapFree=67111352/67111528
[pid=5553] ppid=5551 vsize=506372 CPUtime=4242.84 cores=1,3,5,7
/proc/5553/stat : 5553 (claspmt) R 5551 5553 5436 0 -1 4202496 82004 0 0 0 424206 78 0 0 25 0 4 0 517044576 518524928 78918 33554432000 4194304 4964704 140737325171808 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/5553/statm: 126593 78918 460 189 0 120942 0
[pid=5553/tid=5555] ppid=5551 vsize=506372 CPUtime=1062.07 cores=1,3,5,7
/proc/5553/task/5555/stat : 5555 (claspmt) R 5551 5553 5436 0 -1 4202560 27689 0 0 0 106179 28 0 0 25 0 4 0 517044595 518524928 78918 33554432000 4194304 4964704 140737325171808 18446744073709551615 4627520 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=5553/tid=5556] ppid=5551 vsize=506372 CPUtime=1062.12 cores=1,3,5,7
/proc/5553/task/5556/stat : 5556 (claspmt) R 5551 5553 5436 0 -1 4202560 21443 0 0 0 106196 16 0 0 25 0 4 0 517044595 518524928 78918 33554432000 4194304 4964704 140737325171808 18446744073709551615 4321069 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=5553/tid=5557] ppid=5551 vsize=506372 CPUtime=1062.12 cores=1,3,5,7
/proc/5553/task/5557/stat : 5557 (claspmt) R 5551 5553 5436 0 -1 4202560 13240 0 0 0 106199 13 0 0 25 0 4 0 517044595 518524928 78918 33554432000 4194304 4964704 140737325171808 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4242.84
Current children cumulated vsize (KiB) 506372

Solver just ended. Dumping a history of the last processes samples

[startup+1062.9 s]
/proc/loadavg: 8.24 8.24 8.10 9/188 5615
/proc/meminfo: memFree=24531344/32951124 swapFree=67111352/67111528
[pid=5553] ppid=5551 vsize=506372 CPUtime=4245.24 cores=1,3,5,7
/proc/5553/stat : 5553 (claspmt) R 5551 5553 5436 0 -1 4202496 82004 0 0 0 424446 78 0 0 25 0 4 0 517044576 518524928 78918 33554432000 4194304 4964704 140737325171808 18446744073709551615 4321020 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/5553/statm: 126593 78918 460 189 0 120942 0
[pid=5553/tid=5555] ppid=5551 vsize=506372 CPUtime=1062.67 cores=1,3,5,7
/proc/5553/task/5555/stat : 5555 (claspmt) R 5551 5553 5436 0 -1 4202560 27689 0 0 0 106239 28 0 0 25 0 4 0 517044595 518524928 78918 33554432000 4194304 4964704 140737325171808 18446744073709551615 4654493 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=5553/tid=5556] ppid=5551 vsize=506372 CPUtime=1062.72 cores=1,3,5,7
/proc/5553/task/5556/stat : 5556 (claspmt) R 5551 5553 5436 0 -1 4202560 21443 0 0 0 106256 16 0 0 25 0 4 0 517044595 518524928 78918 33554432000 4194304 4964704 140737325171808 18446744073709551615 4670248 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=5553/tid=5557] ppid=5551 vsize=506372 CPUtime=1062.72 cores=1,3,5,7
/proc/5553/task/5557/stat : 5557 (claspmt) R 5551 5553 5436 0 -1 4202560 13240 0 0 0 106259 13 0 0 25 0 4 0 517044595 518524928 78918 33554432000 4194304 4964704 140737325171808 18446744073709551615 4321016 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4245.24
Current children cumulated vsize (KiB) 506372

[startup+1075.7 s]
/proc/loadavg: 8.33 8.26 8.10 9/188 5616
/proc/meminfo: memFree=24529232/32951124 swapFree=67111352/67111528
[pid=5553] ppid=5551 vsize=506372 CPUtime=4296.37 cores=1,3,5,7
/proc/5553/stat : 5553 (claspmt) R 5551 5553 5436 0 -1 4202496 82007 0 0 0 429559 78 0 0 25 0 4 0 517044576 518524928 78921 33554432000 4194304 4964704 140737325171808 18446744073709551615 4321102 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/5553/statm: 126593 78921 460 189 0 120942 0
[pid=5553/tid=5555] ppid=5551 vsize=506372 CPUtime=1075.47 cores=1,3,5,7
/proc/5553/task/5555/stat : 5555 (claspmt) R 5551 5553 5436 0 -1 4202560 27689 0 0 0 107519 28 0 0 25 0 4 0 517044595 518524928 78921 33554432000 4194304 4964704 140737325171808 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=5553/tid=5556] ppid=5551 vsize=506372 CPUtime=1075.52 cores=1,3,5,7
/proc/5553/task/5556/stat : 5556 (claspmt) R 5551 5553 5436 0 -1 4202560 21445 0 0 0 107536 16 0 0 25 0 4 0 517044595 518524928 78921 33554432000 4194304 4964704 140737325171808 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=5553/tid=5557] ppid=5551 vsize=506372 CPUtime=1075.52 cores=1,3,5,7
/proc/5553/task/5557/stat : 5557 (claspmt) R 5551 5553 5436 0 -1 4202560 13241 0 0 0 107539 13 0 0 25 0 4 0 517044595 518524928 78921 33554432000 4194304 4964704 140737325171808 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4296.37
Current children cumulated vsize (KiB) 506372

[startup+1082.1 s]
/proc/loadavg: 8.30 8.25 8.10 9/188 5616
/proc/meminfo: memFree=24524520/32951124 swapFree=67111352/67111528
[pid=5553] ppid=5551 vsize=506372 CPUtime=4321.93 cores=1,3,5,7
/proc/5553/stat : 5553 (claspmt) R 5551 5553 5436 0 -1 4202496 82007 0 0 0 432115 78 0 0 25 0 4 0 517044576 518524928 78921 33554432000 4194304 4964704 140737325171808 18446744073709551615 4321016 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/5553/statm: 126593 78921 460 189 0 120942 0
[pid=5553/tid=5555] ppid=5551 vsize=506372 CPUtime=1081.87 cores=1,3,5,7
/proc/5553/task/5555/stat : 5555 (claspmt) R 5551 5553 5436 0 -1 4202560 27689 0 0 0 108159 28 0 0 25 0 4 0 517044595 518524928 78921 33554432000 4194304 4964704 140737325171808 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=5553/tid=5556] ppid=5551 vsize=506372 CPUtime=1081.92 cores=1,3,5,7
/proc/5553/task/5556/stat : 5556 (claspmt) R 5551 5553 5436 0 -1 4202560 21445 0 0 0 108176 16 0 0 25 0 4 0 517044595 518524928 78921 33554432000 4194304 4964704 140737325171808 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=5553/tid=5557] ppid=5551 vsize=506372 CPUtime=1081.92 cores=1,3,5,7
/proc/5553/task/5557/stat : 5557 (claspmt) R 5551 5553 5436 0 -1 4202560 13241 0 0 0 108179 13 0 0 25 0 4 0 517044595 518524928 78921 33554432000 4194304 4964704 140737325171808 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4321.93
Current children cumulated vsize (KiB) 506372

[startup+1083.7 s]
/proc/loadavg: 8.30 8.25 8.10 9/188 5616
/proc/meminfo: memFree=24523768/32951124 swapFree=67111352/67111528
[pid=5553] ppid=5551 vsize=506372 CPUtime=4328.33 cores=1,3,5,7
/proc/5553/stat : 5553 (claspmt) R 5551 5553 5436 0 -1 4202496 82030 0 0 0 432755 78 0 0 25 0 4 0 517044576 518524928 78944 33554432000 4194304 4964704 140737325171808 18446744073709551615 4320909 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/5553/statm: 126593 78944 460 189 0 120942 0
[pid=5553/tid=5555] ppid=5551 vsize=506372 CPUtime=1083.47 cores=1,3,5,7
/proc/5553/task/5555/stat : 5555 (claspmt) R 5551 5553 5436 0 -1 4202560 27689 0 0 0 108319 28 0 0 25 0 4 0 517044595 518524928 78944 33554432000 4194304 4964704 140737325171808 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=5553/tid=5556] ppid=5551 vsize=506372 CPUtime=1083.52 cores=1,3,5,7
/proc/5553/task/5556/stat : 5556 (claspmt) R 5551 5553 5436 0 -1 4202560 21468 0 0 0 108336 16 0 0 25 0 4 0 517044595 518524928 78944 33554432000 4194304 4964704 140737325171808 18446744073709551615 4670462 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=5553/tid=5557] ppid=5551 vsize=506372 CPUtime=1083.52 cores=1,3,5,7
/proc/5553/task/5557/stat : 5557 (claspmt) R 5551 5553 5436 0 -1 4202560 13241 0 0 0 108339 13 0 0 25 0 4 0 517044595 518524928 78944 33554432000 4194304 4964704 140737325171808 18446744073709551615 4668488 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4328.33
Current children cumulated vsize (KiB) 506372

[startup+1084.5 s]
/proc/loadavg: 8.28 8.25 8.10 9/188 5616
/proc/meminfo: memFree=24523272/32951124 swapFree=67111352/67111528
[pid=5553] ppid=5551 vsize=506372 CPUtime=4331.52 cores=1,3,5,7
/proc/5553/stat : 5553 (claspmt) R 5551 5553 5436 0 -1 4202496 82032 0 0 0 433074 78 0 0 25 0 4 0 517044576 518524928 78946 33554432000 4194304 4964704 140737325171808 18446744073709551615 4321102 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/5553/statm: 126593 78946 460 189 0 120942 0
[pid=5553/tid=5555] ppid=5551 vsize=506372 CPUtime=1084.27 cores=1,3,5,7
/proc/5553/task/5555/stat : 5555 (claspmt) R 5551 5553 5436 0 -1 4202560 27689 0 0 0 108399 28 0 0 25 0 4 0 517044595 518524928 78946 33554432000 4194304 4964704 140737325171808 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=5553/tid=5556] ppid=5551 vsize=506372 CPUtime=1084.32 cores=1,3,5,7
/proc/5553/task/5556/stat : 5556 (claspmt) R 5551 5553 5436 0 -1 4202560 21470 0 0 0 108416 16 0 0 25 0 4 0 517044595 518524928 78946 33554432000 4194304 4964704 140737325171808 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=5553/tid=5557] ppid=5551 vsize=506372 CPUtime=1084.32 cores=1,3,5,7
/proc/5553/task/5557/stat : 5557 (claspmt) R 5551 5553 5436 0 -1 4202560 13241 0 0 0 108419 13 0 0 25 0 4 0 517044595 518524928 78946 33554432000 4194304 4964704 140737325171808 18446744073709551615 4320970 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4331.52
Current children cumulated vsize (KiB) 506372

[startup+1084.9 s]
/proc/loadavg: 8.28 8.25 8.10 9/188 5616
/proc/meminfo: memFree=24523272/32951124 swapFree=67111352/67111528
[pid=5553] ppid=5551 vsize=506372 CPUtime=4333.12 cores=1,3,5,7
/proc/5553/stat : 5553 (claspmt) R 5551 5553 5436 0 -1 4202496 82066 0 0 0 433234 78 0 0 25 0 4 0 517044576 518524928 78980 33554432000 4194304 4964704 140737325171808 18446744073709551615 4332288 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/5553/statm: 126593 78980 460 189 0 120942 0
[pid=5553/tid=5555] ppid=5551 vsize=506372 CPUtime=1084.67 cores=1,3,5,7
/proc/5553/task/5555/stat : 5555 (claspmt) R 5551 5553 5436 0 -1 4202560 27689 0 0 0 108439 28 0 0 25 0 4 0 517044595 518524928 78980 33554432000 4194304 4964704 140737325171808 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=5553/tid=5556] ppid=5551 vsize=506372 CPUtime=1084.72 cores=1,3,5,7
/proc/5553/task/5556/stat : 5556 (claspmt) R 5551 5553 5436 0 -1 4202560 21504 0 0 0 108456 16 0 0 25 0 4 0 517044595 518524928 78980 33554432000 4194304 4964704 140737325171808 18446744073709551615 4627204 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=5553/tid=5557] ppid=5551 vsize=506372 CPUtime=1084.72 cores=1,3,5,7
/proc/5553/task/5557/stat : 5557 (claspmt) R 5551 5553 5436 0 -1 4202560 13241 0 0 0 108459 13 0 0 25 0 4 0 517044595 518524928 78980 33554432000 4194304 4964704 140737325171808 18446744073709551615 4684027 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4333.12
Current children cumulated vsize (KiB) 506372

[startup+1085.3 s]
/proc/loadavg: 8.28 8.25 8.10 9/188 5616
/proc/meminfo: memFree=24522280/32951124 swapFree=67111352/67111528
[pid=5553] ppid=5551 vsize=506372 CPUtime=4334.72 cores=1,3,5,7
/proc/5553/stat : 5553 (claspmt) R 5551 5553 5436 0 -1 4202496 82076 0 0 0 433394 78 0 0 25 0 4 0 517044576 518524928 78990 33554432000 4194304 4964704 140737325171808 18446744073709551615 4321102 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/5553/statm: 126593 78990 460 189 0 120942 0
[pid=5553/tid=5555] ppid=5551 vsize=506372 CPUtime=1085.07 cores=1,3,5,7
/proc/5553/task/5555/stat : 5555 (claspmt) R 5551 5553 5436 0 -1 4202560 27689 0 0 0 108479 28 0 0 25 0 4 0 517044595 518524928 78990 33554432000 4194304 4964704 140737325171808 18446744073709551615 4670243 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=5553/tid=5556] ppid=5551 vsize=506372 CPUtime=1085.12 cores=1,3,5,7
/proc/5553/task/5556/stat : 5556 (claspmt) R 5551 5553 5436 0 -1 4202560 21514 0 0 0 108496 16 0 0 25 0 4 0 517044595 518524928 78990 33554432000 4194304 4964704 140737325171808 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=5553/tid=5557] ppid=5551 vsize=506372 CPUtime=1085.12 cores=1,3,5,7
/proc/5553/task/5557/stat : 5557 (claspmt) R 5551 5553 5436 0 -1 4202560 13241 0 0 0 108499 13 0 0 25 0 4 0 517044595 518524928 78990 33554432000 4194304 4964704 140737325171808 18446744073709551615 4320872 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4334.72
Current children cumulated vsize (KiB) 506372

[startup+1085.4 s]
/proc/loadavg: 8.28 8.25 8.10 9/188 5616
/proc/meminfo: memFree=24522280/32951124 swapFree=67111352/67111528
[pid=5553] ppid=5551 vsize=506372 CPUtime=4335.12 cores=1,3,5,7
/proc/5553/stat : 5553 (claspmt) R 5551 5553 5436 0 -1 4202496 82077 0 0 0 433434 78 0 0 25 0 4 0 517044576 518524928 78991 33554432000 4194304 4964704 140737325171808 18446744073709551615 4362287 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/5553/statm: 126593 78991 460 189 0 120942 0
[pid=5553/tid=5555] ppid=5551 vsize=506372 CPUtime=1085.17 cores=1,3,5,7
/proc/5553/task/5555/stat : 5555 (claspmt) R 5551 5553 5436 0 -1 4202560 27689 0 0 0 108489 28 0 0 25 0 4 0 517044595 518524928 78991 33554432000 4194304 4964704 140737325171808 18446744073709551615 4670458 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=5553/tid=5556] ppid=5551 vsize=506372 CPUtime=1085.22 cores=1,3,5,7
/proc/5553/task/5556/stat : 5556 (claspmt) R 5551 5553 5436 0 -1 4202560 21515 0 0 0 108506 16 0 0 25 0 4 0 517044595 518524928 78991 33554432000 4194304 4964704 140737325171808 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=5553/tid=5557] ppid=5551 vsize=506372 CPUtime=1085.22 cores=1,3,5,7
/proc/5553/task/5557/stat : 5557 (claspmt) R 5551 5553 5436 0 -1 4202560 13241 0 0 0 108509 13 0 0 25 0 4 0 517044595 518524928 78991 33554432000 4194304 4964704 140737325171808 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4335.12
Current children cumulated vsize (KiB) 506372

Child status: 10
Real time (s): 1085.49
CPU time (s): 4335.28
CPU user time (s): 4334.48
CPU system time (s): 0.801878
CPU usage (%): 399.385
Max. virtual memory (cumulated for all children) (KiB): 506372

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4334.48
system time used= 0.801878
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 82089
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 4686
involuntary context switches= 31486

runsolver used 1.63975 second user time and 4.28235 second system time

The end

Launcher Data 

Begin job on node134 at 2011-04-29 07:21:04
IDJOB=3299546
IDBENCH=71481
IDSOLVER=1683
FILE ID=node134/3299546-1304054464
RUNJOBID= node134-1304053259-5455
PBS_JOBID= 13170420
Free space on /tmp= 71580 MiB

SOLVER NAME= claspmt 2.0-R4095
BENCH NAME= SAT09/CRAFTED/rbsat/crafted/unforced/rbsat-v945c61409g3.cnf
COMMAND LINE= HOME/claspmt -tNBCORE -p HOME/sat11-port.txt --distribute=all,2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3299546-1304054464/watcher-3299546-1304054464 -o /tmp/evaluation-result-3299546-1304054464/solver-3299546-1304054464 -C 4800 -W 1300 -M 15500  HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3299546-1304054464.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 4de3b21cb74a7ec60763201555524736
RANDOM SEED=621306821

node134.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 7186.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      25102440 kB
Buffers:       1474308 kB
Cached:        5787368 kB
SwapCached:         64 kB
Active:        1406160 kB
Inactive:      5921440 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      25102440 kB
SwapTotal:    67111528 kB
SwapFree:     67111352 kB
Dirty:            1588 kB
Writeback:           0 kB
AnonPages:       65648 kB
Mapped:          15480 kB
Slab:           457992 kB
PageTables:       4384 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   218996 kB
VmallocTotal: 34359738367 kB
VmallocUsed:     33868 kB
VmallocChunk: 34359703231 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71580 MiB
End job on node134 at 2011-04-29 07:39:09