Trace number 3449111

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Satisfiability Solver Selector 2011-03-18 (1200 s timeout)SAT 976.02 976.251

General information on the benchmark

Namerandom/large/
unif-k5-r20-v1250-c25000-S540595895-046-UNKNOWN.cnf
MD5SUMc6c08a5348a127e8ddd50935c46cf427
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark107.787
Satisfiable
(Un)Satisfiability was proved
Number of variables1250
Number of clauses25000
Sum of the clauses size125000
Maximum clause length5
Minimum clause length5
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 525000
Number of clauses of size over 50

Solver Data 

14.14/14.23	c COMMAND LINE: portfolio_solver.py -t 1200 -s 546156729 HOME/instance-3449111-1307053646.cnf
14.14/14.23	c    tmpdir         WORKING-DIR
14.14/14.23	c    timelimit      1200
14.14/14.23	c    seed           546156729
14.14/14.23	c    verbosity      0
14.14/14.23	c Parsed command line and set default values...
14.14/14.23	c Starting *WALL CLOCK* TIMER
14.14/14.23	c Found WORKING-DIR/coach-executables-test-SUCCESS.txt
14.14/14.23	c   indicating coach-executables-test.sh was run successfully earlier
14.14/14.23	c Making sure all necessary files and folders are present...
14.14/14.23	c   Checking for ./features                            OK
14.14/14.23	c   Checking for COACH/coach                           OK
14.14/14.23	c   Checking for preprocessors/SatELite_v1.0_linux     OK
14.14/14.23	c   Checking for solvers/adaptg2wsat2009               OK
14.14/14.23	c   Checking for solvers/adaptg2wsat2009++             OK
14.14/14.23	c   Checking for solvers/clasp-1.3.6-x86-linux         OK
14.14/14.23	c   Checking for solvers/cryptominisat                 OK
14.14/14.23	c   Checking for solvers/glucose_static                OK
14.14/14.23	c   Checking for solvers/gnovelty+2                    OK
14.14/14.23	c   Checking for solvers/gnovelty+2-H                  OK
14.14/14.23	c   Checking for solvers/hybridGM3                     OK
14.14/14.23	c   Checking for solvers/kcnfs04SAT07                  OK
14.14/14.23	c   Checking for solvers/lingeling                     OK
14.14/14.23	c   Checking for solvers/LySATc                        OK
14.14/14.23	c   Checking for solvers/LySATi                        OK
14.14/14.23	c   Checking for solvers/march_hi                      OK
14.14/14.23	c   Checking for solvers/march_nn                      OK
14.14/14.23	c   Checking for solvers/minisat_static                OK
14.14/14.23	c   Checking for solvers/mxc-sat09                     OK
14.14/14.23	c   Checking for solvers/picosat                       OK
14.14/14.23	c   Checking for solvers/precosat                      OK
14.14/14.23	c   Checking for solvers/SATenstein                    OK
14.14/14.23	c   Checking for solvers/TNM                           OK
14.14/14.23	c   Checking for solvers/ubcsatOrig                    OK
14.14/14.23	c   Checking for utilities/timerun                     OK
14.14/14.23	c   Checking for folder COACH/DATA                     OK
14.14/14.23	c   Checking for file unif-k3-r4.2-v18000-c75600-S914323646-060.cnf OK
14.14/14.23	c Check successful
14.14/14.23	c TIMER: 0.0 sec total, 0.0 sec since previous report
14.14/14.23	c Computing instance features...
14.14/14.23	c    ./features HOME/instance-3449111-1307053646.cnf
14.14/14.23	c    Features found: 1250 25000 0.05 0.004 0.100094355 0.00264 0.00536 3.68573096 0.004 2.16840434e-16 0.004 0.004 -0 0.37272 0.653069327 0.2 1 0.826477122 0.0799524713 0.0587076598 0 0.333333333 3.01123647 0 0 0 0.00073664 0.230795752 0.00028 0.00132 2.85257267 0.18416 0.01370336 0.0866357525 0.00944 0.01792 0.0176551724 -1 -0 -1 0 -1 -1 -0 -1 0 -0 -1
14.14/14.23	c TIMER: 13.87 sec total, 13.87 sec since previous report
14.14/14.23	c Computing most promising solver to run...
14.14/14.23	c    COACH/coach 1250 25000 0.05 0.004 0.100094355 0.00264 0.00536 3.68573096 0.004 2.16840434e-16 0.004 0.004 -0 0.37272 0.653069327 0.2 1 0.826477122 0.0799524713 0.0587076598 0 0.333333333 3.01123647 0 0 0 0.00073664 0.230795752 0.00028 0.00132 2.85257267 0.18416 0.01370336 0.0866357525 0.00944 0.01792 0.0176551724 -1 -0 -1 0 -1 -1 -0 -1 0 -0 -1 COACH/DATA/ 1
14.14/14.23	c    PORTFOLIO-SUGGESTION SOLVER cryptominisat 4 0
14.14/14.23	c    PORTFOLIO-SUGGESTION SOLVER adaptg2wsat2009 4 0
14.14/14.23	c    PORTFOLIO-SUGGESTION SOLVER precosat 4 0
14.14/14.23	c    PORTFOLIO-SUGGESTION SOLVER march_hi 4 0
14.14/14.23	c    PORTFOLIO-SUGGESTION SOLVER hybridGM3 4 0
14.14/14.23	c    PORTFOLIO-SUGGESTION SOLVER lingeling 4 0
14.14/14.23	c    PORTFOLIO-SUGGESTION SOLVER gnovelty+2 4 0
14.14/14.23	c    PORTFOLIO-SUGGESTION SOLVER TNM 4 0
14.14/14.23	c    PORTFOLIO-SUGGESTION SOLVER AshiHgen 4 0
14.14/14.23	c    PORTFOLIO-SUGGESTION SOLVER mxc-sat09 4 0
14.14/14.23	c    PORTFOLIO-SUGGESTION SOLVER gnovelty+2-H 100000 0
14.14/14.23	c TIMER: 14.21 sec total, 0.34 sec since previous report
14.14/14.23	c Preprocessing OFF
14.14/14.23	c Solvers and corresponding runtimes to be used, and whether on the preprocessed instance:
14.14/14.23	c    cryptominisat   	              4 	False
14.14/14.23	c    adaptg2wsat2009 	              4 	False
14.14/14.23	c    precosat        	              4 	False
14.14/14.23	c    march_hi        	              4 	False
14.14/14.23	c    hybridGM3       	              4 	False
14.14/14.23	c    lingeling       	              4 	False
14.14/14.23	c    gnovelty+2      	              4 	False
976.02/976.24	c    TNM             	              4 	False
976.02/976.24	c    AshiHgen        	              4 	False
976.02/976.24	c    mxc-sat09       	              4 	False
976.02/976.24	c    gnovelty+2-H    	         100000 	False
976.02/976.24	c Default solver to fall back on, in case everything fails:
976.02/976.24	c    lingeling       	       no limit 	False
976.02/976.24	c Running cryptominisat for 4 seconds on HOME/instance-3449111-1307053646.cnf
976.02/976.24	c    utilities/timerun 4 solvers/cryptominisat HOME/instance-3449111-1307053646.cnf
976.02/976.24	c TIMER: 18.22 sec total, 4.01 sec since previous report
976.02/976.24	c Running adaptg2wsat2009 for 4 seconds on HOME/instance-3449111-1307053646.cnf
976.02/976.24	c    utilities/timerun 4 solvers/adaptg2wsat2009 HOME/instance-3449111-1307053646.cnf
976.02/976.24	c TIMER: 22.22 sec total, 4.01 sec since previous report
976.02/976.24	c Running precosat for 4 seconds on HOME/instance-3449111-1307053646.cnf
976.02/976.24	c    utilities/timerun 4 solvers/precosat HOME/instance-3449111-1307053646.cnf
976.02/976.24	c TIMER: 26.23 sec total, 4.01 sec since previous report
976.02/976.24	c Running march_hi for 4 seconds on HOME/instance-3449111-1307053646.cnf
976.02/976.24	c    utilities/timerun 4 solvers/march_hi HOME/instance-3449111-1307053646.cnf
976.02/976.24	c TIMER: 30.23 sec total, 4.0 sec since previous report
976.02/976.24	c Running hybridGM3 for 4 seconds on HOME/instance-3449111-1307053646.cnf
976.02/976.24	c    utilities/timerun 4 solvers/hybridGM3 HOME/instance-3449111-1307053646.cnf
976.02/976.24	c TIMER: 34.24 sec total, 4.01 sec since previous report
976.02/976.24	c Running lingeling for 4 seconds on HOME/instance-3449111-1307053646.cnf
976.02/976.24	c    utilities/timerun 4 solvers/lingeling HOME/instance-3449111-1307053646.cnf
976.02/976.24	c TIMER: 38.24 sec total, 4.0 sec since previous report
976.02/976.24	c Running gnovelty+2 for 4 seconds on HOME/instance-3449111-1307053646.cnf
976.02/976.24	c    utilities/timerun 4 solvers/gnovelty+2 HOME/instance-3449111-1307053646.cnf
976.02/976.24	c TIMER: 42.24 sec total, 4.0 sec since previous report
976.02/976.24	c Running TNM for 4 seconds on HOME/instance-3449111-1307053646.cnf
976.02/976.24	c    utilities/timerun 4 solvers/TNM HOME/instance-3449111-1307053646.cnf
976.02/976.24	c TIMER: 46.26 sec total, 4.01 sec since previous report
976.02/976.24	c Running AshiHgen for 4 seconds on HOME/instance-3449111-1307053646.cnf
976.02/976.24	c    utilities/timerun 4 solvers/SATenstein -i HOME/instance-3449111-1307053646.cnf -alg satenstein -varinfalse 1 -adaptwalkprob 0 -theta 3 -singleclause 1 -randomwalk 3 -performrandomwalk 1 -selectclause 1 -promisinglist 0 -adaptiveprom 0 -heuristic 7 -adaptive 1 -phi 10 -tabusearch 0 -rdp 0.15 -r satcomp  -cutoff max -runs 100 -solve -seed 546156729 
976.02/976.24	c TIMER: 50.28 sec total, 4.02 sec since previous report
976.02/976.24	c Running mxc-sat09 for 4 seconds on HOME/instance-3449111-1307053646.cnf
976.02/976.24	c    utilities/timerun 4 solvers/mxc-sat09 -i HOME/instance-3449111-1307053646.cnf
976.02/976.24	c TIMER: 54.3 sec total, 4.02 sec since previous report
976.02/976.24	c Running gnovelty+2-H for 100000 seconds on HOME/instance-3449111-1307053646.cnf
976.02/976.24	c    utilities/timerun 100000 solvers/gnovelty+2-H HOME/instance-3449111-1307053646.cnf
976.02/976.24	c TIMER: 976.22 sec total, 921.92 sec since previous report
976.02/976.24	c Instance solved!
976.02/976.24	s SATISFIABLE
976.02/976.24	v 1 2 -3 4 -5 -6 7 -8 -9 -10 11 12 -13 -14 15 16 -17 18 19 20
976.02/976.24	v -21 -22 -23 24 -25 -26 -27 -28 -29 30 31 32 -33 34 -35 36 37 -38 -39 40
976.02/976.24	v 41 42 -43 -44 -45 -46 -47 48 -49 50 51 -52 53 54 -55 -56 -57 -58 -59 60
976.02/976.24	v 61 62 63 -64 -65 -66 67 -68 -69 70 71 -72 73 74 -75 76 77 -78 -79 -80
976.02/976.24	v -81 82 83 -84 -85 86 87 -88 -89 90 91 92 -93 94 95 -96 -97 -98 99 100
976.02/976.24	v 101 102 -103 -104 -105 106 107 -108 109 -110 111 -112 -113 114 -115 116 117 -118 119 -120
976.02/976.24	v 121 122 123 124 125 -126 127 -128 129 -130 131 -132 -133 -134 135 136 137 138 139 140
976.02/976.24	v -141 142 143 -144 -145 146 147 148 -149 -150 -151 152 153 -154 155 -156 157 -158 -159 -160
976.02/976.24	v -161 162 163 164 -165 -166 -167 -168 -169 -170 -171 -172 173 174 -175 176 177 -178 179 -180
976.02/976.24	v -181 182 183 -184 -185 186 -187 188 -189 -190 191 -192 -193 -194 195 196 197 -198 199 200
976.02/976.24	v -201 202 -203 204 205 -206 -207 208 209 -210 -211 -212 213 -214 215 -216 217 218 -219 220
976.02/976.24	v -221 -222 -223 224 225 -226 227 -228 229 -230 -231 232 -233 -234 -235 236 237 -238 239 240
976.02/976.24	v 241 242 -243 244 -245 246 -247 -248 -249 250 -251 252 -253 -254 255 256 -257 -258 259 260
976.02/976.24	v 261 262 263 264 265 266 267 -268 -269 -270 271 272 273 -274 275 -276 -277 -278 -279 -280
976.02/976.24	v 281 282 283 -284 285 -286 287 288 -289 290 291 292 -293 -294 -295 296 -297 298 299 -300
976.02/976.24	v -301 -302 303 304 -305 -306 -307 -308 -309 -310 311 312 313 314 -315 -316 -317 318 319 320
976.02/976.24	v 321 -322 323 -324 325 -326 327 328 -329 330 -331 -332 333 -334 -335 -336 -337 -338 -339 -340
976.02/976.24	v 341 342 -343 344 345 346 347 348 349 350 351 352 353 -354 355 356 357 -358 -359 360
976.02/976.24	v -361 362 363 -364 -365 -366 367 368 369 -370 -371 372 373 374 -375 376 377 -378 -379 -380
976.02/976.24	v 381 -382 -383 -384 -385 386 -387 388 -389 390 391 -392 393 394 395 396 -397 -398 399 400
976.02/976.24	v -401 402 403 404 -405 -406 407 408 409 410 411 -412 413 -414 415 -416 417 -418 419 420
976.02/976.24	v -421 422 -423 424 425 426 -427 428 429 430 431 -432 433 -434 435 436 437 -438 439 -440
976.02/976.24	v -441 -442 443 444 445 446 447 -448 -449 450 451 -452 453 454 455 -456 -457 -458 -459 460
976.02/976.24	v -461 462 463 464 465 -466 467 468 469 -470 471 472 -473 474 -475 -476 477 478 -479 -480
976.02/976.24	v 481 482 483 484 -485 486 -487 488 -489 490 491 -492 -493 -494 495 -496 -497 -498 499 500
976.02/976.24	v -501 -502 503 504 505 -506 -507 508 -509 510 -511 -512 513 514 -515 516 -517 518 519 -520
976.02/976.24	v -521 -522 -523 524 -525 -526 527 -528 -529 530 531 -532 533 -534 -535 536 -537 538 539 -540
976.02/976.24	v 541 542 543 -544 -545 -546 -547 548 549 -550 -551 -552 -553 554 -555 556 -557 -558 559 560
976.02/976.24	v -561 -562 563 564 -565 -566 -567 568 -569 -570 571 -572 -573 574 575 576 577 -578 -579 -580
976.02/976.24	v -581 -582 -583 584 585 -586 -587 -588 -589 -590 591 -592 593 594 -595 596 -597 -598 599 600
976.02/976.24	v -601 -602 603 -604 -605 -606 -607 -608 609 -610 611 -612 613 614 -615 616 617 618 619 620
976.02/976.24	v -621 -622 -623 -624 625 -626 -627 -628 629 630 -631 -632 633 634 635 -636 637 -638 -639 640
976.02/976.24	v -641 642 -643 -644 645 -646 647 -648 -649 650 651 -652 -653 -654 -655 656 657 658 -659 -660
976.02/976.24	v -661 662 663 -664 -665 -666 -667 -668 669 -670 671 672 673 -674 675 -676 -677 678 -679 -680
976.02/976.24	v -681 -682 -683 684 -685 686 -687 688 689 690 691 692 693 694 695 696 697 -698 699 700
976.02/976.24	v -701 -702 -703 704 -705 -706 -707 -708 709 -710 -711 -712 -713 714 -715 716 717 -718 -719 720
976.02/976.24	v -721 -722 -723 -724 -725 726 727 -728 -729 730 -731 732 733 734 -735 -736 -737 738 -739 -740
976.02/976.24	v -741 742 743 -744 -745 -746 747 -748 749 -750 -751 -752 -753 754 -755 756 757 -758 759 760
976.02/976.24	v 761 -762 763 764 765 -766 -767 768 -769 770 -771 -772 -773 774 -775 -776 777 778 -779 -780
976.02/976.24	v -781 782 783 -784 -785 -786 -787 788 789 -790 791 792 -793 -794 795 -796 797 -798 799 800
976.02/976.24	v -801 -802 -803 -804 805 806 807 -808 -809 810 811 -812 -813 814 -815 816 -817 818 -819 820
976.02/976.24	v -821 822 -823 824 825 826 -827 -828 -829 830 -831 -832 833 834 -835 -836 837 838 -839 -840
976.02/976.24	v -841 842 843 844 -845 846 847 -848 -849 -850 -851 -852 -853 -854 -855 856 857 858 859 860
976.02/976.24	v 861 -862 -863 864 -865 866 -867 -868 -869 -870 871 -872 -873 874 875 876 877 878 879 880
976.02/976.24	v 881 -882 -883 -884 -885 886 -887 -888 889 890 -891 -892 -893 894 -895 896 -897 -898 -899 900
976.02/976.24	v 901 902 903 -904 905 -906 907 -908 909 910 -911 912 -913 -914 -915 -916 -917 -918 -919 -920
976.02/976.24	v -921 -922 -923 -924 925 926 -927 -928 -929 930 -931 932 -933 934 -935 936 -937 -938 939 -940
976.02/976.24	v 941 -942 -943 -944 -945 -946 -947 -948 -949 -950 951 -952 953 954 -955 -956 -957 -958 -959 -960
976.02/976.24	v -961 -962 963 964 -965 966 967 968 969 -970 -971 -972 973 -974 -975 976 -977 -978 979 980
976.02/976.24	v 981 -982 983 984 985 986 -987 988 989 -990 991 -992 -993 994 -995 996 997 998 999 -1000
976.02/976.24	v -1001 -1002 1003 1004 1005 1006 -1007 1008 -1009 1010 -1011 1012 -1013 -1014 -1015 1016 1017 -1018 1019 -1020
976.02/976.25	v -1021 -1022 -1023 1024 1025 -1026 -1027 1028 -1029 -1030 -1031 -1032 -1033 1034 -1035 -1036 1037 -1038 -1039 1040
976.02/976.25	v 1041 -1042 -1043 1044 -1045 -1046 1047 1048 1049 1050 -1051 -1052 1053 -1054 -1055 -1056 -1057 1058 -1059 -1060
976.02/976.25	v -1061 1062 1063 1064 1065 1066 -1067 -1068 1069 1070 -1071 -1072 -1073 1074 -1075 -1076 -1077 1078 -1079 -1080
976.02/976.25	v -1081 -1082 1083 1084 1085 -1086 1087 1088 -1089 1090 1091 1092 1093 -1094 -1095 1096 1097 1098 -1099 1100
976.02/976.25	v -1101 1102 1103 1104 -1105 -1106 -1107 -1108 -1109 -1110 -1111 1112 1113 -1114 1115 -1116 -1117 1118 -1119 -1120
976.02/976.25	v 1121 -1122 1123 -1124 1125 -1126 1127 -1128 1129 -1130 1131 1132 -1133 -1134 -1135 -1136 1137 1138 -1139 -1140
976.02/976.25	v 1141 1142 1143 1144 -1145 -1146 -1147 1148 -1149 -1150 1151 1152 -1153 -1154 -1155 1156 -1157 -1158 -1159 -1160
976.02/976.25	v 1161 -1162 -1163 -1164 -1165 -1166 -1167 1168 1169 -1170 -1171 1172 -1173 1174 1175 -1176 1177 -1178 1179 -1180
976.02/976.25	v -1181 -1182 -1183 -1184 -1185 -1186 1187 1188 -1189 -1190 -1191 -1192 -1193 1194 1195 1196 -1197 1198 -1199 -1200
976.02/976.25	v 1201 1202 1203 1204 -1205 1206 1207 -1208 1209 1210 1211 -1212 -1213 1214 1215 1216 1217 1218 -1219 1220
976.02/976.25	v 1221 -1222 -1223 -1224 -1225 1226 1227 -1228 -1229 -1230 1231 1232 1233 1234 -1235 1236 1237 1238 -1239 1240
976.02/976.25	v 1241 -1242 -1243 1244 -1245 1246 1247 -1248 -1249 -1250 0
976.02/976.25	c TIMER: 976.22 sec total, 0.0 sec since previous report

Verifier Data 

OK

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3449111-1307053646/watcher-3449111-1307053646 -o /tmp/evaluation-result-3449111-1307053646/solver-3449111-1307053646 -C 1200 -W 1300 -M 7680 python portfolio_solver.py -t 1200 -s 546156729 HOME/instance-3449111-1307053646.cnf 

running on 2 cores: 4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1200 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1230 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 7864320 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 7915520 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 4.05 4.04 2.96 4/445 18943
/proc/meminfo: memFree=25889088/32951124 swapFree=44043512/67111528
[pid=18943] ppid=18941 vsize=16240 CPUtime=0 cores=4,6
/proc/18943/stat : 18943 (python) R 18941 18943 18352 0 -1 4202496 997 0 0 0 0 0 0 0 20 0 1 0 816962932 16629760 870 33554432000 4194304 5683644 140733489308672 18446744073709551615 246516495045 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/18943/statm: 4060 870 368 364 0 547 0

[startup+0.032244 s]
/proc/loadavg: 4.05 4.04 2.96 4/445 18943
/proc/meminfo: memFree=25889088/32951124 swapFree=44043512/67111528
[pid=18943] ppid=18941 vsize=21896 CPUtime=0.02 cores=4,6
/proc/18943/stat : 18943 (python) S 18941 18943 18352 0 -1 4202496 1516 0 0 0 2 0 0 0 20 0 1 0 816962932 22421504 1350 33554432000 4194304 5683644 140733489308672 18446744073709551615 246516834048 0 0 16781312 2 18446744071562362840 0 0 17 4 0 0 0
/proc/18943/statm: 5474 1350 443 364 0 929 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 21896

[startup+0.100263 s]
/proc/loadavg: 4.05 4.04 2.96 4/445 18943
/proc/meminfo: memFree=25889088/32951124 swapFree=44043512/67111528
[pid=18943] ppid=18941 vsize=21896 CPUtime=0.02 cores=4,6
/proc/18943/stat : 18943 (python) S 18941 18943 18352 0 -1 4202496 1516 0 0 0 2 0 0 0 20 0 1 0 816962932 22421504 1350 33554432000 4194304 5683644 140733489308672 18446744073709551615 246516834048 0 0 16781312 2 18446744071562362840 0 0 17 4 0 0 0
/proc/18943/statm: 5474 1350 443 364 0 929 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 21896

[startup+0.300253 s]
/proc/loadavg: 4.05 4.04 2.96 4/445 18943
/proc/meminfo: memFree=25889088/32951124 swapFree=44043512/67111528
[pid=18943] ppid=18941 vsize=21896 CPUtime=0.02 cores=4,6
/proc/18943/stat : 18943 (python) S 18941 18943 18352 0 -1 4202496 1516 0 0 0 2 0 0 0 20 0 1 0 816962932 22421504 1350 33554432000 4194304 5683644 140733489308672 18446744073709551615 246516834048 0 0 16781312 2 18446744071562362840 0 0 17 4 0 0 0
/proc/18943/statm: 5474 1350 443 364 0 929 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 21896

[startup+0.701179 s]
/proc/loadavg: 4.05 4.04 2.96 4/445 18943
/proc/meminfo: memFree=25889088/32951124 swapFree=44043512/67111528
[pid=18943] ppid=18941 vsize=21896 CPUtime=0.02 cores=4,6
/proc/18943/stat : 18943 (python) S 18941 18943 18352 0 -1 4202496 1516 0 0 0 2 0 0 0 20 0 1 0 816962932 22421504 1350 33554432000 4194304 5683644 140733489308672 18446744073709551615 246516834048 0 0 16781312 2 18446744071562362840 0 0 17 4 0 0 0
/proc/18943/statm: 5474 1350 443 364 0 929 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 21896

[startup+1.50103 s]
/proc/loadavg: 4.05 4.04 2.96 5/447 18945
/proc/meminfo: memFree=25877540/32951124 swapFree=44043512/67111528
[pid=18943] ppid=18941 vsize=21896 CPUtime=0.02 cores=4,6
/proc/18943/stat : 18943 (python) S 18941 18943 18352 0 -1 4202496 1516 0 0 0 2 0 0 0 20 0 1 0 816962932 22421504 1350 33554432000 4194304 5683644 140733489308672 18446744073709551615 246516834048 0 0 16781312 2 18446744071562362840 0 0 17 4 0 0 0
/proc/18943/statm: 5474 1350 443 364 0 929 0
[pid=18945] ppid=18943 vsize=8364 CPUtime=1.46 cores=4,6
/proc/18945/stat : 18945 (features) R 18943 18943 18352 0 -1 4202496 2638 0 0 0 145 1 0 0 25 0 1 0 816962935 8564736 1522 33554432000 134512640 135907751 4290019504 18446744073709551615 135392733 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/18945/statm: 2091 1522 111 341 0 1747 0
Current children cumulated CPU time (s) 1.48
Current children cumulated vsize (KiB) 30260

[startup+3.10069 s]
/proc/loadavg: 4.05 4.04 2.96 6/447 18945
/proc/meminfo: memFree=25880144/32951124 swapFree=44043512/67111528
[pid=18943] ppid=18941 vsize=21896 CPUtime=0.02 cores=4,6
/proc/18943/stat : 18943 (python) S 18941 18943 18352 0 -1 4202496 1516 0 0 0 2 0 0 0 20 0 1 0 816962932 22421504 1350 33554432000 4194304 5683644 140733489308672 18446744073709551615 246516834048 0 0 16781312 2 18446744071562362840 0 0 17 4 0 0 0
/proc/18943/statm: 5474 1350 443 364 0 929 0
[pid=18945] ppid=18943 vsize=4844 CPUtime=3.06 cores=4,6
/proc/18945/stat : 18945 (features) R 18943 18943 18352 0 -1 4202496 2914 0 0 0 303 3 0 0 25 0 1 0 816962935 4960256 893 33554432000 134512640 135907751 4290019504 18446744073709551615 134518794 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/18945/statm: 1211 893 112 341 0 867 0
Current children cumulated CPU time (s) 3.08
Current children cumulated vsize (KiB) 26740

[startup+6.30111 s]
/proc/loadavg: 4.05 4.03 2.97 5/447 18945
/proc/meminfo: memFree=25883452/32951124 swapFree=44043512/67111528
[pid=18943] ppid=18941 vsize=21896 CPUtime=0.02 cores=4,6
/proc/18943/stat : 18943 (python) S 18941 18943 18352 0 -1 4202496 1516 0 0 0 2 0 0 0 20 0 1 0 816962932 22421504 1350 33554432000 4194304 5683644 140733489308672 18446744073709551615 246516834048 0 0 16781312 2 18446744071562362840 0 0 17 4 0 0 0
/proc/18943/statm: 5474 1350 443 364 0 929 0
[pid=18945] ppid=18943 vsize=4844 CPUtime=6.24 cores=4,6
/proc/18945/stat : 18945 (features) R 18943 18943 18352 0 -1 4202496 2914 0 0 0 621 3 0 0 25 0 1 0 816962935 4960256 893 33554432000 134512640 135907751 4290019504 18446744073709551615 134518902 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/18945/statm: 1211 893 112 341 0 867 0
Current children cumulated CPU time (s) 6.26
Current children cumulated vsize (KiB) 26740

[startup+12.701 s]
/proc/loadavg: 4.04 4.03 2.98 5/447 18946
/proc/meminfo: memFree=25883228/32951124 swapFree=44043512/67111528
[pid=18943] ppid=18941 vsize=21896 CPUtime=0.02 cores=4,6
/proc/18943/stat : 18943 (python) S 18941 18943 18352 0 -1 4202496 1516 0 0 0 2 0 0 0 20 0 1 0 816962932 22421504 1350 33554432000 4194304 5683644 140733489308672 18446744073709551615 246516834048 0 0 16781312 2 18446744071562362840 0 0 17 4 0 0 0
/proc/18943/statm: 5474 1350 443 364 0 929 0
[pid=18945] ppid=18943 vsize=4844 CPUtime=12.62 cores=4,6
/proc/18945/stat : 18945 (features) R 18943 18943 18352 0 -1 4202496 2914 0 0 0 1259 3 0 0 25 0 1 0 816962935 4960256 893 33554432000 134512640 135907751 4290019504 18446744073709551615 134518685 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/18945/statm: 1211 893 112 341 0 867 0
Current children cumulated CPU time (s) 12.64
Current children cumulated vsize (KiB) 26740

[startup+25.5007 s]
/proc/loadavg: 4.03 4.03 2.99 6/453 18960
/proc/meminfo: memFree=25865720/32951124 swapFree=44043512/67111528
[pid=18943] ppid=18941 vsize=34396 CPUtime=8.02 cores=4,6
/proc/18943/stat : 18943 (python) S 18941 18943 18352 0 -1 4202496 2456 14067 0 0 2 0 798 2 18 0 1 0 816962932 35221504 1408 33554432000 4194304 5683644 140733489308672 18446744073709551615 246516834048 0 0 16781312 2 18446744071562362840 0 0 17 4 0 0 0
/proc/18943/statm: 8599 1408 468 364 0 933 0
[pid=18945] ppid=18943 vsize=0 CPUtime=13.82 cores=4,6
/proc/18945/stat : 18945 (features) Z 18943 18943 18352 0 -1 4202524 2928 0 0 0 1379 3 0 0 25 0 1 0 816962935 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 4 0 0 0
/proc/18945/statm: 0 0 0 0 0 0 0
[pid=18950] ppid=18943 vsize=0 CPUtime=0.33 cores=4,6
/proc/18950/stat : 18950 (coach) Z 18943 18943 18352 0 -1 4202524 3737 0 0 0 32 1 0 0 20 0 1 0 816964323 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 4 0 0 0
/proc/18950/statm: 0 0 0 0 0 0 0
[pid=18959] ppid=18943 vsize=8700 CPUtime=0 cores=4,6
/proc/18959/stat : 18959 (timerun) S 18943 18943 18352 0 -1 4202496 744 0 0 0 0 0 0 0 20 0 1 0 816965158 8908800 248 33554432000 4194304 4922060 140737224546608 18446744073709551615 246516653189 0 65536 16781316 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/18959/statm: 2175 248 208 178 0 68 0
[pid=18960] ppid=18959 vsize=12152 CPUtime=3.23 cores=4,6
/proc/18960/stat : 18960 (precosat) R 18959 18943 18352 0 -1 4202496 2960 0 0 0 323 0 0 0 25 0 1 0 816965158 12443648 2912 33554432000 134512640 135142049 4290833520 18446744073709551615 134612260 0 0 16781312 17442 0 0 0 17 4 0 0 0
/proc/18960/statm: 3038 2912 80 154 0 2882 0
Current children cumulated CPU time (s) 25.4
Current children cumulated vsize (KiB) 55248

[startup+51.101 s]
/proc/loadavg: 4.02 4.03 3.02 5/453 18989
/proc/meminfo: memFree=25872672/32951124 swapFree=44043512/67111528
[pid=18943] ppid=18941 vsize=34396 CPUtime=36.03 cores=4,6
/proc/18943/stat : 18943 (python) S 18941 18943 18352 0 -1 4202496 3485 37400 0 0 2 0 3595 6 18 0 1 0 816962932 35221504 1408 33554432000 4194304 5683644 140733489308672 18446744073709551615 246516834048 0 0 16781312 2 18446744071562362840 0 0 17 6 0 0 0
/proc/18943/statm: 8599 1408 468 364 0 933 0
[pid=18945] ppid=18943 vsize=0 CPUtime=13.82 cores=4,6
/proc/18945/stat : 18945 (features) Z 18943 18943 18352 0 -1 4202524 2928 0 0 0 1379 3 0 0 25 0 1 0 816962935 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 4 0 0 0
/proc/18945/statm: 0 0 0 0 0 0 0
[pid=18950] ppid=18943 vsize=0 CPUtime=0.33 cores=4,6
/proc/18950/stat : 18950 (coach) Z 18943 18943 18352 0 -1 4202524 3737 0 0 0 32 1 0 0 20 0 1 0 816964323 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 4 0 0 0
/proc/18950/statm: 0 0 0 0 0 0 0
[pid=18988] ppid=18943 vsize=8700 CPUtime=0 cores=4,6
/proc/18988/stat : 18988 (timerun) S 18943 18943 18352 0 -1 4202496 744 0 0 0 0 0 0 0 18 0 1 0 816967963 8908800 247 33554432000 4194304 4922060 140735357014160 18446744073709551615 246516653189 0 65536 16781316 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/18988/statm: 2175 247 208 178 0 68 0
[pid=18989] ppid=18988 vsize=10348 CPUtime=0.78 cores=4,6
/proc/18989/stat : 18989 (mxc-sat09) R 18988 18943 18352 0 -1 4202496 2457 0 0 0 78 0 0 0 24 0 1 0 816967964 10596352 2107 33554432000 134512640 134581694 4294114832 18446744073709551615 134534080 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/18989/statm: 2587 2107 209 17 0 1934 0
Current children cumulated CPU time (s) 50.96
Current children cumulated vsize (KiB) 53444

[startup+102.317 s]
/proc/loadavg: 4.05 4.04 3.07 5/453 18994
/proc/meminfo: memFree=25882144/32951124 swapFree=44043512/67111528
[pid=18943] ppid=18941 vsize=34396 CPUtime=40.03 cores=4,6
/proc/18943/stat : 18943 (python) S 18941 18943 18352 0 -1 4202496 3631 40996 0 0 2 0 3995 6 18 0 1 0 816962932 35221504 1408 33554432000 4194304 5683644 140733489308672 18446744073709551615 246516834048 0 0 16781312 2 18446744071562362840 0 0 17 6 0 0 0
/proc/18943/statm: 8599 1408 468 364 0 933 0
[pid=18945] ppid=18943 vsize=0 CPUtime=13.82 cores=4,6
/proc/18945/stat : 18945 (features) Z 18943 18943 18352 0 -1 4202524 2928 0 0 0 1379 3 0 0 25 0 1 0 816962935 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 4 0 0 0
/proc/18945/statm: 0 0 0 0 0 0 0
[pid=18950] ppid=18943 vsize=0 CPUtime=0.33 cores=4,6
/proc/18950/stat : 18950 (coach) Z 18943 18943 18352 0 -1 4202524 3737 0 0 0 32 1 0 0 20 0 1 0 816964323 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 4 0 0 0
/proc/18950/statm: 0 0 0 0 0 0 0
[pid=18992] ppid=18943 vsize=8700 CPUtime=0 cores=4,6
/proc/18992/stat : 18992 (timerun) S 18943 18943 18352 0 -1 4202496 744 0 0 0 0 0 0 0 20 0 1 0 816968365 8908800 247 33554432000 4194304 4922060 140736567626352 18446744073709551615 246516653189 0 65536 16781316 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/18992/statm: 2175 247 208 178 0 68 0
[pid=18993] ppid=18992 vsize=415340 CPUtime=47.93 cores=4,6
/proc/18993/stat : 18993 (gnovelty+2-H) R 18992 18943 18352 0 -1 4202496 820 0 0 0 4793 0 0 0 25 0 1 0 816968365 425308160 761 33554432000 134512640 134600030 4293898896 18446744073709551615 134522414 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/18993/statm: 103835 761 253 22 0 103156 0
Current children cumulated CPU time (s) 102.11
Current children cumulated vsize (KiB) 458436

[startup+162.301 s]
/proc/loadavg: 4.18 4.07 3.14 5/453 18996
/proc/meminfo: memFree=25881372/32951124 swapFree=44043512/67111528
[pid=18943] ppid=18941 vsize=34396 CPUtime=40.03 cores=4,6
/proc/18943/stat : 18943 (python) S 18941 18943 18352 0 -1 4202496 3631 40996 0 0 2 0 3995 6 18 0 1 0 816962932 35221504 1408 33554432000 4194304 5683644 140733489308672 18446744073709551615 246516834048 0 0 16781312 2 18446744071562362840 0 0 17 6 0 0 0
/proc/18943/statm: 8599 1408 468 364 0 933 0
[pid=18945] ppid=18943 vsize=0 CPUtime=13.82 cores=4,6
/proc/18945/stat : 18945 (features) Z 18943 18943 18352 0 -1 4202524 2928 0 0 0 1379 3 0 0 25 0 1 0 816962935 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 4 0 0 0
/proc/18945/statm: 0 0 0 0 0 0 0
[pid=18950] ppid=18943 vsize=0 CPUtime=0.33 cores=4,6
/proc/18950/stat : 18950 (coach) Z 18943 18943 18352 0 -1 4202524 3737 0 0 0 32 1 0 0 20 0 1 0 816964323 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 4 0 0 0
/proc/18950/statm: 0 0 0 0 0 0 0
[pid=18992] ppid=18943 vsize=8700 CPUtime=0 cores=4,6
/proc/18992/stat : 18992 (timerun) S 18943 18943 18352 0 -1 4202496 744 0 0 0 0 0 0 0 20 0 1 0 816968365 8908800 247 33554432000 4194304 4922060 140736567626352 18446744073709551615 246516653189 0 65536 16781316 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/18992/statm: 2175 247 208 178 0 68 0
[pid=18993] ppid=18992 vsize=415340 CPUtime=107.92 cores=4,6
/proc/18993/stat : 18993 (gnovelty+2-H) R 18992 18943 18352 0 -1 4202496 820 0 0 0 10792 0 0 0 25 0 1 0 816968365 425308160 761 33554432000 134512640 134600030 4293898896 18446744073709551615 134522315 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/18993/statm: 103835 761 253 22 0 103156 0
Current children cumulated CPU time (s) 162.1
Current children cumulated vsize (KiB) 458436

[startup+222.301 s]
/proc/loadavg: 4.23 4.10 3.21 5/453 18999
/proc/meminfo: memFree=25900664/32951124 swapFree=44043512/67111528
[pid=18943] ppid=18941 vsize=34396 CPUtime=40.03 cores=4,6

################
# More data... #
################

/proc/18950/statm: 0 0 0 0 0 0 0
[pid=18992] ppid=18943 vsize=8700 CPUtime=0 cores=4,6
/proc/18992/stat : 18992 (timerun) S 18943 18943 18352 0 -1 4202496 744 0 0 0 0 0 0 0 20 0 1 0 816968365 8908800 247 33554432000 4194304 4922060 140736567626352 18446744073709551615 246516653189 0 65536 16781316 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/18992/statm: 2175 247 208 178 0 68 0
[pid=18993] ppid=18992 vsize=415340 CPUtime=905.54 cores=4,6
/proc/18993/stat : 18993 (gnovelty+2-H) R 18992 18943 18352 0 -1 4202496 820 0 0 0 90554 0 0 0 25 0 1 0 816968365 425308160 761 33554432000 134512640 134600030 4293898896 18446744073709551615 134521962 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/18993/statm: 103835 761 253 22 0 103156 0
Current children cumulated CPU time (s) 959.72
Current children cumulated vsize (KiB) 458436

[startup+966.301 s]
/proc/loadavg: 4.17 4.09 3.66 5/453 19125
/proc/meminfo: memFree=25982756/32951124 swapFree=44043512/67111528
[pid=18943] ppid=18941 vsize=34396 CPUtime=40.03 cores=4,6
/proc/18943/stat : 18943 (python) S 18941 18943 18352 0 -1 4202496 3631 40996 0 0 2 0 3995 6 18 0 1 0 816962932 35221504 1408 33554432000 4194304 5683644 140733489308672 18446744073709551615 246516834048 0 0 16781312 2 18446744071562362840 0 0 17 6 0 0 0
/proc/18943/statm: 8599 1408 468 364 0 933 0
[pid=18945] ppid=18943 vsize=0 CPUtime=13.82 cores=4,6
/proc/18945/stat : 18945 (features) Z 18943 18943 18352 0 -1 4202524 2928 0 0 0 1379 3 0 0 25 0 1 0 816962935 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 4 0 0 0
/proc/18945/statm: 0 0 0 0 0 0 0
[pid=18950] ppid=18943 vsize=0 CPUtime=0.33 cores=4,6
/proc/18950/stat : 18950 (coach) Z 18943 18943 18352 0 -1 4202524 3737 0 0 0 32 1 0 0 20 0 1 0 816964323 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 4 0 0 0
/proc/18950/statm: 0 0 0 0 0 0 0
[pid=18992] ppid=18943 vsize=8700 CPUtime=0 cores=4,6
/proc/18992/stat : 18992 (timerun) S 18943 18943 18352 0 -1 4202496 744 0 0 0 0 0 0 0 20 0 1 0 816968365 8908800 247 33554432000 4194304 4922060 140736567626352 18446744073709551615 246516653189 0 65536 16781316 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/18992/statm: 2175 247 208 178 0 68 0
[pid=18993] ppid=18992 vsize=415340 CPUtime=911.94 cores=4,6
/proc/18993/stat : 18993 (gnovelty+2-H) R 18992 18943 18352 0 -1 4202496 820 0 0 0 91194 0 0 0 25 0 1 0 816968365 425308160 761 33554432000 134512640 134600030 4293898896 18446744073709551615 134521952 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/18993/statm: 103835 761 253 22 0 103156 0
Current children cumulated CPU time (s) 966.12
Current children cumulated vsize (KiB) 458436

[startup+972.701 s]
/proc/loadavg: 4.15 4.08 3.66 5/453 19125
/proc/meminfo: memFree=25982752/32951124 swapFree=44043512/67111528
[pid=18943] ppid=18941 vsize=34396 CPUtime=40.03 cores=4,6
/proc/18943/stat : 18943 (python) S 18941 18943 18352 0 -1 4202496 3631 40996 0 0 2 0 3995 6 18 0 1 0 816962932 35221504 1408 33554432000 4194304 5683644 140733489308672 18446744073709551615 246516834048 0 0 16781312 2 18446744071562362840 0 0 17 6 0 0 0
/proc/18943/statm: 8599 1408 468 364 0 933 0
[pid=18945] ppid=18943 vsize=0 CPUtime=13.82 cores=4,6
/proc/18945/stat : 18945 (features) Z 18943 18943 18352 0 -1 4202524 2928 0 0 0 1379 3 0 0 25 0 1 0 816962935 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 4 0 0 0
/proc/18945/statm: 0 0 0 0 0 0 0
[pid=18950] ppid=18943 vsize=0 CPUtime=0.33 cores=4,6
/proc/18950/stat : 18950 (coach) Z 18943 18943 18352 0 -1 4202524 3737 0 0 0 32 1 0 0 20 0 1 0 816964323 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 4 0 0 0
/proc/18950/statm: 0 0 0 0 0 0 0
[pid=18992] ppid=18943 vsize=8700 CPUtime=0 cores=4,6
/proc/18992/stat : 18992 (timerun) S 18943 18943 18352 0 -1 4202496 744 0 0 0 0 0 0 0 20 0 1 0 816968365 8908800 247 33554432000 4194304 4922060 140736567626352 18446744073709551615 246516653189 0 65536 16781316 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/18992/statm: 2175 247 208 178 0 68 0
[pid=18993] ppid=18992 vsize=415340 CPUtime=918.34 cores=4,6
/proc/18993/stat : 18993 (gnovelty+2-H) R 18992 18943 18352 0 -1 4202496 820 0 0 0 91834 0 0 0 25 0 1 0 816968365 425308160 761 33554432000 134512640 134600030 4293898896 18446744073709551615 134534532 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/18993/statm: 103835 761 253 22 0 103156 0
Current children cumulated CPU time (s) 972.52
Current children cumulated vsize (KiB) 458436

[startup+974.301 s]
/proc/loadavg: 4.15 4.08 3.66 5/453 19125
/proc/meminfo: memFree=25982752/32951124 swapFree=44043512/67111528
[pid=18943] ppid=18941 vsize=34396 CPUtime=40.03 cores=4,6
/proc/18943/stat : 18943 (python) S 18941 18943 18352 0 -1 4202496 3631 40996 0 0 2 0 3995 6 18 0 1 0 816962932 35221504 1408 33554432000 4194304 5683644 140733489308672 18446744073709551615 246516834048 0 0 16781312 2 18446744071562362840 0 0 17 6 0 0 0
/proc/18943/statm: 8599 1408 468 364 0 933 0
[pid=18945] ppid=18943 vsize=0 CPUtime=13.82 cores=4,6
/proc/18945/stat : 18945 (features) Z 18943 18943 18352 0 -1 4202524 2928 0 0 0 1379 3 0 0 25 0 1 0 816962935 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 4 0 0 0
/proc/18945/statm: 0 0 0 0 0 0 0
[pid=18950] ppid=18943 vsize=0 CPUtime=0.33 cores=4,6
/proc/18950/stat : 18950 (coach) Z 18943 18943 18352 0 -1 4202524 3737 0 0 0 32 1 0 0 20 0 1 0 816964323 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 4 0 0 0
/proc/18950/statm: 0 0 0 0 0 0 0
[pid=18992] ppid=18943 vsize=8700 CPUtime=0 cores=4,6
/proc/18992/stat : 18992 (timerun) S 18943 18943 18352 0 -1 4202496 744 0 0 0 0 0 0 0 20 0 1 0 816968365 8908800 247 33554432000 4194304 4922060 140736567626352 18446744073709551615 246516653189 0 65536 16781316 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/18992/statm: 2175 247 208 178 0 68 0
[pid=18993] ppid=18992 vsize=415340 CPUtime=919.94 cores=4,6
/proc/18993/stat : 18993 (gnovelty+2-H) R 18992 18943 18352 0 -1 4202496 820 0 0 0 91994 0 0 0 25 0 1 0 816968365 425308160 761 33554432000 134512640 134600030 4293898896 18446744073709551615 134535230 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/18993/statm: 103835 761 253 22 0 103156 0
Current children cumulated CPU time (s) 974.12
Current children cumulated vsize (KiB) 458436

[startup+975.101 s]
/proc/loadavg: 4.14 4.08 3.66 5/453 19125
/proc/meminfo: memFree=25982752/32951124 swapFree=44043512/67111528
[pid=18943] ppid=18941 vsize=34396 CPUtime=40.03 cores=4,6
/proc/18943/stat : 18943 (python) S 18941 18943 18352 0 -1 4202496 3631 40996 0 0 2 0 3995 6 18 0 1 0 816962932 35221504 1408 33554432000 4194304 5683644 140733489308672 18446744073709551615 246516834048 0 0 16781312 2 18446744071562362840 0 0 17 6 0 0 0
/proc/18943/statm: 8599 1408 468 364 0 933 0
[pid=18945] ppid=18943 vsize=0 CPUtime=13.82 cores=4,6
/proc/18945/stat : 18945 (features) Z 18943 18943 18352 0 -1 4202524 2928 0 0 0 1379 3 0 0 25 0 1 0 816962935 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 4 0 0 0
/proc/18945/statm: 0 0 0 0 0 0 0
[pid=18950] ppid=18943 vsize=0 CPUtime=0.33 cores=4,6
/proc/18950/stat : 18950 (coach) Z 18943 18943 18352 0 -1 4202524 3737 0 0 0 32 1 0 0 20 0 1 0 816964323 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 4 0 0 0
/proc/18950/statm: 0 0 0 0 0 0 0
[pid=18992] ppid=18943 vsize=8700 CPUtime=0 cores=4,6
/proc/18992/stat : 18992 (timerun) S 18943 18943 18352 0 -1 4202496 744 0 0 0 0 0 0 0 20 0 1 0 816968365 8908800 247 33554432000 4194304 4922060 140736567626352 18446744073709551615 246516653189 0 65536 16781316 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/18992/statm: 2175 247 208 178 0 68 0
[pid=18993] ppid=18992 vsize=415340 CPUtime=920.74 cores=4,6
/proc/18993/stat : 18993 (gnovelty+2-H) R 18992 18943 18352 0 -1 4202496 820 0 0 0 92074 0 0 0 25 0 1 0 816968365 425308160 761 33554432000 134512640 134600030 4293898896 18446744073709551615 134521599 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/18993/statm: 103835 761 253 22 0 103156 0
Current children cumulated CPU time (s) 974.92
Current children cumulated vsize (KiB) 458436

[startup+975.901 s]
/proc/loadavg: 4.14 4.08 3.66 5/453 19125
/proc/meminfo: memFree=25983744/32951124 swapFree=44043512/67111528
[pid=18943] ppid=18941 vsize=34396 CPUtime=40.03 cores=4,6
/proc/18943/stat : 18943 (python) S 18941 18943 18352 0 -1 4202496 3631 40996 0 0 2 0 3995 6 18 0 1 0 816962932 35221504 1408 33554432000 4194304 5683644 140733489308672 18446744073709551615 246516834048 0 0 16781312 2 18446744071562362840 0 0 17 6 0 0 0
/proc/18943/statm: 8599 1408 468 364 0 933 0
[pid=18945] ppid=18943 vsize=0 CPUtime=13.82 cores=4,6
/proc/18945/stat : 18945 (features) Z 18943 18943 18352 0 -1 4202524 2928 0 0 0 1379 3 0 0 25 0 1 0 816962935 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 4 0 0 0
/proc/18945/statm: 0 0 0 0 0 0 0
[pid=18950] ppid=18943 vsize=0 CPUtime=0.33 cores=4,6
/proc/18950/stat : 18950 (coach) Z 18943 18943 18352 0 -1 4202524 3737 0 0 0 32 1 0 0 20 0 1 0 816964323 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 4 0 0 0
/proc/18950/statm: 0 0 0 0 0 0 0
[pid=18992] ppid=18943 vsize=8700 CPUtime=0 cores=4,6
/proc/18992/stat : 18992 (timerun) S 18943 18943 18352 0 -1 4202496 744 0 0 0 0 0 0 0 20 0 1 0 816968365 8908800 247 33554432000 4194304 4922060 140736567626352 18446744073709551615 246516653189 0 65536 16781316 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/18992/statm: 2175 247 208 178 0 68 0
[pid=18993] ppid=18992 vsize=415340 CPUtime=921.54 cores=4,6
/proc/18993/stat : 18993 (gnovelty+2-H) R 18992 18943 18352 0 -1 4202496 820 0 0 0 92154 0 0 0 25 0 1 0 816968365 425308160 761 33554432000 134512640 134600030 4293898896 18446744073709551615 134521857 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/18993/statm: 103835 761 253 22 0 103156 0
Current children cumulated CPU time (s) 975.72
Current children cumulated vsize (KiB) 458436

[startup+976.1 s]
/proc/loadavg: 4.14 4.08 3.66 5/453 19125
/proc/meminfo: memFree=25983744/32951124 swapFree=44043512/67111528
[pid=18943] ppid=18941 vsize=34396 CPUtime=40.03 cores=4,6
/proc/18943/stat : 18943 (python) S 18941 18943 18352 0 -1 4202496 3631 40996 0 0 2 0 3995 6 18 0 1 0 816962932 35221504 1408 33554432000 4194304 5683644 140733489308672 18446744073709551615 246516834048 0 0 16781312 2 18446744071562362840 0 0 17 6 0 0 0
/proc/18943/statm: 8599 1408 468 364 0 933 0
[pid=18945] ppid=18943 vsize=0 CPUtime=13.82 cores=4,6
/proc/18945/stat : 18945 (features) Z 18943 18943 18352 0 -1 4202524 2928 0 0 0 1379 3 0 0 25 0 1 0 816962935 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 4 0 0 0
/proc/18945/statm: 0 0 0 0 0 0 0
[pid=18950] ppid=18943 vsize=0 CPUtime=0.33 cores=4,6
/proc/18950/stat : 18950 (coach) Z 18943 18943 18352 0 -1 4202524 3737 0 0 0 32 1 0 0 20 0 1 0 816964323 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 4 0 0 0
/proc/18950/statm: 0 0 0 0 0 0 0
[pid=18992] ppid=18943 vsize=8700 CPUtime=0 cores=4,6
/proc/18992/stat : 18992 (timerun) S 18943 18943 18352 0 -1 4202496 744 0 0 0 0 0 0 0 20 0 1 0 816968365 8908800 247 33554432000 4194304 4922060 140736567626352 18446744073709551615 246516653189 0 65536 16781316 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/18992/statm: 2175 247 208 178 0 68 0
[pid=18993] ppid=18992 vsize=415340 CPUtime=921.74 cores=4,6
/proc/18993/stat : 18993 (gnovelty+2-H) R 18992 18943 18352 0 -1 4202496 820 0 0 0 92174 0 0 0 25 0 1 0 816968365 425308160 761 33554432000 134512640 134600030 4293898896 18446744073709551615 134522432 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/18993/statm: 103835 761 253 22 0 103156 0
Current children cumulated CPU time (s) 975.92
Current children cumulated vsize (KiB) 458436

[startup+976.2 s]
/proc/loadavg: 4.14 4.08 3.66 5/453 19125
/proc/meminfo: memFree=25983744/32951124 swapFree=44043512/67111528
[pid=18943] ppid=18941 vsize=34396 CPUtime=40.03 cores=4,6
/proc/18943/stat : 18943 (python) S 18941 18943 18352 0 -1 4202496 3631 40996 0 0 2 0 3995 6 18 0 1 0 816962932 35221504 1408 33554432000 4194304 5683644 140733489308672 18446744073709551615 246516834048 0 0 16781312 2 18446744071562362840 0 0 17 6 0 0 0
/proc/18943/statm: 8599 1408 468 364 0 933 0
[pid=18945] ppid=18943 vsize=0 CPUtime=13.82 cores=4,6
/proc/18945/stat : 18945 (features) Z 18943 18943 18352 0 -1 4202524 2928 0 0 0 1379 3 0 0 25 0 1 0 816962935 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 4 0 0 0
/proc/18945/statm: 0 0 0 0 0 0 0
[pid=18950] ppid=18943 vsize=0 CPUtime=0.33 cores=4,6
/proc/18950/stat : 18950 (coach) Z 18943 18943 18352 0 -1 4202524 3737 0 0 0 32 1 0 0 20 0 1 0 816964323 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 4 0 0 0
/proc/18950/statm: 0 0 0 0 0 0 0
[pid=18992] ppid=18943 vsize=8700 CPUtime=0 cores=4,6
/proc/18992/stat : 18992 (timerun) S 18943 18943 18352 0 -1 4202496 744 0 0 0 0 0 0 0 20 0 1 0 816968365 8908800 247 33554432000 4194304 4922060 140736567626352 18446744073709551615 246516653189 0 65536 16781316 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/18992/statm: 2175 247 208 178 0 68 0
[pid=18993] ppid=18992 vsize=415340 CPUtime=921.84 cores=4,6
/proc/18993/stat : 18993 (gnovelty+2-H) R 18992 18943 18352 0 -1 4202496 820 0 0 0 92184 0 0 0 25 0 1 0 816968365 425308160 761 33554432000 134512640 134600030 4293898896 18446744073709551615 134549346 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/18993/statm: 103835 761 253 22 0 103156 0
Current children cumulated CPU time (s) 976.02
Current children cumulated vsize (KiB) 458436

Child status: 0

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 18943 and gives
#  childrusage.ru_utime.tv_sec=54
#  childrusage.ru_utime.tv_usec=100775
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=126980
# CPU time returned by wait4() is 54.2278
# while last known CPU time is 976.02
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 976.251
CPU time (s): 976.02
CPU user time (s): 975.92
CPU system time (s): 0.1
CPU usage (%): 99.9763
Max. virtual memory (cumulated for all children) (KiB): 1063392

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 54.1008
system time used= 0.12698
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 51914
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 252
involuntary context switches= 2028

runsolver used 4.53831 second user time and 9.54855 second system time

The end

Launcher Data 

Begin job on node134 at 2011-06-03 00:27:27
IDJOB=3449111
IDBENCH=82640
IDSOLVER=1947
FILE ID=node134/3449111-1307053646
RUNJOBID= node134-1307052433-18371
PBS_JOBID= 13497794
Free space on /tmp= 73604 MiB

SOLVER NAME= Coach 2011-03-18 (1200 s timeout)
BENCH NAME= SAT11/random/large/unif-k5-r20-v1250-c25000-S540595895-046-UNKNOWN.cnf
COMMAND LINE= python portfolio_solver.py -t TIMELIMIT -s RANDOMSEED  BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3449111-1307053646/watcher-3449111-1307053646 -o /tmp/evaluation-result-3449111-1307053646/solver-3449111-1307053646 -C 1200 -W 1300 -M 7680  python portfolio_solver.py -t 1200 -s 546156729  HOME/instance-3449111-1307053646.cnf

TIME LIMIT= 1200 seconds
MEMORY LIMIT= 7680 MiB
NBCORE= 2

MD5SUM BENCH= c6c08a5348a127e8ddd50935c46cf427
RANDOM SEED=546156729

node134.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 7186.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      25889368 kB
Buffers:        220624 kB
Cached:         582732 kB
SwapCached:       9540 kB
Active:        6322340 kB
Inactive:       444932 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      25889368 kB
SwapTotal:    67111528 kB
SwapFree:     44043512 kB
Dirty:           72628 kB
Writeback:           0 kB
AnonPages:     5962288 kB
Mapped:          23404 kB
Slab:           136048 kB
PageTables:      90644 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 111405724 kB
VmallocTotal: 34359738367 kB
VmallocUsed:     33868 kB
VmallocChunk: 34359703231 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73572 MiB
End job on node134 at 2011-06-03 00:43:44