Trace number 3191471

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio seqSAT 529.742 529.776

General information on the benchmark

Namerandom/large/
unif-k5-r20-v1250-c25000-S936047914-093-UNKNOWN.cnf
MD5SUMc578ae902020675717dd7f7fb0a11360
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark4.33034
Satisfiable
(Un)Satisfiability was proved
Number of variables1250
Number of clauses25000
Sum of the clauses size125000
Maximum clause length5
Minimum clause length5
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 525000
Number of clauses of size over 50

Solver Data 

0.00/0.04	This is pico-portfolio, a naive parallel portfolio
0.00/0.04	Copyright (C) 2011 Olivier Roussel
0.00/0.04	Using 1 processing units
0.00/0.04	This portfolio uses the following solvers:
0.00/0.04	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.04	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.04	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.04	Starting cryptominisat 2.7.1 on core(s) 4
0.00/0.04	Starting clasp 1.3.6 on core(s) 4
0.00/0.04	Starting TNM 2009 on core(s) 4
529.63/529.76	s SATISFIABLE
529.63/529.76	v -1 2 -3 4 5 -6 -7 -8 -9 10 -11 -12 -13 14 -15 -16 -17 18 -19 20 21 22 23 24 25 26 -27 -28 -29 -30 -31 32 33 -34 -35 -36 -37 38 -39 -40 41 42 43 -44 -45 -46 -47 -48 -49 50 51 52 53 -54 -55 -56 57 -58 -59 60 -61 -62 63 -64 -65 66 -67 68 69 -70 -71 72 -73 -74 75 -76 77 -78 -79 80 -81 82 83 -84 85 86 87 -88 -89 -90 -91 -92 -93 94 -95 -96 97 -98 -99 -100 -101 -102 -103 104 105 106 -107 -108 -109 -110 -111 -112 -113 114 -115 -116 117 -118 -119 120 121 -122 -123 -124 125 126 127 128 129 130 -131 -132 -133 -134 135 136 -137 138 -139 -140 -141 -142 143 144 -145 -146 -147 -148 149 150 -151 -152 153 -154 -155 156 -157 158 159 160 -161 162 163 -164 165 -166 167 168 169 170 -171 -172 173 174 175 176 -177 -178 179 180 -181 182 -183 184 -185 -186 -187 188 -189 -190 -191 192 193 -194 -195 196 -197 -198 199 -200 201 202 -203 204 205 206 207 208 209 210 -211 212 -213 -214 215 216 217 -218 -219 220 221 -222 -223 -224 225 226 227 228 -229 230 231 232 233 234 235 236 -237 -238 239 -240 -241 -242 243 -244 -245 -246 -247 248 -249 250 251 252 -253 -254 -255 256 257 -258 259 -260 261 262 -263 -264 265 -266 -267 -268 -269 -270 271 -272 -273 274 275 -276 277 -278 279 280 -281 -282 -283 -284 285 286 -287 288 289 290 -291 292 -293 -294 -295 -296 297 298 299 -300 -301 -302 -303 304 305 306 -307 -308 -309 -310 311 -312 313 314 -315 -316 317 318 -319 -320 -321 -322 323 324 325 -326 327 328 329 330 331 -332 333 334 335 -336 337 338 339 -340 341 342 343 344 -345 346 -347 -348 -349 350 -351 -352 -353 354 355 356 357 -358 -359 360 361 -362 -363 364 -365 -366 367 368 -369 370 371 372 -373 374 375 376 -377 378 379 380 -381 -382 -383 384 385 -386 387 -388 389 390 -391 -392 393 394 395 396 -397 -398 399 -400 401 402 -403 404 405 406 -407 408 -409 410 -411 -412 -413 414 415 416 417 418 419 420 421 -422 423 424 -425 -426 -427 428 429 -430 431 -432 -433 -434 435 436 437 -438 439 440 441 442 -443 -444 -445 446 447 448 449 450 -451 -452 453 454 -455 -456 -457 -458 -459 460 461 -462 463 -464 -465 -466 -467 -468 -469 -470 -471 -472 -473 -474 475 -476 477 -478 -479 -480 -481 482 -483 -484 -485 486 -487 488 -489 490 491 -492 -493 -494 495 496 -497 -498 499 -500 501 -502 -503 -504 505 506 -507 -508 509 510 -511 512 513 514 515 -516 -517 518 -519 520 -521 522 523 -524 -525 526 527 -528 529 530 -531 532 533 534 -535 -536 537 538 539 540 -541 542 543 -544 -545 546 547 548 549 -550 -551 -552 -553 554 555 -556 -557 -558 559 -560 561 -562 563 -564 -565 -566 567 568 -569 570 571 -572 -573 -574 -575 -576 577 -578 -579 580 581 582 -583 -584 585 -586 -587 588 -589 -590 -591 592 593 -594 595 -596 597 598 -599 -600 -601 -602 -603 604 605 -606 607 608 -609 610 -611 -612 613 -614 615 -616 -617 -618 -619 620 621 622 623 624 -625 -626 627 628 629 -630 631 -632 633 -634 -635 -636 -637 -638 639 -640 -641 642 643 644 645 -646 647 -648 -649 650 -651 652 -653 654 -655 656 657 658 659 -660 -661 662 663 664 -665 666 667 668 669 -670 -671 672 673 -674 -675 -676 -677 678 -679 -680 -681 682 -683 -684 -685 686 687 688 689 -690 691 692 -693 -694 -695 -696 697 698 699 -700 701 702 -703 704 705 -706 -707 -708 -709 710 711 -712 -713 714 -715 -716 -717 718 719 -720 721 722 -723 724 725 726 -727 -728 729 -730 -731 -732 733 -734 735 -736 737 -738 739 740 741 742 -743 744 745 746 -747 748 749 -750 751 752 753 -754 755 756 757 758 759 760 761 -762 763 -764 -765 -766 767 -768 769 770 771 -772 -773 -774 -775 -776 -777 -778 -779 -780 -781 782 -783 -784 -785 -786 787 788 -789 -790 -791 792 793 794 795 -796 797 798 799 800 801 -802 -803 804 -805 -806 -807 808 -809 810 811 812 813 -814 -815 816 817 -818 -819 -820 -821 822 -823 824 825 826 827 -828 -829 -830 831 832 -833 -834 835 -836 -837 -838 839 840 841 -842 -843 844 845 -846 847 -848 -849 850 -851 852 -853 854 -855 856 857 -858 859 860 -861 -862 -863 864 -865 -866 867 868 869 870 -871 -872 873 874 -875 -876 877 878 879 -880 -881 -882 -883 884 885 886 -887 -888 -889 -890 891 892 -893 -894 -895 -896 -897 -898 -899 -900 -901 902 -903 -904 -905 906 907 -908 909 910 911 912 913 914 -915 -916 917 918 919 920 921 -922 -923 924 -925 926 -927 928 929 -930 -931 -932 933 934 -935 -936 -937 938 -939 940 -941 -942 943 -944 -945 946 947 -948 -949 950 951 -952 953 -954 -955 -956 -957 958 -959 -960 961 962 963 964 -965 966 967 968 -969 -970 -971 972 -973 974 -975 976 977 -978 979 980 981 982 983 984 985 -986 987 -988 989 990 991 -992 993 -994 995 996 -997 -998 999 -1000 -1001 -1002 -1003 -1004 1005 1006 1007 1008 -1009 1010 1011 1012 -1013 -1014 1015 -1016 1017 -1018 -1019 1020 -1021 -1022 -1023 1024 1025 -1026 1027 -1028 -1029 -1030 1031 -1032 1033 -1034 1035 -1036 -1037 -1038 1039 -1040 1041 -1042 -1043 -1044 -1045 1046 1047 -1048 1049 -1050 1051 1052 -1053 1054 -1055 1056 -1057 -1058 1059 1060 1061 -1062 -1063 1064 1065 -1066 -1067 -1068 -1069 1070 1071 -1072 -1073 1074 -1075 -1076 -1077 -1078 1079 -1080 1081 1082 1083 1084 -1085 1086 -1087 -1088 1089 -1090 -1091 -1092 -1093 1094 1095 1096 1097 1098 1099 -1100 -1101 -1102 -1103 1104 -1105 -1106 1107 -1108 1109 1110 -1111 1112 -1113 1114 1115 1116 -1117 -1118 -1119 1120 1121 1122 1123 1124 -1125 -1126 1127 1128 1129 1130 1131 1132 1133 -1134 1135 1136 -1137 1138 1139 -1140 -1141 -1142 -1143 1144 -1145 1146 1147 -1148 1149 -1150 1151 1152 -1153 1154 -1155 -1156 1157 -1158 1159 -1160 1161 1162 1163 1164 -1165 1166 1167 1168 -1169 -1170 -1171 1172 1173 -1174 -1175 -1176 -1177 -1178 -1179 1180 -1181 1182 1183 1184 1185 1186 1187 1188 1189 1190 -1191 1192 -1193 1194 1195 1196 1197 -1198 1199 -1200 1201 -1202 1203 1204 -1205 1206 -1207 -1208 -1209 -1210 1211 -1212 1213 -1214 1215 1216 -1217 1218 -1219 -1220 -1221 -1222 1223 1224 1225 1226 1227 1228 1229 1230 -1231 1232 1233 -1234 1235 -1236 1237 -1238 -1239 1240 1241 -1242 -1243 1244 1245 -1246 -1247 1248 -1249 -1250 
529.63/529.76	v 0 
529.63/529.77	solver [3] TNM 2009 answered
529.63/529.77	Done

Verifier Data 

OK

Watcher Data 

runsolver Copyright (C) 2010 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 893)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3191471-1302537256/watcher-3191471-1302537256 -o /tmp/evaluation-result-3191471-1302537256/solver-3191471-1302537256 -C 2400 -W 1300 -M 7680 ppfolio --nbcore=1 HOME/instance-3191471-1302537256.cnf 

running on 2 cores: 4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 7864320 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 7915520 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.84 1.94 1.90 5/182 26130
/proc/meminfo: memFree=28646924/32951124 swapFree=67111528/67111528
[pid=26130] ppid=26124 vsize=304 CPUtime=0 cores=4,6
/proc/26130/stat : 26130 (ppfolio) D 26124 26130 26080 0 -1 4194304 78 0 0 0 0 0 0 0 18 0 1 0 97916907 311296 30 33554432000 4194304 4287625 140733590615104 18446744073709551615 268655738599 0 0 4096 0 18446744071562234166 0 0 17 4 0 0 0
/proc/26130/statm: 76 30 23 23 0 22 0

[startup+0.0589179 s]
/proc/loadavg: 1.84 1.94 1.90 5/182 26130
/proc/meminfo: memFree=28646924/32951124 swapFree=67111528/67111528
[pid=26130] ppid=26124 vsize=18324 CPUtime=0 cores=4,6
/proc/26130/stat : 26130 (ppfolio) S 26124 26130 26080 0 -1 4202496 501 0 2 0 0 0 0 0 20 0 1 0 97916907 18763776 394 33554432000 4194304 4287625 140733590615104 18446744073709551615 268660682255 0 0 4096 65536 0 0 0 17 6 0 0 4
/proc/26130/statm: 4581 394 345 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.100937 s]
/proc/loadavg: 1.84 1.94 1.90 5/182 26130
/proc/meminfo: memFree=28646924/32951124 swapFree=67111528/67111528
[pid=26130] ppid=26124 vsize=18324 CPUtime=0 cores=4,6
/proc/26130/stat : 26130 (ppfolio) S 26124 26130 26080 0 -1 4202496 501 0 2 0 0 0 0 0 20 0 1 0 97916907 18763776 394 33554432000 4194304 4287625 140733590615104 18446744073709551615 268660682255 0 0 4096 65536 0 0 0 17 6 0 0 4
/proc/26130/statm: 4581 394 345 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.300903 s]
/proc/loadavg: 1.84 1.94 1.90 5/182 26130
/proc/meminfo: memFree=28646924/32951124 swapFree=67111528/67111528
[pid=26130] ppid=26124 vsize=18324 CPUtime=0 cores=4,6
/proc/26130/stat : 26130 (ppfolio) S 26124 26130 26080 0 -1 4202496 501 0 2 0 0 0 0 0 19 0 1 0 97916907 18763776 394 33554432000 4194304 4287625 140733590615104 18446744073709551615 268660682255 0 0 4096 65536 4452948425213739008 0 0 17 6 0 0 4
/proc/26130/statm: 4581 394 345 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.700833 s]
/proc/loadavg: 1.84 1.94 1.90 5/182 26130
/proc/meminfo: memFree=28646924/32951124 swapFree=67111528/67111528
[pid=26130] ppid=26124 vsize=18324 CPUtime=0 cores=4,6
/proc/26130/stat : 26130 (ppfolio) S 26124 26130 26080 0 -1 4202496 501 0 2 0 0 0 0 0 19 0 1 0 97916907 18763776 394 33554432000 4194304 4287625 140733590615104 18446744073709551615 268660682255 0 0 4096 65536 4452948425213739008 0 0 17 6 0 0 4
/proc/26130/statm: 4581 394 345 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50073 s]
/proc/loadavg: 1.84 1.94 1.90 15/202 26153
/proc/meminfo: memFree=28492300/32951124 swapFree=67111528/67111528
[pid=26130] ppid=26124 vsize=18324 CPUtime=0 cores=4,6
/proc/26130/stat : 26130 (ppfolio) S 26124 26130 26080 0 -1 4202496 501 0 2 0 0 0 0 0 17 0 1 0 97916907 18763776 394 33554432000 4194304 4287625 140733590615104 18446744073709551615 268660682255 0 0 4096 65536 0 0 0 17 6 0 0 4
/proc/26130/statm: 4581 394 345 23 0 91 0
[pid=26136] ppid=26130 vsize=30212 CPUtime=0.34 cores=4
/proc/26136/stat : 26136 (cryptominisat) R 26130 26130 26080 0 -1 4202496 2928 0 0 0 34 0 0 0 18 0 1 0 97916912 30937088 2558 33554432000 4194304 4587354 140735661411632 18446744073709551615 4238463 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/26136/statm: 7553 2558 326 96 0 4115 0
[pid=26138] ppid=26130 vsize=22788 CPUtime=1.09 cores=4
/proc/26138/stat : 26138 (clasp) R 26130 26130 26080 0 -1 4202496 3232 0 0 0 109 0 0 0 18 0 1 0 97916912 23334912 3027 33554432000 4194304 4785740 140735597378592 18446744073709551615 4287204 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/26138/statm: 5697 3027 340 145 0 2742 0
[pid=26140] ppid=26130 vsize=451868 CPUtime=0 cores=4
/proc/26140/stat : 26140 (TNM) R 26130 26130 26080 0 -1 4202496 227 0 0 0 0 0 0 0 22 0 1 0 97916912 462712832 124 33554432000 134512640 134534564 4288797056 18446744073709551615 5290326 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/26140/statm: 112967 124 90 6 0 111633 0
Current children cumulated CPU time (s) 1.43
Current children cumulated vsize (KiB) 523192

[startup+3.10044 s]
/proc/loadavg: 1.84 1.94 1.90 15/202 26153
/proc/meminfo: memFree=28440344/32951124 swapFree=67111528/67111528
[pid=26130] ppid=26124 vsize=18324 CPUtime=0 cores=4,6
/proc/26130/stat : 26130 (ppfolio) S 26124 26130 26080 0 -1 4202496 501 0 2 0 0 0 0 0 15 0 1 0 97916907 18763776 394 33554432000 4194304 4287625 140733590615104 18446744073709551615 268660682255 0 0 4096 65536 4452949387286413312 0 0 17 6 0 0 4
/proc/26130/statm: 4581 394 345 23 0 91 0
[pid=26136] ppid=26130 vsize=1562024 CPUtime=1.04 cores=4
/proc/26136/stat : 26136 (cryptominisat) R 26130 26130 26080 0 -1 4202496 4970 0 0 0 104 0 0 0 19 0 1 0 97916912 1599512576 2451 33554432000 4194304 4587354 140735661411632 18446744073709551615 4243606 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/26136/statm: 390506 2451 327 96 0 387068 0
[pid=26138] ppid=26130 vsize=24124 CPUtime=1.81 cores=4
/proc/26138/stat : 26138 (clasp) R 26130 26130 26080 0 -1 4202496 3576 0 0 0 181 0 0 0 19 0 1 0 97916912 24702976 3371 33554432000 4194304 4785740 140735597378592 18446744073709551615 4287053 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/26138/statm: 6031 3371 340 145 0 3076 0
[pid=26140] ppid=26130 vsize=454240 CPUtime=0.17 cores=4
/proc/26140/stat : 26140 (TNM) R 26130 26130 26080 0 -1 4202496 945 0 0 0 17 0 0 0 22 0 1 0 97916912 465141760 841 33554432000 134512640 134534564 4288797056 18446744073709551615 134524752 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/26140/statm: 113560 841 91 6 0 112226 0
Current children cumulated CPU time (s) 3.02
Current children cumulated vsize (KiB) 2058712

[startup+6.30087 s]
/proc/loadavg: 2.89 2.15 1.97 15/202 26153
/proc/meminfo: memFree=28398316/32951124 swapFree=67111528/67111528
[pid=26130] ppid=26124 vsize=18324 CPUtime=0 cores=4,6
/proc/26130/stat : 26130 (ppfolio) S 26124 26130 26080 0 -1 4202496 501 0 2 0 0 0 0 0 15 0 1 0 97916907 18763776 394 33554432000 4194304 4287625 140733590615104 18446744073709551615 268660682255 0 0 4096 65536 4452947600580018176 0 0 17 6 0 0 4
/proc/26130/statm: 4581 394 345 23 0 91 0
[pid=26136] ppid=26130 vsize=1561880 CPUtime=2.14 cores=4
/proc/26136/stat : 26136 (cryptominisat) R 26130 26130 26080 0 -1 4202496 7213 0 0 0 214 0 0 0 21 0 1 0 97916912 1599365120 3309 33554432000 4194304 4587354 140735661411632 18446744073709551615 4237679 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/26136/statm: 390470 3309 327 96 0 387032 0
[pid=26138] ppid=26130 vsize=25708 CPUtime=2.88 cores=4
/proc/26138/stat : 26138 (clasp) R 26130 26130 26080 0 -1 4202496 3963 0 0 0 288 0 0 0 21 0 1 0 97916912 26324992 3758 33554432000 4194304 4785740 140735597378592 18446744073709551615 268660358854 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/26138/statm: 6427 3758 340 145 0 3472 0
[pid=26140] ppid=26130 vsize=459792 CPUtime=1.21 cores=4
/proc/26140/stat : 26140 (TNM) R 26130 26130 26080 0 -1 4202496 1543 0 0 0 121 0 0 0 25 0 1 0 97916912 470827008 1439 33554432000 134512640 134534564 4288797056 18446744073709551615 134530379 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/26140/statm: 114948 1439 95 6 0 113614 0
Current children cumulated CPU time (s) 6.23
Current children cumulated vsize (KiB) 2065704

[startup+12.7008 s]
/proc/loadavg: 3.62 2.32 2.02 15/202 26153
/proc/meminfo: memFree=28337972/32951124 swapFree=67111528/67111528
[pid=26130] ppid=26124 vsize=18324 CPUtime=0 cores=4,6
/proc/26130/stat : 26130 (ppfolio) S 26124 26130 26080 0 -1 4202496 501 0 2 0 0 0 0 0 15 0 1 0 97916907 18763776 394 33554432000 4194304 4287625 140733590615104 18446744073709551615 268660682255 0 0 4096 65536 0 0 0 17 6 0 0 4
/proc/26130/statm: 4581 394 345 23 0 91 0
[pid=26136] ppid=26130 vsize=1585740 CPUtime=4.24 cores=4
/proc/26136/stat : 26136 (cryptominisat) R 26130 26130 26080 0 -1 4202496 14233 0 0 0 423 1 0 0 25 0 1 0 97916912 1623797760 8765 33554432000 4194304 4587354 140735661411632 18446744073709551615 4241097 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/26136/statm: 396435 8765 337 96 0 392997 0
[pid=26138] ppid=26130 vsize=27584 CPUtime=5.02 cores=4
/proc/26138/stat : 26138 (clasp) R 26130 26130 26080 0 -1 4202496 4446 0 0 0 501 1 0 0 25 0 1 0 97916912 28246016 4241 33554432000 4194304 4785740 140735597378592 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/26138/statm: 6896 4241 340 145 0 3941 0
[pid=26140] ppid=26130 vsize=459792 CPUtime=3.38 cores=4
/proc/26140/stat : 26140 (TNM) R 26130 26130 26080 0 -1 4202496 1543 0 0 0 338 0 0 0 25 0 1 0 97916912 470827008 1439 33554432000 134512640 134534564 4288797056 18446744073709551615 134528957 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/26140/statm: 114948 1439 95 6 0 113614 0
Current children cumulated CPU time (s) 12.64
Current children cumulated vsize (KiB) 2091440

[startup+25.5005 s]
/proc/loadavg: 5.48 2.79 2.18 14/202 26153
/proc/meminfo: memFree=28282936/32951124 swapFree=67111528/67111528
[pid=26130] ppid=26124 vsize=18324 CPUtime=0 cores=4,6
/proc/26130/stat : 26130 (ppfolio) S 26124 26130 26080 0 -1 4202496 501 0 2 0 0 0 0 0 15 0 1 0 97916907 18763776 394 33554432000 4194304 4287625 140733590615104 18446744073709551615 268660682255 0 0 4096 65536 4452948425213739008 0 0 17 6 0 0 4
/proc/26130/statm: 4581 394 345 23 0 91 0
[pid=26136] ppid=26130 vsize=1583900 CPUtime=8.53 cores=4
/proc/26136/stat : 26136 (cryptominisat) R 26130 26130 26080 0 -1 4202496 17085 0 0 0 852 1 0 0 25 0 1 0 97916912 1621913600 7886 33554432000 4194304 4587354 140735661411632 18446744073709551615 4238431 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/26136/statm: 395975 7886 337 96 0 392537 0
[pid=26138] ppid=26130 vsize=31348 CPUtime=9.29 cores=4
/proc/26138/stat : 26138 (clasp) R 26130 26130 26080 0 -1 4202496 5378 0 0 0 928 1 0 0 25 0 1 0 97916912 32100352 5173 33554432000 4194304 4785740 140735597378592 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/26138/statm: 7837 5173 340 145 0 4882 0
[pid=26140] ppid=26130 vsize=459792 CPUtime=7.61 cores=4
/proc/26140/stat : 26140 (TNM) R 26130 26130 26080 0 -1 4202496 1543 0 0 0 761 0 0 0 25 0 1 0 97916912 470827008 1439 33554432000 134512640 134534564 4288797056 18446744073709551615 134528687 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/26140/statm: 114948 1439 95 6 0 113614 0
Current children cumulated CPU time (s) 25.43
Current children cumulated vsize (KiB) 2093364

[startup+51.101 s]
/proc/loadavg: 7.70 3.53 2.44 15/202 26154
/proc/meminfo: memFree=28155492/32951124 swapFree=67111528/67111528
[pid=26130] ppid=26124 vsize=18324 CPUtime=0 cores=4,6
/proc/26130/stat : 26130 (ppfolio) S 26124 26130 26080 0 -1 4202496 501 0 2 0 0 0 0 0 15 0 1 0 97916907 18763776 394 33554432000 4194304 4287625 140733590615104 18446744073709551615 268660682255 0 0 4096 65536 4452948287774785536 0 0 17 6 0 0 4
/proc/26130/statm: 4581 394 345 23 0 91 0
[pid=26136] ppid=26130 vsize=1601880 CPUtime=17.04 cores=4
/proc/26136/stat : 26136 (cryptominisat) R 26130 26130 26080 0 -1 4202496 26142 0 0 0 1701 3 0 0 25 0 1 0 97916912 1640325120 14640 33554432000 4194304 4587354 140735661411632 18446744073709551615 4388336 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/26136/statm: 400470 14640 337 96 0 397032 0
[pid=26138] ppid=26130 vsize=37296 CPUtime=17.81 cores=4
/proc/26138/stat : 26138 (clasp) R 26130 26130 26080 0 -1 4202496 6837 0 0 0 1780 1 0 0 25 0 1 0 97916912 38191104 6632 33554432000 4194304 4785740 140735597378592 18446744073709551615 4550354 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/26138/statm: 9324 6632 340 145 0 6369 0
[pid=26140] ppid=26130 vsize=459792 CPUtime=16.18 cores=4
/proc/26140/stat : 26140 (TNM) R 26130 26130 26080 0 -1 4202496 1543 0 0 0 1618 0 0 0 25 0 1 0 97916912 470827008 1439 33554432000 134512640 134534564 4288797056 18446744073709551615 134528504 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/26140/statm: 114948 1439 95 6 0 113614 0
Current children cumulated CPU time (s) 51.03
Current children cumulated vsize (KiB) 2117292

[startup+102.307 s]
/proc/loadavg: 10.13 4.83 2.94 14/202 26188
/proc/meminfo: memFree=28048804/32951124 swapFree=67111528/67111528
[pid=26130] ppid=26124 vsize=18324 CPUtime=0 cores=4,6
/proc/26130/stat : 26130 (ppfolio) S 26124 26130 26080 0 -1 4202496 501 0 2 0 0 0 0 0 15 0 1 0 97916907 18763776 394 33554432000 4194304 4287625 140733590615104 18446744073709551615 268660682255 0 0 4096 65536 4452948837530599424 0 0 17 6 0 0 4
/proc/26130/statm: 4581 394 345 23 0 91 0
[pid=26136] ppid=26130 vsize=1622964 CPUtime=34.13 cores=4
/proc/26136/stat : 26136 (cryptominisat) R 26130 26130 26080 0 -1 4202496 49959 0 0 0 3406 7 0 0 25 0 1 0 97916912 1661915136 19937 33554432000 4194304 4587354 140735661411632 18446744073709551615 4388336 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/26136/statm: 405741 19937 337 96 0 402303 0
[pid=26138] ppid=26130 vsize=44860 CPUtime=34.9 cores=4
/proc/26138/stat : 26138 (clasp) R 26130 26130 26080 0 -1 4202496 8651 0 0 0 3489 1 0 0 25 0 1 0 97916912 45936640 8446 33554432000 4194304 4785740 140735597378592 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/26138/statm: 11215 8446 340 145 0 8260 0
[pid=26140] ppid=26130 vsize=459792 CPUtime=33.2 cores=4
/proc/26140/stat : 26140 (TNM) R 26130 26130 26080 0 -1 4202496 1543 0 0 0 3320 0 0 0 25 0 1 0 97916912 470827008 1439 33554432000 134512640 134534564 4288797056 18446744073709551615 134530151 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/26140/statm: 114948 1439 95 6 0 113614 0
Current children cumulated CPU time (s) 102.23
Current children cumulated vsize (KiB) 2145940

[startup+162.3 s]
/proc/loadavg: 11.31 6.13 3.50 13/202 26190
/proc/meminfo: memFree=27870712/32951124 swapFree=67111528/67111528
[pid=26130] ppid=26124 vsize=18324 CPUtime=0 cores=4,6
/proc/26130/stat : 26130 (ppfolio) S 26124 26130 26080 0 -1 4202496 501 0 2 0 0 0 0 0 15 0 1 0 97916907 18763776 394 33554432000 4194304 4287625 140733590615104 18446744073709551615 268660682255 0 0 4096 65536 4452949387286413312 0 0 17 6 0 0 4
/proc/26130/statm: 4581 394 345 23 0 91 0
[pid=26136] ppid=26130 vsize=1631556 CPUtime=54.13 cores=4
/proc/26136/stat : 26136 (cryptominisat) R 26130 26130 26080 0 -1 4202496 79628 0 0 0 5401 12 0 0 25 0 1 0 97916912 1670713344 21855 33554432000 4194304 4587354 140735661411632 18446744073709551615 4388345 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/26136/statm: 407889 21855 337 96 0 404451 0
[pid=26138] ppid=26130 vsize=49768 CPUtime=54.9 cores=4

################
# More data... #
################

/proc/26138/statm: 14437 11612 340 145 0 11482 0
[pid=26140] ppid=26130 vsize=459792 CPUtime=93.21 cores=4
/proc/26140/stat : 26140 (TNM) R 26130 26130 26080 0 -1 4202496 1543 0 0 0 9321 0 0 0 25 0 1 0 97916912 470827008 1439 33554432000 134512640 134534564 4288797056 18446744073709551615 134530549 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/26140/statm: 114948 1439 95 6 0 113614 0
Current children cumulated CPU time (s) 282.24
Current children cumulated vsize (KiB) 2112744

[startup+342.301 s]
/proc/loadavg: 11.96 8.78 4.99 14/202 26195
/proc/meminfo: memFree=27376940/32951124 swapFree=67111528/67111528
[pid=26130] ppid=26124 vsize=18324 CPUtime=0 cores=4,6
/proc/26130/stat : 26130 (ppfolio) S 26124 26130 26080 0 -1 4202496 501 0 2 0 0 0 0 0 15 0 1 0 97916907 18763776 394 33554432000 4194304 4287625 140733590615104 18446744073709551615 268660682255 0 0 4096 65536 4452947875457925120 0 0 17 6 0 0 4
/proc/26130/statm: 4581 394 345 23 0 91 0
[pid=26136] ppid=26130 vsize=1656140 CPUtime=114.12 cores=4
/proc/26136/stat : 26136 (cryptominisat) R 26130 26130 26080 0 -1 4202496 120079 0 0 0 11391 21 0 0 25 0 1 0 97916912 1695887360 25050 33554432000 4194304 4587354 140735661411632 18446744073709551615 4388336 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/26136/statm: 414035 25050 337 96 0 410597 0
[pid=26138] ppid=26130 vsize=64384 CPUtime=114.9 cores=4
/proc/26138/stat : 26138 (clasp) R 26130 26130 26080 0 -1 4202496 13457 0 0 0 11487 3 0 0 25 0 1 0 97916912 65929216 13252 33554432000 4194304 4785740 140735597378592 18446744073709551615 4553437 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/26138/statm: 16096 13252 340 145 0 13141 0
[pid=26140] ppid=26130 vsize=459792 CPUtime=113.22 cores=4
/proc/26140/stat : 26140 (TNM) R 26130 26130 26080 0 -1 4202496 1543 0 0 0 11322 0 0 0 25 0 1 0 97916912 470827008 1439 33554432000 134512640 134534564 4288797056 18446744073709551615 134528295 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/26140/statm: 114948 1439 95 6 0 113614 0
Current children cumulated CPU time (s) 342.24
Current children cumulated vsize (KiB) 2198640

[startup+402.301 s]
/proc/loadavg: 12.02 9.38 5.43 14/202 26196
/proc/meminfo: memFree=27708832/32951124 swapFree=67111528/67111528
[pid=26130] ppid=26124 vsize=18324 CPUtime=0 cores=4,6
/proc/26130/stat : 26130 (ppfolio) S 26124 26130 26080 0 -1 4202496 501 0 2 0 0 0 0 0 15 0 1 0 97916907 18763776 394 33554432000 4194304 4287625 140733590615104 18446744073709551615 268660682255 0 0 4096 65536 4452948700091645952 0 0 17 6 0 0 4
/proc/26130/statm: 4581 394 345 23 0 91 0
[pid=26136] ppid=26130 vsize=1577736 CPUtime=134.12 cores=4
/proc/26136/stat : 26136 (cryptominisat) R 26130 26130 26080 0 -1 4202496 128622 0 0 0 13389 23 0 0 25 0 1 0 97916912 1615601664 5785 33554432000 4194304 4587354 140735661411632 18446744073709551615 4242404 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/26136/statm: 394434 5785 337 96 0 390996 0
[pid=26138] ppid=26130 vsize=66216 CPUtime=134.89 cores=4
/proc/26138/stat : 26138 (clasp) R 26130 26130 26080 0 -1 4202496 13896 0 0 0 13486 3 0 0 25 0 1 0 97916912 67805184 13691 33554432000 4194304 4785740 140735597378592 18446744073709551615 4278587 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/26138/statm: 16554 13691 340 145 0 13599 0
[pid=26140] ppid=26130 vsize=459792 CPUtime=133.22 cores=4
/proc/26140/stat : 26140 (TNM) R 26130 26130 26080 0 -1 4202496 1543 0 0 0 13322 0 0 0 25 0 1 0 97916912 470827008 1439 33554432000 134512640 134534564 4288797056 18446744073709551615 134530614 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/26140/statm: 114948 1439 95 6 0 113614 0
Current children cumulated CPU time (s) 402.23
Current children cumulated vsize (KiB) 2122068

[startup+462.301 s]
/proc/loadavg: 12.01 9.85 5.84 14/202 26207
/proc/meminfo: memFree=27421540/32951124 swapFree=67111528/67111528
[pid=26130] ppid=26124 vsize=18324 CPUtime=0 cores=4,6
/proc/26130/stat : 26130 (ppfolio) S 26124 26130 26080 0 -1 4202496 501 0 2 0 0 0 0 0 15 0 1 0 97916907 18763776 394 33554432000 4194304 4287625 140733590615104 18446744073709551615 268660682255 0 0 4096 65536 4452949249847459840 0 0 17 6 0 0 4
/proc/26130/statm: 4581 394 345 23 0 91 0
[pid=26136] ppid=26130 vsize=1564712 CPUtime=154.11 cores=4
/proc/26136/stat : 26136 (cryptominisat) R 26130 26130 26080 0 -1 4202496 149138 0 0 0 15384 27 0 0 25 0 1 0 97916912 1602265088 6535 33554432000 4194304 4587354 140735661411632 18446744073709551615 4238576 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/26136/statm: 391178 6535 337 96 0 387740 0
[pid=26138] ppid=26130 vsize=68488 CPUtime=154.89 cores=4
/proc/26138/stat : 26138 (clasp) R 26130 26130 26080 0 -1 4202496 14478 0 0 0 15486 3 0 0 25 0 1 0 97916912 70131712 14273 33554432000 4194304 4785740 140735597378592 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/26138/statm: 17122 14273 340 145 0 14167 0
[pid=26140] ppid=26130 vsize=459792 CPUtime=153.23 cores=4
/proc/26140/stat : 26140 (TNM) R 26130 26130 26080 0 -1 4202496 1543 0 0 0 15323 0 0 0 25 0 1 0 97916912 470827008 1439 33554432000 134512640 134534564 4288797056 18446744073709551615 134528504 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/26140/statm: 114948 1439 95 6 0 113614 0
Current children cumulated CPU time (s) 462.23
Current children cumulated vsize (KiB) 2111316

[startup+522.301 s]
/proc/loadavg: 12.00 10.24 6.22 14/202 26209
/proc/meminfo: memFree=27384688/32951124 swapFree=67111528/67111528
[pid=26130] ppid=26124 vsize=18324 CPUtime=0 cores=4,6
/proc/26130/stat : 26130 (ppfolio) S 26124 26130 26080 0 -1 4202496 501 0 2 0 0 0 0 0 15 0 1 0 97916907 18763776 394 33554432000 4194304 4287625 140733590615104 18446744073709551615 268660682255 0 0 4096 65536 4452948425213739008 0 0 17 6 0 0 4
/proc/26130/statm: 4581 394 345 23 0 91 0
[pid=26136] ppid=26130 vsize=1658288 CPUtime=174.11 cores=4
/proc/26136/stat : 26136 (cryptominisat) R 26130 26130 26080 0 -1 4202496 171899 0 0 0 17382 29 0 0 25 0 1 0 97916912 1698086912 29291 33554432000 4194304 4587354 140735661411632 18446744073709551615 4388352 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/26136/statm: 414572 29291 337 96 0 411134 0
[pid=26138] ppid=26130 vsize=73732 CPUtime=174.88 cores=4
/proc/26138/stat : 26138 (clasp) R 26130 26130 26080 0 -1 4202496 15724 0 0 0 17485 3 0 0 25 0 1 0 97916912 75501568 15519 33554432000 4194304 4785740 140735597378592 18446744073709551615 4287241 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/26138/statm: 18433 15519 340 145 0 15478 0
[pid=26140] ppid=26130 vsize=459792 CPUtime=173.24 cores=4
/proc/26140/stat : 26140 (TNM) R 26130 26130 26080 0 -1 4202496 1543 0 0 0 17324 0 0 0 25 0 1 0 97916912 470827008 1439 33554432000 134512640 134534564 4288797056 18446744073709551615 134528988 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/26140/statm: 114948 1439 95 6 0 113614 0
Current children cumulated CPU time (s) 522.23
Current children cumulated vsize (KiB) 2210136

Solver just ended. Dumping a history of the last processes samples

[startup+524.708 s]
/proc/loadavg: 12.00 10.27 6.26 13/202 26209
/proc/meminfo: memFree=27382704/32951124 swapFree=67111528/67111528
[pid=26130] ppid=26124 vsize=18324 CPUtime=0 cores=4,6
/proc/26130/stat : 26130 (ppfolio) S 26124 26130 26080 0 -1 4202496 501 0 2 0 0 0 0 0 15 0 1 0 97916907 18763776 394 33554432000 4194304 4287625 140733590615104 18446744073709551615 268660682255 0 0 4096 65536 4452948425213739008 0 0 17 6 0 0 4
/proc/26130/statm: 4581 394 345 23 0 91 0
[pid=26136] ppid=26130 vsize=1658288 CPUtime=174.91 cores=4
/proc/26136/stat : 26136 (cryptominisat) R 26130 26130 26080 0 -1 4202496 171899 0 0 0 17462 29 0 0 25 0 1 0 97916912 1698086912 29291 33554432000 4194304 4587354 140735661411632 18446744073709551615 4388350 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/26136/statm: 414572 29291 337 96 0 411134 0
[pid=26138] ppid=26130 vsize=73732 CPUtime=175.68 cores=4
/proc/26138/stat : 26138 (clasp) R 26130 26130 26080 0 -1 4202496 15724 0 0 0 17565 3 0 0 25 0 1 0 97916912 75501568 15519 33554432000 4194304 4785740 140735597378592 18446744073709551615 4287241 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/26138/statm: 18433 15519 340 145 0 15478 0
[pid=26140] ppid=26130 vsize=459792 CPUtime=174.04 cores=4
/proc/26140/stat : 26140 (TNM) R 26130 26130 26080 0 -1 4202496 1543 0 0 0 17404 0 0 0 25 0 1 0 97916912 470827008 1439 33554432000 134512640 134534564 4288797056 18446744073709551615 134528737 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/26140/statm: 114948 1439 95 6 0 113614 0
Current children cumulated CPU time (s) 524.63
Current children cumulated vsize (KiB) 2210136

[startup+527.901 s]
/proc/loadavg: 12.00 10.27 6.26 14/202 26209
/proc/meminfo: memFree=27380348/32951124 swapFree=67111528/67111528
[pid=26130] ppid=26124 vsize=18324 CPUtime=0 cores=4,6
/proc/26130/stat : 26130 (ppfolio) S 26124 26130 26080 0 -1 4202496 501 0 2 0 0 0 0 0 15 0 1 0 97916907 18763776 394 33554432000 4194304 4287625 140733590615104 18446744073709551615 268660682255 0 0 4096 65536 4452948425213739008 0 0 17 6 0 0 4
/proc/26130/statm: 4581 394 345 23 0 91 0
[pid=26136] ppid=26130 vsize=1658288 CPUtime=176.01 cores=4
/proc/26136/stat : 26136 (cryptominisat) R 26130 26130 26080 0 -1 4202496 171899 0 0 0 17572 29 0 0 25 0 1 0 97916912 1698086912 29291 33554432000 4194304 4587354 140735661411632 18446744073709551615 4388350 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/26136/statm: 414572 29291 337 96 0 411134 0
[pid=26138] ppid=26130 vsize=73732 CPUtime=176.75 cores=4
/proc/26138/stat : 26138 (clasp) R 26130 26130 26080 0 -1 4202496 15724 0 0 0 17672 3 0 0 25 0 1 0 97916912 75501568 15519 33554432000 4194304 4785740 140735597378592 18446744073709551615 4287058 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/26138/statm: 18433 15519 340 145 0 15478 0
[pid=26140] ppid=26130 vsize=459792 CPUtime=175.08 cores=4
/proc/26140/stat : 26140 (TNM) R 26130 26130 26080 0 -1 4202496 1543 0 0 0 17508 0 0 0 25 0 1 0 97916912 470827008 1439 33554432000 134512640 134534564 4288797056 18446744073709551615 134528944 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/26140/statm: 114948 1439 95 6 0 113614 0
Current children cumulated CPU time (s) 527.84
Current children cumulated vsize (KiB) 2210136

[startup+528.701 s]
/proc/loadavg: 12.00 10.27 6.26 14/202 26209
/proc/meminfo: memFree=27380348/32951124 swapFree=67111528/67111528
[pid=26130] ppid=26124 vsize=18324 CPUtime=0 cores=4,6
/proc/26130/stat : 26130 (ppfolio) S 26124 26130 26080 0 -1 4202496 501 0 2 0 0 0 0 0 15 0 1 0 97916907 18763776 394 33554432000 4194304 4287625 140733590615104 18446744073709551615 268660682255 0 0 4096 65536 4452948425213739008 0 0 17 6 0 0 4
/proc/26130/statm: 4581 394 345 23 0 91 0
[pid=26136] ppid=26130 vsize=1658288 CPUtime=176.27 cores=4
/proc/26136/stat : 26136 (cryptominisat) R 26130 26130 26080 0 -1 4202496 171899 0 0 0 17598 29 0 0 25 0 1 0 97916912 1698086912 29291 33554432000 4194304 4587354 140735661411632 18446744073709551615 4388350 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/26136/statm: 414572 29291 337 96 0 411134 0
[pid=26138] ppid=26130 vsize=73732 CPUtime=176.98 cores=4
/proc/26138/stat : 26138 (clasp) R 26130 26130 26080 0 -1 4202496 15724 0 0 0 17695 3 0 0 25 0 1 0 97916912 75501568 15519 33554432000 4194304 4785740 140735597378592 18446744073709551615 4287237 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/26138/statm: 18433 15519 340 145 0 15478 0
[pid=26140] ppid=26130 vsize=459792 CPUtime=175.38 cores=4
/proc/26140/stat : 26140 (TNM) R 26130 26130 26080 0 -1 4202496 1543 0 0 0 17538 0 0 0 25 0 1 0 97916912 470827008 1439 33554432000 134512640 134534564 4288797056 18446744073709551615 134528708 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/26140/statm: 114948 1439 95 6 0 113614 0
Current children cumulated CPU time (s) 528.63
Current children cumulated vsize (KiB) 2210136

[startup+529.501 s]
/proc/loadavg: 12.00 10.30 6.29 14/202 26209
/proc/meminfo: memFree=27396700/32951124 swapFree=67111528/67111528
[pid=26130] ppid=26124 vsize=18324 CPUtime=0 cores=4,6
/proc/26130/stat : 26130 (ppfolio) S 26124 26130 26080 0 -1 4202496 501 0 2 0 0 0 0 0 15 0 1 0 97916907 18763776 394 33554432000 4194304 4287625 140733590615104 18446744073709551615 268660682255 0 0 4096 65536 4452948425213739008 0 0 17 6 0 0 4
/proc/26130/statm: 4581 394 345 23 0 91 0
[pid=26136] ppid=26130 vsize=1658288 CPUtime=176.51 cores=4
/proc/26136/stat : 26136 (cryptominisat) R 26130 26130 26080 0 -1 4202496 171899 0 0 0 17622 29 0 0 25 0 1 0 97916912 1698086912 29291 33554432000 4194304 4587354 140735661411632 18446744073709551615 4388336 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/26136/statm: 414572 29291 337 96 0 411134 0
[pid=26138] ppid=26130 vsize=73732 CPUtime=177.28 cores=4
/proc/26138/stat : 26138 (clasp) R 26130 26130 26080 0 -1 4202496 15724 0 0 0 17725 3 0 0 25 0 1 0 97916912 75501568 15519 33554432000 4194304 4785740 140735597378592 18446744073709551615 4287104 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/26138/statm: 18433 15519 340 145 0 15478 0
[pid=26140] ppid=26130 vsize=459792 CPUtime=175.64 cores=4
/proc/26140/stat : 26140 (TNM) R 26130 26130 26080 0 -1 4202496 1543 0 0 0 17564 0 0 0 25 0 1 0 97916912 470827008 1439 33554432000 134512640 134534564 4288797056 18446744073709551615 134530360 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/26140/statm: 114948 1439 95 6 0 113614 0
Current children cumulated CPU time (s) 529.43
Current children cumulated vsize (KiB) 2210136

[startup+529.701 s]
/proc/loadavg: 12.00 10.30 6.29 14/202 26209
/proc/meminfo: memFree=27396700/32951124 swapFree=67111528/67111528
[pid=26130] ppid=26124 vsize=18324 CPUtime=0 cores=4,6
/proc/26130/stat : 26130 (ppfolio) S 26124 26130 26080 0 -1 4202496 501 0 2 0 0 0 0 0 15 0 1 0 97916907 18763776 394 33554432000 4194304 4287625 140733590615104 18446744073709551615 268660682255 0 0 4096 65536 4452948425213739008 0 0 17 6 0 0 4
/proc/26130/statm: 4581 394 345 23 0 91 0
[pid=26136] ppid=26130 vsize=1658288 CPUtime=176.61 cores=4
/proc/26136/stat : 26136 (cryptominisat) R 26130 26130 26080 0 -1 4202496 171899 0 0 0 17632 29 0 0 25 0 1 0 97916912 1698086912 29291 33554432000 4194304 4587354 140735661411632 18446744073709551615 4388345 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/26136/statm: 414572 29291 337 96 0 411134 0
[pid=26138] ppid=26130 vsize=73732 CPUtime=177.34 cores=4
/proc/26138/stat : 26138 (clasp) R 26130 26130 26080 0 -1 4202496 15724 0 0 0 17731 3 0 0 25 0 1 0 97916912 75501568 15519 33554432000 4194304 4785740 140735597378592 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/26138/statm: 18433 15519 340 145 0 15478 0
[pid=26140] ppid=26130 vsize=459792 CPUtime=175.68 cores=4
/proc/26140/stat : 26140 (TNM) R 26130 26130 26080 0 -1 4202496 1543 0 0 0 17568 0 0 0 25 0 1 0 97916912 470827008 1439 33554432000 134512640 134534564 4288797056 18446744073709551615 134530664 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/26140/statm: 114948 1439 95 6 0 113614 0
Current children cumulated CPU time (s) 529.63
Current children cumulated vsize (KiB) 2210136

Child status: 0
Real time (s): 529.776
CPU time (s): 529.742
CPU user time (s): 529.394
CPU system time (s): 0.347947
CPU usage (%): 99.9937
Max. virtual memory (cumulated for all children) (KiB): 3644544

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 529.395
system time used= 0.347947
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 189705
page faults= 2
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 290
involuntary context switches= 5875

runsolver used 0.929858 second user time and 1.9647 second system time

The end

Launcher Data 

Begin job on node107 at 2011-04-11 17:54:16
IDJOB=3191471
IDBENCH=82602
IDSOLVER=1613
FILE ID=node107/3191471-1302537256
RUNJOBID= node107-1302537256-26099
PBS_JOBID= 12951133
Free space on /tmp= 73676 MiB

SOLVER NAME= ppfolio seq
BENCH NAME= SAT11/random/large/unif-k5-r20-v1250-c25000-S936047914-093-UNKNOWN.cnf
COMMAND LINE= ppfolio --nbcore=1 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3191471-1302537256/watcher-3191471-1302537256 -o /tmp/evaluation-result-3191471-1302537256/solver-3191471-1302537256 -C 2400 -W 1300 -M 7680  ppfolio --nbcore=1 HOME/instance-3191471-1302537256.cnf

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 7680 MiB
NBCORE= 2

MD5SUM BENCH= c578ae902020675717dd7f7fb0a11360
RANDOM SEED=1247652335

node107.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5359.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      28647896 kB
Buffers:        520708 kB
Cached:        3477988 kB
SwapCached:          0 kB
Active:        2330148 kB
Inactive:      1735300 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      28647896 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:           36140 kB
Writeback:           0 kB
AnonPages:       65924 kB
Mapped:          14712 kB
Slab:           173228 kB
PageTables:       5388 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   189128 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73628 MiB
End job on node107 at 2011-04-11 18:03:06