Trace number 3249548

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ttsth 5-4? 4800.1 1203.39

General information on the benchmark

Namecrafted/mosoi/289/
289-unsat-17x27.cnf
MD5SUMb9a7e3013b1b74b08c8e421f15cb16c4
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables1836
Number of clauses194157
Sum of the clauses size771120
Maximum clause length4
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 22754
Number of clauses of size 30
Number of clauses of size 4191403
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.17/0.23	c Command: HOME/ttsth-5-4 -num-threads 4 HOME/instance-3249548-1304063578.cnf 
0.17/0.23	c Using SATTIMEOUT of 4800
0.17/0.23	c Using SATRAM of 15500
0.17/0.23	c Size of subset node = 32
0.17/0.23	c Variables = 1836
0.17/0.23	c Clauses = 194157
0.17/0.23	c Literals = 771120
0.17/0.23	c Reduced size:
0.17/0.23	c Variables = 1836
0.17/0.23	c Clauses = 194157
0.17/0.23	c Literals = 771120
0.17/0.23	c a2
0.56/0.64	c a1
1.47/1.55	c Independent sub-problems = 1
1.47/1.55	c Sub-problem with 1836 variables and 194157 clauses
1.47/1.55	c using permutation method 4
1.47/1.55	c count = 1
1.47/1.55	c Ordering finished 1.490 seconds
1.47/1.55	c mapped 1.520 seconds
1.47/1.55	c permuted 1.520 seconds
1.47/1.55	c about to sort
1.47/1.58	c sorted
1.86/1.94	c clauses now 194157
1.86/1.94	c init finished 1.580 seconds
1.86/1.94	c tree built 1.910 seconds
1.86/1.94	c 
1.86/1.94	c PA progress                      | CPU progress Partial assignments | improvements                 ucps  CPU time       PA/sec  nodes
1.86/1.94	c ---------------------------------|----------------------------------|--------------------------------------------------------------------
1.86/1.94	c ................................ | ..........                    |                                  1.9         0.0             
1.86/1.94	c ................................ | ..........                  1 |                                  1.9         0.5             
1.86/1.94	c ................................ | ..........                  2 |                                  1.9         1.0             
1.86/1.94	c ................................ | ..........                  3 |                                  1.9         1.6             
1.86/1.94	c ................................ | ..........                  4 |                                  1.9         2.1             
1.86/1.94	c ................................ | ..........                  5 |                                  1.9         2.6             
1.86/1.95	c ................................ | ..........               1000 | 12           470                 1.9       512.8         1489
95.95/25.54	c ................................ | ..........             906000 | 66653        343867             96.2      9422.8      1206988
191.82/49.59	c ................................ | ..........            1519000 | 117779       554732            192.2      7904.0      2392119
288.06/73.68	c ................................ | ..........            1900000 | 152368       668519            288.4      6588.3      3245812
383.90/97.66	c ................................ | ..........            2204000 | 177757       746932            384.1      5737.3      3832542
480.13/121.75	c ................................ | *.........            2507000 | 202054       829550            480.4      5219.0      4321351
575.99/145.74	c ................................ | *.........            2811000 | 228750       921906            576.1      4879.0      4846756
671.82/169.75	c ................................ | *.........            3058000 | 251834       995706            672.0      4550.4      5269517
768.08/193.81	c ................................ | *.........            3347000 | 275082       1088323           768.1      4357.4      5754366
863.94/217.83	c ................................ | *.........            3603000 | 294607       1175592           864.0      4170.0      6072698
960.17/241.96	c ................................ | **........            3807000 | 314010       1233509           960.4      3963.9      6537070
1056.00/265.93	c ................................ | **........            4011000 | 333228       1296172          1056.1      3797.8      6984586
1152.25/290.05	c ................................ | **........            4238000 | 352969       1363303          1152.5      3677.3      7390176
1248.11/314.01	c ................................ | **........            4432000 | 369953       1419940          1248.2      3550.8      7645720
1343.95/338.06	c ................................ | **........            4600000 | 389521       1459937          1344.2      3422.1      8070772
1439.82/362.08	c ................................ | ***.......            4773000 | 408579       1507968          1440.1      3314.3      8397216
1536.08/386.15	c ................................ | ***.......            4983000 | 426418       1568113          1536.2      3243.6      8724387
1631.91/410.18	c ................................ | ***.......            5153000 | 446131       1611585          1632.3      3157.0      9122783
1728.16/434.25	c ................................ | ***.......            5326000 | 464787       1649350          1728.4      3081.5      9535074
1824.01/458.29	c ................................ | ***.......            5475000 | 480961       1687702          1824.4      3001.0      9845739
1920.26/482.32	c ................................ | ****......            5658000 | 499705       1736413          1920.4      2946.3     10172627
2016.09/506.34	c ................................ | ****......            6002000 | 523016       1849263          2016.3      2976.8     10843506
2111.94/530.34	c ................................ | ****......            6307000 | 547050       1949049          2112.1      2986.1     11415113
2207.81/554.38	c ................................ | ****......            6556000 | 568686       2026633          2208.1      2969.1     11824903
2304.05/578.40	c ................................ | ****......            6746000 | 586411       2075432          2304.1      2927.9     12314020
2400.29/602.55	c ................................ | *****.....            6949000 | 603651       2125080          2400.5      2894.8     12723441
2495.73/626.48	c ................................ | *****.....            7176000 | 624410       2185078          2496.1      2874.9     13106880
2592.37/650.60	c ................................ | *****.....            7345000 | 640736       2220642          2592.4      2833.3     13413006
2687.82/674.56	c ................................ | *****.....            7465000 | 650369       2249941          2688.1      2777.1     13759419
2783.70/698.58	c ................................ | *****.....            7610000 | 665165       2282181          2784.0      2733.5     14265948
2879.94/722.64	c ................................ | ******....            7726000 | 677859       2308862          2880.1      2682.6     14640658
2976.17/746.70	c ................................ | ******....            7877000 | 691665       2352589          2976.2      2646.7     14974680
3072.03/770.76	c ................................ | ******....            7996000 | 703487       2383471          3072.3      2602.6     15246530
3168.29/794.89	c ................................ | ******....            8108000 | 715135       2412042          3168.7      2558.8     15559442
3264.13/818.89	c ................................ | ******....            8283000 | 730484       2466933          3264.5      2537.3     15968294
3360.78/843.01	c ................................ | *******...            8425000 | 741345       2513692          3360.8      2506.8     16254536
3455.87/866.88	c ................................ | *******...            8554000 | 751951       2553984          3456.2      2475.0     16462715
3552.90/891.13	c ................................ | *******...            8660000 | 761949       2580522          3553.0      2437.3     16678359
3647.95/914.99	c ................................ | *******...            8795000 | 774765       2620083          3648.3      2410.7     17089864
3744.61/939.16	c ................................ | *******...            8930000 | 786544       2660631          3744.9      2384.6     17391481
3840.86/963.26	c ................................ | ********..            9039000 | 797094       2688786          3841.1      2353.2     17518761
3935.92/987.09	c ................................ | ********..            9133000 | 807232       2709429          3936.3      2320.2     17777071
4032.58/1011.24	c ................................ | ********..            9256000 | 818645       2745429          4032.8      2295.2     18090653
4128.06/1035.16	c ................................ | ********..            9350000 | 829559       2764394          4128.3      2264.9     18418347
4224.71/1059.31	c ................................ | ********..            9484000 | 842338       2801649          4224.8      2244.9     18759581
4320.16/1083.23	c ................................ | *********.            9569000 | 851298       2821890          4320.3      2214.9     18958059
4415.62/1107.19	c ................................ | *********.            9660000 | 862277       2839594          4416.0      2187.5     19196155
4512.28/1131.32	c ................................ | *********.            9772000 | 873633       2867963          4512.4      2165.6     19405943
4608.14/1155.31	c ................................ | *********.            9884000 | 886529       2893995          4608.2      2144.9     19819300
4703.99/1179.32	c ................................ | *********.           10141000 | 911313       2952964          4704.1      2155.8     20753072
4799.87/1203.35	c CPU limit (4800) reached
4799.87/1203.35	c Time = 4800.04 seconds
4799.87/1203.35	s UNKNOWN

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3249548-1304063578/watcher-3249548-1304063578 -o /tmp/evaluation-result-3249548-1304063578/solver-3249548-1304063578 -C 4800 -W 1300 -M 15500 HOME/ttsth-5-4 -num-threads 4 HOME/instance-3249548-1304063578.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.50 7.89 7.50 5/181 31692
/proc/meminfo: memFree=15018492/32950928 swapFree=67111528/67111528
[pid=31692] ppid=31690 vsize=11800 CPUtime=0 cores=1,3,5,7
/proc/31692/stat : 31692 (runsolver) S 31690 31692 31098 0 -1 4202560 42 0 0 0 0 0 0 0 25 0 1 0 517957490 12083200 51 33554432000 4194304 5434984 140733209876672 18446744073709551615 4881607 0 2147483391 4096 24578 18446744071699977015 0 0 17 5 0 0 0
/proc/31692/statm: 2950 51 31 303 0 2644 0

[startup+0.0198149 s]
/proc/loadavg: 7.50 7.89 7.50 5/181 31692
/proc/meminfo: memFree=15018492/32950928 swapFree=67111528/67111528
[pid=31692] ppid=31690 vsize=11800 CPUtime=0 cores=1,3,5,7
/proc/31692/stat : 31692 (runsolver) S 31690 31692 31098 0 -1 4202560 42 0 0 0 0 0 0 0 25 0 1 0 517957490 12083200 51 33554432000 4194304 5434984 140733209876672 18446744073709551615 4881607 0 2147483391 4096 24578 18446744071699977015 0 0 17 5 0 0 0
/proc/31692/statm: 2950 51 31 303 0 2644 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 11800

[startup+0.105806 s]
/proc/loadavg: 7.50 7.89 7.50 5/181 31692
/proc/meminfo: memFree=15018492/32950928 swapFree=67111528/67111528
[pid=31692] ppid=31690 vsize=18532 CPUtime=0.07 cores=1,3,5,7
/proc/31692/stat : 31692 (ttsth-5-4) R 31690 31692 31098 0 -1 4202496 2694 0 0 0 7 0 0 0 25 0 1 0 517957490 18976768 2636 33554432000 4194304 4338100 140734855487488 18446744073709551615 4223897 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/31692/statm: 4633 2637 148 36 0 2538 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 18532

[startup+0.300772 s]
/proc/loadavg: 7.50 7.89 7.50 5/181 31692
/proc/meminfo: memFree=15018492/32950928 swapFree=67111528/67111528
[pid=31692] ppid=31690 vsize=71636 CPUtime=0.27 cores=1,3,5,7
/proc/31692/stat : 31692 (ttsth-5-4) R 31690 31692 31098 0 -1 4202496 14287 0 0 0 25 2 0 0 25 0 1 0 517957490 73355264 14051 33554432000 4194304 4338100 140734855487488 18446744073709551615 274473664267 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/31692/statm: 17949 14069 353 36 0 15854 0
Current children cumulated CPU time (s) 0.27
Current children cumulated vsize (KiB) 71636

[startup+0.7007 s]
/proc/loadavg: 7.50 7.89 7.50 5/181 31692
/proc/meminfo: memFree=15018492/32950928 swapFree=67111528/67111528
[pid=31692] ppid=31690 vsize=37100 CPUtime=0.66 cores=1,3,5,7
/proc/31692/stat : 31692 (ttsth-5-4) R 31690 31692 31098 0 -1 4202496 19375 0 0 0 64 2 0 0 25 0 1 0 517957490 37990400 7310 33554432000 4194304 4338100 140734855487488 18446744073709551615 4245241 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/31692/statm: 9275 7310 155 36 0 7180 0
Current children cumulated CPU time (s) 0.66
Current children cumulated vsize (KiB) 37100

[startup+1.50056 s]
/proc/loadavg: 7.50 7.89 7.50 6/182 31693
/proc/meminfo: memFree=14967900/32950928 swapFree=67111528/67111528
[pid=31692] ppid=31690 vsize=55316 CPUtime=1.47 cores=1,3,5,7
/proc/31692/stat : 31692 (ttsth-5-4) R 31690 31692 31098 0 -1 4202496 23917 0 0 0 144 3 0 0 25 0 1 0 517957490 56643584 11852 33554432000 4194304 4338100 140734855487488 18446744073709551615 4295924 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/31692/statm: 13829 11852 156 36 0 11734 0
Current children cumulated CPU time (s) 1.47
Current children cumulated vsize (KiB) 55316

[startup+3.10028 s]
/proc/loadavg: 7.50 7.89 7.50 9/186 31697
/proc/meminfo: memFree=14923716/32950928 swapFree=67111528/67111528
[pid=31692] ppid=31690 vsize=331712 CPUtime=6.51 cores=1,3,5,7
/proc/31692/stat : 31692 (ttsth-5-4) S 31690 31692 31098 0 -1 4202496 32737 0 0 0 637 14 0 0 25 0 5 0 517957490 339673088 19912 33554432000 4194304 4338100 140734855487488 18446744073709551615 274485770213 0 0 4096 0 18446744073709551615 0 0 17 3 0 0 0
/proc/31692/statm: 82928 19912 176 36 0 80833 0
[pid=31692/tid=31694] ppid=31690 vsize=331712 CPUtime=1.14 cores=1,3,5,7
/proc/31692/task/31694/stat : 31694 (ttsth-5-4) R 31690 31692 31098 0 -1 4202560 707 0 0 0 113 1 0 0 19 0 5 0 517957684 339673088 19912 33554432000 4194304 4338100 140734855487488 18446744073709551615 274485793461 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=31692/tid=31695] ppid=31690 vsize=331712 CPUtime=1.14 cores=1,3,5,7
/proc/31692/task/31695/stat : 31695 (ttsth-5-4) R 31690 31692 31098 0 -1 4202560 461 0 0 0 112 2 0 0 19 0 5 0 517957684 339673088 19912 33554432000 4194304 4338100 140734855487488 18446744073709551615 274485793461 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=31692/tid=31696] ppid=31690 vsize=331712 CPUtime=1.14 cores=1,3,5,7
/proc/31692/task/31696/stat : 31696 (ttsth-5-4) R 31690 31692 31098 0 -1 4202560 508 0 0 0 111 3 0 0 19 0 5 0 517957684 339673088 19912 33554432000 4194304 4338100 140734855487488 18446744073709551615 274485793461 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=31692/tid=31697] ppid=31690 vsize=331712 CPUtime=1.14 cores=1,3,5,7
/proc/31692/task/31697/stat : 31697 (ttsth-5-4) R 31690 31692 31098 0 -1 4202560 431 0 0 0 112 2 0 0 19 0 5 0 517957684 339673088 19912 33554432000 4194304 4338100 140734855487488 18446744073709551615 274485793461 0 0 4096 0 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 6.51
Current children cumulated vsize (KiB) 331712

[startup+6.30071 s]
/proc/loadavg: 7.54 7.89 7.50 9/186 31697
/proc/meminfo: memFree=14883300/32950928 swapFree=67111528/67111528
[pid=31692] ppid=31690 vsize=334972 CPUtime=19.29 cores=1,3,5,7
/proc/31692/stat : 31692 (ttsth-5-4) S 31690 31692 31098 0 -1 4202496 34707 0 0 0 1874 55 0 0 25 0 5 0 517957490 343011328 21882 33554432000 4194304 4338100 140734855487488 18446744073709551615 274485770213 0 0 4096 0 18446744073709551615 0 0 17 3 0 0 0
/proc/31692/statm: 83743 21882 176 36 0 81648 0
[pid=31692/tid=31694] ppid=31690 vsize=334972 CPUtime=4.34 cores=1,3,5,7
/proc/31692/task/31694/stat : 31694 (ttsth-5-4) R 31690 31692 31098 0 -1 4202560 1468 0 0 0 422 12 0 0 18 0 5 0 517957684 343011328 21882 33554432000 4194304 4338100 140734855487488 18446744073709551615 4256139 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=31692/tid=31695] ppid=31690 vsize=334972 CPUtime=4.32 cores=1,3,5,7
/proc/31692/task/31695/stat : 31695 (ttsth-5-4) R 31690 31692 31098 0 -1 4202560 969 0 0 0 420 12 0 0 25 0 5 0 517957684 343011328 21882 33554432000 4194304 4338100 140734855487488 18446744073709551615 274485781763 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=31692/tid=31696] ppid=31690 vsize=334972 CPUtime=4.34 cores=1,3,5,7
/proc/31692/task/31696/stat : 31696 (ttsth-5-4) R 31690 31692 31098 0 -1 4202560 803 0 0 0 421 13 0 0 25 0 5 0 517957684 343011328 21882 33554432000 4194304 4338100 140734855487488 18446744073709551615 274485793461 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=31692/tid=31697] ppid=31690 vsize=334972 CPUtime=4.34 cores=1,3,5,7
/proc/31692/task/31697/stat : 31697 (ttsth-5-4) R 31690 31692 31098 0 -1 4202560 837 0 0 0 422 12 0 0 25 0 5 0 517957684 343011328 21882 33554432000 4194304 4338100 140734855487488 18446744073709551615 274485793461 0 0 4096 0 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 19.29
Current children cumulated vsize (KiB) 334972

[startup+12.7006 s]
/proc/loadavg: 7.58 7.89 7.50 9/186 31697
/proc/meminfo: memFree=14822896/32950928 swapFree=67111528/67111528
[pid=31692] ppid=31690 vsize=348012 CPUtime=44.85 cores=1,3,5,7
/proc/31692/stat : 31692 (ttsth-5-4) S 31690 31692 31098 0 -1 4202496 37573 0 0 0 4338 147 0 0 25 0 5 0 517957490 356364288 24748 33554432000 4194304 4338100 140734855487488 18446744073709551615 274485770213 0 0 4096 0 18446744073709551615 0 0 17 3 0 0 0
/proc/31692/statm: 87003 24748 176 36 0 84908 0
[pid=31692/tid=31694] ppid=31690 vsize=348012 CPUtime=10.74 cores=1,3,5,7
/proc/31692/task/31694/stat : 31694 (ttsth-5-4) R 31690 31692 31098 0 -1 4202560 2376 0 0 0 1039 35 0 0 25 0 5 0 517957684 356364288 24748 33554432000 4194304 4338100 140734855487488 18446744073709551615 4286315 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=31692/tid=31695] ppid=31690 vsize=348012 CPUtime=10.69 cores=1,3,5,7
/proc/31692/task/31695/stat : 31695 (ttsth-5-4) R 31690 31692 31098 0 -1 4202560 1593 0 0 0 1033 36 0 0 25 0 5 0 517957684 356364288 24748 33554432000 4194304 4338100 140734855487488 18446744073709551615 4258020 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=31692/tid=31696] ppid=31690 vsize=348012 CPUtime=10.74 cores=1,3,5,7
/proc/31692/task/31696/stat : 31696 (ttsth-5-4) R 31690 31692 31098 0 -1 4202560 1572 0 0 0 1038 36 0 0 25 0 5 0 517957684 356364288 24748 33554432000 4194304 4338100 140734855487488 18446744073709551615 274485793461 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=31692/tid=31697] ppid=31690 vsize=348012 CPUtime=10.74 cores=1,3,5,7
/proc/31692/task/31697/stat : 31697 (ttsth-5-4) R 31690 31692 31098 0 -1 4202560 1402 0 0 0 1038 36 0 0 23 0 5 0 517957684 356364288 24748 33554432000 4194304 4338100 140734855487488 18446744073709551615 274485793461 0 0 4096 0 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 44.85
Current children cumulated vsize (KiB) 348012

[startup+25.5003 s]
/proc/loadavg: 7.74 7.91 7.52 9/186 31697
/proc/meminfo: memFree=14707716/32950928 swapFree=67111528/67111528
[pid=31692] ppid=31690 vsize=364576 CPUtime=95.95 cores=1,3,5,7
/proc/31692/stat : 31692 (ttsth-5-4) S 31690 31692 31098 0 -1 4202496 42499 0 0 0 9272 323 0 0 25 0 5 0 517957490 373325824 29674 33554432000 4194304 4338100 140734855487488 18446744073709551615 274485770213 0 0 4096 0 18446744073709551615 0 0 17 3 0 0 0
/proc/31692/statm: 91144 29674 176 36 0 89049 0
[pid=31692/tid=31694] ppid=31690 vsize=364576 CPUtime=23.53 cores=1,3,5,7
/proc/31692/task/31694/stat : 31694 (ttsth-5-4) R 31690 31692 31098 0 -1 4202560 3975 0 0 0 2274 79 0 0 25 0 5 0 517957684 373325824 29674 33554432000 4194304 4338100 140734855487488 18446744073709551615 274485793461 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=31692/tid=31695] ppid=31690 vsize=364576 CPUtime=23.41 cores=1,3,5,7
/proc/31692/task/31695/stat : 31695 (ttsth-5-4) R 31690 31692 31098 0 -1 4202560 2565 0 0 0 2263 78 0 0 25 0 5 0 517957684 373325824 29674 33554432000 4194304 4338100 140734855487488 18446744073709551615 4255963 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=31692/tid=31696] ppid=31690 vsize=364576 CPUtime=23.53 cores=1,3,5,7
/proc/31692/task/31696/stat : 31696 (ttsth-5-4) R 31690 31692 31098 0 -1 4202560 2851 0 0 0 2272 81 0 0 25 0 5 0 517957684 373325824 29674 33554432000 4194304 4338100 140734855487488 18446744073709551615 274485793461 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=31692/tid=31697] ppid=31690 vsize=364576 CPUtime=23.54 cores=1,3,5,7
/proc/31692/task/31697/stat : 31697 (ttsth-5-4) R 31690 31692 31098 0 -1 4202560 2478 0 0 0 2274 80 0 0 25 0 5 0 517957684 373325824 29674 33554432000 4194304 4338100 140734855487488 18446744073709551615 274485793461 0 0 4096 0 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 95.95
Current children cumulated vsize (KiB) 364576

[startup+51.1008 s]
/proc/loadavg: 7.83 7.92 7.53 9/186 31698
/proc/meminfo: memFree=14515704/32950928 swapFree=67111528/67111528
[pid=31692] ppid=31690 vsize=406824 CPUtime=198.2 cores=1,3,5,7
/proc/31692/stat : 31692 (ttsth-5-4) S 31690 31692 31098 0 -1 4202496 53603 0 0 0 19173 647 0 0 25 0 5 0 517957490 416587776 40778 33554432000 4194304 4338100 140734855487488 18446744073709551615 274485770213 0 0 4096 0 18446744073709551615 0 0 17 3 0 0 0
/proc/31692/statm: 101706 40778 176 36 0 99611 0
[pid=31692/tid=31694] ppid=31690 vsize=406824 CPUtime=49.13 cores=1,3,5,7
/proc/31692/task/31694/stat : 31694 (ttsth-5-4) R 31690 31692 31098 0 -1 4202560 7531 0 0 0 4754 159 0 0 25 0 5 0 517957684 416587776 40778 33554432000 4194304 4338100 140734855487488 18446744073709551615 4255963 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=31692/tid=31695] ppid=31690 vsize=406824 CPUtime=48.87 cores=1,3,5,7
/proc/31692/task/31695/stat : 31695 (ttsth-5-4) R 31690 31692 31098 0 -1 4202560 4925 0 0 0 4729 158 0 0 25 0 5 0 517957684 416587776 40778 33554432000 4194304 4338100 140734855487488 18446744073709551615 4240537 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=31692/tid=31696] ppid=31690 vsize=406824 CPUtime=49.12 cores=1,3,5,7
/proc/31692/task/31696/stat : 31696 (ttsth-5-4) R 31690 31692 31098 0 -1 4202560 5560 0 0 0 4747 165 0 0 25 0 5 0 517957684 416587776 40778 33554432000 4194304 4338100 140734855487488 18446744073709551615 274485793461 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=31692/tid=31697] ppid=31690 vsize=406824 CPUtime=49.13 cores=1,3,5,7
/proc/31692/task/31697/stat : 31697 (ttsth-5-4) R 31690 31692 31098 0 -1 4202560 4957 0 0 0 4755 158 0 0 25 0 5 0 517957684 416587776 40778 33554432000 4194304 4338100 140734855487488 18446744073709551615 274485793461 0 0 4096 0 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 198.2
Current children cumulated vsize (KiB) 406824

[startup+102.307 s]
/proc/loadavg: 8.02 7.96 7.56 9/186 31699
/proc/meminfo: memFree=14201612/32950928 swapFree=67111528/67111528
[pid=31692] ppid=31690 vsize=454932 CPUtime=402.69 cores=1,3,5,7
/proc/31692/stat : 31692 (ttsth-5-4) S 31690 31692 31098 0 -1 4202496 66438 0 0 0 39146 1123 0 0 25 0 5 0 517957490 465850368 53613 33554432000 4194304 4338100 140734855487488 18446744073709551615 274485770213 0 0 4096 0 18446744073709551615 0 0 17 3 0 0 0
/proc/31692/statm: 113733 53613 176 36 0 111638 0
[pid=31692/tid=31694] ppid=31690 vsize=454932 CPUtime=100.32 cores=1,3,5,7
/proc/31692/task/31694/stat : 31694 (ttsth-5-4) R 31690 31692 31098 0 -1 4202560 11426 0 0 0 9754 278 0 0 25 0 5 0 517957684 465850368 53613 33554432000 4194304 4338100 140734855487488 18446744073709551615 274485793461 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=31692/tid=31695] ppid=31690 vsize=454932 CPUtime=99.78 cores=1,3,5,7
/proc/31692/task/31695/stat : 31695 (ttsth-5-4) R 31690 31692 31098 0 -1 4202560 7705 0 0 0 9704 274 0 0 25 0 5 0 517957684 465850368 53613 33554432000 4194304 4338100 140734855487488 18446744073709551615 4254289 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=31692/tid=31696] ppid=31690 vsize=454932 CPUtime=100.3 cores=1,3,5,7
/proc/31692/task/31696/stat : 31696 (ttsth-5-4) R 31690 31692 31098 0 -1 4202560 8646 0 0 0 9746 284 0 0 25 0 5 0 517957684 465850368 53613 33554432000 4194304 4338100 140734855487488 18446744073709551615 274485793461 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=31692/tid=31697] ppid=31690 vsize=454932 CPUtime=100.33 cores=1,3,5,7
/proc/31692/task/31697/stat : 31697 (ttsth-5-4) R 31690 31692 31098 0 -1 4202560 8031 0 0 0 9752 281 0 0 25 0 5 0 517957684 465850368 53613 33554432000 4194304 4338100 140734855487488 18446744073709551615 274485793461 0 0 4096 0 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 402.69
Current children cumulated vsize (KiB) 454932

[startup+162.3 s]
/proc/loadavg: 8.05 7.98 7.59 9/186 31701
/proc/meminfo: memFree=13888252/32950928 swapFree=67111528/67111528
[pid=31692] ppid=31690 vsize=491004 CPUtime=642.27 cores=1,3,5,7
/proc/31692/stat : 31692 (ttsth-5-4) S 31690 31692 31098 0 -1 4202496 76789 0 0 0 62626 1601 0 0 25 0 5 0 517957490 502788096 63964 33554432000 4194304 4338100 140734855487488 18446744073709551615 274485770213 0 0 4096 0 18446744073709551615 0 0 17 3 0 0 0
/proc/31692/statm: 122751 63964 176 36 0 120656 0
[pid=31692/tid=31694] ppid=31690 vsize=491004 CPUtime=160.31 cores=1,3,5,7
/proc/31692/task/31694/stat : 31694 (ttsth-5-4) R 31690 31692 31098 0 -1 4202560 14431 0 0 0 15632 399 0 0 25 0 5 0 517957684 502788096 63964 33554432000 4194304 4338100 140734855487488 18446744073709551615 4263499 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=31692/tid=31695] ppid=31690 vsize=491004 CPUtime=159.43 cores=1,3,5,7
/proc/31692/task/31695/stat : 31695 (ttsth-5-4) R 31690 31692 31098 0 -1 4202560 9784 0 0 0 15554 389 0 0 25 0 5 0 517957684 502788096 63964 33554432000 4194304 4338100 140734855487488 18446744073709551615 4279434 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=31692/tid=31696] ppid=31690 vsize=491004 CPUtime=160.28 cores=1,3,5,7
/proc/31692/task/31696/stat : 31696 (ttsth-5-4) R 31690 31692 31098 0 -1 4202560 11594 0 0 0 15623 405 0 0 25 0 5 0 517957684 502788096 63965 33554432000 4194304 4338100 140734855487488 18446744073709551615 274485793461 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=31692/tid=31697] ppid=31690 vsize=491004 CPUtime=160.3 cores=1,3,5,7
/proc/31692/task/31697/stat : 31697 (ttsth-5-4) R 31690 31692 31098 0 -1 4202560 10350 0 0 0 15629 401 0 0 25 0 5 0 517957684 502788096 63965 33554432000 4194304 4338100 140734855487488 18446744073709551615 274485793461 0 0 4096 0 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 642.27
Current children cumulated vsize (KiB) 491004

[startup+222.301 s]
/proc/loadavg: 8.12 8.01 7.62 9/186 31703
/proc/meminfo: memFree=13605508/32950928 swapFree=67111528/67111528
[pid=31692] ppid=31690 vsize=523472 CPUtime=881.88 cores=1,3,5,7
/proc/31692/stat : 31692 (ttsth-5-4) S 31690 31692 31098 0 -1 4202496 85944 0 0 0 86169 2019 0 0 25 0 5 0 517957490 536035328 73119 33554432000 4194304 4338100 140734855487488 18446744073709551615 274485770213 0 0 4096 0 18446744073709551615 0 0 17 3 0 0 0
/proc/31692/statm: 130868 73119 176 36 0 128773 0
[pid=31692/tid=31694] ppid=31690 vsize=523472 CPUtime=220.27 cores=1,3,5,7
/proc/31692/task/31694/stat : 31694 (ttsth-5-4) R 31690 31692 31098 0 -1 4202560 17126 0 0 0 21523 504 0 0 25 0 5 0 517957684 536035328 73119 33554432000 4194304 4338100 140734855487488 18446744073709551615 4254388 0 0 4096 0 0 0 0 -1 7 0 0 0

################
# More data... #
################

/proc/loadavg: 8.22 8.15 7.91 9/186 31737
/proc/meminfo: memFree=11069804/32950928 swapFree=67111528/67111528
[pid=31692] ppid=31690 vsize=933664 CPUtime=4236.68 cores=1,3,5,7
/proc/31692/stat : 31692 (ttsth-5-4) S 31690 31692 31098 0 -1 4202496 196360 0 0 0 417120 6548 0 0 25 0 5 0 517957490 956071936 183535 33554432000 4194304 4338100 140734855487488 18446744073709551615 274485770213 0 0 4096 0 18446744073709551615 0 0 17 3 0 0 0
/proc/31692/statm: 233416 183535 176 36 0 231321 0
[pid=31692/tid=31694] ppid=31690 vsize=933664 CPUtime=1058.09 cores=1,3,5,7
/proc/31692/task/31694/stat : 31694 (ttsth-5-4) R 31690 31692 31098 0 -1 4202560 44353 0 0 0 104186 1623 0 0 25 0 5 0 517957684 956071936 183535 33554432000 4194304 4338100 140734855487488 18446744073709551615 4254384 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=31692/tid=31695] ppid=31690 vsize=933664 CPUtime=1058.38 cores=1,3,5,7
/proc/31692/task/31695/stat : 31695 (ttsth-5-4) R 31690 31692 31098 0 -1 4202560 37836 0 0 0 104204 1634 0 0 25 0 5 0 517957684 956071936 183535 33554432000 4194304 4338100 140734855487488 18446744073709551615 274485793461 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=31692/tid=31696] ppid=31690 vsize=933664 CPUtime=1059.09 cores=1,3,5,7
/proc/31692/task/31696/stat : 31696 (ttsth-5-4) R 31690 31692 31098 0 -1 4202560 43233 0 0 0 104270 1639 0 0 22 0 5 0 517957684 956071936 183535 33554432000 4194304 4338100 140734855487488 18446744073709551615 274485793461 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=31692/tid=31697] ppid=31690 vsize=933664 CPUtime=1059.18 cores=1,3,5,7
/proc/31692/task/31697/stat : 31697 (ttsth-5-4) R 31690 31692 31098 0 -1 4202560 40308 0 0 0 104271 1647 0 0 25 0 5 0 517957684 956071936 183535 33554432000 4194304 4338100 140734855487488 18446744073709551615 4254289 0 0 4096 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4236.68
Current children cumulated vsize (KiB) 933664

[startup+1122.3 s]
/proc/loadavg: 8.29 8.18 7.93 9/186 31739
/proc/meminfo: memFree=11025144/32950928 swapFree=67111528/67111528
[pid=31692] ppid=31690 vsize=955956 CPUtime=4476.33 cores=1,3,5,7
/proc/31692/stat : 31692 (ttsth-5-4) S 31690 31692 31098 0 -1 4202496 200870 0 0 0 440884 6749 0 0 25 0 5 0 517957490 978898944 188045 33554432000 4194304 4338100 140734855487488 18446744073709551615 274485770213 0 0 4096 0 18446744073709551615 0 0 17 3 0 0 0
/proc/31692/statm: 238989 188045 176 36 0 236894 0
[pid=31692/tid=31694] ppid=31690 vsize=955956 CPUtime=1117.75 cores=1,3,5,7
/proc/31692/task/31694/stat : 31694 (ttsth-5-4) R 31690 31692 31098 0 -1 4202560 45599 0 0 0 110105 1670 0 0 25 0 5 0 517957684 978898944 188045 33554432000 4194304 4338100 140734855487488 18446744073709551615 4254388 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=31692/tid=31695] ppid=31690 vsize=955956 CPUtime=1118.36 cores=1,3,5,7
/proc/31692/task/31695/stat : 31695 (ttsth-5-4) R 31690 31692 31098 0 -1 4202560 38964 0 0 0 110150 1686 0 0 25 0 5 0 517957684 978898944 188045 33554432000 4194304 4338100 140734855487488 18446744073709551615 4254388 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=31692/tid=31696] ppid=31690 vsize=955956 CPUtime=1119.09 cores=1,3,5,7
/proc/31692/task/31696/stat : 31696 (ttsth-5-4) R 31690 31692 31098 0 -1 4202560 44204 0 0 0 110221 1688 0 0 20 0 5 0 517957684 978898944 188045 33554432000 4194304 4338100 140734855487488 18446744073709551615 4254388 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=31692/tid=31697] ppid=31690 vsize=955956 CPUtime=1119.18 cores=1,3,5,7
/proc/31692/task/31697/stat : 31697 (ttsth-5-4) R 31690 31692 31098 0 -1 4202560 41473 0 0 0 110219 1699 0 0 25 0 5 0 517957684 978898944 188045 33554432000 4194304 4338100 140734855487488 18446744073709551615 4254388 0 0 4096 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4476.33
Current children cumulated vsize (KiB) 955956

[startup+1182.3 s]
/proc/loadavg: 8.14 8.16 7.94 9/186 31740
/proc/meminfo: memFree=10963264/32950928 swapFree=67111528/67111528
[pid=31692] ppid=31690 vsize=1000540 CPUtime=4715.97 cores=1,3,5,7
/proc/31692/stat : 31692 (ttsth-5-4) S 31690 31692 31098 0 -1 4202496 213603 0 0 0 464554 7043 0 0 25 0 5 0 517957490 1024552960 200778 33554432000 4194304 4338100 140734855487488 18446744073709551615 274485770213 0 0 4096 0 18446744073709551615 0 0 17 3 0 0 0
/proc/31692/statm: 250135 200778 176 36 0 248040 0
[pid=31692/tid=31694] ppid=31690 vsize=1000540 CPUtime=1177.43 cores=1,3,5,7
/proc/31692/task/31694/stat : 31694 (ttsth-5-4) R 31690 31692 31098 0 -1 4202560 48975 0 0 0 115998 1745 0 0 25 0 5 0 517957684 1024552960 200778 33554432000 4194304 4338100 140734855487488 18446744073709551615 4254439 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=31692/tid=31695] ppid=31690 vsize=1000540 CPUtime=1178.35 cores=1,3,5,7
/proc/31692/task/31695/stat : 31695 (ttsth-5-4) R 31690 31692 31098 0 -1 4202560 41537 0 0 0 116074 1761 0 0 25 0 5 0 517957684 1024552960 200778 33554432000 4194304 4338100 140734855487488 18446744073709551615 4254289 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=31692/tid=31696] ppid=31690 vsize=1000540 CPUtime=1179.08 cores=1,3,5,7
/proc/31692/task/31696/stat : 31696 (ttsth-5-4) R 31690 31692 31098 0 -1 4202560 47865 0 0 0 116147 1761 0 0 25 0 5 0 517957684 1024552960 200778 33554432000 4194304 4338100 140734855487488 18446744073709551615 274485793461 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=31692/tid=31697] ppid=31690 vsize=1000540 CPUtime=1179.17 cores=1,3,5,7
/proc/31692/task/31697/stat : 31697 (ttsth-5-4) R 31690 31692 31098 0 -1 4202560 44596 0 0 0 116147 1770 0 0 25 0 5 0 517957684 1024552960 200778 33554432000 4194304 4338100 140734855487488 18446744073709551615 274485793461 0 0 4096 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4715.97
Current children cumulated vsize (KiB) 1000540

Solver just ended. Dumping a history of the last processes samples

[startup+1190.3 s]
/proc/loadavg: 8.27 8.19 7.95 9/186 31740
/proc/meminfo: memFree=10948872/32950928 swapFree=67111528/67111528
[pid=31692] ppid=31690 vsize=1014548 CPUtime=4747.92 cores=1,3,5,7
/proc/31692/stat : 31692 (ttsth-5-4) S 31690 31692 31098 0 -1 4202496 216617 0 0 0 467694 7098 0 0 25 0 5 0 517957490 1038897152 203792 33554432000 4194304 4338100 140734855487488 18446744073709551615 274485770213 0 0 4096 0 18446744073709551615 0 0 17 3 0 0 0
/proc/31692/statm: 253637 203792 176 36 0 251542 0
[pid=31692/tid=31694] ppid=31690 vsize=1014548 CPUtime=1185.38 cores=1,3,5,7
/proc/31692/task/31694/stat : 31694 (ttsth-5-4) R 31690 31692 31098 0 -1 4202560 49707 0 0 0 116778 1760 0 0 25 0 5 0 517957684 1038897152 203792 33554432000 4194304 4338100 140734855487488 18446744073709551615 4254388 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=31692/tid=31695] ppid=31690 vsize=1014548 CPUtime=1186.35 cores=1,3,5,7
/proc/31692/task/31695/stat : 31695 (ttsth-5-4) R 31690 31692 31098 0 -1 4202560 42148 0 0 0 116860 1775 0 0 18 0 5 0 517957684 1038897152 203792 33554432000 4194304 4338100 140734855487488 18446744073709551615 4254388 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=31692/tid=31696] ppid=31690 vsize=1014548 CPUtime=1187.08 cores=1,3,5,7
/proc/31692/task/31696/stat : 31696 (ttsth-5-4) R 31690 31692 31098 0 -1 4202560 48658 0 0 0 116934 1774 0 0 25 0 5 0 517957684 1038897152 203792 33554432000 4194304 4338100 140734855487488 18446744073709551615 4254388 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=31692/tid=31697] ppid=31690 vsize=1014548 CPUtime=1187.17 cores=1,3,5,7
/proc/31692/task/31697/stat : 31697 (ttsth-5-4) R 31690 31692 31098 0 -1 4202560 45474 0 0 0 116933 1784 0 0 25 0 5 0 517957684 1038897152 203792 33554432000 4194304 4338100 140734855487488 18446744073709551615 4254388 0 0 4096 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4747.92
Current children cumulated vsize (KiB) 1014548

[startup+1196.7 s]
/proc/loadavg: 8.25 8.18 7.95 9/186 31741
/proc/meminfo: memFree=10941804/32950928 swapFree=67111528/67111528
[pid=31692] ppid=31690 vsize=1020804 CPUtime=4773.5 cores=1,3,5,7
/proc/31692/stat : 31692 (ttsth-5-4) S 31690 31692 31098 0 -1 4202496 218190 0 0 0 470216 7134 0 0 25 0 5 0 517957490 1045303296 205365 33554432000 4194304 4338100 140734855487488 18446744073709551615 274485770213 0 0 4096 0 18446744073709551615 0 0 17 3 0 0 0
/proc/31692/statm: 255201 205365 176 36 0 253106 0
[pid=31692/tid=31694] ppid=31690 vsize=1020804 CPUtime=1191.74 cores=1,3,5,7
/proc/31692/task/31694/stat : 31694 (ttsth-5-4) R 31690 31692 31098 0 -1 4202560 50267 0 0 0 117406 1768 0 0 25 0 5 0 517957684 1045303296 205365 33554432000 4194304 4338100 140734855487488 18446744073709551615 4254275 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=31692/tid=31695] ppid=31690 vsize=1020804 CPUtime=1192.76 cores=1,3,5,7
/proc/31692/task/31695/stat : 31695 (ttsth-5-4) R 31690 31692 31098 0 -1 4202560 42578 0 0 0 117491 1785 0 0 25 0 5 0 517957684 1045303296 205365 33554432000 4194304 4338100 140734855487488 18446744073709551615 274485793461 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=31692/tid=31696] ppid=31690 vsize=1020804 CPUtime=1193.48 cores=1,3,5,7
/proc/31692/task/31696/stat : 31696 (ttsth-5-4) R 31690 31692 31098 0 -1 4202560 49218 0 0 0 117566 1782 0 0 25 0 5 0 517957684 1045303296 205365 33554432000 4194304 4338100 140734855487488 18446744073709551615 274485793461 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=31692/tid=31697] ppid=31690 vsize=1020804 CPUtime=1193.57 cores=1,3,5,7
/proc/31692/task/31697/stat : 31697 (ttsth-5-4) R 31690 31692 31098 0 -1 4202560 45497 0 0 0 117564 1793 0 0 25 0 5 0 517957684 1045303296 205365 33554432000 4194304 4338100 140734855487488 18446744073709551615 4254208 0 0 4096 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4773.5
Current children cumulated vsize (KiB) 1020804

[startup+1199.9 s]
/proc/loadavg: 8.23 8.18 7.95 9/186 31741
/proc/meminfo: memFree=10939944/32950928 swapFree=67111528/67111528
[pid=31692] ppid=31690 vsize=1020804 CPUtime=4786.27 cores=1,3,5,7
/proc/31692/stat : 31692 (ttsth-5-4) S 31690 31692 31098 0 -1 4202496 218671 0 0 0 471475 7152 0 0 25 0 5 0 517957490 1045303296 205846 33554432000 4194304 4338100 140734855487488 18446744073709551615 274485770213 0 0 4096 0 18446744073709551615 0 0 17 3 0 0 0
/proc/31692/statm: 255201 205846 176 36 0 253106 0
[pid=31692/tid=31694] ppid=31690 vsize=1020804 CPUtime=1194.93 cores=1,3,5,7
/proc/31692/task/31694/stat : 31694 (ttsth-5-4) R 31690 31692 31098 0 -1 4202560 50422 0 0 0 117720 1773 0 0 25 0 5 0 517957684 1045303296 205846 33554432000 4194304 4338100 140734855487488 18446744073709551615 274473362913 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=31692/tid=31695] ppid=31690 vsize=1020804 CPUtime=1195.95 cores=1,3,5,7
/proc/31692/task/31695/stat : 31695 (ttsth-5-4) R 31690 31692 31098 0 -1 4202560 42697 0 0 0 117806 1789 0 0 25 0 5 0 517957684 1045303296 205846 33554432000 4194304 4338100 140734855487488 18446744073709551615 274485793461 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=31692/tid=31696] ppid=31690 vsize=1020804 CPUtime=1196.68 cores=1,3,5,7
/proc/31692/task/31696/stat : 31696 (ttsth-5-4) R 31690 31692 31098 0 -1 4202560 49402 0 0 0 117881 1787 0 0 24 0 5 0 517957684 1045303296 205846 33554432000 4194304 4338100 140734855487488 18446744073709551615 274485793461 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=31692/tid=31697] ppid=31690 vsize=1020804 CPUtime=1196.76 cores=1,3,5,7
/proc/31692/task/31697/stat : 31697 (ttsth-5-4) R 31690 31692 31098 0 -1 4202560 45520 0 0 0 117878 1798 0 0 25 0 5 0 517957684 1045303296 205846 33554432000 4194304 4338100 140734855487488 18446744073709551615 274485793461 0 0 4096 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4786.27
Current children cumulated vsize (KiB) 1020804

[startup+1201.5 s]
/proc/loadavg: 8.23 8.18 7.95 9/186 31741
/proc/meminfo: memFree=10938208/32950928 swapFree=67111528/67111528
[pid=31692] ppid=31690 vsize=1020804 CPUtime=4792.65 cores=1,3,5,7
/proc/31692/stat : 31692 (ttsth-5-4) S 31690 31692 31098 0 -1 4202496 218926 0 0 0 472103 7162 0 0 25 0 5 0 517957490 1045303296 206101 33554432000 4194304 4338100 140734855487488 18446744073709551615 274485770213 0 0 4096 0 18446744073709551615 0 0 17 3 0 0 0
/proc/31692/statm: 255201 206101 176 36 0 253106 0
[pid=31692/tid=31694] ppid=31690 vsize=1020804 CPUtime=1196.51 cores=1,3,5,7
/proc/31692/task/31694/stat : 31694 (ttsth-5-4) R 31690 31692 31098 0 -1 4202560 50490 0 0 0 117876 1775 0 0 25 0 5 0 517957684 1045303296 206101 33554432000 4194304 4338100 140734855487488 18446744073709551615 4254418 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=31692/tid=31695] ppid=31690 vsize=1020804 CPUtime=1197.55 cores=1,3,5,7
/proc/31692/task/31695/stat : 31695 (ttsth-5-4) R 31690 31692 31098 0 -1 4202560 42758 0 0 0 117964 1791 0 0 25 0 5 0 517957684 1045303296 206101 33554432000 4194304 4338100 140734855487488 18446744073709551615 274485793461 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=31692/tid=31696] ppid=31690 vsize=1020804 CPUtime=1198.28 cores=1,3,5,7
/proc/31692/task/31696/stat : 31696 (ttsth-5-4) R 31690 31692 31098 0 -1 4202560 49463 0 0 0 118038 1790 0 0 25 0 5 0 517957684 1045303296 206101 33554432000 4194304 4338100 140734855487488 18446744073709551615 274485793461 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=31692/tid=31697] ppid=31690 vsize=1020804 CPUtime=1198.37 cores=1,3,5,7
/proc/31692/task/31697/stat : 31697 (ttsth-5-4) R 31690 31692 31098 0 -1 4202560 45585 0 0 0 118036 1801 0 0 25 0 5 0 517957684 1045303296 206101 33554432000 4194304 4338100 140734855487488 18446744073709551615 274485793461 0 0 4096 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4792.65
Current children cumulated vsize (KiB) 1020804

[startup+1202.31 s]
/proc/loadavg: 8.23 8.18 7.95 9/186 31741
/proc/meminfo: memFree=10937340/32950928 swapFree=67111528/67111528
[pid=31692] ppid=31690 vsize=1023932 CPUtime=4795.87 cores=1,3,5,7
/proc/31692/stat : 31692 (ttsth-5-4) S 31690 31692 31098 0 -1 4202496 219065 0 0 0 472419 7168 0 0 25 0 5 0 517957490 1048506368 206240 33554432000 4194304 4338100 140734855487488 18446744073709551615 274485770213 0 0 4096 0 18446744073709551615 0 0 17 3 0 0 0
/proc/31692/statm: 255983 206240 176 36 0 253888 0
[pid=31692/tid=31694] ppid=31690 vsize=1023932 CPUtime=1197.32 cores=1,3,5,7
/proc/31692/task/31694/stat : 31694 (ttsth-5-4) R 31690 31692 31098 0 -1 4202560 50520 0 0 0 117955 1777 0 0 25 0 5 0 517957684 1048506368 206240 33554432000 4194304 4338100 140734855487488 18446744073709551615 4258020 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=31692/tid=31695] ppid=31690 vsize=1023932 CPUtime=1198.35 cores=1,3,5,7
/proc/31692/task/31695/stat : 31695 (ttsth-5-4) R 31690 31692 31098 0 -1 4202560 42790 0 0 0 118043 1792 0 0 25 0 5 0 517957684 1048506368 206240 33554432000 4194304 4338100 140734855487488 18446744073709551615 4257956 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=31692/tid=31696] ppid=31690 vsize=1023932 CPUtime=1199.08 cores=1,3,5,7
/proc/31692/task/31696/stat : 31696 (ttsth-5-4) R 31690 31692 31098 0 -1 4202560 49500 0 0 0 118117 1791 0 0 25 0 5 0 517957684 1048506368 206240 33554432000 4194304 4338100 140734855487488 18446744073709551615 274473362484 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=31692/tid=31697] ppid=31690 vsize=1023932 CPUtime=1199.17 cores=1,3,5,7
/proc/31692/task/31697/stat : 31697 (ttsth-5-4) R 31690 31692 31098 0 -1 4202560 45625 0 0 0 118115 1802 0 0 25 0 5 0 517957684 1048506368 206240 33554432000 4194304 4338100 140734855487488 18446744073709551615 274473362466 0 0 4096 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4795.87
Current children cumulated vsize (KiB) 1023932

[startup+1203.1 s]
/proc/loadavg: 8.23 8.18 7.95 9/186 31741
/proc/meminfo: memFree=10937340/32950928 swapFree=67111528/67111528
[pid=31692] ppid=31690 vsize=1023932 CPUtime=4799.05 cores=1,3,5,7
/proc/31692/stat : 31692 (ttsth-5-4) S 31690 31692 31098 0 -1 4202496 219215 0 0 0 472735 7170 0 0 25 0 5 0 517957490 1048506368 206390 33554432000 4194304 4338100 140734855487488 18446744073709551615 274485770213 0 0 4096 0 18446744073709551615 0 0 17 3 0 0 0
/proc/31692/statm: 255983 206390 176 36 0 253888 0
[pid=31692/tid=31694] ppid=31690 vsize=1023932 CPUtime=1198.11 cores=1,3,5,7
/proc/31692/task/31694/stat : 31694 (ttsth-5-4) R 31690 31692 31098 0 -1 4202560 50569 0 0 0 118034 1777 0 0 25 0 5 0 517957684 1048506368 206390 33554432000 4194304 4338100 140734855487488 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=31692/tid=31695] ppid=31690 vsize=1023932 CPUtime=1199.15 cores=1,3,5,7
/proc/31692/task/31695/stat : 31695 (ttsth-5-4) R 31690 31692 31098 0 -1 4202560 42819 0 0 0 118122 1793 0 0 25 0 5 0 517957684 1048506368 206390 33554432000 4194304 4338100 140734855487488 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=31692/tid=31696] ppid=31690 vsize=1023932 CPUtime=1199.88 cores=1,3,5,7
/proc/31692/task/31696/stat : 31696 (ttsth-5-4) R 31690 31692 31098 0 -1 4202560 49537 0 0 0 118197 1791 0 0 25 0 5 0 517957684 1048506368 206390 33554432000 4194304 4338100 140734855487488 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=31692/tid=31697] ppid=31690 vsize=1023932 CPUtime=1199.97 cores=1,3,5,7
/proc/31692/task/31697/stat : 31697 (ttsth-5-4) R 31690 31692 31098 0 -1 4202560 45660 0 0 0 118194 1803 0 0 25 0 5 0 517957684 1048506368 206390 33554432000 4194304 4338100 140734855487488 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4799.05
Current children cumulated vsize (KiB) 1023932

[startup+1203.3 s]
/proc/loadavg: 8.21 8.18 7.95 9/186 31741
/proc/meminfo: memFree=10936596/32950928 swapFree=67111528/67111528
[pid=31692] ppid=31690 vsize=1023932 CPUtime=4799.87 cores=1,3,5,7
/proc/31692/stat : 31692 (ttsth-5-4) S 31690 31692 31098 0 -1 4202496 219238 0 0 0 472816 7171 0 0 25 0 5 0 517957490 1048506368 206413 33554432000 4194304 4338100 140734855487488 18446744073709551615 274485770213 0 0 4096 0 18446744073709551615 0 0 17 3 0 0 0
/proc/31692/statm: 255983 206413 176 36 0 253888 0
[pid=31692/tid=31694] ppid=31690 vsize=1023932 CPUtime=1198.31 cores=1,3,5,7
/proc/31692/task/31694/stat : 31694 (ttsth-5-4) R 31690 31692 31098 0 -1 4202560 50574 0 0 0 118053 1778 0 0 25 0 5 0 517957684 1048506368 206413 33554432000 4194304 4338100 140734855487488 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=31692/tid=31695] ppid=31690 vsize=1023932 CPUtime=1199.35 cores=1,3,5,7
/proc/31692/task/31695/stat : 31695 (ttsth-5-4) R 31690 31692 31098 0 -1 4202560 42825 0 0 0 118142 1793 0 0 25 0 5 0 517957684 1048506368 206413 33554432000 4194304 4338100 140734855487488 18446744073709551615 274485793461 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=31692/tid=31696] ppid=31690 vsize=1023932 CPUtime=1200.09 cores=1,3,5,7
/proc/31692/task/31696/stat : 31696 (ttsth-5-4) R 31690 31692 31098 0 -1 4202560 49544 0 0 0 118217 1792 0 0 25 0 5 0 517957684 1048506368 206413 33554432000 4194304 4338100 140734855487488 18446744073709551615 274485793461 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=31692/tid=31697] ppid=31690 vsize=1023932 CPUtime=1200.17 cores=1,3,5,7
/proc/31692/task/31697/stat : 31697 (ttsth-5-4) R 31690 31692 31098 0 -1 4202560 45665 0 0 0 118214 1803 0 0 25 0 5 0 517957684 1048506368 206413 33554432000 4194304 4338100 140734855487488 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4799.87
Current children cumulated vsize (KiB) 1023932

Child status: 0
Real time (s): 1203.39
CPU time (s): 4800.1
CPU user time (s): 4728.34
CPU system time (s): 71.7581
CPU usage (%): 398.881
Max. virtual memory (cumulated for all children) (KiB): 1023932

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4728.34
system time used= 71.7581
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 219246
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 400549
involuntary context switches= 26558

runsolver used 2.05169 second user time and 4.52531 second system time

The end

Launcher Data 

Begin job on node125 at 2011-04-29 09:52:58
IDJOB=3249548
IDBENCH=83173
IDSOLVER=1654
FILE ID=node125/3249548-1304063578
RUNJOBID= node125-1304062369-31572
PBS_JOBID= 13170441
Free space on /tmp= 72752 MiB

SOLVER NAME= ttsth 5-4
BENCH NAME= SAT11/crafted/mosoi/289/289-unsat-17x27.cnf
COMMAND LINE= DIR/ttsth-5-4 -num-threads NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3249548-1304063578/watcher-3249548-1304063578 -o /tmp/evaluation-result-3249548-1304063578/solver-3249548-1304063578 -C 4800 -W 1300 -M 15500  HOME/ttsth-5-4 -num-threads 4 HOME/instance-3249548-1304063578.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= b9a7e3013b1b74b08c8e421f15cb16c4
RANDOM SEED=869259047

node125.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5266.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      15018648 kB
Buffers:       2219268 kB
Cached:       15027760 kB
SwapCached:          0 kB
Active:        9220368 kB
Inactive:      8180476 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      15018648 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:           10064 kB
Writeback:           0 kB
AnonPages:      153144 kB
Mapped:          15212 kB
Slab:           469236 kB
PageTables:       4496 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   345112 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72752 MiB
End job on node125 at 2011-04-29 10:13:02