Trace number 3265214

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ttsth 5-4? 4800.07 1207.4

General information on the benchmark

NameSAT05/crafted/sabharwal05/counting/php/unsat/
harder/php-040-039.shuffled-as.sat05-1194.cnf
MD5SUM8c84d9b9f2d75de33656119bc03a9afb
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark45.3841
Satisfiable
(Un)Satisfiability was proved
Number of variables1560
Number of clauses30460
Sum of the clauses size62400
Maximum clause length39
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 230420
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 540

Solver Data 

0.00/0.02	c Command: HOME/ttsth-5-4 -num-threads 4 HOME/instance-3265214-1304101782.cnf 
0.00/0.02	c Using SATTIMEOUT of 4800
0.00/0.02	c Using SATRAM of 15500
0.00/0.02	c Size of subset node = 32
0.00/0.02	c Variables = 1560
0.00/0.02	c Clauses = 30460
0.00/0.02	c Literals = 62400
0.00/0.02	c Reduced size:
0.00/0.02	c Variables = 1560
0.00/0.02	c Clauses = 30460
0.00/0.02	c Literals = 62400
0.00/0.02	c a2
0.00/0.04	c a1
0.89/0.96	c Independent sub-problems = 1
0.89/0.96	c Sub-problem with 1560 variables and 30460 clauses
0.89/0.96	c using permutation method 4
0.89/0.96	c count = 2
0.89/0.96	c Ordering finished 0.950 seconds
0.89/0.96	c mapped 0.960 seconds
0.89/0.96	c permuted 0.960 seconds
0.89/0.96	c about to sort
0.89/0.96	c sorted
1.00/1.01	c clauses now 30460
1.00/1.01	c init finished 0.980 seconds
1.00/1.01	c tree built 1.000 seconds
1.00/1.01	c 
1.00/1.01	c PA progress                      | CPU progress Partial assignments | improvements                 ucps  CPU time       PA/sec  nodes
1.00/1.01	c ---------------------------------|----------------------------------|--------------------------------------------------------------------
1.00/1.01	c ................................ | ..........                    |                                  1.0         0.0             
1.00/1.01	c ................................ | ..........                  1 |                                  1.0         1.0             
1.00/1.01	c ................................ | ..........                  2 |                                  1.0         2.0             
1.00/1.01	c ................................ | ..........                  3 |                                  1.0         3.0             
1.00/1.01	c ................................ | ..........                  4 |                                  1.0         4.0             
1.00/1.01	c ................................ | ..........                  5 |                                  1.0         5.0             
1.00/1.01	c ................................ | ..........               1000 |                                  1.0       990.1             
95.89/24.92	c ................................ | ..........            6714000 | 908366       43336              96.0     69937.5      4383263
191.77/49.06	c ................................ | ..........           11304000 | 1577400      54951             192.0     58871.9      7141660
287.72/73.18	c ................................ | ..........           13882000 | 1987728      55388             288.1     48193.0      8313331
383.93/97.31	c ................................ | ..........           17889000 | 2592002      64031             384.0     46585.9     10471280
479.70/121.48	c ................................ | *.........           21119000 | 3097340      65680             480.0     43996.1     11584793
576.00/145.60	c ................................ | *.........           23997000 | 3556248      67323             576.0     41660.0     12310024
671.90/169.73	c ................................ | *.........           26332000 | 3948333      67522             672.0     39182.2     12985559
767.85/193.87	c ................................ | *.........           28039000 | 4249575      67534             768.1     36502.9     13411044
863.90/217.97	c ................................ | *.........           29085000 | 4434993      67534             864.2     33655.4     13981075
959.68/242.09	c ................................ | **........           32895000 | 4987408      78843             960.0     34264.6     15791200
1055.90/266.23	c ................................ | **........           35440000 | 5386498      79679            1056.0     33559.7     17019491
1151.90/290.33	c ................................ | **........           37035000 | 5642396      80985            1152.0     32148.4     17824956
1247.62/314.49	c ................................ | **........           39861000 | 6101393      81341            1248.0     31939.9     18423203
1343.86/338.66	c ................................ | **........           41873000 | 6440919      81540            1344.1     31153.2     18858053
1439.85/362.74	c ................................ | ***.......           43379000 | 6709617      81552            1440.0     30123.3     19551210
1535.88/386.83	c ................................ | ***.......           44730000 | 6928993      83384            1536.0     29120.9     19737467
1631.64/410.99	c ................................ | ***.......           46876000 | 7272913      83693            1632.0     28722.7     20605219
1727.62/435.09	c ................................ | ***.......           48235000 | 7503886      83871            1728.0     27913.6     21030963
1823.81/459.25	c ................................ | ***.......           50268000 | 7853070      83893            1824.0     27559.1     21450448
1919.83/483.36	c ................................ | ****......           51464000 | 8073544      83893            1920.1     26803.2     21510320
2015.87/507.44	c ................................ | ****......           52864000 | 8304014      84112            2016.0     26221.8     22006347
2111.96/531.52	c ................................ | ****......           53897000 | 8486753      84123            2112.1     25518.8     22583691
2207.84/555.66	c ................................ | ****......           55341000 | 8746779      84123            2208.1     25062.8     22762460
2303.67/579.88	c ................................ | ****......           56293000 | 8916977      84146            2304.0     24432.5     22762460
2399.79/603.95	c ................................ | *****.....           57239000 | 9089283      84146            2400.0     23849.6     22802559
2495.85/628.08	c ................................ | *****.....           58051000 | 9241019      84146            2496.2     23256.2     22802559
2591.93/652.12	c ................................ | *****.....           58708000 | 9367053      84146            2592.0     22649.4     22802559
2688.03/676.23	c ................................ | *****.....           59188000 | 9459464      84146            2688.1     22018.2     22802559
2783.78/700.29	c ................................ | *****.....           59631000 | 9550079      84146            2784.2     21418.0     22809501
2879.81/724.44	c ................................ | ******....           63292000 | 10094048     91928            2880.0     21976.4     23600554
2975.99/748.62	c ................................ | ******....           66174000 | 10538472     93417            2976.1     22235.4     24193797
3071.82/772.75	c ................................ | ******....           68592000 | 10924452     94748            3072.0     22328.0     24614395
3167.86/796.93	c ................................ | ******....           71539000 | 11409275     95066            3168.0     22581.7     25223113
3263.62/821.09	c ................................ | ******....           73799000 | 11804230     95089            3264.0     22610.0     26279798
3359.85/845.24	c ................................ | *******...           75655000 | 12105772     96377            3360.0     22516.2     26563369
3456.04/869.40	c ................................ | *******...           77842000 | 12461301     96564            3456.1     22523.4     27092274
3551.82/893.54	c ................................ | *******...           79944000 | 12813863     96734            3552.0     22506.6     27283756
3648.09/917.70	c ................................ | *******...           81746000 | 13135969     96744            3648.1     22407.9     27876215
3743.95/941.81	c ................................ | *******...           83400000 | 13412064     96914            3744.0     22275.6     28329961
3839.90/965.92	c ................................ | ********..           84942000 | 13681903     96924            3840.0     22120.3     28625472
3935.77/990.06	c ................................ | ********..           86348000 | 13936012     96933            3936.0     21938.0     28700993
4031.73/1014.18	c ................................ | ********..           87574000 | 14159998     96933            4032.1     21719.4     28856127
4127.80/1038.26	c ................................ | ********..           88485000 | 14329984     96933            4128.1     21435.0     29182961
4223.88/1062.37	c ................................ | ********..           89220000 | 14473866     96933            4224.2     21121.2     29748721
4319.63/1086.39	c ................................ | *********.           89641000 | 14559396     96933            4320.0     20750.2     30134054
4415.91/1110.62	c ................................ | *********.           92882000 | 15092749     98435            4416.0     21033.1     30770963
4511.66/1134.78	c ................................ | *********.           95198000 | 15497289     98603            4512.0     21098.8     31084964
4607.79/1159.05	c ................................ | *********.           98396000 | 16072789     98628            4608.0     21353.3     31657309
4703.66/1183.19	c ................................ | *********.          100449000 | 16451907     98793            4704.0     21353.8     32068965
4799.85/1207.35	c CPU limit (4800) reached
4799.85/1207.35	c Time = 4800.01 seconds
4799.85/1207.35	s UNKNOWN

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3265214-1304101782/watcher-3265214-1304101782 -o /tmp/evaluation-result-3265214-1304101782/solver-3265214-1304101782 -C 4800 -W 1300 -M 15500 HOME/ttsth-5-4 -num-threads 4 HOME/instance-3265214-1304101782.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.68 7.92 8.35 5/181 29954
/proc/meminfo: memFree=12654612/32950940 swapFree=67111528/67111528
[pid=29954] ppid=29952 vsize=9756 CPUtime=0 cores=0,2,4,6
/proc/29954/stat : 29954 (ttsth-5-4) R 29952 29954 28861 0 -1 4202496 486 0 0 0 0 0 0 0 25 0 1 0 600408967 9990144 428 33554432000 4194304 4338100 140736315474352 18446744073709551615 215988289639 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/29954/statm: 2439 428 147 36 0 344 0

[startup+0.0657389 s]
/proc/loadavg: 7.68 7.92 8.35 5/181 29954
/proc/meminfo: memFree=12654612/32950940 swapFree=67111528/67111528
[pid=29954] ppid=29952 vsize=16072 CPUtime=0.06 cores=0,2,4,6
/proc/29954/stat : 29954 (ttsth-5-4) R 29952 29954 28861 0 -1 4202496 2221 0 0 0 6 0 0 0 25 0 1 0 600408967 16457728 2043 33554432000 4194304 4338100 140736315474352 18446744073709551615 215988250841 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/29954/statm: 4018 2044 153 36 0 1923 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 16072

[startup+0.10073 s]
/proc/loadavg: 7.68 7.92 8.35 5/181 29954
/proc/meminfo: memFree=12654612/32950940 swapFree=67111528/67111528
[pid=29954] ppid=29952 vsize=16468 CPUtime=0.09 cores=0,2,4,6
/proc/29954/stat : 29954 (ttsth-5-4) R 29952 29954 28861 0 -1 4202496 2307 0 0 0 9 0 0 0 25 0 1 0 600408967 16863232 2129 33554432000 4194304 4338100 140736315474352 18446744073709551615 4245205 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/29954/statm: 4117 2129 154 36 0 2022 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 16468

[startup+0.300695 s]
/proc/loadavg: 7.68 7.92 8.35 5/181 29954
/proc/meminfo: memFree=12654612/32950940 swapFree=67111528/67111528
[pid=29954] ppid=29952 vsize=16628 CPUtime=0.29 cores=0,2,4,6
/proc/29954/stat : 29954 (ttsth-5-4) R 29952 29954 28861 0 -1 4202496 2336 0 0 0 29 0 0 0 25 0 1 0 600408967 17027072 2158 33554432000 4194304 4338100 140736315474352 18446744073709551615 4245192 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/29954/statm: 4157 2158 154 36 0 2062 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 16628

[startup+0.700625 s]
/proc/loadavg: 7.68 7.92 8.35 5/181 29954
/proc/meminfo: memFree=12654612/32950940 swapFree=67111528/67111528
[pid=29954] ppid=29952 vsize=17044 CPUtime=0.69 cores=0,2,4,6
/proc/29954/stat : 29954 (ttsth-5-4) R 29952 29954 28861 0 -1 4202496 2425 0 0 0 69 0 0 0 25 0 1 0 600408967 17453056 2247 33554432000 4194304 4338100 140736315474352 18446744073709551615 4245205 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/29954/statm: 4261 2247 154 36 0 2166 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 17044

[startup+1.50049 s]
/proc/loadavg: 7.68 7.92 8.35 6/182 29955
/proc/meminfo: memFree=12624976/32950940 swapFree=67111528/67111528
[pid=29954] ppid=29952 vsize=282920 CPUtime=2.93 cores=0,2,4,6
/proc/29954/stat : 29954 (ttsth-5-4) S 29952 29954 28861 0 -1 4202496 7952 0 0 0 292 1 0 0 25 0 5 0 600408967 289710080 7714 33554432000 4194304 4338100 140736315474352 18446744073709551615 216000395237 0 0 4096 0 18446744073709551615 0 0 17 2 0 0 0
/proc/29954/statm: 70730 7714 175 36 0 68635 0
Current children cumulated CPU time (s) 2.93
Current children cumulated vsize (KiB) 282920

[startup+3.10021 s]
/proc/loadavg: 7.68 7.92 8.35 9/186 29959
/proc/meminfo: memFree=12606592/32950940 swapFree=67111528/67111528
[pid=29954] ppid=29952 vsize=295432 CPUtime=9.31 cores=0,2,4,6
/proc/29954/stat : 29954 (ttsth-5-4) S 29952 29954 28861 0 -1 4202496 11126 0 0 0 923 8 0 0 25 0 5 0 600408967 302522368 10888 33554432000 4194304 4338100 140736315474352 18446744073709551615 216000395237 0 0 4096 0 18446744073709551615 0 0 17 2 0 0 0
/proc/29954/statm: 73858 10888 175 36 0 71763 0
[pid=29954/tid=29956] ppid=29952 vsize=295432 CPUtime=2.07 cores=0,2,4,6
/proc/29954/task/29956/stat : 29956 (ttsth-5-4) R 29952 29954 28861 0 -1 4202560 403 0 0 0 206 1 0 0 25 0 5 0 600409068 302522368 10888 33554432000 4194304 4338100 140736315474352 18446744073709551615 4263499 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=29954/tid=29957] ppid=29952 vsize=295432 CPUtime=2.06 cores=0,2,4,6
/proc/29954/task/29957/stat : 29957 (ttsth-5-4) R 29952 29954 28861 0 -1 4202560 1724 0 0 0 204 2 0 0 21 0 5 0 600409068 302522368 10888 33554432000 4194304 4338100 140736315474352 18446744073709551615 4254840 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=29954/tid=29958] ppid=29952 vsize=295432 CPUtime=2.06 cores=0,2,4,6
/proc/29954/task/29958/stat : 29958 (ttsth-5-4) R 29952 29954 28861 0 -1 4202560 1808 0 0 0 205 1 0 0 25 0 5 0 600409068 302522368 10888 33554432000 4194304 4338100 140736315474352 18446744073709551615 4242496 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=29954/tid=29959] ppid=29952 vsize=295432 CPUtime=2.07 cores=0,2,4,6
/proc/29954/task/29959/stat : 29959 (ttsth-5-4) R 29952 29954 28861 0 -1 4202560 774 0 0 0 205 2 0 0 25 0 5 0 600409068 302522368 10888 33554432000 4194304 4338100 140736315474352 18446744073709551615 216000418485 0 0 4096 0 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 9.31
Current children cumulated vsize (KiB) 295432

[startup+6.30065 s]
/proc/loadavg: 7.70 7.92 8.35 9/186 29959
/proc/meminfo: memFree=12566012/32950940 swapFree=67111528/67111528
[pid=29954] ppid=29952 vsize=320456 CPUtime=22.03 cores=0,2,4,6
/proc/29954/stat : 29954 (ttsth-5-4) S 29952 29954 28861 0 -1 4202496 17430 0 0 0 2177 26 0 0 25 0 5 0 600408967 328146944 17192 33554432000 4194304 4338100 140736315474352 18446744073709551615 216000395237 0 0 4096 0 18446744073709551615 0 0 17 2 0 0 0
/proc/29954/statm: 80114 17192 175 36 0 78019 0
[pid=29954/tid=29956] ppid=29952 vsize=320456 CPUtime=5.27 cores=0,2,4,6
/proc/29954/task/29956/stat : 29956 (ttsth-5-4) R 29952 29954 28861 0 -1 4202560 1005 0 0 0 524 3 0 0 25 0 5 0 600409068 328146944 17193 33554432000 4194304 4338100 140736315474352 18446744073709551615 4234407 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=29954/tid=29957] ppid=29952 vsize=320456 CPUtime=5.22 cores=0,2,4,6
/proc/29954/task/29957/stat : 29957 (ttsth-5-4) R 29952 29954 28861 0 -1 4202560 4021 0 0 0 514 8 0 0 25 0 5 0 600409068 328146944 17193 33554432000 4194304 4338100 140736315474352 18446744073709551615 4254311 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=29954/tid=29958] ppid=29952 vsize=320456 CPUtime=5.25 cores=0,2,4,6
/proc/29954/task/29958/stat : 29958 (ttsth-5-4) R 29952 29954 28861 0 -1 4202560 4404 0 0 0 519 6 0 0 25 0 5 0 600409068 328146944 17193 33554432000 4194304 4338100 140736315474352 18446744073709551615 216000418485 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=29954/tid=29959] ppid=29952 vsize=320456 CPUtime=5.25 cores=0,2,4,6
/proc/29954/task/29959/stat : 29959 (ttsth-5-4) R 29952 29954 28861 0 -1 4202560 1584 0 0 0 518 7 0 0 22 0 5 0 600409068 328146944 17193 33554432000 4194304 4338100 140736315474352 18446744073709551615 216000418485 0 0 4096 0 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 22.03
Current children cumulated vsize (KiB) 320456

[startup+12.7005 s]
/proc/loadavg: 7.73 7.92 8.35 9/186 29959
/proc/meminfo: memFree=12499100/32950940 swapFree=67111528/67111528
[pid=29954] ppid=29952 vsize=352340 CPUtime=47.48 cores=0,2,4,6
/proc/29954/stat : 29954 (ttsth-5-4) S 29952 29954 28861 0 -1 4202496 25125 0 0 0 4671 77 0 0 25 0 5 0 600408967 360796160 24887 33554432000 4194304 4338100 140736315474352 18446744073709551615 216000395237 0 0 4096 0 18446744073709551615 0 0 17 2 0 0 0
/proc/29954/statm: 88085 24887 175 36 0 85990 0
[pid=29954/tid=29956] ppid=29952 vsize=352340 CPUtime=11.66 cores=0,2,4,6
/proc/29954/task/29956/stat : 29956 (ttsth-5-4) R 29952 29954 28861 0 -1 4202560 1877 0 0 0 1155 11 0 0 21 0 5 0 600409068 360796160 24887 33554432000 4194304 4338100 140736315474352 18446744073709551615 215987987565 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=29954/tid=29957] ppid=29952 vsize=352340 CPUtime=11.54 cores=0,2,4,6
/proc/29954/task/29957/stat : 29957 (ttsth-5-4) R 29952 29954 28861 0 -1 4202560 7429 0 0 0 1133 21 0 0 21 0 5 0 600409068 360796160 24887 33554432000 4194304 4338100 140736315474352 18446744073709551615 215987987565 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=29954/tid=29958] ppid=29952 vsize=352340 CPUtime=11.61 cores=0,2,4,6
/proc/29954/task/29958/stat : 29958 (ttsth-5-4) R 29952 29954 28861 0 -1 4202560 6610 0 0 0 1139 22 0 0 18 0 5 0 600409068 360796160 24887 33554432000 4194304 4338100 140736315474352 18446744073709551615 216000418485 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=29954/tid=29959] ppid=29952 vsize=352340 CPUtime=11.62 cores=0,2,4,6
/proc/29954/task/29959/stat : 29959 (ttsth-5-4) R 29952 29954 28861 0 -1 4202560 2792 0 0 0 1142 20 0 0 25 0 5 0 600409068 360796160 24887 33554432000 4194304 4338100 140736315474352 18446744073709551615 216000418485 0 0 4096 0 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 47.48
Current children cumulated vsize (KiB) 352340

[startup+25.5003 s]
/proc/loadavg: 7.86 7.94 8.35 10/186 29991
/proc/meminfo: memFree=17088316/32950940 swapFree=67111528/67111528
[pid=29954] ppid=29952 vsize=419472 CPUtime=98.27 cores=0,2,4,6
/proc/29954/stat : 29954 (ttsth-5-4) S 29952 29954 28861 0 -1 4202496 42465 0 0 0 9648 179 0 0 25 0 5 0 600408967 429539328 42227 33554432000 4194304 4338100 140736315474352 18446744073709551615 216000395237 0 0 4096 0 18446744073709551615 0 0 17 2 0 0 0
/proc/29954/statm: 104868 42227 175 36 0 102773 0
[pid=29954/tid=29956] ppid=29952 vsize=419472 CPUtime=24.44 cores=0,2,4,6
/proc/29954/task/29956/stat : 29956 (ttsth-5-4) R 29952 29954 28861 0 -1 4202560 3420 0 0 0 2414 30 0 0 25 0 5 0 600409068 429539328 42227 33554432000 4194304 4338100 140736315474352 18446744073709551615 4258042 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=29954/tid=29957] ppid=29952 vsize=419472 CPUtime=24.19 cores=0,2,4,6
/proc/29954/task/29957/stat : 29957 (ttsth-5-4) R 29952 29954 28861 0 -1 4202560 13613 0 0 0 2370 49 0 0 25 0 5 0 600409068 429539328 42227 33554432000 4194304 4338100 140736315474352 18446744073709551615 215987987681 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=29954/tid=29958] ppid=29952 vsize=419472 CPUtime=24.3 cores=0,2,4,6
/proc/29954/task/29958/stat : 29958 (ttsth-5-4) R 29952 29954 28861 0 -1 4202560 13611 0 0 0 2378 52 0 0 25 0 5 0 600409068 429539328 42227 33554432000 4194304 4338100 140736315474352 18446744073709551615 216000418485 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=29954/tid=29959] ppid=29952 vsize=419472 CPUtime=24.31 cores=0,2,4,6
/proc/29954/task/29959/stat : 29959 (ttsth-5-4) R 29952 29954 28861 0 -1 4202560 5404 0 0 0 2384 47 0 0 19 0 5 0 600409068 429539328 42227 33554432000 4194304 4338100 140736315474352 18446744073709551615 216000418485 0 0 4096 0 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 98.27
Current children cumulated vsize (KiB) 419472

[startup+51.1008 s]
/proc/loadavg: 7.98 7.96 8.34 9/186 29992
/proc/meminfo: memFree=16762308/32950940 swapFree=67111528/67111528
[pid=29954] ppid=29952 vsize=508340 CPUtime=200.14 cores=0,2,4,6
/proc/29954/stat : 29954 (ttsth-5-4) S 29952 29954 28861 0 -1 4202496 64758 0 0 0 19627 387 0 0 25 0 5 0 600408967 520540160 64520 33554432000 4194304 4338100 140736315474352 18446744073709551615 216000395237 0 0 4096 0 18446744073709551615 0 0 17 2 0 0 0
/proc/29954/statm: 127085 64520 175 36 0 124990 0
[pid=29954/tid=29956] ppid=29952 vsize=508340 CPUtime=49.82 cores=0,2,4,6
/proc/29954/task/29956/stat : 29956 (ttsth-5-4) R 29952 29954 28861 0 -1 4202560 6973 0 0 0 4896 86 0 0 18 0 5 0 600409068 520540160 64520 33554432000 4194304 4338100 140736315474352 18446744073709551615 4254451 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=29954/tid=29957] ppid=29952 vsize=508340 CPUtime=49.65 cores=0,2,4,6
/proc/29954/task/29957/stat : 29957 (ttsth-5-4) R 29952 29954 28861 0 -1 4202560 23447 0 0 0 4857 108 0 0 18 0 5 0 600409068 520540160 64520 33554432000 4194304 4338100 140736315474352 18446744073709551615 216000418485 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=29954/tid=29958] ppid=29952 vsize=508340 CPUtime=49.77 cores=0,2,4,6
/proc/29954/task/29958/stat : 29958 (ttsth-5-4) R 29952 29954 28861 0 -1 4202560 19988 0 0 0 4871 106 0 0 25 0 5 0 600409068 520540160 64520 33554432000 4194304 4338100 140736315474352 18446744073709551615 216000418485 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=29954/tid=29959] ppid=29952 vsize=508340 CPUtime=49.85 cores=0,2,4,6
/proc/29954/task/29959/stat : 29959 (ttsth-5-4) R 29952 29954 28861 0 -1 4202560 7933 0 0 0 4900 85 0 0 23 0 5 0 600409068 520540160 64520 33554432000 4194304 4338100 140736315474352 18446744073709551615 216000418485 0 0 4096 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 200.14
Current children cumulated vsize (KiB) 508340

[startup+102.307 s]
/proc/loadavg: 7.99 7.97 8.33 9/186 29993
/proc/meminfo: memFree=16388072/32950940 swapFree=67111528/67111528
[pid=29954] ppid=29952 vsize=622876 CPUtime=403.79 cores=0,2,4,6
/proc/29954/stat : 29954 (ttsth-5-4) S 29952 29954 28861 0 -1 4202496 93789 0 0 0 39616 763 0 0 25 0 5 0 600408967 637825024 93263 33554432000 4194304 4338100 140736315474352 18446744073709551615 216000395237 0 0 4096 0 18446744073709551615 0 0 17 2 0 0 0
/proc/29954/statm: 155719 93263 175 36 0 153624 0
[pid=29954/tid=29956] ppid=29952 vsize=622876 CPUtime=100.53 cores=0,2,4,6
/proc/29954/task/29956/stat : 29956 (ttsth-5-4) S 29952 29954 28861 0 -1 4202560 12684 0 0 0 9862 191 0 0 18 0 5 0 600409068 637825024 93263 33554432000 4194304 4338100 140736315474352 18446744073709551615 216000418164 0 0 4096 0 18446604453917981504 0 0 -1 2 0 0 0
[pid=29954/tid=29957] ppid=29952 vsize=622876 CPUtime=100.58 cores=0,2,4,6
/proc/29954/task/29957/stat : 29957 (ttsth-5-4) S 29952 29954 28861 0 -1 4202560 35980 0 0 0 9846 212 0 0 19 0 5 0 600409068 637825024 93263 33554432000 4194304 4338100 140736315474352 18446744073709551615 216000418164 0 0 4096 0 18446604453917981504 0 0 -1 4 0 0 0
[pid=29954/tid=29958] ppid=29952 vsize=622876 CPUtime=100.64 cores=0,2,4,6
/proc/29954/task/29958/stat : 29958 (ttsth-5-4) R 29952 29954 28861 0 -1 4202560 27320 0 0 0 9853 211 0 0 18 0 5 0 600409068 637825024 93263 33554432000 4194304 4338100 140736315474352 18446744073709551615 216000418164 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=29954/tid=29959] ppid=29952 vsize=622876 CPUtime=101 cores=0,2,4,6
/proc/29954/task/29959/stat : 29959 (ttsth-5-4) R 29952 29954 28861 0 -1 4202560 11388 0 0 0 9953 147 0 0 25 0 5 0 600409068 637825024 93263 33554432000 4194304 4338100 140736315474352 18446744073709551615 216000418485 0 0 4096 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 403.79
Current children cumulated vsize (KiB) 622876

[startup+162.3 s]
/proc/loadavg: 8.17 8.02 8.32 9/186 29995
/proc/meminfo: memFree=16186044/32950940 swapFree=67111528/67111528
[pid=29954] ppid=29952 vsize=691124 CPUtime=642.55 cores=0,2,4,6
/proc/29954/stat : 29954 (ttsth-5-4) S 29952 29954 28861 0 -1 4202496 110008 0 0 0 63066 1189 0 0 25 0 5 0 600408967 707710976 109482 33554432000 4194304 4338100 140736315474352 18446744073709551615 216000395237 0 0 4096 0 18446744073709551615 0 0 17 2 0 0 0
/proc/29954/statm: 172781 109482 175 36 0 170686 0
[pid=29954/tid=29956] ppid=29952 vsize=691124 CPUtime=160.13 cores=0,2,4,6
/proc/29954/task/29956/stat : 29956 (ttsth-5-4) R 29952 29954 28861 0 -1 4202560 13279 0 0 0 15702 311 0 0 25 0 5 0 600409068 707710976 109482 33554432000 4194304 4338100 140736315474352 18446744073709551615 4254388 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=29954/tid=29957] ppid=29952 vsize=691124 CPUtime=160.32 cores=0,2,4,6
/proc/29954/task/29957/stat : 29957 (ttsth-5-4) R 29952 29954 28861 0 -1 4202560 42677 0 0 0 15704 328 0 0 19 0 5 0 600409068 707710976 109482 33554432000 4194304 4338100 140736315474352 18446744073709551615 4254289 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=29954/tid=29958] ppid=29952 vsize=691124 CPUtime=160.51 cores=0,2,4,6
/proc/29954/task/29958/stat : 29958 (ttsth-5-4) R 29952 29954 28861 0 -1 4202560 30308 0 0 0 15761 290 0 0 19 0 5 0 600409068 707710976 109482 33554432000 4194304 4338100 140736315474352 18446744073709551615 216000418485 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=29954/tid=29959] ppid=29952 vsize=691124 CPUtime=160.55 cores=0,2,4,6
/proc/29954/task/29959/stat : 29959 (ttsth-5-4) R 29952 29954 28861 0 -1 4202560 17327 0 0 0 15797 258 0 0 19 0 5 0 600409068 707710976 109482 33554432000 4194304 4338100 140736315474352 18446744073709551615 216000418485 0 0 4096 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 642.55
Current children cumulated vsize (KiB) 691124

[startup+222.301 s]
/proc/loadavg: 8.06 8.01 8.29 9/186 29997
/proc/meminfo: memFree=16103076/32950940 swapFree=67111528/67111528
[pid=29954] ppid=29952 vsize=736196 CPUtime=881.39 cores=0,2,4,6
/proc/29954/stat : 29954 (ttsth-5-4) S 29952 29954 28861 0 -1 4202496 121130 0 0 0 86623 1516 0 0 25 0 5 0 600408967 753864704 120604 33554432000 4194304 4338100 140736315474352 18446744073709551615 216000395237 0 0 4096 0 18446744073709551615 0 0 17 2 0 0 0
/proc/29954/statm: 184049 120604 175 36 0 181954 0
[pid=29954/tid=29956] ppid=29952 vsize=736196 CPUtime=219.79 cores=0,2,4,6
/proc/29954/task/29956/stat : 29956 (ttsth-5-4) R 29952 29954 28861 0 -1 4202560 14912 0 0 0 21590 389 0 0 20 0 5 0 600409068 753864704 120604 33554432000 4194304 4338100 140736315474352 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 0 0 0 0

################
# More data... #
################

/proc/loadavg: 8.03 8.11 8.17 9/186 30053
/proc/meminfo: memFree=13733680/32950940 swapFree=67111528/67111528
[pid=29954] ppid=29952 vsize=1231420 CPUtime=4223.88 cores=0,2,4,6
/proc/29954/stat : 29954 (ttsth-5-4) S 29952 29954 28861 0 -1 4202496 244254 0 0 0 416171 6217 0 0 25 0 5 0 600408967 1260974080 243728 33554432000 4194304 4338100 140736315474352 18446744073709551615 216000395237 0 0 4096 0 18446744073709551615 0 0 17 2 0 0 0
/proc/29954/statm: 307855 243728 175 36 0 305760 0
[pid=29954/tid=29956] ppid=29952 vsize=1231420 CPUtime=1054.47 cores=0,2,4,6
/proc/29954/task/29956/stat : 29956 (ttsth-5-4) R 29952 29954 28861 0 -1 4202560 50801 0 0 0 103736 1711 0 0 19 0 5 0 600409068 1260974080 243728 33554432000 4194304 4338100 140736315474352 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=29954/tid=29957] ppid=29952 vsize=1231420 CPUtime=1055.53 cores=0,2,4,6
/proc/29954/task/29957/stat : 29957 (ttsth-5-4) R 29952 29954 28861 0 -1 4202560 96230 0 0 0 103978 1575 0 0 19 0 5 0 600409068 1260974080 243728 33554432000 4194304 4338100 140736315474352 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=29954/tid=29958] ppid=29952 vsize=1231420 CPUtime=1057.44 cores=0,2,4,6
/proc/29954/task/29958/stat : 29958 (ttsth-5-4) R 29952 29954 28861 0 -1 4202560 54769 0 0 0 104411 1333 0 0 25 0 5 0 600409068 1260974080 243728 33554432000 4194304 4338100 140736315474352 18446744073709551615 216000418485 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=29954/tid=29959] ppid=29952 vsize=1231420 CPUtime=1055.39 cores=0,2,4,6
/proc/29954/task/29959/stat : 29959 (ttsth-5-4) R 29952 29954 28861 0 -1 4202560 36037 0 0 0 103943 1596 0 0 25 0 5 0 600409068 1260974080 243728 33554432000 4194304 4338100 140736315474352 18446744073709551615 216000418485 0 0 4096 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4223.88
Current children cumulated vsize (KiB) 1231420

[startup+1122.3 s]
/proc/loadavg: 8.12 8.12 8.17 9/186 30055
/proc/meminfo: memFree=13765768/32950940 swapFree=67111528/67111528
[pid=29954] ppid=29952 vsize=1275212 CPUtime=4462.33 cores=0,2,4,6
/proc/29954/stat : 29954 (ttsth-5-4) S 29952 29954 28861 0 -1 4202496 254504 0 0 0 439678 6555 0 0 25 0 5 0 600408967 1305817088 253978 33554432000 4194304 4338100 140736315474352 18446744073709551615 216000395237 0 0 4096 0 18446744073709551615 0 0 17 2 0 0 0
/proc/29954/statm: 318803 253978 175 36 0 316708 0
[pid=29954/tid=29956] ppid=29952 vsize=1275212 CPUtime=1114.07 cores=0,2,4,6
/proc/29954/task/29956/stat : 29956 (ttsth-5-4) R 29952 29954 28861 0 -1 4202560 53580 0 0 0 109601 1806 0 0 21 0 5 0 600409068 1305817088 253978 33554432000 4194304 4338100 140736315474352 18446744073709551615 216000418485 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=29954/tid=29957] ppid=29952 vsize=1275212 CPUtime=1115.05 cores=0,2,4,6
/proc/29954/task/29957/stat : 29957 (ttsth-5-4) R 29952 29954 28861 0 -1 4202560 97999 0 0 0 109838 1667 0 0 25 0 5 0 600409068 1305817088 253978 33554432000 4194304 4338100 140736315474352 18446744073709551615 216000418485 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=29954/tid=29958] ppid=29952 vsize=1275212 CPUtime=1117.15 cores=0,2,4,6
/proc/29954/task/29958/stat : 29958 (ttsth-5-4) R 29952 29954 28861 0 -1 4202560 57458 0 0 0 110315 1400 0 0 25 0 5 0 600409068 1305817088 253978 33554432000 4194304 4338100 140736315474352 18446744073709551615 216000418485 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=29954/tid=29959] ppid=29952 vsize=1275212 CPUtime=1115.02 cores=0,2,4,6
/proc/29954/task/29959/stat : 29959 (ttsth-5-4) R 29952 29954 28861 0 -1 4202560 39050 0 0 0 109822 1680 0 0 19 0 5 0 600409068 1305817088 253978 33554432000 4194304 4338100 140736315474352 18446744073709551615 4254433 0 0 4096 0 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4462.33
Current children cumulated vsize (KiB) 1275212

[startup+1182.3 s]
/proc/loadavg: 8.16 8.12 8.16 9/186 30056
/proc/meminfo: memFree=13688252/32950940 swapFree=67111528/67111528
[pid=29954] ppid=29952 vsize=1306492 CPUtime=4700.48 cores=0,2,4,6
/proc/29954/stat : 29954 (ttsth-5-4) S 29952 29954 28861 0 -1 4202496 262407 0 0 0 463058 6990 0 0 25 0 5 0 600408967 1337847808 261881 33554432000 4194304 4338100 140736315474352 18446744073709551615 216000395237 0 0 4096 0 18446744073709551615 0 0 17 2 0 0 0
/proc/29954/statm: 326623 261881 175 36 0 324528 0
[pid=29954/tid=29956] ppid=29952 vsize=1306492 CPUtime=1173.53 cores=0,2,4,6
/proc/29954/task/29956/stat : 29956 (ttsth-5-4) R 29952 29954 28861 0 -1 4202560 57728 0 0 0 115423 1930 0 0 25 0 5 0 600409068 1337847808 261881 33554432000 4194304 4338100 140736315474352 18446744073709551615 4254337 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=29954/tid=29957] ppid=29952 vsize=1306492 CPUtime=1174.5 cores=0,2,4,6
/proc/29954/task/29957/stat : 29957 (ttsth-5-4) R 29952 29954 28861 0 -1 4202560 101285 0 0 0 115663 1787 0 0 18 0 5 0 600409068 1337847808 261881 33554432000 4194304 4338100 140736315474352 18446744073709551615 4254311 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=29954/tid=29958] ppid=29952 vsize=1306492 CPUtime=1176.85 cores=0,2,4,6
/proc/29954/task/29958/stat : 29958 (ttsth-5-4) R 29952 29954 28861 0 -1 4202560 57927 0 0 0 116186 1499 0 0 19 0 5 0 600409068 1337847808 261881 33554432000 4194304 4338100 140736315474352 18446744073709551615 216000418485 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=29954/tid=29959] ppid=29952 vsize=1306492 CPUtime=1174.55 cores=0,2,4,6
/proc/29954/task/29959/stat : 29959 (ttsth-5-4) R 29952 29954 28861 0 -1 4202560 39050 0 0 0 115683 1772 0 0 25 0 5 0 600409068 1337847808 261882 33554432000 4194304 4338100 140736315474352 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4700.48
Current children cumulated vsize (KiB) 1306492

Solver just ended. Dumping a history of the last processes samples

[startup+1190.3 s]
/proc/loadavg: 8.14 8.12 8.16 9/186 30056
/proc/meminfo: memFree=13635664/32950940 swapFree=67111528/67111528
[pid=29954] ppid=29952 vsize=1312748 CPUtime=4732.2 cores=0,2,4,6
/proc/29954/stat : 29954 (ttsth-5-4) S 29952 29954 28861 0 -1 4202496 264228 0 0 0 466173 7047 0 0 25 0 5 0 600408967 1344253952 263702 33554432000 4194304 4338100 140736315474352 18446744073709551615 216000395237 0 0 4096 0 18446744073709551615 0 0 17 2 0 0 0
/proc/29954/statm: 328187 263702 175 36 0 326092 0
[pid=29954/tid=29956] ppid=29952 vsize=1312748 CPUtime=1181.4 cores=0,2,4,6
/proc/29954/task/29956/stat : 29956 (ttsth-5-4) R 29952 29954 28861 0 -1 4202560 58154 0 0 0 116193 1947 0 0 18 0 5 0 600409068 1344253952 263702 33554432000 4194304 4338100 140736315474352 18446744073709551615 4254433 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=29954/tid=29957] ppid=29952 vsize=1312748 CPUtime=1182.44 cores=0,2,4,6
/proc/29954/task/29957/stat : 29957 (ttsth-5-4) R 29952 29954 28861 0 -1 4202560 102680 0 0 0 116441 1803 0 0 19 0 5 0 600409068 1344253952 263702 33554432000 4194304 4338100 140736315474352 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=29954/tid=29958] ppid=29952 vsize=1312748 CPUtime=1184.79 cores=0,2,4,6
/proc/29954/task/29958/stat : 29958 (ttsth-5-4) R 29952 29954 28861 0 -1 4202560 57927 0 0 0 116967 1512 0 0 20 0 5 0 600409068 1344253952 263702 33554432000 4194304 4338100 140736315474352 18446744073709551615 4254289 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=29954/tid=29959] ppid=29952 vsize=1312748 CPUtime=1182.52 cores=0,2,4,6
/proc/29954/task/29959/stat : 29959 (ttsth-5-4) R 29952 29954 28861 0 -1 4202560 39050 0 0 0 116470 1782 0 0 19 0 5 0 600409068 1344253952 263702 33554432000 4194304 4338100 140736315474352 18446744073709551615 216000418485 0 0 4096 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4732.2
Current children cumulated vsize (KiB) 1312748

[startup+1196.7 s]
/proc/loadavg: 8.21 8.13 8.17 9/186 30056
/proc/meminfo: memFree=13623012/32950940 swapFree=67111528/67111528
[pid=29954] ppid=29952 vsize=1322132 CPUtime=4757.67 cores=0,2,4,6
/proc/29954/stat : 29954 (ttsth-5-4) S 29952 29954 28861 0 -1 4202496 266666 0 0 0 468678 7089 0 0 25 0 5 0 600408967 1353863168 266140 33554432000 4194304 4338100 140736315474352 18446744073709551615 216000395237 0 0 4096 0 18446744073709551615 0 0 17 2 0 0 0
/proc/29954/statm: 330533 266140 175 36 0 328438 0
[pid=29954/tid=29956] ppid=29952 vsize=1322132 CPUtime=1187.75 cores=0,2,4,6
/proc/29954/task/29956/stat : 29956 (ttsth-5-4) R 29952 29954 28861 0 -1 4202560 59154 0 0 0 116816 1959 0 0 18 0 5 0 600409068 1353863168 266140 33554432000 4194304 4338100 140736315474352 18446744073709551615 216000418485 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=29954/tid=29957] ppid=29952 vsize=1322132 CPUtime=1188.8 cores=0,2,4,6
/proc/29954/task/29957/stat : 29957 (ttsth-5-4) R 29952 29954 28861 0 -1 4202560 104118 0 0 0 117065 1815 0 0 18 0 5 0 600409068 1353863168 266140 33554432000 4194304 4338100 140736315474352 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=29954/tid=29958] ppid=29952 vsize=1322132 CPUtime=1191.16 cores=0,2,4,6
/proc/29954/task/29958/stat : 29958 (ttsth-5-4) R 29952 29954 28861 0 -1 4202560 57927 0 0 0 117593 1523 0 0 19 0 5 0 600409068 1353863168 266140 33554432000 4194304 4338100 140736315474352 18446744073709551615 216000418485 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=29954/tid=29959] ppid=29952 vsize=1322132 CPUtime=1188.9 cores=0,2,4,6
/proc/29954/task/29959/stat : 29959 (ttsth-5-4) R 29952 29954 28861 0 -1 4202560 39050 0 0 0 117101 1789 0 0 19 0 5 0 600409068 1353863168 266140 33554432000 4194304 4338100 140736315474352 18446744073709551615 216000418485 0 0 4096 0 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4757.67
Current children cumulated vsize (KiB) 1322132

[startup+1203.1 s]
/proc/loadavg: 8.19 8.13 8.17 9/186 30057
/proc/meminfo: memFree=13603540/32950940 swapFree=67111528/67111528
[pid=29954] ppid=29952 vsize=1325260 CPUtime=4783.1 cores=0,2,4,6
/proc/29954/stat : 29954 (ttsth-5-4) S 29952 29954 28861 0 -1 4202496 267941 0 0 0 471186 7124 0 0 25 0 5 0 600408967 1357066240 267415 33554432000 4194304 4338100 140736315474352 18446744073709551615 216000395237 0 0 4096 0 18446744073709551615 0 0 17 2 0 0 0
/proc/29954/statm: 331315 267415 175 36 0 329220 0
[pid=29954/tid=29956] ppid=29952 vsize=1325260 CPUtime=1194.12 cores=0,2,4,6
/proc/29954/task/29956/stat : 29956 (ttsth-5-4) R 29952 29954 28861 0 -1 4202560 59457 0 0 0 117447 1965 0 0 25 0 5 0 600409068 1357066240 267415 33554432000 4194304 4338100 140736315474352 18446744073709551615 216000418485 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=29954/tid=29957] ppid=29952 vsize=1325260 CPUtime=1195.15 cores=0,2,4,6
/proc/29954/task/29957/stat : 29957 (ttsth-5-4) R 29952 29954 28861 0 -1 4202560 105090 0 0 0 117690 1825 0 0 18 0 5 0 600409068 1357066240 267415 33554432000 4194304 4338100 140736315474352 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=29954/tid=29958] ppid=29952 vsize=1325260 CPUtime=1197.51 cores=0,2,4,6
/proc/29954/task/29958/stat : 29958 (ttsth-5-4) R 29952 29954 28861 0 -1 4202560 57927 0 0 0 118218 1533 0 0 19 0 5 0 600409068 1357066240 267415 33554432000 4194304 4338100 140736315474352 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=29954/tid=29959] ppid=29952 vsize=1325260 CPUtime=1195.28 cores=0,2,4,6
/proc/29954/task/29959/stat : 29959 (ttsth-5-4) R 29952 29954 28861 0 -1 4202560 39050 0 0 0 117729 1799 0 0 19 0 5 0 600409068 1357066240 267415 33554432000 4194304 4338100 140736315474352 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4783.1
Current children cumulated vsize (KiB) 1325260

[startup+1204.7 s]
/proc/loadavg: 8.18 8.13 8.17 9/186 30057
/proc/meminfo: memFree=13600936/32950940 swapFree=67111528/67111528
[pid=29954] ppid=29952 vsize=1325260 CPUtime=4789.48 cores=0,2,4,6
/proc/29954/stat : 29954 (ttsth-5-4) S 29952 29954 28861 0 -1 4202496 268082 0 0 0 471818 7130 0 0 25 0 5 0 600408967 1357066240 267556 33554432000 4194304 4338100 140736315474352 18446744073709551615 216000395237 0 0 4096 0 18446744073709551615 0 0 17 2 0 0 0
/proc/29954/statm: 331315 267556 175 36 0 329220 0
[pid=29954/tid=29956] ppid=29952 vsize=1325260 CPUtime=1195.71 cores=0,2,4,6
/proc/29954/task/29956/stat : 29956 (ttsth-5-4) R 29952 29954 28861 0 -1 4202560 59598 0 0 0 117604 1967 0 0 19 0 5 0 600409068 1357066240 267556 33554432000 4194304 4338100 140736315474352 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=29954/tid=29957] ppid=29952 vsize=1325260 CPUtime=1196.74 cores=0,2,4,6
/proc/29954/task/29957/stat : 29957 (ttsth-5-4) R 29952 29954 28861 0 -1 4202560 105090 0 0 0 117849 1825 0 0 21 0 5 0 600409068 1357066240 267556 33554432000 4194304 4338100 140736315474352 18446744073709551615 216000418485 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=29954/tid=29958] ppid=29952 vsize=1325260 CPUtime=1199.11 cores=0,2,4,6
/proc/29954/task/29958/stat : 29958 (ttsth-5-4) R 29952 29954 28861 0 -1 4202560 57927 0 0 0 118376 1535 0 0 18 0 5 0 600409068 1357066240 267556 33554432000 4194304 4338100 140736315474352 18446744073709551615 216000418485 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=29954/tid=29959] ppid=29952 vsize=1325260 CPUtime=1196.87 cores=0,2,4,6
/proc/29954/task/29959/stat : 29959 (ttsth-5-4) R 29952 29954 28861 0 -1 4202560 39050 0 0 0 117886 1801 0 0 23 0 5 0 600409068 1357066240 267556 33554432000 4194304 4338100 140736315474352 18446744073709551615 216000418485 0 0 4096 0 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4789.48
Current children cumulated vsize (KiB) 1325260

[startup+1206.3 s]
/proc/loadavg: 8.18 8.13 8.17 9/186 30057
/proc/meminfo: memFree=13599324/32950940 swapFree=67111528/67111528
[pid=29954] ppid=29952 vsize=1328388 CPUtime=4795.86 cores=0,2,4,6
/proc/29954/stat : 29954 (ttsth-5-4) S 29952 29954 28861 0 -1 4202496 268180 0 0 0 472449 7137 0 0 25 0 5 0 600408967 1360269312 267654 33554432000 4194304 4338100 140736315474352 18446744073709551615 216000395237 0 0 4096 0 18446744073709551615 0 0 17 2 0 0 0
/proc/29954/statm: 332097 267654 175 36 0 330002 0
[pid=29954/tid=29956] ppid=29952 vsize=1328388 CPUtime=1197.3 cores=0,2,4,6
/proc/29954/task/29956/stat : 29956 (ttsth-5-4) R 29952 29954 28861 0 -1 4202560 59696 0 0 0 117761 1969 0 0 18 0 5 0 600409068 1360269312 267654 33554432000 4194304 4338100 140736315474352 18446744073709551615 4254294 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=29954/tid=29957] ppid=29952 vsize=1328388 CPUtime=1198.35 cores=0,2,4,6
/proc/29954/task/29957/stat : 29957 (ttsth-5-4) R 29952 29954 28861 0 -1 4202560 105090 0 0 0 118008 1827 0 0 20 0 5 0 600409068 1360269312 267654 33554432000 4194304 4338100 140736315474352 18446744073709551615 216000418485 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=29954/tid=29958] ppid=29952 vsize=1328388 CPUtime=1200.7 cores=0,2,4,6
/proc/29954/task/29958/stat : 29958 (ttsth-5-4) R 29952 29954 28861 0 -1 4202560 57927 0 0 0 118534 1536 0 0 20 0 5 0 600409068 1360269312 267654 33554432000 4194304 4338100 140736315474352 18446744073709551615 216000418485 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=29954/tid=29959] ppid=29952 vsize=1328388 CPUtime=1198.47 cores=0,2,4,6
/proc/29954/task/29959/stat : 29959 (ttsth-5-4) R 29952 29954 28861 0 -1 4202560 39050 0 0 0 118044 1803 0 0 25 0 5 0 600409068 1360269312 267654 33554432000 4194304 4338100 140736315474352 18446744073709551615 216000418485 0 0 4096 0 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4795.86
Current children cumulated vsize (KiB) 1328388

[startup+1207.1 s]
/proc/loadavg: 8.18 8.13 8.17 9/186 30057
/proc/meminfo: memFree=13596968/32950940 swapFree=67111528/67111528
[pid=29954] ppid=29952 vsize=1328388 CPUtime=4799.05 cores=0,2,4,6
/proc/29954/stat : 29954 (ttsth-5-4) S 29952 29954 28861 0 -1 4202496 268246 0 0 0 472762 7143 0 0 25 0 5 0 600408967 1360269312 267720 33554432000 4194304 4338100 140736315474352 18446744073709551615 216000395237 0 0 4096 0 18446744073709551615 0 0 17 2 0 0 0
/proc/29954/statm: 332097 267720 175 36 0 330002 0
[pid=29954/tid=29956] ppid=29952 vsize=1328388 CPUtime=1198.09 cores=0,2,4,6
/proc/29954/task/29956/stat : 29956 (ttsth-5-4) R 29952 29954 28861 0 -1 4202560 59762 0 0 0 117839 1970 0 0 19 0 5 0 600409068 1360269312 267720 33554432000 4194304 4338100 140736315474352 18446744073709551615 4285872 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=29954/tid=29957] ppid=29952 vsize=1328388 CPUtime=1199.14 cores=0,2,4,6
/proc/29954/task/29957/stat : 29957 (ttsth-5-4) R 29952 29954 28861 0 -1 4202560 105090 0 0 0 118087 1827 0 0 22 0 5 0 600409068 1360269312 267720 33554432000 4194304 4338100 140736315474352 18446744073709551615 4254429 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=29954/tid=29958] ppid=29952 vsize=1328388 CPUtime=1201.5 cores=0,2,4,6
/proc/29954/task/29958/stat : 29958 (ttsth-5-4) R 29952 29954 28861 0 -1 4202560 57927 0 0 0 118612 1538 0 0 23 0 5 0 600409068 1360269312 267720 33554432000 4194304 4338100 140736315474352 18446744073709551615 4253966 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=29954/tid=29959] ppid=29952 vsize=1328388 CPUtime=1199.26 cores=0,2,4,6
/proc/29954/task/29959/stat : 29959 (ttsth-5-4) R 29952 29954 28861 0 -1 4202560 39050 0 0 0 118121 1805 0 0 18 0 5 0 600409068 1360269312 267720 33554432000 4194304 4338100 140736315474352 18446744073709551615 4253954 0 0 4096 0 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4799.05
Current children cumulated vsize (KiB) 1328388

[startup+1207.3 s]
/proc/loadavg: 8.18 8.13 8.17 9/186 30057
/proc/meminfo: memFree=13596968/32950940 swapFree=67111528/67111528
[pid=29954] ppid=29952 vsize=1328388 CPUtime=4799.85 cores=0,2,4,6
/proc/29954/stat : 29954 (ttsth-5-4) S 29952 29954 28861 0 -1 4202496 268315 0 0 0 472841 7144 0 0 25 0 5 0 600408967 1360269312 267789 33554432000 4194304 4338100 140736315474352 18446744073709551615 216000395237 0 0 4096 0 18446744073709551615 0 0 17 2 0 0 0
/proc/29954/statm: 332097 267789 175 36 0 330002 0
[pid=29954/tid=29956] ppid=29952 vsize=1328388 CPUtime=1198.3 cores=0,2,4,6
/proc/29954/task/29956/stat : 29956 (ttsth-5-4) R 29952 29954 28861 0 -1 4202560 59831 0 0 0 117859 1971 0 0 20 0 5 0 600409068 1360269312 267789 33554432000 4194304 4338100 140736315474352 18446744073709551615 4229573 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=29954/tid=29957] ppid=29952 vsize=1328388 CPUtime=1199.34 cores=0,2,4,6
/proc/29954/task/29957/stat : 29957 (ttsth-5-4) R 29952 29954 28861 0 -1 4202560 105090 0 0 0 118107 1827 0 0 23 0 5 0 600409068 1360269312 267789 33554432000 4194304 4338100 140736315474352 18446744073709551615 216000418485 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=29954/tid=29958] ppid=29952 vsize=1328388 CPUtime=1201.69 cores=0,2,4,6
/proc/29954/task/29958/stat : 29958 (ttsth-5-4) R 29952 29954 28861 0 -1 4202560 57927 0 0 0 118631 1538 0 0 25 0 5 0 600409068 1360269312 267789 33554432000 4194304 4338100 140736315474352 18446744073709551615 216000418485 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=29954/tid=29959] ppid=29952 vsize=1328388 CPUtime=1199.46 cores=0,2,4,6
/proc/29954/task/29959/stat : 29959 (ttsth-5-4) R 29952 29954 28861 0 -1 4202560 39050 0 0 0 118140 1806 0 0 18 0 5 0 600409068 1360269312 267789 33554432000 4194304 4338100 140736315474352 18446744073709551615 216000418485 0 0 4096 0 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4799.85
Current children cumulated vsize (KiB) 1328388

Child status: 0
Real time (s): 1207.4
CPU time (s): 4800.07
CPU user time (s): 4728.58
CPU system time (s): 71.4891
CPU usage (%): 397.555
Max. virtual memory (cumulated for all children) (KiB): 1328388

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4728.58
system time used= 71.4891
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 268326
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 558754
involuntary context switches= 25172

runsolver used 1.80472 second user time and 4.03839 second system time

The end

Launcher Data 

Begin job on node117 at 2011-04-29 20:29:42
IDJOB=3265214
IDBENCH=85456
IDSOLVER=1654
FILE ID=node117/3265214-1304101782
RUNJOBID= node117-1304100568-29834
PBS_JOBID= 13170599
Free space on /tmp= 71680 MiB

SOLVER NAME= ttsth 5-4
BENCH NAME= SAT05/crafted/sabharwal05/counting/php/unsat/harder/php-040-039.shuffled-as.sat05-1194.cnf
COMMAND LINE= DIR/ttsth-5-4 -num-threads NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3265214-1304101782/watcher-3265214-1304101782 -o /tmp/evaluation-result-3265214-1304101782/solver-3265214-1304101782 -C 4800 -W 1300 -M 15500  HOME/ttsth-5-4 -num-threads 4 HOME/instance-3265214-1304101782.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 8c84d9b9f2d75de33656119bc03a9afb
RANDOM SEED=790300795

node117.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5267.44
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950940 kB
MemFree:      12654644 kB
Buffers:       2381516 kB
Cached:       12481184 kB
SwapCached:          0 kB
Active:       12927624 kB
Inactive:      6777708 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950940 kB
LowFree:      12654644 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:             404 kB
Writeback:           0 kB
AnonPages:     4840700 kB
Mapped:          15196 kB
Slab:           518628 kB
PageTables:      13700 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586996 kB
Committed_AS:  5094664 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71676 MiB
End job on node117 at 2011-04-29 20:49:49