Trace number 3266446

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ttsth 5-4? (MO) 2305.01 578.024

General information on the benchmark

NameSAT02/handmade/simon/
satex-challenges/c6288.shuffled.cnf
MD5SUM75bd8319132b47c2d2e6f0889735a248
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark0.865867
Satisfiable
(Un)Satisfiability was proved
Number of variables5008
Number of clauses14813
Sum of the clauses size34485
Maximum clause length33
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 29982
Number of clauses of size 34829
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 51

Solver Data 

0.00/0.01	c Command: HOME/ttsth-5-4 -num-threads 4 HOME/instance-3266446-1304105160.cnf 
0.00/0.01	c Using SATTIMEOUT of 4800
0.00/0.01	c Using SATRAM of 15500
0.00/0.01	c Size of subset node = 32
0.00/0.01	c Variables = 5008
0.00/0.01	c Clauses = 14813
0.00/0.01	c Literals = 34485
0.00/0.01	c Reduced size:
0.00/0.01	c Variables = 5008
0.00/0.01	c Clauses = 14780
0.00/0.01	c Literals = 34419
0.00/0.01	c a2
0.02/0.02	c a1
0.59/0.60	c Independent sub-problems = 1
0.59/0.60	c Sub-problem with 5007 variables and 14780 clauses
0.59/0.60	c using permutation method 4
0.59/0.60	c count = 2
0.59/0.60	c Ordering finished 0.600 seconds
0.59/0.60	c mapped 0.600 seconds
0.59/0.60	c permuted 0.600 seconds
0.59/0.60	c about to sort
0.59/0.61	c sorted
0.59/0.67	c clauses now 14780
0.59/0.67	c init finished 0.650 seconds
0.59/0.67	c tree built 0.670 seconds
0.59/0.67	c 
0.59/0.67	c PA progress                      | CPU progress Partial assignments | improvements                 ucps  CPU time       PA/sec  nodes
0.59/0.67	c ---------------------------------|----------------------------------|--------------------------------------------------------------------
0.59/0.67	c ................................ | ..........                    |                                  0.7         0.0             
0.59/0.67	c ................................ | ..........                  1 |                                  0.7         1.5             
0.59/0.68	c ................................ | ..........                  2 |                                  0.7         3.0             
0.59/0.68	c ................................ | ..........                  3 |                                  0.7         4.5             
0.59/0.68	c ................................ | ..........                  4 |                                  0.7         6.0             
0.59/0.68	c ................................ | ..........                  5 |                                  0.7         7.5             
0.59/0.68	c ................................ | ..........               1000 | 5            94                  0.7      1470.6         1363
95.70/24.57	c ................................ | ..........            2226000 | 58569        799976             96.0     23187.5     15335931
191.97/48.61	c ................................ | ..........            4133000 | 113103       1409887           192.0     21523.8     38559356
287.87/72.63	c ................................ | ..........            5725000 | 160321       1969005           288.0     19877.8     61363353
383.74/96.67	c ................................ | ..........            7496000 | 208378       2450112           384.0     19519.3     89120769
480.02/120.70	c ................................ | *.........            9132000 | 255467       3011217           480.0     19024.2    112225569
575.90/144.73	c ................................ | *.........           10711000 | 299097       3542813           576.0     18594.5    133903478
671.78/168.76	c ................................ | *.........           12358000 | 344736       3998505           672.0     18388.8    158592868
767.66/192.79	c ................................ | *.........           13892000 | 390856       4481146           768.0     18088.1    180749920
863.92/216.82	c ................................ | *.........           15449000 | 433799       4930253           864.0     17880.4    202708442
959.80/240.86	c ................................ | **........           16565000 | 468752       5392498           960.0     17254.5    222424470
1055.69/264.88	c ................................ | **........           17666000 | 503129       5800268          1056.0     16729.0    241580120
1151.97/288.91	c ................................ | **........           19041000 | 541505       6219294          1152.0     16528.5    264956736
1247.83/312.94	c ................................ | **........           20452000 | 579923       6627751          1248.0     16387.7    285404595
1343.70/336.98	c ................................ | **........           21799000 | 620603       6996548          1344.0     16219.3    312514227
1439.98/361.02	c ................................ | ***.......           22986000 | 657133       7441774          1440.1     15961.5    331193938
1535.88/385.03	c ................................ | ***.......           24202000 | 694245       7916792          1536.0     15756.5    351455300
1631.73/409.07	c ................................ | ***.......           25439000 | 728664       8354482          1632.0     15587.2    370433738
1727.99/433.10	c ................................ | ***.......           26579000 | 762203       8748039          1728.0     15381.3    389831605
1823.85/457.14	c ................................ | ***.......           27704000 | 794584       9157305          1824.0     15188.3    403649588
1919.72/481.17	c ................................ | ****......           28774000 | 831131       9564795          1920.0     14986.5    423027076
2015.99/505.22	c ................................ | ****......           29845000 | 866432       9948037          2016.1     14803.6    441403759
2111.83/529.26	c ................................ | ****......           31173000 | 904414       10363637         2112.1     14759.4    459662824
2207.72/553.29	c ................................ | ****......           32532000 | 943370       10775095         2208.1     14733.3    476659157
2303.94/577.31	c ................................ | ****......           33895000 | 981208       11145365         2304.0     14711.4    490377412

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3266446-1304105160/watcher-3266446-1304105160 -o /tmp/evaluation-result-3266446-1304105160/solver-3266446-1304105160 -C 4800 -W 1300 -M 15500 HOME/ttsth-5-4 -num-threads 4 HOME/instance-3266446-1304105160.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.49 7.98 8.05 2/177 3042
/proc/meminfo: memFree=30773608/32951124 swapFree=67110188/67111528
[pid=3042] ppid=3040 vsize=9408 CPUtime=0 cores=0,2,4,6
/proc/3042/stat : 3042 (ttsth-5-4) R 3040 3042 2052 0 -1 4202496 403 0 0 0 0 0 0 0 23 0 1 0 522116757 9633792 345 33554432000 4194304 4338100 140736187566016 18446744073709551615 222921776896 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/3042/statm: 2352 345 147 36 0 257 0

[startup+0.024441 s]
/proc/loadavg: 7.49 7.98 8.05 2/177 3042
/proc/meminfo: memFree=30773608/32951124 swapFree=67110188/67111528
[pid=3042] ppid=3040 vsize=12428 CPUtime=0.02 cores=0,2,4,6
/proc/3042/stat : 3042 (ttsth-5-4) R 3040 3042 2052 0 -1 4202496 1177 0 0 0 2 0 0 0 23 0 1 0 522116757 12726272 1119 33554432000 4194304 4338100 140736187566016 18446744073709551615 222921172998 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/3042/statm: 3107 1119 150 36 0 1012 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 12428

[startup+0.100449 s]
/proc/loadavg: 7.49 7.98 8.05 2/177 3042
/proc/meminfo: memFree=30773608/32951124 swapFree=67110188/67111528
[pid=3042] ppid=3040 vsize=13244 CPUtime=0.09 cores=0,2,4,6
/proc/3042/stat : 3042 (ttsth-5-4) R 3040 3042 2052 0 -1 4202496 1414 0 0 0 9 0 0 0 23 0 1 0 522116757 13561856 1327 33554432000 4194304 4338100 140736187566016 18446744073709551615 4297987 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/3042/statm: 3311 1327 153 36 0 1216 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 13244

[startup+0.300385 s]
/proc/loadavg: 7.49 7.98 8.05 2/177 3042
/proc/meminfo: memFree=30773608/32951124 swapFree=67110188/67111528
[pid=3042] ppid=3040 vsize=13376 CPUtime=0.29 cores=0,2,4,6
/proc/3042/stat : 3042 (ttsth-5-4) R 3040 3042 2052 0 -1 4202496 1434 0 0 0 29 0 0 0 25 0 1 0 522116757 13697024 1347 33554432000 4194304 4338100 140736187566016 18446744073709551615 4245205 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/3042/statm: 3344 1347 153 36 0 1249 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 13376

[startup+0.700611 s]
/proc/loadavg: 7.49 7.98 8.05 2/177 3042
/proc/meminfo: memFree=30773608/32951124 swapFree=67110188/67111528
[pid=3042] ppid=3040 vsize=324488 CPUtime=0.75 cores=0,2,4,6
/proc/3042/stat : 3042 (ttsth-5-4) S 3040 3042 2052 0 -1 4202496 17086 0 0 0 73 2 0 0 25 0 5 0 522116757 332275712 16998 33554432000 4194304 4338100 140736187566016 18446744073709551615 222933579749 0 0 4096 0 18446744073709551615 0 0 17 2 0 0 0
/proc/3042/statm: 81122 16998 174 36 0 79027 0
Current children cumulated CPU time (s) 0.75
Current children cumulated vsize (KiB) 324488

[startup+1.5011 s]
/proc/loadavg: 7.37 7.95 8.04 10/186 3051
/proc/meminfo: memFree=30658220/32951124 swapFree=67110188/67111528
[pid=3042] ppid=3040 vsize=336908 CPUtime=3.92 cores=0,2,4,6
/proc/3042/stat : 3042 (ttsth-5-4) S 3040 3042 2052 0 -1 4202496 21515 0 0 0 385 7 0 0 25 0 5 0 522116757 344993792 21427 33554432000 4194304 4338100 140736187566016 18446744073709551615 222933579749 0 0 4096 0 18446744073709551615 0 0 17 2 0 0 0
/proc/3042/statm: 84227 21433 174 36 0 82132 0
[pid=3042/tid=3048] ppid=3040 vsize=337040 CPUtime=0.8 cores=0,2,4,6
/proc/3042/task/3048/stat : 3048 (ttsth-5-4) R 3040 3042 2052 0 -1 4202560 1430 0 0 0 79 1 0 0 18 0 5 0 522116825 345128960 21434 33554432000 4194304 4338100 140736187566016 18446744073709551615 222921882143 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=3042/tid=3049] ppid=3040 vsize=337040 CPUtime=0.8 cores=0,2,4,6
/proc/3042/task/3049/stat : 3049 (ttsth-5-4) R 3040 3042 2052 0 -1 4202560 1404 0 0 0 79 1 0 0 18 0 5 0 522116825 345128960 21438 33554432000 4194304 4338100 140736187566016 18446744073709551615 4283672 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=3042/tid=3050] ppid=3040 vsize=337040 CPUtime=0.8 cores=0,2,4,6
/proc/3042/task/3050/stat : 3050 (ttsth-5-4) R 3040 3042 2052 0 -1 4202560 1339 0 0 0 79 1 0 0 18 0 5 0 522116825 345128960 21443 33554432000 4194304 4338100 140736187566016 18446744073709551615 222921882066 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=3042/tid=3051] ppid=3040 vsize=337040 CPUtime=0.8 cores=0,2,4,6
/proc/3042/task/3051/stat : 3051 (ttsth-5-4) R 3040 3042 2052 0 -1 4202560 1274 0 0 0 80 0 0 0 18 0 5 0 522116825 345128960 21446 33554432000 4194304 4338100 140736187566016 18446744073709551615 4283342 0 0 4096 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3.92
Current children cumulated vsize (KiB) 336908

[startup+3.10081 s]
/proc/loadavg: 7.37 7.95 8.04 9/186 3051
/proc/meminfo: memFree=30603660/32951124 swapFree=67110188/67111528
[pid=3042] ppid=3040 vsize=357868 CPUtime=10.28 cores=0,2,4,6
/proc/3042/stat : 3042 (ttsth-5-4) S 3040 3042 2052 0 -1 4202496 27688 0 0 0 1011 17 0 0 25 0 5 0 522116757 366456832 27600 33554432000 4194304 4338100 140736187566016 18446744073709551615 222933579749 0 0 4096 0 18446744073709551615 0 0 17 2 0 0 0
/proc/3042/statm: 89467 27600 174 36 0 87372 0
[pid=3042/tid=3048] ppid=3040 vsize=357868 CPUtime=2.41 cores=0,2,4,6
/proc/3042/task/3048/stat : 3048 (ttsth-5-4) R 3040 3042 2052 0 -1 4202560 3069 0 0 0 236 5 0 0 18 0 5 0 522116825 366456832 27600 33554432000 4194304 4338100 140736187566016 18446744073709551615 222921473481 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=3042/tid=3049] ppid=3040 vsize=357868 CPUtime=2.38 cores=0,2,4,6
/proc/3042/task/3049/stat : 3049 (ttsth-5-4) R 3040 3042 2052 0 -1 4202560 2920 0 0 0 234 4 0 0 18 0 5 0 522116825 366456832 27600 33554432000 4194304 4338100 140736187566016 18446744073709551615 222921172718 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=3042/tid=3050] ppid=3040 vsize=357868 CPUtime=2.37 cores=0,2,4,6
/proc/3042/task/3050/stat : 3050 (ttsth-5-4) R 3040 3042 2052 0 -1 4202560 2960 0 0 0 235 2 0 0 18 0 5 0 522116825 366456832 27600 33554432000 4194304 4338100 140736187566016 18446744073709551615 222921172198 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=3042/tid=3051] ppid=3040 vsize=357868 CPUtime=2.41 cores=0,2,4,6
/proc/3042/task/3051/stat : 3051 (ttsth-5-4) R 3040 3042 2052 0 -1 4202560 2657 0 0 0 238 3 0 0 18 0 5 0 522116825 366456832 27600 33554432000 4194304 4338100 140736187566016 18446744073709551615 222921172354 0 0 4096 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 10.28
Current children cumulated vsize (KiB) 357868

[startup+6.30023 s]
/proc/loadavg: 7.37 7.95 8.04 9/186 3051
/proc/meminfo: memFree=30508076/32951124 swapFree=67110188/67111528
[pid=3042] ppid=3040 vsize=388304 CPUtime=23.02 cores=0,2,4,6
/proc/3042/stat : 3042 (ttsth-5-4) S 3040 3042 2052 0 -1 4202496 35422 0 0 0 2270 32 0 0 25 0 5 0 522116757 397623296 35331 33554432000 4194304 4338100 140736187566016 18446744073709551615 222933579749 0 0 4096 0 18446744073709551615 0 0 17 2 0 0 0
/proc/3042/statm: 97076 35331 175 36 0 94981 0
[pid=3042/tid=3048] ppid=3040 vsize=388304 CPUtime=5.6 cores=0,2,4,6
/proc/3042/task/3048/stat : 3048 (ttsth-5-4) R 3040 3042 2052 0 -1 4202560 5128 0 0 0 550 10 0 0 22 0 5 0 522116825 397623296 35331 33554432000 4194304 4338100 140736187566016 18446744073709551615 222921172718 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=3042/tid=3049] ppid=3040 vsize=388304 CPUtime=5.57 cores=0,2,4,6
/proc/3042/task/3049/stat : 3049 (ttsth-5-4) R 3040 3042 2052 0 -1 4202560 5008 0 0 0 548 9 0 0 21 0 5 0 522116825 397623296 35331 33554432000 4194304 4338100 140736187566016 18446744073709551615 222921172414 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=3042/tid=3050] ppid=3040 vsize=388304 CPUtime=5.54 cores=0,2,4,6
/proc/3042/task/3050/stat : 3050 (ttsth-5-4) R 3040 3042 2052 0 -1 4202560 4941 0 0 0 551 3 0 0 18 0 5 0 522116825 397623296 35331 33554432000 4194304 4338100 140736187566016 18446744073709551615 222933602997 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=3042/tid=3051] ppid=3040 vsize=388304 CPUtime=5.6 cores=0,2,4,6
/proc/3042/task/3051/stat : 3051 (ttsth-5-4) R 3040 3042 2052 0 -1 4202560 4263 0 0 0 554 6 0 0 19 0 5 0 522116825 397623296 35331 33554432000 4194304 4338100 140736187566016 18446744073709551615 222933602997 0 0 4096 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 23.02
Current children cumulated vsize (KiB) 388304

[startup+12.7011 s]
/proc/loadavg: 7.46 7.95 8.04 9/186 3051
/proc/meminfo: memFree=30259384/32951124 swapFree=67110188/67111528
[pid=3042] ppid=3040 vsize=526848 CPUtime=48.58 cores=0,2,4,6
/proc/3042/stat : 3042 (ttsth-5-4) S 3040 3042 2052 0 -1 4202496 70582 0 0 0 4819 39 0 0 25 0 5 0 522116757 539492352 70491 33554432000 4194304 4338100 140736187566016 18446744073709551615 222933579749 0 0 4096 0 18446744073709551615 0 0 17 2 0 0 0
/proc/3042/statm: 131712 70491 175 36 0 129617 0
[pid=3042/tid=3048] ppid=3040 vsize=526848 CPUtime=12 cores=0,2,4,6
/proc/3042/task/3048/stat : 3048 (ttsth-5-4) R 3040 3042 2052 0 -1 4202560 12642 0 0 0 1188 12 0 0 25 0 5 0 522116825 539492352 70491 33554432000 4194304 4338100 140736187566016 18446744073709551615 4206915 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=3042/tid=3049] ppid=3040 vsize=526848 CPUtime=11.94 cores=0,2,4,6
/proc/3042/task/3049/stat : 3049 (ttsth-5-4) R 3040 3042 2052 0 -1 4202560 13195 0 0 0 1183 11 0 0 25 0 5 0 522116825 539492352 70491 33554432000 4194304 4338100 140736187566016 18446744073709551615 4240522 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=3042/tid=3050] ppid=3040 vsize=526848 CPUtime=11.94 cores=0,2,4,6
/proc/3042/task/3050/stat : 3050 (ttsth-5-4) R 3040 3042 2052 0 -1 4202560 14331 0 0 0 1189 5 0 0 18 0 5 0 522116825 539492352 70491 33554432000 4194304 4338100 140736187566016 18446744073709551615 4254462 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=3042/tid=3051] ppid=3040 vsize=526848 CPUtime=12 cores=0,2,4,6
/proc/3042/task/3051/stat : 3051 (ttsth-5-4) R 3040 3042 2052 0 -1 4202560 14332 0 0 0 1192 8 0 0 25 0 5 0 522116825 539492352 70491 33554432000 4194304 4338100 140736187566016 18446744073709551615 222921172393 0 0 4096 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 48.58
Current children cumulated vsize (KiB) 526848

[startup+25.5007 s]
/proc/loadavg: 7.63 7.97 8.04 10/186 3051
/proc/meminfo: memFree=29766476/32951124 swapFree=67110188/67111528
[pid=3042] ppid=3040 vsize=844532 CPUtime=99.69 cores=0,2,4,6
/proc/3042/stat : 3042 (ttsth-5-4) S 3040 3042 2052 0 -1 4202496 152465 0 0 0 9912 57 0 0 25 0 5 0 522116757 864800768 152374 33554432000 4194304 4338100 140736187566016 18446744073709551615 222933579749 0 0 4096 0 18446744073709551615 0 0 17 2 0 0 0
/proc/3042/statm: 211133 152374 175 36 0 209038 0
[pid=3042/tid=3048] ppid=3040 vsize=844532 CPUtime=24.8 cores=0,2,4,6
/proc/3042/task/3048/stat : 3048 (ttsth-5-4) R 3040 3042 2052 0 -1 4202560 29320 0 0 0 2464 16 0 0 25 0 5 0 522116825 864800768 152374 33554432000 4194304 4338100 140736187566016 18446744073709551615 4254388 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=3042/tid=3049] ppid=3040 vsize=844532 CPUtime=24.67 cores=0,2,4,6
/proc/3042/task/3049/stat : 3049 (ttsth-5-4) R 3040 3042 2052 0 -1 4202560 34707 0 0 0 2452 15 0 0 25 0 5 0 522116825 864800768 152374 33554432000 4194304 4338100 140736187566016 18446744073709551615 222921172410 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=3042/tid=3050] ppid=3040 vsize=844532 CPUtime=24.7 cores=0,2,4,6
/proc/3042/task/3050/stat : 3050 (ttsth-5-4) R 3040 3042 2052 0 -1 4202560 38113 0 0 0 2460 10 0 0 18 0 5 0 522116825 864800768 152374 33554432000 4194304 4338100 140736187566016 18446744073709551615 222933602997 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=3042/tid=3051] ppid=3040 vsize=844532 CPUtime=24.81 cores=0,2,4,6
/proc/3042/task/3051/stat : 3051 (ttsth-5-4) R 3040 3042 2052 0 -1 4202560 34243 0 0 0 2468 13 0 0 25 0 5 0 522116825 864800768 152374 33554432000 4194304 4338100 140736187566016 18446744073709551615 4254221 0 0 4096 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 99.69
Current children cumulated vsize (KiB) 844532

[startup+51.101 s]
/proc/loadavg: 7.81 7.98 8.04 9/186 3052
/proc/meminfo: memFree=28830492/32951124 swapFree=67110188/67111528
[pid=3042] ppid=3040 vsize=1641652 CPUtime=201.97 cores=0,2,4,6
/proc/3042/stat : 3042 (ttsth-5-4) S 3040 3042 2052 0 -1 4202496 352791 0 0 0 20099 98 0 0 25 0 5 0 522116757 1681051648 352700 33554432000 4194304 4338100 140736187566016 18446744073709551615 222933579749 0 0 4096 0 18446744073709551615 0 0 17 2 0 0 0
/proc/3042/statm: 410413 352700 176 36 0 408318 0
[pid=3042/tid=3048] ppid=3040 vsize=1641652 CPUtime=50.4 cores=0,2,4,6
/proc/3042/task/3048/stat : 3048 (ttsth-5-4) R 3040 3042 2052 0 -1 4202560 80828 0 0 0 5013 27 0 0 25 0 5 0 522116825 1681051648 352700 33554432000 4194304 4338100 140736187566016 18446744073709551615 4254388 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=3042/tid=3049] ppid=3040 vsize=1641652 CPUtime=50.15 cores=0,2,4,6
/proc/3042/task/3049/stat : 3049 (ttsth-5-4) R 3040 3042 2052 0 -1 4202560 82156 0 0 0 4992 23 0 0 25 0 5 0 522116825 1681051648 352700 33554432000 4194304 4338100 140736187566016 18446744073709551615 222921172396 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=3042/tid=3050] ppid=3040 vsize=1641652 CPUtime=50.29 cores=0,2,4,6
/proc/3042/task/3050/stat : 3050 (ttsth-5-4) R 3040 3042 2052 0 -1 4202560 92305 0 0 0 5008 21 0 0 25 0 5 0 522116825 1681051648 352700 33554432000 4194304 4338100 140736187566016 18446744073709551615 222933602997 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=3042/tid=3051] ppid=3040 vsize=1641652 CPUtime=50.4 cores=0,2,4,6
/proc/3042/task/3051/stat : 3051 (ttsth-5-4) R 3040 3042 2052 0 -1 4202560 81420 0 0 0 5017 23 0 0 25 0 5 0 522116825 1681051648 352700 33554432000 4194304 4338100 140736187566016 18446744073709551615 222933602997 0 0 4096 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 201.97
Current children cumulated vsize (KiB) 1641652

[startup+102.307 s]
/proc/loadavg: 7.92 7.98 8.04 9/186 3053
/proc/meminfo: memFree=26817432/32951124 swapFree=67110188/67111528
[pid=3042] ppid=3040 vsize=3360328 CPUtime=406.53 cores=0,2,4,6
/proc/3042/stat : 3042 (ttsth-5-4) S 3040 3042 2052 0 -1 4202496 786329 0 0 0 40487 166 0 0 25 0 5 0 522116757 3440975872 786238 33554432000 4194304 4338100 140736187566016 18446744073709551615 222933579749 0 0 4096 0 18446744073709551615 0 0 17 2 0 0 0
/proc/3042/statm: 840082 786238 176 36 0 837987 0
[pid=3042/tid=3048] ppid=3040 vsize=3360328 CPUtime=101.6 cores=0,2,4,6
/proc/3042/task/3048/stat : 3048 (ttsth-5-4) R 3040 3042 2052 0 -1 4202560 194908 0 0 0 10111 49 0 0 25 0 5 0 522116825 3440975872 786238 33554432000 4194304 4338100 140736187566016 18446744073709551615 222921172217 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=3042/tid=3049] ppid=3040 vsize=3360328 CPUtime=101.12 cores=0,2,4,6
/proc/3042/task/3049/stat : 3049 (ttsth-5-4) R 3040 3042 2052 0 -1 4202560 187738 0 0 0 10074 38 0 0 25 0 5 0 522116825 3440975872 786238 33554432000 4194304 4338100 140736187566016 18446744073709551615 222921473681 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=3042/tid=3050] ppid=3040 vsize=3360328 CPUtime=101.48 cores=0,2,4,6
/proc/3042/task/3050/stat : 3050 (ttsth-5-4) R 3040 3042 2052 0 -1 4202560 204145 0 0 0 10111 37 0 0 25 0 5 0 522116825 3440975872 786238 33554432000 4194304 4338100 140736187566016 18446744073709551615 222921172449 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=3042/tid=3051] ppid=3040 vsize=3360328 CPUtime=101.61 cores=0,2,4,6
/proc/3042/task/3051/stat : 3051 (ttsth-5-4) R 3040 3042 2052 0 -1 4202560 183456 0 0 0 10123 38 0 0 25 0 5 0 522116825 3440975872 786238 33554432000 4194304 4338100 140736187566016 18446744073709551615 4254010 0 0 4096 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 406.53
Current children cumulated vsize (KiB) 3360328

[startup+162.301 s]
/proc/loadavg: 8.00 8.00 8.04 9/186 3055
/proc/meminfo: memFree=24770280/32951124 swapFree=67110188/67111528
[pid=3042] ppid=3040 vsize=5119172 CPUtime=646.21 cores=0,2,4,6
/proc/3042/stat : 3042 (ttsth-5-4) S 3040 3042 2052 0 -1 4202496 1230419 0 0 0 64383 238 0 0 25 0 5 0 522116757 5242032128 1230328 33554432000 4194304 4338100 140736187566016 18446744073709551615 222933579749 0 0 4096 0 18446744073709551615 0 0 17 2 0 0 0
/proc/3042/statm: 1279793 1230328 176 36 0 1277698 0
[pid=3042/tid=3048] ppid=3040 vsize=5119172 CPUtime=161.59 cores=0,2,4,6
/proc/3042/task/3048/stat : 3048 (ttsth-5-4) R 3040 3042 2052 0 -1 4202560 326219 0 0 0 16087 72 0 0 25 0 5 0 522116825 5242032128 1230328 33554432000 4194304 4338100 140736187566016 18446744073709551615 4254388 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=3042/tid=3049] ppid=3040 vsize=5119172 CPUtime=160.85 cores=0,2,4,6
/proc/3042/task/3049/stat : 3049 (ttsth-5-4) R 3040 3042 2052 0 -1 4202560 289292 0 0 0 16030 55 0 0 25 0 5 0 522116825 5242032128 1230328 33554432000 4194304 4338100 140736187566016 18446744073709551615 4254329 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=3042/tid=3050] ppid=3040 vsize=5119172 CPUtime=161.47 cores=0,2,4,6
/proc/3042/task/3050/stat : 3050 (ttsth-5-4) R 3040 3042 2052 0 -1 4202560 310393 0 0 0 16096 51 0 0 25 0 5 0 522116825 5242032128 1230328 33554432000 4194304 4338100 140736187566016 18446744073709551615 222921172198 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=3042/tid=3051] ppid=3040 vsize=5119172 CPUtime=161.6 cores=0,2,4,6
/proc/3042/task/3051/stat : 3051 (ttsth-5-4) R 3040 3042 2052 0 -1 4202560 288433 0 0 0 16103 57 0 0 25 0 5 0 522116825 5242032128 1230328 33554432000 4194304 4338100 140736187566016 18446744073709551615 4254388 0 0 4096 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 646.21
Current children cumulated vsize (KiB) 5119172

[startup+222.301 s]
/proc/loadavg: 8.19 8.04 8.05 9/186 3057
/proc/meminfo: memFree=22789820/32951124 swapFree=67110188/67111528
[pid=3042] ppid=3040 vsize=6893804 CPUtime=885.9 cores=0,2,4,6
/proc/3042/stat : 3042 (ttsth-5-4) S 3040 3042 2052 0 -1 4202496 1678046 0 0 0 88279 311 0 0 25 0 5 0 522116757 7059255296 1677955 33554432000 4194304 4338100 140736187566016 18446744073709551615 222933579749 0 0 4096 0 18446744073709551615 0 0 17 2 0 0 0
/proc/3042/statm: 1723451 1677955 176 36 0 1721356 0
[pid=3042/tid=3048] ppid=3040 vsize=6893804 CPUtime=221.57 cores=0,2,4,6
/proc/3042/task/3048/stat : 3048 (ttsth-5-4) R 3040 3042 2052 0 -1 4202560 439588 0 0 0 22060 97 0 0 25 0 5 0 522116825 7059255296 1677955 33554432000 4194304 4338100 140736187566016 18446744073709551615 4254388 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=3042/tid=3049] ppid=3040 vsize=6893804 CPUtime=220.56 cores=0,2,4,6
/proc/3042/task/3049/stat : 3049 (ttsth-5-4) R 3040 3042 2052 0 -1 4202560 427772 0 0 0 21982 74 0 0 25 0 5 0 522116825 7059255296 1677955 33554432000 4194304 4338100 140736187566016 18446744073709551615 4241581 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=3042/tid=3050] ppid=3040 vsize=6893804 CPUtime=221.46 cores=0,2,4,6
/proc/3042/task/3050/stat : 3050 (ttsth-5-4) R 3040 3042 2052 0 -1 4202560 410034 0 0 0 22081 65 0 0 25 0 5 0 522116825 7059255296 1677955 33554432000 4194304 4338100 140736187566016 18446744073709551615 222921172198 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=3042/tid=3051] ppid=3040 vsize=6893804 CPUtime=221.59 cores=0,2,4,6
/proc/3042/task/3051/stat : 3051 (ttsth-5-4) R 3040 3042 2052 0 -1 4202560 384570 0 0 0 22087 72 0 0 25 0 5 0 522116825 7059255296 1677955 33554432000 4194304 4338100 140736187566016 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 885.9
Current children cumulated vsize (KiB) 6893804

[startup+282.301 s]
/proc/loadavg: 8.13 8.05 8.05 9/186 3058
/proc/meminfo: memFree=20998848/32951124 swapFree=67110188/67111528
[pid=3042] ppid=3040 vsize=8494592 CPUtime=1125.6 cores=0,2,4,6
/proc/3042/stat : 3042 (ttsth-5-4) S 3040 3042 2052 0 -1 4202496 2082503 0 0 0 112185 375 0 0 25 0 5 0 522116757 8698462208 2082412 33554432000 4194304 4338100 140736187566016 18446744073709551615 222933579749 0 0 4096 0 18446744073709551615 0 0 17 2 0 0 0
/proc/3042/statm: 2123648 2082412 176 36 0 2121553 0
[pid=3042/tid=3048] ppid=3040 vsize=8494592 CPUtime=281.38 cores=0,2,4,6
/proc/3042/task/3048/stat : 3048 (ttsth-5-4) R 3040 3042 2052 0 -1 4202560 511300 0 0 0 28025 113 0 0 25 0 5 0 522116825 8698462208 2082412 33554432000 4194304 4338100 140736187566016 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=3042/tid=3049] ppid=3040 vsize=8494592 CPUtime=280.47 cores=0,2,4,6
/proc/3042/task/3049/stat : 3049 (ttsth-5-4) R 3040 3042 2052 0 -1 4202560 536309 0 0 0 27957 90 0 0 25 0 5 0 522116825 8698462208 2082412 33554432000 4194304 4338100 140736187566016 18446744073709551615 222921172384 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=3042/tid=3050] ppid=3040 vsize=8494592 CPUtime=281.44 cores=0,2,4,6
/proc/3042/task/3050/stat : 3050 (ttsth-5-4) R 3040 3042 2052 0 -1 4202560 540435 0 0 0 28063 81 0 0 25 0 5 0 522116825 8698462208 2082412 33554432000 4194304 4338100 140736187566016 18446744073709551615 222921473696 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=3042/tid=3051] ppid=3040 vsize=8494592 CPUtime=281.59 cores=0,2,4,6
/proc/3042/task/3051/stat : 3051 (ttsth-5-4) R 3040 3042 2052 0 -1 4202560 478377 0 0 0 28071 88 0 0 25 0 5 0 522116825 8698462208 2082412 33554432000 4194304 4338100 140736187566016 18446744073709551615 4240513 0 0 4096 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1125.6
Current children cumulated vsize (KiB) 8494592

[startup+342.301 s]
/proc/loadavg: 8.05 8.04 8.04 9/186 3060
/proc/meminfo: memFree=18931608/32951124 swapFree=67110188/67111528
[pid=3042] ppid=3040 vsize=10369252 CPUtime=1365.28 cores=0,2,4,6
/proc/3042/stat : 3042 (ttsth-5-4) S 3040 3042 2052 0 -1 4202496 2553271 0 0 0 136082 446 0 0 25 0 5 0 522116757 10618114048 2553180 33554432000 4194304 4338100 140736187566016 18446744073709551615 222933579749 0 0 4096 0 18446744073709551615 0 0 17 2 0 0 0
/proc/3042/statm: 2592313 2553181 176 36 0 2590218 0
[pid=3042/tid=3048] ppid=3040 vsize=10369252 CPUtime=341.37 cores=0,2,4,6
/proc/3042/task/3048/stat : 3048 (ttsth-5-4) R 3040 3042 2052 0 -1 4202560 626337 0 0 0 34004 133 0 0 25 0 5 0 522116825 10618114048 2553181 33554432000 4194304 4338100 140736187566016 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=3042/tid=3049] ppid=3040 vsize=10369252 CPUtime=340.38 cores=0,2,4,6
/proc/3042/task/3049/stat : 3049 (ttsth-5-4) R 3040 3042 2052 0 -1 4202560 704086 0 0 0 33925 113 0 0 25 0 5 0 522116825 10618114048 2553181 33554432000 4194304 4338100 140736187566016 18446744073709551615 4234407 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=3042/tid=3050] ppid=3040 vsize=10369252 CPUtime=341.23 cores=0,2,4,6
/proc/3042/task/3050/stat : 3050 (ttsth-5-4) R 3040 3042 2052 0 -1 4202560 638148 0 0 0 34028 95 0 0 25 0 5 0 522116825 10618114048 2553181 33554432000 4194304 4338100 140736187566016 18446744073709551615 222921171984 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=3042/tid=3051] ppid=3040 vsize=10369252 CPUtime=341.59 cores=0,2,4,6
/proc/3042/task/3051/stat : 3051 (ttsth-5-4) R 3040 3042 2052 0 -1 4202560 568619 0 0 0 34057 102 0 0 25 0 5 0 522116825 10618114048 2553181 33554432000 4194304 4338100 140736187566016 18446744073709551615 4254289 0 0 4096 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1365.28
Current children cumulated vsize (KiB) 10369252

[startup+402.301 s]
/proc/loadavg: 8.15 8.06 8.05 9/186 3061
/proc/meminfo: memFree=17326488/32951124 swapFree=67110188/67111528
[pid=3042] ppid=3040 vsize=11877028 CPUtime=1604.96 cores=0,2,4,6
/proc/3042/stat : 3042 (ttsth-5-4) S 3040 3042 2052 0 -1 4202496 2934120 0 0 0 159990 506 0 0 25 0 5 0 522116757 12162076672 2934029 33554432000 4194304 4338100 140736187566016 18446744073709551615 222933579749 0 0 4096 0 18446744073709551615 0 0 17 2 0 0 0
/proc/3042/statm: 2969257 2934029 176 36 0 2967162 0
[pid=3042/tid=3048] ppid=3040 vsize=11877028 CPUtime=401.36 cores=0,2,4,6
/proc/3042/task/3048/stat : 3048 (ttsth-5-4) R 3040 3042 2052 0 -1 4202560 725230 0 0 0 39986 150 0 0 25 0 5 0 522116825 12162076672 2934029 33554432000 4194304 4338100 140736187566016 18446744073709551615 4254388 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=3042/tid=3049] ppid=3040 vsize=11877028 CPUtime=400.37 cores=0,2,4,6
/proc/3042/task/3049/stat : 3049 (ttsth-5-4) R 3040 3042 2052 0 -1 4202560 776322 0 0 0 39911 126 0 0 25 0 5 0 522116825 12162076672 2934029 33554432000 4194304 4338100 140736187566016 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=3042/tid=3050] ppid=3040 vsize=11877028 CPUtime=400.97 cores=0,2,4,6
/proc/3042/task/3050/stat : 3050 (ttsth-5-4) R 3040 3042 2052 0 -1 4202560 758304 0 0 0 39985 112 0 0 25 0 5 0 522116825 12162076672 2934029 33554432000 4194304 4338100 140736187566016 18446744073709551615 4254388 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=3042/tid=3051] ppid=3040 vsize=11877028 CPUtime=401.55 cores=0,2,4,6
/proc/3042/task/3051/stat : 3051 (ttsth-5-4) R 3040 3042 2052 0 -1 4202560 658182 0 0 0 40040 115 0 0 25 0 5 0 522116825 12162076672 2934029 33554432000 4194304 4338100 140736187566016 18446744073709551615 222921172198 0 0 4096 0 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 1604.96
Current children cumulated vsize (KiB) 11877028

[startup+462.301 s]
/proc/loadavg: 8.17 8.08 8.05 9/186 3063
/proc/meminfo: memFree=15823304/32951124 swapFree=67110188/67111528
[pid=3042] ppid=3040 vsize=13285940 CPUtime=1844.63 cores=0,2,4,6
/proc/3042/stat : 3042 (ttsth-5-4) S 3040 3042 2052 0 -1 4202496 3284713 0 0 0 183897 566 0 0 25 0 5 0 522116757 13604802560 3284622 33554432000 4194304 4338100 140736187566016 18446744073709551615 222933579749 0 0 4096 0 18446744073709551615 0 0 17 2 0 0 0
/proc/3042/statm: 3321485 3284622 176 36 0 3319390 0
[pid=3042/tid=3048] ppid=3040 vsize=13285940 CPUtime=461.35 cores=0,2,4,6
/proc/3042/task/3048/stat : 3048 (ttsth-5-4) R 3040 3042 2052 0 -1 4202560 820924 0 0 0 45967 168 0 0 25 0 5 0 522116825 13604802560 3284622 33554432000 4194304 4338100 140736187566016 18446744073709551615 4234407 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=3042/tid=3049] ppid=3040 vsize=13285940 CPUtime=460.28 cores=0,2,4,6
/proc/3042/task/3049/stat : 3049 (ttsth-5-4) R 3040 3042 2052 0 -1 4202560 831266 0 0 0 45892 136 0 0 25 0 5 0 522116825 13604802560 3284622 33554432000 4194304 4338100 140736187566016 18446744073709551615 4230389 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=3042/tid=3050] ppid=3040 vsize=13285940 CPUtime=460.97 cores=0,2,4,6
/proc/3042/task/3050/stat : 3050 (ttsth-5-4) R 3040 3042 2052 0 -1 4202560 871915 0 0 0 45966 131 0 0 25 0 5 0 522116825 13604802560 3284623 33554432000 4194304 4338100 140736187566016 18446744073709551615 222921473562 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=3042/tid=3051] ppid=3040 vsize=13285940 CPUtime=461.31 cores=0,2,4,6
/proc/3042/task/3051/stat : 3051 (ttsth-5-4) R 3040 3042 2052 0 -1 4202560 744526 0 0 0 46004 127 0 0 25 0 5 0 522116825 13604802560 3284623 33554432000 4194304 4338100 140736187566016 18446744073709551615 4254326 0 0 4096 0 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 1844.63
Current children cumulated vsize (KiB) 13285940

[startup+522.301 s]
/proc/loadavg: 8.12 8.08 8.05 9/186 3065
/proc/meminfo: memFree=14289840/32951124 swapFree=67110188/67111528
[pid=3042] ppid=3040 vsize=14730100 CPUtime=2084.28 cores=0,2,4,6
/proc/3042/stat : 3042 (ttsth-5-4) S 3040 3042 2052 0 -1 4202496 3649658 0 0 0 207801 627 0 0 25 0 5 0 522116757 15083622400 3649567 33554432000 4194304 4338100 140736187566016 18446744073709551615 222933579749 0 0 4096 0 18446744073709551615 0 0 17 2 0 0 0
/proc/3042/statm: 3682525 3649569 176 36 0 3680430 0
[pid=3042/tid=3048] ppid=3040 vsize=14730100 CPUtime=521.31 cores=0,2,4,6
/proc/3042/task/3048/stat : 3048 (ttsth-5-4) R 3040 3042 2052 0 -1 4202560 945083 0 0 0 51942 189 0 0 25 0 5 0 522116825 15083622400 3649569 33554432000 4194304 4338100 140736187566016 18446744073709551615 4234407 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=3042/tid=3049] ppid=3040 vsize=14730100 CPUtime=519.99 cores=0,2,4,6
/proc/3042/task/3049/stat : 3049 (ttsth-5-4) R 3040 3042 2052 0 -1 4202560 902049 0 0 0 51851 148 0 0 25 0 5 0 522116825 15083622400 3649569 33554432000 4194304 4338100 140736187566016 18446744073709551615 222921473536 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=3042/tid=3050] ppid=3040 vsize=14730100 CPUtime=520.97 cores=0,2,4,6
/proc/3042/task/3050/stat : 3050 (ttsth-5-4) R 3040 3042 2052 0 -1 4202560 972513 0 0 0 51950 147 0 0 25 0 5 0 522116825 15083622400 3649569 33554432000 4194304 4338100 140736187566016 18446744073709551615 4254437 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=3042/tid=3051] ppid=3040 vsize=14730100 CPUtime=521.29 cores=0,2,4,6
/proc/3042/task/3051/stat : 3051 (ttsth-5-4) R 3040 3042 2052 0 -1 4202560 813933 0 0 0 51990 139 0 0 25 0 5 0 522116825 15083622400 3649569 33554432000 4194304 4338100 140736187566016 18446744073709551615 4234407 0 0 4096 0 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 2084.28
Current children cumulated vsize (KiB) 14730100



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+577.401 s]
/proc/loadavg: 8.17 8.09 8.06 9/186 3066
/proc/meminfo: memFree=12981788/32951124 swapFree=67110188/67111528
[pid=3042] ppid=3040 vsize=15877100 CPUtime=2304.37 cores=0,2,4,6
/proc/3042/stat : 3042 (ttsth-5-4) S 3040 3042 2052 0 -1 4202496 3939549 0 0 0 229754 683 0 0 25 0 5 0 522116757 16258150400 3939458 33554432000 4194304 4338100 140736187566016 18446744073709551615 222933579749 0 0 4096 0 18446744073709551615 0 0 17 2 0 0 0
/proc/3042/statm: 3969275 3939458 176 36 0 3967180 0
[pid=3042/tid=3048] ppid=3040 vsize=15877100 CPUtime=576.41 cores=0,2,4,6
/proc/3042/task/3048/stat : 3048 (ttsth-5-4) R 3040 3042 2052 0 -1 4202560 1031574 0 0 0 57431 210 0 0 25 0 5 0 522116825 16258150400 3939458 33554432000 4194304 4338100 140736187566016 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=3042/tid=3049] ppid=3040 vsize=15877100 CPUtime=574.8 cores=0,2,4,6
/proc/3042/task/3049/stat : 3049 (ttsth-5-4) R 3040 3042 2052 0 -1 4202560 964415 0 0 0 57320 160 0 0 25 0 5 0 522116825 16258150400 3939458 33554432000 4194304 4338100 140736187566016 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=3042/tid=3050] ppid=3040 vsize=15877100 CPUtime=576.06 cores=0,2,4,6
/proc/3042/task/3050/stat : 3050 (ttsth-5-4) R 3040 3042 2052 0 -1 4202560 1044832 0 0 0 57447 159 0 0 25 0 5 0 522116825 16258150400 3939458 33554432000 4194304 4338100 140736187566016 18446744073709551615 4254221 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=3042/tid=3051] ppid=3040 vsize=15877100 CPUtime=576.4 cores=0,2,4,6
/proc/3042/task/3051/stat : 3051 (ttsth-5-4) R 3040 3042 2052 0 -1 4202560 882646 0 0 0 57489 151 0 0 25 0 5 0 522116825 16258150400 3939458 33554432000 4194304 4338100 140736187566016 18446744073709551615 222933589766 0 0 4096 0 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 2304.37
Current children cumulated vsize (KiB) 15877100

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+577.801 s]
/proc/loadavg: 8.17 8.09 8.06 9/186 3066
/proc/meminfo: memFree=12981788/32951124 swapFree=67110188/67111528
[pid=3042] ppid=3040 vsize=0 CPUtime=2304.78 cores=0,2,4,6
/proc/3042/stat : 3042 (ttsth-5-4) Z 3040 3042 2052 0 -1 4203548 3939562 0 0 0 229757 721 0 0 18 0 2 0 522116757 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 2 0 0 0
/proc/3042/statm: 0 0 0 0 0 0 0
[pid=3042/tid=3051] ppid=3040 vsize=0 CPUtime=576.78 cores=0,2,4,6
/proc/3042/task/3051/stat : 3051 (ttsth-5-4) R 3040 3042 2052 0 -1 4203588 882646 0 0 0 57489 189 0 0 25 0 2 0 522116825 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2304.78
Current children cumulated vsize (KiB) 0

[startup+578.001 s]
/proc/loadavg: 8.17 8.09 8.06 9/186 3066
/proc/meminfo: memFree=12981788/32951124 swapFree=67110188/67111528
[pid=3042] ppid=3040 vsize=0 CPUtime=2304.98 cores=0,2,4,6
/proc/3042/stat : 3042 (ttsth-5-4) Z 3040 3042 2052 0 -1 4203548 3939562 0 0 0 229757 741 0 0 18 0 2 0 522116757 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 2 0 0 0
/proc/3042/statm: 0 0 0 0 0 0 0
[pid=3042/tid=3051] ppid=3040 vsize=0 CPUtime=576.98 cores=0,2,4,6
/proc/3042/task/3051/stat : 3051 (ttsth-5-4) R 3040 3042 2052 0 -1 4203588 882646 0 0 0 57489 209 0 0 25 0 2 0 522116825 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2304.98
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 578.024
CPU time (s): 2305.01
CPU user time (s): 2297.57
CPU system time (s): 7.43787
CPU usage (%): 398.774
Max. virtual memory (cumulated for all children) (KiB): 15877100

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2297.57
system time used= 7.43787
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3939562
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 9651
involuntary context switches= 11330

runsolver used 0.792879 second user time and 1.93571 second system time

The end

Launcher Data 

Begin job on node109 at 2011-04-29 21:26:00
IDJOB=3266446
IDBENCH=87734
IDSOLVER=1654
FILE ID=node109/3266446-1304105160
RUNJOBID= node109-1304105160-3021
PBS_JOBID= 13170607
Free space on /tmp= 72384 MiB

SOLVER NAME= ttsth 5-4
BENCH NAME= SAT02/handmade/simon/satex-challenges/c6288.shuffled.cnf
COMMAND LINE= DIR/ttsth-5-4 -num-threads NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3266446-1304105160/watcher-3266446-1304105160 -o /tmp/evaluation-result-3266446-1304105160/solver-3266446-1304105160 -C 4800 -W 1300 -M 15500  HOME/ttsth-5-4 -num-threads 4 HOME/instance-3266446-1304105160.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 75bd8319132b47c2d2e6f0889735a248
RANDOM SEED=1218511254

node109.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      30773764 kB
Buffers:        733024 kB
Cached:         991140 kB
SwapCached:        712 kB
Active:         136188 kB
Inactive:      1653220 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      30773764 kB
SwapTotal:    67111528 kB
SwapFree:     67110188 kB
Dirty:             492 kB
Writeback:           0 kB
AnonPages:       64068 kB
Mapped:          14784 kB
Slab:           324864 kB
PageTables:       4900 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   209568 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72384 MiB
End job on node109 at 2011-04-29 21:35:40