Trace number 3261122

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ttsth 5-4? (TO) 4800.23 1203.07

General information on the benchmark

Namecrafted/skvortsov/battleship/
battleship-10-10-unsat.cnf
MD5SUM5ad28aa134f570fa0399980e14c0e5d4
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark0.487925
Satisfiable
(Un)Satisfiability was proved
Number of variables100
Number of clauses550
Sum of the clauses size1900
Maximum clause length10
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 2450
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 5100

Solver Data 

0.00/0.00	c Command: HOME/ttsth-5-4 -num-threads 4 HOME/instance-3261122-1304087588.cnf 
0.00/0.00	c Using SATTIMEOUT of 4800
0.00/0.00	c Using SATRAM of 15500
0.00/0.00	c Size of subset node = 32
0.00/0.00	c Variables = 100
0.00/0.00	c Clauses = 550
0.00/0.00	c Literals = 1900
0.00/0.00	c Reduced size:
0.00/0.00	c Variables = 100
0.00/0.00	c Clauses = 550
0.00/0.00	c Literals = 1900
0.00/0.00	c a2
0.00/0.00	c a1
0.79/0.88	c Independent sub-problems = 1
0.79/0.88	c Sub-problem with 100 variables and 550 clauses
0.79/0.88	c using permutation method 4
0.79/0.88	c count = 3
0.79/0.88	c Ordering finished 0.880 seconds
0.79/0.88	c mapped 0.880 seconds
0.79/0.88	c permuted 0.880 seconds
0.79/0.88	c about to sort
0.79/0.88	c sorted
0.79/0.88	c clauses now 550
0.79/0.88	c init finished 0.880 seconds
0.79/0.88	c tree built 0.880 seconds
0.79/0.88	c 
0.79/0.88	c PA progress                      | CPU progress Partial assignments | improvements                 ucps  CPU time       PA/sec  nodes
0.79/0.88	c ---------------------------------|----------------------------------|--------------------------------------------------------------------
0.79/0.88	c ................................ | ..........                    |                                  0.9         0.0             
0.79/0.88	c ................................ | ..........                  1 |                                  0.9         1.1             
0.79/0.88	c ................................ | ..........                  2 |                                  0.9         2.3             
0.79/0.88	c ................................ | ..........                  3 |                                  0.9         3.4             
0.79/0.88	c ................................ | ..........                  4 |                                  0.9         4.5             
0.79/0.88	c ................................ | ..........                  5 |                                  0.9         5.7             
0.79/0.89	c ................................ | ..........               1000 | 255          100                 0.9      1123.6        10761
95.98/24.78	c ................................ | ..........             198000 | 64890        2444               96.3      2055.4     11775712
191.84/48.78	c ................................ | ..........             289000 | 94895        2730              192.2      1503.8     17336451
288.05/72.80	c ................................ | ..........             352000 | 115285       2845              288.1      1221.8     19678229
385.02/97.15	c ................................ | ..........             408000 | 133480       5183              385.2      1059.1     25448528
480.47/121.06	c ................................ | *.........             447000 | 146121       6438              480.7       929.9     32075374
577.84/145.46	c ................................ | *.........             481000 | 157027       7165              578.1       832.0     35095412
672.47/169.20	c ................................ | *.........             519000 | 169499       7178              672.9       771.3     35095412
768.68/193.27	c ................................ | *.........             553000 | 180485       7178              769.0       719.1     35095412
865.73/217.52	c ................................ | *.........             588000 | 192119       7178              865.8       679.1     35095412
960.33/241.28	c ................................ | **........             645000 | 210950       7178              960.7       671.4     35095412
1056.43/265.37	c ................................ | **........             793000 | 260523       7259             1056.7       750.4     35095412
1151.85/289.29	c ................................ | **........             903000 | 297469       7300             1152.2       783.7     35338534
1247.96/313.33	c ................................ | **........            1017000 | 336032       7337             1248.1       814.8     35496301
1344.55/337.50	c ................................ | **........            1111000 | 367841       7380             1344.5       826.3     36359493
1440.75/361.68	c ................................ | ***.......            1193000 | 395485       7380             1441.1       827.9     37170077
1536.55/385.66	c ................................ | ***.......            1278000 | 424558       7386             1536.8       831.6     37979748
1633.49/409.96	c ................................ | ***.......            1362000 | 453520       7386             1633.7       833.7     38193527
1729.72/434.04	c ................................ | ***.......            1392000 | 463262       7395             1729.9       804.7     38193527
1826.76/458.32	c ................................ | ***.......            1425000 | 474114       7395             1826.9       780.0     38199716
1921.39/482.03	c ................................ | ****......            1454000 | 483653       7395             1921.5       756.7     38294369
2016.04/505.70	c ................................ | ****......            1485000 | 493646       7395             2016.0       736.6     38452981
2111.86/529.78	c ................................ | ****......            1516000 | 503762       7395             2112.2       717.7     38452981
2211.28/554.62	c ................................ | ****......            1547000 | 513594       7395             2211.4       699.6     38508703
2306.33/578.46	c ................................ | ****......            1577000 | 523051       7395             2306.6       683.7     38603209
2401.76/602.30	c ................................ | *****.....            1608000 | 533025       7404             2401.8       669.5     38698598
2498.42/626.52	c ................................ | *****.....            1635000 | 541695       7404             2498.5       654.4     38783142
2592.68/650.14	c ................................ | *****.....            1663000 | 550662       7404             2592.8       641.4     38873882
2689.31/674.36	c ................................ | *****.....            1693000 | 560523       7404             2689.5       629.5     38966476
2785.96/698.53	c ................................ | *****.....            1721000 | 569653       7404             2786.1       617.7     39186768
2882.60/722.77	c ................................ | ******....            1748000 | 578209       7404             2882.9       606.3     39441189
2976.03/746.13	c ................................ | ******....            1776000 | 587381       7404             2976.2       596.7     39714549
3073.08/770.41	c ................................ | ******....            1805000 | 596804       7411             3073.1       587.3     39982596
3168.14/794.25	c ................................ | ******....            1834000 | 606275       7428             3168.3       578.9     40307154
3263.91/818.25	c ................................ | ******....            1962000 | 648753       7450             3264.1       601.1     41939584
3359.98/842.33	c ................................ | *******...            2046000 | 676475       7480             3360.1       608.9     42812586
3456.17/866.40	c ................................ | *******...            2133000 | 705546       7506             3456.2       617.2     42812586
3553.09/890.70	c ................................ | *******...            2224000 | 735852       7506             3553.1       625.9     43024029
3648.90/914.72	c ................................ | *******...            2300000 | 761144       7506             3649.0       630.3     43381606
3744.30/938.65	c ................................ | *******...            2372000 | 784988       7513             3744.5       633.5     43853559
3840.49/962.79	c ................................ | ********..            2456000 | 813350       7548             3840.9       639.4     44217908
3937.10/986.96	c ................................ | ********..            2514000 | 832847       7553             3937.4       638.5     44390715
4032.99/1010.95	c ................................ | ********..            2535000 | 839500       7553             4033.2       628.5     44554671
4129.96/1035.27	c ................................ | ********..            2561000 | 847919       7553             4130.2       620.1     44609659
4227.41/1059.65	c ................................ | ********..            2586000 | 856124       7553             4227.6       611.7     44609659
4320.46/1082.92	c ................................ | *********.            2609000 | 863502       7553             4320.6       603.9     44609659
4417.53/1107.25	c ................................ | *********.            2631000 | 870435       7553             4417.7       595.6     44609659
4512.56/1131.02	c ................................ | *********.            2657000 | 878902       7569             4512.7       588.8     44644672
4610.41/1155.53	c ................................ | *********.            2682000 | 887033       7574             4610.5       581.7     44654181
4706.65/1179.62	c ................................ | *********.            2706000 | 894671       7574             4706.7       574.9     44654181

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3261122-1304087588/watcher-3261122-1304087588 -o /tmp/evaluation-result-3261122-1304087588/solver-3261122-1304087588 -C 4800 -W 1300 -M 15500 HOME/ttsth-5-4 -num-threads 4 HOME/instance-3261122-1304087588.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 6.37 7.73 7.91 3/173 24216
/proc/meminfo: memFree=25320796/32951124 swapFree=67051468/67111528
[pid=24216] ppid=24213 vsize=8972 CPUtime=0 cores=0,2,4,6
/proc/24216/stat : 24216 (ttsth-5-4) R 24213 24216 24182 0 -1 4202496 314 0 0 0 0 0 0 0 25 0 1 0 520361577 9187328 256 33554432000 4194304 4338100 140736791791264 18446744073709551615 4295924 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/24216/statm: 2243 256 151 36 0 148 0

[startup+0.065314 s]
/proc/loadavg: 6.37 7.73 7.91 3/173 24216
/proc/meminfo: memFree=25320796/32951124 swapFree=67051468/67111528
[pid=24216] ppid=24213 vsize=8972 CPUtime=0.06 cores=0,2,4,6
/proc/24216/stat : 24216 (ttsth-5-4) R 24213 24216 24182 0 -1 4202496 315 0 0 0 6 0 0 0 25 0 1 0 520361577 9187328 257 33554432000 4194304 4338100 140736791791264 18446744073709551615 4296000 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/24216/statm: 2243 257 152 36 0 148 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 8972

[startup+0.100325 s]
/proc/loadavg: 6.37 7.73 7.91 3/173 24216
/proc/meminfo: memFree=25320796/32951124 swapFree=67051468/67111528
[pid=24216] ppid=24213 vsize=8972 CPUtime=0.09 cores=0,2,4,6
/proc/24216/stat : 24216 (ttsth-5-4) R 24213 24216 24182 0 -1 4202496 315 0 0 0 9 0 0 0 25 0 1 0 520361577 9187328 257 33554432000 4194304 4338100 140736791791264 18446744073709551615 4296000 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/24216/statm: 2243 257 152 36 0 148 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 8972

[startup+0.300253 s]
/proc/loadavg: 6.37 7.73 7.91 3/173 24216
/proc/meminfo: memFree=25320796/32951124 swapFree=67051468/67111528
[pid=24216] ppid=24213 vsize=8972 CPUtime=0.29 cores=0,2,4,6
/proc/24216/stat : 24216 (ttsth-5-4) R 24213 24216 24182 0 -1 4202496 315 0 0 0 29 0 0 0 25 0 1 0 520361577 9187328 257 33554432000 4194304 4338100 140736791791264 18446744073709551615 4296000 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/24216/statm: 2243 257 152 36 0 148 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 8972

[startup+0.700144 s]
/proc/loadavg: 6.37 7.73 7.91 3/173 24216
/proc/meminfo: memFree=25320796/32951124 swapFree=67051468/67111528
[pid=24216] ppid=24213 vsize=8972 CPUtime=0.69 cores=0,2,4,6
/proc/24216/stat : 24216 (ttsth-5-4) R 24213 24216 24182 0 -1 4202496 315 0 0 0 69 0 0 0 25 0 1 0 520361577 9187328 257 33554432000 4194304 4338100 140736791791264 18446744073709551615 4296083 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/24216/statm: 2243 257 152 36 0 148 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 8972

[startup+1.50097 s]
/proc/loadavg: 6.37 7.73 7.91 9/186 24229
/proc/meminfo: memFree=25285792/32951124 swapFree=67051468/67111528
[pid=24216] ppid=24213 vsize=229508 CPUtime=3.31 cores=0,2,4,6
/proc/24216/stat : 24216 (ttsth-5-4) S 24213 24216 24182 0 -1 4202496 10881 0 0 0 329 2 0 0 25 0 5 0 520361577 235016192 10823 33554432000 4194304 4338100 140736791791264 18446744073709551615 218382759909 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/24216/statm: 57377 10823 173 36 0 55282 0
[pid=24216/tid=24226] ppid=24213 vsize=229508 CPUtime=0.6 cores=0,2,4,6
/proc/24216/task/24226/stat : 24226 (ttsth-5-4) R 24213 24216 24182 0 -1 4202560 2460 0 0 0 60 0 0 0 18 0 5 0 520361666 235016192 10824 33554432000 4194304 4338100 140736791791264 18446744073709551615 4254404 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=24216/tid=24227] ppid=24213 vsize=229508 CPUtime=0.6 cores=0,2,4,6
/proc/24216/task/24227/stat : 24227 (ttsth-5-4) R 24213 24216 24182 0 -1 4202560 2004 0 0 0 60 0 0 0 18 0 5 0 520361666 235016192 10826 33554432000 4194304 4338100 140736791791264 18446744073709551615 4234407 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=24216/tid=24228] ppid=24213 vsize=229508 CPUtime=0.6 cores=0,2,4,6
/proc/24216/task/24228/stat : 24228 (ttsth-5-4) R 24213 24216 24182 0 -1 4202560 3930 0 0 0 60 0 0 0 25 0 5 0 520361666 235016192 10826 33554432000 4194304 4338100 140736791791264 18446744073709551615 4234407 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=24216/tid=24229] ppid=24213 vsize=229508 CPUtime=0.59 cores=0,2,4,6
/proc/24216/task/24229/stat : 24229 (ttsth-5-4) R 24213 24216 24182 0 -1 4202560 1839 0 0 0 59 0 0 0 25 0 5 0 520361666 235016192 10827 33554432000 4194304 4338100 140736791791264 18446744073709551615 4254437 0 0 4096 0 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3.31
Current children cumulated vsize (KiB) 229508

[startup+3.10068 s]
/proc/loadavg: 6.37 7.73 7.91 9/186 24229
/proc/meminfo: memFree=25212508/32951124 swapFree=67051468/67111528
[pid=24216] ppid=24213 vsize=285944 CPUtime=9.71 cores=0,2,4,6
/proc/24216/stat : 24216 (ttsth-5-4) S 24213 24216 24182 0 -1 4202496 24665 0 0 0 962 9 0 0 25 0 5 0 520361577 292806656 24607 33554432000 4194304 4338100 140736791791264 18446744073709551615 218382759909 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/24216/statm: 71486 24607 173 36 0 69391 0
[pid=24216/tid=24226] ppid=24213 vsize=285944 CPUtime=2.2 cores=0,2,4,6
/proc/24216/task/24226/stat : 24226 (ttsth-5-4) R 24213 24216 24182 0 -1 4202560 5131 0 0 0 220 0 0 0 21 0 5 0 520361666 292806656 24607 33554432000 4194304 4338100 140736791791264 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=24216/tid=24227] ppid=24213 vsize=285944 CPUtime=2.2 cores=0,2,4,6
/proc/24216/task/24227/stat : 24227 (ttsth-5-4) R 24213 24216 24182 0 -1 4202560 4923 0 0 0 217 3 0 0 21 0 5 0 520361666 292806656 24607 33554432000 4194304 4338100 140736791791264 18446744073709551615 4254294 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=24216/tid=24228] ppid=24213 vsize=285944 CPUtime=2.2 cores=0,2,4,6
/proc/24216/task/24228/stat : 24228 (ttsth-5-4) R 24213 24216 24182 0 -1 4202560 9230 0 0 0 219 1 0 0 25 0 5 0 520361666 292806656 24607 33554432000 4194304 4338100 140736791791264 18446744073709551615 4254315 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=24216/tid=24229] ppid=24213 vsize=285944 CPUtime=2.19 cores=0,2,4,6
/proc/24216/task/24229/stat : 24229 (ttsth-5-4) R 24213 24216 24182 0 -1 4202560 4730 0 0 0 216 3 0 0 25 0 5 0 520361666 292806656 24607 33554432000 4194304 4338100 140736791791264 18446744073709551615 4254388 0 0 4096 0 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 9.71
Current children cumulated vsize (KiB) 285944

[startup+6.30111 s]
/proc/loadavg: 6.50 7.73 7.91 9/186 24229
/proc/meminfo: memFree=25088640/32951124 swapFree=67051468/67111528
[pid=24216] ppid=24213 vsize=348504 CPUtime=22.49 cores=0,2,4,6
/proc/24216/stat : 24216 (ttsth-5-4) S 24213 24216 24182 0 -1 4202496 41153 0 0 0 2231 18 0 0 25 0 5 0 520361577 356868096 41095 33554432000 4194304 4338100 140736791791264 18446744073709551615 218382759909 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/24216/statm: 87126 41097 173 36 0 85031 0
[pid=24216/tid=24226] ppid=24213 vsize=348504 CPUtime=5.4 cores=0,2,4,6
/proc/24216/task/24226/stat : 24226 (ttsth-5-4) R 24213 24216 24182 0 -1 4202560 8048 0 0 0 539 1 0 0 25 0 5 0 520361666 356868096 41097 33554432000 4194304 4338100 140736791791264 18446744073709551615 4254404 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=24216/tid=24227] ppid=24213 vsize=348504 CPUtime=5.4 cores=0,2,4,6
/proc/24216/task/24227/stat : 24227 (ttsth-5-4) R 24213 24216 24182 0 -1 4202560 8512 0 0 0 533 7 0 0 25 0 5 0 520361666 356868096 41098 33554432000 4194304 4338100 140736791791264 18446744073709551615 4234407 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=24216/tid=24228] ppid=24213 vsize=348504 CPUtime=5.4 cores=0,2,4,6
/proc/24216/task/24228/stat : 24228 (ttsth-5-4) R 24213 24216 24182 0 -1 4202560 15628 0 0 0 538 2 0 0 25 0 5 0 520361666 356868096 41098 33554432000 4194304 4338100 140736791791264 18446744073709551615 4234407 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=24216/tid=24229] ppid=24213 vsize=348504 CPUtime=5.37 cores=0,2,4,6
/proc/24216/task/24229/stat : 24229 (ttsth-5-4) R 24213 24216 24182 0 -1 4202560 8317 0 0 0 530 7 0 0 25 0 5 0 520361666 356868096 41099 33554432000 4194304 4338100 140736791791264 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 22.49
Current children cumulated vsize (KiB) 348504

[startup+12.701 s]
/proc/loadavg: 6.62 7.74 7.91 9/186 24229
/proc/meminfo: memFree=24941864/32951124 swapFree=67051468/67111528
[pid=24216] ppid=24213 vsize=442344 CPUtime=48.05 cores=0,2,4,6
/proc/24216/stat : 24216 (ttsth-5-4) S 24213 24216 24182 0 -1 4202496 64376 0 0 0 4772 33 0 0 25 0 5 0 520361577 452960256 64318 33554432000 4194304 4338100 140736791791264 18446744073709551615 218382759909 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/24216/statm: 110586 64318 173 36 0 108491 0
[pid=24216/tid=24226] ppid=24213 vsize=442344 CPUtime=11.8 cores=0,2,4,6
/proc/24216/task/24226/stat : 24226 (ttsth-5-4) R 24213 24216 24182 0 -1 4202560 13022 0 0 0 1178 2 0 0 25 0 5 0 520361666 452960256 64318 33554432000 4194304 4338100 140736791791264 18446744073709551615 4254451 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=24216/tid=24227] ppid=24213 vsize=442344 CPUtime=11.79 cores=0,2,4,6
/proc/24216/task/24227/stat : 24227 (ttsth-5-4) R 24213 24216 24182 0 -1 4202560 13029 0 0 0 1166 13 0 0 25 0 5 0 520361666 452960256 64318 33554432000 4194304 4338100 140736791791264 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=24216/tid=24228] ppid=24213 vsize=442344 CPUtime=11.8 cores=0,2,4,6
/proc/24216/task/24228/stat : 24228 (ttsth-5-4) R 24213 24216 24182 0 -1 4202560 24929 0 0 0 1176 4 0 0 25 0 5 0 520361666 452960256 64318 33554432000 4194304 4338100 140736791791264 18446744073709551615 218370653696 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=24216/tid=24229] ppid=24213 vsize=442344 CPUtime=11.73 cores=0,2,4,6
/proc/24216/task/24229/stat : 24229 (ttsth-5-4) R 24213 24216 24182 0 -1 4202560 12745 0 0 0 1161 12 0 0 25 0 5 0 520361666 452960256 64318 33554432000 4194304 4338100 140736791791264 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 48.05
Current children cumulated vsize (KiB) 442344

[startup+25.5007 s]
/proc/loadavg: 6.93 7.75 7.91 9/186 24229
/proc/meminfo: memFree=24706012/32951124 swapFree=67051468/67111528
[pid=24216] ppid=24213 vsize=564740 CPUtime=99.17 cores=0,2,4,6
/proc/24216/stat : 24216 (ttsth-5-4) S 24213 24216 24182 0 -1 4202496 94789 0 0 0 9857 60 0 0 25 0 5 0 520361577 578293760 94723 33554432000 4194304 4338100 140736791791264 18446744073709551615 218382759909 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/24216/statm: 141185 94724 174 36 0 139090 0
[pid=24216/tid=24226] ppid=24213 vsize=564740 CPUtime=24.6 cores=0,2,4,6
/proc/24216/task/24226/stat : 24226 (ttsth-5-4) R 24213 24216 24182 0 -1 4202560 18775 0 0 0 2457 3 0 0 25 0 5 0 520361666 578293760 94724 33554432000 4194304 4338100 140736791791264 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=24216/tid=24227] ppid=24213 vsize=564740 CPUtime=24.6 cores=0,2,4,6
/proc/24216/task/24227/stat : 24227 (ttsth-5-4) R 24213 24216 24182 0 -1 4202560 19643 0 0 0 2435 25 0 0 25 0 5 0 520361666 578293760 94724 33554432000 4194304 4338100 140736791791264 18446744073709551615 4234407 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=24216/tid=24228] ppid=24213 vsize=564740 CPUtime=24.6 cores=0,2,4,6
/proc/24216/task/24228/stat : 24228 (ttsth-5-4) R 24213 24216 24182 0 -1 4202560 36580 0 0 0 2453 7 0 0 25 0 5 0 520361666 578293760 94724 33554432000 4194304 4338100 140736791791264 18446744073709551615 4254357 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=24216/tid=24229] ppid=24213 vsize=564740 CPUtime=24.46 cores=0,2,4,6
/proc/24216/task/24229/stat : 24229 (ttsth-5-4) R 24213 24216 24182 0 -1 4202560 19141 0 0 0 2422 24 0 0 25 0 5 0 520361666 578293760 94724 33554432000 4194304 4338100 140736791791264 18446744073709551615 218382783157 0 0 4096 0 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 99.17
Current children cumulated vsize (KiB) 564740

[startup+51.1011 s]
/proc/loadavg: 7.36 7.78 7.91 10/186 24230
/proc/meminfo: memFree=24366264/32951124 swapFree=67051468/67111528
[pid=24216] ppid=24213 vsize=743036 CPUtime=201.43 cores=0,2,4,6
/proc/24216/stat : 24216 (ttsth-5-4) S 24213 24216 24182 0 -1 4202496 140051 0 0 0 20046 97 0 0 25 0 5 0 520361577 760868864 139985 33554432000 4194304 4338100 140736791791264 18446744073709551615 218382759909 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/24216/statm: 185759 139985 174 36 0 183664 0
[pid=24216/tid=24226] ppid=24213 vsize=743036 CPUtime=50.18 cores=0,2,4,6
/proc/24216/task/24226/stat : 24226 (ttsth-5-4) R 24213 24216 24182 0 -1 4202560 28031 0 0 0 5013 5 0 0 25 0 5 0 520361666 760868864 139985 33554432000 4194304 4338100 140736791791264 18446744073709551615 4254239 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=24216/tid=24227] ppid=24213 vsize=743036 CPUtime=50.19 cores=0,2,4,6
/proc/24216/task/24227/stat : 24227 (ttsth-5-4) R 24213 24216 24182 0 -1 4202560 29402 0 0 0 4980 39 0 0 19 0 5 0 520361666 760868864 139985 33554432000 4194304 4338100 140736791791264 18446744073709551615 218382783157 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=24216/tid=24228] ppid=24213 vsize=743036 CPUtime=50.21 cores=0,2,4,6
/proc/24216/task/24228/stat : 24228 (ttsth-5-4) R 24213 24216 24182 0 -1 4202560 53162 0 0 0 5010 11 0 0 25 0 5 0 520361666 760868864 139985 33554432000 4194304 4338100 140736791791264 18446744073709551615 4254275 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=24216/tid=24229] ppid=24213 vsize=743036 CPUtime=49.93 cores=0,2,4,6
/proc/24216/task/24229/stat : 24229 (ttsth-5-4) R 24213 24216 24182 0 -1 4202560 28805 0 0 0 4952 41 0 0 25 0 5 0 520361666 760868864 139985 33554432000 4194304 4338100 140736791791264 18446744073709551615 4254315 0 0 4096 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 201.43
Current children cumulated vsize (KiB) 743036

[startup+102.307 s]
/proc/loadavg: 7.85 7.85 7.93 9/186 24231
/proc/meminfo: memFree=23878560/32951124 swapFree=67051468/67111528
[pid=24216] ppid=24213 vsize=1071464 CPUtime=405.82 cores=0,2,4,6
/proc/24216/stat : 24216 (ttsth-5-4) S 24213 24216 24182 0 -1 4202496 217909 0 0 0 40447 135 0 0 25 0 5 0 520361577 1097179136 217843 33554432000 4194304 4338100 140736791791264 18446744073709551615 218382759909 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/24216/statm: 267866 217843 175 36 0 265771 0
[pid=24216/tid=24226] ppid=24213 vsize=1071464 CPUtime=101.1 cores=0,2,4,6
/proc/24216/task/24226/stat : 24226 (ttsth-5-4) R 24213 24216 24182 0 -1 4202560 31789 0 0 0 10104 6 0 0 25 0 5 0 520361666 1097179136 217843 33554432000 4194304 4338100 140736791791264 18446744073709551615 4254311 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=24216/tid=24227] ppid=24213 vsize=1071464 CPUtime=101.3 cores=0,2,4,6
/proc/24216/task/24227/stat : 24227 (ttsth-5-4) R 24213 24216 24182 0 -1 4202560 47374 0 0 0 10084 46 0 0 19 0 5 0 520361666 1097179136 217843 33554432000 4194304 4338100 140736791791264 18446744073709551615 218382783157 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=24216/tid=24228] ppid=24213 vsize=1071464 CPUtime=101.4 cores=0,2,4,6
/proc/24216/task/24228/stat : 24228 (ttsth-5-4) R 24213 24216 24182 0 -1 4202560 93762 0 0 0 10120 20 0 0 25 0 5 0 520361666 1097179136 217843 33554432000 4194304 4338100 140736791791264 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=24216/tid=24229] ppid=24213 vsize=1071464 CPUtime=101.1 cores=0,2,4,6
/proc/24216/task/24229/stat : 24229 (ttsth-5-4) R 24213 24216 24182 0 -1 4202560 44333 0 0 0 10049 61 0 0 25 0 5 0 520361666 1097179136 217843 33554432000 4194304 4338100 140736791791264 18446744073709551615 218382783157 0 0 4096 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 405.82
Current children cumulated vsize (KiB) 1071464

[startup+162.3 s]
/proc/loadavg: 8.08 7.90 7.94 9/186 24233
/proc/meminfo: memFree=23404852/32951124 swapFree=67051468/67111528
[pid=24216] ppid=24213 vsize=1396624 CPUtime=645.31 cores=0,2,4,6
/proc/24216/stat : 24216 (ttsth-5-4) S 24213 24216 24182 0 -1 4202496 283305 0 0 0 64347 184 0 0 25 0 5 0 520361577 1430142976 283239 33554432000 4194304 4338100 140736791791264 18446744073709551615 218382759909 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/24216/statm: 349156 283239 175 36 0 347061 0
[pid=24216/tid=24226] ppid=24213 vsize=1396624 CPUtime=160.74 cores=0,2,4,6
/proc/24216/task/24226/stat : 24226 (ttsth-5-4) R 24213 24216 24182 0 -1 4202560 35914 0 0 0 16062 12 0 0 21 0 5 0 520361666 1430142976 283239 33554432000 4194304 4338100 140736791791264 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=24216/tid=24227] ppid=24213 vsize=1396624 CPUtime=161.21 cores=0,2,4,6
/proc/24216/task/24227/stat : 24227 (ttsth-5-4) R 24213 24216 24182 0 -1 4202560 66135 0 0 0 16063 58 0 0 25 0 5 0 520361666 1430142976 283239 33554432000 4194304 4338100 140736791791264 18446744073709551615 218382783157 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=24216/tid=24228] ppid=24213 vsize=1396624 CPUtime=161.35 cores=0,2,4,6
/proc/24216/task/24228/stat : 24228 (ttsth-5-4) R 24213 24216 24182 0 -1 4202560 118106 0 0 0 16107 28 0 0 25 0 5 0 520361666 1430142976 283239 33554432000 4194304 4338100 140736791791264 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=24216/tid=24229] ppid=24213 vsize=1396624 CPUtime=161.08 cores=0,2,4,6
/proc/24216/task/24229/stat : 24229 (ttsth-5-4) R 24213 24216 24182 0 -1 4202560 62499 0 0 0 16024 84 0 0 25 0 5 0 520361666 1430142976 283239 33554432000 4194304 4338100 140736791791264 18446744073709551615 4254388 0 0 4096 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 645.31
Current children cumulated vsize (KiB) 1396624


################
# More data... #
################

[pid=24216/tid=24227] ppid=24213 vsize=1542224 CPUtime=700.87 cores=0,2,4,6
/proc/24216/task/24227/stat : 24227 (ttsth-5-4) R 24213 24216 24182 0 -1 4202560 75401 0 0 0 69811 276 0 0 19 0 5 0 520361666 1579237376 317743 33554432000 4194304 4338100 140736791791264 18446744073709551615 4254259 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=24216/tid=24228] ppid=24213 vsize=1542224 CPUtime=698.69 cores=0,2,4,6
/proc/24216/task/24228/stat : 24228 (ttsth-5-4) R 24213 24216 24182 0 -1 4202560 125233 0 0 0 69624 245 0 0 25 0 5 0 520361666 1579237376 317743 33554432000 4194304 4338100 140736791791264 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=24216/tid=24229] ppid=24213 vsize=1542224 CPUtime=700.72 cores=0,2,4,6
/proc/24216/task/24229/stat : 24229 (ttsth-5-4) R 24213 24216 24182 0 -1 4202560 69410 0 0 0 69800 272 0 0 25 0 5 0 520361666 1579237376 317743 33554432000 4194304 4338100 140736791791264 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 2801.12
Current children cumulated vsize (KiB) 1542224

[startup+762.306 s]
/proc/loadavg: 8.10 8.07 8.00 9/186 24249
/proc/meminfo: memFree=22189128/32951124 swapFree=67051468/67111528
[pid=24216] ppid=24213 vsize=1567248 CPUtime=3040.74 cores=0,2,4,6
/proc/24216/stat : 24216 (ttsth-5-4) S 24213 24216 24182 0 -1 4202496 323059 0 0 0 303053 1021 0 0 25 0 5 0 520361577 1604861952 322993 33554432000 4194304 4338100 140736791791264 18446744073709551615 218382759909 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/24216/statm: 391812 322993 175 36 0 389717 0
[pid=24216/tid=24226] ppid=24213 vsize=1567248 CPUtime=759.92 cores=0,2,4,6
/proc/24216/task/24226/stat : 24226 (ttsth-5-4) R 24213 24216 24182 0 -1 4202560 47114 0 0 0 75810 182 0 0 25 0 5 0 520361666 1604861952 322993 33554432000 4194304 4338100 140736791791264 18446744073709551615 4254429 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=24216/tid=24227] ppid=24213 vsize=1567248 CPUtime=760.86 cores=0,2,4,6
/proc/24216/task/24227/stat : 24227 (ttsth-5-4) R 24213 24216 24182 0 -1 4202560 77228 0 0 0 75795 291 0 0 19 0 5 0 520361666 1604861952 322993 33554432000 4194304 4338100 140736791791264 18446744073709551615 218382783157 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=24216/tid=24228] ppid=24213 vsize=1567248 CPUtime=758.34 cores=0,2,4,6
/proc/24216/task/24228/stat : 24228 (ttsth-5-4) R 24213 24216 24182 0 -1 4202560 126913 0 0 0 75573 261 0 0 22 0 5 0 520361666 1604861952 322993 33554432000 4194304 4338100 140736791791264 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=24216/tid=24229] ppid=24213 vsize=1567248 CPUtime=760.71 cores=0,2,4,6
/proc/24216/task/24229/stat : 24229 (ttsth-5-4) R 24213 24216 24182 0 -1 4202560 71153 0 0 0 75785 286 0 0 25 0 5 0 520361666 1604861952 322993 33554432000 4194304 4338100 140736791791264 18446744073709551615 218382783157 0 0 4096 0 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3040.74
Current children cumulated vsize (KiB) 1567248

[startup+822.301 s]
/proc/loadavg: 8.19 8.10 8.01 9/186 24251
/proc/meminfo: memFree=22040308/32951124 swapFree=67051468/67111528
[pid=24216] ppid=24213 vsize=1636064 CPUtime=3280.28 cores=0,2,4,6
/proc/24216/stat : 24216 (ttsth-5-4) S 24213 24216 24182 0 -1 4202496 340152 0 0 0 326910 1118 0 0 25 0 5 0 520361577 1675329536 340086 33554432000 4194304 4338100 140736791791264 18446744073709551615 218382759909 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/24216/statm: 409016 340086 175 36 0 406921 0
[pid=24216/tid=24226] ppid=24213 vsize=1636064 CPUtime=819.64 cores=0,2,4,6
/proc/24216/task/24226/stat : 24226 (ttsth-5-4) R 24213 24216 24182 0 -1 4202560 50786 0 0 0 81757 207 0 0 25 0 5 0 520361666 1675329536 340086 33554432000 4194304 4338100 140736791791264 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=24216/tid=24227] ppid=24213 vsize=1636064 CPUtime=820.81 cores=0,2,4,6
/proc/24216/task/24227/stat : 24227 (ttsth-5-4) R 24213 24216 24182 0 -1 4202560 81888 0 0 0 81765 316 0 0 25 0 5 0 520361666 1675329536 340086 33554432000 4194304 4338100 140736791791264 18446744073709551615 218382783157 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=24216/tid=24228] ppid=24213 vsize=1636064 CPUtime=818.25 cores=0,2,4,6
/proc/24216/task/24228/stat : 24228 (ttsth-5-4) R 24213 24216 24182 0 -1 4202560 131209 0 0 0 81545 280 0 0 25 0 5 0 520361666 1675329536 340086 33554432000 4194304 4338100 140736791791264 18446744073709551615 218382783157 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=24216/tid=24229] ppid=24213 vsize=1636064 CPUtime=820.67 cores=0,2,4,6
/proc/24216/task/24229/stat : 24229 (ttsth-5-4) R 24213 24216 24182 0 -1 4202560 75618 0 0 0 81753 314 0 0 22 0 5 0 520361666 1675329536 340086 33554432000 4194304 4338100 140736791791264 18446744073709551615 218382783157 0 0 4096 0 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3280.28
Current children cumulated vsize (KiB) 1636064

[startup+882.301 s]
/proc/loadavg: 8.07 8.08 8.00 9/186 24252
/proc/meminfo: memFree=21913440/32951124 swapFree=67051468/67111528
[pid=24216] ppid=24213 vsize=1674456 CPUtime=3519.57 cores=0,2,4,6
/proc/24216/stat : 24216 (ttsth-5-4) S 24213 24216 24182 0 -1 4202496 347826 0 0 0 350717 1240 0 0 25 0 5 0 520361577 1714642944 347760 33554432000 4194304 4338100 140736791791264 18446744073709551615 218382759909 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/24216/statm: 418614 347760 175 36 0 416519 0
[pid=24216/tid=24226] ppid=24213 vsize=1674456 CPUtime=879.18 cores=0,2,4,6
/proc/24216/task/24226/stat : 24226 (ttsth-5-4) R 24213 24216 24182 0 -1 4202560 52163 0 0 0 87677 241 0 0 25 0 5 0 520361666 1714642944 347760 33554432000 4194304 4338100 140736791791264 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=24216/tid=24227] ppid=24213 vsize=1674456 CPUtime=880.7 cores=0,2,4,6
/proc/24216/task/24227/stat : 24227 (ttsth-5-4) R 24213 24216 24182 0 -1 4202560 83394 0 0 0 87721 349 0 0 18 0 5 0 520361666 1714642944 347760 33554432000 4194304 4338100 140736791791264 18446744073709551615 218382783157 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=24216/tid=24228] ppid=24213 vsize=1674456 CPUtime=878.23 cores=0,2,4,6
/proc/24216/task/24228/stat : 24228 (ttsth-5-4) R 24213 24216 24182 0 -1 4202560 133509 0 0 0 87522 301 0 0 25 0 5 0 520361666 1714642944 347760 33554432000 4194304 4338100 140736791791264 18446744073709551615 218382783157 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=24216/tid=24229] ppid=24213 vsize=1674456 CPUtime=880.55 cores=0,2,4,6
/proc/24216/task/24229/stat : 24229 (ttsth-5-4) R 24213 24216 24182 0 -1 4202560 78109 0 0 0 87707 348 0 0 25 0 5 0 520361666 1714642944 347760 33554432000 4194304 4338100 140736791791264 18446744073709551615 218382783157 0 0 4096 0 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3519.57
Current children cumulated vsize (KiB) 1674456

[startup+942.3 s]
/proc/loadavg: 8.02 8.06 8.00 9/186 24254
/proc/meminfo: memFree=21825116/32951124 swapFree=67051468/67111528
[pid=24216] ppid=24213 vsize=1705736 CPUtime=3759.07 cores=0,2,4,6
/proc/24216/stat : 24216 (ttsth-5-4) S 24213 24216 24182 0 -1 4202496 356102 0 0 0 374559 1348 0 0 25 0 5 0 520361577 1746673664 356036 33554432000 4194304 4338100 140736791791264 18446744073709551615 218382759909 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/24216/statm: 426434 356036 175 36 0 424339 0
[pid=24216/tid=24226] ppid=24213 vsize=1705736 CPUtime=938.8 cores=0,2,4,6
/proc/24216/task/24226/stat : 24226 (ttsth-5-4) R 24213 24216 24182 0 -1 4202560 55127 0 0 0 93608 272 0 0 25 0 5 0 520361666 1746673664 356036 33554432000 4194304 4338100 140736791791264 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=24216/tid=24227] ppid=24213 vsize=1705736 CPUtime=940.64 cores=0,2,4,6
/proc/24216/task/24227/stat : 24227 (ttsth-5-4) R 24213 24216 24182 0 -1 4202560 84087 0 0 0 93688 376 0 0 18 0 5 0 520361666 1746673664 356036 33554432000 4194304 4338100 140736791791264 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=24216/tid=24228] ppid=24213 vsize=1705736 CPUtime=938.22 cores=0,2,4,6
/proc/24216/task/24228/stat : 24228 (ttsth-5-4) R 24213 24216 24182 0 -1 4202560 133509 0 0 0 93502 320 0 0 25 0 5 0 520361666 1746673664 356036 33554432000 4194304 4338100 140736791791264 18446744073709551615 218382783157 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=24216/tid=24229] ppid=24213 vsize=1705736 CPUtime=940.49 cores=0,2,4,6
/proc/24216/task/24229/stat : 24229 (ttsth-5-4) R 24213 24216 24182 0 -1 4202560 82728 0 0 0 93671 378 0 0 25 0 5 0 520361666 1746673664 356036 33554432000 4194304 4338100 140736791791264 18446744073709551615 218382783157 0 0 4096 0 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3759.07
Current children cumulated vsize (KiB) 1705736

[startup+1002.3 s]
/proc/loadavg: 8.01 8.05 8.00 9/186 24255
/proc/meminfo: memFree=21764600/32951124 swapFree=67051468/67111528
[pid=24216] ppid=24213 vsize=1718248 CPUtime=3998.62 cores=0,2,4,6
/proc/24216/stat : 24216 (ttsth-5-4) S 24213 24216 24182 0 -1 4202496 359897 0 0 0 398427 1435 0 0 25 0 5 0 520361577 1759485952 359831 33554432000 4194304 4338100 140736791791264 18446744073709551615 218382759909 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/24216/statm: 429562 359831 175 36 0 427467 0
[pid=24216/tid=24226] ppid=24213 vsize=1718248 CPUtime=998.42 cores=0,2,4,6
/proc/24216/task/24226/stat : 24226 (ttsth-5-4) R 24213 24216 24182 0 -1 4202560 57286 0 0 0 99547 295 0 0 25 0 5 0 520361666 1759485952 359831 33554432000 4194304 4338100 140736791791264 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=24216/tid=24227] ppid=24213 vsize=1718248 CPUtime=1000.59 cores=0,2,4,6
/proc/24216/task/24227/stat : 24227 (ttsth-5-4) R 24213 24216 24182 0 -1 4202560 84657 0 0 0 99659 400 0 0 18 0 5 0 520361666 1759485952 359831 33554432000 4194304 4338100 140736791791264 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=24216/tid=24228] ppid=24213 vsize=1718248 CPUtime=998.21 cores=0,2,4,6
/proc/24216/task/24228/stat : 24228 (ttsth-5-4) R 24213 24216 24182 0 -1 4202560 133509 0 0 0 99486 335 0 0 25 0 5 0 520361666 1759485952 359831 33554432000 4194304 4338100 140736791791264 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=24216/tid=24229] ppid=24213 vsize=1718248 CPUtime=1000.46 cores=0,2,4,6
/proc/24216/task/24229/stat : 24229 (ttsth-5-4) R 24213 24216 24182 0 -1 4202560 83794 0 0 0 99644 402 0 0 25 0 5 0 520361666 1759485952 359831 33554432000 4194304 4338100 140736791791264 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3998.62
Current children cumulated vsize (KiB) 1718248

[startup+1062.3 s]
/proc/loadavg: 8.11 8.07 8.01 9/186 24257
/proc/meminfo: memFree=21708160/32951124 swapFree=67051468/67111528
[pid=24216] ppid=24213 vsize=1727632 CPUtime=4238.2 cores=0,2,4,6
/proc/24216/stat : 24216 (ttsth-5-4) S 24213 24216 24182 0 -1 4202496 361386 0 0 0 422334 1486 0 0 25 0 5 0 520361577 1769095168 361320 33554432000 4194304 4338100 140736791791264 18446744073709551615 218382759909 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/24216/statm: 431908 361320 175 36 0 429813 0
[pid=24216/tid=24226] ppid=24213 vsize=1727632 CPUtime=1058.09 cores=0,2,4,6
/proc/24216/task/24226/stat : 24226 (ttsth-5-4) R 24213 24216 24182 0 -1 4202560 58158 0 0 0 105499 310 0 0 25 0 5 0 520361666 1769095168 361320 33554432000 4194304 4338100 140736791791264 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=24216/tid=24227] ppid=24213 vsize=1727632 CPUtime=1060.57 cores=0,2,4,6
/proc/24216/task/24227/stat : 24227 (ttsth-5-4) R 24213 24216 24182 0 -1 4202560 84940 0 0 0 105644 413 0 0 25 0 5 0 520361666 1769095168 361320 33554432000 4194304 4338100 140736791791264 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=24216/tid=24228] ppid=24213 vsize=1727632 CPUtime=1058.2 cores=0,2,4,6
/proc/24216/task/24228/stat : 24228 (ttsth-5-4) R 24213 24216 24182 0 -1 4202560 133509 0 0 0 105475 345 0 0 25 0 5 0 520361666 1769095168 361320 33554432000 4194304 4338100 140736791791264 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=24216/tid=24229] ppid=24213 vsize=1727632 CPUtime=1060.42 cores=0,2,4,6
/proc/24216/task/24229/stat : 24229 (ttsth-5-4) R 24213 24216 24182 0 -1 4202560 84128 0 0 0 105625 417 0 0 25 0 5 0 520361666 1769095168 361320 33554432000 4194304 4338100 140736791791264 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4238.2
Current children cumulated vsize (KiB) 1727632

[startup+1122.3 s]
/proc/loadavg: 8.16 8.08 8.01 9/186 24259
/proc/meminfo: memFree=21665612/32951124 swapFree=67051468/67111528
[pid=24216] ppid=24213 vsize=1727632 CPUtime=4477.82 cores=0,2,4,6
/proc/24216/stat : 24216 (ttsth-5-4) S 24213 24216 24182 0 -1 4202496 361463 0 0 0 446251 1531 0 0 25 0 5 0 520361577 1769095168 361397 33554432000 4194304 4338100 140736791791264 18446744073709551615 218382759909 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/24216/statm: 431908 361397 175 36 0 429813 0
[pid=24216/tid=24226] ppid=24213 vsize=1727632 CPUtime=1117.73 cores=0,2,4,6
/proc/24216/task/24226/stat : 24226 (ttsth-5-4) R 24213 24216 24182 0 -1 4202560 58158 0 0 0 111450 323 0 0 25 0 5 0 520361666 1769095168 361397 33554432000 4194304 4338100 140736791791264 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=24216/tid=24227] ppid=24213 vsize=1727632 CPUtime=1120.57 cores=0,2,4,6
/proc/24216/task/24227/stat : 24227 (ttsth-5-4) R 24213 24216 24182 0 -1 4202560 84940 0 0 0 111632 425 0 0 25 0 5 0 520361666 1769095168 361397 33554432000 4194304 4338100 140736791791264 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=24216/tid=24228] ppid=24213 vsize=1727632 CPUtime=1118.2 cores=0,2,4,6
/proc/24216/task/24228/stat : 24228 (ttsth-5-4) R 24213 24216 24182 0 -1 4202560 133509 0 0 0 111466 354 0 0 25 0 5 0 520361666 1769095168 361397 33554432000 4194304 4338100 140736791791264 18446744073709551615 4254315 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=24216/tid=24229] ppid=24213 vsize=1727632 CPUtime=1120.41 cores=0,2,4,6
/proc/24216/task/24229/stat : 24229 (ttsth-5-4) R 24213 24216 24182 0 -1 4202560 84205 0 0 0 111613 428 0 0 25 0 5 0 520361666 1769095168 361397 33554432000 4194304 4338100 140736791791264 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4477.82
Current children cumulated vsize (KiB) 1727632

[startup+1182.3 s]
/proc/loadavg: 8.06 8.07 8.01 9/186 24260
/proc/meminfo: memFree=21631740/32951124 swapFree=67051468/67111528
[pid=24216] ppid=24213 vsize=1727632 CPUtime=4717.44 cores=0,2,4,6
/proc/24216/stat : 24216 (ttsth-5-4) S 24213 24216 24182 0 -1 4202496 361735 0 0 0 470164 1580 0 0 25 0 5 0 520361577 1769095168 361669 33554432000 4194304 4338100 140736791791264 18446744073709551615 218382759909 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/24216/statm: 431908 361669 175 36 0 429813 0
[pid=24216/tid=24226] ppid=24213 vsize=1727632 CPUtime=1177.39 cores=0,2,4,6
/proc/24216/task/24226/stat : 24226 (ttsth-5-4) R 24213 24216 24182 0 -1 4202560 58158 0 0 0 117402 337 0 0 18 0 5 0 520361666 1769095168 361669 33554432000 4194304 4338100 140736791791264 18446744073709551615 4254388 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=24216/tid=24227] ppid=24213 vsize=1727632 CPUtime=1180.54 cores=0,2,4,6
/proc/24216/task/24227/stat : 24227 (ttsth-5-4) R 24213 24216 24182 0 -1 4202560 84940 0 0 0 117616 438 0 0 21 0 5 0 520361666 1769095168 361669 33554432000 4194304 4338100 140736791791264 18446744073709551615 4254347 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=24216/tid=24228] ppid=24213 vsize=1727632 CPUtime=1178.19 cores=0,2,4,6
/proc/24216/task/24228/stat : 24228 (ttsth-5-4) R 24213 24216 24182 0 -1 4202560 133510 0 0 0 117456 363 0 0 25 0 5 0 520361666 1769095168 361669 33554432000 4194304 4338100 140736791791264 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=24216/tid=24229] ppid=24213 vsize=1727632 CPUtime=1180.39 cores=0,2,4,6
/proc/24216/task/24229/stat : 24229 (ttsth-5-4) R 24213 24216 24182 0 -1 4202560 84476 0 0 0 117599 440 0 0 25 0 5 0 520361666 1769095168 361669 33554432000 4194304 4338100 140736791791264 18446744073709551615 4254388 0 0 4096 0 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4717.44
Current children cumulated vsize (KiB) 1727632



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1203 s]
/proc/loadavg: 8.04 8.06 8.00 5/180 24262
/proc/meminfo: memFree=23871208/32951124 swapFree=67051468/67111528
[pid=24216] ppid=24213 vsize=1727632 CPUtime=4800.13 cores=0,2,4,6
/proc/24216/stat : 24216 (ttsth-5-4) S 24213 24216 24182 0 -1 4202496 361735 0 0 0 478420 1593 0 0 25 0 5 0 520361577 1769095168 361669 33554432000 4194304 4338100 140736791791264 18446744073709551615 218382759909 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/24216/statm: 431908 361669 175 36 0 429813 0
[pid=24216/tid=24226] ppid=24213 vsize=1727632 CPUtime=1197.97 cores=0,2,4,6
/proc/24216/task/24226/stat : 24226 (ttsth-5-4) R 24213 24216 24182 0 -1 4202560 58158 0 0 0 119457 340 0 0 25 0 5 0 520361666 1769095168 361669 33554432000 4194304 4338100 140736791791264 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=24216/tid=24227] ppid=24213 vsize=1727632 CPUtime=1201.25 cores=0,2,4,6
/proc/24216/task/24227/stat : 24227 (ttsth-5-4) R 24213 24216 24182 0 -1 4202560 84940 0 0 0 119683 442 0 0 25 0 5 0 520361666 1769095168 361669 33554432000 4194304 4338100 140736791791264 18446744073709551615 218382783157 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=24216/tid=24228] ppid=24213 vsize=1727632 CPUtime=1198.9 cores=0,2,4,6
/proc/24216/task/24228/stat : 24228 (ttsth-5-4) R 24213 24216 24182 0 -1 4202560 133510 0 0 0 119525 365 0 0 25 0 5 0 520361666 1769095168 361669 33554432000 4194304 4338100 140736791791264 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=24216/tid=24229] ppid=24213 vsize=1727632 CPUtime=1201.1 cores=0,2,4,6
/proc/24216/task/24229/stat : 24229 (ttsth-5-4) R 24213 24216 24182 0 -1 4202560 84476 0 0 0 119666 444 0 0 25 0 5 0 520361666 1769095168 361669 33554432000 4194304 4338100 140736791791264 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4800.13
Current children cumulated vsize (KiB) 1727632

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1203.07
CPU time (s): 4800.23
CPU user time (s): 4784.23
CPU system time (s): 15.9966
CPU usage (%): 398.998
Max. virtual memory (cumulated for all children) (KiB): 1727632

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4784.23
system time used= 15.9966
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 361735
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 71477
involuntary context switches= 22547

runsolver used 1.91571 second user time and 4.65029 second system time

The end

Launcher Data 

Begin job on node101 at 2011-04-29 16:33:08
IDJOB=3261122
IDBENCH=83210
IDSOLVER=1654
FILE ID=node101/3261122-1304087588
RUNJOBID= node101-1304087588-24200
PBS_JOBID= 13170559
Free space on /tmp= 72024 MiB

SOLVER NAME= ttsth 5-4
BENCH NAME= SAT11/crafted/skvortsov/battleship/battleship-10-10-unsat.cnf
COMMAND LINE= DIR/ttsth-5-4 -num-threads NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3261122-1304087588/watcher-3261122-1304087588 -o /tmp/evaluation-result-3261122-1304087588/solver-3261122-1304087588 -C 4800 -W 1300 -M 15500  HOME/ttsth-5-4 -num-threads 4 HOME/instance-3261122-1304087588.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 5ad28aa134f570fa0399980e14c0e5d4
RANDOM SEED=264554957

node101.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.841
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.841
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.841
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.841
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.841
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.841
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.841
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.841
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      25321448 kB
Buffers:       2024848 kB
Cached:        5125512 kB
SwapCached:      30452 kB
Active:        3057496 kB
Inactive:      4126680 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      25321448 kB
SwapTotal:    67111528 kB
SwapFree:     67051468 kB
Dirty:             196 kB
Writeback:           0 kB
AnonPages:       25244 kB
Mapped:           8648 kB
Slab:           380360 kB
PageTables:       5180 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   185364 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72024 MiB
End job on node101 at 2011-04-29 16:53:13