Trace number 1532018

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ttsth-5-0 2009-03-19? (TO) 1200.2 1200.62

General information on the benchmark

NameRANDOM/MEDIUM/3SAT/SATISFIABLE/380/
unif-k3-r4.25-v380-c1615-S486002104-037.cnf
MD5SUMf4b8d839b40ecfc6d6fa55a34f75fca9
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark0.009997
Satisfiable
(Un)Satisfiability was proved
Number of variables380
Number of clauses1615
Sum of the clauses size4845
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 31615
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.00/0.00	c Command: HOME/ttsth-5-0 -num-threads 2 HOME/instance-1532018-1238597274.cnf 
0.00/0.00	c Using SATTIMEOUT of 1200
0.00/0.00	c Using SATRAM of 1800
0.00/0.00	c Size of subset node = 16
0.00/0.00	c Variables = 380
0.00/0.00	c Clauses = 1615
0.00/0.00	c Literals = 4845
0.00/0.00	c Reduced size:
0.00/0.00	c Variables = 380
0.00/0.00	c Clauses = 1613
0.00/0.00	c Literals = 4839
0.00/0.00	c a2
0.00/0.00	c a1
0.19/0.28	c Independent sub-problems = 1
0.19/0.28	c Sub-problem with 379 variables and 1613 clauses
0.19/0.28	c using permutation method 4
0.19/0.28	c count = 3
0.19/0.28	c Ordering finished 0.280 seconds
0.19/0.28	c mapped 0.280 seconds
0.19/0.28	c permuted 0.280 seconds
0.19/0.28	c about to sort
0.19/0.28	c sorted
0.19/0.29	c clauses now 1613
0.19/0.29	c init finished 0.280 seconds
0.19/0.29	c tree built 0.290 seconds
0.19/0.29	c 
0.19/0.29	c PA progress                      | CPU progress Partial assignments | improvements      CPU time        PA/sec        nodes
0.19/0.29	c ---------------------------------|----------------------------------|------------------------------------------------------
0.19/0.29	c ................................ | ..........                       |                        0.3           0.0             
0.19/0.29	c ................................ | ..........                     1 |                        0.3           3.4             
0.19/0.29	c ................................ | ..........                     2 |                        0.3           6.9             
0.19/0.29	c ................................ | ..........                     3 |                        0.3          10.3             
0.19/0.29	c ................................ | ..........                     4 |                        0.3          13.8             
0.19/0.29	c ................................ | ..........                     5 |                        0.3          17.2             
0.39/0.40	c ................................ | ..........                  1000 | 66                     0.4        2564.1        43155
24.18/24.22	c ................................ | ..........                164000 | 51969                 24.2        6774.1      3142052
47.97/48.01	c ................................ | ..........                239000 | 80060                 48.0        4979.2      4755151
71.97/72.08	c ................................ | ..........                311000 | 106877                72.1        4315.2      6494636
95.95/96.05	c ................................ | ..........                366000 | 126330                96.0        3811.3      7808309
119.95/120.07	c ................................ | *.........                410000 | 143813               120.0        3415.5      8974522
144.14/144.29	c ................................ | *.........                470000 | 166755               144.2        3258.2     10241331
168.03/168.12	c ................................ | *.........                524000 | 186745               168.1        3117.6     11413002
191.92/192.07	c ................................ | *.........                584000 | 206001               192.0        3041.2     12829983
216.11/216.29	c ................................ | *.........                624000 | 219013               216.2        2885.7     13906502
240.30/240.47	c ................................ | **........                658000 | 230827               240.4        2737.0     14697772
264.40/264.50	c ................................ | **........                702000 | 244602               264.4        2654.6     15626304
288.19/288.37	c ................................ | **........                735000 | 254908               288.3        2549.3     16486776
312.48/312.62	c ................................ | **........                761000 | 264256               312.6        2434.8     17255761
336.67/336.81	c ................................ | **........                788000 | 272552               336.7        2340.1     18052143
361.06/361.22	c ................................ | ***.......                815000 | 280622               361.1        2256.7     18827265
384.66/384.86	c ................................ | ***.......                839000 | 289202               384.8        2180.4     19581972
407.96/408.18	c ................................ | ***.......                863000 | 297585               408.1        2114.7     20287004
432.24/432.42	c ................................ | ***.......                908000 | 312167               432.3        2100.2     21227514
456.43/456.62	c ................................ | ***.......                951000 | 326849               456.5        2083.1     22218898
480.03/480.25	c ................................ | ****......                985000 | 339182               480.1        2051.4     23104624
504.82/505.06	c ................................ | ****......               1019000 | 351808               505.0        2018.0     23948347
528.61/528.83	c ................................ | ****......               1048000 | 362254               528.7        1982.1     24671165
552.80/553.08	c ................................ | ****......               1076000 | 372331               553.0        1945.9     25435217
576.59/576.89	c ................................ | ****......               1105000 | 382675               576.8        1915.8     26216249
600.39/600.67	c ................................ | *****.....               1132000 | 392368               600.5        1884.9     26930603
624.18/624.42	c ................................ | *****.....               1155000 | 399782               624.3        1850.1     27526755
647.97/648.23	c ................................ | *****.....               1178000 | 407884               648.1        1817.6     28188904
672.56/672.87	c ................................ | *****.....               1202000 | 416827               672.7        1786.7     28841280
696.55/696.83	c ................................ | *****.....               1221000 | 424290               696.7        1752.6     29471536
719.94/720.29	c ................................ | ******....               1242000 | 432206               720.1        1724.6     30123907
744.73/745.05	c ................................ | ******....               1259000 | 438413               744.9        1690.2     30815292
768.53/768.85	c ................................ | ******....               1275000 | 444288               768.7        1658.7     31337704
792.31/792.65	c ................................ | ******....               1297000 | 452383               792.5        1636.6     31929181
817.40/817.70	c ................................ | ******....               1313000 | 458483               817.5        1606.1     32465976
840.00/840.32	c ................................ | *******...               1338000 | 467950               840.1        1592.6     33115016
864.99/865.33	c ................................ | *******...               1365000 | 479099               865.1        1577.8     33824359
888.98/889.34	c ................................ | *******...               1383000 | 486586               889.2        1555.4     34415446
912.58/912.97	c ................................ | *******...               1406000 | 495615               912.8        1540.3     34987572
936.16/936.52	c ................................ | *******...               1428000 | 503865               936.3        1525.1     35594131
959.97/960.37	c ................................ | ********..               1452000 | 512426               960.2        1512.2     36268919
984.35/984.72	c ................................ | ********..               1472000 | 519813               984.5        1495.1     36875952
1008.74/1009.12	c ................................ | ********..               1493000 | 527717              1008.9        1479.8     37570913
1031.93/1032.33	c ................................ | ********..               1512000 | 535427              1032.1        1464.9     38108824
1056.12/1056.54	c ................................ | ********..               1529000 | 542188              1056.3        1447.5     38690471
1080.11/1080.51	c ................................ | *********.               1546000 | 548543              1080.3        1431.1     39283996
1104.71/1105.14	c ................................ | *********.               1566000 | 556532              1104.9        1417.3     39915848
1127.90/1128.34	c ................................ | *********.               1584000 | 563092              1128.1        1404.1     40494824
1152.79/1153.21	c ................................ | *********.               1603000 | 570155              1153.0        1390.3     41152513
1176.49/1176.95	c ................................ | *********.               1622000 | 577182              1176.7        1378.4     41730913

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver version 3.2.9 (svn:489) (c) roussel@cril.univ-artois.fr

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-1532018-1238597274/watcher-1532018-1238597274 -o /tmp/evaluation-result-1532018-1238597274/solver-1532018-1238597274 -C 1200 -W 1800 -M 1800 --output-limit 1,15 HOME/ttsth-5-0 -num-threads 2 HOME/instance-1532018-1238597274.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1200 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1230 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.50 2.12 2.12 3/86 2238
/proc/meminfo: memFree=1665424/2055924 swapFree=4179644/4192956
[pid=2238] ppid=2236 vsize=1064 CPUtime=0
/proc/2238/stat : 2238 (ttsth-5-0) R 2236 2238 1664 0 -1 4194304 167 0 0 0 0 0 0 0 18 0 1 0 486057859 1089536 151 1992294400 134512640 135237372 4294956192 18446744073709551615 134749351 0 0 4096 0 0 0 0 17 1 0 0
/proc/2238/statm: 266 151 78 176 0 88 0

[startup+0.0805631 s]
/proc/loadavg: 2.50 2.12 2.12 3/86 2238
/proc/meminfo: memFree=1665424/2055924 swapFree=4179644/4192956
[pid=2238] ppid=2236 vsize=1200 CPUtime=0.07
/proc/2238/stat : 2238 (ttsth-5-0) R 2236 2238 1664 0 -1 4194304 192 0 0 0 7 0 0 0 18 0 1 0 486057859 1228800 176 1992294400 134512640 135237372 4294956192 18446744073709551615 134553816 0 0 4096 0 0 0 0 17 1 0 0
/proc/2238/statm: 300 176 79 176 0 122 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 1200

[startup+0.101566 s]
/proc/loadavg: 2.50 2.12 2.12 3/86 2238
/proc/meminfo: memFree=1665424/2055924 swapFree=4179644/4192956
[pid=2238] ppid=2236 vsize=1200 CPUtime=0.09
/proc/2238/stat : 2238 (ttsth-5-0) R 2236 2238 1664 0 -1 4194304 193 0 0 0 9 0 0 0 18 0 1 0 486057859 1228800 177 1992294400 134512640 135237372 4294956192 18446744073709551615 134553980 0 0 4096 0 0 0 0 17 1 0 0
/proc/2238/statm: 300 177 79 176 0 122 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 1200

[startup+0.301605 s]
/proc/loadavg: 2.50 2.12 2.12 3/86 2238
/proc/meminfo: memFree=1665424/2055924 swapFree=4179644/4192956
[pid=2238] ppid=2236 vsize=23096 CPUtime=0.29
/proc/2238/stat : 2238 (ttsth-5-0) S 2236 2238 1664 0 -1 4194304 484 0 0 0 29 0 0 0 19 0 3 0 486057859 23650304 468 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/2238/statm: 5774 468 97 176 0 5596 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 23096

[startup+0.701677 s]
/proc/loadavg: 2.50 2.12 2.12 3/86 2238
/proc/meminfo: memFree=1665424/2055924 swapFree=4179644/4192956
[pid=2238] ppid=2236 vsize=25656 CPUtime=0.69
/proc/2238/stat : 2238 (ttsth-5-0) S 2236 2238 1664 0 -1 4194304 1195 0 0 0 69 0 0 0 19 0 3 0 486057859 26271744 1179 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/2238/statm: 6414 1179 97 176 0 6236 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 25656

[startup+1.50182 s]
/proc/loadavg: 2.50 2.12 2.12 4/89 2241
/proc/meminfo: memFree=1659000/2055924 swapFree=4179644/4192956
[pid=2238] ppid=2236 vsize=30136 CPUtime=1.49
/proc/2238/stat : 2238 (ttsth-5-0) S 2236 2238 1664 0 -1 4194304 2321 0 0 0 148 1 0 0 19 0 3 0 486057859 30859264 2305 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/2238/statm: 7534 2305 97 176 0 7356 0
[pid=2238/tid=2240] ppid=2236 vsize=30136 CPUtime=0.59
/proc/2238/task/2240/stat : 2240 (ttsth-5-0) R 2236 2238 1664 0 -1 4194368 893 0 0 0 59 0 0 0 25 0 3 0 486057888 30859264 2305 1992294400 134512640 135237372 4294956192 18446744073709551615 134546034 0 0 4096 0 0 0 0 -1 1 0 0
[pid=2238/tid=2241] ppid=2236 vsize=30136 CPUtime=0.59
/proc/2238/task/2241/stat : 2241 (ttsth-5-0) R 2236 2238 1664 0 -1 4194368 965 0 0 0 59 0 0 0 25 0 3 0 486057888 30859264 2305 1992294400 134512640 135237372 4294956192 18446744073709551615 134680262 0 0 4096 0 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 30136

[startup+3.10213 s]
/proc/loadavg: 2.50 2.12 2.12 4/89 2241
/proc/meminfo: memFree=1653752/2055924 swapFree=4179644/4192956
[pid=2238] ppid=2236 vsize=37080 CPUtime=3.09
/proc/2238/stat : 2238 (ttsth-5-0) S 2236 2238 1664 0 -1 4194304 3803 0 0 0 308 1 0 0 19 0 3 0 486057859 37969920 3787 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/2238/statm: 9270 3787 97 176 0 9092 0
[pid=2238/tid=2240] ppid=2236 vsize=37080 CPUtime=1.39
/proc/2238/task/2240/stat : 2240 (ttsth-5-0) R 2236 2238 1664 0 -1 4194368 1580 0 0 0 139 0 0 0 25 0 3 0 486057888 37969920 3787 1992294400 134512640 135237372 4294956192 18446744073709551615 134562401 0 0 4096 0 0 0 0 -1 1 0 0
[pid=2238/tid=2241] ppid=2236 vsize=37080 CPUtime=1.39
/proc/2238/task/2241/stat : 2241 (ttsth-5-0) R 2236 2238 1664 0 -1 4194368 1760 0 0 0 139 0 0 0 25 0 3 0 486057888 37969920 3787 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 37080

[startup+6.30171 s]
/proc/loadavg: 2.54 2.14 2.12 4/89 2241
/proc/meminfo: memFree=1644040/2055924 swapFree=4179644/4192956
[pid=2238] ppid=2236 vsize=45720 CPUtime=6.29
/proc/2238/stat : 2238 (ttsth-5-0) S 2236 2238 1664 0 -1 4194304 5943 0 0 0 626 3 0 0 19 0 3 0 486057859 46817280 5927 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/2238/statm: 11430 5927 97 176 0 11252 0
[pid=2238/tid=2240] ppid=2236 vsize=45720 CPUtime=2.99
/proc/2238/task/2240/stat : 2240 (ttsth-5-0) R 2236 2238 1664 0 -1 4194368 2643 0 0 0 298 1 0 0 25 0 3 0 486057888 46817280 5927 1992294400 134512640 135237372 4294956192 18446744073709551615 134562341 0 0 4096 0 0 0 0 -1 1 0 0
[pid=2238/tid=2241] ppid=2236 vsize=45720 CPUtime=2.99
/proc/2238/task/2241/stat : 2241 (ttsth-5-0) R 2236 2238 1664 0 -1 4194368 2837 0 0 0 298 1 0 0 23 0 3 0 486057888 46817280 5927 1992294400 134512640 135237372 4294956192 18446744073709551615 134587840 0 0 4096 0 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 45720

[startup+12.7029 s]
/proc/loadavg: 2.58 2.15 2.13 4/89 2241
/proc/meminfo: memFree=1629384/2055924 swapFree=4179644/4192956
[pid=2238] ppid=2236 vsize=59000 CPUtime=12.69
/proc/2238/stat : 2238 (ttsth-5-0) S 2236 2238 1664 0 -1 4194304 9249 0 0 0 1264 5 0 0 19 0 3 0 486057859 60416000 9233 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/2238/statm: 14750 9234 97 176 0 14572 0
[pid=2238/tid=2240] ppid=2236 vsize=59000 CPUtime=6.19
/proc/2238/task/2240/stat : 2240 (ttsth-5-0) R 2236 2238 1664 0 -1 4194368 4281 0 0 0 617 2 0 0 25 0 3 0 486057888 60416000 9234 1992294400 134512640 135237372 4294956192 18446744073709551615 134546034 0 0 4096 0 0 0 0 -1 1 0 0
[pid=2238/tid=2241] ppid=2236 vsize=59000 CPUtime=6.19
/proc/2238/task/2241/stat : 2241 (ttsth-5-0) R 2236 2238 1664 0 -1 4194368 4506 0 0 0 617 2 0 0 25 0 3 0 486057888 60416000 9234 1992294400 134512640 135237372 4294956192 18446744073709551615 134562363 0 0 4096 0 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 59000

[startup+25.5013 s]
/proc/loadavg: 2.67 2.19 2.14 4/89 2241
/proc/meminfo: memFree=1611848/2055924 swapFree=4179644/4192956
[pid=2238] ppid=2236 vsize=75640 CPUtime=25.48
/proc/2238/stat : 2238 (ttsth-5-0) S 2236 2238 1664 0 -1 4194304 13458 0 0 0 2540 8 0 0 19 0 3 0 486057859 77455360 13442 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/2238/statm: 18910 13442 97 176 0 18732 0
[pid=2238/tid=2240] ppid=2236 vsize=75640 CPUtime=12.58
/proc/2238/task/2240/stat : 2240 (ttsth-5-0) R 2236 2238 1664 0 -1 4194368 6334 0 0 0 1254 4 0 0 25 0 3 0 486057888 77455360 13442 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 1 0 0
[pid=2238/tid=2241] ppid=2236 vsize=75640 CPUtime=12.59
/proc/2238/task/2241/stat : 2241 (ttsth-5-0) R 2236 2238 1664 0 -1 4194368 6661 0 0 0 1256 3 0 0 25 0 3 0 486057888 77455360 13442 1992294400 134512640 135237372 4294956192 18446744073709551615 134562351 0 0 4096 0 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 75640

[startup+51.102 s]
/proc/loadavg: 2.78 2.26 2.16 4/89 2241
/proc/meminfo: memFree=1583944/2055924 swapFree=4179644/4192956
[pid=2238] ppid=2236 vsize=104120 CPUtime=51.07
/proc/2238/stat : 2238 (ttsth-5-0) S 2236 2238 1664 0 -1 4194304 20557 0 0 0 5095 12 0 0 19 0 3 0 486057859 106618880 20541 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/2238/statm: 26030 20541 97 176 0 25852 0
[pid=2238/tid=2240] ppid=2236 vsize=104120 CPUtime=25.38
/proc/2238/task/2240/stat : 2240 (ttsth-5-0) R 2236 2238 1664 0 -1 4194368 10277 0 0 0 2531 7 0 0 25 0 3 0 486057888 106618880 20541 1992294400 134512640 135237372 4294956192 18446744073709551615 134546034 0 0 4096 0 0 0 0 -1 1 0 0
[pid=2238/tid=2241] ppid=2236 vsize=104120 CPUtime=25.39
/proc/2238/task/2241/stat : 2241 (ttsth-5-0) R 2236 2238 1664 0 -1 4194368 9817 0 0 0 2534 5 0 0 25 0 3 0 486057888 106618880 20541 1992294400 134512640 135237372 4294956192 18446744073709551615 134562380 0 0 4096 0 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 51.07
Current children cumulated vsize (KiB) 104120

[startup+102.307 s]
/proc/loadavg: 2.90 2.37 2.20 4/89 2241
/proc/meminfo: memFree=1532488/2055924 swapFree=4179644/4192956
[pid=2238] ppid=2236 vsize=154840 CPUtime=102.26
/proc/2238/stat : 2238 (ttsth-5-0) S 2236 2238 1664 0 -1 4194304 33222 0 0 0 10204 22 0 0 19 0 3 0 486057859 158556160 33206 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/2238/statm: 38710 33206 97 176 0 38532 0
[pid=2238/tid=2240] ppid=2236 vsize=154840 CPUtime=50.97
/proc/2238/task/2240/stat : 2240 (ttsth-5-0) R 2236 2238 1664 0 -1 4194368 16677 0 0 0 5085 12 0 0 25 0 3 0 486057888 158556160 33206 1992294400 134512640 135237372 4294956192 18446744073709551615 134562357 0 0 4096 0 0 0 0 -1 1 0 0
[pid=2238/tid=2241] ppid=2236 vsize=154840 CPUtime=50.98
/proc/2238/task/2241/stat : 2241 (ttsth-5-0) R 2236 2238 1664 0 -1 4194368 16082 0 0 0 5089 9 0 0 25 0 3 0 486057888 158556160 33206 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 102.26
Current children cumulated vsize (KiB) 154840

[startup+162.301 s]
/proc/loadavg: 2.96 2.48 2.25 4/89 2241
/proc/meminfo: memFree=1486472/2055924 swapFree=4179644/4192956
[pid=2238] ppid=2236 vsize=201240 CPUtime=162.24
/proc/2238/stat : 2238 (ttsth-5-0) S 2236 2238 1664 0 -1 4194304 44846 0 0 0 16193 31 0 0 19 0 3 0 486057859 206069760 44830 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/2238/statm: 50310 44830 97 176 0 50132 0
[pid=2238/tid=2240] ppid=2236 vsize=201240 CPUtime=80.95
/proc/2238/task/2240/stat : 2240 (ttsth-5-0) R 2236 2238 1664 0 -1 4194368 22407 0 0 0 8078 17 0 0 25 0 3 0 486057888 206069760 44831 1992294400 134512640 135237372 4294956192 18446744073709551615 134546034 0 0 4096 0 0 0 0 -1 1 0 0
[pid=2238/tid=2241] ppid=2236 vsize=201240 CPUtime=80.98
/proc/2238/task/2241/stat : 2241 (ttsth-5-0) R 2236 2238 1664 0 -1 4194368 21977 0 0 0 8085 13 0 0 25 0 3 0 486057888 206069760 44831 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 162.24
Current children cumulated vsize (KiB) 201240

[startup+222.302 s]
/proc/loadavg: 2.98 2.57 2.29 4/89 2241
/proc/meminfo: memFree=1437256/2055924 swapFree=4179644/4192956
[pid=2238] ppid=2236 vsize=249852 CPUtime=222.21
/proc/2238/stat : 2238 (ttsth-5-0) S 2236 2238 1664 0 -1 4194304 56946 0 0 0 22181 40 0 0 19 0 3 0 486057859 255848448 56930 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/2238/statm: 62463 56930 97 176 0 62285 0
[pid=2238/tid=2240] ppid=2236 vsize=249852 CPUtime=110.93
/proc/2238/task/2240/stat : 2240 (ttsth-5-0) R 2236 2238 1664 0 -1 4194368 28035 0 0 0 11072 21 0 0 25 0 3 0 486057888 255848448 56930 1992294400 134512640 135237372 4294956192 18446744073709551615 134562388 0 0 4096 0 0 0 0 -1 1 0 0
[pid=2238/tid=2241] ppid=2236 vsize=249852 CPUtime=110.97
/proc/2238/task/2241/stat : 2241 (ttsth-5-0) R 2236 2238 1664 0 -1 4194368 28448 0 0 0 11079 18 0 0 25 0 3 0 486057888 255848448 56930 1992294400 134512640 135237372 4294956192 18446744073709551615 134552742 0 0 4096 0 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 222.21
Current children cumulated vsize (KiB) 249852

[startup+282.303 s]
/proc/loadavg: 2.99 2.65 2.33 4/89 2241
/proc/meminfo: memFree=1403016/2055924 swapFree=4179644/4192956
[pid=2238] ppid=2236 vsize=284412 CPUtime=282.2
/proc/2238/stat : 2238 (ttsth-5-0) S 2236 2238 1664 0 -1 4194304 65583 0 0 0 28173 47 0 0 19 0 3 0 486057859 291237888 65567 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/2238/statm: 71103 65567 97 176 0 70925 0
[pid=2238/tid=2240] ppid=2236 vsize=284412 CPUtime=140.98
/proc/2238/task/2240/stat : 2240 (ttsth-5-0) R 2236 2238 1664 0 -1 4194368 32758 0 0 0 14073 25 0 0 25 0 3 0 486057888 291237888 65567 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 1 0 0
[pid=2238/tid=2241] ppid=2236 vsize=284412 CPUtime=140.91
/proc/2238/task/2241/stat : 2241 (ttsth-5-0) R 2236 2238 1664 0 -1 4194368 32362 0 0 0 14070 21 0 0 25 0 3 0 486057888 291237888 65567 1992294400 134512640 135237372 4294956192 18446744073709551615 134562344 0 0 4096 0 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 282.2
Current children cumulated vsize (KiB) 284412

[startup+342.302 s]
/proc/loadavg: 2.99 2.71 2.37 4/89 2243
/proc/meminfo: memFree=1371656/2055924 swapFree=4179644/4192956
[pid=2238] ppid=2236 vsize=315292 CPUtime=342.18
/proc/2238/stat : 2238 (ttsth-5-0) S 2236 2238 1664 0 -1 4194304 73321 0 0 0 34164 54 0 0 19 0 3 0 486057859 322859008 73305 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/2238/statm: 78823 73305 97 176 0 78645 0
[pid=2238/tid=2240] ppid=2236 vsize=315292 CPUtime=170.97
/proc/2238/task/2240/stat : 2240 (ttsth-5-0) R 2236 2238 1664 0 -1 4194368 36167 0 0 0 17068 29 0 0 25 0 3 0 486057888 322859008 73305 1992294400 134512640 135237372 4294956192 18446744073709551615 134562357 0 0 4096 0 0 0 0 -1 1 0 0
[pid=2238/tid=2241] ppid=2236 vsize=315292 CPUtime=170.9
/proc/2238/task/2241/stat : 2241 (ttsth-5-0) R 2236 2238 1664 0 -1 4194368 36691 0 0 0 17066 24 0 0 25 0 3 0 486057888 322859008 73305 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 342.18
Current children cumulated vsize (KiB) 315292

[startup+402.302 s]

################
# More data... #
################

[pid=2238] ppid=2236 vsize=446332 CPUtime=582.09
/proc/2238/stat : 2238 (ttsth-5-0) S 2236 2238 1664 0 -1 4194304 106069 0 0 0 58129 80 0 0 19 0 3 0 486057859 457043968 106053 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/2238/statm: 111583 106053 97 176 0 111405 0
[pid=2238/tid=2240] ppid=2236 vsize=446332 CPUtime=290.94
/proc/2238/task/2240/stat : 2240 (ttsth-5-0) R 2236 2238 1664 0 -1 4194368 52562 0 0 0 29054 40 0 0 25 0 3 0 486057888 457043968 106053 1992294400 134512640 135237372 4294956192 18446744073709551615 134562294 0 0 4096 0 0 0 0 -1 1 0 0
[pid=2238/tid=2241] ppid=2236 vsize=446332 CPUtime=290.85
/proc/2238/task/2241/stat : 2241 (ttsth-5-0) R 2236 2238 1664 0 -1 4194368 53044 0 0 0 29046 39 0 0 25 0 3 0 486057888 457043968 106053 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 582.09
Current children cumulated vsize (KiB) 446332

[startup+642.301 s]
/proc/loadavg: 2.99 2.88 2.53 4/89 2243
/proc/meminfo: memFree=1214280/2055924 swapFree=4179644/4192956
[pid=2238] ppid=2236 vsize=472252 CPUtime=642.08
/proc/2238/stat : 2238 (ttsth-5-0) S 2236 2238 1664 0 -1 4194304 112567 0 0 0 64122 86 0 0 19 0 3 0 486057859 483586048 112551 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/2238/statm: 118063 112551 97 176 0 117885 0
[pid=2238/tid=2240] ppid=2236 vsize=472252 CPUtime=320.92
/proc/2238/task/2240/stat : 2240 (ttsth-5-0) R 2236 2238 1664 0 -1 4194368 55559 0 0 0 32049 43 0 0 25 0 3 0 486057888 483586048 112551 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 1 0 0
[pid=2238/tid=2241] ppid=2236 vsize=472252 CPUtime=320.84
/proc/2238/task/2241/stat : 2241 (ttsth-5-0) R 2236 2238 1664 0 -1 4194368 56545 0 0 0 32043 41 0 0 25 0 3 0 486057888 483586048 112551 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 642.08
Current children cumulated vsize (KiB) 472252

[startup+702.301 s]
/proc/loadavg: 2.99 2.90 2.56 4/89 2243
/proc/meminfo: memFree=1188872/2055924 swapFree=4179644/4192956
[pid=2238] ppid=2236 vsize=497692 CPUtime=702.05
/proc/2238/stat : 2238 (ttsth-5-0) S 2236 2238 1664 0 -1 4194304 118945 0 0 0 70113 92 0 0 19 0 3 0 486057859 509636608 118929 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/2238/statm: 124423 118929 97 176 0 124245 0
[pid=2238/tid=2240] ppid=2236 vsize=497692 CPUtime=350.91
/proc/2238/task/2240/stat : 2240 (ttsth-5-0) R 2236 2238 1664 0 -1 4194368 58337 0 0 0 35044 47 0 0 25 0 3 0 486057888 509636608 118929 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 1 0 0
[pid=2238/tid=2241] ppid=2236 vsize=497692 CPUtime=350.84
/proc/2238/task/2241/stat : 2241 (ttsth-5-0) R 2236 2238 1664 0 -1 4194368 60145 0 0 0 35039 45 0 0 25 0 3 0 486057888 509636608 118929 1992294400 134512640 135237372 4294956192 18446744073709551615 134562344 0 0 4096 0 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 702.05
Current children cumulated vsize (KiB) 497692

[startup+762.307 s]
/proc/loadavg: 2.99 2.92 2.58 4/89 2243
/proc/meminfo: memFree=1163400/2055924 swapFree=4179644/4192956
[pid=2238] ppid=2236 vsize=523132 CPUtime=762.03
/proc/2238/stat : 2238 (ttsth-5-0) S 2236 2238 1664 0 -1 4194304 125260 0 0 0 76105 98 0 0 19 0 3 0 486057859 535687168 125244 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/2238/statm: 130783 125244 97 176 0 130605 0
[pid=2238/tid=2240] ppid=2236 vsize=523132 CPUtime=380.89
/proc/2238/task/2240/stat : 2240 (ttsth-5-0) R 2236 2238 1664 0 -1 4194368 60953 0 0 0 38040 49 0 0 25 0 3 0 486057888 535687168 125244 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 1 0 0
[pid=2238/tid=2241] ppid=2236 vsize=523132 CPUtime=380.83
/proc/2238/task/2241/stat : 2241 (ttsth-5-0) R 2236 2238 1664 0 -1 4194368 63844 0 0 0 38035 48 0 0 25 0 3 0 486057888 535687168 125244 1992294400 134512640 135237372 4294956192 18446744073709551615 134562357 0 0 4096 0 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 762.03
Current children cumulated vsize (KiB) 523132

[startup+822.301 s]
/proc/loadavg: 2.99 2.93 2.61 4/89 2249
/proc/meminfo: memFree=1140936/2055924 swapFree=4179644/4192956
[pid=2238] ppid=2236 vsize=545852 CPUtime=822
/proc/2238/stat : 2238 (ttsth-5-0) S 2236 2238 1664 0 -1 4194304 130945 0 0 0 82098 102 0 0 19 0 3 0 486057859 558952448 130929 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/2238/statm: 136463 130929 97 176 0 136285 0
[pid=2238/tid=2240] ppid=2236 vsize=545852 CPUtime=410.87
/proc/2238/task/2240/stat : 2240 (ttsth-5-0) R 2236 2238 1664 0 -1 4194368 63597 0 0 0 41036 51 0 0 25 0 3 0 486057888 558952448 130929 1992294400 134512640 135237372 4294956192 18446744073709551615 134562380 0 0 4096 0 0 0 0 -1 1 0 0
[pid=2238/tid=2241] ppid=2236 vsize=545852 CPUtime=410.83
/proc/2238/task/2241/stat : 2241 (ttsth-5-0) R 2236 2238 1664 0 -1 4194368 66885 0 0 0 41033 50 0 0 25 0 3 0 486057888 558952448 130929 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 822
Current children cumulated vsize (KiB) 545852

[startup+882.301 s]
/proc/loadavg: 2.99 2.94 2.63 4/89 2249
/proc/meminfo: memFree=1114184/2055924 swapFree=4179644/4192956
[pid=2238] ppid=2236 vsize=572252 CPUtime=881.98
/proc/2238/stat : 2238 (ttsth-5-0) S 2236 2238 1664 0 -1 4194304 137537 0 0 0 88091 107 0 0 19 0 3 0 486057859 585986048 137521 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/2238/statm: 143063 137521 97 176 0 142885 0
[pid=2238/tid=2240] ppid=2236 vsize=572252 CPUtime=440.86
/proc/2238/task/2240/stat : 2240 (ttsth-5-0) R 2236 2238 1664 0 -1 4194368 67001 0 0 0 44032 54 0 0 25 0 3 0 486057888 585986048 137521 1992294400 134512640 135237372 4294956192 18446744073709551615 134562461 0 0 4096 0 0 0 0 -1 1 0 0
[pid=2238/tid=2241] ppid=2236 vsize=572252 CPUtime=440.83
/proc/2238/task/2241/stat : 2241 (ttsth-5-0) R 2236 2238 1664 0 -1 4194368 70073 0 0 0 44030 53 0 0 25 0 3 0 486057888 585986048 137521 1992294400 134512640 135237372 4294956192 18446744073709551615 134735206 0 0 4096 0 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 881.98
Current children cumulated vsize (KiB) 572252

[startup+942.302 s]
/proc/loadavg: 2.99 2.95 2.65 4/89 2249
/proc/meminfo: memFree=1090504/2055924 swapFree=4179644/4192956
[pid=2238] ppid=2236 vsize=596092 CPUtime=941.96
/proc/2238/stat : 2238 (ttsth-5-0) S 2236 2238 1664 0 -1 4194304 143525 0 0 0 94084 112 0 0 19 0 3 0 486057859 610398208 143509 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/2238/statm: 149023 143509 97 176 0 148845 0
[pid=2238/tid=2240] ppid=2236 vsize=596092 CPUtime=470.84
/proc/2238/task/2240/stat : 2240 (ttsth-5-0) R 2236 2238 1664 0 -1 4194368 70260 0 0 0 47028 56 0 0 25 0 3 0 486057888 610398208 143509 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 1 0 0
[pid=2238/tid=2241] ppid=2236 vsize=596092 CPUtime=470.82
/proc/2238/task/2241/stat : 2241 (ttsth-5-0) R 2236 2238 1664 0 -1 4194368 72802 0 0 0 47027 55 0 0 25 0 3 0 486057888 610398208 143509 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 941.96
Current children cumulated vsize (KiB) 596092

[startup+1002.3 s]
/proc/loadavg: 2.99 2.95 2.67 4/89 2249
/proc/meminfo: memFree=1064264/2055924 swapFree=4179644/4192956
[pid=2238] ppid=2236 vsize=622172 CPUtime=1001.94
/proc/2238/stat : 2238 (ttsth-5-0) S 2236 2238 1664 0 -1 4194304 150037 0 0 0 100076 118 0 0 19 0 3 0 486057859 637104128 150021 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/2238/statm: 155543 150021 97 176 0 155365 0
[pid=2238/tid=2240] ppid=2236 vsize=622172 CPUtime=500.82
/proc/2238/task/2240/stat : 2240 (ttsth-5-0) R 2236 2238 1664 0 -1 4194368 73290 0 0 0 50022 60 0 0 25 0 3 0 486057888 637104128 150021 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 1 0 0
[pid=2238/tid=2241] ppid=2236 vsize=622172 CPUtime=500.81
/proc/2238/task/2241/stat : 2241 (ttsth-5-0) R 2236 2238 1664 0 -1 4194368 76284 0 0 0 50024 57 0 0 25 0 3 0 486057888 637104128 150021 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1001.94
Current children cumulated vsize (KiB) 622172

[startup+1062.3 s]
/proc/loadavg: 2.99 2.96 2.68 4/89 2249
/proc/meminfo: memFree=1041032/2055924 swapFree=4179644/4192956
[pid=2238] ppid=2236 vsize=645372 CPUtime=1061.92
/proc/2238/stat : 2238 (ttsth-5-0) S 2236 2238 1664 0 -1 4194304 155853 0 0 0 106069 123 0 0 19 0 3 0 486057859 660860928 155837 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/2238/statm: 161343 155837 97 176 0 161165 0
[pid=2238/tid=2240] ppid=2236 vsize=645372 CPUtime=530.82
/proc/2238/task/2240/stat : 2240 (ttsth-5-0) R 2236 2238 1664 0 -1 4194368 76097 0 0 0 53020 62 0 0 25 0 3 0 486057888 660860928 155837 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 1 0 0
[pid=2238/tid=2241] ppid=2236 vsize=645372 CPUtime=530.8
/proc/2238/task/2241/stat : 2241 (ttsth-5-0) R 2236 2238 1664 0 -1 4194368 79293 0 0 0 53020 60 0 0 25 0 3 0 486057888 660860928 155837 1992294400 134512640 135237372 4294956192 18446744073709551615 134562380 0 0 4096 0 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1061.92
Current children cumulated vsize (KiB) 645372

[startup+1122.3 s]
/proc/loadavg: 2.99 2.96 2.70 4/89 2249
/proc/meminfo: memFree=1016456/2055924 swapFree=4179644/4192956
[pid=2238] ppid=2236 vsize=669852 CPUtime=1121.9
/proc/2238/stat : 2238 (ttsth-5-0) S 2236 2238 1664 0 -1 4194304 161943 0 0 0 112063 127 0 0 19 0 3 0 486057859 685928448 161927 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/2238/statm: 167463 161927 97 176 0 167285 0
[pid=2238/tid=2240] ppid=2236 vsize=669852 CPUtime=560.81
/proc/2238/task/2240/stat : 2240 (ttsth-5-0) R 2236 2238 1664 0 -1 4194368 78886 0 0 0 56017 64 0 0 25 0 3 0 486057888 685928448 161927 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 1 0 0
[pid=2238/tid=2241] ppid=2236 vsize=669852 CPUtime=560.79
/proc/2238/task/2241/stat : 2241 (ttsth-5-0) R 2236 2238 1664 0 -1 4194368 82594 0 0 0 56016 63 0 0 25 0 3 0 486057888 685928448 161927 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1121.9
Current children cumulated vsize (KiB) 669852

[startup+1182.3 s]
/proc/loadavg: 2.99 2.97 2.72 4/89 2249
/proc/meminfo: memFree=992648/2055924 swapFree=4179644/4192956
[pid=2238] ppid=2236 vsize=693692 CPUtime=1181.88
/proc/2238/stat : 2238 (ttsth-5-0) S 2236 2238 1664 0 -1 4194304 167914 0 0 0 118056 132 0 0 19 0 3 0 486057859 710340608 167898 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/2238/statm: 173423 167898 97 176 0 173245 0
[pid=2238/tid=2240] ppid=2236 vsize=693692 CPUtime=590.81
/proc/2238/task/2240/stat : 2240 (ttsth-5-0) R 2236 2238 1664 0 -1 4194368 81433 0 0 0 59015 66 0 0 25 0 3 0 486057888 710340608 167898 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 1 0 0
[pid=2238/tid=2241] ppid=2236 vsize=693692 CPUtime=590.77
/proc/2238/task/2241/stat : 2241 (ttsth-5-0) R 2236 2238 1664 0 -1 4194368 86018 0 0 0 59012 65 0 0 25 0 3 0 486057888 710340608 167898 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1181.88
Current children cumulated vsize (KiB) 693692



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1200.5 s]
/proc/loadavg: 2.99 2.97 2.73 4/89 2249
/proc/meminfo: memFree=986952/2055924 swapFree=4179644/4192956
[pid=2238] ppid=2236 vsize=699132 CPUtime=1200.08
/proc/2238/stat : 2238 (ttsth-5-0) S 2236 2238 1664 0 -1 4194304 169261 0 0 0 119875 133 0 0 19 0 3 0 486057859 715911168 169245 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/2238/statm: 174783 169245 97 176 0 174605 0
[pid=2238/tid=2240] ppid=2236 vsize=699132 CPUtime=599.9
/proc/2238/task/2240/stat : 2240 (ttsth-5-0) R 2236 2238 1664 0 -1 4194368 82082 0 0 0 59924 66 0 0 25 0 3 0 486057888 715911168 169245 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 1 0 0
[pid=2238/tid=2241] ppid=2236 vsize=699132 CPUtime=599.87
/proc/2238/task/2241/stat : 2241 (ttsth-5-0) R 2236 2238 1664 0 -1 4194368 86716 0 0 0 59921 66 0 0 25 0 3 0 486057888 715911168 169245 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1200.08
Current children cumulated vsize (KiB) 699132

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1200.61 s]
/proc/loadavg: 2.99 2.97 2.73 4/89 2249
/proc/meminfo: memFree=986952/2055924 swapFree=4179644/4192956
[pid=2238] ppid=2236 vsize=0 CPUtime=1200.18
/proc/2238/stat : 2238 (ttsth-5-0) R 2236 2238 1664 0 -1 4195332 169261 0 0 0 119875 143 0 0 17 0 1 0 486057859 0 0 1992294400 0 0 0 0 0 0 0 4096 0 0 0 0 17 0 0 0
/proc/2238/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 1200.18
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1200.62
CPU time (s): 1200.2
CPU user time (s): 1198.76
CPU system time (s): 1.43878
CPU usage (%): 99.965
Max. virtual memory (cumulated for all children) (KiB): 699132

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1198.76
system time used= 1.43878
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 169261
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 21
involuntary context switches= 13292

runsolver used 1.45678 second user time and 4.02139 second system time

The end

Launcher Data 

Begin job on node83 at 2009-04-01 16:47:54
IDJOB=1532018
IDBENCH=70738
IDSOLVER=549
FILE ID=node83/1532018-1238597274
PBS_JOBID= 9068321
Free space on /tmp= 66508 MiB

SOLVER NAME= ttsth-5-0 2009-03-19
BENCH NAME= SAT09/RANDOM/MEDIUM/3SAT/SATISFIABLE/380/unif-k3-r4.25-v380-c1615-S486002104-037.cnf
COMMAND LINE= HOME/ttsth-5-0 -num-threads MAXNBTHREAD BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-1532018-1238597274/watcher-1532018-1238597274 -o /tmp/evaluation-result-1532018-1238597274/solver-1532018-1238597274 -C 1200 -W 1800 -M 1800 --output-limit 1,15  HOME/ttsth-5-0 -num-threads 2 HOME/instance-1532018-1238597274.cnf

TIME LIMIT= 1200 seconds
MEMORY LIMIT= 1800 MiB
MAX NB THREAD= 2

MD5SUM BENCH= f4b8d839b40ecfc6d6fa55a34f75fca9
RANDOM SEED=561951774

node83.alineos.net Linux 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.268
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.268
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5996.54
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055924 kB
MemFree:       1665840 kB
Buffers:         79260 kB
Cached:         215688 kB
SwapCached:       7584 kB
Active:         209896 kB
Inactive:       103660 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055924 kB
LowFree:       1665840 kB
SwapTotal:     4192956 kB
SwapFree:      4179644 kB
Dirty:            1200 kB
Writeback:           0 kB
Mapped:          26044 kB
Slab:            60544 kB
Committed_AS:  1269008 kB
PageTables:       2680 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66504 MiB
End job on node83 at 2009-04-01 17:07:57