Trace number 3260594

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ttsth 5-4? 4800.05 1203.86

General information on the benchmark

Namecrafted/skvortsov/
automata-synchronization/rnd_150_42_s.cnf
MD5SUM4177e06821060b0db9493e3e34514fae
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark8.28674
Satisfiable
(Un)Satisfiability was proved
Number of variables6384
Number of clauses23817
Sum of the clauses size59934
Maximum clause length3
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 211517
Number of clauses of size 312300
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.00/0.02	c Command: HOME/ttsth-5-4 -num-threads 4 HOME/instance-3260594-1304071863.cnf 
0.00/0.02	c Using SATTIMEOUT of 4800
0.00/0.02	c Using SATRAM of 15500
0.00/0.02	c Size of subset node = 32
0.00/0.02	c Variables = 6384
0.00/0.02	c Clauses = 23817
0.00/0.02	c Literals = 59934
0.00/0.02	c Reduced size:
0.00/0.02	c Variables = 6384
0.00/0.02	c Clauses = 17947
0.00/0.02	c Literals = 45996
0.00/0.02	c a2
0.02/0.03	c a1
0.49/0.53	c Independent sub-problems = 1
0.49/0.53	c Sub-problem with 5258 variables and 17947 clauses
0.49/0.53	c using permutation method 4
0.49/0.53	c count = 2
0.49/0.53	c Ordering finished 0.530 seconds
0.49/0.53	c mapped 0.530 seconds
0.49/0.53	c permuted 0.530 seconds
0.49/0.53	c about to sort
0.49/0.54	c sorted
0.59/0.62	c clauses now 17947
0.59/0.62	c init finished 0.580 seconds
0.59/0.62	c tree built 0.610 seconds
0.59/0.62	c 
0.59/0.62	c PA progress                      | CPU progress Partial assignments | improvements                 ucps  CPU time       PA/sec  nodes
0.59/0.62	c ---------------------------------|----------------------------------|--------------------------------------------------------------------
0.59/0.62	c ................................ | ..........                    |                                  0.6         0.0             
0.59/0.62	c ................................ | ..........                  1 |              1                   0.6         1.6             
0.59/0.62	c ................................ | ..........                  2 |              1                   0.6         3.2             
0.59/0.62	c ................................ | ..........                  3 |              1                   0.6         4.8             
0.59/0.62	c ................................ | ..........                  4 |              1                   0.6         6.5             
0.59/0.62	c ................................ | ..........                  5 |              1                   0.6         8.1             
0.59/0.62	c ................................ | ..........               1000 |              162                 0.6      1612.9            5
95.81/24.54	c ................................ | ..........           12013000 | 7786         766691             96.0    125135.4       261815
191.96/48.61	c ................................ | ..........           23608000 | 19781        1430825           192.0    122958.3       497885
287.74/72.67	c ................................ | ..........           35287000 | 29064        2089841           288.0    122524.3       685034
383.87/96.73	c ................................ | ..........           46520000 | 42222        2688739           384.0    121145.8       904761
479.99/120.80	c ................................ | *.........           57089000 | 57899        3304744           480.0    118935.4      1146961
575.70/144.88	c ................................ | *.........           67503000 | 73692        3896496           576.0    117190.7      1380320
671.83/168.94	c ................................ | *.........           77923000 | 88684        4438999           672.0    115956.8      1600062
767.97/193.00	c ................................ | *.........           88180000 | 104281       4980554           768.0    114817.7      1816128
863.68/217.08	c ................................ | *.........           98418000 | 120515       5535248           864.0    113909.7      2004437
959.82/241.14	c ................................ | **........          109220000 | 132943       6042422           960.0    113769.6      2135570
1055.97/265.20	c ................................ | **........          119724000 | 146599       6564588          1056.0    113375.0      2301051
1151.72/289.27	c ................................ | **........          129892000 | 162048       7071371          1152.0    112753.5      2468707
1247.81/313.35	c ................................ | **........          140298000 | 176133       7595139          1248.0    112417.4      2630496
1343.96/337.41	c ................................ | **........          150266000 | 192205       8095312          1344.0    111805.1      2813832
1439.68/361.48	c ................................ | ***.......          160783000 | 204995       8574809          1440.0    111654.9      2864538
1535.84/385.54	c ................................ | ***.......          171370000 | 216293       9060666          1536.0    111569.0      2966494
1631.97/409.60	c ................................ | ***.......          181764000 | 228812       9527986          1632.0    111375.0      3105725
1727.72/433.66	c ................................ | ***.......          191793000 | 244127       10022148         1728.0    110991.3      3146798
1823.86/457.73	c ................................ | ***.......          201316000 | 261236       10537806         1824.0    110370.6      3261235
1919.61/481.80	c ................................ | ****......          210706000 | 279341       11002208         1920.0    109742.1      3367404
2015.71/505.87	c ................................ | ****......          219784000 | 298905       11481853         2016.0    109019.8      3423986
2111.83/529.94	c ................................ | ****......          229744000 | 313311       11950117         2112.0    108780.3      3432754
2207.94/554.01	c ................................ | ****......          240289000 | 325491       12395781         2208.0    108826.5      3493447
2303.67/578.08	c ................................ | ****......          249906000 | 342396       12857620         2304.0    108466.1      3589128
2399.80/602.15	c ................................ | *****.....          259265000 | 360497       13333010         2400.0    108027.1      3738491
2495.95/626.21	c ................................ | *****.....          268375000 | 380034       13838038         2496.0    107521.6      3904095
2591.67/650.28	c ................................ | *****.....          277955000 | 397274       14294441         2592.0    107235.7      4017087
2687.85/674.34	c ................................ | *****.....          286444000 | 420307       14762919         2688.0    106563.6      4135935
2783.99/698.41	c ................................ | *****.....          295390000 | 439189       15218129         2784.0    106102.0      4288831
2879.72/722.47	c ................................ | ******....          303939000 | 460804       15661213         2880.0    105534.4      4529917
2975.85/746.54	c ................................ | ******....          312930000 | 479247       16109868         2976.0    105150.9      4737215
3071.96/770.61	c ................................ | ******....          321882000 | 498259       16572618         3072.0    104779.3      4935943
3167.70/794.68	c ................................ | ******....          330712000 | 518495       17018888         3168.0    104390.8      5090557
3263.82/818.74	c ................................ | ******....          339599000 | 537137       17466130         3264.0    104043.5      5250032
3359.95/842.81	c ................................ | *******...          348865000 | 553065       17931086         3360.0    103828.9      5372681
3455.70/866.88	c ................................ | *******...          357725000 | 571019       18401094         3456.0    103508.4      5563749
3551.84/890.94	c ................................ | *******...          366507000 | 590190       18866680         3552.0    103183.3      5768705
3647.95/915.01	c ................................ | *******...          375395000 | 608830       19314047         3648.0    102904.3      5849976
3743.68/939.08	c ................................ | *******...          384188000 | 626586       19760991         3744.0    102614.3      6005908
3839.81/963.15	c ................................ | ********..          392703000 | 646221       20170630         3840.0    102265.3      6195490
3935.94/987.21	c ................................ | ********..          402280000 | 660702       20591265         3936.0    102205.3      6351642
4031.69/1011.27	c ................................ | ********..          410252000 | 683293       21005956         4032.0    101749.0      6581924
4127.85/1035.34	c ................................ | ********..          417893000 | 707240       21425745         4128.0    101233.8      6691246
4223.95/1059.41	c ................................ | ********..          425237000 | 732232       21842242         4224.0    100671.6      6875202
4319.71/1083.48	c ................................ | *********.          432457000 | 756987       22279561         4320.0    100105.6      7149797
4415.83/1107.54	c ................................ | *********.          440087000 | 780030       22701178         4416.0     99657.4      7313156
4511.93/1131.61	c ................................ | *********.          447762000 | 803323       23114895         4512.0     99238.0      7383070
4607.67/1155.68	c ................................ | *********.          455061000 | 828570       23529104         4608.0     98754.6      7383070
4703.79/1179.75	c ................................ | *********.          463568000 | 848335       23951774         4704.0     98547.6      7383070
4799.92/1203.82	c CPU limit (4800) reached
4799.92/1203.82	c Time = 4800.00 seconds
4799.92/1203.82	s UNKNOWN

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3260594-1304071863/watcher-3260594-1304071863 -o /tmp/evaluation-result-3260594-1304071863/solver-3260594-1304071863 -C 4800 -W 1300 -M 15500 HOME/ttsth-5-4 -num-threads 4 HOME/instance-3260594-1304071863.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.76 5.01 6.59 2/177 22527
/proc/meminfo: memFree=18442176/32950928 swapFree=67111524/67111528
[pid=22527] ppid=22525 vsize=9408 CPUtime=0 cores=1,3,5,7
/proc/22527/stat : 22527 (ttsth-5-4) R 22525 22527 20564 0 -1 4202496 424 0 0 0 0 0 0 0 22 0 1 0 597416979 9633792 366 33554432000 4194304 4338100 140737244404640 18446744073709551615 4223897 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/22527/statm: 2352 367 147 36 0 257 0

[startup+0.0296691 s]
/proc/loadavg: 3.76 5.01 6.59 2/177 22527
/proc/meminfo: memFree=18442176/32950928 swapFree=67111524/67111528
[pid=22527] ppid=22525 vsize=13820 CPUtime=0.02 cores=1,3,5,7
/proc/22527/stat : 22527 (ttsth-5-4) R 22525 22527 20564 0 -1 4202496 1527 0 0 0 2 0 0 0 22 0 1 0 597416979 14151680 1469 33554432000 4194304 4338100 140737244404640 18446744073709551615 256414786809 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/22527/statm: 3455 1469 151 36 0 1360 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 13820

[startup+0.100658 s]
/proc/loadavg: 3.76 5.01 6.59 2/177 22527
/proc/meminfo: memFree=18442176/32950928 swapFree=67111524/67111528
[pid=22527] ppid=22525 vsize=14948 CPUtime=0.09 cores=1,3,5,7
/proc/22527/stat : 22527 (ttsth-5-4) R 22525 22527 20564 0 -1 4202496 1879 0 0 0 9 0 0 0 22 0 1 0 597416979 15306752 1737 33554432000 4194304 4338100 140737244404640 18446744073709551615 4245213 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/22527/statm: 3737 1737 156 36 0 1642 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 14948

[startup+0.300622 s]
/proc/loadavg: 3.76 5.01 6.59 2/177 22527
/proc/meminfo: memFree=18442176/32950928 swapFree=67111524/67111528
[pid=22527] ppid=22525 vsize=14948 CPUtime=0.29 cores=1,3,5,7
/proc/22527/stat : 22527 (ttsth-5-4) R 22525 22527 20564 0 -1 4202496 1900 0 0 0 29 0 0 0 23 0 1 0 597416979 15306752 1758 33554432000 4194304 4338100 140737244404640 18446744073709551615 4245205 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/22527/statm: 3737 1758 156 36 0 1642 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 14948

[startup+0.700485 s]
/proc/loadavg: 3.76 5.01 6.59 2/177 22527
/proc/meminfo: memFree=18442176/32950928 swapFree=67111524/67111528
[pid=22527] ppid=22525 vsize=258272 CPUtime=0.91 cores=1,3,5,7
/proc/22527/stat : 22527 (ttsth-5-4) S 22525 22527 20564 0 -1 4202496 18169 0 0 0 89 2 0 0 25 0 5 0 597416979 264470528 17990 33554432000 4194304 4338100 140737244404640 18446744073709551615 256427194341 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/22527/statm: 64568 17990 176 36 0 62473 0
Current children cumulated CPU time (s) 0.91
Current children cumulated vsize (KiB) 258272

[startup+1.50033 s]
/proc/loadavg: 3.76 5.01 6.59 10/186 22536
/proc/meminfo: memFree=18363020/32950928 swapFree=67111524/67111528
[pid=22527] ppid=22525 vsize=328520 CPUtime=4.09 cores=1,3,5,7
/proc/22527/stat : 22527 (ttsth-5-4) S 22525 22527 20564 0 -1 4202496 18898 0 0 0 394 15 0 0 25 0 5 0 597416979 336404480 18719 33554432000 4194304 4338100 140737244404640 18446744073709551615 256427194341 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/22527/statm: 82130 18719 176 36 0 80035 0
[pid=22527/tid=22533] ppid=22525 vsize=328520 CPUtime=0.86 cores=1,3,5,7
/proc/22527/task/22533/stat : 22533 (ttsth-5-4) R 22525 22527 20564 0 -1 4202560 495 0 0 0 83 3 0 0 18 0 5 0 597417042 336404480 18719 33554432000 4194304 4338100 140737244404640 18446744073709551615 256414786951 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=22527/tid=22534] ppid=22525 vsize=328520 CPUtime=0.86 cores=1,3,5,7
/proc/22527/task/22534/stat : 22534 (ttsth-5-4) R 22525 22527 20564 0 -1 4202560 471 0 0 0 83 3 0 0 25 0 5 0 597417042 336404480 18719 33554432000 4194304 4338100 140737244404640 18446744073709551615 4239444 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=22527/tid=22535] ppid=22525 vsize=328520 CPUtime=0.86 cores=1,3,5,7
/proc/22527/task/22535/stat : 22535 (ttsth-5-4) R 22525 22527 20564 0 -1 4202560 477 0 0 0 84 2 0 0 18 0 5 0 597417042 336404480 18719 33554432000 4194304 4338100 140737244404640 18446744073709551615 4240516 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=22527/tid=22536] ppid=22525 vsize=328520 CPUtime=0.86 cores=1,3,5,7
/proc/22527/task/22536/stat : 22536 (ttsth-5-4) R 22525 22527 20564 0 -1 4202560 481 0 0 0 83 3 0 0 18 0 5 0 597417042 336404480 18719 33554432000 4194304 4338100 140737244404640 18446744073709551615 256427217589 0 0 4096 0 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4.09
Current children cumulated vsize (KiB) 328520

[startup+3.10103 s]
/proc/loadavg: 4.18 5.07 6.61 9/186 22536
/proc/meminfo: memFree=18359176/32950928 swapFree=67111524/67111528
[pid=22527] ppid=22525 vsize=328916 CPUtime=10.47 cores=1,3,5,7
/proc/22527/stat : 22527 (ttsth-5-4) S 22525 22527 20564 0 -1 4202496 19286 0 0 0 1002 45 0 0 25 0 5 0 597416979 336809984 19107 33554432000 4194304 4338100 140737244404640 18446744073709551615 256427194341 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/22527/statm: 82229 19107 176 36 0 80134 0
[pid=22527/tid=22533] ppid=22525 vsize=328916 CPUtime=2.45 cores=1,3,5,7
/proc/22527/task/22533/stat : 22533 (ttsth-5-4) R 22525 22527 20564 0 -1 4202560 585 0 0 0 234 11 0 0 20 0 5 0 597417042 336809984 19107 33554432000 4194304 4338100 140737244404640 18446744073709551615 256414787310 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=22527/tid=22534] ppid=22525 vsize=328916 CPUtime=2.44 cores=1,3,5,7
/proc/22527/task/22534/stat : 22534 (ttsth-5-4) R 22525 22527 20564 0 -1 4202560 554 0 0 0 234 10 0 0 20 0 5 0 597417042 336809984 19107 33554432000 4194304 4338100 140737244404640 18446744073709551615 4241503 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=22527/tid=22535] ppid=22525 vsize=328916 CPUtime=2.46 cores=1,3,5,7
/proc/22527/task/22535/stat : 22535 (ttsth-5-4) R 22525 22527 20564 0 -1 4202560 568 0 0 0 236 10 0 0 20 0 5 0 597417042 336809984 19107 33554432000 4194304 4338100 140737244404640 18446744073709551615 256414786612 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=22527/tid=22536] ppid=22525 vsize=328916 CPUtime=2.46 cores=1,3,5,7
/proc/22527/task/22536/stat : 22536 (ttsth-5-4) R 22525 22527 20564 0 -1 4202560 605 0 0 0 235 11 0 0 19 0 5 0 597417042 336809984 19107 33554432000 4194304 4338100 140737244404640 18446744073709551615 256414786707 0 0 4096 0 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 10.47
Current children cumulated vsize (KiB) 328916

[startup+6.30043 s]
/proc/loadavg: 4.18 5.07 6.61 9/186 22536
/proc/meminfo: memFree=18350104/32950928 swapFree=67111524/67111528
[pid=22527] ppid=22525 vsize=329444 CPUtime=23.22 cores=1,3,5,7
/proc/22527/stat : 22527 (ttsth-5-4) S 22525 22527 20564 0 -1 4202496 20082 0 0 0 2221 101 0 0 25 0 5 0 597416979 337350656 19903 33554432000 4194304 4338100 140737244404640 18446744073709551615 256427194341 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/22527/statm: 82361 19903 176 36 0 80266 0
[pid=22527/tid=22533] ppid=22525 vsize=329444 CPUtime=5.66 cores=1,3,5,7
/proc/22527/task/22533/stat : 22533 (ttsth-5-4) R 22525 22527 20564 0 -1 4202560 782 0 0 0 540 26 0 0 18 0 5 0 597417042 337350656 19903 33554432000 4194304 4338100 140737244404640 18446744073709551615 4286690 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=22527/tid=22534] ppid=22525 vsize=329444 CPUtime=5.62 cores=1,3,5,7
/proc/22527/task/22534/stat : 22534 (ttsth-5-4) R 22525 22527 20564 0 -1 4202560 739 0 0 0 540 22 0 0 18 0 5 0 597417042 337350656 19903 33554432000 4194304 4338100 140737244404640 18446744073709551615 4240537 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=22527/tid=22535] ppid=22525 vsize=329444 CPUtime=5.65 cores=1,3,5,7
/proc/22527/task/22535/stat : 22535 (ttsth-5-4) R 22525 22527 20564 0 -1 4202560 726 0 0 0 540 25 0 0 18 0 5 0 597417042 337350656 19903 33554432000 4194304 4338100 140737244404640 18446744073709551615 256414786841 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=22527/tid=22536] ppid=22525 vsize=329444 CPUtime=5.66 cores=1,3,5,7
/proc/22527/task/22536/stat : 22536 (ttsth-5-4) R 22525 22527 20564 0 -1 4202560 861 0 0 0 540 26 0 0 18 0 5 0 597417042 337350656 19903 33554432000 4194304 4338100 140737244404640 18446744073709551615 4241570 0 0 4096 0 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 23.22
Current children cumulated vsize (KiB) 329444

[startup+12.7012 s]
/proc/loadavg: 4.77 5.17 6.62 9/186 22536
/proc/meminfo: memFree=18333896/32950928 swapFree=67111524/67111528
[pid=22527] ppid=22525 vsize=330236 CPUtime=48.75 cores=1,3,5,7
/proc/22527/stat : 22527 (ttsth-5-4) S 22525 22527 20564 0 -1 4202496 21400 0 0 0 4648 227 0 0 25 0 5 0 597416979 338161664 21221 33554432000 4194304 4338100 140737244404640 18446744073709551615 256427194341 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/22527/statm: 82559 21221 176 36 0 80464 0
[pid=22527/tid=22533] ppid=22525 vsize=330236 CPUtime=12.04 cores=1,3,5,7
/proc/22527/task/22533/stat : 22533 (ttsth-5-4) R 22525 22527 20564 0 -1 4202560 1079 0 0 0 1147 57 0 0 25 0 5 0 597417042 338161664 21221 33554432000 4194304 4338100 140737244404640 18446744073709551615 256414786669 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=22527/tid=22534] ppid=22525 vsize=330236 CPUtime=11.97 cores=1,3,5,7
/proc/22527/task/22534/stat : 22534 (ttsth-5-4) R 22525 22527 20564 0 -1 4202560 1059 0 0 0 1146 51 0 0 25 0 5 0 597417042 338161664 21221 33554432000 4194304 4338100 140737244404640 18446744073709551615 256415088171 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=22527/tid=22535] ppid=22525 vsize=330236 CPUtime=12.04 cores=1,3,5,7
/proc/22527/task/22535/stat : 22535 (ttsth-5-4) R 22525 22527 20564 0 -1 4202560 1006 0 0 0 1148 56 0 0 18 0 5 0 597417042 338161664 21221 33554432000 4194304 4338100 140737244404640 18446744073709551615 4254849 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=22527/tid=22536] ppid=22525 vsize=330236 CPUtime=12.04 cores=1,3,5,7
/proc/22527/task/22536/stat : 22536 (ttsth-5-4) R 22525 22527 20564 0 -1 4202560 1282 0 0 0 1145 59 0 0 18 0 5 0 597417042 338161664 21221 33554432000 4194304 4338100 140737244404640 18446744073709551615 256415049481 0 0 4096 0 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 48.75
Current children cumulated vsize (KiB) 330236

[startup+25.5008 s]
/proc/loadavg: 5.26 5.26 6.64 9/186 22537
/proc/meminfo: memFree=18305120/32950928 swapFree=67111524/67111528
[pid=22527] ppid=22525 vsize=335080 CPUtime=99.81 cores=1,3,5,7
/proc/22527/stat : 22527 (ttsth-5-4) S 22525 22527 20564 0 -1 4202496 24015 0 0 0 9501 480 0 0 25 0 5 0 597416979 343121920 23836 33554432000 4194304 4338100 140737244404640 18446744073709551615 256427194341 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/22527/statm: 83770 23836 176 36 0 81675 0
[pid=22527/tid=22533] ppid=22525 vsize=335080 CPUtime=24.84 cores=1,3,5,7
/proc/22527/task/22533/stat : 22533 (ttsth-5-4) R 22525 22527 20564 0 -1 4202560 1646 0 0 0 2360 124 0 0 22 0 5 0 597417042 343121920 23836 33554432000 4194304 4338100 140737244404640 18446744073709551615 256427217589 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=22527/tid=22534] ppid=22525 vsize=335080 CPUtime=24.67 cores=1,3,5,7
/proc/22527/task/22534/stat : 22534 (ttsth-5-4) R 22525 22527 20564 0 -1 4202560 1673 0 0 0 2358 109 0 0 25 0 5 0 597417042 343121920 23836 33554432000 4194304 4338100 140737244404640 18446744073709551615 4285386 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=22527/tid=22535] ppid=22525 vsize=335080 CPUtime=24.82 cores=1,3,5,7
/proc/22527/task/22535/stat : 22535 (ttsth-5-4) R 22525 22527 20564 0 -1 4202560 1608 0 0 0 2362 120 0 0 22 0 5 0 597417042 343121920 23836 33554432000 4194304 4338100 140737244404640 18446744073709551615 256427217589 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=22527/tid=22536] ppid=22525 vsize=335080 CPUtime=24.83 cores=1,3,5,7
/proc/22527/task/22536/stat : 22536 (ttsth-5-4) R 22525 22527 20564 0 -1 4202560 2114 0 0 0 2359 124 0 0 25 0 5 0 597417042 343121920 23836 33554432000 4194304 4338100 140737244404640 18446744073709551615 256427217589 0 0 4096 0 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 99.81
Current children cumulated vsize (KiB) 335080

[startup+51.101 s]
/proc/loadavg: 6.20 5.48 6.67 9/186 22537
/proc/meminfo: memFree=18251660/32950928 swapFree=67111524/67111528
[pid=22527] ppid=22525 vsize=344372 CPUtime=201.93 cores=1,3,5,7
/proc/22527/stat : 22527 (ttsth-5-4) S 22525 22527 20564 0 -1 4202496 28700 0 0 0 19227 966 0 0 25 0 5 0 597416979 352636928 28521 33554432000 4194304 4338100 140737244404640 18446744073709551615 256427194341 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/22527/statm: 86093 28521 176 36 0 83998 0
[pid=22527/tid=22533] ppid=22525 vsize=344372 CPUtime=50.42 cores=1,3,5,7
/proc/22527/task/22533/stat : 22533 (ttsth-5-4) R 22525 22527 20564 0 -1 4202560 2667 0 0 0 4788 254 0 0 21 0 5 0 597417042 352636928 28521 33554432000 4194304 4338100 140737244404640 18446744073709551615 4240530 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=22527/tid=22534] ppid=22525 vsize=344372 CPUtime=50.1 cores=1,3,5,7
/proc/22527/task/22534/stat : 22534 (ttsth-5-4) R 22525 22527 20564 0 -1 4202560 2745 0 0 0 4792 218 0 0 19 0 5 0 597417042 352636928 28521 33554432000 4194304 4338100 140737244404640 18446744073709551615 256414787028 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=22527/tid=22535] ppid=22525 vsize=344372 CPUtime=50.38 cores=1,3,5,7
/proc/22527/task/22535/stat : 22535 (ttsth-5-4) R 22525 22527 20564 0 -1 4202560 2749 0 0 0 4796 242 0 0 20 0 5 0 597417042 352636928 28521 33554432000 4194304 4338100 140737244404640 18446744073709551615 256427217589 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=22527/tid=22536] ppid=22525 vsize=344372 CPUtime=50.39 cores=1,3,5,7
/proc/22527/task/22536/stat : 22536 (ttsth-5-4) R 22525 22527 20564 0 -1 4202560 3565 0 0 0 4790 249 0 0 25 0 5 0 597417042 352636928 28521 33554432000 4194304 4338100 140737244404640 18446744073709551615 256427217589 0 0 4096 0 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 201.93
Current children cumulated vsize (KiB) 344372

[startup+102.306 s]
/proc/loadavg: 7.28 5.90 6.75 9/186 22539
/proc/meminfo: memFree=18146376/32950928 swapFree=67111524/67111528
[pid=22527] ppid=22525 vsize=365292 CPUtime=406.21 cores=1,3,5,7
/proc/22527/stat : 22527 (ttsth-5-4) S 22525 22527 20564 0 -1 4202496 37179 0 0 0 38681 1940 0 0 25 0 5 0 597416979 374059008 37000 33554432000 4194304 4338100 140737244404640 18446744073709551615 256427194341 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/22527/statm: 91323 37000 176 36 0 89228 0
[pid=22527/tid=22533] ppid=22525 vsize=365292 CPUtime=101.54 cores=1,3,5,7
/proc/22527/task/22533/stat : 22533 (ttsth-5-4) R 22525 22527 20564 0 -1 4202560 4548 0 0 0 9642 512 0 0 25 0 5 0 597417042 374059008 37000 33554432000 4194304 4338100 140737244404640 18446744073709551615 256427217589 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=22527/tid=22534] ppid=22525 vsize=365292 CPUtime=100.95 cores=1,3,5,7
/proc/22527/task/22534/stat : 22534 (ttsth-5-4) R 22525 22527 20564 0 -1 4202560 4685 0 0 0 9649 446 0 0 18 0 5 0 597417042 374059008 37000 33554432000 4194304 4338100 140737244404640 18446744073709551615 4240537 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=22527/tid=22535] ppid=22525 vsize=365292 CPUtime=101.53 cores=1,3,5,7
/proc/22527/task/22535/stat : 22535 (ttsth-5-4) R 22525 22527 20564 0 -1 4202560 4867 0 0 0 9668 485 0 0 18 0 5 0 597417042 374059008 37000 33554432000 4194304 4338100 140737244404640 18446744073709551615 256427217589 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=22527/tid=22536] ppid=22525 vsize=365292 CPUtime=101.53 cores=1,3,5,7
/proc/22527/task/22536/stat : 22536 (ttsth-5-4) R 22525 22527 20564 0 -1 4202560 6105 0 0 0 9659 494 0 0 18 0 5 0 597417042 374059008 37000 33554432000 4194304 4338100 140737244404640 18446744073709551615 256427217589 0 0 4096 0 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 406.21
Current children cumulated vsize (KiB) 365292

[startup+162.301 s]
/proc/loadavg: 7.93 6.34 6.84 9/186 22540
/proc/meminfo: memFree=18032784/32950928 swapFree=67111524/67111528
[pid=22527] ppid=22525 vsize=386872 CPUtime=645.5 cores=1,3,5,7
/proc/22527/stat : 22527 (ttsth-5-4) S 22525 22527 20564 0 -1 4202496 47500 0 0 0 61467 3083 0 0 25 0 5 0 597416979 396156928 47321 33554432000 4194304 4338100 140737244404640 18446744073709551615 256427194341 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/22527/statm: 96718 47321 176 36 0 94623 0
[pid=22527/tid=22533] ppid=22525 vsize=386872 CPUtime=161.25 cores=1,3,5,7
/proc/22527/task/22533/stat : 22533 (ttsth-5-4) R 22525 22527 20564 0 -1 4202560 6819 0 0 0 15318 807 0 0 25 0 5 0 597417042 396156928 47321 33554432000 4194304 4338100 140737244404640 18446744073709551615 4240516 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=22527/tid=22534] ppid=22525 vsize=386872 CPUtime=160.73 cores=1,3,5,7
/proc/22527/task/22534/stat : 22534 (ttsth-5-4) R 22525 22527 20564 0 -1 4202560 7146 0 0 0 15355 718 0 0 25 0 5 0 597417042 396156928 47321 33554432000 4194304 4338100 140737244404640 18446744073709551615 4256288 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=22527/tid=22535] ppid=22525 vsize=386872 CPUtime=161.44 cores=1,3,5,7
/proc/22527/task/22535/stat : 22535 (ttsth-5-4) R 22525 22527 20564 0 -1 4202560 7445 0 0 0 15373 771 0 0 19 0 5 0 597417042 396156928 47321 33554432000 4194304 4338100 140737244404640 18446744073709551615 256427217589 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=22527/tid=22536] ppid=22525 vsize=386872 CPUtime=161.41 cores=1,3,5,7
/proc/22527/task/22536/stat : 22536 (ttsth-5-4) R 22525 22527 20564 0 -1 4202560 9116 0 0 0 15358 783 0 0 25 0 5 0 597417042 396156928 47321 33554432000 4194304 4338100 140737244404640 18446744073709551615 256427217589 0 0 4096 0 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 645.5
Current children cumulated vsize (KiB) 386872


################
# More data... #
################

/proc/loadavg: 8.04 8.03 7.64 9/186 22566
/proc/meminfo: memFree=16685288/32950928 swapFree=67111524/67111528
[pid=22527] ppid=22525 vsize=845940 CPUtime=4474.86 cores=1,3,5,7
/proc/22527/stat : 22527 (ttsth-5-4) S 22525 22527 20564 0 -1 4202496 164554 0 0 0 426245 21241 0 0 25 0 5 0 597416979 866242560 164375 33554432000 4194304 4338100 140737244404640 18446744073709551615 256427194341 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/22527/statm: 211485 164375 176 36 0 209390 0
[pid=22527/tid=22533] ppid=22525 vsize=845940 CPUtime=1117.71 cores=1,3,5,7
/proc/22527/task/22533/stat : 22533 (ttsth-5-4) R 22525 22527 20564 0 -1 4202560 34210 0 0 0 106263 5508 0 0 25 0 5 0 597417042 866242560 164375 33554432000 4194304 4338100 140737244404640 18446744073709551615 256427217589 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=22527/tid=22534] ppid=22525 vsize=845940 CPUtime=1118.99 cores=1,3,5,7
/proc/22527/task/22534/stat : 22534 (ttsth-5-4) R 22525 22527 20564 0 -1 4202560 34974 0 0 0 106783 5116 0 0 25 0 5 0 597417042 866242560 164375 33554432000 4194304 4338100 140737244404640 18446744073709551615 256427217589 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=22527/tid=22535] ppid=22525 vsize=845940 CPUtime=1117.88 cores=1,3,5,7
/proc/22527/task/22535/stat : 22535 (ttsth-5-4) R 22525 22527 20564 0 -1 4202560 34234 0 0 0 106506 5282 0 0 22 0 5 0 597417042 866242560 164375 33554432000 4194304 4338100 140737244404640 18446744073709551615 4254311 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=22527/tid=22536] ppid=22525 vsize=845940 CPUtime=1119.63 cores=1,3,5,7
/proc/22527/task/22536/stat : 22536 (ttsth-5-4) R 22525 22527 20564 0 -1 4202560 44162 0 0 0 106631 5332 0 0 25 0 5 0 597417042 866242560 164375 33554432000 4194304 4338100 140737244404640 18446744073709551615 256427217589 0 0 4096 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4474.86
Current children cumulated vsize (KiB) 845940

[startup+1182.3 s]
/proc/loadavg: 8.01 8.02 7.66 9/186 22568
/proc/meminfo: memFree=16615584/32950928 swapFree=67111524/67111528
[pid=22527] ppid=22525 vsize=853740 CPUtime=4714.17 cores=1,3,5,7
/proc/22527/stat : 22527 (ttsth-5-4) S 22525 22527 20564 0 -1 4202496 169403 0 0 0 449037 22380 0 0 25 0 5 0 597416979 874229760 169224 33554432000 4194304 4338100 140737244404640 18446744073709551615 256427194341 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/22527/statm: 213435 169224 176 36 0 211340 0
[pid=22527/tid=22533] ppid=22525 vsize=853740 CPUtime=1177.62 cores=1,3,5,7
/proc/22527/task/22533/stat : 22533 (ttsth-5-4) R 22525 22527 20564 0 -1 4202560 35357 0 0 0 111957 5805 0 0 25 0 5 0 597417042 874229760 169224 33554432000 4194304 4338100 140737244404640 18446744073709551615 256427217589 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=22527/tid=22534] ppid=22525 vsize=853740 CPUtime=1178.9 cores=1,3,5,7
/proc/22527/task/22534/stat : 22534 (ttsth-5-4) R 22525 22527 20564 0 -1 4202560 36020 0 0 0 112495 5395 0 0 25 0 5 0 597417042 874229760 169224 33554432000 4194304 4338100 140737244404640 18446744073709551615 256427217589 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=22527/tid=22535] ppid=22525 vsize=853740 CPUtime=1177.46 cores=1,3,5,7
/proc/22527/task/22535/stat : 22535 (ttsth-5-4) R 22525 22527 20564 0 -1 4202560 35582 0 0 0 112183 5563 0 0 25 0 5 0 597417042 874229760 169224 33554432000 4194304 4338100 140737244404640 18446744073709551615 256414786669 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=22527/tid=22536] ppid=22525 vsize=853740 CPUtime=1179.55 cores=1,3,5,7
/proc/22527/task/22536/stat : 22536 (ttsth-5-4) R 22525 22527 20564 0 -1 4202560 45470 0 0 0 112341 5614 0 0 21 0 5 0 597417042 874229760 169224 33554432000 4194304 4338100 140737244404640 18446744073709551615 256427217589 0 0 4096 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4714.17
Current children cumulated vsize (KiB) 853740

Solver just ended. Dumping a history of the last processes samples

[startup+1190.3 s]
/proc/loadavg: 8.09 8.04 7.67 9/186 22568
/proc/meminfo: memFree=16602812/32950928 swapFree=67111524/67111528
[pid=22527] ppid=22525 vsize=854400 CPUtime=4746.07 cores=1,3,5,7
/proc/22527/stat : 22527 (ttsth-5-4) S 22525 22527 20564 0 -1 4202496 169928 0 0 0 452074 22533 0 0 25 0 5 0 597416979 874905600 169749 33554432000 4194304 4338100 140737244404640 18446744073709551615 256427194341 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/22527/statm: 213600 169749 176 36 0 211505 0
[pid=22527/tid=22533] ppid=22525 vsize=854400 CPUtime=1185.57 cores=1,3,5,7
/proc/22527/task/22533/stat : 22533 (ttsth-5-4) R 22525 22527 20564 0 -1 4202560 35479 0 0 0 112715 5842 0 0 25 0 5 0 597417042 874905600 169749 33554432000 4194304 4338100 140737244404640 18446744073709551615 4254321 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=22527/tid=22534] ppid=22525 vsize=854400 CPUtime=1186.89 cores=1,3,5,7
/proc/22527/task/22534/stat : 22534 (ttsth-5-4) R 22525 22527 20564 0 -1 4202560 36142 0 0 0 113256 5433 0 0 25 0 5 0 597417042 874905600 169749 33554432000 4194304 4338100 140737244404640 18446744073709551615 256427217589 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=22527/tid=22535] ppid=22525 vsize=854400 CPUtime=1185.44 cores=1,3,5,7
/proc/22527/task/22535/stat : 22535 (ttsth-5-4) R 22525 22527 20564 0 -1 4202560 35722 0 0 0 112941 5603 0 0 25 0 5 0 597417042 874905600 169749 33554432000 4194304 4338100 140737244404640 18446744073709551615 256427217589 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=22527/tid=22536] ppid=22525 vsize=854400 CPUtime=1187.53 cores=1,3,5,7
/proc/22527/task/22536/stat : 22536 (ttsth-5-4) R 22525 22527 20564 0 -1 4202560 45611 0 0 0 113100 5653 0 0 21 0 5 0 597417042 874905600 169749 33554432000 4194304 4338100 140737244404640 18446744073709551615 256427217589 0 0 4096 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4746.07
Current children cumulated vsize (KiB) 854400

[startup+1196.7 s]
/proc/loadavg: 8.08 8.04 7.67 9/186 22568
/proc/meminfo: memFree=16596856/32950928 swapFree=67111524/67111528
[pid=22527] ppid=22525 vsize=854796 CPUtime=4771.62 cores=1,3,5,7
/proc/22527/stat : 22527 (ttsth-5-4) S 22525 22527 20564 0 -1 4202496 170350 0 0 0 454499 22663 0 0 25 0 5 0 597416979 875311104 170171 33554432000 4194304 4338100 140737244404640 18446744073709551615 256427194341 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/22527/statm: 213699 170171 176 36 0 211604 0
[pid=22527/tid=22533] ppid=22525 vsize=854796 CPUtime=1191.93 cores=1,3,5,7
/proc/22527/task/22533/stat : 22533 (ttsth-5-4) R 22525 22527 20564 0 -1 4202560 35578 0 0 0 113317 5876 0 0 20 0 5 0 597417042 875311104 170171 33554432000 4194304 4338100 140737244404640 18446744073709551615 4285616 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=22527/tid=22534] ppid=22525 vsize=854796 CPUtime=1193.29 cores=1,3,5,7
/proc/22527/task/22534/stat : 22534 (ttsth-5-4) R 22525 22527 20564 0 -1 4202560 36241 0 0 0 113863 5466 0 0 20 0 5 0 597417042 875311104 170171 33554432000 4194304 4338100 140737244404640 18446744073709551615 256427217589 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=22527/tid=22535] ppid=22525 vsize=854796 CPUtime=1191.82 cores=1,3,5,7
/proc/22527/task/22535/stat : 22535 (ttsth-5-4) R 22525 22527 20564 0 -1 4202560 35834 0 0 0 113547 5635 0 0 20 0 5 0 597417042 875311104 170171 33554432000 4194304 4338100 140737244404640 18446744073709551615 256427217589 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=22527/tid=22536] ppid=22525 vsize=854796 CPUtime=1193.93 cores=1,3,5,7
/proc/22527/task/22536/stat : 22536 (ttsth-5-4) R 22525 22527 20564 0 -1 4202560 45723 0 0 0 113710 5683 0 0 19 0 5 0 597417042 875311104 170171 33554432000 4194304 4338100 140737244404640 18446744073709551615 256427217589 0 0 4096 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4771.62
Current children cumulated vsize (KiB) 854796

[startup+1199.9 s]
/proc/loadavg: 8.08 8.04 7.67 9/186 22568
/proc/meminfo: memFree=16594624/32950928 swapFree=67111524/67111528
[pid=22527] ppid=22525 vsize=855060 CPUtime=4784.37 cores=1,3,5,7
/proc/22527/stat : 22527 (ttsth-5-4) S 22525 22527 20564 0 -1 4202496 170560 0 0 0 455717 22720 0 0 25 0 5 0 597416979 875581440 170381 33554432000 4194304 4338100 140737244404640 18446744073709551615 256427194341 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/22527/statm: 213765 170381 176 36 0 211670 0
[pid=22527/tid=22533] ppid=22525 vsize=855060 CPUtime=1195.1 cores=1,3,5,7
/proc/22527/task/22533/stat : 22533 (ttsth-5-4) R 22525 22527 20564 0 -1 4202560 35627 0 0 0 113620 5890 0 0 25 0 5 0 597417042 875581440 170381 33554432000 4194304 4338100 140737244404640 18446744073709551615 256414787889 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=22527/tid=22534] ppid=22525 vsize=855060 CPUtime=1196.48 cores=1,3,5,7
/proc/22527/task/22534/stat : 22534 (ttsth-5-4) R 22525 22527 20564 0 -1 4202560 36289 0 0 0 114168 5480 0 0 25 0 5 0 597417042 875581440 170381 33554432000 4194304 4338100 140737244404640 18446744073709551615 4240537 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=22527/tid=22535] ppid=22525 vsize=855060 CPUtime=1195.01 cores=1,3,5,7
/proc/22527/task/22535/stat : 22535 (ttsth-5-4) R 22525 22527 20564 0 -1 4202560 35891 0 0 0 113851 5650 0 0 22 0 5 0 597417042 875581440 170381 33554432000 4194304 4338100 140737244404640 18446744073709551615 4241252 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=22527/tid=22536] ppid=22525 vsize=855060 CPUtime=1197.12 cores=1,3,5,7
/proc/22527/task/22536/stat : 22536 (ttsth-5-4) R 22525 22527 20564 0 -1 4202560 45779 0 0 0 114015 5697 0 0 25 0 5 0 597417042 875581440 170381 33554432000 4194304 4338100 140737244404640 18446744073709551615 4253962 0 0 4096 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4784.37
Current children cumulated vsize (KiB) 855060

[startup+1201.5 s]
/proc/loadavg: 8.08 8.04 7.67 9/186 22568
/proc/meminfo: memFree=16592268/32950928 swapFree=67111524/67111528
[pid=22527] ppid=22525 vsize=855060 CPUtime=4790.74 cores=1,3,5,7
/proc/22527/stat : 22527 (ttsth-5-4) S 22525 22527 20564 0 -1 4202496 170664 0 0 0 456328 22746 0 0 25 0 5 0 597416979 875581440 170485 33554432000 4194304 4338100 140737244404640 18446744073709551615 256427194341 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/22527/statm: 213765 170485 176 36 0 211670 0
[pid=22527/tid=22533] ppid=22525 vsize=855060 CPUtime=1196.69 cores=1,3,5,7
/proc/22527/task/22533/stat : 22533 (ttsth-5-4) R 22525 22527 20564 0 -1 4202560 35651 0 0 0 113772 5897 0 0 25 0 5 0 597417042 875581440 170485 33554432000 4194304 4338100 140737244404640 18446744073709551615 4255714 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=22527/tid=22534] ppid=22525 vsize=855060 CPUtime=1198.08 cores=1,3,5,7
/proc/22527/task/22534/stat : 22534 (ttsth-5-4) R 22525 22527 20564 0 -1 4202560 36313 0 0 0 114322 5486 0 0 25 0 5 0 597417042 875581440 170485 33554432000 4194304 4338100 140737244404640 18446744073709551615 256427217589 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=22527/tid=22535] ppid=22525 vsize=855060 CPUtime=1196.61 cores=1,3,5,7
/proc/22527/task/22535/stat : 22535 (ttsth-5-4) R 22525 22527 20564 0 -1 4202560 35919 0 0 0 114004 5657 0 0 18 0 5 0 597417042 875581440 170485 33554432000 4194304 4338100 140737244404640 18446744073709551615 256427217589 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=22527/tid=22536] ppid=22525 vsize=855060 CPUtime=1198.72 cores=1,3,5,7
/proc/22527/task/22536/stat : 22536 (ttsth-5-4) R 22525 22527 20564 0 -1 4202560 45807 0 0 0 114168 5704 0 0 25 0 5 0 597417042 875581440 170485 33554432000 4194304 4338100 140737244404640 18446744073709551615 256427217589 0 0 4096 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4790.74
Current children cumulated vsize (KiB) 855060

[startup+1203.1 s]
/proc/loadavg: 8.07 8.04 7.67 9/186 22568
/proc/meminfo: memFree=16591276/32950928 swapFree=67111524/67111528
[pid=22527] ppid=22525 vsize=855192 CPUtime=4797.13 cores=1,3,5,7
/proc/22527/stat : 22527 (ttsth-5-4) S 22525 22527 20564 0 -1 4202496 170776 0 0 0 456940 22773 0 0 25 0 5 0 597416979 875716608 170597 33554432000 4194304 4338100 140737244404640 18446744073709551615 256427194341 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/22527/statm: 213798 170597 176 36 0 211703 0
[pid=22527/tid=22533] ppid=22525 vsize=855192 CPUtime=1198.29 cores=1,3,5,7
/proc/22527/task/22533/stat : 22533 (ttsth-5-4) R 22525 22527 20564 0 -1 4202560 35677 0 0 0 113925 5904 0 0 25 0 5 0 597417042 875716608 170597 33554432000 4194304 4338100 140737244404640 18446744073709551615 4284214 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=22527/tid=22534] ppid=22525 vsize=855192 CPUtime=1199.67 cores=1,3,5,7
/proc/22527/task/22534/stat : 22534 (ttsth-5-4) R 22525 22527 20564 0 -1 4202560 36339 0 0 0 114475 5492 0 0 25 0 5 0 597417042 875716608 170597 33554432000 4194304 4338100 140737244404640 18446744073709551615 256427217589 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=22527/tid=22535] ppid=22525 vsize=855192 CPUtime=1198.21 cores=1,3,5,7
/proc/22527/task/22535/stat : 22535 (ttsth-5-4) R 22525 22527 20564 0 -1 4202560 35949 0 0 0 114157 5664 0 0 21 0 5 0 597417042 875716608 170597 33554432000 4194304 4338100 140737244404640 18446744073709551615 256427217589 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=22527/tid=22536] ppid=22525 vsize=855192 CPUtime=1200.31 cores=1,3,5,7
/proc/22527/task/22536/stat : 22536 (ttsth-5-4) R 22525 22527 20564 0 -1 4202560 45837 0 0 0 114321 5710 0 0 25 0 5 0 597417042 875716608 170597 33554432000 4194304 4338100 140737244404640 18446744073709551615 256427217589 0 0 4096 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4797.13
Current children cumulated vsize (KiB) 855192

[startup+1203.5 s]
/proc/loadavg: 8.07 8.04 7.67 9/186 22568
/proc/meminfo: memFree=16590284/32950928 swapFree=67111524/67111528
[pid=22527] ppid=22525 vsize=855192 CPUtime=4798.73 cores=1,3,5,7
/proc/22527/stat : 22527 (ttsth-5-4) S 22525 22527 20564 0 -1 4202496 170806 0 0 0 457094 22779 0 0 25 0 5 0 597416979 875716608 170627 33554432000 4194304 4338100 140737244404640 18446744073709551615 256427194341 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/22527/statm: 213798 170627 176 36 0 211703 0
[pid=22527/tid=22533] ppid=22525 vsize=855192 CPUtime=1198.67 cores=1,3,5,7
/proc/22527/task/22533/stat : 22533 (ttsth-5-4) R 22525 22527 20564 0 -1 4202560 35684 0 0 0 113962 5905 0 0 25 0 5 0 597417042 875716608 170627 33554432000 4194304 4338100 140737244404640 18446744073709551615 256415088057 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=22527/tid=22534] ppid=22525 vsize=855192 CPUtime=1200.07 cores=1,3,5,7
/proc/22527/task/22534/stat : 22534 (ttsth-5-4) R 22525 22527 20564 0 -1 4202560 36346 0 0 0 114513 5494 0 0 25 0 5 0 597417042 875716608 170627 33554432000 4194304 4338100 140737244404640 18446744073709551615 256414786576 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=22527/tid=22535] ppid=22525 vsize=855192 CPUtime=1198.61 cores=1,3,5,7
/proc/22527/task/22535/stat : 22535 (ttsth-5-4) R 22525 22527 20564 0 -1 4202560 35957 0 0 0 114196 5665 0 0 18 0 5 0 597417042 875716608 170627 33554432000 4194304 4338100 140737244404640 18446744073709551615 256415088113 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=22527/tid=22536] ppid=22525 vsize=855192 CPUtime=1200.71 cores=1,3,5,7
/proc/22527/task/22536/stat : 22536 (ttsth-5-4) R 22525 22527 20564 0 -1 4202560 45845 0 0 0 114359 5712 0 0 18 0 5 0 597417042 875716608 170627 33554432000 4194304 4338100 140737244404640 18446744073709551615 4257956 0 0 4096 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4798.73
Current children cumulated vsize (KiB) 855192

[startup+1203.7 s]
/proc/loadavg: 8.07 8.04 7.67 9/186 22568
/proc/meminfo: memFree=16590284/32950928 swapFree=67111524/67111528
[pid=22527] ppid=22525 vsize=855324 CPUtime=4799.52 cores=1,3,5,7
/proc/22527/stat : 22527 (ttsth-5-4) S 22525 22527 20564 0 -1 4202496 170822 0 0 0 457170 22782 0 0 25 0 5 0 597416979 875851776 170643 33554432000 4194304 4338100 140737244404640 18446744073709551615 256427194341 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/22527/statm: 213831 170643 176 36 0 211736 0
[pid=22527/tid=22533] ppid=22525 vsize=855324 CPUtime=1198.87 cores=1,3,5,7
/proc/22527/task/22533/stat : 22533 (ttsth-5-4) R 22525 22527 20564 0 -1 4202560 35688 0 0 0 113981 5906 0 0 25 0 5 0 597417042 875851776 170643 33554432000 4194304 4338100 140737244404640 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=22527/tid=22534] ppid=22525 vsize=855324 CPUtime=1200.27 cores=1,3,5,7
/proc/22527/task/22534/stat : 22534 (ttsth-5-4) R 22525 22527 20564 0 -1 4202560 36350 0 0 0 114533 5494 0 0 25 0 5 0 597417042 875851776 170643 33554432000 4194304 4338100 140737244404640 18446744073709551615 256427217589 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=22527/tid=22535] ppid=22525 vsize=855324 CPUtime=1198.81 cores=1,3,5,7
/proc/22527/task/22535/stat : 22535 (ttsth-5-4) R 22525 22527 20564 0 -1 4202560 35961 0 0 0 114215 5666 0 0 18 0 5 0 597417042 875851776 170643 33554432000 4194304 4338100 140737244404640 18446744073709551615 256427217589 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=22527/tid=22536] ppid=22525 vsize=855324 CPUtime=1200.91 cores=1,3,5,7
/proc/22527/task/22536/stat : 22536 (ttsth-5-4) R 22525 22527 20564 0 -1 4202560 45849 0 0 0 114378 5713 0 0 18 0 5 0 597417042 875851776 170643 33554432000 4194304 4338100 140737244404640 18446744073709551615 256427217589 0 0 4096 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4799.52
Current children cumulated vsize (KiB) 855324

[startup+1203.8 s]
/proc/loadavg: 8.07 8.04 7.67 9/186 22568
/proc/meminfo: memFree=16590284/32950928 swapFree=67111524/67111528
[pid=22527] ppid=22525 vsize=855324 CPUtime=4799.92 cores=1,3,5,7
/proc/22527/stat : 22527 (ttsth-5-4) S 22525 22527 20564 0 -1 4202496 170830 0 0 0 457208 22784 0 0 25 0 5 0 597416979 875851776 170651 33554432000 4194304 4338100 140737244404640 18446744073709551615 256427194341 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/22527/statm: 213831 170651 176 36 0 211736 0
[pid=22527/tid=22533] ppid=22525 vsize=855324 CPUtime=1198.98 cores=1,3,5,7
/proc/22527/task/22533/stat : 22533 (ttsth-5-4) R 22525 22527 20564 0 -1 4202560 35690 0 0 0 113991 5907 0 0 18 0 5 0 597417042 875851776 170651 33554432000 4194304 4338100 140737244404640 18446744073709551615 4284214 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=22527/tid=22534] ppid=22525 vsize=855324 CPUtime=1200.37 cores=1,3,5,7
/proc/22527/task/22534/stat : 22534 (ttsth-5-4) R 22525 22527 20564 0 -1 4202560 36352 0 0 0 114543 5494 0 0 25 0 5 0 597417042 875851776 170651 33554432000 4194304 4338100 140737244404640 18446744073709551615 256427217589 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=22527/tid=22535] ppid=22525 vsize=855324 CPUtime=1198.91 cores=1,3,5,7
/proc/22527/task/22535/stat : 22535 (ttsth-5-4) R 22525 22527 20564 0 -1 4202560 35963 0 0 0 114225 5666 0 0 18 0 5 0 597417042 875851776 170651 33554432000 4194304 4338100 140737244404640 18446744073709551615 256427217589 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=22527/tid=22536] ppid=22525 vsize=855324 CPUtime=1201.01 cores=1,3,5,7
/proc/22527/task/22536/stat : 22536 (ttsth-5-4) R 22525 22527 20564 0 -1 4202560 45851 0 0 0 114388 5713 0 0 18 0 5 0 597417042 875851776 170651 33554432000 4194304 4338100 140737244404640 18446744073709551615 256427217589 0 0 4096 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4799.92
Current children cumulated vsize (KiB) 855324

Child status: 0
Real time (s): 1203.86
CPU time (s): 4800.05
CPU user time (s): 4572.17
CPU system time (s): 227.88
CPU usage (%): 398.722
Max. virtual memory (cumulated for all children) (KiB): 855324

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4572.17
system time used= 227.88
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 170834
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2263013
involuntary context switches= 28826

runsolver used 1.9947 second user time and 4.5763 second system time

The end

Launcher Data 

Begin job on node115 at 2011-04-29 12:11:03
IDJOB=3260594
IDBENCH=83188
IDSOLVER=1654
FILE ID=node115/3260594-1304071863
RUNJOBID= node115-1304071862-22508
PBS_JOBID= 13170430
Free space on /tmp= 72732 MiB

SOLVER NAME= ttsth 5-4
BENCH NAME= SAT11/crafted/skvortsov/automata-synchronization/rnd_150_42_s.cnf
COMMAND LINE= DIR/ttsth-5-4 -num-threads NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3260594-1304071863/watcher-3260594-1304071863 -o /tmp/evaluation-result-3260594-1304071863/solver-3260594-1304071863 -C 4800 -W 1300 -M 15500  HOME/ttsth-5-4 -num-threads 4 HOME/instance-3260594-1304071863.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 4177e06821060b0db9493e3e34514fae
RANDOM SEED=519608724

node115.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.62
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      18442568 kB
Buffers:       2320216 kB
Cached:       11541512 kB
SwapCached:          4 kB
Active:        6867364 kB
Inactive:      7086480 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      18442568 kB
SwapTotal:    67111528 kB
SwapFree:     67111524 kB
Dirty:             788 kB
Writeback:          16 kB
AnonPages:       91640 kB
Mapped:          14840 kB
Slab:           490076 kB
PageTables:       5020 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   232908 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72732 MiB
End job on node115 at 2011-04-29 12:31:07