Trace number 1779898

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ttsth-5-0 2009-03-19 (4 threads)? (MO) 1920.99 489.429

General information on the benchmark

NameAPPLICATIONS/bioinfo/
q_query_3_l42_lambda.cnf
MD5SUMf7e4b8eacc29c0297225e4db3860ba3b
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark32.55
Satisfiable
(Un)Satisfiability was proved
Number of variables30006
Number of clauses148836
Sum of the clauses size428633
Maximum clause length9
Minimum clause length1
Number of clauses of size 13956
Number of clauses of size 237657
Number of clauses of size 386475
Number of clauses of size 414306
Number of clauses of size 56316
Number of clauses of size over 5126

Solver Data 

0.32/0.35	c Command: HOME/ttsth-5-0 -num-threads 4 HOME/instance-1779898-1243680129.cnf 
0.32/0.35	c Using SATTIMEOUT of 10000
0.32/0.35	c Using SATRAM of 2047
0.32/0.35	c Size of subset node = 16
0.32/0.35	c Variables = 30006
0.32/0.35	c Clauses = 148836
0.32/0.35	c Literals = 428633
0.32/0.35	c Reduced size:
0.32/0.35	c Variables = 30006
0.32/0.35	c Clauses = 133707
0.32/0.35	c Literals = 390638
0.32/0.35	c a2
0.62/0.68	c a1
8.71/8.74	c Independent sub-problems = 1
8.71/8.74	c Sub-problem with 25142 variables and 133707 clauses
8.71/8.74	c using permutation method 4
8.71/8.74	c count = 1
8.71/8.74	c Ordering finished 8.670 seconds
8.71/8.74	c mapped 8.730 seconds
8.71/8.74	c permuted 8.730 seconds
8.71/8.74	c about to sort
8.71/8.79	c sorted
10.71/10.78	c clauses now 133707
10.71/10.78	c init finished 8.950 seconds
10.71/10.78	c tree built 10.780 seconds
10.71/10.78	c 
10.71/10.78	c PA progress                      | CPU progress Partial assignments | improvements      CPU time        PA/sec        nodes
10.71/10.78	c ---------------------------------|----------------------------------|------------------------------------------------------
10.71/10.78	c ................................ | ..........                       |                       10.8           0.0             
10.71/10.78	c ................................ | ..........                     1 |                       10.8           0.1             
10.71/10.78	c ****************................ | ..........                     2 |                       10.8           0.2            1
10.71/10.78	c ****************................ | ..........                     3 |                       10.8           0.3            1
10.71/10.78	c ****************................ | ..........                     4 |                       10.8           0.4            1
10.71/10.78	c ****************................ | ..........                     5 |                       10.8           0.5            1
10.71/10.78	c ****************................ | ..........                     6 |                       10.8           0.6            1
10.71/10.79	c ****************................ | ..........                  1000 | 2                     10.8          92.8          116
199.73/58.18	c ****************................ | ..........               1904000 | 54584                200.0        9519.5     12024033
400.06/108.33	c ****************................ | ..........               3605000 | 88586                400.1        9009.1     26418584
599.81/158.40	c ****************................ | ..........               4590000 | 131622               600.2        7647.2     40531086
800.24/208.41	c ****************................ | ..........               5311000 | 164646               800.2        6636.7     54785835
1000.00/258.44	c ****************................ | *.........               6104000 | 192694              1000.1        6103.2     66564995
1199.64/308.50	c ****************................ | *.........               6790000 | 222122              1200.0        5658.3     78490439
1399.70/358.71	c ****************................ | *.........               7490000 | 244391              1400.1        5349.7     89428846
1600.03/408.93	c ****************................ | *.........               8150000 | 267911              1600.1        5093.5     99877183
1800.08/459.11	c ****************................ | *.........               8853000 | 288846              1800.1        4918.1    110517464

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver version 3.2.9 (svn:503) (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w /tmp/evaluation-result-1779898-1243680129/watcher-1779898-1243680129 -o /tmp/evaluation-result-1779898-1243680129/solver-1779898-1243680129 -C 10000 -W 1000 -M 2047 HOME/ttsth-5-0 -num-threads 4 HOME/instance-1779898-1243680129.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 10000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 10030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 2096128 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 2147328 KiB
Current StackSize limit: 8192 KiB


[startup+0 s]
/proc/loadavg: 4.33 4.07 3.68 2/98 25686
/proc/meminfo: memFree=3073524/3368532 swapFree=1959840/1959888
[pid=25686] ppid=25684 vsize=1820 CPUtime=0.02
/proc/25686/stat : 25686 (ttsth-5-0) R 25684 25686 30226 0 -1 4202496 348 0 0 0 1 1 0 0 22 0 1 0 949589633 1863680 304 4294967295 134512640 135237372 3219179856 3219178652 134639534 0 0 0 0 0 0 0 17 1 0 0 0
/proc/25686/statm: 455 305 75 177 0 277 0

[startup+0.125675 s]
/proc/loadavg: 4.33 4.07 3.68 2/98 25686
/proc/meminfo: memFree=3073524/3368532 swapFree=1959840/1959888
[pid=25686] ppid=25684 vsize=6288 CPUtime=0.13
/proc/25686/stat : 25686 (ttsth-5-0) R 25684 25686 30226 0 -1 4202496 1477 0 0 0 11 2 0 0 24 0 1 0 949589633 6438912 1433 4294967295 134512640 135237372 3219179856 3219178380 134639534 0 0 0 0 0 0 0 17 1 0 0 0
/proc/25686/statm: 1572 1434 75 177 0 1394 0
Current children cumulated CPU time (s) 0.13
Current children cumulated vsize (KiB) 6288

[startup+0.215668 s]
/proc/loadavg: 4.33 4.07 3.68 2/98 25686
/proc/meminfo: memFree=3073524/3368532 swapFree=1959840/1959888
[pid=25686] ppid=25684 vsize=11348 CPUtime=0.22
/proc/25686/stat : 25686 (ttsth-5-0) R 25684 25686 30226 0 -1 4202496 2517 0 0 0 20 2 0 0 25 0 1 0 949589633 11620352 2473 4294967295 134512640 135237372 3219179856 3219179580 134533779 0 0 0 0 0 0 0 17 1 0 0 0
/proc/25686/statm: 2837 2473 75 177 0 2659 0
Current children cumulated CPU time (s) 0.22
Current children cumulated vsize (KiB) 11348

[startup+0.315659 s]
/proc/loadavg: 4.33 4.07 3.68 2/98 25686
/proc/meminfo: memFree=3073524/3368532 swapFree=1959840/1959888
[pid=25686] ppid=25684 vsize=11348 CPUtime=0.32
/proc/25686/stat : 25686 (ttsth-5-0) R 25684 25686 30226 0 -1 4202496 2630 0 0 0 30 2 0 0 25 0 1 0 949589633 11620352 2586 4294967295 134512640 135237372 3219179856 3219179548 134534394 0 0 0 0 0 0 0 17 1 0 0 0
/proc/25686/statm: 2837 2586 75 177 0 2659 0
Current children cumulated CPU time (s) 0.32
Current children cumulated vsize (KiB) 11348

[startup+0.715627 s]
/proc/loadavg: 4.33 4.07 3.68 2/98 25686
/proc/meminfo: memFree=3073524/3368532 swapFree=1959840/1959888
[pid=25686] ppid=25684 vsize=22576 CPUtime=0.72
/proc/25686/stat : 25686 (ttsth-5-0) R 25684 25686 30226 0 -1 4202496 5269 0 0 0 70 2 0 0 25 0 1 0 949589633 23117824 5224 4294967295 134512640 135237372 3219179856 3219179024 134749351 0 0 0 0 0 0 0 17 1 0 0 0
/proc/25686/statm: 5644 5224 76 177 0 5466 0
Current children cumulated CPU time (s) 0.72
Current children cumulated vsize (KiB) 22576

[startup+1.51556 s]
/proc/loadavg: 4.33 4.07 3.68 2/99 25688
/proc/meminfo: memFree=3050836/3368532 swapFree=1959840/1959888
[pid=25686] ppid=25684 vsize=25524 CPUtime=1.52
/proc/25686/stat : 25686 (ttsth-5-0) R 25684 25686 30226 0 -1 4202496 6620 0 0 0 150 2 0 0 25 0 1 0 949589633 26136576 6174 4294967295 134512640 135237372 3219179856 3219179184 134555272 0 0 0 0 0 0 0 17 1 0 0 0
/proc/25686/statm: 6381 6174 77 177 0 6203 0
Current children cumulated CPU time (s) 1.52
Current children cumulated vsize (KiB) 25524

[startup+3.11543 s]
/proc/loadavg: 4.06 4.02 3.67 2/99 25688
/proc/meminfo: memFree=3049652/3368532 swapFree=1959840/1959888
[pid=25686] ppid=25684 vsize=25688 CPUtime=3.12
/proc/25686/stat : 25686 (ttsth-5-0) R 25684 25686 30226 0 -1 4202496 6656 0 0 0 310 2 0 0 25 0 1 0 949589633 26304512 6210 4294967295 134512640 135237372 3219179856 3219179216 134600763 0 0 0 0 0 0 0 17 1 0 0 0
/proc/25686/statm: 6422 6210 77 177 0 6244 0
Current children cumulated CPU time (s) 3.12
Current children cumulated vsize (KiB) 25688

[startup+6.31517 s]
/proc/loadavg: 4.06 4.02 3.67 2/99 25689
/proc/meminfo: memFree=3049264/3368532 swapFree=1959840/1959888
[pid=25686] ppid=25684 vsize=25820 CPUtime=6.31
/proc/25686/stat : 25686 (ttsth-5-0) R 25684 25686 30226 0 -1 4202496 6697 0 0 0 629 2 0 0 25 0 1 0 949589633 26439680 6251 4294967295 134512640 135237372 3219179856 3219179216 134600707 0 0 0 0 0 0 0 17 1 0 0 0
/proc/25686/statm: 6455 6251 77 177 0 6277 0
Current children cumulated CPU time (s) 6.31
Current children cumulated vsize (KiB) 25820

[startup+12.7147 s]
/proc/loadavg: 3.83 3.97 3.66 5/103 25694
/proc/meminfo: memFree=2947772/3368532 swapFree=1959840/1959888
[pid=25686] ppid=25684 vsize=162448 CPUtime=18.38
/proc/25686/stat : 25686 (ttsth-5-0) S 25684 25686 30226 0 -1 4202496 33452 0 0 0 1829 9 0 0 25 0 5 0 949589633 166346752 32679 4294967295 134512640 135237372 3219179856 3219179452 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/25686/statm: 40612 32679 95 177 0 40434 0
[pid=25686/tid=25691] ppid=25684 vsize=162448 CPUtime=1.92
/proc/25686/task/25691/stat : 25691 (ttsth-5-0) R 25684 25686 30226 0 -1 4202560 947 0 0 0 191 1 0 0 25 0 5 0 949590712 166346752 32679 4294967295 134512640 135237372 3219179856 3082158728 134519944 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=25686/tid=25692] ppid=25684 vsize=162448 CPUtime=1.88
/proc/25686/task/25692/stat : 25692 (ttsth-5-0) R 25684 25686 30226 0 -1 4202560 867 0 0 0 187 1 0 0 25 0 5 0 949590712 166346752 32679 4294967295 134512640 135237372 3219179856 3073858076 134636641 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=25686/tid=25693] ppid=25684 vsize=162448 CPUtime=1.9
/proc/25686/task/25693/stat : 25693 (ttsth-5-0) R 25684 25686 30226 0 -1 4202560 836 0 0 0 190 0 0 0 25 0 5 0 949590712 166346752 32679 4294967295 134512640 135237372 3219179856 3065504320 134561463 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=25686/tid=25694] ppid=25684 vsize=162448 CPUtime=1.91
/proc/25686/task/25694/stat : 25694 (ttsth-5-0) R 25684 25686 30226 0 -1 4202560 1174 0 0 0 191 0 0 0 25 0 5 0 949590713 166346752 32679 4294967295 134512640 135237372 3219179856 3057022048 134680270 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 18.38
Current children cumulated vsize (KiB) 162448

[startup+25.5136 s]
/proc/loadavg: 3.94 3.99 3.66 5/103 25695
/proc/meminfo: memFree=2879432/3368532 swapFree=1959840/1959888
[pid=25686] ppid=25684 vsize=230804 CPUtime=69.57
/proc/25686/stat : 25686 (ttsth-5-0) S 25684 25686 30226 0 -1 4202496 49921 0 0 0 6935 22 0 0 25 0 5 0 949589633 236343296 49148 4294967295 134512640 135237372 3219179856 3219179452 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/25686/statm: 57701 49148 95 177 0 57523 0
[pid=25686/tid=25691] ppid=25684 vsize=230804 CPUtime=14.72
/proc/25686/task/25691/stat : 25691 (ttsth-5-0) R 25684 25686 30226 0 -1 4202560 4766 0 0 0 1467 5 0 0 25 0 5 0 949590712 236343296 49148 4294967295 134512640 135237372 3219179856 3082252892 134550044 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=25686/tid=25692] ppid=25684 vsize=230804 CPUtime=14.68
/proc/25686/task/25692/stat : 25692 (ttsth-5-0) R 25684 25686 30226 0 -1 4202560 5306 0 0 0 1462 6 0 0 25 0 5 0 949590712 236343296 49148 4294967295 134512640 135237372 3219179856 3073879792 134550989 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=25686/tid=25693] ppid=25684 vsize=230804 CPUtime=14.69
/proc/25686/task/25693/stat : 25693 (ttsth-5-0) R 25684 25686 30226 0 -1 4202560 5226 0 0 0 1466 3 0 0 25 0 5 0 949590712 236343296 49148 4294967295 134512640 135237372 3219179856 3065481888 134589547 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=25686/tid=25694] ppid=25684 vsize=230804 CPUtime=14.71
/proc/25686/task/25694/stat : 25694 (ttsth-5-0) R 25684 25686 30226 0 -1 4202560 4995 0 0 0 1470 1 0 0 25 0 5 0 949590713 236343296 49148 4294967295 134512640 135237372 3219179856 3057117104 134749343 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 69.57
Current children cumulated vsize (KiB) 230804

[startup+51.1115 s]
/proc/loadavg: 4.27 4.07 3.70 5/103 25879
/proc/meminfo: memFree=2798264/3368532 swapFree=1959840/1959888
[pid=25686] ppid=25684 vsize=316192 CPUtime=171.73
/proc/25686/stat : 25686 (ttsth-5-0) S 25684 25686 30226 0 -1 4202496 70574 0 0 0 17140 33 0 0 25 0 5 0 949589633 323780608 69801 4294967295 134512640 135237372 3219179856 3219179452 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/25686/statm: 79048 69801 95 177 0 78870 0
[pid=25686/tid=25691] ppid=25684 vsize=316192 CPUtime=40.26
/proc/25686/task/25691/stat : 25691 (ttsth-5-0) R 25684 25686 30226 0 -1 4202560 9636 0 0 0 4021 5 0 0 25 0 5 0 949590712 323780608 69801 4294967295 134512640 135237372 3219179856 3082280544 134749353 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=25686/tid=25692] ppid=25684 vsize=316192 CPUtime=40.2
/proc/25686/task/25692/stat : 25692 (ttsth-5-0) R 25684 25686 30226 0 -1 4202560 12075 0 0 0 4011 9 0 0 25 0 5 0 949590712 323780608 69801 4294967295 134512640 135237372 3219179856 3073883168 134592450 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=25686/tid=25693] ppid=25684 vsize=316192 CPUtime=40.25
/proc/25686/task/25693/stat : 25693 (ttsth-5-0) R 25684 25686 30226 0 -1 4202560 10277 0 0 0 4020 5 0 0 25 0 5 0 949590712 323780608 69801 4294967295 134512640 135237372 3219179856 3065444448 134562338 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=25686/tid=25694] ppid=25684 vsize=316192 CPUtime=40.25
/proc/25686/task/25694/stat : 25694 (ttsth-5-0) R 25684 25686 30226 0 -1 4202560 8958 0 0 0 4018 7 0 0 25 0 5 0 949590713 323780608 69801 4294967295 134512640 135237372 3219179856 3057060352 134562416 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 171.73
Current children cumulated vsize (KiB) 316192

[startup+102.307 s]
/proc/loadavg: 4.27 4.10 3.73 5/103 26071
/proc/meminfo: memFree=2559348/3368532 swapFree=1959840/1959888
[pid=25686] ppid=25684 vsize=566416 CPUtime=376.07
/proc/25686/stat : 25686 (ttsth-5-0) S 25684 25686 30226 0 -1 4202496 129768 0 0 0 37541 66 0 0 25 0 5 0 949589633 580009984 128995 4294967295 134512640 135237372 3219179856 3219179452 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/25686/statm: 141604 128995 95 177 0 141426 0
[pid=25686/tid=25691] ppid=25684 vsize=566416 CPUtime=91.22
/proc/25686/task/25691/stat : 25691 (ttsth-5-0) R 25684 25686 30226 0 -1 4202560 23811 0 0 0 9112 10 0 0 25 0 5 0 949590712 580009984 128995 4294967295 134512640 135237372 3219179856 3082144048 134562338 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=25686/tid=25692] ppid=25684 vsize=566416 CPUtime=91.37
/proc/25686/task/25692/stat : 25692 (ttsth-5-0) R 25684 25686 30226 0 -1 4202560 30191 0 0 0 9122 15 0 0 25 0 5 0 949590712 580009984 128995 4294967295 134512640 135237372 3219179856 3073760864 134546026 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=25686/tid=25693] ppid=25684 vsize=566416 CPUtime=91.35
/proc/25686/task/25693/stat : 25693 (ttsth-5-0) R 25684 25686 30226 0 -1 4202560 26609 0 0 0 9119 16 0 0 25 0 5 0 949590712 580009984 128995 4294967295 134512640 135237372 3219179856 3065401808 134680282 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=25686/tid=25694] ppid=25684 vsize=566416 CPUtime=91.35
/proc/25686/task/25694/stat : 25694 (ttsth-5-0) R 25684 25686 30226 0 -1 4202560 19529 0 0 0 9117 18 0 0 25 0 5 0 949590713 580009984 128995 4294967295 134512640 135237372 3219179856 3057108688 134588255 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 376.07
Current children cumulated vsize (KiB) 566416

[startup+162.312 s]
/proc/loadavg: 4.18 4.11 3.75 5/103 26259
/proc/meminfo: memFree=2299360/3368532 swapFree=1959840/1959888
[pid=25686] ppid=25684 vsize=844092 CPUtime=615.85
/proc/25686/stat : 25686 (ttsth-5-0) S 25684 25686 30226 0 -1 4202496 195297 0 0 0 61483 102 0 0 25 0 5 0 949589633 864350208 194524 4294967295 134512640 135237372 3219179856 3219179452 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/25686/statm: 211023 194524 95 177 0 210845 0
[pid=25686/tid=25691] ppid=25684 vsize=844092 CPUtime=151.18
/proc/25686/task/25691/stat : 25691 (ttsth-5-0) R 25684 25686 30226 0 -1 4202560 50625 0 0 0 15094 24 0 0 25 0 5 0 949590712 864350208 194524 4294967295 134512640 135237372 3219179856 3082237216 134562334 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=25686/tid=25692] ppid=25684 vsize=844092 CPUtime=151.36
/proc/25686/task/25692/stat : 25692 (ttsth-5-0) R 25684 25686 30226 0 -1 4202560 43733 0 0 0 15114 22 0 0 25 0 5 0 949590712 864350208 194524 4294967295 134512640 135237372 3219179856 3073868176 134749353 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=25686/tid=25693] ppid=25684 vsize=844092 CPUtime=151.21
/proc/25686/task/25693/stat : 25693 (ttsth-5-0) R 25684 25686 30226 0 -1 4202560 44092 0 0 0 15096 25 0 0 25 0 5 0 949590712 864350208 194524 4294967295 134512640 135237372 3219179856 3065473248 134591221 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=25686/tid=25694] ppid=25684 vsize=844092 CPUtime=151.32
/proc/25686/task/25694/stat : 25694 (ttsth-5-0) R 25684 25686 30226 0 -1 4202560 27219 0 0 0 15108 24 0 0 25 0 5 0 949590713 864350208 194524 4294967295 134512640 135237372 3219179856 3057077312 134562338 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 615.85
Current children cumulated vsize (KiB) 844092

[startup+222.308 s]
/proc/loadavg: 4.17 4.12 3.77 5/103 26445
/proc/meminfo: memFree=2032644/3368532 swapFree=1959840/1959888
[pid=25686] ppid=25684 vsize=1123836 CPUtime=855.57
/proc/25686/stat : 25686 (ttsth-5-0) S 25684 25686 30226 0 -1 4202496 261311 0 0 0 85422 135 0 0 25 0 5 0 949589633 1150808064 260538 4294967295 134512640 135237372 3219179856 3219179452 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/25686/statm: 280959 260538 95 177 0 280781 0
[pid=25686/tid=25691] ppid=25684 vsize=1123836 CPUtime=211.13
/proc/25686/task/25691/stat : 25691 (ttsth-5-0) R 25684 25686 30226 0 -1 4202560 74340 0 0 0 21080 33 0 0 25 0 5 0 949590712 1150808064 260538 4294967295 134512640 135237372 3219179856 3082236544 134546026 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=25686/tid=25692] ppid=25684 vsize=1123836 CPUtime=211.29
/proc/25686/task/25692/stat : 25692 (ttsth-5-0) R 25684 25686 30226 0 -1 4202560 54903 0 0 0 21100 29 0 0 25 0 5 0 949590712 1150808064 260538 4294967295 134512640 135237372 3219179856 3073890496 134549903 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=25686/tid=25693] ppid=25684 vsize=1123836 CPUtime=211.09
/proc/25686/task/25693/stat : 25693 (ttsth-5-0) R 25684 25686 30226 0 -1 4202560 59775 0 0 0 21077 32 0 0 25 0 5 0 949590712 1150808064 260538 4294967295 134512640 135237372 3219179856 3065498448 134591171 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=25686/tid=25694] ppid=25684 vsize=1123836 CPUtime=211.28
/proc/25686/task/25694/stat : 25694 (ttsth-5-0) R 25684 25686 30226 0 -1 4202560 42665 0 0 0 21094 34 0 0 25 0 5 0 949590713 1150808064 260538 4294967295 134512640 135237372 3219179856 3057083616 134680251 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 855.57
Current children cumulated vsize (KiB) 1123836

[startup+282.313 s]
/proc/loadavg: 4.27 4.14 3.80 5/103 26634
/proc/meminfo: memFree=1816660/3368532 swapFree=1959840/1959888
[pid=25686] ppid=25684 vsize=1355824 CPUtime=1095.3
/proc/25686/stat : 25686 (ttsth-5-0) S 25684 25686 30226 0 -1 4202496 316002 0 0 0 109365 165 0 0 25 0 5 0 949589633 1388363776 315229 4294967295 134512640 135237372 3219179856 3219179452 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/25686/statm: 338956 315229 95 177 0 338778 0
[pid=25686/tid=25691] ppid=25684 vsize=1355824 CPUtime=271.14
/proc/25686/task/25691/stat : 25691 (ttsth-5-0) R 25684 25686 30226 0 -1 4202560 91866 0 0 0 27076 38 0 0 25 0 5 0 949590712 1388363776 315229 4294967295 134512640 135237372 3219179856 3082233904 134546034 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=25686/tid=25692] ppid=25684 vsize=1355824 CPUtime=271.09
/proc/25686/task/25692/stat : 25692 (ttsth-5-0) R 25684 25686 30226 0 -1 4202560 63363 0 0 0 27076 33 0 0 25 0 5 0 949590712 1388363776 315229 4294967295 134512640 135237372 3219179856 3073860560 134680217 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=25686/tid=25693] ppid=25684 vsize=1355824 CPUtime=271.05
/proc/25686/task/25693/stat : 25693 (ttsth-5-0) R 25684 25686 30226 0 -1 4202560 76616 0 0 0 27063 42 0 0 25 0 5 0 949590712 1388363776 315229 4294967295 134512640 135237372 3219179856 3065466400 134562380 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=25686/tid=25694] ppid=25684 vsize=1355824 CPUtime=271.24
/proc/25686/task/25694/stat : 25694 (ttsth-5-0) R 25684 25686 30226 0 -1 4202560 54529 0 0 0 27079 45 0 0 25 0 5 0 949590713 1388363776 315229 4294967295 134512640 135237372 3219179856 3057119536 134562338 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1095.3
Current children cumulated vsize (KiB) 1355824

[startup+342.318 s]
/proc/loadavg: 4.43 4.19 3.84 5/103 26824
/proc/meminfo: memFree=1593876/3368532 swapFree=1959840/1959888
[pid=25686] ppid=25684 vsize=1588560 CPUtime=1334.49
/proc/25686/stat : 25686 (ttsth-5-0) S 25684 25686 30226 0 -1 4202496 370860 0 0 0 133230 219 0 0 25 0 5 0 949589633 1626685440 370087 4294967295 134512640 135237372 3219179856 3219179452 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/25686/statm: 397140 370087 95 177 0 396962 0
[pid=25686/tid=25691] ppid=25684 vsize=1588560 CPUtime=331.11
/proc/25686/task/25691/stat : 25691 (ttsth-5-0) R 25684 25686 30226 0 -1 4202560 109859 0 0 0 33054 57 0 0 25 0 5 0 949590712 1626685440 370087 4294967295 134512640 135237372 3219179856 3082274512 134546026 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=25686/tid=25692] ppid=25684 vsize=1588560 CPUtime=330.53
/proc/25686/task/25692/stat : 25692 (ttsth-5-0) R 25684 25686 30226 0 -1 4202560 74065 0 0 0 33014 39 0 0 25 0 5 0 949590712 1626685440 370087 4294967295 134512640 135237372 3219179856 3073868816 134680320 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=25686/tid=25693] ppid=25684 vsize=1588560 CPUtime=331
/proc/25686/task/25693/stat : 25693 (ttsth-5-0) R 25684 25686 30226 0 -1 4202560 92586 0 0 0 33052 48 0 0 25 0 5 0 949590712 1626685440 370087 4294967295 134512640 135237372 3219179856 3065492828 134680208 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=25686/tid=25694] ppid=25684 vsize=1588560 CPUtime=331.07
/proc/25686/task/25694/stat : 25694 (ttsth-5-0) R 25684 25686 30226 0 -1 4202560 64722 0 0 0 33039 68 0 0 25 0 5 0 949590713 1626685440 370087 4294967295 134512640 135237372 3219179856 3057070752 134562338 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1334.49
Current children cumulated vsize (KiB) 1588560

[startup+402.313 s]
/proc/loadavg: 4.33 4.19 3.86 6/104 26971
/proc/meminfo: memFree=1406396/3368532 swapFree=1959840/1959888
[pid=25686] ppid=25684 vsize=1788764 CPUtime=1573.81
/proc/25686/stat : 25686 (ttsth-5-0) S 25684 25686 30226 0 -1 4202496 418270 0 0 0 157137 244 0 0 25 0 5 0 949589633 1831694336 417497 4294967295 134512640 135237372 3219179856 3219179452 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/25686/statm: 447191 417497 95 177 0 447013 0
[pid=25686/tid=25691] ppid=25684 vsize=1788764 CPUtime=391.07
/proc/25686/task/25691/stat : 25691 (ttsth-5-0) R 25684 25686 30226 0 -1 4202560 125281 0 0 0 39045 62 0 0 25 0 5 0 949590712 1831694336 417497 4294967295 134512640 135237372 3219179856 3082237600 134546034 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=25686/tid=25692] ppid=25684 vsize=1788764 CPUtime=389.96
/proc/25686/task/25692/stat : 25692 (ttsth-5-0) R 25684 25686 30226 0 -1 4202560 84436 0 0 0 38951 45 0 0 25 0 5 0 949590712 1831694336 417497 4294967295 134512640 135237372 3219179856 3073809232 134562338 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=25686/tid=25693] ppid=25684 vsize=1788764 CPUtime=390.98
/proc/25686/task/25693/stat : 25693 (ttsth-5-0) R 25684 25686 30226 0 -1 4202560 106341 0 0 0 39040 58 0 0 25 0 5 0 949590712 1831694336 417497 4294967295 134512640 135237372 3219179856 3065419936 134749343 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=25686/tid=25694] ppid=25684 vsize=1788764 CPUtime=391.02
/proc/25686/task/25694/stat : 25694 (ttsth-5-0) R 25684 25686 30226 0 -1 4202560 72584 0 0 0 39030 72 0 0 25 0 5 0 949590713 1831694336 417497 4294967295 134512640 135237372 3219179856 3057085408 134562338 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1573.81
Current children cumulated vsize (KiB) 1788764

[startup+462.308 s]
/proc/loadavg: 4.57 4.27 3.91 5/103 27204
/proc/meminfo: memFree=1205956/3368532 swapFree=1959840/1959888
[pid=25686] ppid=25684 vsize=1999680 CPUtime=1812.86
/proc/25686/stat : 25686 (ttsth-5-0) S 25684 25686 30226 0 -1 4202496 467947 0 0 0 181019 267 0 0 25 0 5 0 949589633 2047672320 467174 4294967295 134512640 135237372 3219179856 3219179452 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/25686/statm: 499920 467174 95 177 0 499742 0
[pid=25686/tid=25691] ppid=25684 vsize=1999680 CPUtime=451
/proc/25686/task/25691/stat : 25691 (ttsth-5-0) R 25684 25686 30226 0 -1 4202560 139218 0 0 0 45035 65 0 0 25 0 5 0 949590712 2047672320 467174 4294967295 134512640 135237372 3219179856 3082237072 134546026 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=25686/tid=25692] ppid=25684 vsize=1999680 CPUtime=449.78
/proc/25686/task/25692/stat : 25692 (ttsth-5-0) R 25684 25686 30226 0 -1 4202560 98083 0 0 0 44924 54 0 0 25 0 5 0 949590712 2047672320 467174 4294967295 134512640 135237372 3219179856 3073757760 134562338 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=25686/tid=25693] ppid=25684 vsize=1999680 CPUtime=450.94
/proc/25686/task/25693/stat : 25693 (ttsth-5-0) R 25684 25686 30226 0 -1 4202560 120245 0 0 0 45030 64 0 0 25 0 5 0 949590712 2047672320 467174 4294967295 134512640 135237372 3219179856 3065368544 134562338 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=25686/tid=25694] ppid=25684 vsize=1999680 CPUtime=450.36
/proc/25686/task/25694/stat : 25694 (ttsth-5-0) R 25684 25686 30226 0 -1 4202560 80773 0 0 0 44959 77 0 0 25 0 5 0 949590713 2047672320 467174 4294967295 134512640 135237372 3219179856 3057092096 134551002 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 1812.86
Current children cumulated vsize (KiB) 1999680



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+489.306 s]
/proc/loadavg: 4.45 4.27 3.91 5/103 27205
/proc/meminfo: memFree=1113940/3368532 swapFree=1959840/1959888
[pid=25686] ppid=25684 vsize=2096816 CPUtime=1920.82
/proc/25686/stat : 25686 (ttsth-5-0) S 25684 25686 30226 0 -1 4202496 490699 0 0 0 191798 284 0 0 25 0 5 0 949589633 2147139584 489926 4294967295 134512640 135237372 3219179856 3219179452 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/25686/statm: 524204 489926 95 177 0 524026 0
[pid=25686/tid=25691] ppid=25684 vsize=2096816 CPUtime=478.01
/proc/25686/task/25691/stat : 25691 (ttsth-5-0) R 25684 25686 30226 0 -1 4202560 145015 0 0 0 47734 67 0 0 25 0 5 0 949590712 2147139584 489926 4294967295 134512640 135237372 3219179856 3082227808 134546026 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=25686/tid=25692] ppid=25684 vsize=2096816 CPUtime=476.78
/proc/25686/task/25692/stat : 25692 (ttsth-5-0) R 25684 25686 30226 0 -1 4202560 104299 0 0 0 47621 57 0 0 25 0 5 0 949590712 2147139584 489926 4294967295 134512640 135237372 3219179856 3073862048 134749343 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=25686/tid=25693] ppid=25684 vsize=2096816 CPUtime=477.89
/proc/25686/task/25693/stat : 25693 (ttsth-5-0) R 25684 25686 30226 0 -1 4202560 127777 0 0 0 47716 73 0 0 25 0 5 0 949590712 2147139584 489927 4294967295 134512640 135237372 3219179856 3065462160 134546026 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=25686/tid=25694] ppid=25684 vsize=2096816 CPUtime=477.36
/proc/25686/task/25694/stat : 25694 (ttsth-5-0) R 25684 25686 30226 0 -1 4202560 83981 0 0 0 47656 80 0 0 25 0 5 0 949590713 2147139584 489927 4294967295 134512640 135237372 3219179856 3057099724 134550976 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 1920.82
Current children cumulated vsize (KiB) 2096816

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+489.426 s]
/proc/loadavg: 4.45 4.27 3.91 5/103 27205
/proc/meminfo: memFree=1113940/3368532 swapFree=1959840/1959888
[pid=25686] ppid=25684 vsize=0 CPUtime=1920.98
/proc/25686/stat : 25686 (ttsth-5-0) Z 25684 25686 30226 0 -1 4203524 490715 0 0 0 191805 293 0 0 18 0 2 0 949589633 0 0 4294967295 0 0 0 0 0 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/25686/statm: 0 0 0 0 0 0 0
[pid=25686/tid=25694] ppid=25684 vsize=0 CPUtime=477.47
/proc/25686/task/25694/stat : 25694 (ttsth-5-0) R 25684 25686 30226 0 -1 4203588 83983 0 0 0 47658 89 0 0 25 0 2 0 949590713 0 0 4294967295 0 0 0 0 0 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 1920.98
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 489.429
CPU time (s): 1920.99
CPU user time (s): 1918.05
CPU system time (s): 2.94
CPU usage (%): 392.496
Max. virtual memory (cumulated for all children) (KiB): 2096816

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1918.05
system time used= 2.94
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 490715
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2625
involuntary context switches= 35707

runsolver used 0.01 second user time and 0 second system time

The end

Launcher Data 

Begin job on tipi39 at 2009-05-30 12:42:09
IDJOB=1779898
IDBENCH=70939
IDSOLVER=632
FILE ID=tipi39/1779898-1243680129
PBS_JOBID=
Free space on /tmp= 5741 MiB

SOLVER NAME= ttsth-5-0 2009-03-19 (4 threads)
BENCH NAME= SAT09/APPLICATIONS/bioinfo/q_query_3_l42_lambda.cnf
COMMAND LINE= HOME/ttsth-5-0 -num-threads MAXNBTHREAD BENCHNAME
RUNSOLVER COMMAND LINE= runsolver --timestamp  -w /tmp/evaluation-result-1779898-1243680129/watcher-1779898-1243680129 -o /tmp/evaluation-result-1779898-1243680129/solver-1779898-1243680129 -C 10000 -W 1000 -M 2047  HOME/ttsth-5-0 -num-threads 4 HOME/instance-1779898-1243680129.cnf

TIME LIMIT= 10000 seconds
MEMORY LIMIT= 2047 MiB
MAX NB THREAD= 4

MD5SUM BENCH= f7e4b8eacc29c0297225e4db3860ba3b
RANDOM SEED= 315139378

Linux tipi39 2.6.21.5 #6 SMP Wed Jul 4 17:16:38 CEST 2007 i686 GNU/Linux

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.067
cache size	: 4096 KB
physical id	: 0
siblings	: 2
core id		: 0
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3992.41
clflush size	: 64

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.067
cache size	: 4096 KB
physical id	: 0
siblings	: 2
core id		: 1
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.10
clflush size	: 64

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.067
cache size	: 4096 KB
physical id	: 3
siblings	: 2
core id		: 0
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.16
clflush size	: 64

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.067
cache size	: 4096 KB
physical id	: 3
siblings	: 2
core id		: 1
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.15
clflush size	: 64


/proc/meminfo:
MemTotal:      3368532 kB
MemFree:       3074116 kB
Buffers:         83580 kB
Cached:         100056 kB
SwapCached:          0 kB
Active:         122056 kB
Inactive:        77480 kB
HighTotal:     2489216 kB
HighFree:      2375560 kB
LowTotal:       879316 kB
LowFree:        698556 kB
SwapTotal:     1959888 kB
SwapFree:      1959840 kB
Dirty:            3576 kB
Writeback:           0 kB
AnonPages:       16384 kB
Mapped:           6132 kB
Slab:            84020 kB
SReclaimable:    73712 kB
SUnreclaim:      10308 kB
PageTables:        520 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:   3644152 kB
Committed_AS:    94800 kB
VmallocTotal:   114680 kB
VmallocUsed:      1444 kB
VmallocChunk:   113072 kB

Free space on /tmp at the end= 5741 MiB
End job on tipi39 at 2009-05-30 12:50:20