Trace number 1780018

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ttsth-5-0 2009-03-19 (4 threads)? (MO) 1548.35 399.237

General information on the benchmark

NameAPPLICATIONS/bioinfo/
q_query_3_l48_lambda.cnf
MD5SUMe7c28f6a200a1c1912fbaacfb3572515
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark417.27
Satisfiable
(Un)Satisfiability was proved
Number of variables34656
Number of clauses174528
Sum of the clauses size503708
Maximum clause length9
Minimum clause length1
Number of clauses of size 14424
Number of clauses of size 242805
Number of clauses of size 3103458
Number of clauses of size 416481
Number of clauses of size 57216
Number of clauses of size over 5144

Solver Data 

0.42/0.41	c Command: HOME/ttsth-5-0 -num-threads 4 HOME/instance-1780018-1243680621.cnf 
0.42/0.41	c Using SATTIMEOUT of 10000
0.42/0.41	c Using SATRAM of 2047
0.42/0.41	c Size of subset node = 16
0.42/0.41	c Variables = 34656
0.42/0.41	c Clauses = 174528
0.42/0.41	c Literals = 503708
0.42/0.41	c Reduced size:
0.42/0.41	c Variables = 34656
0.42/0.41	c Clauses = 157923
0.42/0.41	c Literals = 462041
0.42/0.41	c a2
0.72/0.81	c a1
12.32/12.32	c Independent sub-problems = 1
12.32/12.32	c Sub-problem with 29324 variables and 157923 clauses
12.32/12.32	c using permutation method 4
12.32/12.32	c count = 1
12.32/12.32	c Ordering finished 12.260 seconds
12.32/12.32	c mapped 12.330 seconds
12.32/12.32	c permuted 12.330 seconds
12.32/12.32	c about to sort
12.32/12.38	c sorted
15.12/15.14	c clauses now 157923
15.12/15.14	c init finished 12.580 seconds
15.12/15.14	c tree built 15.150 seconds
15.12/15.14	c 
15.12/15.14	c PA progress                      | CPU progress Partial assignments | improvements      CPU time        PA/sec        nodes
15.12/15.14	c ---------------------------------|----------------------------------|------------------------------------------------------
15.12/15.14	c ................................ | ..........                       |                       15.2           0.0             
15.12/15.14	c ................................ | ..........                     1 |                       15.2           0.1             
15.12/15.14	c ****************................ | ..........                     2 |                       15.2           0.1            1
15.12/15.14	c ****************................ | ..........                     3 |                       15.2           0.2            1
15.12/15.14	c ****************................ | ..........                     4 |                       15.2           0.3            1
15.12/15.14	c ****************................ | ..........                     5 |                       15.2           0.3            1
15.12/15.14	c ****************................ | ..........                     6 |                       15.2           0.4            1
15.12/15.15	c ****************................ | ..........                  1000 | 3                     15.2          66.0          111
199.83/61.48	c ****************................ | ..........               2309000 | 94271                200.1       11541.0     16315062
399.82/111.56	c ****************................ | ..........               3894000 | 147624               400.1        9733.5     31472193
599.95/161.66	c ****************................ | ..........               5295000 | 195672               600.1        8823.4     48261752
800.00/211.72	c ****************................ | ..........               6537000 | 238559               800.0        8170.8     65098959
999.67/261.80	c ****************................ | *.........               7693000 | 279552              1000.0        7692.8     78662775
1199.98/311.82	c ****************................ | *.........               8750000 | 316795              1200.1        7291.3     92720198
1399.68/361.91	c ****************................ | *.........               9730000 | 350759              1400.0        6949.8    105885278

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver version 3.2.9 (svn:503) (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w /tmp/evaluation-result-1780018-1243680621/watcher-1780018-1243680621 -o /tmp/evaluation-result-1780018-1243680621/solver-1780018-1243680621 -C 10000 -W 1000 -M 2047 HOME/ttsth-5-0 -num-threads 4 HOME/instance-1780018-1243680621.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 10000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 10030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 2096128 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 2147328 KiB
Current StackSize limit: 8192 KiB


[startup+0 s]
/proc/loadavg: 4.09 4.19 3.89 3/98 27245
/proc/meminfo: memFree=3073456/3368532 swapFree=1959840/1959888
[pid=27245] ppid=27243 vsize=1140 CPUtime=0.01
/proc/27245/stat : 27245 (ttsth-5-0) R 27243 27245 30226 0 -1 4202496 177 0 0 0 1 0 0 0 18 0 1 0 949638906 1167360 132 4294967295 134512640 135237372 3213599744 3213599192 134732614 0 0 0 0 0 0 0 17 2 0 0 0
/proc/27245/statm: 285 132 75 177 0 107 0

[startup+0.042521 s]
/proc/loadavg: 4.09 4.19 3.89 3/98 27245
/proc/meminfo: memFree=3073456/3368532 swapFree=1959840/1959888
[pid=27245] ppid=27243 vsize=2916 CPUtime=0.05
/proc/27245/stat : 27245 (ttsth-5-0) R 27243 27245 30226 0 -1 4202496 597 0 0 0 5 0 0 0 18 0 1 0 949638906 2985984 552 4294967295 134512640 135237372 3213599744 3213598268 134639534 0 0 0 0 0 0 0 17 2 0 0 0
/proc/27245/statm: 729 553 75 177 0 551 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 2916

[startup+0.112513 s]
/proc/loadavg: 4.09 4.19 3.89 3/98 27245
/proc/meminfo: memFree=3073456/3368532 swapFree=1959840/1959888
[pid=27245] ppid=27243 vsize=5888 CPUtime=0.12
/proc/27245/stat : 27245 (ttsth-5-0) R 27243 27245 30226 0 -1 4202496 1346 0 0 0 11 1 0 0 18 0 1 0 949638906 6029312 1301 4294967295 134512640 135237372 3213599744 3213599192 134732614 0 0 0 0 0 0 0 17 2 0 0 0
/proc/27245/statm: 1472 1301 75 177 0 1294 0
Current children cumulated CPU time (s) 0.12
Current children cumulated vsize (KiB) 5888

[startup+0.312501 s]
/proc/loadavg: 4.09 4.19 3.89 3/98 27245
/proc/meminfo: memFree=3073456/3368532 swapFree=1959840/1959888
[pid=27245] ppid=27243 vsize=12976 CPUtime=0.32
/proc/27245/stat : 27245 (ttsth-5-0) R 27243 27245 30226 0 -1 4202496 3057 0 0 0 30 2 0 0 18 0 1 0 949638906 13287424 3012 4294967295 134512640 135237372 3213599744 3213599436 134534118 0 0 0 0 0 0 0 17 2 0 0 0
/proc/27245/statm: 3244 3012 75 177 0 3066 0
Current children cumulated CPU time (s) 0.32
Current children cumulated vsize (KiB) 12976

[startup+0.712464 s]
/proc/loadavg: 4.09 4.19 3.89 3/98 27245
/proc/meminfo: memFree=3073456/3368532 swapFree=1959840/1959888
[pid=27245] ppid=27243 vsize=25152 CPUtime=0.72
/proc/27245/stat : 27245 (ttsth-5-0) R 27243 27245 30226 0 -1 4202496 6039 0 0 0 69 3 0 0 18 0 1 0 949638906 25755648 5963 4294967295 134512640 135237372 3213599744 3213598368 134680282 0 0 0 0 0 0 0 17 2 0 0 0
/proc/27245/statm: 6288 5963 76 177 0 6110 0
Current children cumulated CPU time (s) 0.72
Current children cumulated vsize (KiB) 25152

[startup+1.5124 s]
/proc/loadavg: 4.09 4.19 3.89 2/99 27246
/proc/meminfo: memFree=3050220/3368532 swapFree=1959840/1959888
[pid=27245] ppid=27243 vsize=29864 CPUtime=1.52
/proc/27245/stat : 27245 (ttsth-5-0) R 27243 27245 30226 0 -1 4202496 7826 0 0 0 149 3 0 0 20 0 1 0 949638906 30580736 7240 4294967295 134512640 135237372 3213599744 3213599072 134555272 0 0 0 0 0 0 0 17 2 0 0 0
/proc/27245/statm: 7466 7240 77 177 0 7288 0
Current children cumulated CPU time (s) 1.52
Current children cumulated vsize (KiB) 29864

[startup+3.11227 s]
/proc/loadavg: 4.09 4.19 3.89 2/99 27246
/proc/meminfo: memFree=3045164/3368532 swapFree=1959840/1959888
[pid=27245] ppid=27243 vsize=29864 CPUtime=3.12
/proc/27245/stat : 27245 (ttsth-5-0) R 27243 27245 30226 0 -1 4202496 7839 0 0 0 309 3 0 0 25 0 1 0 949638906 30580736 7253 4294967295 134512640 135237372 3213599744 3213599104 134600975 0 0 0 0 0 0 0 17 2 0 0 0
/proc/27245/statm: 7466 7253 77 177 0 7288 0
Current children cumulated CPU time (s) 3.12
Current children cumulated vsize (KiB) 29864

[startup+6.31201 s]
/proc/loadavg: 3.84 4.14 3.88 2/99 27246
/proc/meminfo: memFree=3044892/3368532 swapFree=1959840/1959888
[pid=27245] ppid=27243 vsize=30580 CPUtime=6.32
/proc/27245/stat : 27245 (ttsth-5-0) R 27243 27245 30226 0 -1 4202496 7960 0 0 0 629 3 0 0 25 0 1 0 949638906 31313920 7374 4294967295 134512640 135237372 3213599744 3213599104 134600718 0 0 0 0 0 0 0 17 2 0 0 0
/proc/27245/statm: 7645 7374 77 177 0 7467 0
Current children cumulated CPU time (s) 6.32
Current children cumulated vsize (KiB) 30580

[startup+12.7115 s]
/proc/loadavg: 3.61 4.09 3.86 2/99 27247
/proc/meminfo: memFree=3044576/3368532 swapFree=1959840/1959888
[pid=27245] ppid=27243 vsize=98140 CPUtime=12.72
/proc/27245/stat : 27245 (ttsth-5-0) R 27243 27245 30226 0 -1 4202496 25079 0 0 0 1265 7 0 0 25 0 1 0 949638906 100495360 24338 4294967295 134512640 135237372 3213599744 3213597008 134551480 0 0 0 0 0 0 0 17 2 0 0 0
/proc/27245/statm: 24535 24338 91 177 0 24357 0
Current children cumulated CPU time (s) 12.72
Current children cumulated vsize (KiB) 98140

[startup+25.5104 s]
/proc/loadavg: 3.50 4.04 3.85 5/103 27434
/proc/meminfo: memFree=2857816/3368532 swapFree=1959840/1959888
[pid=27245] ppid=27243 vsize=252528 CPUtime=56.27
/proc/27245/stat : 27245 (ttsth-5-0) S 27243 27245 30226 0 -1 4202496 55437 0 0 0 5604 23 0 0 25 0 5 0 949638906 258588672 54412 4294967295 134512640 135237372 3213599744 3213599340 134629544 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/27245/statm: 63132 54412 95 177 0 62954 0
[pid=27245/tid=27248] ppid=27243 vsize=252528 CPUtime=10.3
/proc/27245/task/27248/stat : 27248 (ttsth-5-0) R 27243 27245 30226 0 -1 4202560 3790 0 0 0 1028 2 0 0 25 0 5 0 949640421 258588672 54412 4294967295 134512640 135237372 3213599744 3075922320 134546026 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=27245/tid=27249] ppid=27243 vsize=252528 CPUtime=10.19
/proc/27245/task/27249/stat : 27249 (ttsth-5-0) R 27243 27245 30226 0 -1 4202560 5817 0 0 0 1017 2 0 0 25 0 5 0 949640421 258588672 54412 4294967295 134512640 135237372 3213599744 3067907104 134551736 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=27245/tid=27250] ppid=27243 vsize=252528 CPUtime=10.36
/proc/27245/task/27250/stat : 27250 (ttsth-5-0) R 27243 27245 30226 0 -1 4202560 6513 0 0 0 1030 6 0 0 25 0 5 0 949640421 258588672 54412 4294967295 134512640 135237372 3213599744 3059285664 134562338 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=27245/tid=27251] ppid=27243 vsize=252528 CPUtime=10.27
/proc/27245/task/27251/stat : 27251 (ttsth-5-0) R 27243 27245 30226 0 -1 4202560 4130 0 0 0 1021 6 0 0 25 0 5 0 949640422 258588672 54412 4294967295 134512640 135237372 3213599744 3050732060 134549872 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 56.27
Current children cumulated vsize (KiB) 252528

[startup+51.1084 s]
/proc/loadavg: 3.67 4.03 3.85 5/103 27438
/proc/meminfo: memFree=2717520/3368532 swapFree=1959840/1959888
[pid=27245] ppid=27243 vsize=403140 CPUtime=158.63
/proc/27245/stat : 27245 (ttsth-5-0) S 27243 27245 30226 0 -1 4202496 90887 0 0 0 15814 49 0 0 25 0 5 0 949638906 412815360 89862 4294967295 134512640 135237372 3213599744 3213599340 134629544 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/27245/statm: 100785 89862 95 177 0 100607 0
[pid=27245/tid=27248] ppid=27243 vsize=403140 CPUtime=35.87
/proc/27245/task/27248/stat : 27248 (ttsth-5-0) R 27243 27245 30226 0 -1 4202560 11094 0 0 0 3583 4 0 0 25 0 5 0 949640421 412815360 89862 4294967295 134512640 135237372 3213599744 3075915328 134562338 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=27245/tid=27249] ppid=27243 vsize=403140 CPUtime=35.78
/proc/27245/task/27249/stat : 27249 (ttsth-5-0) R 27243 27245 30226 0 -1 4202560 14755 0 0 0 3567 11 0 0 25 0 5 0 949640421 412815360 89862 4294967295 134512640 135237372 3213599744 3067735568 134562459 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=27245/tid=27250] ppid=27243 vsize=403140 CPUtime=35.96
/proc/27245/task/27250/stat : 27250 (ttsth-5-0) R 27243 27245 30226 0 -1 4202560 16307 0 0 0 3581 15 0 0 25 0 5 0 949640421 412815360 89862 4294967295 134512640 135237372 3213599744 3059340848 134590368 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=27245/tid=27251] ppid=27243 vsize=403140 CPUtime=35.87
/proc/27245/task/27251/stat : 27251 (ttsth-5-0) R 27243 27245 30226 0 -1 4202560 13544 0 0 0 3575 12 0 0 25 0 5 0 949640422 412815360 89862 4294967295 134512640 135237372 3213599744 3050854752 134592211 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 158.63
Current children cumulated vsize (KiB) 403140

[startup+102.314 s]
/proc/loadavg: 4.15 4.10 3.88 5/103 27623
/proc/meminfo: memFree=2473520/3368532 swapFree=1959840/1959888
[pid=27245] ppid=27243 vsize=657620 CPUtime=363.08
/proc/27245/stat : 27245 (ttsth-5-0) S 27243 27245 30226 0 -1 4202496 151255 0 0 0 36213 95 0 0 25 0 5 0 949638906 673402880 150230 4294967295 134512640 135237372 3213599744 3213599340 134629544 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/27245/statm: 164405 150230 95 177 0 164227 0
[pid=27245/tid=27248] ppid=27243 vsize=657620 CPUtime=86.99
/proc/27245/task/27248/stat : 27248 (ttsth-5-0) R 27243 27245 30226 0 -1 4202560 22969 0 0 0 8686 13 0 0 25 0 5 0 949640421 673402880 150230 4294967295 134512640 135237372 3213599744 3075958768 134561428 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=27245/tid=27249] ppid=27243 vsize=657620 CPUtime=86.85
/proc/27245/task/27249/stat : 27249 (ttsth-5-0) R 27243 27245 30226 0 -1 4202560 31343 0 0 0 8659 26 0 0 25 0 5 0 949640421 673402880 150230 4294967295 134512640 135237372 3213599744 3067756768 134562338 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=27245/tid=27250] ppid=27243 vsize=657620 CPUtime=87.01
/proc/27245/task/27250/stat : 27250 (ttsth-5-0) R 27243 27245 30226 0 -1 4202560 36345 0 0 0 8672 29 0 0 25 0 5 0 949640421 673402880 150230 4294967295 134512640 135237372 3213599744 3059143244 134636641 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=27245/tid=27251] ppid=27243 vsize=657620 CPUtime=87.08
/proc/27245/task/27251/stat : 27251 (ttsth-5-0) R 27243 27245 30226 0 -1 4202560 25411 0 0 0 8688 20 0 0 25 0 5 0 949640422 673402880 150230 4294967295 134512640 135237372 3213599744 3050863728 134562338 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 363.08
Current children cumulated vsize (KiB) 657620

[startup+162.319 s]
/proc/loadavg: 4.12 4.10 3.89 5/103 27811
/proc/meminfo: memFree=2168924/3368532 swapFree=1959840/1959888
[pid=27245] ppid=27243 vsize=982492 CPUtime=602.75
/proc/27245/stat : 27245 (ttsth-5-0) S 27243 27245 30226 0 -1 4202496 228193 0 0 0 60131 144 0 0 25 0 5 0 949638906 1006071808 227168 4294967295 134512640 135237372 3213599744 3213599340 134629544 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/27245/statm: 245623 227168 95 177 0 245445 0
[pid=27245/tid=27248] ppid=27243 vsize=982492 CPUtime=146.82
/proc/27245/task/27248/stat : 27248 (ttsth-5-0) R 27243 27245 30226 0 -1 4202560 34399 0 0 0 14652 30 0 0 25 0 5 0 949640421 1006071808 227168 4294967295 134512640 135237372 3213599744 3075957904 134561426 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=27245/tid=27249] ppid=27243 vsize=982492 CPUtime=146.86
/proc/27245/task/27249/stat : 27249 (ttsth-5-0) R 27243 27245 30226 0 -1 4202560 58891 0 0 0 14649 37 0 0 25 0 5 0 949640421 1006071808 227168 4294967295 134512640 135237372 3213599744 3067693332 134680504 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=27245/tid=27250] ppid=27243 vsize=982492 CPUtime=146.85
/proc/27245/task/27250/stat : 27250 (ttsth-5-0) R 27243 27245 30226 0 -1 4202560 58076 0 0 0 14644 41 0 0 25 0 5 0 949640421 1006071808 227168 4294967295 134512640 135237372 3213599744 3059140784 134562338 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=27245/tid=27251] ppid=27243 vsize=982492 CPUtime=147.07
/proc/27245/task/27251/stat : 27251 (ttsth-5-0) R 27243 27245 30226 0 -1 4202560 41640 0 0 0 14678 29 0 0 25 0 5 0 949640422 1006071808 227168 4294967295 134512640 135237372 3213599744 3050753488 134562344 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 602.75
Current children cumulated vsize (KiB) 982492

[startup+222.314 s]
/proc/loadavg: 4.15 4.11 3.91 5/103 27999
/proc/meminfo: memFree=1852836/3368532 swapFree=1959840/1959888
[pid=27245] ppid=27243 vsize=1313940 CPUtime=842.4
/proc/27245/stat : 27245 (ttsth-5-0) S 27243 27245 30226 0 -1 4202496 306377 0 0 0 84047 193 0 0 25 0 5 0 949638906 1345474560 305352 4294967295 134512640 135237372 3213599744 3213599340 134629544 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/27245/statm: 328485 305352 95 177 0 328307 0
[pid=27245/tid=27248] ppid=27243 vsize=1313940 CPUtime=206.7
/proc/27245/task/27248/stat : 27248 (ttsth-5-0) R 27243 27245 30226 0 -1 4202560 44724 0 0 0 20628 42 0 0 25 0 5 0 949640421 1345474560 305352 4294967295 134512640 135237372 3213599744 3075916384 134562380 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=27245/tid=27249] ppid=27243 vsize=1313940 CPUtime=206.83
/proc/27245/task/27249/stat : 27249 (ttsth-5-0) R 27243 27245 30226 0 -1 4202560 80815 0 0 0 20636 47 0 0 25 0 5 0 949640421 1345474560 305352 4294967295 134512640 135237372 3213599744 3067649248 134587943 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=27245/tid=27250] ppid=27243 vsize=1313940 CPUtime=206.76
/proc/27245/task/27250/stat : 27250 (ttsth-5-0) R 27243 27245 30226 0 -1 4202560 89452 0 0 0 20621 55 0 0 25 0 5 0 949640421 1345474560 305352 4294967295 134512640 135237372 3213599744 3059451008 134591082 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=27245/tid=27251] ppid=27243 vsize=1313940 CPUtime=206.96
/proc/27245/task/27251/stat : 27251 (ttsth-5-0) R 27243 27245 30226 0 -1 4202560 56199 0 0 0 20654 42 0 0 25 0 5 0 949640422 1345474560 305352 4294967295 134512640 135237372 3213599744 3050738944 134562338 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 842.4
Current children cumulated vsize (KiB) 1313940

[startup+282.309 s]
/proc/loadavg: 4.14 4.11 3.92 5/103 28188
/proc/meminfo: memFree=1605068/3368532 swapFree=1959840/1959888
[pid=27245] ppid=27243 vsize=1577984 CPUtime=1082.04
/proc/27245/stat : 27245 (ttsth-5-0) S 27243 27245 30226 0 -1 4202496 368812 0 0 0 107980 224 0 0 25 0 5 0 949638906 1615855616 367787 4294967295 134512640 135237372 3213599744 3213599340 134629544 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/27245/statm: 394496 367787 95 177 0 394318 0
[pid=27245/tid=27248] ppid=27243 vsize=1577984 CPUtime=266.6
/proc/27245/task/27248/stat : 27248 (ttsth-5-0) R 27243 27245 30226 0 -1 4202560 54870 0 0 0 26611 49 0 0 25 0 5 0 949640421 1615855616 367787 4294967295 134512640 135237372 3213599744 3075938476 134549950 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=27245/tid=27249] ppid=27243 vsize=1577984 CPUtime=266.77
/proc/27245/task/27249/stat : 27249 (ttsth-5-0) R 27243 27245 30226 0 -1 4202560 100515 0 0 0 26621 56 0 0 25 0 5 0 949640421 1615855616 367787 4294967295 134512640 135237372 3213599744 3067817264 134552745 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=27245/tid=27250] ppid=27243 vsize=1577984 CPUtime=266.76
/proc/27245/task/27250/stat : 27250 (ttsth-5-0) R 27243 27245 30226 0 -1 4202560 107188 0 0 0 26616 60 0 0 25 0 5 0 949640421 1615855616 367787 4294967295 134512640 135237372 3213599744 3059264544 134562399 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=27245/tid=27251] ppid=27243 vsize=1577984 CPUtime=266.76
/proc/27245/task/27251/stat : 27251 (ttsth-5-0) R 27243 27245 30226 0 -1 4202560 71052 0 0 0 26624 52 0 0 25 0 5 0 949640422 1615855616 367787 4294967295 134512640 135237372 3213599744 3050754032 134562363 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1082.04
Current children cumulated vsize (KiB) 1577984

[startup+342.315 s]
/proc/loadavg: 4.16 4.12 3.93 5/103 28382
/proc/meminfo: memFree=1346860/3368532 swapFree=1959840/1959888
[pid=27245] ppid=27243 vsize=1850516 CPUtime=1321.72
/proc/27245/stat : 27245 (ttsth-5-0) S 27243 27245 30226 0 -1 4202496 432826 0 0 0 131905 267 0 0 25 0 5 0 949638906 1894928384 431801 4294967295 134512640 135237372 3213599744 3213599340 134629544 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/27245/statm: 462629 431801 95 177 0 462451 0
[pid=27245/tid=27248] ppid=27243 vsize=1850516 CPUtime=326.52
/proc/27245/task/27248/stat : 27248 (ttsth-5-0) R 27243 27245 30226 0 -1 4202560 63336 0 0 0 32592 60 0 0 25 0 5 0 949640421 1894928384 431801 4294967295 134512640 135237372 3213599744 3075904560 134562338 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=27245/tid=27249] ppid=27243 vsize=1850516 CPUtime=326.6
/proc/27245/task/27249/stat : 27249 (ttsth-5-0) R 27243 27245 30226 0 -1 4202560 120930 0 0 0 32588 72 0 0 25 0 5 0 949640421 1894928384 431801 4294967295 134512640 135237372 3213599744 3067665616 134546034 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=27245/tid=27250] ppid=27243 vsize=1850516 CPUtime=326.73
/proc/27245/task/27250/stat : 27250 (ttsth-5-0) R 27243 27245 30226 0 -1 4202560 127882 0 0 0 32604 69 0 0 25 0 5 0 949640421 1894928384 431801 4294967295 134512640 135237372 3213599744 3059131752 134680505 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=27245/tid=27251] ppid=27243 vsize=1850516 CPUtime=326.72
/proc/27245/task/27251/stat : 27251 (ttsth-5-0) R 27243 27245 30226 0 -1 4202560 85491 0 0 0 32613 59 0 0 25 0 5 0 949640422 1894928384 431801 4294967295 134512640 135237372 3213599744 3050738640 134562380 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 1321.72
Current children cumulated vsize (KiB) 1850516



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+399.11 s]
/proc/loadavg: 4.54 4.22 3.97 5/103 28568
/proc/meminfo: memFree=1112080/3368532 swapFree=1959840/1959888
[pid=27245] ppid=27243 vsize=2097128 CPUtime=1548.17
/proc/27245/stat : 27245 (ttsth-5-0) S 27243 27245 30226 0 -1 4202496 491130 0 0 0 154485 332 0 0 25 0 5 0 949638906 2147459072 490105 4294967295 134512640 135237372 3213599744 3213599340 134629544 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/27245/statm: 524282 490105 95 177 0 524104 0
[pid=27245/tid=27248] ppid=27243 vsize=2097128 CPUtime=383.01
/proc/27245/task/27248/stat : 27248 (ttsth-5-0) R 27243 27245 30226 0 -1 4202560 71308 0 0 0 38218 83 0 0 25 0 5 0 949640421 2147459072 490105 4294967295 134512640 135237372 3213599744 3075913664 134562278 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=27245/tid=27249] ppid=27243 vsize=2097128 CPUtime=383.32
/proc/27245/task/27249/stat : 27249 (ttsth-5-0) R 27243 27245 30226 0 -1 4202560 137142 0 0 0 38245 87 0 0 25 0 5 0 949640421 2147459072 490105 4294967295 134512640 135237372 3213599744 3067661440 134546034 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=27245/tid=27250] ppid=27243 vsize=2097128 CPUtime=383.48
/proc/27245/task/27250/stat : 27250 (ttsth-5-0) R 27243 27245 30226 0 -1 4202560 151013 0 0 0 38260 88 0 0 25 0 5 0 949640421 2147459072 490105 4294967295 134512640 135237372 3213599744 3059361744 134562338 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=27245/tid=27251] ppid=27243 vsize=2097128 CPUtime=383.21
/proc/27245/task/27251/stat : 27251 (ttsth-5-0) R 27243 27245 30226 0 -1 4202560 96480 0 0 0 38254 67 0 0 25 0 5 0 949640422 2147459072 490105 4294967295 134512640 135237372 3213599744 3050896576 134562344 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 1548.17
Current children cumulated vsize (KiB) 2097128

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+399.23 s]
/proc/loadavg: 4.54 4.22 3.97 2/101 28569
/proc/meminfo: memFree=3031788/3368532 swapFree=1959840/1959888
[pid=27245] ppid=27243 vsize=0 CPUtime=1548.35
/proc/27245/stat : 27245 (ttsth-5-0) Z 27243 27245 30226 0 -1 4203524 491137 0 0 0 154493 342 0 0 18 0 2 0 949638906 0 0 4294967295 0 0 0 0 0 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/27245/statm: 0 0 0 0 0 0 0
[pid=27245/tid=27250] ppid=27243 vsize=0 CPUtime=383.6
/proc/27245/task/27250/stat : 27250 (ttsth-5-0) R 27243 27245 30226 0 -1 4203588 151013 0 0 0 38262 98 0 0 25 0 2 0 949640421 0 0 4294967295 0 0 0 0 0 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 1548.35
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 27245 and gives
#  childrusage.ru_utime.tv_sec=1544
#  childrusage.ru_utime.tv_usec=930000
#  childrusage.ru_stime.tv_sec=3
#  childrusage.ru_stime.tv_usec=420000
# CPU time returned by wait4() is 1548.35
# while last known CPU time is 1548.35
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 399.237
CPU time (s): 1548.35
CPU user time (s): 1544.93
CPU system time (s): 3.42
CPU usage (%): 387.828
Max. virtual memory (cumulated for all children) (KiB): 2097128

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1544.93
system time used= 3.42
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 491137
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 4121
involuntary context switches= 27866

runsolver used 0 second user time and 0.01 second system time

The end

Launcher Data 

Begin job on tipi39 at 2009-05-30 12:50:21
IDJOB=1780018
IDBENCH=70947
IDSOLVER=632
FILE ID=tipi39/1780018-1243680621
PBS_JOBID=
Free space on /tmp= 5741 MiB

SOLVER NAME= ttsth-5-0 2009-03-19 (4 threads)
BENCH NAME= SAT09/APPLICATIONS/bioinfo/q_query_3_l48_lambda.cnf
COMMAND LINE= HOME/ttsth-5-0 -num-threads MAXNBTHREAD BENCHNAME
RUNSOLVER COMMAND LINE= runsolver --timestamp  -w /tmp/evaluation-result-1780018-1243680621/watcher-1780018-1243680621 -o /tmp/evaluation-result-1780018-1243680621/solver-1780018-1243680621 -C 10000 -W 1000 -M 2047  HOME/ttsth-5-0 -num-threads 4 HOME/instance-1780018-1243680621.cnf

TIME LIMIT= 10000 seconds
MEMORY LIMIT= 2047 MiB
MAX NB THREAD= 4

MD5SUM BENCH= e7c28f6a200a1c1912fbaacfb3572515
RANDOM SEED= 472396006

Linux tipi39 2.6.21.5 #6 SMP Wed Jul 4 17:16:38 CEST 2007 i686 GNU/Linux

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.067
cache size	: 4096 KB
physical id	: 0
siblings	: 2
core id		: 0
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3992.41
clflush size	: 64

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.067
cache size	: 4096 KB
physical id	: 0
siblings	: 2
core id		: 1
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.10
clflush size	: 64

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.067
cache size	: 4096 KB
physical id	: 3
siblings	: 2
core id		: 0
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.16
clflush size	: 64

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.067
cache size	: 4096 KB
physical id	: 3
siblings	: 2
core id		: 1
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.15
clflush size	: 64


/proc/meminfo:
MemTotal:      3368532 kB
MemFree:       3073456 kB
Buffers:         83580 kB
Cached:         101272 kB
SwapCached:          0 kB
Active:         122460 kB
Inactive:        78284 kB
HighTotal:     2489216 kB
HighFree:      2374288 kB
LowTotal:       879316 kB
LowFree:        699168 kB
SwapTotal:     1959888 kB
SwapFree:      1959840 kB
Dirty:            4192 kB
Writeback:           0 kB
AnonPages:       15940 kB
Mapped:           6056 kB
Slab:            84224 kB
SReclaimable:    73728 kB
SUnreclaim:      10496 kB
PageTables:        528 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:   3644152 kB
Committed_AS:    94792 kB
VmallocTotal:   114680 kB
VmallocUsed:      1444 kB
VmallocChunk:   113072 kB

Free space on /tmp at the end= 5741 MiB
End job on tipi39 at 2009-05-30 12:57:03