Trace number 1779988

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ttsth-5-0 2009-03-19 (4 threads)? (MO) 1434.38 366.034

General information on the benchmark

NameAPPLICATIONS/bioinfo/
q_query_3_l39_lambda.cnf
MD5SUMcc949593da8c10735a1b7ac8b30d4e4d
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark4.25
Satisfiable
(Un)Satisfiability was proved
Number of variables27735
Number of clauses136449
Sum of the clauses size392486
Maximum clause length9
Minimum clause length1
Number of clauses of size 13722
Number of clauses of size 235083
Number of clauses of size 378429
Number of clauses of size 413232
Number of clauses of size 55866
Number of clauses of size over 5117

Solver Data 

0.30/0.34	c Command: HOME/ttsth-5-0 -num-threads 4 HOME/instance-1779988-1243680646.cnf 
0.30/0.34	c Using SATTIMEOUT of 10000
0.30/0.34	c Using SATRAM of 2047
0.30/0.34	c Size of subset node = 16
0.30/0.34	c Variables = 27735
0.30/0.34	c Clauses = 136449
0.30/0.34	c Literals = 392486
0.30/0.34	c Reduced size:
0.30/0.34	c Variables = 27735
0.30/0.34	c Clauses = 122058
0.30/0.34	c Literals = 356327
0.30/0.34	c a2
0.60/0.64	c a1
7.20/7.28	c Independent sub-problems = 1
7.20/7.28	c Sub-problem with 23105 variables and 122058 clauses
7.20/7.28	c using permutation method 4
7.20/7.28	c count = 1
7.20/7.28	c Ordering finished 7.220 seconds
7.20/7.28	c mapped 7.280 seconds
7.20/7.28	c permuted 7.280 seconds
7.20/7.28	c about to sort
7.30/7.33	c sorted
9.00/9.00	c clauses now 122058
9.00/9.00	c init finished 7.470 seconds
9.00/9.00	c tree built 9.000 seconds
9.00/9.00	c 
9.00/9.00	c PA progress                      | CPU progress Partial assignments | improvements      CPU time        PA/sec        nodes
9.00/9.00	c ---------------------------------|----------------------------------|------------------------------------------------------
9.00/9.00	c ................................ | ..........                       |                        9.0           0.0             
9.00/9.00	c ................................ | ..........                     1 |                        9.0           0.1             
9.00/9.00	c ****************................ | ..........                     2 |                        9.0           0.2            1
9.00/9.00	c ****************................ | ..........                     3 |                        9.0           0.3            1
9.00/9.00	c ****************................ | ..........                     4 |                        9.0           0.4            1
9.00/9.00	c ****************................ | ..........                     5 |                        9.0           0.6            1
9.00/9.00	c ****************................ | ..........                     6 |                        9.0           0.7            1
9.00/9.01	c ****************................ | ..........                  1000 | 2                      9.0         111.1          116
200.08/56.92	c ****************................ | ..........               1057000 | 43326                200.1        5281.3     31834627
400.11/107.05	c ****************................ | ..........               1621000 | 63914                400.3        4049.6     50306357
599.95/157.03	c ****************................ | ..........               2111000 | 83607                600.0        3518.0     67238370
800.41/207.33	c ****************................ | ..........               2484000 | 98387                800.5        3102.9     78999855
1000.10/257.36	c ****************................ | *.........               2876000 | 121541              1000.3        2875.1     91402288
1200.00/307.36	c ****************................ | *.........               3200000 | 134740              1200.2        2666.3    101772324
1399.80/357.38	c ****************................ | *.........               3546000 | 155539              1400.1        2532.7    115507455

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver version 3.2.9 (svn:503) (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w /tmp/evaluation-result-1779988-1243680646/watcher-1779988-1243680646 -o /tmp/evaluation-result-1779988-1243680646/solver-1779988-1243680646 -C 10000 -W 1000 -M 2047 HOME/ttsth-5-0 -num-threads 4 HOME/instance-1779988-1243680646.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 10000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 10030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 2096128 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 2147328 KiB
Current StackSize limit: 8192 KiB


[startup+0 s]
/proc/loadavg: 4.13 4.15 3.66 3/115 7376
/proc/meminfo: memFree=2988828/3368532 swapFree=1941392/1959888
[pid=7376] ppid=7374 vsize=1140 CPUtime=0
/proc/7376/stat : 7376 (ttsth-5-0) R 7374 7376 11443 0 -1 4202496 180 0 0 0 0 0 0 0 18 0 1 0 1132744428 1167360 136 4294967295 134512640 135237372 3219458464 3219457912 134732614 0 0 0 0 0 0 0 17 3 0 0 0
/proc/7376/statm: 285 136 75 177 0 107 0

[startup+0.10444 s]
/proc/loadavg: 4.13 4.15 3.66 3/115 7376
/proc/meminfo: memFree=2988828/3368532 swapFree=1941392/1959888
[pid=7376] ppid=7374 vsize=5096 CPUtime=0.1
/proc/7376/stat : 7376 (ttsth-5-0) R 7374 7376 11443 0 -1 4202496 1152 0 0 0 10 0 0 0 18 0 1 0 1132744428 5218304 1108 4294967295 134512640 135237372 3219458464 3219457912 134732614 0 0 0 0 0 0 0 17 3 0 0 0
/proc/7376/statm: 1274 1108 75 177 0 1096 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 5096

[startup+0.204437 s]
/proc/loadavg: 4.13 4.15 3.66 3/115 7376
/proc/meminfo: memFree=2988828/3368532 swapFree=1941392/1959888
[pid=7376] ppid=7374 vsize=8972 CPUtime=0.2
/proc/7376/stat : 7376 (ttsth-5-0) R 7374 7376 11443 0 -1 4202496 2132 0 0 0 18 2 0 0 18 0 1 0 1132744428 9187328 2088 4294967295 134512640 135237372 3219458464 3219457912 134732614 0 0 0 0 0 0 0 17 0 0 0 0
/proc/7376/statm: 2243 2088 75 177 0 2065 0
Current children cumulated CPU time (s) 0.2
Current children cumulated vsize (KiB) 8972

[startup+0.304435 s]
/proc/loadavg: 4.13 4.15 3.66 3/115 7376
/proc/meminfo: memFree=2988828/3368532 swapFree=1941392/1959888
[pid=7376] ppid=7374 vsize=10296 CPUtime=0.3
/proc/7376/stat : 7376 (ttsth-5-0) R 7374 7376 11443 0 -1 4202496 2425 0 0 0 28 2 0 0 18 0 1 0 1132744428 10543104 2381 4294967295 134512640 135237372 3219458464 3219458156 134534557 0 0 0 0 0 0 0 17 0 0 0 0
/proc/7376/statm: 2574 2381 75 177 0 2396 0
Current children cumulated CPU time (s) 0.3
Current children cumulated vsize (KiB) 10296

[startup+0.704421 s]
/proc/loadavg: 4.13 4.15 3.66 3/115 7376
/proc/meminfo: memFree=2988828/3368532 swapFree=1941392/1959888
[pid=7376] ppid=7374 vsize=20956 CPUtime=0.7
/proc/7376/stat : 7376 (ttsth-5-0) R 7374 7376 11443 0 -1 4202496 4911 0 0 0 68 2 0 0 18 0 1 0 1132744428 21458944 4866 4294967295 134512640 135237372 3219458464 3219457968 134540242 0 0 0 0 0 0 0 17 0 0 0 0
/proc/7376/statm: 5239 4868 76 177 0 5061 0
Current children cumulated CPU time (s) 0.7
Current children cumulated vsize (KiB) 20956

[startup+1.50438 s]
/proc/loadavg: 4.13 4.15 3.66 2/116 7377
/proc/meminfo: memFree=2967384/3368532 swapFree=1941392/1959888
[pid=7376] ppid=7374 vsize=23256 CPUtime=1.5
/proc/7376/stat : 7376 (ttsth-5-0) R 7374 7376 11443 0 -1 4202496 6035 0 0 0 148 2 0 0 20 0 1 0 1132744428 23814144 5622 4294967295 134512640 135237372 3219458464 3219457792 134555272 0 0 0 0 0 0 0 17 0 0 0 0
/proc/7376/statm: 5814 5622 77 177 0 5636 0
Current children cumulated CPU time (s) 1.5
Current children cumulated vsize (KiB) 23256

[startup+3.10432 s]
/proc/loadavg: 4.13 4.15 3.66 2/116 7377
/proc/meminfo: memFree=2967384/3368532 swapFree=1941392/1959888
[pid=7376] ppid=7374 vsize=23612 CPUtime=3.1
/proc/7376/stat : 7376 (ttsth-5-0) R 7374 7376 11443 0 -1 4202496 6085 0 0 0 308 2 0 0 25 0 1 0 1132744428 24178688 5672 4294967295 134512640 135237372 3219458464 3219457824 134600718 0 0 0 0 0 0 0 17 0 0 0 0
/proc/7376/statm: 5903 5672 77 177 0 5725 0
Current children cumulated CPU time (s) 3.1
Current children cumulated vsize (KiB) 23612

[startup+6.30419 s]
/proc/loadavg: 3.88 4.09 3.65 2/116 7377
/proc/meminfo: memFree=2966752/3368532 swapFree=1941392/1959888
[pid=7376] ppid=7374 vsize=23612 CPUtime=6.3
/proc/7376/stat : 7376 (ttsth-5-0) R 7374 7376 11443 0 -1 4202496 6119 0 0 0 628 2 0 0 25 0 1 0 1132744428 24178688 5706 4294967295 134512640 135237372 3219458464 3219457824 134600713 0 0 0 0 0 0 0 17 0 0 0 0
/proc/7376/statm: 5903 5706 77 177 0 5725 0
Current children cumulated CPU time (s) 6.3
Current children cumulated vsize (KiB) 23612

[startup+12.7039 s]
/proc/loadavg: 3.65 4.04 3.63 6/120 7382
/proc/meminfo: memFree=2832400/3368532 swapFree=1941392/1959888
[pid=7376] ppid=7374 vsize=198892 CPUtime=23.66
/proc/7376/stat : 7376 (ttsth-5-0) S 7374 7376 11443 0 -1 4202496 41892 0 0 0 2351 15 0 0 25 0 5 0 1132744428 203665408 41239 4294967295 134512640 135237372 3219458464 3219458060 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/7376/statm: 49723 41239 95 177 0 49545 0
[pid=7376/tid=7379] ppid=7374 vsize=198892 CPUtime=3.7
/proc/7376/task/7379/stat : 7379 (ttsth-5-0) R 7374 7376 11443 0 -1 4202560 5471 0 0 0 369 1 0 0 25 0 5 0 1132745328 203665408 41240 4294967295 134512640 135237372 3219458464 3082008304 134589526 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=7376/tid=7380] ppid=7374 vsize=198892 CPUtime=3.67
/proc/7376/task/7380/stat : 7380 (ttsth-5-0) R 7374 7376 11443 0 -1 4202560 2859 0 0 0 367 0 0 0 25 0 5 0 1132745329 203665408 41240 4294967295 134512640 135237372 3219458464 3073617248 134590571 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=7376/tid=7381] ppid=7374 vsize=198892 CPUtime=3.65
/proc/7376/task/7381/stat : 7381 (ttsth-5-0) R 7374 7376 11443 0 -1 4202560 3067 0 0 0 363 2 0 0 25 0 5 0 1132745329 203665408 41240 4294967295 134512640 135237372 3219458464 3065225040 134546034 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=7376/tid=7382] ppid=7374 vsize=198892 CPUtime=3.65
/proc/7376/task/7382/stat : 7382 (ttsth-5-0) R 7374 7376 11443 0 -1 4202560 3364 0 0 0 360 5 0 0 25 0 5 0 1132745329 203665408 41240 4294967295 134512640 135237372 3219458464 3056846720 134680273 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 23.66
Current children cumulated vsize (KiB) 198892

[startup+25.5034 s]
/proc/loadavg: 3.87 4.07 3.65 5/120 7382
/proc/meminfo: memFree=2669008/3368532 swapFree=1941392/1959888
[pid=7376] ppid=7374 vsize=365804 CPUtime=74.86
/proc/7376/stat : 7376 (ttsth-5-0) S 7374 7376 11443 0 -1 4202496 81956 0 0 0 7445 41 0 0 25 0 5 0 1132744428 374583296 81303 4294967295 134512640 135237372 3219458464 3219458060 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/7376/statm: 91451 81304 95 177 0 91273 0
[pid=7376/tid=7379] ppid=7374 vsize=365804 CPUtime=16.5
/proc/7376/task/7379/stat : 7379 (ttsth-5-0) R 7374 7376 11443 0 -1 4202560 18630 0 0 0 1642 8 0 0 25 0 5 0 1132745328 374583296 81304 4294967295 134512640 135237372 3219458464 3081992992 134546034 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=7376/tid=7380] ppid=7374 vsize=365804 CPUtime=16.47
/proc/7376/task/7380/stat : 7380 (ttsth-5-0) R 7374 7376 11443 0 -1 4202560 9936 0 0 0 1641 6 0 0 25 0 5 0 1132745329 374583296 81304 4294967295 134512640 135237372 3219458464 3073630348 134549872 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=7376/tid=7381] ppid=7374 vsize=365804 CPUtime=16.45
/proc/7376/task/7381/stat : 7381 (ttsth-5-0) R 7374 7376 11443 0 -1 4202560 12771 0 0 0 1639 6 0 0 25 0 5 0 1132745329 374583296 81305 4294967295 134512640 135237372 3219458464 3065228928 134546026 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=7376/tid=7382] ppid=7374 vsize=365804 CPUtime=16.45
/proc/7376/task/7382/stat : 7382 (ttsth-5-0) R 7374 7376 11443 0 -1 4202560 13489 0 0 0 1631 14 0 0 25 0 5 0 1132745329 374583296 81305 4294967295 134512640 135237372 3219458464 3056841008 134552742 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 74.86
Current children cumulated vsize (KiB) 365804

[startup+51.1124 s]
/proc/loadavg: 4.18 4.13 3.68 5/120 7569
/proc/meminfo: memFree=2417896/3368532 swapFree=1941392/1959888
[pid=7376] ppid=7374 vsize=628480 CPUtime=176.88
/proc/7376/stat : 7376 (ttsth-5-0) S 7374 7376 11443 0 -1 4202496 144451 0 0 0 17611 77 0 0 25 0 5 0 1132744428 643563520 143798 4294967295 134512640 135237372 3219458464 3219458060 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/7376/statm: 157120 143798 95 177 0 156942 0
[pid=7376/tid=7379] ppid=7374 vsize=628480 CPUtime=41.86
/proc/7376/task/7379/stat : 7379 (ttsth-5-0) R 7374 7376 11443 0 -1 4202560 35906 0 0 0 4171 15 0 0 25 0 5 0 1132745328 643563520 143798 4294967295 134512640 135237372 3219458464 3082006800 134562357 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=7376/tid=7380] ppid=7374 vsize=628480 CPUtime=42.04
/proc/7376/task/7380/stat : 7380 (ttsth-5-0) R 7374 7376 11443 0 -1 4202560 20429 0 0 0 4190 14 0 0 25 0 5 0 1132745329 643563520 143798 4294967295 134512640 135237372 3219458464 3073613920 134562338 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=7376/tid=7381] ppid=7374 vsize=628480 CPUtime=42
/proc/7376/task/7381/stat : 7381 (ttsth-5-0) R 7374 7376 11443 0 -1 4202560 30524 0 0 0 4179 21 0 0 25 0 5 0 1132745329 643563520 143798 4294967295 134512640 135237372 3219458464 3065250528 134591429 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=7376/tid=7382] ppid=7374 vsize=628480 CPUtime=41.98
/proc/7376/task/7382/stat : 7382 (ttsth-5-0) R 7374 7376 11443 0 -1 4202560 30460 0 0 0 4178 20 0 0 25 0 5 0 1132745329 643563520 143798 4294967295 134512640 135237372 3219458464 3056850496 134546034 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 176.88
Current children cumulated vsize (KiB) 628480

[startup+102.31 s]
/proc/loadavg: 4.34 4.17 3.71 5/120 7754
/proc/meminfo: memFree=2109180/3368532 swapFree=1941392/1959888
[pid=7376] ppid=7374 vsize=949900 CPUtime=381.33
/proc/7376/stat : 7376 (ttsth-5-0) S 7374 7376 11443 0 -1 4202496 220536 0 0 0 38011 122 0 0 25 0 5 0 1132744428 972697600 219883 4294967295 134512640 135237372 3219458464 3219458060 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/7376/statm: 237475 219884 95 177 0 237297 0
[pid=7376/tid=7379] ppid=7374 vsize=949900 CPUtime=92.9
/proc/7376/task/7379/stat : 7379 (ttsth-5-0) R 7374 7376 11443 0 -1 4202560 57744 0 0 0 9258 32 0 0 25 0 5 0 1132745328 972697600 219884 4294967295 134512640 135237372 3219458464 3081998016 134562344 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=7376/tid=7380] ppid=7374 vsize=949900 CPUtime=93.19
/proc/7376/task/7380/stat : 7380 (ttsth-5-0) R 7374 7376 11443 0 -1 4202560 34509 0 0 0 9294 25 0 0 25 0 5 0 1132745329 972697600 219884 4294967295 134512640 135237372 3219458464 3073619968 134562338 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=7376/tid=7381] ppid=7374 vsize=949900 CPUtime=93.18
/proc/7376/task/7381/stat : 7381 (ttsth-5-0) R 7374 7376 11443 0 -1 4202560 42701 0 0 0 9292 26 0 0 25 0 5 0 1132745329 972697600 219885 4294967295 134512640 135237372 3219458464 3065222688 134546026 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=7376/tid=7382] ppid=7374 vsize=949900 CPUtime=93.06
/proc/7376/task/7382/stat : 7382 (ttsth-5-0) R 7374 7376 11443 0 -1 4202560 58452 0 0 0 9274 32 0 0 25 0 5 0 1132745329 972697600 219885 4294967295 134512640 135237372 3219458464 3056836144 134546026 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 381.33
Current children cumulated vsize (KiB) 949900

[startup+162.308 s]
/proc/loadavg: 4.50 4.24 3.76 6/121 7832
/proc/meminfo: memFree=1801940/3368532 swapFree=1941392/1959888
[pid=7376] ppid=7374 vsize=1278436 CPUtime=621.1
/proc/7376/stat : 7376 (ttsth-5-0) S 7374 7376 11443 0 -1 4202496 297920 0 0 0 61927 183 0 0 25 0 5 0 1132744428 1309118464 297267 4294967295 134512640 135237372 3219458464 3219458060 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/7376/statm: 319609 297267 95 177 0 319431 0
[pid=7376/tid=7379] ppid=7374 vsize=1278436 CPUtime=152.71
/proc/7376/task/7379/stat : 7379 (ttsth-5-0) R 7374 7376 11443 0 -1 4202560 81165 0 0 0 15217 54 0 0 25 0 5 0 1132745328 1309118464 297267 4294967295 134512640 135237372 3219458464 3082001472 134562328 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=7376/tid=7380] ppid=7374 vsize=1278436 CPUtime=153.18
/proc/7376/task/7380/stat : 7380 (ttsth-5-0) R 7374 7376 11443 0 -1 4202560 49235 0 0 0 15284 34 0 0 25 0 5 0 1132745329 1309118464 297267 4294967295 134512640 135237372 3219458464 3073609036 134549925 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=7376/tid=7381] ppid=7374 vsize=1278436 CPUtime=153.18
/proc/7376/task/7381/stat : 7381 (ttsth-5-0) R 7374 7376 11443 0 -1 4202560 65203 0 0 0 15276 42 0 0 25 0 5 0 1132745329 1309118464 297267 4294967295 134512640 135237372 3219458464 3065244592 134551002 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=7376/tid=7382] ppid=7374 vsize=1278436 CPUtime=153.03
/proc/7376/task/7382/stat : 7382 (ttsth-5-0) R 7374 7376 11443 0 -1 4202560 75185 0 0 0 15257 46 0 0 25 0 5 0 1132745329 1309118464 297267 4294967295 134512640 135237372 3219458464 3056838448 134546026 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 621.1
Current children cumulated vsize (KiB) 1278436

[startup+222.316 s]
/proc/loadavg: 4.40 4.27 3.80 7/121 8023
/proc/meminfo: memFree=1578128/3368532 swapFree=1941392/1959888
[pid=7376] ppid=7374 vsize=1513332 CPUtime=860.38
/proc/7376/stat : 7376 (ttsth-5-0) S 7374 7376 11443 0 -1 4202496 353552 0 0 0 85812 226 0 0 25 0 5 0 1132744428 1549651968 352899 4294967295 134512640 135237372 3219458464 3219458060 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/7376/statm: 378333 352899 95 177 0 378155 0
[pid=7376/tid=7379] ppid=7374 vsize=1513332 CPUtime=212.13
/proc/7376/task/7379/stat : 7379 (ttsth-5-0) R 7374 7376 11443 0 -1 4202560 100285 0 0 0 21144 69 0 0 25 0 5 0 1132745328 1549651968 352899 4294967295 134512640 135237372 3219458464 3082042912 134546026 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=7376/tid=7380] ppid=7374 vsize=1513332 CPUtime=213.13
/proc/7376/task/7380/stat : 7380 (ttsth-5-0) R 7374 7376 11443 0 -1 4202560 62978 0 0 0 21268 45 0 0 25 0 5 0 1132745329 1549651968 352899 4294967295 134512640 135237372 3219458464 3073619168 134562338 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=7376/tid=7381] ppid=7374 vsize=1513332 CPUtime=213.12
/proc/7376/task/7381/stat : 7381 (ttsth-5-0) R 7374 7376 11443 0 -1 4202560 73714 0 0 0 21261 51 0 0 25 0 5 0 1132745329 1549651968 352899 4294967295 134512640 135237372 3219458464 3065231776 134561423 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=7376/tid=7382] ppid=7374 vsize=1513332 CPUtime=213
/proc/7376/task/7382/stat : 7382 (ttsth-5-0) R 7374 7376 11443 0 -1 4202560 89443 0 0 0 21246 54 0 0 25 0 5 0 1132745329 1549651968 352899 4294967295 134512640 135237372 3219458464 3056837296 134546026 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 860.38
Current children cumulated vsize (KiB) 1513332

[startup+282.313 s]
/proc/loadavg: 4.36 4.30 3.84 6/121 8151
/proc/meminfo: memFree=1352796/3368532 swapFree=1941392/1959888
[pid=7376] ppid=7374 vsize=1752664 CPUtime=1100.04
/proc/7376/stat : 7376 (ttsth-5-0) S 7374 7376 11443 0 -1 4202496 410187 0 0 0 109741 263 0 0 25 0 5 0 1132744428 1794727936 409534 4294967295 134512640 135237372 3219458464 3219458060 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/7376/statm: 438166 409534 95 177 0 437988 0
[pid=7376/tid=7379] ppid=7374 vsize=1752664 CPUtime=271.85
/proc/7376/task/7379/stat : 7379 (ttsth-5-0) R 7374 7376 11443 0 -1 4202560 119461 0 0 0 27101 84 0 0 25 0 5 0 1132745328 1794727936 409534 4294967295 134512640 135237372 3219458464 3082008400 134546026 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=7376/tid=7380] ppid=7374 vsize=1752664 CPUtime=273.1
/proc/7376/task/7380/stat : 7380 (ttsth-5-0) R 7374 7376 11443 0 -1 4202560 77056 0 0 0 27252 58 0 0 25 0 5 0 1132745329 1794727936 409534 4294967295 134512640 135237372 3219458464 3073621848 134562275 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=7376/tid=7381] ppid=7374 vsize=1752664 CPUtime=273.1
/proc/7376/task/7381/stat : 7381 (ttsth-5-0) R 7374 7376 11443 0 -1 4202560 82862 0 0 0 27256 54 0 0 25 0 5 0 1132745329 1794727936 409534 4294967295 134512640 135237372 3219458464 3065223920 134562338 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=7376/tid=7382] ppid=7374 vsize=1752664 CPUtime=272.99
/proc/7376/task/7382/stat : 7382 (ttsth-5-0) R 7374 7376 11443 0 -1 4202560 103676 0 0 0 27239 60 0 0 25 0 5 0 1132745329 1794727936 409534 4294967295 134512640 135237372 3219458464 3056843308 134636641 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 1100.04
Current children cumulated vsize (KiB) 1752664

[startup+342.311 s]
/proc/loadavg: 4.31 4.30 3.87 6/120 8323
/proc/meminfo: memFree=1137180/3368532 swapFree=1941392/1959888
[pid=7376] ppid=7374 vsize=1980192 CPUtime=1339.97
/proc/7376/stat : 7376 (ttsth-5-0) S 7374 7376 11443 0 -1 4202496 463779 0 0 0 133700 297 0 0 25 0 5 0 1132744428 2027716608 463126 4294967295 134512640 135237372 3219458464 3219458060 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/7376/statm: 495048 463126 95 177 0 494870 0
[pid=7376/tid=7379] ppid=7374 vsize=1980192 CPUtime=331.82
/proc/7376/task/7379/stat : 7379 (ttsth-5-0) R 7374 7376 11443 0 -1 4202560 134242 0 0 0 33091 91 0 0 25 0 5 0 1132745328 2027716608 463126 4294967295 134512640 135237372 3219458464 3082004240 134562344 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=7376/tid=7380] ppid=7374 vsize=1980192 CPUtime=333.09
/proc/7376/task/7380/stat : 7380 (ttsth-5-0) R 7374 7376 11443 0 -1 4202560 88853 0 0 0 33242 67 0 0 25 0 5 0 1132745329 2027716608 463127 4294967295 134512640 135237372 3219458464 3073619824 134562338 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=7376/tid=7381] ppid=7374 vsize=1980192 CPUtime=333.09
/proc/7376/task/7381/stat : 7381 (ttsth-5-0) R 7374 7376 11443 0 -1 4202560 90455 0 0 0 33250 59 0 0 25 0 5 0 1132745329 2027716608 463127 4294967295 134512640 135237372 3219458464 3065227264 134562373 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=7376/tid=7382] ppid=7374 vsize=1980192 CPUtime=332.97
/proc/7376/task/7382/stat : 7382 (ttsth-5-0) R 7374 7376 11443 0 -1 4202560 123098 0 0 0 33224 73 0 0 25 0 5 0 1132745329 2027716608 463127 4294967295 134512640 135237372 3219458464 3056839120 134546026 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 1339.97
Current children cumulated vsize (KiB) 1980192



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+365.91 s]
/proc/loadavg: 4.32 4.31 3.88 5/120 8511
/proc/meminfo: memFree=1026640/3368532 swapFree=1941392/1959888
[pid=7376] ppid=7374 vsize=2096904 CPUtime=1434.22
/proc/7376/stat : 7376 (ttsth-5-0) S 7374 7376 11443 0 -1 4202496 491139 0 0 0 143107 315 0 0 25 0 5 0 1132744428 2147229696 490486 4294967295 134512640 135237372 3219458464 3219458060 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/7376/statm: 524226 490486 95 177 0 524048 0
[pid=7376/tid=7379] ppid=7374 vsize=2096904 CPUtime=355.41
/proc/7376/task/7379/stat : 7379 (ttsth-5-0) R 7374 7376 11443 0 -1 4202560 144757 0 0 0 35442 99 0 0 25 0 5 0 1132745328 2147229696 490486 4294967295 134512640 135237372 3219458464 3082005040 134546034 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=7376/tid=7380] ppid=7374 vsize=2096904 CPUtime=356.55
/proc/7376/task/7380/stat : 7380 (ttsth-5-0) R 7374 7376 11443 0 -1 4202560 94971 0 0 0 35583 72 0 0 25 0 5 0 1132745329 2147229696 490486 4294967295 134512640 135237372 3219458464 3073617968 134546026 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=7376/tid=7381] ppid=7374 vsize=2096904 CPUtime=356.68
/proc/7376/task/7381/stat : 7381 (ttsth-5-0) R 7374 7376 11443 0 -1 4202560 94505 0 0 0 35608 60 0 0 25 0 5 0 1132745329 2147229696 490486 4294967295 134512640 135237372 3219458464 3065245328 134680229 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=7376/tid=7382] ppid=7374 vsize=2096904 CPUtime=356.58
/proc/7376/task/7382/stat : 7382 (ttsth-5-0) R 7374 7376 11443 0 -1 4202560 129774 0 0 0 35581 77 0 0 25 0 5 0 1132745329 2147229696 490486 4294967295 134512640 135237372 3219458464 3056840560 134546026 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 1434.22
Current children cumulated vsize (KiB) 2096904

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+366.03 s]
/proc/loadavg: 4.32 4.31 3.88 5/120 8511
/proc/meminfo: memFree=1026640/3368532 swapFree=1941392/1959888
[pid=7376] ppid=7374 vsize=0 CPUtime=1434.38
/proc/7376/stat : 7376 (ttsth-5-0) Z 7374 7376 11443 0 -1 4203524 491143 0 0 0 143113 325 0 0 23 0 2 0 1132744428 0 0 4294967295 0 0 0 0 0 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/7376/statm: 0 0 0 0 0 0 0
[pid=7376/tid=7381] ppid=7374 vsize=0 CPUtime=356.8
/proc/7376/task/7381/stat : 7381 (ttsth-5-0) R 7374 7376 11443 0 -1 4203588 94506 0 0 0 35610 70 0 0 25 0 2 0 1132745329 0 0 4294967295 0 0 0 0 0 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1434.38
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 7376 and gives
#  childrusage.ru_utime.tv_sec=1431
#  childrusage.ru_utime.tv_usec=130000
#  childrusage.ru_stime.tv_sec=3
#  childrusage.ru_stime.tv_usec=250000
# CPU time returned by wait4() is 1434.38
# while last known CPU time is 1434.38
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 366.034
CPU time (s): 1434.38
CPU user time (s): 1431.13
CPU system time (s): 3.25
CPU usage (%): 391.871
Max. virtual memory (cumulated for all children) (KiB): 2096904

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1431.13
system time used= 3.25
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 491143
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2474
involuntary context switches= 26318

runsolver used 0 second user time and 0.01 second system time

The end

Launcher Data 

Begin job on  at 2009-05-30 12:50:46
IDJOB=1779988
IDBENCH=70945
IDSOLVER=632
FILE ID=/1779988-1243680646
PBS_JOBID=
Free space on /tmp= 15728 MiB

SOLVER NAME= ttsth-5-0 2009-03-19 (4 threads)
BENCH NAME= SAT09/APPLICATIONS/bioinfo/q_query_3_l39_lambda.cnf
COMMAND LINE= HOME/ttsth-5-0 -num-threads MAXNBTHREAD BENCHNAME
RUNSOLVER COMMAND LINE= runsolver --timestamp  -w /tmp/evaluation-result-1779988-1243680646/watcher-1779988-1243680646 -o /tmp/evaluation-result-1779988-1243680646/solver-1779988-1243680646 -C 10000 -W 1000 -M 2047  HOME/ttsth-5-0 -num-threads 4 HOME/instance-1779988-1243680646.cnf

TIME LIMIT= 10000 seconds
MEMORY LIMIT= 2047 MiB
MAX NB THREAD= 4

MD5SUM BENCH= cc949593da8c10735a1b7ac8b30d4e4d
RANDOM SEED= 465887517

Linux (none) 2.6.21.5 #6 SMP Wed Jul 4 17:16:38 CEST 2007 i686 GNU/Linux

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.143
cache size	: 4096 KB
physical id	: 0
siblings	: 2
core id		: 0
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3992.42
clflush size	: 64

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.143
cache size	: 4096 KB
physical id	: 0
siblings	: 2
core id		: 1
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.11
clflush size	: 64

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.143
cache size	: 4096 KB
physical id	: 3
siblings	: 2
core id		: 0
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.17
clflush size	: 64

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.143
cache size	: 4096 KB
physical id	: 3
siblings	: 2
core id		: 1
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.15
clflush size	: 64


/proc/meminfo:
MemTotal:      3368532 kB
MemFree:       2988828 kB
Buffers:         87672 kB
Cached:         188440 kB
SwapCached:       4320 kB
Active:         181712 kB
Inactive:       104928 kB
HighTotal:     2489216 kB
HighFree:      2287880 kB
LowTotal:       879316 kB
LowFree:        700948 kB
SwapTotal:     1959888 kB
SwapFree:      1941392 kB
Dirty:            3404 kB
Writeback:          16 kB
AnonPages:        9536 kB
Mapped:           4360 kB
Slab:            82248 kB
SReclaimable:    72180 kB
SUnreclaim:      10068 kB
PageTables:        760 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:   3644152 kB
Committed_AS:   127080 kB
VmallocTotal:   114680 kB
VmallocUsed:      1444 kB
VmallocChunk:   113072 kB

Free space on /tmp at the end= 15728 MiB
End job on  at 2009-05-30 12:56:54