Trace number 1562864

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ttsth-5-0 2009-03-19? (TO) 1200.16 607.346

General information on the benchmark

NameAPPLICATIONS/bioinfo/
q_query_3_l37_lambda.cnf
MD5SUM6c0fa36b77ee8403468509d27984ddf2
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark0.643901
Satisfiable
(Un)Satisfiability was proved
Number of variables26241
Number of clauses128361
Sum of the clauses size368903
Maximum clause length9
Minimum clause length1
Number of clauses of size 13566
Number of clauses of size 233367
Number of clauses of size 373230
Number of clauses of size 412521
Number of clauses of size 55566
Number of clauses of size over 5111

Solver Data 

0.30/0.38	c Command: HOME/ttsth-5-0 -num-threads 2 HOME/instance-1562864-1240998506.cnf 
0.30/0.38	c Using SATTIMEOUT of 1200
0.30/0.38	c Using SATRAM of 1800
0.30/0.38	c Size of subset node = 16
0.30/0.38	c Variables = 26241
0.30/0.38	c Clauses = 128361
0.30/0.38	c Literals = 368903
0.30/0.38	c Reduced size:
0.30/0.38	c Variables = 26241
0.30/0.38	c Clauses = 114462
0.30/0.38	c Literals = 333968
0.30/0.38	c a2
0.69/0.78	c a1
9.89/9.94	c Independent sub-problems = 1
9.89/9.94	c Sub-problem with 21767 variables and 114462 clauses
9.89/9.94	c using permutation method 4
9.89/9.94	c count = 1
9.89/9.94	c Ordering finished 9.870 seconds
9.89/9.94	c mapped 9.940 seconds
9.89/9.94	c permuted 9.940 seconds
9.89/9.94	c about to sort
9.89/9.99	c sorted
11.49/11.52	c clauses now 114462
11.49/11.52	c init finished 10.100 seconds
11.49/11.52	c tree built 11.510 seconds
11.49/11.52	c 
11.49/11.52	c PA progress                      | CPU progress Partial assignments | improvements      CPU time        PA/sec        nodes
11.49/11.52	c ---------------------------------|----------------------------------|------------------------------------------------------
11.49/11.52	c ................................ | ..........                       |                       11.5           0.0             
11.49/11.52	c ................................ | ..........                     1 |                       11.5           0.1             
11.49/11.52	c ****************................ | ..........                     2 |                       11.5           0.2            1
11.49/11.52	c ****************................ | ..........                     3 |                       11.5           0.3            1
11.49/11.52	c ****************................ | ..........                     4 |                       11.5           0.3            1
11.49/11.52	c ****************................ | ..........                     5 |                       11.5           0.4            1
11.49/11.52	c ****************................ | ..........                     6 |                       11.5           0.5            1
11.49/11.53	c ****************................ | ..........                  1000 | 2                     11.5          86.7          130
23.84/17.78	c ****************................ | ..........                235000 | 18026                 24.0        9787.6      1662018
47.99/29.80	c ****************................ | ..........                562000 | 45217                 48.0       11705.9      4285178
71.94/41.84	c ****************................ | ..........                815000 | 66199                 72.0       11316.3      6241369
95.88/53.87	c ****************................ | ..........               1061000 | 86687                 96.0       11047.5      7956187
119.83/65.88	c ****************................ | *.........               1295000 | 104769               120.0       10790.8      9632532
143.98/77.93	c ****************................ | *.........               1563000 | 123308               144.1       10848.9     11865560
167.92/89.94	c ****************................ | *.........               1861000 | 143520               168.0       11075.4     13407704
191.88/101.96	c ****************................ | *.........               2153000 | 163053               192.0       11211.8     14501677
215.82/113.97	c ****************................ | *.........               2462000 | 185191               216.0       11397.6     16136766
239.97/126.03	c ****************................ | **........               2767000 | 206705               240.1       11525.8     17586237
263.91/138.03	c ****************................ | **........               3093000 | 228854               264.0       11714.6     19111192
287.87/150.04	c ****************................ | **........               3419000 | 251430               288.0       11871.5     21153194
311.82/162.07	c ****************................ | **........               3729000 | 274320               312.0       11951.5     22941937
335.76/174.10	c ****************................ | **........               4048000 | 296102               336.0       12047.3     24468685
359.92/186.12	c ****************................ | ***.......               4369000 | 318309               360.0       12135.4     26101380
383.87/198.14	c ****************................ | ***.......               4700000 | 341787               384.0       12239.3     27653357
407.82/210.16	c ****************................ | ***.......               4996000 | 364447               408.0       12245.1     29332121
431.97/222.21	c ****************................ | ***.......               5320000 | 386456               432.1       12313.4     30995283
455.91/234.25	c ****************................ | ***.......               5649000 | 409369               456.1       12385.4     32623505
479.85/246.26	c ****************................ | ****......               5972000 | 432386               480.1       12440.4     34266996
503.81/258.27	c ****************................ | ****......               6303000 | 455598               504.0       12505.0     35790981
527.75/270.29	c ****************................ | ****......               6620000 | 477623               528.0       12537.6     37381270
551.90/282.32	c ****************................ | ****......               6953000 | 501028               552.0       12595.3     39046743
575.85/294.35	c ****************................ | ****......               7276000 | 524581               576.0       12630.8     40702225
599.81/306.38	c ****************................ | *****.....               7608000 | 547674               600.1       12678.7     42255237
623.75/318.37	c ****************................ | *****.....               7899000 | 570206               624.0       12658.7     44021932
647.89/330.41	c ****************................ | *****.....               8218000 | 592847               648.0       12681.9     45627595
671.83/342.43	c ****************................ | *****.....               8541000 | 615208               672.0       12709.8     47187596
695.77/354.49	c ****************................ | *****.....               8869000 | 637835               696.1       12741.7     48724934
719.91/366.50	c ****************................ | ******....               9199000 | 661200               720.0       12775.9     50338879
743.86/378.55	c ****************................ | ******....               9523000 | 684428               744.1       12798.7     51920154
767.80/390.57	c ****************................ | ******....               9852000 | 707452               768.0       12827.3     53496108
791.72/402.60	c ****************................ | ******....              10176000 | 730356               792.0       12847.8     55027732
815.86/414.63	c ****************................ | ******....              10509000 | 753509               816.0       12877.9     56508022
839.80/426.63	c ****************................ | *******...              10823000 | 776523               840.0       12884.5     58086520
863.74/438.69	c ****************................ | *******...              11151000 | 800206               864.1       12905.2     59657747
887.87/450.70	c ****************................ | *******...              11473000 | 822773               888.0       12919.9     61315117
911.81/462.73	c ****************................ | *******...              11803000 | 845402               912.0       12941.7     63015779
935.75/474.78	c ****************................ | *******...              12126000 | 869415               936.0       12954.4     64642363
959.68/486.79	c ****************................ | ********..              12456000 | 892766               960.0       12974.7     66209669
983.83/498.82	c ****************................ | ********..              12785000 | 916125               984.0       12992.5     67803066
1007.77/510.84	c ****************................ | ********..              13116000 | 939801              1008.0       13011.8     69353789
1031.71/522.90	c ****************................ | ********..              13422000 | 962824              1032.1       13005.1     70777882
1055.84/534.94	c ****************................ | ********..              13626000 | 980140              1056.1       12902.4     71810505
1079.78/546.99	c ****************................ | *********.              13845000 | 998409              1080.1       12818.0     73154453
1103.72/558.95	c ****************................ | *********.              14143000 | 1019395             1104.0       12810.7     74503122
1127.67/571.00	c ****************................ | *********.              14419000 | 1038733             1128.0       12782.3     75729952
1151.81/583.01	c ****************................ | *********.              14740000 | 1061015             1152.0       12795.1     77292697
1175.74/595.05	c ****************................ | *********.              15065000 | 1083416             1176.0       12809.9     78820524
1199.88/607.12	c CPU limit (1200) reached
1199.88/607.12	c Time = 1200.11 seconds
1199.88/607.12	s UNKNOWN

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver version 3.2.9 (svn:492) (c) roussel@cril.univ-artois.fr

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-1562864-1240998506/watcher-1562864-1240998506 -o /tmp/evaluation-result-1562864-1240998506/solver-1562864-1240998506 -C 1200 -W 1800 -M 1800 HOME/ttsth-5-0 -num-threads 2 HOME/instance-1562864-1240998506.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1200 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1230 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.00 0.97 0.70 3/64 10543
/proc/meminfo: memFree=799728/2055920 swapFree=4180896/4192956
[pid=10543] ppid=10541 vsize=1064 CPUtime=0
/proc/10543/stat : 10543 (ttsth-5-0) R 10541 10543 10300 0 -1 4194304 148 0 0 0 0 0 0 0 20 0 1 0 127883504 1089536 132 1992294400 134512640 135237372 4294956192 18446744073709551615 134732614 0 0 4096 0 0 0 0 17 1 0 0
/proc/10543/statm: 266 133 77 176 0 88 0

[startup+0.10342 s]
/proc/loadavg: 1.00 0.97 0.70 3/64 10543
/proc/meminfo: memFree=799728/2055920 swapFree=4180896/4192956
[pid=10543] ppid=10541 vsize=4372 CPUtime=0.09
/proc/10543/stat : 10543 (ttsth-5-0) R 10541 10543 10300 0 -1 4194304 993 0 0 0 9 0 0 0 20 0 1 0 127883504 4476928 977 1992294400 134512640 135237372 4294956192 18446744073709551615 134737654 0 0 4096 0 0 0 0 17 1 0 0
/proc/10543/statm: 1093 977 78 176 0 915 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 4372

[startup+0.202429 s]
/proc/loadavg: 1.00 0.97 0.70 3/64 10543
/proc/meminfo: memFree=799728/2055920 swapFree=4180896/4192956
[pid=10543] ppid=10541 vsize=7708 CPUtime=0.19
/proc/10543/stat : 10543 (ttsth-5-0) R 10541 10543 10300 0 -1 4194304 1789 0 0 0 19 0 0 0 21 0 1 0 127883504 7892992 1773 1992294400 134512640 135237372 4294956192 18446744073709551615 134884129 0 0 4096 0 0 0 0 17 1 0 0
/proc/10543/statm: 1927 1774 78 176 0 1749 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 7708

[startup+0.302438 s]
/proc/loadavg: 1.00 0.97 0.70 3/64 10543
/proc/meminfo: memFree=799728/2055920 swapFree=4180896/4192956
[pid=10543] ppid=10541 vsize=9812 CPUtime=0.3
/proc/10543/stat : 10543 (ttsth-5-0) R 10541 10543 10300 0 -1 4194304 2266 0 0 0 29 1 0 0 22 0 1 0 127883504 10047488 2250 1992294400 134512640 135237372 4294956192 18446744073709551615 134534098 0 0 4096 0 0 0 0 17 1 0 0
/proc/10543/statm: 2453 2250 78 176 0 2275 0
Current children cumulated CPU time (s) 0.3
Current children cumulated vsize (KiB) 9812

[startup+0.70148 s]
/proc/loadavg: 1.00 0.97 0.70 3/64 10543
/proc/meminfo: memFree=799728/2055920 swapFree=4180896/4192956
[pid=10543] ppid=10541 vsize=18340 CPUtime=0.69
/proc/10543/stat : 10543 (ttsth-5-0) R 10541 10543 10300 0 -1 4194304 4359 0 0 0 68 1 0 0 25 0 1 0 127883504 18780160 4342 1992294400 134512640 135237372 4294956192 18446744073709551615 134519996 0 0 4096 0 0 0 0 17 1 0 0
/proc/10543/statm: 4585 4342 79 176 0 4407 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 18340

[startup+1.50156 s]
/proc/loadavg: 1.00 0.97 0.70 2/65 10544
/proc/meminfo: memFree=780264/2055920 swapFree=4180896/4192956
[pid=10543] ppid=10541 vsize=21944 CPUtime=1.49
/proc/10543/stat : 10543 (ttsth-5-0) R 10541 10543 10300 0 -1 4194304 5636 0 0 0 148 1 0 0 25 0 1 0 127883504 22470656 5306 1992294400 134512640 135237372 4294956192 18446744073709551615 134600848 0 0 4096 0 0 0 0 17 1 0 0
/proc/10543/statm: 5486 5306 80 176 0 5308 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 21944

[startup+3.10172 s]
/proc/loadavg: 1.00 0.97 0.70 2/65 10544
/proc/meminfo: memFree=778664/2055920 swapFree=4180896/4192956
[pid=10543] ppid=10541 vsize=22220 CPUtime=3.09
/proc/10543/stat : 10543 (ttsth-5-0) R 10541 10543 10300 0 -1 4194304 5657 0 0 0 308 1 0 0 25 0 1 0 127883504 22753280 5327 1992294400 134512640 135237372 4294956192 18446744073709551615 134600707 0 0 4096 0 0 0 0 17 1 0 0
/proc/10543/statm: 5555 5327 80 176 0 5377 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 22220

[startup+6.30105 s]
/proc/loadavg: 1.00 0.97 0.70 2/65 10544
/proc/meminfo: memFree=778408/2055920 swapFree=4180896/4192956
[pid=10543] ppid=10541 vsize=22220 CPUtime=6.28
/proc/10543/stat : 10543 (ttsth-5-0) R 10541 10543 10300 0 -1 4194304 5708 0 0 0 627 1 0 0 25 0 1 0 127883504 22753280 5378 1992294400 134512640 135237372 4294956192 18446744073709551615 134600744 0 0 4096 0 0 0 0 17 1 0 0
/proc/10543/statm: 5555 5378 80 176 0 5377 0
Current children cumulated CPU time (s) 6.28
Current children cumulated vsize (KiB) 22220

[startup+12.7017 s]
/proc/loadavg: 1.00 0.97 0.71 3/67 10546
/proc/meminfo: memFree=722600/2055920 swapFree=4180896/4192956
[pid=10543] ppid=10541 vsize=101236 CPUtime=13.86
/proc/10543/stat : 10543 (ttsth-5-0) S 10541 10543 10300 0 -1 4194304 20650 0 0 0 1379 7 0 0 25 0 3 0 127883504 103665664 20096 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/10543/statm: 25309 20096 98 176 0 25131 0
[pid=10543/tid=10545] ppid=10541 vsize=101236 CPUtime=1.17
/proc/10543/task/10545/stat : 10545 (ttsth-5-0) R 10541 10543 10300 0 -1 4194368 1087 0 0 0 117 0 0 0 18 0 3 0 127884656 103665664 20096 1992294400 134512640 135237372 4294956192 18446744073709551615 134562420 0 0 4096 0 0 0 0 -1 1 0 0
[pid=10543/tid=10546] ppid=10541 vsize=101236 CPUtime=1.17
/proc/10543/task/10546/stat : 10546 (ttsth-5-0) R 10541 10543 10300 0 -1 4194368 844 0 0 0 117 0 0 0 19 0 3 0 127884656 103665664 20097 1992294400 134512640 135237372 4294956192 18446744073709551615 134590501 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 13.86
Current children cumulated vsize (KiB) 101236

[startup+25.503 s]
/proc/loadavg: 1.23 1.02 0.73 3/67 10546
/proc/meminfo: memFree=672616/2055920 swapFree=4180896/4192956
[pid=10543] ppid=10541 vsize=150876 CPUtime=39.41
/proc/10543/stat : 10543 (ttsth-5-0) S 10541 10543 10300 0 -1 4194304 32577 0 0 0 3926 15 0 0 25 0 3 0 127883504 154497024 32023 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/10543/statm: 37719 32023 98 176 0 37541 0
[pid=10543/tid=10545] ppid=10541 vsize=150876 CPUtime=13.97
/proc/10543/task/10545/stat : 10545 (ttsth-5-0) R 10541 10543 10300 0 -1 4194368 6322 0 0 0 1393 4 0 0 25 0 3 0 127884656 154497024 32023 1992294400 134512640 135237372 4294956192 18446744073709551615 134590180 0 0 4096 0 0 0 0 -1 1 0 0
[pid=10543/tid=10546] ppid=10541 vsize=150876 CPUtime=13.92
/proc/10543/task/10546/stat : 10546 (ttsth-5-0) R 10541 10543 10300 0 -1 4194368 7536 0 0 0 1388 4 0 0 25 0 3 0 127884656 154497024 32023 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 39.41
Current children cumulated vsize (KiB) 150876

[startup+51.1026 s]
/proc/loadavg: 1.53 1.11 0.76 3/67 10546
/proc/meminfo: memFree=608616/2055920 swapFree=4180896/4192956
[pid=10543] ppid=10541 vsize=218100 CPUtime=90.49
/proc/10543/stat : 10543 (ttsth-5-0) S 10541 10543 10300 0 -1 4194304 48764 0 0 0 9021 28 0 0 25 0 3 0 127883504 223334400 48210 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/10543/statm: 54525 48210 98 176 0 54347 0
[pid=10543/tid=10545] ppid=10541 vsize=218100 CPUtime=39.56
/proc/10543/task/10545/stat : 10545 (ttsth-5-0) R 10541 10543 10300 0 -1 4194368 14179 0 0 0 3945 11 0 0 25 0 3 0 127884656 223334400 48210 1992294400 134512640 135237372 4294956192 18446744073709551615 134749351 0 0 4096 0 0 0 0 -1 1 0 0
[pid=10543/tid=10546] ppid=10541 vsize=218100 CPUtime=39.41
/proc/10543/task/10546/stat : 10546 (ttsth-5-0) R 10541 10543 10300 0 -1 4194368 15866 0 0 0 3931 10 0 0 25 0 3 0 127884656 223334400 48210 1992294400 134512640 135237372 4294956192 18446744073709551615 134590285 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 90.49
Current children cumulated vsize (KiB) 218100

[startup+102.303 s]
/proc/loadavg: 1.84 1.26 0.83 3/67 10546
/proc/meminfo: memFree=497256/2055920 swapFree=4180896/4192956
[pid=10543] ppid=10541 vsize=332024 CPUtime=192.69
/proc/10543/stat : 10543 (ttsth-5-0) S 10541 10543 10300 0 -1 4194304 76139 0 0 0 19220 49 0 0 25 0 3 0 127883504 339992576 75585 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/10543/statm: 83006 75585 98 176 0 82828 0
[pid=10543/tid=10545] ppid=10541 vsize=332024 CPUtime=90.74
/proc/10543/task/10545/stat : 10545 (ttsth-5-0) R 10541 10543 10300 0 -1 4194368 29691 0 0 0 9053 21 0 0 25 0 3 0 127884656 339992576 75585 1992294400 134512640 135237372 4294956192 18446744073709551615 134562357 0 0 4096 0 0 0 0 -1 1 0 0
[pid=10543/tid=10546] ppid=10541 vsize=332024 CPUtime=90.41
/proc/10543/task/10546/stat : 10546 (ttsth-5-0) R 10541 10543 10300 0 -1 4194368 27729 0 0 0 9021 20 0 0 25 0 3 0 127884656 339992576 75585 1992294400 134512640 135237372 4294956192 18446744073709551615 134562380 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 192.69
Current children cumulated vsize (KiB) 332024

[startup+162.303 s]
/proc/loadavg: 1.98 1.41 0.91 3/67 10546
/proc/meminfo: memFree=365800/2055920 swapFree=4180896/4192956
[pid=10543] ppid=10541 vsize=471036 CPUtime=312.42
/proc/10543/stat : 10543 (ttsth-5-0) S 10541 10543 10300 0 -1 4194304 109313 0 0 0 31166 76 0 0 25 0 3 0 127883504 482340864 108759 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/10543/statm: 117759 108759 98 176 0 117581 0
[pid=10543/tid=10545] ppid=10541 vsize=471036 CPUtime=150.73
/proc/10543/task/10545/stat : 10545 (ttsth-5-0) R 10541 10543 10300 0 -1 4194368 50596 0 0 0 15034 39 0 0 25 0 3 0 127884656 482340864 108759 1992294400 134512640 135237372 4294956192 18446744073709551615 134562380 0 0 4096 0 0 0 0 -1 1 0 0
[pid=10543/tid=10546] ppid=10541 vsize=471036 CPUtime=150.17
/proc/10543/task/10546/stat : 10546 (ttsth-5-0) R 10541 10543 10300 0 -1 4194368 39998 0 0 0 14987 30 0 0 25 0 3 0 127884656 482340864 108759 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 312.42
Current children cumulated vsize (KiB) 471036

[startup+222.306 s]
/proc/loadavg: 2.18 1.57 0.99 3/67 10546
/proc/meminfo: memFree=238184/2055920 swapFree=4180896/4192956
[pid=10543] ppid=10541 vsize=603592 CPUtime=432.16
/proc/10543/stat : 10543 (ttsth-5-0) S 10541 10543 10300 0 -1 4194304 140817 0 0 0 43115 101 0 0 25 0 3 0 127883504 618078208 140263 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/10543/statm: 150898 140263 98 176 0 150720 0
[pid=10543/tid=10545] ppid=10541 vsize=603592 CPUtime=210.71
/proc/10543/task/10545/stat : 10545 (ttsth-5-0) R 10541 10543 10300 0 -1 4194368 71317 0 0 0 21019 52 0 0 25 0 3 0 127884656 618078208 140263 1992294400 134512640 135237372 4294956192 18446744073709551615 134562360 0 0 4096 0 0 0 0 -1 1 0 0
[pid=10543/tid=10546] ppid=10541 vsize=603592 CPUtime=209.92
/proc/10543/task/10546/stat : 10546 (ttsth-5-0) R 10541 10543 10300 0 -1 4194368 50781 0 0 0 20951 41 0 0 25 0 3 0 127884656 618078208 140263 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 432.16
Current children cumulated vsize (KiB) 603592

[startup+282.302 s]
/proc/loadavg: 2.18 1.68 1.06 3/67 10546
/proc/meminfo: memFree=113256/2055920 swapFree=4180896/4192956
[pid=10543] ppid=10541 vsize=736008 CPUtime=551.9
/proc/10543/stat : 10543 (ttsth-5-0) S 10541 10543 10300 0 -1 4194304 172272 0 0 0 55064 126 0 0 25 0 3 0 127883504 753672192 171718 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/10543/statm: 184002 171718 98 176 0 183824 0
[pid=10543/tid=10545] ppid=10541 vsize=736008 CPUtime=270.69
/proc/10543/task/10545/stat : 10545 (ttsth-5-0) R 10541 10543 10300 0 -1 4194368 91767 0 0 0 27003 66 0 0 25 0 3 0 127884656 753672192 171718 1992294400 134512640 135237372 4294956192 18446744073709551615 134749335 0 0 4096 0 0 0 0 -1 1 0 0
[pid=10543/tid=10546] ppid=10541 vsize=736008 CPUtime=269.68
/proc/10543/task/10546/stat : 10546 (ttsth-5-0) R 10541 10543 10300 0 -1 4194368 61786 0 0 0 26916 52 0 0 21 0 3 0 127884656 753672192 171718 1992294400 134512640 135237372 4294956192 18446744073709551615 134749343 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 551.9
Current children cumulated vsize (KiB) 736008

[startup+342.302 s]
/proc/loadavg: 2.07 1.73 1.12 3/67 10546
/proc/meminfo: memFree=15592/2055920 swapFree=4180896/4192956
[pid=10543] ppid=10541 vsize=871064 CPUtime=671.63
/proc/10543/stat : 10543 (ttsth-5-0) S 10541 10543 10300 0 -1 4194304 204078 0 0 0 67011 152 0 0 25 0 3 0 127883504 891969536 203524 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/10543/statm: 217766 203524 98 176 0 217588 0
[pid=10543/tid=10545] ppid=10541 vsize=871064 CPUtime=330.68
/proc/10543/task/10545/stat : 10545 (ttsth-5-0) R 10541 10543 10300 0 -1 4194368 112582 0 0 0 32986 82 0 0 25 0 3 0 127884656 891969536 203524 1992294400 134512640 135237372 4294956192 18446744073709551615 134592429 0 0 4096 0 0 0 0 -1 1 0 0
[pid=10543/tid=10546] ppid=10541 vsize=871064 CPUtime=329.44
/proc/10543/task/10546/stat : 10546 (ttsth-5-0) R 10541 10543 10300 0 -1 4194368 72777 0 0 0 32881 63 0 0 25 0 3 0 127884656 891969536 203524 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 671.63
Current children cumulated vsize (KiB) 871064

[startup+402.302 s]
/proc/loadavg: 2.08 1.80 1.18 3/67 10546
/proc/meminfo: memFree=15080/2055920 swapFree=4180896/4192956
[pid=10543] ppid=10541 vsize=1000820 CPUtime=791.32
/proc/10543/stat : 10543 (ttsth-5-0) S 10541 10543 10300 0 -1 4194304 234659 0 0 0 78954 178 0 0 25 0 3 0 127883504 1024839680 234105 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/10543/statm: 250205 234105 98 176 0 250027 0
[pid=10543/tid=10545] ppid=10541 vsize=1000820 CPUtime=390.62
/proc/10543/task/10545/stat : 10545 (ttsth-5-0) R 10541 10543 10300 0 -1 4194368 133020 0 0 0 38965 97 0 0 25 0 3 0 127884656 1024839680 234105 1992294400 134512640 135237372 4294956192 18446744073709551615 134749351 0 0 4096 0 0 0 0 -1 1 0 0
[pid=10543/tid=10546] ppid=10541 vsize=1000820 CPUtime=389.17
/proc/10543/task/10546/stat : 10546 (ttsth-5-0) R 10541 10543 10300 0 -1 4194368 82920 0 0 0 38844 73 0 0 25 0 3 0 127884656 1024839680 234105 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 791.32
Current children cumulated vsize (KiB) 1000820

[startup+462.303 s]
/proc/loadavg: 2.08 1.85 1.23 3/67 10546
/proc/meminfo: memFree=15656/2055920 swapFree=4180896/4192956
[pid=10543] ppid=10541 vsize=1133504 CPUtime=911.01
/proc/10543/stat : 10543 (ttsth-5-0) S 10541 10543 10300 0 -1 4194304 265951 0 0 0 90894 207 0 0 25 0 3 0 127883504 1160708096 265397 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/10543/statm: 283376 265397 98 176 0 283198 0
[pid=10543/tid=10545] ppid=10541 vsize=1133504 CPUtime=450.58
/proc/10543/task/10545/stat : 10545 (ttsth-5-0) R 10541 10543 10300 0 -1 4194368 153393 0 0 0 44944 114 0 0 25 0 3 0 127884656 1160708096 265397 1992294400 134512640 135237372 4294956192 18446744073709551615 134680737 0 0 4096 0 0 0 0 -1 1 0 0
[pid=10543/tid=10546] ppid=10541 vsize=1133504 CPUtime=448.91
/proc/10543/task/10546/stat : 10546 (ttsth-5-0) R 10541 10543 10300 0 -1 4194368 93839 0 0 0 44805 86 0 0 25 0 3 0 127884656 1160708096 265397 1992294400 134512640 135237372 4294956192 18446744073709551615 134562341 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 911.01
Current children cumulated vsize (KiB) 1133504

[startup+522.303 s]
/proc/loadavg: 2.10 1.89 1.28 3/67 10546
/proc/meminfo: memFree=16360/2055920 swapFree=4180896/4192956
[pid=10543] ppid=10541 vsize=1261068 CPUtime=1030.71
/proc/10543/stat : 10543 (ttsth-5-0) S 10541 10543 10300 0 -1 4194304 296231 0 0 0 102837 234 0 0 25 0 3 0 127883504 1291333632 295677 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/10543/statm: 315267 295677 98 176 0 315089 0
[pid=10543/tid=10545] ppid=10541 vsize=1261068 CPUtime=510.53
/proc/10543/task/10545/stat : 10545 (ttsth-5-0) R 10541 10543 10300 0 -1 4194368 173066 0 0 0 50924 129 0 0 25 0 3 0 127884656 1291333632 295677 1992294400 134512640 135237372 4294956192 18446744073709551615 134561510 0 0 4096 0 0 0 0 -1 1 0 0
[pid=10543/tid=10546] ppid=10541 vsize=1261068 CPUtime=508.65
/proc/10543/task/10546/stat : 10546 (ttsth-5-0) R 10541 10543 10300 0 -1 4194368 104446 0 0 0 50768 97 0 0 25 0 3 0 127884656 1291333632 295677 1992294400 134512640 135237372 4294956192 18446744073709551615 134591177 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1030.71
Current children cumulated vsize (KiB) 1261068

[startup+582.302 s]
/proc/loadavg: 2.04 1.91 1.32 3/67 10546
/proc/meminfo: memFree=15976/2055920 swapFree=4180896/4192956
[pid=10543] ppid=10541 vsize=1366108 CPUtime=1150.39
/proc/10543/stat : 10543 (ttsth-5-0) S 10541 10543 10300 0 -1 4194304 321596 0 0 0 114779 260 0 0 25 0 3 0 127883504 1398894592 321042 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/10543/statm: 341527 321042 98 176 0 341349 0
[pid=10543/tid=10545] ppid=10541 vsize=1366108 CPUtime=570.49
/proc/10543/task/10545/stat : 10545 (ttsth-5-0) R 10541 10543 10300 0 -1 4194368 188574 0 0 0 56905 144 0 0 25 0 3 0 127884656 1398894592 321042 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 1 0 0
[pid=10543/tid=10546] ppid=10541 vsize=1366108 CPUtime=568.38
/proc/10543/task/10546/stat : 10546 (ttsth-5-0) R 10541 10543 10300 0 -1 4194368 114303 0 0 0 56729 109 0 0 18 0 3 0 127884656 1398894592 321042 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1150.39
Current children cumulated vsize (KiB) 1366108



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+607.202 s]
/proc/loadavg: 2.02 1.91 1.34 2/65 10546
/proc/meminfo: memFree=517864/2055920 swapFree=4180896/4192956
[pid=10543] ppid=10541 vsize=0 CPUtime=1200.02
/proc/10543/stat : 10543 (ttsth-5-0) R 10541 10543 10300 0 -1 4195332 333953 0 0 0 119723 279 0 0 17 0 1 0 127883504 0 0 1992294400 0 0 0 0 0 0 0 4096 0 0 0 0 17 1 0 0
/proc/10543/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 1200.02
Current children cumulated vsize (KiB) 0

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+607.311 s]
/proc/loadavg: 2.02 1.91 1.34 2/65 10546
/proc/meminfo: memFree=517864/2055920 swapFree=4180896/4192956
[pid=10543] ppid=10541 vsize=0 CPUtime=1200.12
/proc/10543/stat : 10543 (ttsth-5-0) R 10541 10543 10300 0 -1 4195332 333953 0 0 0 119723 289 0 0 18 0 1 0 127883504 0 0 1992294400 0 0 0 0 0 0 0 4096 0 0 0 0 17 1 0 0
/proc/10543/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 1200.12
Current children cumulated vsize (KiB) 0

Child status: 0
Real time (s): 607.346
CPU time (s): 1200.16
CPU user time (s): 1197.23
CPU system time (s): 2.92555
CPU usage (%): 197.607
Max. virtual memory (cumulated for all children) (KiB): 1417356

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1197.23
system time used= 2.92556
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 333953
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 141
involuntary context switches= 9552

runsolver used 0.613906 second user time and 1.61875 second system time

The end

Launcher Data 

Begin job on node27 at 2009-04-29 11:48:26
IDJOB=1562864
IDBENCH=70942
IDSOLVER=549
FILE ID=node27/1562864-1240998506
PBS_JOBID= 9204840
Free space on /tmp= 66188 MiB

SOLVER NAME= ttsth-5-0 2009-03-19
BENCH NAME= SAT09/APPLICATIONS/bioinfo/q_query_3_l37_lambda.cnf
COMMAND LINE= HOME/ttsth-5-0 -num-threads MAXNBTHREAD BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-1562864-1240998506/watcher-1562864-1240998506 -o /tmp/evaluation-result-1562864-1240998506/solver-1562864-1240998506 -C 1200 -W 1800 -M 1800  HOME/ttsth-5-0 -num-threads 2 HOME/instance-1562864-1240998506.cnf

TIME LIMIT= 1200 seconds
MEMORY LIMIT= 1800 MiB
MAX NB THREAD= 2

MD5SUM BENCH= 6c0fa36b77ee8403468509d27984ddf2
RANDOM SEED=208794980

node27.alineos.net Linux 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 2800.234
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5521.40
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 2800.234
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:        800144 kB
Buffers:         71384 kB
Cached:        1093480 kB
SwapCached:       5076 kB
Active:         315552 kB
Inactive:       857436 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:        800144 kB
SwapTotal:     4192956 kB
SwapFree:      4180896 kB
Dirty:            3324 kB
Writeback:           0 kB
Mapped:          14144 kB
Slab:            68636 kB
Committed_AS:   497440 kB
PageTables:       1372 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264948 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66188 MiB
End job on node27 at 2009-04-29 11:58:35