Trace number 1563124

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ttsth-5-0 2009-03-19? (TO) 1200.08 611.73

General information on the benchmark

NameAPPLICATIONS/bioinfo/
q_query_3_l48_lambda.cnf
MD5SUMe7c28f6a200a1c1912fbaacfb3572515
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark261.819
Satisfiable
(Un)Satisfiability was proved
Number of variables34656
Number of clauses174528
Sum of the clauses size503708
Maximum clause length9
Minimum clause length1
Number of clauses of size 14424
Number of clauses of size 242805
Number of clauses of size 3103458
Number of clauses of size 416481
Number of clauses of size 57216
Number of clauses of size over 5144

Solver Data 

0.49/0.51	c Command: HOME/ttsth-5-0 -num-threads 2 HOME/instance-1563124-1241000648.cnf 
0.49/0.51	c Using SATTIMEOUT of 1200
0.49/0.51	c Using SATRAM of 1800
0.49/0.51	c Size of subset node = 16
0.49/0.51	c Variables = 34656
0.49/0.51	c Clauses = 174528
0.49/0.51	c Literals = 503708
0.49/0.51	c Reduced size:
0.49/0.51	c Variables = 34656
0.49/0.51	c Clauses = 157923
0.49/0.51	c Literals = 462041
0.49/0.51	c a2
0.99/1.06	c a1
17.78/17.82	c Independent sub-problems = 1
17.78/17.82	c Sub-problem with 29324 variables and 157923 clauses
17.78/17.82	c using permutation method 4
17.78/17.82	c count = 1
17.78/17.82	c Ordering finished 17.720 seconds
17.78/17.82	c mapped 17.810 seconds
17.78/17.82	c permuted 17.810 seconds
17.78/17.82	c about to sort
17.78/17.88	c sorted
20.48/20.55	c clauses now 157923
20.48/20.55	c init finished 18.020 seconds
20.48/20.55	c tree built 20.540 seconds
20.48/20.55	c 
20.48/20.55	c PA progress                      | CPU progress Partial assignments | improvements      CPU time        PA/sec        nodes
20.48/20.55	c ---------------------------------|----------------------------------|------------------------------------------------------
20.48/20.55	c ................................ | ..........                       |                       20.5           0.0             
20.48/20.55	c ................................ | ..........                     1 |                       20.5           0.0             
20.48/20.55	c ****************................ | ..........                     2 |                       20.5           0.1            1
20.48/20.55	c ****************................ | ..........                     3 |                       20.5           0.1            1
20.48/20.55	c ****************................ | ..........                     4 |                       20.5           0.2            1
20.48/20.55	c ****************................ | ..........                     5 |                       20.5           0.2            1
20.48/20.55	c ****************................ | ..........                     6 |                       20.5           0.3            1
20.48/20.58	c ****************................ | ..........                  1000 | 8                     20.6          48.6          121
23.82/22.29	c ****************................ | ..........                 88000 | 2997                  24.0        3665.1       311666
47.97/34.31	c ****************................ | ..........                613000 | 27854                 48.0       12770.8      1899038
71.92/46.35	c ****************................ | ..........               1170000 | 53179                 72.0       16243.2      3545286
95.86/58.37	c ****************................ | ..........               1780000 | 81206                 96.0       18535.9      5067628
120.02/70.40	c ****************................ | *.........               2145000 | 94926                120.0       17869.0      6943097
143.96/82.41	c ****************................ | *.........               2469000 | 107080               144.0       17145.8      8542377
167.91/94.43	c ****************................ | *.........               2821000 | 120188               168.0       16791.7     10143889
191.85/106.46	c ****************................ | *.........               3186000 | 133699               192.0       16593.8     11880686
215.80/118.50	c ****************................ | *.........               3521000 | 146002               216.0       16298.7     13608960
239.94/130.53	c ****************................ | **........               3814000 | 156338               240.0       15889.0     15296046
263.90/142.55	c ****************................ | **........               4101000 | 166320               264.1       15531.1     16697536
287.83/154.56	c ****************................ | **........               4392000 | 176377               288.0       15249.5     18027454
311.98/166.61	c ****************................ | **........               4662000 | 185691               312.1       14939.4     19618493
335.94/178.63	c ****************................ | **........               4916000 | 194475               336.1       14628.8     20922336
359.88/190.66	c ****************................ | ***.......               5174000 | 203356               360.1       14369.4     22181211
383.82/202.66	c ****************................ | ***.......               5435000 | 212351               384.0       14153.3     23405653
407.98/214.74	c ****************................ | ***.......               5693000 | 221176               408.1       13949.3     24720611
431.92/226.73	c ****************................ | ***.......               5944000 | 229858               432.1       13757.7     25581559
455.87/238.75	c ****************................ | ***.......               6199000 | 238675               456.0       13593.4     26700599
479.81/250.79	c ****************................ | ****......               6447000 | 247201               480.1       13429.3     27960933
503.97/262.81	c ****************................ | ****......               6692000 | 255686               504.1       13275.9     29040925
527.91/274.82	c ****************................ | ****......               6938000 | 264635               528.0       13139.4     30564502
551.85/286.83	c ****************................ | ****......               7191000 | 273729               552.0       13026.9     31906786
575.80/298.85	c ****************................ | ****......               7490000 | 284347               576.0       13003.5     33342516
599.95/310.90	c ****************................ | *****.....               7751000 | 294106               600.0       12917.3     34921524
623.89/322.94	c ****************................ | *****.....               8007000 | 302986               624.1       12830.1     36382085
647.84/334.95	c ****************................ | *****.....               8249000 | 311299               648.0       12729.0     37736064
671.79/346.97	c ****************................ | *****.....               8498000 | 319854               672.0       12645.3     38945255
695.74/358.99	c ****************................ | *****.....               8736000 | 328086               696.0       12551.0     39936114
719.89/371.01	c ****************................ | ******....               8972000 | 336379               720.0       12460.8     40865649
743.83/383.09	c ****************................ | ******....               9189000 | 344284               744.1       12348.6     41937603
767.77/395.05	c ****************................ | ******....               9410000 | 351824               768.0       12252.6     43191618
791.73/407.10	c ****************................ | ******....               9620000 | 358916               792.0       12145.9     44683490
815.87/419.12	c ****************................ | ******....               9826000 | 365906               816.0       12041.1     45859733
839.82/431.16	c ****************................ | *******...              10048000 | 373550               840.1       11961.1     47041895
863.96/443.21	c ****************................ | *******...              10256000 | 380637               864.1       11868.7     47827585
887.91/455.23	c ****************................ | *******...              10464000 | 387742               888.1       11782.5     48513888
912.05/467.30	c ****************................ | *******...              10664000 | 394945               912.2       11690.4     49664305
935.80/479.28	c ****************................ | *******...              10800000 | 399581               936.1       11537.0     50417712
959.74/491.28	c ****************................ | ********..              10963000 | 405106               960.1       11419.1     51744597
983.89/503.31	c ****************................ | ********..              11142000 | 411170               984.1       11322.5     52696494
1007.83/515.34	c ****************................ | ********..              11303000 | 416657              1008.1       11212.4     53753526
1031.79/527.34	c ****************................ | ********..              11496000 | 423267              1032.0       11139.3     55538130
1055.73/539.35	c ****************................ | ********..              11692000 | 429883              1056.0       11072.0     56388016
1079.88/551.41	c ****************................ | *********.              11911000 | 437419              1080.1       11027.9     57563453
1103.82/563.41	c ****************................ | *********.              12114000 | 444358              1104.0       10972.6     58477229
1127.77/575.44	c ****************................ | *********.              12298000 | 450576              1128.0       10902.1     59675562
1151.72/587.49	c ****************................ | *********.              12472000 | 456897              1152.1       10825.6     60983671
1175.86/599.51	c ****************................ | *********.              12607000 | 461469              1176.0       10719.8     62592362
1199.79/611.55	c CPU limit (1200) reached
1199.79/611.55	c Time = 1200.08 seconds
1199.79/611.55	s UNKNOWN

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver version 3.2.9 (svn:492) (c) roussel@cril.univ-artois.fr

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-1563124-1241000648/watcher-1563124-1241000648 -o /tmp/evaluation-result-1563124-1241000648/solver-1563124-1241000648 -C 1200 -W 1800 -M 1800 HOME/ttsth-5-0 -num-threads 2 HOME/instance-1563124-1241000648.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1200 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1230 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.83 1.82 1.40 3/64 19345
/proc/meminfo: memFree=1069536/2055920 swapFree=4181900/4192956
[pid=19345] ppid=19343 vsize=1064 CPUtime=0
/proc/19345/stat : 19345 (ttsth-5-0) R 19343 19345 19127 0 -1 4194304 146 0 0 0 0 0 0 0 18 0 1 0 128092794 1089536 130 1992294400 134512640 135237372 4294956192 18446744073709551615 134732614 0 0 4096 0 0 0 0 17 1 0 0
/proc/19345/statm: 266 130 77 176 0 88 0

[startup+0.043813 s]
/proc/loadavg: 1.83 1.82 1.40 3/64 19345
/proc/meminfo: memFree=1069536/2055920 swapFree=4181900/4192956
[pid=19345] ppid=19343 vsize=2412 CPUtime=0.04
/proc/19345/stat : 19345 (ttsth-5-0) R 19343 19345 19127 0 -1 4194304 491 0 0 0 4 0 0 0 18 0 1 0 128092794 2469888 475 1992294400 134512640 135237372 4294956192 18446744073709551615 134732614 0 0 4096 0 0 0 0 17 1 0 0
/proc/19345/statm: 603 475 78 176 0 425 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 2412

[startup+0.101823 s]
/proc/loadavg: 1.83 1.82 1.40 3/64 19345
/proc/meminfo: memFree=1069536/2055920 swapFree=4181900/4192956
[pid=19345] ppid=19343 vsize=4372 CPUtime=0.09
/proc/19345/stat : 19345 (ttsth-5-0) R 19343 19345 19127 0 -1 4194304 987 0 0 0 9 0 0 0 18 0 1 0 128092794 4476928 971 1992294400 134512640 135237372 4294956192 18446744073709551615 134732614 0 0 4096 0 0 0 0 17 1 0 0
/proc/19345/statm: 1093 972 78 176 0 915 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 4372

[startup+0.301858 s]
/proc/loadavg: 1.83 1.82 1.40 3/64 19345
/proc/meminfo: memFree=1069536/2055920 swapFree=4181900/4192956
[pid=19345] ppid=19343 vsize=11144 CPUtime=0.29
/proc/19345/stat : 19345 (ttsth-5-0) R 19343 19345 19127 0 -1 4194304 2618 0 0 0 29 0 0 0 19 0 1 0 128092794 11411456 2602 1992294400 134512640 135237372 4294956192 18446744073709551615 134639534 0 0 4096 0 0 0 0 17 1 0 0
/proc/19345/statm: 2786 2603 78 176 0 2608 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 11144

[startup+0.701932 s]
/proc/loadavg: 1.83 1.82 1.40 3/64 19345
/proc/meminfo: memFree=1069536/2055920 swapFree=4181900/4192956
[pid=19345] ppid=19343 vsize=25084 CPUtime=0.69
/proc/19345/stat : 19345 (ttsth-5-0) R 19343 19345 19127 0 -1 4194304 6014 0 0 0 68 1 0 0 23 0 1 0 128092794 25686016 5967 1992294400 134512640 135237372 4294956192 18446744073709551615 134519991 0 0 4096 0 0 0 0 17 1 0 0
/proc/19345/statm: 6271 5967 79 176 0 6093 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 25084

[startup+1.50108 s]
/proc/loadavg: 1.83 1.82 1.40 2/65 19346
/proc/meminfo: memFree=1045784/2055920 swapFree=4181900/4192956
[pid=19345] ppid=19343 vsize=27264 CPUtime=1.49
/proc/19345/stat : 19345 (ttsth-5-0) R 19343 19345 19127 0 -1 4194304 7173 0 0 0 147 2 0 0 25 0 1 0 128092794 27918336 6616 1992294400 134512640 135237372 4294956192 18446744073709551615 134732614 0 0 4096 0 0 0 0 17 1 0 0
/proc/19345/statm: 6816 6616 80 176 0 6638 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 27264

[startup+3.10137 s]
/proc/loadavg: 1.83 1.82 1.40 2/65 19346
/proc/meminfo: memFree=1040600/2055920 swapFree=4181900/4192956
[pid=19345] ppid=19343 vsize=29796 CPUtime=3.08
/proc/19345/stat : 19345 (ttsth-5-0) R 19343 19345 19127 0 -1 4194304 7812 0 0 0 306 2 0 0 25 0 1 0 128092794 30511104 7255 1992294400 134512640 135237372 4294956192 18446744073709551615 134555279 0 0 4096 0 0 0 0 17 1 0 0
/proc/19345/statm: 7449 7255 80 176 0 7271 0
Current children cumulated CPU time (s) 3.08
Current children cumulated vsize (KiB) 29796

[startup+6.30296 s]
/proc/loadavg: 1.77 1.80 1.39 2/65 19346
/proc/meminfo: memFree=1040344/2055920 swapFree=4181900/4192956
[pid=19345] ppid=19343 vsize=30056 CPUtime=6.29
/proc/19345/stat : 19345 (ttsth-5-0) R 19343 19345 19127 0 -1 4194304 7850 0 0 0 627 2 0 0 25 0 1 0 128092794 30777344 7293 1992294400 134512640 135237372 4294956192 18446744073709551615 134600698 0 0 4096 0 0 0 0 17 1 0 0
/proc/19345/statm: 7514 7293 80 176 0 7336 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 30056

[startup+12.7011 s]
/proc/loadavg: 1.71 1.79 1.39 2/65 19346
/proc/meminfo: memFree=1039896/2055920 swapFree=4181900/4192956
[pid=19345] ppid=19343 vsize=30512 CPUtime=12.69
/proc/19345/stat : 19345 (ttsth-5-0) R 19343 19345 19127 0 -1 4194304 7934 0 0 0 1266 3 0 0 25 0 1 0 128092794 31244288 7377 1992294400 134512640 135237372 4294956192 18446744073709551615 134600718 0 0 4096 0 0 0 0 17 1 0 0
/proc/19345/statm: 7628 7377 80 176 0 7450 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 30512

[startup+25.5025 s]
/proc/loadavg: 1.63 1.77 1.39 3/67 19348
/proc/meminfo: memFree=953736/2055920 swapFree=4181900/4192956
[pid=19345] ppid=19343 vsize=137092 CPUtime=30.41
/proc/19345/stat : 19345 (ttsth-5-0) S 19343 19345 19127 0 -1 4194304 30218 0 0 0 3027 14 0 0 25 0 3 0 128092794 140382208 29067 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/19345/statm: 34273 29067 98 176 0 34095 0
[pid=19345/tid=19347] ppid=19343 vsize=137092 CPUtime=4.94
/proc/19345/task/19347/stat : 19347 (ttsth-5-0) R 19343 19345 19127 0 -1 4194368 2065 0 0 0 493 1 0 0 25 0 3 0 128094849 140382208 29067 1992294400 134512640 135237372 4294956192 18446744073709551615 134562351 0 0 4096 0 0 0 0 -1 1 0 0
[pid=19345/tid=19348] ppid=19343 vsize=137092 CPUtime=4.91
/proc/19345/task/19348/stat : 19348 (ttsth-5-0) R 19343 19345 19127 0 -1 4194368 1990 0 0 0 490 1 0 0 25 0 3 0 128094849 140382208 29067 1992294400 134512640 135237372 4294956192 18446744073709551615 134549873 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 30.41
Current children cumulated vsize (KiB) 137092

[startup+51.1021 s]
/proc/loadavg: 1.75 1.79 1.41 3/67 19348
/proc/meminfo: memFree=901896/2055920 swapFree=4181900/4192956
[pid=19345] ppid=19343 vsize=191636 CPUtime=81.5
/proc/19345/stat : 19345 (ttsth-5-0) S 19343 19345 19127 0 -1 4194304 43329 0 0 0 8126 24 0 0 25 0 3 0 128092794 196235264 42178 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/19345/statm: 47909 42178 98 176 0 47731 0
[pid=19345/tid=19347] ppid=19343 vsize=191636 CPUtime=30.53
/proc/19345/task/19347/stat : 19347 (ttsth-5-0) R 19343 19345 19127 0 -1 4194368 8855 0 0 0 3045 8 0 0 25 0 3 0 128094849 196235264 42178 1992294400 134512640 135237372 4294956192 18446744073709551615 134749351 0 0 4096 0 0 0 0 -1 1 0 0
[pid=19345/tid=19348] ppid=19343 vsize=191636 CPUtime=30.42
/proc/19345/task/19348/stat : 19348 (ttsth-5-0) R 19343 19345 19127 0 -1 4194368 8311 0 0 0 3037 5 0 0 25 0 3 0 128094849 196235264 42178 1992294400 134512640 135237372 4294956192 18446744073709551615 134680499 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 81.5
Current children cumulated vsize (KiB) 191636

[startup+102.306 s]
/proc/loadavg: 1.89 1.82 1.43 3/67 19348
/proc/meminfo: memFree=787784/2055920 swapFree=4181900/4192956
[pid=19345] ppid=19343 vsize=309096 CPUtime=183.68
/proc/19345/stat : 19345 (ttsth-5-0) S 19343 19345 19127 0 -1 4194304 71508 0 0 0 18322 46 0 0 25 0 3 0 128092794 316514304 70357 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/19345/statm: 77274 70357 98 176 0 77096 0
[pid=19345/tid=19347] ppid=19343 vsize=309096 CPUtime=81.71
/proc/19345/task/19347/stat : 19347 (ttsth-5-0) R 19343 19345 19127 0 -1 4194368 23005 0 0 0 8152 19 0 0 25 0 3 0 128094849 316514304 70357 1992294400 134512640 135237372 4294956192 18446744073709551615 134519965 0 0 4096 0 0 0 0 -1 1 0 0
[pid=19345/tid=19348] ppid=19343 vsize=309096 CPUtime=81.4
/proc/19345/task/19348/stat : 19348 (ttsth-5-0) R 19343 19345 19127 0 -1 4194368 22340 0 0 0 8125 15 0 0 25 0 3 0 128094849 316514304 70357 1992294400 134512640 135237372 4294956192 18446744073709551615 134519936 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 183.68
Current children cumulated vsize (KiB) 309096

[startup+162.301 s]
/proc/loadavg: 1.96 1.85 1.47 3/67 19348
/proc/meminfo: memFree=670088/2055920 swapFree=4181900/4192956
[pid=19345] ppid=19343 vsize=433404 CPUtime=303.4
/proc/19345/stat : 19345 (ttsth-5-0) S 19343 19345 19127 0 -1 4194304 101365 0 0 0 30272 68 0 0 25 0 3 0 128092794 443805696 100214 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/19345/statm: 108351 100214 98 176 0 108173 0
[pid=19345/tid=19347] ppid=19343 vsize=433404 CPUtime=141.68
/proc/19345/task/19347/stat : 19347 (ttsth-5-0) R 19343 19345 19127 0 -1 4194368 34814 0 0 0 14140 28 0 0 25 0 3 0 128094849 443805696 100214 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 1 0 0
[pid=19345/tid=19348] ppid=19343 vsize=433404 CPUtime=141.17
/proc/19345/task/19348/stat : 19348 (ttsth-5-0) R 19343 19345 19127 0 -1 4194368 40388 0 0 0 14088 29 0 0 25 0 3 0 128094849 443805696 100214 1992294400 134512640 135237372 4294956192 18446744073709551615 134728996 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 303.4
Current children cumulated vsize (KiB) 433404

[startup+222.301 s]
/proc/loadavg: 1.98 1.87 1.50 3/67 19348
/proc/meminfo: memFree=568520/2055920 swapFree=4181900/4192956
[pid=19345] ppid=19343 vsize=539168 CPUtime=423.14
/proc/19345/stat : 19345 (ttsth-5-0) S 19343 19345 19127 0 -1 4194304 126184 0 0 0 42226 88 0 0 25 0 3 0 128092794 552108032 125033 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/19345/statm: 134792 125033 98 176 0 134614 0
[pid=19345/tid=19347] ppid=19343 vsize=539168 CPUtime=201.66
/proc/19345/task/19347/stat : 19347 (ttsth-5-0) R 19343 19345 19127 0 -1 4194368 42737 0 0 0 20129 37 0 0 25 0 3 0 128094849 552108032 125033 1992294400 134512640 135237372 4294956192 18446744073709551615 134562341 0 0 4096 0 0 0 0 -1 1 0 0
[pid=19345/tid=19348] ppid=19343 vsize=539168 CPUtime=200.92
/proc/19345/task/19348/stat : 19348 (ttsth-5-0) R 19343 19345 19127 0 -1 4194368 57284 0 0 0 20052 40 0 0 25 0 3 0 128094849 552108032 125033 1992294400 134512640 135237372 4294956192 18446744073709551615 134592214 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 423.14
Current children cumulated vsize (KiB) 539168

[startup+282.301 s]
/proc/loadavg: 1.99 1.89 1.53 3/67 19348
/proc/meminfo: memFree=475208/2055920 swapFree=4181900/4192956
[pid=19345] ppid=19343 vsize=636968 CPUtime=542.87
/proc/19345/stat : 19345 (ttsth-5-0) S 19343 19345 19127 0 -1 4194304 149782 0 0 0 54180 107 0 0 25 0 3 0 128092794 652255232 148631 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/19345/statm: 159242 148631 98 176 0 159064 0
[pid=19345/tid=19347] ppid=19343 vsize=636968 CPUtime=261.64
/proc/19345/task/19347/stat : 19347 (ttsth-5-0) R 19343 19345 19127 0 -1 4194368 50110 0 0 0 26119 45 0 0 25 0 3 0 128094849 652255232 148631 1992294400 134512640 135237372 4294956192 18446744073709551615 134562380 0 0 4096 0 0 0 0 -1 1 0 0
[pid=19345/tid=19348] ppid=19343 vsize=636968 CPUtime=260.67
/proc/19345/task/19348/stat : 19348 (ttsth-5-0) R 19343 19345 19127 0 -1 4194368 73509 0 0 0 26016 51 0 0 25 0 3 0 128094849 652255232 148631 1992294400 134512640 135237372 4294956192 18446744073709551615 134749351 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 542.87
Current children cumulated vsize (KiB) 636968

[startup+342.301 s]
/proc/loadavg: 1.99 1.91 1.55 3/67 19348
/proc/meminfo: memFree=361032/2055920 swapFree=4181900/4192956
[pid=19345] ppid=19343 vsize=754612 CPUtime=662.61
/proc/19345/stat : 19345 (ttsth-5-0) S 19343 19345 19127 0 -1 4194304 178012 0 0 0 66131 130 0 0 25 0 3 0 128092794 772722688 176861 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/19345/statm: 188653 176861 98 176 0 188475 0
[pid=19345/tid=19347] ppid=19343 vsize=754612 CPUtime=321.62
/proc/19345/task/19347/stat : 19347 (ttsth-5-0) R 19343 19345 19127 0 -1 4194368 59412 0 0 0 32108 54 0 0 25 0 3 0 128094849 772722688 176861 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 1 0 0
[pid=19345/tid=19348] ppid=19343 vsize=754612 CPUtime=320.43
/proc/19345/task/19348/stat : 19348 (ttsth-5-0) R 19343 19345 19127 0 -1 4194368 92437 0 0 0 31979 64 0 0 25 0 3 0 128094849 772722688 176861 1992294400 134512640 135237372 4294956192 18446744073709551615 134749311 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 662.61
Current children cumulated vsize (KiB) 754612

[startup+402.302 s]
/proc/loadavg: 1.99 1.92 1.58 3/67 19348
/proc/meminfo: memFree=276040/2055920 swapFree=4181900/4192956
[pid=19345] ppid=19343 vsize=843024 CPUtime=782.34
/proc/19345/stat : 19345 (ttsth-5-0) S 19343 19345 19127 0 -1 4194304 199510 0 0 0 78088 146 0 0 25 0 3 0 128092794 863256576 198359 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/19345/statm: 210756 198359 98 176 0 210578 0
[pid=19345/tid=19347] ppid=19343 vsize=843024 CPUtime=381.6
/proc/19345/task/19347/stat : 19347 (ttsth-5-0) R 19343 19345 19127 0 -1 4194368 66639 0 0 0 38099 61 0 0 25 0 3 0 128094849 863256576 198359 1992294400 134512640 135237372 4294956192 18446744073709551615 134549950 0 0 4096 0 0 0 0 -1 1 0 0
[pid=19345/tid=19348] ppid=19343 vsize=843024 CPUtime=380.2
/proc/19345/task/19348/stat : 19348 (ttsth-5-0) R 19343 19345 19127 0 -1 4194368 106708 0 0 0 37945 75 0 0 19 0 3 0 128094849 863256576 198359 1992294400 134512640 135237372 4294956192 18446744073709551615 134587840 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 782.34
Current children cumulated vsize (KiB) 843024

[startup+462.302 s]
/proc/loadavg: 1.99 1.93 1.60 3/67 19348
/proc/meminfo: memFree=192840/2055920 swapFree=4181900/4192956
[pid=19345] ppid=19343 vsize=926908 CPUtime=902.07
/proc/19345/stat : 19345 (ttsth-5-0) S 19343 19345 19127 0 -1 4194304 219921 0 0 0 90048 159 0 0 25 0 3 0 128092794 949153792 218770 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/19345/statm: 231727 218770 98 176 0 231549 0
[pid=19345/tid=19347] ppid=19343 vsize=926908 CPUtime=441.58
/proc/19345/task/19347/stat : 19347 (ttsth-5-0) R 19343 19345 19127 0 -1 4194368 72761 0 0 0 44092 66 0 0 25 0 3 0 128094849 949153792 218770 1992294400 134512640 135237372 4294956192 18446744073709551615 134680290 0 0 4096 0 0 0 0 -1 1 0 0
[pid=19345/tid=19348] ppid=19343 vsize=926908 CPUtime=439.94
/proc/19345/task/19348/stat : 19348 (ttsth-5-0) R 19343 19345 19127 0 -1 4194368 120997 0 0 0 43912 82 0 0 25 0 3 0 128094849 949153792 218770 1992294400 134512640 135237372 4294956192 18446744073709551615 134590186 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 902.07
Current children cumulated vsize (KiB) 926908

[startup+522.301 s]
/proc/loadavg: 1.99 1.94 1.62 3/67 19348
/proc/meminfo: memFree=107336/2055920 swapFree=4181900/4192956
[pid=19345] ppid=19343 vsize=1017584 CPUtime=1021.8
/proc/19345/stat : 19345 (ttsth-5-0) S 19343 19345 19127 0 -1 4194304 241708 0 0 0 102008 172 0 0 25 0 3 0 128092794 1042006016 240557 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/19345/statm: 254396 240557 98 176 0 254218 0
[pid=19345/tid=19347] ppid=19343 vsize=1017584 CPUtime=501.55
/proc/19345/task/19347/stat : 19347 (ttsth-5-0) R 19343 19345 19127 0 -1 4194368 78922 0 0 0 50085 70 0 0 25 0 3 0 128094849 1042006016 240557 1992294400 134512640 135237372 4294956192 18446744073709551615 134546034 0 0 4096 0 0 0 0 -1 1 0 0
[pid=19345/tid=19348] ppid=19343 vsize=1017584 CPUtime=499.7
/proc/19345/task/19348/stat : 19348 (ttsth-5-0) R 19343 19345 19127 0 -1 4194368 136623 0 0 0 49879 91 0 0 25 0 3 0 128094849 1042006016 240557 1992294400 134512640 135237372 4294956192 18446744073709551615 134590241 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1021.8
Current children cumulated vsize (KiB) 1017584

[startup+582.301 s]
/proc/loadavg: 1.99 1.95 1.64 3/67 19348
/proc/meminfo: memFree=15496/2055920 swapFree=4181900/4192956
[pid=19345] ppid=19343 vsize=1109192 CPUtime=1141.54
/proc/19345/stat : 19345 (ttsth-5-0) S 19343 19345 19127 0 -1 4194304 264237 0 0 0 113963 191 0 0 25 0 3 0 128092794 1135812608 263086 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/19345/statm: 277298 263086 98 176 0 277120 0
[pid=19345/tid=19347] ppid=19343 vsize=1109192 CPUtime=561.53
/proc/19345/task/19347/stat : 19347 (ttsth-5-0) R 19343 19345 19127 0 -1 4194368 84760 0 0 0 56076 77 0 0 25 0 3 0 128094849 1135812608 263086 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 1 0 0
[pid=19345/tid=19348] ppid=19343 vsize=1109192 CPUtime=559.46
/proc/19345/task/19348/stat : 19348 (ttsth-5-0) R 19343 19345 19127 0 -1 4194368 153314 0 0 0 55843 103 0 0 25 0 3 0 128094849 1135812608 263086 1992294400 134512640 135237372 4294956192 18446744073709551615 134562351 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1141.54
Current children cumulated vsize (KiB) 1109192



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+611.702 s]
/proc/loadavg: 1.99 1.95 1.65 2/65 19348
/proc/meminfo: memFree=948296/2055920 swapFree=4181900/4192956
[pid=19345] ppid=19343 vsize=0 CPUtime=1200.05
/proc/19345/stat : 19345 (ttsth-5-0) R 19343 19345 19127 0 -1 4195332 276188 0 0 0 119790 215 0 0 17 0 1 0 128092794 0 0 1992294400 0 0 0 0 0 0 0 4096 0 0 0 0 17 1 0 0
/proc/19345/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 1200.05
Current children cumulated vsize (KiB) 0

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+611.702 s]
/proc/loadavg: 1.99 1.95 1.65 2/65 19348
/proc/meminfo: memFree=948296/2055920 swapFree=4181900/4192956
[pid=19345] ppid=19343 vsize=0 CPUtime=1200.05
/proc/19345/stat : 19345 (ttsth-5-0) R 19343 19345 19127 0 -1 4195332 276188 0 0 0 119790 215 0 0 17 0 1 0 128092794 0 0 1992294400 0 0 0 0 0 0 0 4096 0 0 0 0 17 1 0 0
/proc/19345/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 1200.05
Current children cumulated vsize (KiB) 0

Child status: 0
Real time (s): 611.73
CPU time (s): 1200.08
CPU user time (s): 1197.91
CPU system time (s): 2.17467
CPU usage (%): 196.178
Max. virtual memory (cumulated for all children) (KiB): 1157560

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1197.91
system time used= 2.17467
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 276188
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 127
involuntary context switches= 9118

runsolver used 0.543917 second user time and 1.68174 second system time

The end

Launcher Data 

Begin job on node44 at 2009-04-29 12:24:08
IDJOB=1563124
IDBENCH=70947
IDSOLVER=549
FILE ID=node44/1563124-1241000648
PBS_JOBID= 9204825
Free space on /tmp= 66272 MiB

SOLVER NAME= ttsth-5-0 2009-03-19
BENCH NAME= SAT09/APPLICATIONS/bioinfo/q_query_3_l48_lambda.cnf
COMMAND LINE= HOME/ttsth-5-0 -num-threads MAXNBTHREAD BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-1563124-1241000648/watcher-1563124-1241000648 -o /tmp/evaluation-result-1563124-1241000648/solver-1563124-1241000648 -C 1200 -W 1800 -M 1800  HOME/ttsth-5-0 -num-threads 2 HOME/instance-1563124-1241000648.cnf

TIME LIMIT= 1200 seconds
MEMORY LIMIT= 1800 MiB
MAX NB THREAD= 2

MD5SUM BENCH= e7c28f6a200a1c1912fbaacfb3572515
RANDOM SEED=2008814221

node44.alineos.net Linux 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.267
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5931.00
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.267
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1069952 kB
Buffers:         50424 kB
Cached:         838888 kB
SwapCached:       4956 kB
Active:          82624 kB
Inactive:       815168 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1069952 kB
SwapTotal:     4192956 kB
SwapFree:      4181900 kB
Dirty:            4036 kB
Writeback:           0 kB
Mapped:          14584 kB
Slab:            74200 kB
Committed_AS:   577520 kB
PageTables:       1380 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66272 MiB
End job on node44 at 2009-04-29 12:34:22