Trace number 1722986

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ttsth-5-0 2009-03-19? (TO) 1200.13 602.741

General information on the benchmark

NameAPPLICATIONS/satComp09_BioInstances/
rbcl_xits_13_UNKNOWN.cnf
MD5SUM604e1311b2fcb3c933399ca7195c63f1
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables2058
Number of clauses133055
Sum of the clauses size396210
Maximum clause length14
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 23208
Number of clauses of size 3129824
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 523

Solver Data 

0.19/0.26	c Command: HOME/ttsth-5-0 -num-threads 2 HOME/instance-1722986-1240681845.cnf 
0.19/0.26	c Using SATTIMEOUT of 1200
0.19/0.26	c Using SATRAM of 1800
0.19/0.26	c Size of subset node = 16
0.19/0.26	c Variables = 2058
0.19/0.26	c Clauses = 133055
0.19/0.26	c Literals = 396210
0.19/0.26	c Reduced size:
0.19/0.26	c Variables = 2058
0.19/0.26	c Clauses = 133055
0.19/0.26	c Literals = 396210
0.19/0.26	c a2
0.69/0.73	c a1
1.39/1.49	c Independent sub-problems = 1
1.39/1.49	c Sub-problem with 2058 variables and 133055 clauses
1.39/1.49	c using permutation method 4
1.39/1.49	c count = 1
1.39/1.49	c Ordering finished 1.410 seconds
1.39/1.49	c mapped 1.480 seconds
1.39/1.49	c permuted 1.480 seconds
1.39/1.49	c about to sort
1.49/1.55	c sorted
2.59/2.60	c clauses now 133055
2.59/2.60	c init finished 1.580 seconds
2.59/2.60	c tree built 2.590 seconds
2.59/2.60	c 
2.59/2.60	c PA progress                      | CPU progress Partial assignments | improvements      CPU time        PA/sec        nodes
2.59/2.60	c ---------------------------------|----------------------------------|------------------------------------------------------
2.59/2.60	c ................................ | ..........                       |                        2.6           0.0             
2.59/2.60	c ................................ | ..........                     1 |                        2.6           0.4             
2.59/2.60	c ................................ | ..........                     2 |                        2.6           0.8             
2.59/2.60	c ................................ | ..........                     3 |                        2.6           1.2             
2.59/2.60	c ................................ | ..........                     4 |                        2.6           1.5             
2.59/2.60	c ................................ | ..........                     5 |                        2.6           1.9             
2.59/2.62	c ................................ | ..........                  1000 |                        2.6         380.2          451
23.93/13.35	c ................................ | ..........                309000 | 13193                 24.0       12853.6      1544949
48.08/25.41	c ................................ | ..........                582000 | 30340                 48.1       12099.8      2864603
72.03/37.44	c ................................ | ..........                811000 | 46514                 72.1       11245.1      4343661
95.99/49.45	c ................................ | ..........               1013000 | 66943                 96.1       10542.2      5711375
119.93/61.46	c ................................ | *.........               1223000 | 87274                120.1       10185.7      7086565
143.87/73.47	c ................................ | *.........               1395000 | 98571                144.0        9685.5      8306117
168.02/85.52	c ................................ | *.........               1558000 | 111092               168.1        9268.3      9391945
191.96/97.57	c ................................ | *.........               1696000 | 120664               192.1        8827.4     10374800
215.91/109.56	c ................................ | *.........               1806000 | 126042               216.1        8358.8     11242934
239.85/121.58	c ................................ | **........               1914000 | 132001               240.1        7973.3     12114814
264.00/133.60	c ................................ | **........               2020000 | 140107               264.1        7650.1     12917991
287.95/145.66	c ................................ | **........               2117000 | 147137               288.1        7347.4     13667991
311.90/157.63	c ................................ | **........               2206000 | 154112               312.0        7070.5     14355114
335.84/169.68	c ................................ | **........               2288000 | 160670               336.1        6808.1     15077402
360.19/181.82	c ................................ | ***.......               2371000 | 168186               360.3        6580.6     15759459
383.93/193.70	c ................................ | ***.......               2466000 | 177259               384.0        6421.7     16438305
407.89/205.77	c ................................ | ***.......               2565000 | 187747               408.1        6285.2     17216799
431.84/217.78	c ................................ | ***.......               2645000 | 194599               432.1        6121.8     17797770
455.99/229.88	c ................................ | ***.......               2720000 | 200971               456.2        5962.2     18386055
479.93/241.81	c ................................ | ****......               2795000 | 208505               480.0        5822.7     18963534
503.87/253.84	c ................................ | ****......               2868000 | 216687               504.0        5690.1     19587517
527.82/265.85	c ................................ | ****......               2972000 | 225870               528.0        5628.8     20282754
551.97/277.91	c ................................ | ****......               3101000 | 236293               552.1        5616.9     20986454
575.91/289.95	c ................................ | ****......               3216000 | 247862               576.1        5582.3     21564942
600.26/302.14	c ................................ | *****.....               3316000 | 260183               600.4        5522.6     22299906
624.00/314.00	c ................................ | *****.....               3384000 | 266472               624.1        5422.2     22908888
647.95/326.05	c ................................ | *****.....               3445000 | 272763               648.2        5315.0     23523528
671.90/338.00	c ................................ | *****.....               3519000 | 282335               672.0        5236.5     24093056
695.84/350.03	c ................................ | *****.....               3565000 | 287178               696.0        5122.0     24608996
720.79/362.54	c ................................ | ******....               3612000 | 291158               721.0        5009.8     25117285
744.14/374.22	c ................................ | ******....               3658000 | 294430               744.3        4914.7     25543871
767.89/386.19	c ................................ | ******....               3688000 | 296395               768.2        4800.9     25914052
791.84/398.20	c ................................ | ******....               3720000 | 298238               792.1        4696.1     26263523
815.78/410.19	c ................................ | ******....               3758000 | 300659               816.1        4604.9     26607593
839.73/422.18	c ................................ | *******...               3800000 | 303731               840.0        4523.7     27005669
864.08/434.33	c ................................ | *******...               3840000 | 307630               864.3        4443.1     27410946
888.02/446.30	c ................................ | *******...               3883000 | 311620               888.2        4372.0     27797463
911.96/458.35	c ................................ | *******...               3926000 | 315758               912.2        4303.8     28160520
935.92/470.33	c ................................ | *******...               4018000 | 323551               936.1        4292.1     28645568
959.86/482.33	c ................................ | ********..               4118000 | 334428               960.1        4289.2     29103782
984.01/494.41	c ................................ | ********..               4222000 | 346446               984.2        4289.9     29589794
1007.95/506.42	c ................................ | ********..               4321000 | 355999              1008.2        4286.0     30149398
1031.91/518.43	c ................................ | ********..               4423000 | 368734              1032.1        4285.3     30673354
1055.85/530.41	c ................................ | ********..               4478000 | 374420              1056.0        4240.4     31117195
1080.19/542.62	c ................................ | *********.               4522000 | 378756              1080.4        4185.5     31625416
1103.75/554.49	c ................................ | *********.               4570000 | 383241              1104.1        4139.2     32027999
1128.28/566.73	c ................................ | *********.               4630000 | 388709              1128.5        4102.8     32441950
1151.64/578.50	c ................................ | *********.               4693000 | 396144              1152.0        4073.7     32819943
1175.78/590.53	c ................................ | *********.               4767000 | 405088              1176.0        4053.5     33315247
1199.93/602.65	c CPU limit (1200) reached
1199.93/602.65	c Time = 1200.21 seconds
1199.93/602.65	s UNKNOWN

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver version 3.2.9 (svn:492) (c) roussel@cril.univ-artois.fr

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-1722986-1240681845/watcher-1722986-1240681845 -o /tmp/evaluation-result-1722986-1240681845/solver-1722986-1240681845 -C 1200 -W 1800 -M 1800 --output-limit 1,15 HOME/ttsth-5-0 -num-threads 2 HOME/instance-1722986-1240681845.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1200 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1230 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.99 1.85 1.53 3/64 19026
/proc/meminfo: memFree=1201072/2055920 swapFree=4124000/4192956
[pid=19026] ppid=19024 vsize=1064 CPUtime=0
/proc/19026/stat : 19026 (ttsth-5-0) R 19024 19026 18772 0 -1 4194304 145 0 0 0 0 0 0 0 18 0 1 0 96218598 1089536 129 1992294400 134512640 135237372 4294956192 18446744073709551615 134536395 0 0 4096 0 0 0 0 17 1 0 0
/proc/19026/statm: 266 129 78 176 0 88 0

[startup+0.0856239 s]
/proc/loadavg: 1.99 1.85 1.53 3/64 19026
/proc/meminfo: memFree=1201072/2055920 swapFree=4124000/4192956
[pid=19026] ppid=19024 vsize=3816 CPUtime=0.07
/proc/19026/stat : 19026 (ttsth-5-0) R 19024 19026 18772 0 -1 4194304 839 0 0 0 7 0 0 0 18 0 1 0 96218598 3907584 823 1992294400 134512640 135237372 4294956192 18446744073709551615 134732614 0 0 4096 0 0 0 0 17 1 0 0
/proc/19026/statm: 954 823 78 176 0 776 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 3816

[startup+0.101626 s]
/proc/loadavg: 1.99 1.85 1.53 3/64 19026
/proc/meminfo: memFree=1201072/2055920 swapFree=4124000/4192956
[pid=19026] ppid=19024 vsize=4344 CPUtime=0.09
/proc/19026/stat : 19026 (ttsth-5-0) R 19024 19026 18772 0 -1 4194304 982 0 0 0 8 1 0 0 18 0 1 0 96218598 4448256 966 1992294400 134512640 135237372 4294956192 18446744073709551615 134732614 0 0 4096 0 0 0 0 17 1 0 0
/proc/19026/statm: 1086 966 78 176 0 908 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 4344

[startup+0.301662 s]
/proc/loadavg: 1.99 1.85 1.53 3/64 19026
/proc/meminfo: memFree=1201072/2055920 swapFree=4124000/4192956
[pid=19026] ppid=19024 vsize=15992 CPUtime=0.29
/proc/19026/stat : 19026 (ttsth-5-0) R 19024 19026 18772 0 -1 4194304 3784 0 0 0 28 1 0 0 19 0 1 0 96218598 16375808 3768 1992294400 134512640 135237372 4294956192 18446744073709551615 134749343 0 0 4096 0 0 0 0 17 1 0 0
/proc/19026/statm: 3998 3768 79 176 0 3820 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 15992

[startup+0.701736 s]
/proc/loadavg: 1.99 1.85 1.53 3/64 19026
/proc/meminfo: memFree=1201072/2055920 swapFree=4124000/4192956
[pid=19026] ppid=19024 vsize=18344 CPUtime=0.69
/proc/19026/stat : 19026 (ttsth-5-0) R 19024 19026 18772 0 -1 4194304 4373 0 0 0 67 2 0 0 22 0 1 0 96218598 18784256 4356 1992294400 134512640 135237372 4294956192 18446744073709551615 134519996 0 0 4096 0 0 0 0 17 1 0 0
/proc/19026/statm: 4586 4356 79 176 0 4408 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 18344

[startup+1.50188 s]
/proc/loadavg: 1.91 1.84 1.53 2/65 19027
/proc/meminfo: memFree=1183720/2055920 swapFree=4124000/4192956
[pid=19026] ppid=19024 vsize=19904 CPUtime=1.49
/proc/19026/stat : 19026 (ttsth-5-0) R 19024 19026 18772 0 -1 4194304 5258 0 0 0 147 2 0 0 25 0 1 0 96218598 20381696 4851 1992294400 134512640 135237372 4294956192 18446744073709551615 134680212 0 0 4096 0 0 0 0 17 1 0 0
/proc/19026/statm: 4976 4851 86 176 0 4798 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 19904

[startup+3.10119 s]
/proc/loadavg: 1.91 1.84 1.53 2/65 19027
/proc/meminfo: memFree=1178344/2055920 swapFree=4124000/4192956
[pid=19026] ppid=19024 vsize=52416 CPUtime=3.58
/proc/19026/stat : 19026 (ttsth-5-0) S 19024 19026 18772 0 -1 4194304 8177 0 0 0 353 5 0 0 25 0 3 0 96218598 53673984 7640 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/19026/statm: 13104 7640 98 176 0 12926 0
Current children cumulated CPU time (s) 3.58
Current children cumulated vsize (KiB) 52416

[startup+6.30177 s]
/proc/loadavg: 1.92 1.84 1.53 3/67 19029
/proc/meminfo: memFree=1164440/2055920 swapFree=4124000/4192956
[pid=19026] ppid=19024 vsize=61028 CPUtime=9.96
/proc/19026/stat : 19026 (ttsth-5-0) S 19024 19026 18772 0 -1 4194304 10322 0 0 0 990 6 0 0 25 0 3 0 96218598 62492672 9785 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/19026/statm: 15257 9785 98 176 0 15079 0
[pid=19026/tid=19028] ppid=19024 vsize=61028 CPUtime=3.68
/proc/19026/task/19028/stat : 19028 (ttsth-5-0) R 19024 19026 18772 0 -1 4194368 982 0 0 0 367 1 0 0 25 0 3 0 96218858 62492672 9785 1992294400 134512640 135237372 4294956192 18446744073709551615 134680499 0 0 4096 0 0 0 0 -1 1 0 0
[pid=19026/tid=19029] ppid=19024 vsize=61028 CPUtime=3.67
/proc/19026/task/19029/stat : 19029 (ttsth-5-0) R 19024 19026 18772 0 -1 4194368 1603 0 0 0 367 0 0 0 25 0 3 0 96218858 62492672 9785 1992294400 134512640 135237372 4294956192 18446744073709551615 134519962 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 9.96
Current children cumulated vsize (KiB) 61028

[startup+12.7019 s]
/proc/loadavg: 1.93 1.84 1.54 3/67 19029
/proc/meminfo: memFree=1149080/2055920 swapFree=4124000/4192956
[pid=19026] ppid=19024 vsize=75108 CPUtime=22.74
/proc/19026/stat : 19026 (ttsth-5-0) S 19024 19026 18772 0 -1 4194304 13841 0 0 0 2265 9 0 0 25 0 3 0 96218598 76910592 13304 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/19026/statm: 18777 13304 98 176 0 18599 0
[pid=19026/tid=19028] ppid=19024 vsize=75108 CPUtime=10.08
/proc/19026/task/19028/stat : 19028 (ttsth-5-0) R 19024 19026 18772 0 -1 4194368 2418 0 0 0 1006 2 0 0 25 0 3 0 96218858 76910592 13304 1992294400 134512640 135237372 4294956192 18446744073709551615 134562344 0 0 4096 0 0 0 0 -1 1 0 0
[pid=19026/tid=19029] ppid=19024 vsize=75108 CPUtime=10.04
/proc/19026/task/19029/stat : 19029 (ttsth-5-0) R 19024 19026 18772 0 -1 4194368 3686 0 0 0 1003 1 0 0 25 0 3 0 96218858 76910592 13304 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 22.74
Current children cumulated vsize (KiB) 75108

[startup+25.5013 s]
/proc/loadavg: 1.94 1.85 1.54 3/67 19029
/proc/meminfo: memFree=1125912/2055920 swapFree=4124000/4192956
[pid=19026] ppid=19024 vsize=97800 CPUtime=48.28
/proc/19026/stat : 19026 (ttsth-5-0) S 19024 19026 18772 0 -1 4194304 19496 0 0 0 4816 12 0 0 25 0 3 0 96218598 100147200 18959 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/19026/statm: 24450 18959 98 176 0 24272 0
[pid=19026/tid=19028] ppid=19024 vsize=97800 CPUtime=22.88
/proc/19026/task/19028/stat : 19028 (ttsth-5-0) R 19024 19026 18772 0 -1 4194368 4986 0 0 0 2284 4 0 0 25 0 3 0 96218858 100147200 18959 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 1 0 0
[pid=19026/tid=19029] ppid=19024 vsize=97800 CPUtime=22.79
/proc/19026/task/19029/stat : 19029 (ttsth-5-0) R 19024 19026 18772 0 -1 4194368 6773 0 0 0 2276 3 0 0 25 0 3 0 96218858 100147200 18959 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 48.28
Current children cumulated vsize (KiB) 97800

[startup+51.102 s]
/proc/loadavg: 1.96 1.86 1.55 3/67 19029
/proc/meminfo: memFree=1077976/2055920 swapFree=4124000/4192956
[pid=19026] ppid=19024 vsize=145960 CPUtime=99.37
/proc/19026/stat : 19026 (ttsth-5-0) S 19024 19026 18772 0 -1 4194304 31555 0 0 0 9915 22 0 0 25 0 3 0 96218598 149463040 31018 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/19026/statm: 36490 31018 98 176 0 36312 0
[pid=19026/tid=19028] ppid=19024 vsize=145960 CPUtime=48.46
/proc/19026/task/19028/stat : 19028 (ttsth-5-0) R 19024 19026 18772 0 -1 4194368 8264 0 0 0 4839 7 0 0 25 0 3 0 96218858 149463040 31018 1992294400 134512640 135237372 4294956192 18446744073709551615 134562336 0 0 4096 0 0 0 0 -1 1 0 0
[pid=19026/tid=19029] ppid=19024 vsize=145960 CPUtime=48.29
/proc/19026/task/19029/stat : 19029 (ttsth-5-0) R 19024 19026 18772 0 -1 4194368 15554 0 0 0 4820 9 0 0 25 0 3 0 96218858 149463040 31018 1992294400 134512640 135237372 4294956192 18446744073709551615 134561428 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 99.37
Current children cumulated vsize (KiB) 145960

[startup+102.305 s]
/proc/loadavg: 1.98 1.88 1.57 3/67 19029
/proc/meminfo: memFree=998808/2055920 swapFree=4124000/4192956
[pid=19026] ppid=19024 vsize=223984 CPUtime=201.55
/proc/19026/stat : 19026 (ttsth-5-0) S 19024 19026 18772 0 -1 4194304 51083 0 0 0 20117 38 0 0 25 0 3 0 96218598 229359616 50546 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/19026/statm: 55996 50546 98 176 0 55818 0
[pid=19026/tid=19028] ppid=19024 vsize=223984 CPUtime=99.65
/proc/19026/task/19028/stat : 19028 (ttsth-5-0) R 19024 19026 18772 0 -1 4194368 15124 0 0 0 9951 14 0 0 25 0 3 0 96218858 229359616 50546 1992294400 134512640 135237372 4294956192 18446744073709551615 134562380 0 0 4096 0 0 0 0 -1 1 0 0
[pid=19026/tid=19029] ppid=19024 vsize=223984 CPUtime=99.29
/proc/19026/task/19029/stat : 19029 (ttsth-5-0) R 19024 19026 18772 0 -1 4194368 28222 0 0 0 9910 19 0 0 25 0 3 0 96218858 229359616 50546 1992294400 134512640 135237372 4294956192 18446744073709551615 134562405 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 201.55
Current children cumulated vsize (KiB) 223984

[startup+162.301 s]
/proc/loadavg: 1.99 1.90 1.60 3/67 19029
/proc/meminfo: memFree=936728/2055920 swapFree=4124000/4192956
[pid=19026] ppid=19024 vsize=286224 CPUtime=321.27
/proc/19026/stat : 19026 (ttsth-5-0) S 19024 19026 18772 0 -1 4194304 66654 0 0 0 32075 52 0 0 25 0 3 0 96218598 293093376 66117 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/19026/statm: 71556 66117 98 176 0 71378 0
[pid=19026/tid=19028] ppid=19024 vsize=286224 CPUtime=159.63
/proc/19026/task/19028/stat : 19028 (ttsth-5-0) R 19024 19026 18772 0 -1 4194368 19511 0 0 0 15943 20 0 0 25 0 3 0 96218858 293093376 66117 1992294400 134512640 135237372 4294956192 18446744073709551615 134749351 0 0 4096 0 0 0 0 -1 1 0 0
[pid=19026/tid=19029] ppid=19024 vsize=286224 CPUtime=159.04
/proc/19026/task/19029/stat : 19029 (ttsth-5-0) R 19024 19026 18772 0 -1 4194368 39406 0 0 0 15877 27 0 0 25 0 3 0 96218858 293093376 66117 1992294400 134512640 135237372 4294956192 18446744073709551615 134749351 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 321.27
Current children cumulated vsize (KiB) 286224

[startup+222.301 s]
/proc/loadavg: 1.99 1.91 1.62 3/67 19029
/proc/meminfo: memFree=881752/2055920 swapFree=4124000/4192956
[pid=19026] ppid=19024 vsize=340596 CPUtime=441
/proc/19026/stat : 19026 (ttsth-5-0) S 19024 19026 18772 0 -1 4194304 80236 0 0 0 44039 61 0 0 25 0 3 0 96218598 348770304 79699 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/19026/statm: 85149 79699 98 176 0 84971 0
[pid=19026/tid=19028] ppid=19024 vsize=340596 CPUtime=219.61
/proc/19026/task/19028/stat : 19028 (ttsth-5-0) R 19024 19026 18772 0 -1 4194368 23640 0 0 0 21936 25 0 0 25 0 3 0 96218858 348770304 79699 1992294400 134512640 135237372 4294956192 18446744073709551615 134562344 0 0 4096 0 0 0 0 -1 1 0 0
[pid=19026/tid=19029] ppid=19024 vsize=340596 CPUtime=218.79
/proc/19026/task/19029/stat : 19029 (ttsth-5-0) R 19024 19026 18772 0 -1 4194368 48859 0 0 0 21847 32 0 0 25 0 3 0 96218858 348770304 79699 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 441
Current children cumulated vsize (KiB) 340596

[startup+282.301 s]
/proc/loadavg: 2.06 1.94 1.65 3/67 19029
/proc/meminfo: memFree=831128/2055920 swapFree=4124000/4192956
[pid=19026] ppid=19024 vsize=391956 CPUtime=560.74
/proc/19026/stat : 19026 (ttsth-5-0) S 19024 19026 18772 0 -1 4194304 93027 0 0 0 56004 70 0 0 25 0 3 0 96218598 401362944 92490 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/19026/statm: 97989 92490 98 176 0 97811 0
[pid=19026/tid=19028] ppid=19024 vsize=391956 CPUtime=279.58
/proc/19026/task/19028/stat : 19028 (ttsth-5-0) R 19024 19026 18772 0 -1 4194368 28546 0 0 0 27930 28 0 0 25 0 3 0 96218858 401362944 92490 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 1 0 0
[pid=19026/tid=19029] ppid=19024 vsize=391956 CPUtime=278.55
/proc/19026/task/19029/stat : 19029 (ttsth-5-0) R 19024 19026 18772 0 -1 4194368 56744 0 0 0 27818 37 0 0 25 0 3 0 96218858 401362944 92490 1992294400 134512640 135237372 4294956192 18446744073709551615 134562413 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 560.74
Current children cumulated vsize (KiB) 391956

[startup+342.302 s]
/proc/loadavg: 2.02 1.95 1.67 3/67 19029
/proc/meminfo: memFree=781912/2055920 swapFree=4124000/4192956
[pid=19026] ppid=19024 vsize=440436 CPUtime=680.48
/proc/19026/stat : 19026 (ttsth-5-0) S 19024 19026 18772 0 -1 4194304 105168 0 0 0 67969 79 0 0 25 0 3 0 96218598 451006464 104631 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/19026/statm: 110109 104631 98 176 0 109931 0
[pid=19026/tid=19028] ppid=19024 vsize=440436 CPUtime=339.56
/proc/19026/task/19028/stat : 19028 (ttsth-5-0) R 19024 19026 18772 0 -1 4194368 33514 0 0 0 33924 32 0 0 25 0 3 0 96218858 451006464 104631 1992294400 134512640 135237372 4294956192 18446744073709551615 134562344 0 0 4096 0 0 0 0 -1 1 0 0
[pid=19026/tid=19029] ppid=19024 vsize=440436 CPUtime=338.3
/proc/19026/task/19029/stat : 19029 (ttsth-5-0) R 19024 19026 18772 0 -1 4194368 63917 0 0 0 33789 41 0 0 25 0 3 0 96218858 451006464 104631 1992294400 134512640 135237372 4294956192 18446744073709551615 134562273 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 680.48
Current children cumulated vsize (KiB) 440436

[startup+402.301 s]
/proc/loadavg: 2.01 1.95 1.68 3/67 19029
/proc/meminfo: memFree=747864/2055920 swapFree=4124000/4192956
[pid=19026] ppid=19024 vsize=474676 CPUtime=800.21
/proc/19026/stat : 19026 (ttsth-5-0) S 19024 19026 18772 0 -1 4194304 113744 0 0 0 79936 85 0 0 25 0 3 0 96218598 486068224 113207 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/19026/statm: 118669 113207 98 176 0 118491 0
[pid=19026/tid=19028] ppid=19024 vsize=474676 CPUtime=399.54
/proc/19026/task/19028/stat : 19028 (ttsth-5-0) R 19024 19026 18772 0 -1 4194368 35755 0 0 0 39919 35 0 0 25 0 3 0 96218858 486068224 113207 1992294400 134512640 135237372 4294956192 18446744073709551615 134562459 0 0 4096 0 0 0 0 -1 1 0 0
[pid=19026/tid=19029] ppid=19024 vsize=474676 CPUtime=398.06
/proc/19026/task/19029/stat : 19029 (ttsth-5-0) R 19024 19026 18772 0 -1 4194368 70252 0 0 0 39761 45 0 0 25 0 3 0 96218858 486068224 113207 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 800.21
Current children cumulated vsize (KiB) 474676

[startup+462.301 s]
/proc/loadavg: 2.00 1.96 1.70 3/67 19029
/proc/meminfo: memFree=716952/2055920 swapFree=4124000/4192956
[pid=19026] ppid=19024 vsize=505396 CPUtime=919.95
/proc/19026/stat : 19026 (ttsth-5-0) S 19024 19026 18772 0 -1 4194304 121415 0 0 0 91903 92 0 0 25 0 3 0 96218598 517525504 120878 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/19026/statm: 126349 120878 98 176 0 126171 0
[pid=19026/tid=19028] ppid=19024 vsize=505396 CPUtime=459.53
/proc/19026/task/19028/stat : 19028 (ttsth-5-0) R 19024 19026 18772 0 -1 4194368 37910 0 0 0 45915 38 0 0 25 0 3 0 96218858 517525504 120878 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 1 0 0
[pid=19026/tid=19029] ppid=19024 vsize=505396 CPUtime=457.81
/proc/19026/task/19029/stat : 19029 (ttsth-5-0) R 19024 19026 18772 0 -1 4194368 75768 0 0 0 45732 49 0 0 25 0 3 0 96218858 517525504 120878 1992294400 134512640 135237372 4294956192 18446744073709551615 134562437 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 919.95
Current children cumulated vsize (KiB) 505396

[startup+522.301 s]
/proc/loadavg: 2.00 1.97 1.72 3/67 19029
/proc/meminfo: memFree=677528/2055920 swapFree=4124000/4192956
[pid=19026] ppid=19024 vsize=545236 CPUtime=1039.68
/proc/19026/stat : 19026 (ttsth-5-0) S 19024 19026 18772 0 -1 4194304 131382 0 0 0 103869 99 0 0 25 0 3 0 96218598 558321664 130845 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/19026/statm: 136309 130845 98 176 0 136131 0
[pid=19026/tid=19028] ppid=19024 vsize=545236 CPUtime=519.51
/proc/19026/task/19028/stat : 19028 (ttsth-5-0) R 19024 19026 18772 0 -1 4194368 42875 0 0 0 51909 42 0 0 25 0 3 0 96218858 558321664 130845 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 1 0 0
[pid=19026/tid=19029] ppid=19024 vsize=545236 CPUtime=517.57
/proc/19026/task/19029/stat : 19029 (ttsth-5-0) R 19024 19026 18772 0 -1 4194368 80770 0 0 0 51705 52 0 0 25 0 3 0 96218858 558321664 130845 1992294400 134512640 135237372 4294956192 18446744073709551615 134562351 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1039.68
Current children cumulated vsize (KiB) 545236

[startup+582.301 s]
/proc/loadavg: 2.00 1.97 1.73 3/67 19029
/proc/meminfo: memFree=642904/2055920 swapFree=4124000/4192956
[pid=19026] ppid=19024 vsize=579316 CPUtime=1159.42
/proc/19026/stat : 19026 (ttsth-5-0) S 19024 19026 18772 0 -1 4194304 139887 0 0 0 115835 107 0 0 25 0 3 0 96218598 593219584 139350 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/19026/statm: 144829 139350 98 176 0 144651 0
[pid=19026/tid=19028] ppid=19024 vsize=579316 CPUtime=579.48
/proc/19026/task/19028/stat : 19028 (ttsth-5-0) R 19024 19026 18772 0 -1 4194368 46408 0 0 0 57902 46 0 0 25 0 3 0 96218858 593219584 139350 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 1 0 0
[pid=19026/tid=19029] ppid=19024 vsize=579316 CPUtime=577.33
/proc/19026/task/19029/stat : 19029 (ttsth-5-0) R 19024 19026 18772 0 -1 4194368 85742 0 0 0 57677 56 0 0 25 0 3 0 96218858 593219584 139350 1992294400 134512640 135237372 4294956192 18446744073709551615 134562380 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1159.42
Current children cumulated vsize (KiB) 579316



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+602.702 s]
/proc/loadavg: 2.00 1.97 1.74 2/65 19029
/proc/meminfo: memFree=984344/2055920 swapFree=4124000/4192956
[pid=19026] ppid=19024 vsize=0 CPUtime=1200.09
/proc/19026/stat : 19026 (ttsth-5-0) R 19024 19026 18772 0 -1 4195332 143347 0 0 0 119893 116 0 0 17 0 1 0 96218598 0 0 1992294400 0 0 0 0 0 0 0 4096 0 0 0 0 17 1 0 0
/proc/19026/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 1200.09
Current children cumulated vsize (KiB) 0

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+602.702 s]
/proc/loadavg: 2.00 1.97 1.74 2/65 19029
/proc/meminfo: memFree=984344/2055920 swapFree=4124000/4192956
[pid=19026] ppid=19024 vsize=0 CPUtime=1200.09
/proc/19026/stat : 19026 (ttsth-5-0) R 19024 19026 18772 0 -1 4195332 143347 0 0 0 119893 116 0 0 17 0 1 0 96218598 0 0 1992294400 0 0 0 0 0 0 0 4096 0 0 0 0 17 1 0 0
/proc/19026/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 1200.09
Current children cumulated vsize (KiB) 0

Child status: 0
Real time (s): 602.741
CPU time (s): 1200.13
CPU user time (s): 1198.93
CPU system time (s): 1.19682
CPU usage (%): 199.112
Max. virtual memory (cumulated for all children) (KiB): 593076

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1198.93
system time used= 1.19682
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 143347
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 65
involuntary context switches= 9190

runsolver used 0.78788 second user time and 1.41678 second system time

The end

Launcher Data 

Begin job on node2 at 2009-04-25 19:50:45
IDJOB=1722986
IDBENCH=71100
IDSOLVER=549
FILE ID=node2/1722986-1240681845
PBS_JOBID= 9186635
Free space on /tmp= 66316 MiB

SOLVER NAME= ttsth-5-0 2009-03-19
BENCH NAME= SAT09/APPLICATIONS/satComp09_BioInstances/rbcl_xits_13_UNKNOWN.cnf
COMMAND LINE= HOME/ttsth-5-0 -num-threads MAXNBTHREAD BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-1722986-1240681845/watcher-1722986-1240681845 -o /tmp/evaluation-result-1722986-1240681845/solver-1722986-1240681845 -C 1200 -W 1800 -M 1800 --output-limit 1,15  HOME/ttsth-5-0 -num-threads 2 HOME/instance-1722986-1240681845.cnf

TIME LIMIT= 1200 seconds
MEMORY LIMIT= 1800 MiB
MAX NB THREAD= 2

MD5SUM BENCH= 604e1311b2fcb3c933399ca7195c63f1
RANDOM SEED=1119578092

node2.alineos.net Linux 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.265
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.265
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1201552 kB
Buffers:         77340 kB
Cached:         634928 kB
SwapCached:      63068 kB
Active:         318424 kB
Inactive:       459356 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1201552 kB
SwapTotal:     4192956 kB
SwapFree:      4124000 kB
Dirty:            2964 kB
Writeback:           0 kB
Mapped:          13984 kB
Slab:            62508 kB
Committed_AS:   348388 kB
PageTables:       1468 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66312 MiB
End job on node2 at 2009-04-25 20:00:50