Trace number 1730156

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ttsth-5-0 2009-03-19? (MO) 513.328 258.473

General information on the benchmark

Namecrafted/Difficult/contest05/sabharwal/
gt-ordering-unsat-gt-045.sat05-1310.reshuffled-07.cnf
MD5SUMae4e3f3661a3c7ad7c7ec30d56d611a1
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark12.913
Satisfiable
(Un)Satisfiability was proved
Number of variables1980
Number of clauses86175
Sum of the clauses size259380
Maximum clause length44
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 2990
Number of clauses of size 385140
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 545

Solver Data 

0.09/0.16	c Command: HOME/ttsth-5-0 -num-threads 2 HOME/instance-1730156-1240756668.cnf 
0.09/0.16	c Using SATTIMEOUT of 1200
0.09/0.16	c Using SATRAM of 1800
0.09/0.16	c Size of subset node = 16
0.09/0.16	c Variables = 2025
0.09/0.16	c Clauses = 86175
0.09/0.16	c Literals = 259380
0.09/0.16	c Reduced size:
0.09/0.16	c Variables = 1980
0.09/0.16	c Clauses = 86175
0.09/0.16	c Literals = 259380
0.09/0.16	c a2
0.49/0.53	c a1
1.39/1.43	c Independent sub-problems = 1
1.39/1.43	c Sub-problem with 1980 variables and 86175 clauses
1.39/1.43	c using permutation method 4
1.39/1.43	c count = 1
1.39/1.43	c Ordering finished 1.380 seconds
1.39/1.43	c mapped 1.430 seconds
1.39/1.43	c permuted 1.430 seconds
1.39/1.43	c about to sort
1.39/1.46	c sorted
2.20/2.23	c clauses now 86175
2.20/2.23	c init finished 1.490 seconds
2.20/2.23	c tree built 2.230 seconds
2.20/2.23	c 
2.20/2.23	c PA progress                      | CPU progress Partial assignments | improvements      CPU time        PA/sec        nodes
2.20/2.23	c ---------------------------------|----------------------------------|------------------------------------------------------
2.20/2.23	c ................................ | ..........                       |                        2.2           0.0             
2.20/2.23	c ................................ | ..........                     1 |                        2.2           0.4             
2.20/2.23	c ................................ | ..........                     2 |                        2.2           0.9             
2.20/2.23	c ................................ | ..........                     3 |                        2.2           1.3             
2.20/2.23	c ................................ | ..........                     4 |                        2.2           1.8             
2.20/2.23	c ................................ | ..........                     5 |                        2.2           2.2             
2.20/2.26	c ................................ | ..........                  1000 |                        2.3         440.5          543
23.91/13.15	c ................................ | ..........                204000 | 23526                 24.0        8496.5      6599908
48.06/25.23	c ................................ | ..........                341000 | 40108                 48.1        7083.5     12621130
72.21/37.32	c ................................ | ..........                415000 | 54243                 72.3        5743.1     18126985
95.95/49.21	c ................................ | ..........                512000 | 72231                 96.0        5333.3     22870531
120.10/61.35	c ................................ | *.........                648000 | 94447                120.2        5389.7     27863843
143.85/73.28	c ................................ | *.........                757000 | 112225               144.0        5255.8     33010576
167.99/85.31	c ................................ | *.........                883000 | 127444               168.0        5254.7     38062127
191.94/97.33	c ................................ | *.........               1027000 | 139063               192.1        5347.6     42541878
215.90/109.34	c ................................ | *.........               1158000 | 159267               216.0        5360.9     48648452
240.03/121.48	c ................................ | **........               1255000 | 177900               240.2        5223.7     53235635
263.99/133.47	c ................................ | **........               1332000 | 191165               264.2        5042.2     58936736
288.14/145.55	c ................................ | **........               1398000 | 203363               288.3        4849.3     64210111
312.49/157.75	c ................................ | **........               1448000 | 213716               312.6        4631.4     70281685
336.04/169.60	c ................................ | **........               1487000 | 222014               336.3        4421.9     73937484
360.18/181.67	c ................................ | ***.......               1542000 | 233123               360.4        4278.7     79806083
383.94/193.52	c ................................ | ***.......               1584000 | 242095               384.0        4124.7     84814725
407.88/205.57	c ................................ | ***.......               1641000 | 253055               408.1        4021.3     89181389
431.82/217.56	c ................................ | ***.......               1726000 | 263150               432.0        3995.2     95236760
456.18/229.78	c ................................ | ***.......               1782000 | 271388               456.4        3904.3    100126626
480.12/241.72	c ................................ | ****......               1838000 | 278129               480.2        3827.2    104738541
504.68/254.07	c ................................ | ****......               1872000 | 282811               504.9        3707.7    108796071

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver version 3.2.9 (svn:492) (c) roussel@cril.univ-artois.fr

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-1730156-1240756668/watcher-1730156-1240756668 -o /tmp/evaluation-result-1730156-1240756668/solver-1730156-1240756668 -C 1200 -W 1800 -M 1800 --output-limit 1,15 HOME/ttsth-5-0 -num-threads 2 HOME/instance-1730156-1240756668.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1200 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1230 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.83 1.82 1.45 3/65 23530
/proc/meminfo: memFree=1766816/2055920 swapFree=4181392/4192956
[pid=23530] ppid=23528 vsize=1064 CPUtime=0
/proc/23530/stat : 23530 (ttsth-5-0) R 23528 23530 23279 0 -1 4194304 137 0 0 0 0 0 0 0 20 0 1 0 103696034 1089536 121 1992294400 134512640 135237372 4294956192 18446744073709551615 134639534 0 0 4096 0 0 0 0 17 1 0 0
/proc/23530/statm: 266 122 77 176 0 88 0

[startup+0.047749 s]
/proc/loadavg: 1.83 1.82 1.45 3/65 23530
/proc/meminfo: memFree=1766816/2055920 swapFree=4181392/4192956
[pid=23530] ppid=23528 vsize=2680 CPUtime=0.04
/proc/23530/stat : 23530 (ttsth-5-0) R 23528 23530 23279 0 -1 4194304 535 0 0 0 4 0 0 0 20 0 1 0 103696034 2744320 519 1992294400 134512640 135237372 4294956192 18446744073709551615 134536395 0 0 4096 0 0 0 0 17 1 0 0
/proc/23530/statm: 670 519 78 176 0 492 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 2680

[startup+0.101754 s]
/proc/loadavg: 1.83 1.82 1.45 3/65 23530
/proc/meminfo: memFree=1766816/2055920 swapFree=4181392/4192956
[pid=23530] ppid=23528 vsize=4344 CPUtime=0.09
/proc/23530/stat : 23530 (ttsth-5-0) R 23528 23530 23279 0 -1 4194304 982 0 0 0 9 0 0 0 20 0 1 0 103696034 4448256 966 1992294400 134512640 135237372 4294956192 18446744073709551615 134732614 0 0 4096 0 0 0 0 17 1 0 0
/proc/23530/statm: 1086 966 78 176 0 908 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 4344

[startup+0.301776 s]
/proc/loadavg: 1.83 1.82 1.45 3/65 23530
/proc/meminfo: memFree=1766816/2055920 swapFree=4181392/4192956
[pid=23530] ppid=23528 vsize=14768 CPUtime=0.29
/proc/23530/stat : 23530 (ttsth-5-0) R 23528 23530 23279 0 -1 4194304 3589 0 0 0 27 2 0 0 22 0 1 0 103696034 15122432 3572 1992294400 134512640 135237372 4294956192 18446744073709551615 134519996 0 0 4096 0 0 0 0 17 1 0 0
/proc/23530/statm: 3692 3572 79 176 0 3514 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 14768

[startup+0.701821 s]
/proc/loadavg: 1.83 1.82 1.45 3/65 23530
/proc/meminfo: memFree=1766816/2055920 swapFree=4181392/4192956
[pid=23530] ppid=23528 vsize=14876 CPUtime=0.69
/proc/23530/stat : 23530 (ttsth-5-0) R 23528 23530 23279 0 -1 4194304 3769 0 0 0 67 2 0 0 25 0 1 0 103696034 15233024 3582 1992294400 134512640 135237372 4294956192 18446744073709551615 134555267 0 0 4096 0 0 0 0 17 1 0 0
/proc/23530/statm: 3719 3582 80 176 0 3541 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 14876

[startup+1.50191 s]
/proc/loadavg: 1.83 1.82 1.45 2/66 23531
/proc/meminfo: memFree=1752344/2055920 swapFree=4181392/4192956
[pid=23530] ppid=23528 vsize=14932 CPUtime=1.49
/proc/23530/stat : 23530 (ttsth-5-0) R 23528 23530 23279 0 -1 4194304 3899 0 0 0 147 2 0 0 25 0 1 0 103696034 15290368 3627 1992294400 134512640 135237372 4294956192 18446744073709551615 134731700 0 0 4096 0 0 0 0 17 1 0 0
/proc/23530/statm: 3733 3627 91 176 0 3555 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 14932

[startup+3.10109 s]
/proc/loadavg: 1.83 1.82 1.45 2/66 23531
/proc/meminfo: memFree=1737944/2055920 swapFree=4181392/4192956
[pid=23530] ppid=23528 vsize=66504 CPUtime=3.95
/proc/23530/stat : 23530 (ttsth-5-0) S 23528 23530 23279 0 -1 4194304 11590 0 0 0 391 4 0 0 25 0 3 0 103696034 68100096 11318 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/23530/statm: 16626 11318 98 176 0 16448 0
Current children cumulated CPU time (s) 3.95
Current children cumulated vsize (KiB) 66504

[startup+6.30245 s]
/proc/loadavg: 1.85 1.82 1.45 3/68 23533
/proc/meminfo: memFree=1696776/2055920 swapFree=4181392/4192956
[pid=23530] ppid=23528 vsize=100712 CPUtime=10.34
/proc/23530/stat : 23530 (ttsth-5-0) S 23528 23530 23279 0 -1 4194304 19883 0 0 0 1025 9 0 0 25 0 3 0 103696034 103129088 19611 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/23530/statm: 25178 19611 98 176 0 25000 0
[pid=23530/tid=23532] ppid=23528 vsize=100712 CPUtime=4.05
/proc/23530/task/23532/stat : 23532 (ttsth-5-0) R 23528 23530 23279 0 -1 4194368 7314 0 0 0 402 3 0 0 18 0 3 0 103696258 103129088 19611 1992294400 134512640 135237372 4294956192 18446744073709551615 134592041 0 0 4096 0 0 0 0 -1 1 0 0
[pid=23530/tid=23533] ppid=23528 vsize=100712 CPUtime=4.04
/proc/23530/task/23533/stat : 23533 (ttsth-5-0) R 23528 23530 23279 0 -1 4194368 4107 0 0 0 403 1 0 0 25 0 3 0 103696258 103129088 19611 1992294400 134512640 135237372 4294956192 18446744073709551615 134749343 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 10.34
Current children cumulated vsize (KiB) 100712

[startup+12.7012 s]
/proc/loadavg: 1.86 1.83 1.45 3/68 23533
/proc/meminfo: memFree=1637768/2055920 swapFree=4181392/4192956
[pid=23530] ppid=23528 vsize=160580 CPUtime=23.11
/proc/23530/stat : 23530 (ttsth-5-0) S 23528 23530 23279 0 -1 4194304 34377 0 0 0 2296 15 0 0 25 0 3 0 103696034 164433920 34105 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/23530/statm: 40145 34105 98 176 0 39967 0
[pid=23530/tid=23532] ppid=23528 vsize=160580 CPUtime=10.45
/proc/23530/task/23532/stat : 23532 (ttsth-5-0) R 23528 23530 23279 0 -1 4194368 16022 0 0 0 1038 7 0 0 25 0 3 0 103696258 164433920 34105 1992294400 134512640 135237372 4294956192 18446744073709551615 134749351 0 0 4096 0 0 0 0 -1 1 0 0
[pid=23530/tid=23533] ppid=23528 vsize=160580 CPUtime=10.41
/proc/23530/task/23533/stat : 23533 (ttsth-5-0) R 23528 23530 23279 0 -1 4194368 9893 0 0 0 1038 3 0 0 22 0 3 0 103696258 164433920 34105 1992294400 134512640 135237372 4294956192 18446744073709551615 134549908 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 23.11
Current children cumulated vsize (KiB) 160580

[startup+25.5016 s]
/proc/loadavg: 1.89 1.83 1.46 3/68 23533
/proc/meminfo: memFree=1532424/2055920 swapFree=4181392/4192956
[pid=23530] ppid=23528 vsize=264720 CPUtime=48.65
/proc/23530/stat : 23530 (ttsth-5-0) S 23528 23530 23279 0 -1 4194304 59610 0 0 0 4838 27 0 0 25 0 3 0 103696034 271073280 59338 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/23530/statm: 66180 59338 98 176 0 66002 0
[pid=23530/tid=23532] ppid=23528 vsize=264720 CPUtime=23.24
/proc/23530/task/23532/stat : 23532 (ttsth-5-0) R 23528 23530 23279 0 -1 4194368 29121 0 0 0 2310 14 0 0 25 0 3 0 103696258 271073280 59338 1992294400 134512640 135237372 4294956192 18446744073709551615 134562380 0 0 4096 0 0 0 0 -1 1 0 0
[pid=23530/tid=23533] ppid=23528 vsize=264720 CPUtime=23.15
/proc/23530/task/23533/stat : 23533 (ttsth-5-0) R 23528 23530 23279 0 -1 4194368 22027 0 0 0 2307 8 0 0 16 0 3 0 103696258 271073280 59338 1992294400 134512640 135237372 4294956192 18446744073709551615 134749351 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 48.65
Current children cumulated vsize (KiB) 264720

[startup+51.1014 s]
/proc/loadavg: 1.93 1.85 1.47 3/68 23533
/proc/meminfo: memFree=1364040/2055920 swapFree=4181392/4192956
[pid=23530] ppid=23528 vsize=439376 CPUtime=99.74
/proc/23530/stat : 23530 (ttsth-5-0) S 23528 23530 23279 0 -1 4194304 101540 0 0 0 9929 45 0 0 25 0 3 0 103696034 449921024 101268 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/23530/statm: 109844 101268 98 176 0 109666 0
[pid=23530/tid=23532] ppid=23528 vsize=439376 CPUtime=48.84
/proc/23530/task/23532/stat : 23532 (ttsth-5-0) R 23528 23530 23279 0 -1 4194368 48914 0 0 0 4860 24 0 0 25 0 3 0 103696258 449921024 101268 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 1 0 0
[pid=23530/tid=23533] ppid=23528 vsize=439376 CPUtime=48.66
/proc/23530/task/23533/stat : 23533 (ttsth-5-0) R 23528 23530 23279 0 -1 4194368 44164 0 0 0 4849 17 0 0 18 0 3 0 103696258 449921024 101268 1992294400 134512640 135237372 4294956192 18446744073709551615 134749351 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 99.74
Current children cumulated vsize (KiB) 439376

[startup+102.305 s]
/proc/loadavg: 1.97 1.87 1.50 3/68 23535
/proc/meminfo: memFree=1016840/2055920 swapFree=4181392/4192956
[pid=23530] ppid=23528 vsize=799760 CPUtime=201.92
/proc/23530/stat : 23530 (ttsth-5-0) S 23528 23530 23279 0 -1 4194304 187623 0 0 0 20100 92 0 0 25 0 3 0 103696034 818954240 187351 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/23530/statm: 199940 187351 98 176 0 199762 0
[pid=23530/tid=23532] ppid=23528 vsize=799760 CPUtime=100.03
/proc/23530/task/23532/stat : 23532 (ttsth-5-0) R 23528 23530 23279 0 -1 4194368 94244 0 0 0 9952 51 0 0 25 0 3 0 103696258 818954240 187351 1992294400 134512640 135237372 4294956192 18446744073709551615 134680474 0 0 4096 0 0 0 0 -1 1 0 0
[pid=23530/tid=23533] ppid=23528 vsize=799760 CPUtime=99.65
/proc/23530/task/23533/stat : 23533 (ttsth-5-0) R 23528 23530 23279 0 -1 4194368 84917 0 0 0 9927 38 0 0 18 0 3 0 103696258 818954240 187351 1992294400 134512640 135237372 4294956192 18446744073709551615 134749351 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 201.92
Current children cumulated vsize (KiB) 799760

[startup+162.302 s]
/proc/loadavg: 1.99 1.89 1.53 3/68 23535
/proc/meminfo: memFree=610376/2055920 swapFree=4181392/4192956
[pid=23530] ppid=23528 vsize=1221428 CPUtime=321.66
/proc/23530/stat : 23530 (ttsth-5-0) S 23528 23530 23279 0 -1 4194304 289400 0 0 0 32021 145 0 0 25 0 3 0 103696034 1250742272 289128 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/23530/statm: 305357 289128 98 176 0 305179 0
[pid=23530/tid=23532] ppid=23528 vsize=1221428 CPUtime=160.01
/proc/23530/task/23532/stat : 23532 (ttsth-5-0) R 23528 23530 23279 0 -1 4194368 137325 0 0 0 15924 77 0 0 25 0 3 0 103696258 1250742272 289128 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 1 0 0
[pid=23530/tid=23533] ppid=23528 vsize=1221428 CPUtime=159.41
/proc/23530/task/23533/stat : 23533 (ttsth-5-0) R 23528 23530 23279 0 -1 4194368 143613 0 0 0 15877 64 0 0 25 0 3 0 103696258 1250742272 289128 1992294400 134512640 135237372 4294956192 18446744073709551615 134590241 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 321.66
Current children cumulated vsize (KiB) 1221428

[startup+222.301 s]
/proc/loadavg: 1.99 1.91 1.55 3/68 23535
/proc/meminfo: memFree=206408/2055920 swapFree=4181392/4192956
[pid=23530] ppid=23528 vsize=1637620 CPUtime=441.4
/proc/23530/stat : 23530 (ttsth-5-0) S 23528 23530 23279 0 -1 4194304 389844 0 0 0 43944 196 0 0 25 0 3 0 103696034 1676922880 389572 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/23530/statm: 409405 389572 98 176 0 409227 0
[pid=23530/tid=23532] ppid=23528 vsize=1637620 CPUtime=219.99
/proc/23530/task/23532/stat : 23532 (ttsth-5-0) R 23528 23530 23279 0 -1 4194368 177993 0 0 0 21898 101 0 0 25 0 3 0 103696258 1676922880 389572 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 1 0 0
[pid=23530/tid=23533] ppid=23528 vsize=1637620 CPUtime=219.17
/proc/23530/task/23533/stat : 23533 (ttsth-5-0) R 23528 23530 23279 0 -1 4194368 203389 0 0 0 21826 91 0 0 25 0 3 0 103696258 1676922880 389572 1992294400 134512640 135237372 4294956192 18446744073709551615 134565869 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 441.4
Current children cumulated vsize (KiB) 1637620



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+258.201 s]
/proc/loadavg: 1.99 1.92 1.57 3/68 23535
/proc/meminfo: memFree=15304/2055920 swapFree=4181392/4192956
[pid=23530] ppid=23528 vsize=1843824 CPUtime=513.05
/proc/23530/stat : 23530 (ttsth-5-0) S 23528 23530 23279 0 -1 4194304 439562 0 0 0 51082 223 0 0 25 0 3 0 103696034 1888075776 439290 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/23530/statm: 460956 439290 98 176 0 460778 0
[pid=23530/tid=23532] ppid=23528 vsize=1843824 CPUtime=255.88
/proc/23530/task/23532/stat : 23532 (ttsth-5-0) R 23528 23530 23279 0 -1 4194368 197934 0 0 0 25475 113 0 0 25 0 3 0 103696258 1888075776 439290 1992294400 134512640 135237372 4294956192 18446744073709551615 134562344 0 0 4096 0 0 0 0 -1 1 0 0
[pid=23530/tid=23533] ppid=23528 vsize=1843824 CPUtime=254.92
/proc/23530/task/23533/stat : 23533 (ttsth-5-0) R 23528 23530 23279 0 -1 4194368 233166 0 0 0 25386 106 0 0 25 0 3 0 103696258 1888075776 439290 1992294400 134512640 135237372 4294956192 18446744073709551615 134587952 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 513.05
Current children cumulated vsize (KiB) 1843824

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+258.402 s]
/proc/loadavg: 1.99 1.92 1.57 2/68 23536
/proc/meminfo: memFree=1332992/2055920 swapFree=4181392/4192956
[pid=23530] ppid=23528 vsize=0 CPUtime=513.25
/proc/23530/stat : 23530 (ttsth-5-0) Z 23528 23530 23279 0 -1 4195340 439562 0 0 0 51083 242 0 0 16 0 2 0 103696034 0 0 1992294400 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/23530/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 513.25
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 258.473
CPU time (s): 513.328
CPU user time (s): 510.838
CPU system time (s): 2.48962
CPU usage (%): 198.6
Max. virtual memory (cumulated for all children) (KiB): 1843824

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 510.838
system time used= 2.48962
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 439562
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 354
involuntary context switches= 3937

runsolver used 0.244962 second user time and 0.712891 second system time

The end

Launcher Data 

Begin job on node87 at 2009-04-26 16:37:49
IDJOB=1730156
IDBENCH=24722
IDSOLVER=549
FILE ID=node87/1730156-1240756668
PBS_JOBID= 9187113
Free space on /tmp= 66444 MiB

SOLVER NAME= ttsth-5-0 2009-03-19
BENCH NAME= SAT07/crafted/Difficult/contest05/sabharwal/gt-ordering-unsat-gt-045.sat05-1310.reshuffled-07.cnf
COMMAND LINE= HOME/ttsth-5-0 -num-threads MAXNBTHREAD BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-1730156-1240756668/watcher-1730156-1240756668 -o /tmp/evaluation-result-1730156-1240756668/solver-1730156-1240756668 -C 1200 -W 1800 -M 1800 --output-limit 1,15  HOME/ttsth-5-0 -num-threads 2 HOME/instance-1730156-1240756668.cnf

TIME LIMIT= 1200 seconds
MEMORY LIMIT= 1800 MiB
MAX NB THREAD= 2

MD5SUM BENCH= ae4e3f3661a3c7ad7c7ec30d56d611a1
RANDOM SEED=758276839

node87.alineos.net Linux 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.213
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.213
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5996.54
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1767296 kB
Buffers:         28904 kB
Cached:         190024 kB
SwapCached:       5472 kB
Active:          74844 kB
Inactive:       151972 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1767296 kB
SwapTotal:     4192956 kB
SwapFree:      4181392 kB
Dirty:            2252 kB
Writeback:           0 kB
Mapped:          13532 kB
Slab:            47712 kB
Committed_AS:   375536 kB
PageTables:       1456 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66444 MiB
End job on node87 at 2009-04-26 16:42:09