Trace number 1560628

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ttsth-5-0 2009-03-19? (MO) 583.604 582.185

General information on the benchmark

NameAPPLICATIONS/aprove09/
AProVE09-07.cnf
MD5SUMc5fb730ce517a6a48db8bb4f0db1d85a
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark0.602908
Satisfiable
(Un)Satisfiability was proved
Number of variables8567
Number of clauses28936
Sum of the clauses size74592
Maximum clause length14
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 213207
Number of clauses of size 314832
Number of clauses of size 4883
Number of clauses of size 50
Number of clauses of size over 513

Solver Data 

0.05/0.06	c Command: HOME/ttsth-5-0 -num-threads 2 HOME/instance-1560628-1238758115.cnf 
0.05/0.06	c Using SATTIMEOUT of 1200
0.05/0.06	c Using SATRAM of 1800
0.05/0.06	c Size of subset node = 16
0.05/0.06	c Variables = 8567
0.05/0.06	c Clauses = 28936
0.05/0.06	c Literals = 74592
0.05/0.06	c Reduced size:
0.05/0.06	c Variables = 8567
0.05/0.06	c Clauses = 28676
0.05/0.06	c Literals = 73832
0.05/0.06	c a2
0.09/0.13	c a1
1.39/1.45	c Independent sub-problems = 1
1.39/1.45	c Sub-problem with 8544 variables and 28676 clauses
1.39/1.45	c using permutation method 4
1.39/1.45	c count = 1
1.39/1.45	c Ordering finished 1.430 seconds
1.39/1.45	c mapped 1.440 seconds
1.39/1.45	c permuted 1.440 seconds
1.39/1.45	c about to sort
1.39/1.46	c sorted
1.60/1.65	c clauses now 28676
1.60/1.65	c init finished 1.490 seconds
1.60/1.65	c tree built 1.650 seconds
1.60/1.65	c 
1.60/1.65	c PA progress                      | CPU progress Partial assignments | improvements      CPU time        PA/sec        nodes
1.60/1.65	c ---------------------------------|----------------------------------|------------------------------------------------------
1.60/1.65	c ................................ | ..........                       |                        1.6           0.0             
1.60/1.65	c ................................ | ..........                     1 |                        1.6           0.6             
1.60/1.65	c ................................ | ..........                     2 |                        1.6           1.2             
1.60/1.65	c ................................ | ..........                     3 |                        1.6           1.8             
1.60/1.65	c ................................ | ..........                     4 |                        1.6           2.4             
1.60/1.65	c ................................ | ..........                     5 |                        1.6           3.0             
1.60/1.65	c ................................ | ..........                  1000 | 18                     1.6         606.1          541
24.09/24.11	c ................................ | ..........                632000 | 53347                 24.1       26224.1      5997905
47.97/48.01	c ................................ | ..........               1096000 | 92816                 48.0       22833.3     10507032
71.97/72.02	c ................................ | ..........               1481000 | 130762                72.0       20566.6     16355442
95.96/96.05	c ................................ | ..........               1856000 | 167959                96.0       19327.3     22294098
120.05/120.13	c ................................ | *.........               2140000 | 195459               120.1       17817.0     27539325
144.04/144.12	c ................................ | *.........               2383000 | 222533               144.1       16539.4     32832652
168.03/168.13	c ................................ | *.........               2648000 | 253018               168.1       15754.4     38428823
192.02/192.14	c ................................ | *.........               2944000 | 281838               192.1       15326.1     43579225
216.01/216.17	c ................................ | *.........               3186000 | 306808               216.1       14742.5     48237720
239.90/240.07	c ................................ | **........               3405000 | 330871               240.0       14186.3     52892689
263.90/264.06	c ................................ | **........               3606000 | 354226               264.0       13659.1     58153026
287.88/288.10	c ................................ | **........               3802000 | 377000               288.0       13200.0     62963141
311.88/312.10	c ................................ | **........               4015000 | 403417               312.0       12867.8     68391402
335.87/336.08	c ................................ | **........               4215000 | 427045               336.0       12544.6     73408995
359.95/360.10	c ................................ | ***.......               4395000 | 448203               360.0       12207.7     78099623
383.95/384.14	c ................................ | ***.......               4585000 | 470901               384.1       11938.5     82381795
407.95/408.14	c ................................ | ***.......               4797000 | 493413               408.1       11755.9     86456903
431.94/432.17	c ................................ | ***.......               4964000 | 513046               432.1       11488.9     90045883
455.93/456.12	c ................................ | ***.......               5109000 | 530587               456.0       11203.7     93741650
479.91/480.17	c ................................ | ****......               5258000 | 548738               480.1       10952.8     97422710
503.91/504.18	c ................................ | ****......               5399000 | 566937               504.1       10710.8    101342881
527.90/528.14	c ................................ | ****......               5535000 | 584516               528.0       10482.4    105023070
552.08/552.32	c ................................ | ****......               5677000 | 602947               552.2       10281.1    109125910
575.86/576.14	c ................................ | ****......               5826000 | 621206               576.0       10114.6    113020943

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver version 3.2.9 (svn:492) (c) roussel@cril.univ-artois.fr

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-1560628-1238758115/watcher-1560628-1238758115 -o /tmp/evaluation-result-1560628-1238758115/solver-1560628-1238758115 -C 1200 -W 1800 -M 1800 --output-limit 1,15 HOME/ttsth-5-0 -num-threads 2 HOME/instance-1560628-1238758115.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1200 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1230 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.95 1.95 1.98 4/86 17355
/proc/meminfo: memFree=1806208/2055920 swapFree=4170308/4192956
[pid=17355] ppid=17353 vsize=1064 CPUtime=0
/proc/17355/stat : 17355 (ttsth-5-0) R 17353 17355 16692 0 -1 4194304 163 0 0 0 0 0 0 0 18 0 1 0 1148475531 1089536 147 1992294400 134512640 135237372 4294956192 18446744073709551615 134685178 0 0 4096 0 0 0 0 17 0 0 0
/proc/17355/statm: 266 147 78 176 0 88 0

[startup+0.0555259 s]
/proc/loadavg: 1.95 1.95 1.98 4/86 17355
/proc/meminfo: memFree=1806208/2055920 swapFree=4170308/4192956
[pid=17355] ppid=17353 vsize=2948 CPUtime=0.05
/proc/17355/stat : 17355 (ttsth-5-0) R 17353 17355 16692 0 -1 4194304 608 0 0 0 5 0 0 0 18 0 1 0 1148475531 3018752 592 1992294400 134512640 135237372 4294956192 18446744073709551615 134534164 0 0 4096 0 0 0 0 17 0 0 0
/proc/17355/statm: 737 592 78 176 0 559 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 2948

[startup+0.101532 s]
/proc/loadavg: 1.95 1.95 1.98 4/86 17355
/proc/meminfo: memFree=1806208/2055920 swapFree=4170308/4192956
[pid=17355] ppid=17353 vsize=4936 CPUtime=0.09
/proc/17355/stat : 17355 (ttsth-5-0) R 17353 17355 16692 0 -1 4194304 1114 0 0 0 9 0 0 0 18 0 1 0 1148475531 5054464 1097 1992294400 134512640 135237372 4294956192 18446744073709551615 134519996 0 0 4096 0 0 0 0 17 0 0 0
/proc/17355/statm: 1234 1097 79 176 0 1056 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 4936

[startup+0.301555 s]
/proc/loadavg: 1.95 1.95 1.98 4/86 17355
/proc/meminfo: memFree=1806208/2055920 swapFree=4170308/4192956
[pid=17355] ppid=17353 vsize=6200 CPUtime=0.29
/proc/17355/stat : 17355 (ttsth-5-0) R 17353 17355 16692 0 -1 4194304 1456 0 0 0 29 0 0 0 19 0 1 0 1148475531 6348800 1410 1992294400 134512640 135237372 4294956192 18446744073709551615 134555279 0 0 4096 0 0 0 0 17 0 0 0
/proc/17355/statm: 1550 1410 80 176 0 1372 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 6200

[startup+0.701605 s]
/proc/loadavg: 1.95 1.95 1.98 4/86 17355
/proc/meminfo: memFree=1806208/2055920 swapFree=4170308/4192956
[pid=17355] ppid=17353 vsize=6368 CPUtime=0.69
/proc/17355/stat : 17355 (ttsth-5-0) R 17353 17355 16692 0 -1 4194304 1494 0 0 0 69 0 0 0 23 0 1 0 1148475531 6520832 1448 1992294400 134512640 135237372 4294956192 18446744073709551615 134555279 0 0 4096 0 0 0 0 17 0 0 0
/proc/17355/statm: 1592 1448 80 176 0 1414 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 6368

[startup+1.50171 s]
/proc/loadavg: 1.95 1.95 1.98 3/87 17356
/proc/meminfo: memFree=1800504/2055920 swapFree=4170308/4192956
[pid=17355] ppid=17353 vsize=16920 CPUtime=1.49
/proc/17355/stat : 17355 (ttsth-5-0) R 17353 17355 16692 0 -1 4194304 4133 0 0 0 148 1 0 0 25 0 1 0 1148475531 17326080 4087 1992294400 134512640 135237372 4294956192 18446744073709551615 134732614 0 0 4096 0 0 0 0 17 0 0 0
/proc/17355/statm: 4230 4087 91 176 0 4052 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 16920

[startup+3.10191 s]
/proc/loadavg: 1.95 1.95 1.98 4/89 17358
/proc/meminfo: memFree=1777896/2055920 swapFree=4170308/4192956
[pid=17355] ppid=17353 vsize=56148 CPUtime=3.09
/proc/17355/stat : 17355 (ttsth-5-0) S 17353 17355 16692 0 -1 4194304 8674 0 0 0 306 3 0 0 25 0 3 0 1148475531 57495552 8628 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 0 0 0
/proc/17355/statm: 14037 8628 98 176 0 13859 0
[pid=17355/tid=17357] ppid=17353 vsize=56148 CPUtime=0.72
/proc/17355/task/17357/stat : 17357 (ttsth-5-0) R 17353 17355 16692 0 -1 4194368 1106 0 0 0 72 0 0 0 25 0 3 0 1148475696 57495552 8628 1992294400 134512640 135237372 4294956192 18446744073709551615 134749343 0 0 4096 0 0 0 0 -1 0 0 0
[pid=17355/tid=17358] ppid=17353 vsize=56148 CPUtime=0.7
/proc/17355/task/17358/stat : 17358 (ttsth-5-0) R 17353 17355 16692 0 -1 4194368 1109 0 0 0 70 0 0 0 25 0 3 0 1148475696 57495552 8629 1992294400 134512640 135237372 4294956192 18446744073709551615 134749343 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 56148

[startup+6.3023 s]
/proc/loadavg: 2.03 1.97 1.98 4/89 17358
/proc/meminfo: memFree=1760432/2055920 swapFree=4170308/4192956
[pid=17355] ppid=17353 vsize=71192 CPUtime=6.3
/proc/17355/stat : 17355 (ttsth-5-0) S 17353 17355 16692 0 -1 4194304 12436 0 0 0 626 4 0 0 25 0 3 0 1148475531 72900608 12390 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 0 0 0
/proc/17355/statm: 17798 12390 98 176 0 17620 0
[pid=17355/tid=17357] ppid=17353 vsize=71192 CPUtime=2.32
/proc/17355/task/17357/stat : 17357 (ttsth-5-0) R 17353 17355 16692 0 -1 4194368 2784 0 0 0 232 0 0 0 25 0 3 0 1148475696 72900608 12390 1992294400 134512640 135237372 4294956192 18446744073709551615 134590368 0 0 4096 0 0 0 0 -1 0 0 0
[pid=17355/tid=17358] ppid=17353 vsize=71192 CPUtime=2.3
/proc/17355/task/17358/stat : 17358 (ttsth-5-0) R 17353 17355 16692 0 -1 4194368 3193 0 0 0 230 0 0 0 25 0 3 0 1148475696 72900608 12390 1992294400 134512640 135237372 4294956192 18446744073709551615 134550999 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 6.3
Current children cumulated vsize (KiB) 71192

[startup+12.7011 s]
/proc/loadavg: 2.11 1.99 1.99 4/89 17358
/proc/meminfo: memFree=1734256/2055920 swapFree=4170308/4192956
[pid=17355] ppid=17353 vsize=96600 CPUtime=12.69
/proc/17355/stat : 17355 (ttsth-5-0) S 17353 17355 16692 0 -1 4194304 18788 0 0 0 1261 8 0 0 25 0 3 0 1148475531 98918400 18742 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 0 0 0
/proc/17355/statm: 24150 18742 98 176 0 23972 0
[pid=17355/tid=17357] ppid=17353 vsize=96600 CPUtime=5.52
/proc/17355/task/17357/stat : 17357 (ttsth-5-0) R 17353 17355 16692 0 -1 4194368 5500 0 0 0 550 2 0 0 25 0 3 0 1148475696 98918400 18742 1992294400 134512640 135237372 4294956192 18446744073709551615 134749351 0 0 4096 0 0 0 0 -1 0 0 0
[pid=17355/tid=17358] ppid=17353 vsize=96600 CPUtime=5.5
/proc/17355/task/17358/stat : 17358 (ttsth-5-0) R 17353 17355 16692 0 -1 4194368 6829 0 0 0 547 3 0 0 25 0 3 0 1148475696 98918400 18742 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 96600

[startup+25.5017 s]
/proc/loadavg: 2.31 2.04 2.01 4/89 17358
/proc/meminfo: memFree=1679792/2055920 swapFree=4170308/4192956
[pid=17355] ppid=17353 vsize=148724 CPUtime=25.49
/proc/17355/stat : 17355 (ttsth-5-0) S 17353 17355 16692 0 -1 4194304 31872 0 0 0 2535 14 0 0 25 0 3 0 1148475531 152293376 31826 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 0 0 0
/proc/17355/statm: 37181 31826 98 176 0 37003 0
[pid=17355/tid=17357] ppid=17353 vsize=148724 CPUtime=11.92
/proc/17355/task/17357/stat : 17357 (ttsth-5-0) R 17353 17355 16692 0 -1 4194368 12523 0 0 0 1188 4 0 0 25 0 3 0 1148475696 152293376 31826 1992294400 134512640 135237372 4294956192 18446744073709551615 134749351 0 0 4096 0 0 0 0 -1 0 0 0
[pid=17355/tid=17358] ppid=17353 vsize=148724 CPUtime=11.9
/proc/17355/task/17358/stat : 17358 (ttsth-5-0) R 17353 17355 16692 0 -1 4194368 12890 0 0 0 1183 7 0 0 25 0 3 0 1148475696 152293376 31826 1992294400 134512640 135237372 4294956192 18446744073709551615 134587921 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 148724

[startup+51.1019 s]
/proc/loadavg: 2.54 2.11 2.03 4/89 17358
/proc/meminfo: memFree=1605936/2055920 swapFree=4170308/4192956
[pid=17355] ppid=17353 vsize=223508 CPUtime=51.08
/proc/17355/stat : 17355 (ttsth-5-0) S 17353 17355 16692 0 -1 4194304 50468 0 0 0 5085 23 0 0 25 0 3 0 1148475531 228872192 50422 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 0 0 0
/proc/17355/statm: 55877 50422 98 176 0 55699 0
[pid=17355/tid=17357] ppid=17353 vsize=223508 CPUtime=24.71
/proc/17355/task/17357/stat : 17357 (ttsth-5-0) R 17353 17355 16692 0 -1 4194368 22805 0 0 0 2461 10 0 0 25 0 3 0 1148475696 228872192 50423 1992294400 134512640 135237372 4294956192 18446744073709551615 134546026 0 0 4096 0 0 0 0 -1 0 0 0
[pid=17355/tid=17358] ppid=17353 vsize=223508 CPUtime=24.7
/proc/17355/task/17358/stat : 17358 (ttsth-5-0) R 17353 17355 16692 0 -1 4194368 21205 0 0 0 2460 10 0 0 25 0 3 0 1148475696 228872192 50423 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 223508

[startup+102.306 s]
/proc/loadavg: 2.80 2.25 2.08 4/89 17358
/proc/meminfo: memFree=1407216/2055920 swapFree=4170308/4192956
[pid=17355] ppid=17353 vsize=420684 CPUtime=102.26
/proc/17355/stat : 17355 (ttsth-5-0) S 17353 17355 16692 0 -1 4194304 99658 0 0 0 10180 46 0 0 25 0 3 0 1148475531 430780416 99612 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 0 0 0
/proc/17355/statm: 105171 99612 98 176 0 104993 0
[pid=17355/tid=17357] ppid=17353 vsize=420684 CPUtime=50.3
/proc/17355/task/17357/stat : 17357 (ttsth-5-0) R 17353 17355 16692 0 -1 4194368 49381 0 0 0 5007 23 0 0 25 0 3 0 1148475696 430780416 99612 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 0 0 0
[pid=17355/tid=17358] ppid=17353 vsize=420684 CPUtime=50.3
/proc/17355/task/17358/stat : 17358 (ttsth-5-0) R 17353 17355 16692 0 -1 4194368 43818 0 0 0 5009 21 0 0 25 0 3 0 1148475696 430780416 99612 1992294400 134512640 135237372 4294956192 18446744073709551615 134680467 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 102.26
Current children cumulated vsize (KiB) 420684

[startup+162.302 s]
/proc/loadavg: 2.92 2.38 2.13 4/89 17358
/proc/meminfo: memFree=1200688/2055920 swapFree=4170308/4192956
[pid=17355] ppid=17353 vsize=628952 CPUtime=162.23
/proc/17355/stat : 17355 (ttsth-5-0) S 17353 17355 16692 0 -1 4194304 151703 0 0 0 16154 69 0 0 25 0 3 0 1148475531 644046848 151657 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 0 0 0
/proc/17355/statm: 157238 151657 98 176 0 157060 0
[pid=17355/tid=17357] ppid=17353 vsize=628952 CPUtime=80.3
/proc/17355/task/17357/stat : 17357 (ttsth-5-0) R 17353 17355 16692 0 -1 4194368 76240 0 0 0 7995 35 0 0 25 0 3 0 1148475696 644046848 151657 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 0 0 0
[pid=17355/tid=17358] ppid=17353 vsize=628952 CPUtime=80.27
/proc/17355/task/17358/stat : 17358 (ttsth-5-0) R 17353 17355 16692 0 -1 4194368 69004 0 0 0 7996 31 0 0 25 0 3 0 1148475696 644046848 151657 1992294400 134512640 135237372 4294956192 18446744073709551615 134749351 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 162.23
Current children cumulated vsize (KiB) 628952

[startup+222.301 s]
/proc/loadavg: 2.97 2.49 2.19 4/89 17358
/proc/meminfo: memFree=1003312/2055920 swapFree=4170308/4192956
[pid=17355] ppid=17353 vsize=825180 CPUtime=222.21
/proc/17355/stat : 17355 (ttsth-5-0) S 17353 17355 16692 0 -1 4194304 200483 0 0 0 22131 90 0 0 25 0 3 0 1148475531 844984320 200437 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 0 0 0
/proc/17355/statm: 206295 200437 98 176 0 206117 0
[pid=17355/tid=17357] ppid=17353 vsize=825180 CPUtime=110.36
/proc/17355/task/17357/stat : 17357 (ttsth-5-0) R 17353 17355 16692 0 -1 4194368 100911 0 0 0 10989 47 0 0 25 0 3 0 1148475696 844984320 200437 1992294400 134512640 135237372 4294956192 18446744073709551615 134546034 0 0 4096 0 0 0 0 -1 0 0 0
[pid=17355/tid=17358] ppid=17353 vsize=825180 CPUtime=110.19
/proc/17355/task/17358/stat : 17358 (ttsth-5-0) R 17353 17355 16692 0 -1 4194368 93113 0 0 0 10979 40 0 0 25 0 3 0 1148475696 844984320 200438 1992294400 134512640 135237372 4294956192 18446744073709551615 134587943 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 222.21
Current children cumulated vsize (KiB) 825180

[startup+282.302 s]
/proc/loadavg: 2.99 2.58 2.23 4/89 17358
/proc/meminfo: memFree=812720/2055920 swapFree=4170308/4192956
[pid=17355] ppid=17353 vsize=1017576 CPUtime=282.19
/proc/17355/stat : 17355 (ttsth-5-0) S 17353 17355 16692 0 -1 4194304 248568 0 0 0 28107 112 0 0 25 0 3 0 1148475531 1041997824 248522 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 0 0 0
/proc/17355/statm: 254394 248522 98 176 0 254216 0
[pid=17355/tid=17357] ppid=17353 vsize=1017576 CPUtime=140.34
/proc/17355/task/17357/stat : 17357 (ttsth-5-0) R 17353 17355 16692 0 -1 4194368 123242 0 0 0 13979 55 0 0 25 0 3 0 1148475696 1041997824 248522 1992294400 134512640 135237372 4294956192 18446744073709551615 134546026 0 0 4096 0 0 0 0 -1 0 0 0
[pid=17355/tid=17358] ppid=17353 vsize=1017576 CPUtime=140.18
/proc/17355/task/17358/stat : 17358 (ttsth-5-0) R 17353 17355 16692 0 -1 4194368 118867 0 0 0 13965 53 0 0 25 0 3 0 1148475696 1041997824 248522 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 282.19
Current children cumulated vsize (KiB) 1017576

[startup+342.301 s]
/proc/loadavg: 2.99 2.65 2.28 4/89 17358
/proc/meminfo: memFree=609776/2055920 swapFree=4170308/4192956
[pid=17355] ppid=17353 vsize=1218080 CPUtime=342.16
/proc/17355/stat : 17355 (ttsth-5-0) S 17353 17355 16692 0 -1 4194304 298703 0 0 0 34084 132 0 0 25 0 3 0 1148475531 1247313920 298657 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 0 0 0
/proc/17355/statm: 304520 298657 98 176 0 304342 0
[pid=17355/tid=17357] ppid=17353 vsize=1218080 CPUtime=170.32
/proc/17355/task/17357/stat : 17357 (ttsth-5-0) R 17353 17355 16692 0 -1 4194368 150180 0 0 0 16965 67 0 0 25 0 3 0 1148475696 1247313920 298657 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 0 0 0
[pid=17355/tid=17358] ppid=17353 vsize=1218080 CPUtime=170.18
/proc/17355/task/17358/stat : 17358 (ttsth-5-0) R 17353 17355 16692 0 -1 4194368 142064 0 0 0 16955 63 0 0 25 0 3 0 1148475696 1247313920 298657 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 342.16
Current children cumulated vsize (KiB) 1218080

[startup+402.302 s]
/proc/loadavg: 2.99 2.71 2.32 4/89 17358
/proc/meminfo: memFree=438320/2055920 swapFree=4170308/4192956
[pid=17355] ppid=17353 vsize=1390228 CPUtime=402.14
/proc/17355/stat : 17355 (ttsth-5-0) S 17353 17355 16692 0 -1 4194304 341742 0 0 0 40061 153 0 0 25 0 3 0 1148475531 1423593472 341696 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 0 0 0
/proc/17355/statm: 347557 341696 98 176 0 347379 0
[pid=17355/tid=17357] ppid=17353 vsize=1390228 CPUtime=200.3
/proc/17355/task/17357/stat : 17357 (ttsth-5-0) R 17353 17355 16692 0 -1 4194368 174040 0 0 0 19952 78 0 0 25 0 3 0 1148475696 1423593472 341696 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 0 0 0
[pid=17355/tid=17358] ppid=17353 vsize=1390228 CPUtime=200.17
/proc/17355/task/17358/stat : 17358 (ttsth-5-0) R 17353 17355 16692 0 -1 4194368 161243 0 0 0 19945 72 0 0 25 0 3 0 1148475696 1423593472 341696 1992294400 134512640 135237372 4294956192 18446744073709551615 134749318 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 402.14
Current children cumulated vsize (KiB) 1390228

[startup+462.301 s]
/proc/loadavg: 2.99 2.76 2.36 4/89 17358
/proc/meminfo: memFree=296624/2055920 swapFree=4170308/4192956
[pid=17355] ppid=17353 vsize=1530704 CPUtime=462.12
/proc/17355/stat : 17355 (ttsth-5-0) S 17353 17355 16692 0 -1 4194304 376854 0 0 0 46043 169 0 0 25 0 3 0 1148475531 1567440896 376808 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 0 0 0
/proc/17355/statm: 382676 376808 98 176 0 382498 0
[pid=17355/tid=17357] ppid=17353 vsize=1530704 CPUtime=230.29
/proc/17355/task/17357/stat : 17357 (ttsth-5-0) R 17353 17355 16692 0 -1 4194368 191118 0 0 0 22943 86 0 0 25 0 3 0 1148475696 1567440896 376808 1992294400 134512640 135237372 4294956192 18446744073709551615 134562351 0 0 4096 0 0 0 0 -1 0 0 0
[pid=17355/tid=17358] ppid=17353 vsize=1530704 CPUtime=230.17
/proc/17355/task/17358/stat : 17358 (ttsth-5-0) R 17353 17355 16692 0 -1 4194368 179277 0 0 0 22937 80 0 0 25 0 3 0 1148475696 1567440896 376808 1992294400 134512640 135237372 4294956192 18446744073709551615 134680223 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 462.12
Current children cumulated vsize (KiB) 1530704

[startup+522.302 s]
/proc/loadavg: 2.99 2.80 2.40 4/89 17358
/proc/meminfo: memFree=149936/2055920 swapFree=4170308/4192956
[pid=17355] ppid=17353 vsize=1682164 CPUtime=522.1
/proc/17355/stat : 17355 (ttsth-5-0) S 17353 17355 16692 0 -1 4194304 413777 0 0 0 52024 186 0 0 25 0 3 0 1148475531 1722535936 413731 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 0 0 0
/proc/17355/statm: 420541 413731 98 176 0 420363 0
[pid=17355/tid=17357] ppid=17353 vsize=1682164 CPUtime=260.28
/proc/17355/task/17357/stat : 17357 (ttsth-5-0) R 17353 17355 16692 0 -1 4194368 210322 0 0 0 25933 95 0 0 25 0 3 0 1148475696 1722535936 413731 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 0 0 0
[pid=17355/tid=17358] ppid=17353 vsize=1682164 CPUtime=260.16
/proc/17355/task/17358/stat : 17358 (ttsth-5-0) R 17353 17355 16692 0 -1 4194368 196996 0 0 0 25928 88 0 0 25 0 3 0 1148475696 1722535936 413731 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 522.1
Current children cumulated vsize (KiB) 1682164



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+581.907 s]
/proc/loadavg: 2.99 2.84 2.43 4/89 17358
/proc/meminfo: memFree=15728/2055920 swapFree=4170308/4192956
[pid=17355] ppid=17353 vsize=1843700 CPUtime=583.32
/proc/17355/stat : 17355 (ttsth-5-0) S 17353 17355 16692 0 -1 4194304 452877 0 0 0 58128 204 0 0 25 0 3 0 1148475531 1887948800 452831 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 0 0 0
/proc/17355/statm: 460925 452831 98 176 0 460747 0
[pid=17355/tid=17357] ppid=17353 vsize=1843700 CPUtime=290.08
/proc/17355/task/17357/stat : 17357 (ttsth-5-0) R 17353 17355 16692 0 -1 4194368 230676 0 0 0 28904 104 0 0 25 0 3 0 1148475696 1887948800 452831 1992294400 134512640 135237372 4294956192 18446744073709551615 134592435 0 0 4096 0 0 0 0 -1 1 0 0
[pid=17355/tid=17358] ppid=17353 vsize=1843700 CPUtime=291.59
/proc/17355/task/17358/stat : 17358 (ttsth-5-0) R 17353 17355 16692 0 -1 4194368 215742 0 0 0 29061 98 0 0 25 0 3 0 1148475696 1887948800 452831 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 583.32
Current children cumulated vsize (KiB) 1843700

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+582.013 s]
/proc/loadavg: 2.99 2.84 2.43 4/89 17358
/proc/meminfo: memFree=15728/2055920 swapFree=4170308/4192956
[pid=17355] ppid=17353 vsize=0 CPUtime=583.42
/proc/17355/stat : 17355 (ttsth-5-0) R 17353 17355 16692 0 -1 4195332 452877 0 0 0 58129 213 0 0 17 0 1 0 1148475531 0 0 1992294400 0 0 0 0 0 0 0 4096 0 0 0 0 17 0 0 0
/proc/17355/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 583.42
Current children cumulated vsize (KiB) 0

[startup+582.101 s]
/proc/loadavg: 2.99 2.84 2.43 4/89 17358
/proc/meminfo: memFree=15728/2055920 swapFree=4170308/4192956
[pid=17355] ppid=17353 vsize=0 CPUtime=583.51
/proc/17355/stat : 17355 (ttsth-5-0) R 17353 17355 16692 0 -1 4195332 452877 0 0 0 58129 222 0 0 18 0 1 0 1148475531 0 0 1992294400 0 0 0 0 0 0 0 4096 0 0 0 0 17 0 0 0
/proc/17355/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 583.51
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 582.185
CPU time (s): 583.604
CPU user time (s): 581.294
CPU system time (s): 2.31065
CPU usage (%): 100.244
Max. virtual memory (cumulated for all children) (KiB): 1843700

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 581.294
system time used= 2.31065
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 452877
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 42
involuntary context switches= 7446

runsolver used 0.679896 second user time and 1.9817 second system time

The end

Launcher Data 

Begin job on node92 at 2009-04-03 13:28:35
IDJOB=1560628
IDBENCH=70899
IDSOLVER=549
FILE ID=node92/1560628-1238758115
PBS_JOBID= 9085443
Free space on /tmp= 66552 MiB

SOLVER NAME= ttsth-5-0 2009-03-19
BENCH NAME= SAT09/APPLICATIONS/aprove09/AProVE09-07.cnf
COMMAND LINE= HOME/ttsth-5-0 -num-threads MAXNBTHREAD BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-1560628-1238758115/watcher-1560628-1238758115 -o /tmp/evaluation-result-1560628-1238758115/solver-1560628-1238758115 -C 1200 -W 1800 -M 1800 --output-limit 1,15  HOME/ttsth-5-0 -num-threads 2 HOME/instance-1560628-1238758115.cnf

TIME LIMIT= 1200 seconds
MEMORY LIMIT= 1800 MiB
MAX NB THREAD= 2

MD5SUM BENCH= c5fb730ce517a6a48db8bb4f0db1d85a
RANDOM SEED=971327873

node92.alineos.net Linux 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.249
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.249
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5996.54
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1806688 kB
Buffers:         30332 kB
Cached:         145228 kB
SwapCached:       7632 kB
Active:          70924 kB
Inactive:       114572 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1806688 kB
SwapTotal:     4192956 kB
SwapFree:      4170308 kB
Dirty:            1264 kB
Writeback:           0 kB
Mapped:          15684 kB
Slab:            47780 kB
Committed_AS:  1954132 kB
PageTables:       2768 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66552 MiB
End job on node92 at 2009-04-03 13:38:19