Trace number 3292643

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Black Hole SAT 2011-03-08? (TO) 1300.01 1300.06

General information on the benchmark

NameSAT05/industrial/narain05/vpn/
clauses-8.renamed-as.sat05-1964.cnf
MD5SUM83c1fe52702413077bb84179a04b277a
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark141.907
Satisfiable
(Un)Satisfiability was proved
Number of variables1461771
Number of clauses5687554
Sum of the clauses size14147618
Maximum clause length601
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 24325673
Number of clauses of size 3961281
Number of clauses of size 411051
Number of clauses of size 5354960
Number of clauses of size over 534588

Solver Data 

14.59/14.64	c RESTART
24.99/25.09	c RESTART
34.69/34.72	c RESTART
70.79/70.80	c RESTART
76.79/76.86	c RESTART
96.48/96.53	c RESTART
100.28/100.38	c RESTART
103.18/103.21	c RESTART
114.39/114.45	c RESTART
116.69/116.71	c RESTART
127.48/127.58	c RESTART
133.19/133.29	c RESTART
149.38/149.47	c RESTART
167.19/167.21	c RESTART
181.18/181.28	c RESTART
182.08/182.12	c RESTART
182.98/183.02	c RESTART
265.48/265.57	c RESTART
266.48/266.56	c RESTART
270.78/270.89	c RESTART
270.98/271.07	c RESTART
282.58/282.65	c RESTART
312.88/312.90	c RESTART
781.67/781.70	c RESTART
806.07/806.18	c RESTART
848.37/848.43	c RESTART
861.96/862.03	c RESTART
893.76/893.86	c RESTART

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3292643-1303796901/watcher-3292643-1303796901 -o /tmp/evaluation-result-3292643-1303796901/solver-3292643-1303796901 -C 2400 -W 1300 -M 7680 saturn HOME/instance-3292643-1303796901.cnf 

running on 2 cores: 5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 7864320 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 7915520 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.50 3.85 3.52 4/189 5818
/proc/meminfo: memFree=18495052/32950940 swapFree=67111528/67111528
[pid=5818] ppid=5816 vsize=177528 CPUtime=0 cores=5,7
/proc/5818/stat : 5818 (saturn) R 5816 5818 4768 0 -1 4202496 3737 0 0 0 0 0 0 0 23 0 1 0 569921291 181788672 3679 33554432000 4194304 4210924 140733639886128 18446744073709551615 215988286557 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/5818/statm: 44382 3691 81 5 0 14305 0

[startup+0.104313 s]
/proc/loadavg: 3.50 3.85 3.52 4/189 5818
/proc/meminfo: memFree=18495052/32950940 swapFree=67111528/67111528
[pid=5818] ppid=5816 vsize=303156 CPUtime=0.09 cores=5,7
/proc/5818/stat : 5818 (saturn) R 5816 5818 4768 0 -1 4202496 45483 0 0 0 5 4 0 0 24 0 1 0 569921291 310431744 45425 33554432000 4194304 4210924 140733639886128 18446744073709551615 4206826 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/5818/statm: 75789 45442 95 5 0 45712 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 303156

[startup+0.200293 s]
/proc/loadavg: 3.50 3.85 3.52 4/189 5818
/proc/meminfo: memFree=18495052/32950940 swapFree=67111528/67111528
[pid=5818] ppid=5816 vsize=671872 CPUtime=0.19 cores=5,7
/proc/5818/stat : 5818 (saturn) R 5816 5818 4768 0 -1 4202496 52856 0 0 0 14 5 0 0 24 0 1 0 569921291 687996928 52798 33554432000 4194304 4210924 140733639886128 18446744073709551615 215988253381 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/5818/statm: 167968 52799 864 5 0 137891 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 671872

[startup+0.300275 s]
/proc/loadavg: 3.50 3.85 3.52 4/189 5818
/proc/meminfo: memFree=18495052/32950940 swapFree=67111528/67111528
[pid=5818] ppid=5816 vsize=689956 CPUtime=0.29 cores=5,7
/proc/5818/stat : 5818 (saturn) R 5816 5818 4768 0 -1 4202496 60063 0 0 0 23 6 0 0 25 0 1 0 569921291 706514944 60005 33554432000 4194304 4210924 140733639886128 18446744073709551615 4203330 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/5818/statm: 172489 60008 1693 5 0 142412 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 689956

[startup+0.700206 s]
/proc/loadavg: 3.50 3.85 3.52 4/189 5818
/proc/meminfo: memFree=18495052/32950940 swapFree=67111528/67111528
[pid=5818] ppid=5816 vsize=759520 CPUtime=0.69 cores=5,7
/proc/5818/stat : 5818 (saturn) R 5816 5818 4768 0 -1 4202496 88185 0 0 0 60 9 0 0 25 0 1 0 569921291 777748480 88127 33554432000 4194304 4210924 140733639886128 18446744073709551615 4197908 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/5818/statm: 189880 88128 5241 5 0 159803 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 759520

[startup+1.50106 s]
/proc/loadavg: 3.50 3.85 3.52 5/190 5819
/proc/meminfo: memFree=18066508/32950940 swapFree=67111528/67111528
[pid=5818] ppid=5816 vsize=895876 CPUtime=1.49 cores=5,7
/proc/5818/stat : 5818 (saturn) R 5816 5818 4768 0 -1 4202496 143139 0 0 0 134 15 0 0 25 0 1 0 569921291 917377024 143081 33554432000 4194304 4210924 140733639886128 18446744073709551615 4197908 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/5818/statm: 223969 143082 12272 5 0 193892 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 895876

[startup+3.10078 s]
/proc/loadavg: 3.50 3.85 3.52 5/190 5819
/proc/meminfo: memFree=17806528/32950940 swapFree=67111528/67111528
[pid=5818] ppid=5816 vsize=1158028 CPUtime=3.09 cores=5,7
/proc/5818/stat : 5818 (saturn) R 5816 5818 4768 0 -1 4202496 249468 0 0 0 282 27 0 0 25 0 1 0 569921291 1185820672 249410 33554432000 4194304 4210924 140733639886128 18446744073709551615 215988253381 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/5818/statm: 289507 249411 26343 5 0 259430 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 1158028

[startup+6.30023 s]
/proc/loadavg: 3.54 3.86 3.53 5/190 5819
/proc/meminfo: memFree=17522612/32950940 swapFree=67111528/67111528
[pid=5818] ppid=5816 vsize=1084492 CPUtime=6.29 cores=5,7
/proc/5818/stat : 5818 (saturn) R 5816 5818 4768 0 -1 4202496 274967 0 0 0 599 30 0 0 25 0 1 0 569921291 1110519808 243506 33554432000 4194304 4210924 140733639886128 18446744073709551615 4199385 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/5818/statm: 271123 243506 97 5 0 269594 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 1084492

[startup+12.7011 s]
/proc/loadavg: 3.58 3.86 3.53 5/190 5819
/proc/meminfo: memFree=17520892/32950940 swapFree=67111528/67111528
[pid=5818] ppid=5816 vsize=1084756 CPUtime=12.69 cores=5,7
/proc/5818/stat : 5818 (saturn) R 5816 5818 4768 0 -1 4202496 275080 0 0 0 1239 30 0 0 25 0 1 0 569921291 1110790144 243619 33554432000 4194304 4210924 140733639886128 18446744073709551615 4206988 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/5818/statm: 271189 243619 97 5 0 269660 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 1084756

[startup+25.5009 s]
/proc/loadavg: 3.67 3.86 3.54 5/190 5819
/proc/meminfo: memFree=17520344/32950940 swapFree=67111528/67111528
[pid=5818] ppid=5816 vsize=1084888 CPUtime=25.49 cores=5,7
/proc/5818/stat : 5818 (saturn) R 5816 5818 4768 0 -1 4202496 275109 0 0 0 2519 30 0 0 25 0 1 0 569921291 1110925312 243648 33554432000 4194304 4210924 140733639886128 18446744073709551615 4206192 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/5818/statm: 271222 243648 103 5 0 269693 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 1084888

[startup+51.1004 s]
/proc/loadavg: 3.78 3.87 3.55 5/190 5820
/proc/meminfo: memFree=17518412/32950940 swapFree=67111528/67111528
[pid=5818] ppid=5816 vsize=1085416 CPUtime=51.09 cores=5,7
/proc/5818/stat : 5818 (saturn) R 5816 5818 4768 0 -1 4202496 275270 0 0 0 5079 30 0 0 25 0 1 0 569921291 1111465984 243809 33554432000 4194304 4210924 140733639886128 18446744073709551615 4207018 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/5818/statm: 271354 243809 103 5 0 269825 0
Current children cumulated CPU time (s) 51.09
Current children cumulated vsize (KiB) 1085416

[startup+102.3 s]
/proc/loadavg: 3.96 3.91 3.57 5/190 5821
/proc/meminfo: memFree=17515416/32950940 swapFree=67111528/67111528
[pid=5818] ppid=5816 vsize=1085548 CPUtime=102.29 cores=5,7
/proc/5818/stat : 5818 (saturn) R 5816 5818 4768 0 -1 4202496 275300 0 0 0 10199 30 0 0 25 0 1 0 569921291 1111601152 243839 33554432000 4194304 4210924 140733639886128 18446744073709551615 4206981 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/5818/statm: 271387 243839 103 5 0 269858 0
Current children cumulated CPU time (s) 102.29
Current children cumulated vsize (KiB) 1085548

[startup+162.301 s]
/proc/loadavg: 4.03 3.94 3.60 5/190 5849
/proc/meminfo: memFree=17367764/32950940 swapFree=67111528/67111528
[pid=5818] ppid=5816 vsize=1085680 CPUtime=162.28 cores=5,7
/proc/5818/stat : 5818 (saturn) R 5816 5818 4768 0 -1 4202496 275336 0 0 0 16198 30 0 0 25 0 1 0 569921291 1111736320 243875 33554432000 4194304 4210924 140733639886128 18446744073709551615 4204590 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/5818/statm: 271420 243875 103 5 0 269891 0
Current children cumulated CPU time (s) 162.28
Current children cumulated vsize (KiB) 1085680

[startup+222.306 s]
/proc/loadavg: 4.01 3.95 3.62 5/190 5851
/proc/meminfo: memFree=17347760/32950940 swapFree=67111528/67111528
[pid=5818] ppid=5816 vsize=1086076 CPUtime=222.28 cores=5,7
/proc/5818/stat : 5818 (saturn) R 5816 5818 4768 0 -1 4202496 275420 0 0 0 22198 30 0 0 25 0 1 0 569921291 1112141824 243959 33554432000 4194304 4210924 140733639886128 18446744073709551615 4198608 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/5818/statm: 271519 243959 103 5 0 269990 0
Current children cumulated CPU time (s) 222.28
Current children cumulated vsize (KiB) 1086076

[startup+282.301 s]
/proc/loadavg: 4.00 3.95 3.65 5/190 5852
/proc/meminfo: memFree=17324708/32950940 swapFree=67111528/67111528
[pid=5818] ppid=5816 vsize=1087004 CPUtime=282.28 cores=5,7
/proc/5818/stat : 5818 (saturn) R 5816 5818 4768 0 -1 4202496 275639 0 0 0 28198 30 0 0 25 0 1 0 569921291 1113092096 244178 33554432000 4194304 4210924 140733639886128 18446744073709551615 4204590 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/5818/statm: 271751 244178 103 5 0 270222 0
Current children cumulated CPU time (s) 282.28
Current children cumulated vsize (KiB) 1087004

[startup+342.3 s]
/proc/loadavg: 4.00 3.96 3.66 5/190 5854
/proc/meminfo: memFree=17314816/32950940 swapFree=67111528/67111528
[pid=5818] ppid=5816 vsize=1087268 CPUtime=342.28 cores=5,7
/proc/5818/stat : 5818 (saturn) R 5816 5818 4768 0 -1 4202496 275731 0 0 0 34197 31 0 0 25 0 1 0 569921291 1113362432 244270 33554432000 4194304 4210924 140733639886128 18446744073709551615 4205025 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/5818/statm: 271817 244270 103 5 0 270288 0
Current children cumulated CPU time (s) 342.28
Current children cumulated vsize (KiB) 1087268

[startup+402.301 s]
/proc/loadavg: 4.06 3.98 3.69 5/190 5855
/proc/meminfo: memFree=17295620/32950940 swapFree=67111528/67111528
[pid=5818] ppid=5816 vsize=1087268 CPUtime=402.28 cores=5,7
/proc/5818/stat : 5818 (saturn) R 5816 5818 4768 0 -1 4202496 275731 0 0 0 40197 31 0 0 25 0 1 0 569921291 1113362432 244270 33554432000 4194304 4210924 140733639886128 18446744073709551615 4204579 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/5818/statm: 271817 244270 103 5 0 270288 0
Current children cumulated CPU time (s) 402.28
Current children cumulated vsize (KiB) 1087268

[startup+462.3 s]
/proc/loadavg: 4.05 3.99 3.71 5/190 5857
/proc/meminfo: memFree=17282396/32950940 swapFree=67111528/67111528
[pid=5818] ppid=5816 vsize=1087268 CPUtime=462.28 cores=5,7
/proc/5818/stat : 5818 (saturn) R 5816 5818 4768 0 -1 4202496 275731 0 0 0 46197 31 0 0 25 0 1 0 569921291 1113362432 244270 33554432000 4194304 4210924 140733639886128 18446744073709551615 4204579 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/5818/statm: 271817 244270 103 5 0 270288 0
Current children cumulated CPU time (s) 462.28
Current children cumulated vsize (KiB) 1087268

[startup+522.301 s]
/proc/loadavg: 4.02 3.99 3.73 5/190 5858
/proc/meminfo: memFree=17270128/32950940 swapFree=67111528/67111528
[pid=5818] ppid=5816 vsize=1087268 CPUtime=522.27 cores=5,7
/proc/5818/stat : 5818 (saturn) R 5816 5818 4768 0 -1 4202496 275731 0 0 0 52196 31 0 0 25 0 1 0 569921291 1113362432 244270 33554432000 4194304 4210924 140733639886128 18446744073709551615 4198737 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/5818/statm: 271817 244270 103 5 0 270288 0
Current children cumulated CPU time (s) 522.27
Current children cumulated vsize (KiB) 1087268

[startup+582.3 s]
/proc/loadavg: 4.00 3.99 3.74 5/190 5860
/proc/meminfo: memFree=17253160/32950940 swapFree=67111528/67111528
[pid=5818] ppid=5816 vsize=1087268 CPUtime=582.27 cores=5,7
/proc/5818/stat : 5818 (saturn) R 5816 5818 4768 0 -1 4202496 275731 0 0 0 58196 31 0 0 25 0 1 0 569921291 1113362432 244270 33554432000 4194304 4210924 140733639886128 18446744073709551615 4204590 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/5818/statm: 271817 244270 103 5 0 270288 0
Current children cumulated CPU time (s) 582.27
Current children cumulated vsize (KiB) 1087268

[startup+642.301 s]
/proc/loadavg: 4.00 3.99 3.75 5/190 5862
/proc/meminfo: memFree=17240832/32950940 swapFree=67111528/67111528
[pid=5818] ppid=5816 vsize=1087268 CPUtime=642.27 cores=5,7
/proc/5818/stat : 5818 (saturn) R 5816 5818 4768 0 -1 4202496 275731 0 0 0 64196 31 0 0 25 0 1 0 569921291 1113362432 244270 33554432000 4194304 4210924 140733639886128 18446744073709551615 4207018 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/5818/statm: 271817 244270 103 5 0 270288 0
Current children cumulated CPU time (s) 642.27
Current children cumulated vsize (KiB) 1087268

[startup+702.3 s]
/proc/loadavg: 4.00 3.99 3.76 5/190 5863
/proc/meminfo: memFree=17231692/32950940 swapFree=67111528/67111528
[pid=5818] ppid=5816 vsize=1087268 CPUtime=702.27 cores=5,7
/proc/5818/stat : 5818 (saturn) R 5816 5818 4768 0 -1 4202496 275731 0 0 0 70196 31 0 0 25 0 1 0 569921291 1113362432 244270 33554432000 4194304 4210924 140733639886128 18446744073709551615 4197169 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/5818/statm: 271817 244270 103 5 0 270288 0
Current children cumulated CPU time (s) 702.27
Current children cumulated vsize (KiB) 1087268

[startup+762.301 s]
/proc/loadavg: 4.00 3.99 3.77 5/190 5874
/proc/meminfo: memFree=17218868/32950940 swapFree=67111528/67111528
[pid=5818] ppid=5816 vsize=1087268 CPUtime=762.27 cores=5,7
/proc/5818/stat : 5818 (saturn) R 5816 5818 4768 0 -1 4202496 275731 0 0 0 76196 31 0 0 25 0 1 0 569921291 1113362432 244270 33554432000 4194304 4210924 140733639886128 18446744073709551615 4198663 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/5818/statm: 271817 244270 103 5 0 270288 0
Current children cumulated CPU time (s) 762.27
Current children cumulated vsize (KiB) 1087268

[startup+822.3 s]
/proc/loadavg: 4.00 3.99 3.79 5/190 5875
/proc/meminfo: memFree=17215880/32950940 swapFree=67111528/67111528
[pid=5818] ppid=5816 vsize=1087268 CPUtime=822.27 cores=5,7
/proc/5818/stat : 5818 (saturn) R 5816 5818 4768 0 -1 4202496 275731 0 0 0 82196 31 0 0 25 0 1 0 569921291 1113362432 244270 33554432000 4194304 4210924 140733639886128 18446744073709551615 4204579 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/5818/statm: 271817 244270 103 5 0 270288 0
Current children cumulated CPU time (s) 822.27
Current children cumulated vsize (KiB) 1087268

[startup+882.307 s]
/proc/loadavg: 4.00 3.99 3.80 5/190 5877
/proc/meminfo: memFree=17200444/32950940 swapFree=67111528/67111528
[pid=5818] ppid=5816 vsize=1088072 CPUtime=882.27 cores=5,7
/proc/5818/stat : 5818 (saturn) R 5816 5818 4768 0 -1 4202496 275926 0 0 0 88196 31 0 0 25 0 1 0 569921291 1114185728 244465 33554432000 4194304 4210924 140733639886128 18446744073709551615 4206988 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/5818/statm: 272018 244465 103 5 0 270489 0
Current children cumulated CPU time (s) 882.27
Current children cumulated vsize (KiB) 1088072

[startup+942.3 s]
/proc/loadavg: 4.00 3.99 3.81 5/190 5879
/proc/meminfo: memFree=17186176/32950940 swapFree=67111528/67111528
[pid=5818] ppid=5816 vsize=1088340 CPUtime=942.26 cores=5,7
/proc/5818/stat : 5818 (saturn) R 5816 5818 4768 0 -1 4202496 275993 0 0 0 94195 31 0 0 25 0 1 0 569921291 1114460160 244532 33554432000 4194304 4210924 140733639886128 18446744073709551615 4206991 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/5818/statm: 272085 244532 103 5 0 270556 0
Current children cumulated CPU time (s) 942.26
Current children cumulated vsize (KiB) 1088340

[startup+1002.3 s]
/proc/loadavg: 4.04 4.01 3.82 5/190 5880
/proc/meminfo: memFree=17176972/32950940 swapFree=67111528/67111528
[pid=5818] ppid=5816 vsize=1088476 CPUtime=1002.26 cores=5,7
/proc/5818/stat : 5818 (saturn) R 5816 5818 4768 0 -1 4202496 276024 0 0 0 100195 31 0 0 25 0 1 0 569921291 1114599424 244563 33554432000 4194304 4210924 140733639886128 18446744073709551615 4206991 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/5818/statm: 272119 244563 103 5 0 270590 0
Current children cumulated CPU time (s) 1002.26
Current children cumulated vsize (KiB) 1088476

[startup+1062.3 s]
/proc/loadavg: 4.01 4.00 3.83 5/190 5882
/proc/meminfo: memFree=17164928/32950940 swapFree=67111528/67111528
[pid=5818] ppid=5816 vsize=1088476 CPUtime=1062.25 cores=5,7
/proc/5818/stat : 5818 (saturn) R 5816 5818 4768 0 -1 4202496 276026 0 0 0 106194 31 0 0 25 0 1 0 569921291 1114599424 244565 33554432000 4194304 4210924 140733639886128 18446744073709551615 4204579 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/5818/statm: 272119 244565 103 5 0 270590 0
Current children cumulated CPU time (s) 1062.25
Current children cumulated vsize (KiB) 1088476

[startup+1122.3 s]
/proc/loadavg: 4.00 4.00 3.83 5/190 5883
/proc/meminfo: memFree=17153616/32950940 swapFree=67111528/67111528
[pid=5818] ppid=5816 vsize=1088476 CPUtime=1122.25 cores=5,7
/proc/5818/stat : 5818 (saturn) R 5816 5818 4768 0 -1 4202496 276026 0 0 0 112194 31 0 0 25 0 1 0 569921291 1114599424 244565 33554432000 4194304 4210924 140733639886128 18446744073709551615 4206988 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/5818/statm: 272119 244565 103 5 0 270590 0
Current children cumulated CPU time (s) 1122.25
Current children cumulated vsize (KiB) 1088476

[startup+1182.3 s]
/proc/loadavg: 4.10 4.03 3.85 5/190 5885
/proc/meminfo: memFree=17142432/32950940 swapFree=67111528/67111528
[pid=5818] ppid=5816 vsize=1088476 CPUtime=1182.25 cores=5,7
/proc/5818/stat : 5818 (saturn) R 5816 5818 4768 0 -1 4202496 276026 0 0 0 118194 31 0 0 25 0 1 0 569921291 1114599424 244565 33554432000 4194304 4210924 140733639886128 18446744073709551615 4204590 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/5818/statm: 272119 244565 103 5 0 270590 0
Current children cumulated CPU time (s) 1182.25
Current children cumulated vsize (KiB) 1088476

[startup+1242.3 s]
/proc/loadavg: 4.04 4.02 3.86 5/190 5887
/proc/meminfo: memFree=17129388/32950940 swapFree=67111528/67111528
[pid=5818] ppid=5816 vsize=1088476 CPUtime=1242.25 cores=5,7
/proc/5818/stat : 5818 (saturn) R 5816 5818 4768 0 -1 4202496 276026 0 0 0 124194 31 0 0 25 0 1 0 569921291 1114599424 244565 33554432000 4194304 4210924 140733639886128 18446744073709551615 4204590 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/5818/statm: 272119 244565 103 5 0 270590 0
Current children cumulated CPU time (s) 1242.25
Current children cumulated vsize (KiB) 1088476



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 3.85 3.98 3.85 3/180 5924
/proc/meminfo: memFree=17167716/32950940 swapFree=67111528/67111528
[pid=5818] ppid=5816 vsize=1088476 CPUtime=1299.95 cores=5,7
/proc/5818/stat : 5818 (saturn) R 5816 5818 4768 0 -1 4202496 276026 0 0 0 129964 31 0 0 25 0 1 0 569921291 1114599424 244565 33554432000 4194304 4210924 140733639886128 18446744073709551615 4204579 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/5818/statm: 272119 244565 103 5 0 270590 0
Current children cumulated CPU time (s) 1299.95
Current children cumulated vsize (KiB) 1088476

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1300 s]
/proc/loadavg: 3.85 3.98 3.85 3/180 5924
/proc/meminfo: memFree=17167716/32950940 swapFree=67111528/67111528
[pid=5818] ppid=5816 vsize=1088476 CPUtime=1299.95 cores=5,7
/proc/5818/stat : 5818 (saturn) R 5816 5818 4768 0 -1 4202496 276026 0 0 0 129964 31 0 0 25 0 1 0 569921291 1114599424 244565 33554432000 4194304 4210924 140733639886128 18446744073709551615 4204579 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/5818/statm: 272119 244565 103 5 0 270590 0
Current children cumulated CPU time (s) 1299.95
Current children cumulated vsize (KiB) 1088476

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1300.06
CPU time (s): 1300.01
CPU user time (s): 1299.65
CPU system time (s): 0.362944
CPU usage (%): 99.9963
Max. virtual memory (cumulated for all children) (KiB): 1190632

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1299.65
system time used= 0.362944
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 276026
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 4
involuntary context switches= 2138

runsolver used 2.06768 second user time and 5.03123 second system time

The end

Launcher Data 

Begin job on node117 at 2011-04-26 07:48:25
IDJOB=3292643
IDBENCH=86133
IDSOLVER=1583
FILE ID=node117/3292643-1303796901
RUNJOBID= node117-1303796901-5670
PBS_JOBID= 13157263
Free space on /tmp= 71836 MiB

SOLVER NAME= Black Hole SAT 2011-03-08
BENCH NAME= SAT05/industrial/narain05/vpn/clauses-8.renamed-as.sat05-1964.cnf
COMMAND LINE= saturn BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3292643-1303796901/watcher-3292643-1303796901 -o /tmp/evaluation-result-3292643-1303796901/solver-3292643-1303796901 -C 2400 -W 1300 -M 7680  saturn HOME/instance-3292643-1303796901.cnf

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 7680 MiB
NBCORE= 2

MD5SUM BENCH= 83c1fe52702413077bb84179a04b277a
RANDOM SEED=52428037

node117.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5267.44
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950940 kB
MemFree:      18495208 kB
Buffers:       2335436 kB
Cached:       11450652 kB
SwapCached:          0 kB
Active:        6817800 kB
Inactive:      7068660 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950940 kB
LowFree:      18495208 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:          118080 kB
Writeback:           0 kB
AnonPages:       99516 kB
Mapped:          15208 kB
Slab:           504740 kB
PageTables:       5324 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586996 kB
Committed_AS:   287100 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71832 MiB
End job on node117 at 2011-04-26 08:10:07