Trace number 3159546

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
synit_sat 2011-03-03? (TO) 1300.02 1300.04

General information on the benchmark

Namerandom/large/
unif-k3-r4.2-v25000-c105000-S5267991-057-UNKNOWN.cnf
MD5SUM1a8d3d5d5a6ad4a4b0bb6bd83ad87f53
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark312.282
Satisfiable
(Un)Satisfiability was proved
Number of variables25000
Number of clauses105000
Sum of the clauses size315000
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 3105000
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.00/0.01	c start  0 total 0
0.10/0.12	c Find Units :          0
0.10/0.12	c Find Invs  :          0
0.10/0.13	c Find Ands  :          0 AvgFaninNum: nan
0.10/0.13	c Find Xors  :          0 AvgFaninNum: nan
0.10/0.15	c Find Ite   :          0
0.10/0.19	c UnDirect variable: 0
0.10/0.19	c UnDirect to Direct Gate: 0
0.10/0.19	c Forced Direct Gate: 0 Unuse unDirect Gate: 0
0.10/0.19	c Break Cycle : 0
0.10/0.19	c Total Root : 0 Undef Var: 25000
0.10/0.19	c After covering, Total Root: 0 Leaf: 0
0.10/0.19	c Variable( cover/uncovered/unused ): 0 25000 0
0.10/0.19	c Unit Clauses: 0
0.10/0.19	c Binary Clauses( cover/uncovered ): 0 0
0.10/0.19	c Clauses( cover/uncovered ): 0 105000
0.10/0.19	c Total Clauses( cover/uncovered ): 0 105000 0%
0.10/0.19	c Covered Ands: 0 Invs: 0 Xors: 0 Ites: 0
0.19/0.28	c Uncover Clauses avg size: 3 max size: 3
0.19/0.28	c Final circuit: i/l/o/s   25000       0  105000    209994
0.19/0.28	c cover rate 0
0.19/0.28	c rocky end  0.27 total 0.27
0.49/0.51	c covering time  0.23 total 0.5
1299.98/1300.00	c interrupt  1299.48 total 1299.98
1299.98/1300.00	c INTERRUPTED ... 
1299.98/1300.00	s UNKNOWN

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 893)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3159546-1301733067/watcher-3159546-1301733067 -o /tmp/evaluation-result-3159546-1301733067/solver-3159546-1301733067 -C 2400 -W 1300 -M 7680 HOME/synit_sat HOME/instance-3159546-1301733067.cnf 1809242656 

running on 2 cores: 1,3

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 7864320 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 7915520 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.03 0.03 0.00 1/178 11561
/proc/meminfo: memFree=22583076/32951124 swapFree=67111528/67111528
[pid=11561] ppid=11559 vsize=31708 CPUtime=0 cores=1,3
/proc/11561/stat : 11561 (synit_sat) R 11559 11561 11531 0 -1 4202496 2783 0 0 0 0 0 0 0 21 0 1 0 284904617 32468992 2717 33554432000 4194304 4947581 140736839958784 18446744073709551615 4283938 0 0 4096 24578 0 0 0 17 1 0 0 0
/proc/11561/statm: 7927 2718 376 184 0 2802 0

[startup+0.104633 s]
/proc/loadavg: 0.03 0.03 0.00 1/178 11561
/proc/meminfo: memFree=22583076/32951124 swapFree=67111528/67111528
[pid=11561] ppid=11559 vsize=58460 CPUtime=0.1 cores=1,3
/proc/11561/stat : 11561 (synit_sat) R 11559 11561 11531 0 -1 4202496 9304 0 0 0 9 1 0 0 21 0 1 0 284904617 59863040 9238 33554432000 4194304 4947581 140736839958784 18446744073709551615 4814748 0 0 4096 24578 0 0 0 17 1 0 0 0
/proc/11561/statm: 14615 9238 376 184 0 9490 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 58460

[startup+0.20057 s]
/proc/loadavg: 0.03 0.03 0.00 1/178 11561
/proc/meminfo: memFree=22583076/32951124 swapFree=67111528/67111528
[pid=11561] ppid=11559 vsize=58456 CPUtime=0.19 cores=1,3
/proc/11561/stat : 11561 (synit_sat) R 11559 11561 11531 0 -1 4202496 9525 0 0 0 18 1 0 0 22 0 1 0 284904617 59858944 9459 33554432000 4194304 4947581 140736839958784 18446744073709551615 4800068 0 0 4096 24578 0 0 0 17 1 0 0 0
/proc/11561/statm: 14614 9459 384 184 0 9489 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 58456

[startup+0.300592 s]
/proc/loadavg: 0.03 0.03 0.00 1/178 11561
/proc/meminfo: memFree=22583076/32951124 swapFree=67111528/67111528
[pid=11561] ppid=11559 vsize=70744 CPUtime=0.29 cores=1,3
/proc/11561/stat : 11561 (synit_sat) R 11559 11561 11531 0 -1 4202496 12599 0 0 0 28 1 0 0 22 0 1 0 284904617 72441856 12533 33554432000 4194304 4947581 140736839958784 18446744073709551615 4225327 0 0 4096 24578 0 0 0 17 1 0 0 0
/proc/11561/statm: 17686 12533 386 184 0 12561 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 70744

[startup+0.700518 s]
/proc/loadavg: 0.03 0.03 0.00 1/178 11561
/proc/meminfo: memFree=22583076/32951124 swapFree=67111528/67111528
[pid=11561] ppid=11559 vsize=148316 CPUtime=0.69 cores=1,3
/proc/11561/stat : 11561 (synit_sat) R 11559 11561 11531 0 -1 4202496 30163 0 0 0 66 3 0 0 24 0 1 0 284904617 151875584 30079 33554432000 4194304 4947581 140736839958784 18446744073709551615 271550231488 0 0 4096 24578 0 0 0 17 1 0 0 0
/proc/11561/statm: 37079 30079 433 184 0 31954 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 148316

[startup+1.50037 s]
/proc/loadavg: 0.19 0.06 0.01 4/189 11582
/proc/meminfo: memFree=22329532/32951124 swapFree=67111528/67111528
[pid=11561] ppid=11559 vsize=164112 CPUtime=1.49 cores=1,3
/proc/11561/stat : 11561 (synit_sat) R 11559 11561 11531 0 -1 4202496 34491 0 0 0 145 4 0 0 25 0 1 0 284904617 168050688 34407 33554432000 4194304 4947581 140736839958784 18446744073709551615 4399401 0 0 4096 24578 0 0 0 17 1 0 0 0
/proc/11561/statm: 41028 34407 455 184 0 35903 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 164112

[startup+3.10109 s]
/proc/loadavg: 0.19 0.06 0.01 4/189 11583
/proc/meminfo: memFree=22314972/32951124 swapFree=67111528/67111528
[pid=11561] ppid=11559 vsize=196928 CPUtime=3.09 cores=1,3
/proc/11561/stat : 11561 (synit_sat) R 11559 11561 11531 0 -1 4202496 35680 0 0 0 305 4 0 0 25 0 1 0 284904617 201654272 35596 33554432000 4194304 4947581 140736839958784 18446744073709551615 271550234379 0 0 4096 24578 0 0 0 17 1 0 0 0
/proc/11561/statm: 49232 35596 455 184 0 44107 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 196928

[startup+6.3005 s]
/proc/loadavg: 0.49 0.13 0.03 5/194 11593
/proc/meminfo: memFree=22146176/32951124 swapFree=67111528/67111528
[pid=11561] ppid=11559 vsize=196928 CPUtime=6.29 cores=1,3
/proc/11561/stat : 11561 (synit_sat) R 11559 11561 11531 0 -1 4202496 38433 0 0 0 625 4 0 0 25 0 1 0 284904617 201654272 38349 33554432000 4194304 4947581 140736839958784 18446744073709551615 4399720 0 0 4096 24578 0 0 0 17 1 0 0 0
/proc/11561/statm: 49232 38349 455 184 0 44107 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 196928

[startup+12.7003 s]
/proc/loadavg: 0.77 0.19 0.05 5/194 11593
/proc/meminfo: memFree=21979544/32951124 swapFree=67111528/67111528
[pid=11561] ppid=11559 vsize=298924 CPUtime=12.69 cores=1,3
/proc/11561/stat : 11561 (synit_sat) R 11559 11561 11531 0 -1 4202496 56505 0 0 0 1263 6 0 0 25 0 1 0 284904617 306098176 56421 33554432000 4194304 4947581 140736839958784 18446744073709551615 4399340 0 0 4096 24578 0 0 0 17 1 0 0 0
/proc/11561/statm: 74731 56421 465 184 0 69606 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 298924

[startup+25.501 s]
/proc/loadavg: 1.49 0.38 0.12 5/194 11593
/proc/meminfo: memFree=21824844/32951124 swapFree=67111528/67111528
[pid=11561] ppid=11559 vsize=328516 CPUtime=25.49 cores=1,3
/proc/11561/stat : 11561 (synit_sat) R 11559 11561 11531 0 -1 4202496 65586 0 0 0 2541 8 0 0 25 0 1 0 284904617 336400384 65502 33554432000 4194304 4947581 140736839958784 18446744073709551615 4399793 0 0 4096 24578 0 0 0 17 1 0 0 0
/proc/11561/statm: 82129 65502 465 184 0 77004 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 328516

[startup+51.1003 s]
/proc/loadavg: 2.34 0.67 0.22 5/194 11594
/proc/meminfo: memFree=21661816/32951124 swapFree=67111528/67111528
[pid=11561] ppid=11559 vsize=399648 CPUtime=51.09 cores=1,3
/proc/11561/stat : 11561 (synit_sat) R 11559 11561 11531 0 -1 4202496 82830 0 0 0 5099 10 0 0 25 0 1 0 284904617 409239552 82746 33554432000 4194304 4947581 140736839958784 18446744073709551615 4400176 0 0 4096 24578 0 0 0 17 1 0 0 0
/proc/11561/statm: 99912 82746 465 184 0 94787 0
Current children cumulated CPU time (s) 51.09
Current children cumulated vsize (KiB) 399648

[startup+102.301 s]
/proc/loadavg: 3.28 1.18 0.41 5/194 11595
/proc/meminfo: memFree=21512864/32951124 swapFree=67111528/67111528
[pid=11561] ppid=11559 vsize=454628 CPUtime=102.3 cores=1,3
/proc/11561/stat : 11561 (synit_sat) R 11559 11561 11531 0 -1 4202496 97526 0 0 0 10217 13 0 0 25 0 1 0 284904617 465539072 97442 33554432000 4194304 4947581 140736839958784 18446744073709551615 4398560 0 0 4096 24578 0 0 0 17 1 0 0 0
/proc/11561/statm: 113657 97442 465 184 0 108532 0
Current children cumulated CPU time (s) 102.3
Current children cumulated vsize (KiB) 454628

[startup+162.301 s]
/proc/loadavg: 3.73 1.69 0.64 5/194 11597
/proc/meminfo: memFree=21374448/32951124 swapFree=67111528/67111528
[pid=11561] ppid=11559 vsize=468428 CPUtime=162.28 cores=1,3
/proc/11561/stat : 11561 (synit_sat) R 11559 11561 11531 0 -1 4202496 100930 0 0 0 16215 13 0 0 25 0 1 0 284904617 479670272 100846 33554432000 4194304 4947581 140736839958784 18446744073709551615 4399717 0 0 4096 24578 0 0 0 17 1 0 0 0
/proc/11561/statm: 117107 100846 465 184 0 111982 0
Current children cumulated CPU time (s) 162.28
Current children cumulated vsize (KiB) 468428

[startup+222.307 s]
/proc/loadavg: 3.99 2.14 0.85 5/194 11598
/proc/meminfo: memFree=21213972/32951124 swapFree=67111528/67111528
[pid=11561] ppid=11559 vsize=579700 CPUtime=222.3 cores=1,3
/proc/11561/stat : 11561 (synit_sat) R 11559 11561 11531 0 -1 4202496 117482 0 0 0 22212 18 0 0 25 0 1 0 284904617 593612800 117398 33554432000 4194304 4947581 140736839958784 18446744073709551615 4352055 0 0 4096 24578 0 0 0 17 1 0 0 0
/proc/11561/statm: 144925 117398 465 184 0 139800 0
Current children cumulated CPU time (s) 222.3
Current children cumulated vsize (KiB) 579700

[startup+282.3 s]
/proc/loadavg: 4.12 2.50 1.06 5/194 11600
/proc/meminfo: memFree=21138788/32951124 swapFree=67111528/67111528
[pid=11561] ppid=11559 vsize=635360 CPUtime=282.29 cores=1,3
/proc/11561/stat : 11561 (synit_sat) R 11559 11561 11531 0 -1 4202496 128112 0 0 0 28209 20 0 0 25 0 1 0 284904617 650608640 128028 33554432000 4194304 4947581 140736839958784 18446744073709551615 4400304 0 0 4096 24578 0 0 0 17 1 0 0 0
/proc/11561/statm: 158840 128028 465 184 0 153715 0
Current children cumulated CPU time (s) 282.29
Current children cumulated vsize (KiB) 635360

[startup+342.3 s]
/proc/loadavg: 4.08 2.79 1.24 5/194 11601
/proc/meminfo: memFree=21116816/32951124 swapFree=67111528/67111528
[pid=11561] ppid=11559 vsize=635488 CPUtime=342.29 cores=1,3
/proc/11561/stat : 11561 (synit_sat) R 11559 11561 11531 0 -1 4202496 131700 0 0 0 34209 20 0 0 25 0 1 0 284904617 650739712 131580 33554432000 4194304 4947581 140736839958784 18446744073709551615 4399414 0 0 4096 24578 0 0 0 17 1 0 0 0
/proc/11561/statm: 158872 131580 465 184 0 153747 0
Current children cumulated CPU time (s) 342.29
Current children cumulated vsize (KiB) 635488

[startup+402.3 s]
/proc/loadavg: 4.03 3.01 1.41 5/194 11603
/proc/meminfo: memFree=21085520/32951124 swapFree=67111528/67111528
[pid=11561] ppid=11559 vsize=635488 CPUtime=402.28 cores=1,3
/proc/11561/stat : 11561 (synit_sat) R 11559 11561 11531 0 -1 4202496 131922 0 0 0 40208 20 0 0 25 0 1 0 284904617 650739712 131706 33554432000 4194304 4947581 140736839958784 18446744073709551615 4352488 0 0 4096 24578 0 0 0 17 1 0 0 0
/proc/11561/statm: 158872 131706 465 184 0 153747 0
Current children cumulated CPU time (s) 402.28
Current children cumulated vsize (KiB) 635488

[startup+462.3 s]
/proc/loadavg: 4.20 3.23 1.59 5/194 11605
/proc/meminfo: memFree=21095412/32951124 swapFree=67111528/67111528
[pid=11561] ppid=11559 vsize=692636 CPUtime=462.29 cores=1,3
/proc/11561/stat : 11561 (synit_sat) R 11559 11561 11531 0 -1 4202496 133011 0 0 0 46208 21 0 0 25 0 1 0 284904617 709259264 126069 33554432000 4194304 4947581 140736839958784 18446744073709551615 271550234379 0 0 4096 24578 0 0 0 17 1 0 0 0
/proc/11561/statm: 173159 126069 465 184 0 168034 0
Current children cumulated CPU time (s) 462.29
Current children cumulated vsize (KiB) 692636

[startup+522.3 s]
/proc/loadavg: 4.14 3.39 1.74 5/194 11606
/proc/meminfo: memFree=21054448/32951124 swapFree=67111528/67111528
[pid=11561] ppid=11559 vsize=749908 CPUtime=522.28 cores=1,3
/proc/11561/stat : 11561 (synit_sat) R 11559 11561 11531 0 -1 4202496 142239 0 0 0 52203 25 0 0 25 0 1 0 284904617 767905792 135297 33554432000 4194304 4947581 140736839958784 18446744073709551615 4399941 0 0 4096 24578 0 0 0 17 1 0 0 0
/proc/11561/statm: 187477 135297 465 184 0 182352 0
Current children cumulated CPU time (s) 522.28
Current children cumulated vsize (KiB) 749908

[startup+582.301 s]
/proc/loadavg: 4.25 3.54 1.90 5/194 11608
/proc/meminfo: memFree=21042392/32951124 swapFree=67111528/67111528
[pid=11561] ppid=11559 vsize=749908 CPUtime=582.29 cores=1,3
/proc/11561/stat : 11561 (synit_sat) R 11559 11561 11531 0 -1 4202496 142939 0 0 0 58203 26 0 0 25 0 1 0 284904617 767905792 135997 33554432000 4194304 4947581 140736839958784 18446744073709551615 4399939 0 0 4096 24578 0 0 0 17 1 0 0 0
/proc/11561/statm: 187477 135997 465 184 0 182352 0
Current children cumulated CPU time (s) 582.29
Current children cumulated vsize (KiB) 749908

[startup+642.301 s]
/proc/loadavg: 4.09 3.62 2.02 5/194 11609
/proc/meminfo: memFree=21035408/32951124 swapFree=67111528/67111528
[pid=11561] ppid=11559 vsize=749908 CPUtime=642.29 cores=1,3
/proc/11561/stat : 11561 (synit_sat) R 11559 11561 11531 0 -1 4202496 143733 0 0 0 64203 26 0 0 25 0 1 0 284904617 767905792 136791 33554432000 4194304 4947581 140736839958784 18446744073709551615 4398646 0 0 4096 24578 0 0 0 17 1 0 0 0
/proc/11561/statm: 187477 136791 465 184 0 182352 0
Current children cumulated CPU time (s) 642.29
Current children cumulated vsize (KiB) 749908

[startup+702.301 s]
/proc/loadavg: 4.22 3.74 2.16 5/194 11611
/proc/meminfo: memFree=20974376/32951124 swapFree=67111528/67111528
[pid=11561] ppid=11559 vsize=749908 CPUtime=702.29 cores=1,3
/proc/11561/stat : 11561 (synit_sat) R 11559 11561 11531 0 -1 4202496 144308 0 0 0 70202 27 0 0 25 0 1 0 284904617 767905792 137366 33554432000 4194304 4947581 140736839958784 18446744073709551615 4400060 0 0 4096 24578 0 0 0 17 1 0 0 0
/proc/11561/statm: 187477 137366 465 184 0 182352 0
Current children cumulated CPU time (s) 702.29
Current children cumulated vsize (KiB) 749908

[startup+762.301 s]
/proc/loadavg: 4.16 3.80 2.28 5/194 11613
/proc/meminfo: memFree=20909720/32951124 swapFree=67111528/67111528
[pid=11561] ppid=11559 vsize=749908 CPUtime=762.29 cores=1,3
/proc/11561/stat : 11561 (synit_sat) R 11559 11561 11531 0 -1 4202496 144833 0 0 0 76202 27 0 0 25 0 1 0 284904617 767905792 137891 33554432000 4194304 4947581 140736839958784 18446744073709551615 4399939 0 0 4096 24578 0 0 0 17 1 0 0 0
/proc/11561/statm: 187477 137891 465 184 0 182352 0
Current children cumulated CPU time (s) 762.29
Current children cumulated vsize (KiB) 749908

[startup+822.301 s]
/proc/loadavg: 4.20 3.86 2.39 5/194 11614
/proc/meminfo: memFree=20856748/32951124 swapFree=67111528/67111528
[pid=11561] ppid=11559 vsize=749908 CPUtime=822.28 cores=1,3
/proc/11561/stat : 11561 (synit_sat) R 11559 11561 11531 0 -1 4202496 145275 0 0 0 82201 27 0 0 25 0 1 0 284904617 767905792 138333 33554432000 4194304 4947581 140736839958784 18446744073709551615 4400060 0 0 4096 24578 0 0 0 17 1 0 0 0
/proc/11561/statm: 187477 138333 465 184 0 182352 0
Current children cumulated CPU time (s) 822.28
Current children cumulated vsize (KiB) 749908

[startup+882.307 s]
/proc/loadavg: 4.07 3.89 2.49 6/194 11616
/proc/meminfo: memFree=20735928/32951124 swapFree=67111528/67111528
[pid=11561] ppid=11559 vsize=810328 CPUtime=882.29 cores=1,3
/proc/11561/stat : 11561 (synit_sat) R 11559 11561 11531 0 -1 4202496 173557 0 0 0 88198 31 0 0 25 0 1 0 284904617 829775872 166615 33554432000 4194304 4947581 140736839958784 18446744073709551615 4400023 0 0 4096 24578 0 0 0 17 1 0 0 0
/proc/11561/statm: 202582 166615 465 184 0 197457 0
Current children cumulated CPU time (s) 882.29
Current children cumulated vsize (KiB) 810328

[startup+942.301 s]
/proc/loadavg: 4.10 3.92 2.59 5/194 11617
/proc/meminfo: memFree=20602108/32951124 swapFree=67111528/67111528
[pid=11561] ppid=11559 vsize=929944 CPUtime=942.28 cores=1,3
/proc/11561/stat : 11561 (synit_sat) R 11559 11561 11531 0 -1 4202496 198710 0 0 0 94191 37 0 0 25 0 1 0 284904617 952262656 191768 33554432000 4194304 4947581 140736839958784 18446744073709551615 4399418 0 0 4096 24578 0 0 0 17 1 0 0 0
/proc/11561/statm: 232486 191768 465 184 0 227361 0
Current children cumulated CPU time (s) 942.28
Current children cumulated vsize (KiB) 929944

[startup+1002.3 s]
/proc/loadavg: 4.03 3.93 2.67 5/194 11619
/proc/meminfo: memFree=20586940/32951124 swapFree=67111528/67111528
[pid=11561] ppid=11559 vsize=929944 CPUtime=1002.28 cores=1,3
/proc/11561/stat : 11561 (synit_sat) R 11559 11561 11531 0 -1 4202496 199253 0 0 0 100191 37 0 0 25 0 1 0 284904617 952262656 192311 33554432000 4194304 4947581 140736839958784 18446744073709551615 4398560 0 0 4096 24578 0 0 0 17 1 0 0 0
/proc/11561/statm: 232486 192311 465 184 0 227361 0
Current children cumulated CPU time (s) 1002.28
Current children cumulated vsize (KiB) 929944

[startup+1062.3 s]
/proc/loadavg: 4.16 3.98 2.77 5/194 11621
/proc/meminfo: memFree=20514992/32951124 swapFree=67111528/67111528
[pid=11561] ppid=11559 vsize=929944 CPUtime=1062.29 cores=1,3
/proc/11561/stat : 11561 (synit_sat) R 11559 11561 11531 0 -1 4202496 199658 0 0 0 106191 38 0 0 25 0 1 0 284904617 952262656 192716 33554432000 4194304 4947581 140736839958784 18446744073709551615 4401200 0 0 4096 24578 0 0 0 17 1 0 0 0
/proc/11561/statm: 232486 192716 465 184 0 227361 0
Current children cumulated CPU time (s) 1062.29
Current children cumulated vsize (KiB) 929944

[startup+1122.3 s]
/proc/loadavg: 4.06 3.98 2.84 5/194 11622
/proc/meminfo: memFree=20427284/32951124 swapFree=67111528/67111528
[pid=11561] ppid=11559 vsize=930072 CPUtime=1122.28 cores=1,3
/proc/11561/stat : 11561 (synit_sat) R 11559 11561 11531 0 -1 4202496 203459 0 0 0 112190 38 0 0 25 0 1 0 284904617 952393728 196517 33554432000 4194304 4947581 140736839958784 18446744073709551615 4398556 0 0 4096 24578 0 0 0 17 1 0 0 0
/proc/11561/statm: 232518 196517 465 184 0 227393 0
Current children cumulated CPU time (s) 1122.28
Current children cumulated vsize (KiB) 930072

[startup+1182.3 s]
/proc/loadavg: 4.09 3.99 2.92 5/194 11624
/proc/meminfo: memFree=20407792/32951124 swapFree=67111528/67111528
[pid=11561] ppid=11559 vsize=1174020 CPUtime=1182.28 cores=1,3
/proc/11561/stat : 11561 (synit_sat) R 11559 11561 11531 0 -1 4202496 203883 0 0 0 118190 38 0 0 25 0 1 0 284904617 1202196480 196941 33554432000 4194304 4947581 140736839958784 18446744073709551615 4398560 0 0 4096 24578 0 0 0 17 1 0 0 0
/proc/11561/statm: 293505 196941 465 184 0 288380 0
Current children cumulated CPU time (s) 1182.28
Current children cumulated vsize (KiB) 1174020

[startup+1242.3 s]
/proc/loadavg: 4.14 4.02 2.99 5/194 11625
/proc/meminfo: memFree=20364596/32951124 swapFree=67111528/67111528
[pid=11561] ppid=11559 vsize=1663632 CPUtime=1242.28 cores=1,3
/proc/11561/stat : 11561 (synit_sat) R 11559 11561 11531 0 -1 4202496 205394 0 0 0 124189 39 0 0 25 0 1 0 284904617 1703559168 198452 33554432000 4194304 4947581 140736839958784 18446744073709551615 4346229 0 0 4096 24578 0 0 0 17 1 0 0 0
/proc/11561/statm: 415908 198452 465 184 0 410783 0
Current children cumulated CPU time (s) 1242.28
Current children cumulated vsize (KiB) 1663632



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 4.14 4.03 3.05 5/194 11627
/proc/meminfo: memFree=20368536/32951124 swapFree=67111528/67111528
[pid=11561] ppid=11559 vsize=1909388 CPUtime=1299.98 cores=1,3
/proc/11561/stat : 11561 (synit_sat) R 11559 11561 11531 0 -1 4202496 206560 0 0 0 129959 39 0 0 25 0 1 0 284904617 1955213312 199566 33554432000 4194304 4947581 140736839958784 18446744073709551615 4350958 0 0 4096 24578 0 0 0 17 1 0 0 0
/proc/11561/statm: 477347 199566 465 184 0 472222 0
Current children cumulated CPU time (s) 1299.98
Current children cumulated vsize (KiB) 1909388

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1300 s]
/proc/loadavg: 4.14 4.03 3.05 5/194 11627
/proc/meminfo: memFree=20368536/32951124 swapFree=67111528/67111528
[pid=11561] ppid=11559 vsize=1909388 CPUtime=1299.98 cores=1,3
/proc/11561/stat : 11561 (synit_sat) R 11559 11561 11531 0 -1 4202496 206560 0 0 0 129959 39 0 0 25 0 1 0 284904617 1955213312 199566 33554432000 4194304 4947581 140736839958784 18446744073709551615 4350958 0 0 4096 24578 0 0 0 17 1 0 0 0
/proc/11561/statm: 477347 199566 465 184 0 472222 0
Current children cumulated CPU time (s) 1299.98
Current children cumulated vsize (KiB) 1909388

Child status: 1
Real time (s): 1300.04
CPU time (s): 1300.02
CPU user time (s): 1299.6
CPU system time (s): 0.424935
CPU usage (%): 99.999
Max. virtual memory (cumulated for all children) (KiB): 1909388

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1299.6
system time used= 0.424935
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 206565
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 10
involuntary context switches= 16244

runsolver used 2.07568 second user time and 5.02724 second system time

The end

Launcher Data 

Begin job on node133 at 2011-04-02 10:31:07
IDJOB=3159546
IDBENCH=82569
IDSOLVER=1571
FILE ID=node133/3159546-1301733067
RUNJOBID= node133-1301733065-11551
PBS_JOBID= 12840936
Free space on /tmp= 72184 MiB

SOLVER NAME= synit_sat 2011-03-03
BENCH NAME= SAT11/random/large/unif-k3-r4.2-v25000-c105000-S5267991-057-UNKNOWN.cnf
COMMAND LINE= HOME/synit_sat BENCHNAME RANDOMSEED
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3159546-1301733067/watcher-3159546-1301733067 -o /tmp/evaluation-result-3159546-1301733067/solver-3159546-1301733067 -C 2400 -W 1300 -M 7680  HOME/synit_sat HOME/instance-3159546-1301733067.cnf 1809242656

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 7680 MiB
NBCORE= 2

MD5SUM BENCH= 1a8d3d5d5a6ad4a4b0bb6bd83ad87f53
RANDOM SEED=1809242656

node133.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 6741.12
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      22583356 kB
Buffers:        344748 kB
Cached:        9712508 kB
SwapCached:          0 kB
Active:        7268436 kB
Inactive:      2850984 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      22583356 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:            4576 kB
Writeback:           0 kB
AnonPages:       62248 kB
Mapped:          14624 kB
Slab:           185248 kB
PageTables:       5036 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   191180 kB
VmallocTotal: 34359738367 kB
VmallocUsed:     33868 kB
VmallocChunk: 34359703231 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72172 MiB
End job on node133 at 2011-04-02 10:52:49