Trace number 3188537

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
QuteRSat 2011-03-01? (TO) 1300.07 1300.04

General information on the benchmark

Namerandom/large/
unif-k3-r4.2-v40000-c168000-S1920335371-069-UNKNOWN.cnf
MD5SUM2df42d61a6b217e160d2447861596d0d
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark56.0875
Satisfiable
(Un)Satisfiability was proved
Number of variables40000
Number of clauses168000
Sum of the clauses size504000
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 3168000
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.00/0.00	c Set FPU double precision.
0.19/0.20	c Parse Cnf success: #var: 40000 #clause: 168000
0.19/0.20	c Find Units :          0
0.19/0.20	c Find Invs  :          0
0.19/0.22	c Find Ands  :          0 AvgFaninNum: nan
0.19/0.23	c Find Xors  :          0 AvgFaninNum: nan
0.19/0.25	c Find Ite   :          0
0.29/0.33	c UnDirect variable: 0
0.29/0.33	c UnDirect to Direct Gate: 0
0.29/0.33	c Forced Direct Gate: 0 Unuse unDirect Gate: 0
0.29/0.33	c Break Cycle : 0
0.29/0.33	c Total Root : 0 Undef Var: 40000
0.29/0.33	c After covering, Total Root: 0 Leaf: 0
0.29/0.33	c Variable( cover/uncovered/unused ): 0 40000 0
0.29/0.33	c Unit Clauses: 0
0.29/0.33	c Binary Clauses( cover/uncovered ): 0 0
0.29/0.33	c Clauses( cover/uncovered ): 0 168000
0.29/0.33	c Total Clauses( cover/uncovered ): 0 168000 0%
0.29/0.33	c Covered Ands: 0 Invs: 0 Xors: 0 Ites: 0
0.48/0.52	c Uncover Clauses avg size: 3 max size: 3
0.48/0.53	c Final circuit: i/l/o/s   40000       0  168000    335996
0.48/0.53	c CnfToAig: Time: 0.51 s
0.69/0.80	c TmMap: Set choices finish.
0.89/0.93	c TmMap: Set big and: 168000
0.89/0.93	c TmMap: Origin: 375997 ClauseNum: 1007988 --> New: 208001 ClauseNum: 672000
0.89/0.93	c TmMap: Time: 0.17
0.89/0.97	c Try to Add: #clause: 336000 #xorclause: 0
0.99/1.06	c #var: 40000 #clauses: 168001 Solving... 
1300.03/1300.00	c Time Out !!
1300.03/1300.00	s UNKNOWN

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 893)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3188537-1302281991/watcher-3188537-1302281991 -o /tmp/evaluation-result-3188537-1302281991/solver-3188537-1302281991 -C 2400 -W 1300 -M 7680 qutersat_release HOME/instance-3188537-1302281991.cnf 1412993962 

running on 2 cores: 4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 7864320 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 7915520 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 4.00 4.05 4.65 5/184 29567
/proc/meminfo: memFree=32598460/32950904 swapFree=67082008/67111528
[pid=29567] ppid=29565 vsize=33388 CPUtime=0 cores=4,6
/proc/29567/stat : 29567 (qutersat_releas) R 29565 29567 29367 0 -1 4202496 1848 0 0 0 0 0 0 0 25 0 1 0 339798927 34189312 1782 33554432000 4194304 6016207 140736080943200 18446744073709551615 4272580 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/29567/statm: 8347 1799 372 445 0 1891 0

[startup+0.0872219 s]
/proc/loadavg: 4.00 4.05 4.65 5/184 29567
/proc/meminfo: memFree=32598460/32950904 swapFree=67082008/67111528
[pid=29567] ppid=29565 vsize=49772 CPUtime=0.07 cores=4,6
/proc/29567/stat : 29567 (qutersat_releas) R 29565 29567 29367 0 -1 4202496 6167 0 0 0 7 0 0 0 25 0 1 0 339798927 50966528 6100 33554432000 4194304 6016207 140736080943200 18446744073709551615 4779602 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/29567/statm: 12443 6102 379 445 0 5987 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 49772

[startup+0.100217 s]
/proc/loadavg: 4.00 4.05 4.65 5/184 29567
/proc/meminfo: memFree=32598460/32950904 swapFree=67082008/67111528
[pid=29567] ppid=29565 vsize=51948 CPUtime=0.08 cores=4,6
/proc/29567/stat : 29567 (qutersat_releas) R 29565 29567 29367 0 -1 4202496 6625 0 0 0 8 0 0 0 25 0 1 0 339798927 53194752 6558 33554432000 4194304 6016207 140736080943200 18446744073709551615 4779602 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/29567/statm: 12987 6560 379 445 0 6531 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 51948

[startup+0.300183 s]
/proc/loadavg: 4.00 4.05 4.65 5/184 29567
/proc/meminfo: memFree=32598460/32950904 swapFree=67082008/67111528
[pid=29567] ppid=29565 vsize=69484 CPUtime=0.29 cores=4,6
/proc/29567/stat : 29567 (qutersat_releas) R 29565 29567 29367 0 -1 4202496 11219 0 0 0 28 1 0 0 25 0 1 0 339798927 71151616 11152 33554432000 4194304 6016207 140736080943200 18446744073709551615 4265466 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/29567/statm: 17371 11152 396 445 0 10915 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 69484

[startup+0.700159 s]
/proc/loadavg: 4.00 4.05 4.65 5/184 29567
/proc/meminfo: memFree=32598460/32950904 swapFree=67082008/67111528
[pid=29567] ppid=29565 vsize=127276 CPUtime=0.69 cores=4,6
/proc/29567/stat : 29567 (qutersat_releas) R 29565 29567 29367 0 -1 4202496 24827 0 0 0 67 2 0 0 25 0 1 0 339798927 130330624 24760 33554432000 4194304 6016207 140736080943200 18446744073709551615 4818872 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/29567/statm: 31819 24760 670 445 0 25363 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 127276

[startup+1.50109 s]
/proc/loadavg: 4.00 4.05 4.65 5/190 29574
/proc/meminfo: memFree=32304680/32950904 swapFree=67082008/67111528
[pid=29567] ppid=29565 vsize=157080 CPUtime=1.49 cores=4,6
/proc/29567/stat : 29567 (qutersat_releas) R 29565 29567 29367 0 -1 4202496 32748 0 0 0 146 3 0 0 25 0 1 0 339798927 160849920 32681 33554432000 4194304 6016207 140736080943200 18446744073709551615 4543466 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/29567/statm: 39270 32681 709 445 0 32814 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 157080

[startup+3.10068 s]
/proc/loadavg: 4.00 4.05 4.65 5/190 29574
/proc/meminfo: memFree=32302448/32950904 swapFree=67082008/67111528
[pid=29567] ppid=29565 vsize=157080 CPUtime=3.09 cores=4,6
/proc/29567/stat : 29567 (qutersat_releas) R 29565 29567 29367 0 -1 4202496 32759 0 0 0 306 3 0 0 25 0 1 0 339798927 160849920 32692 33554432000 4194304 6016207 140736080943200 18446744073709551615 4425389 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/29567/statm: 39270 32692 719 445 0 32814 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 157080

[startup+6.30011 s]
/proc/loadavg: 4.00 4.05 4.64 5/190 29574
/proc/meminfo: memFree=32287836/32950904 swapFree=67082008/67111528
[pid=29567] ppid=29565 vsize=157080 CPUtime=6.29 cores=4,6
/proc/29567/stat : 29567 (qutersat_releas) R 29565 29567 29367 0 -1 4202496 32759 0 0 0 626 3 0 0 25 0 1 0 339798927 160849920 32692 33554432000 4194304 6016207 140736080943200 18446744073709551615 4424219 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/29567/statm: 39270 32692 719 445 0 32814 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 157080

[startup+12.701 s]
/proc/loadavg: 4.00 4.05 4.64 5/190 29575
/proc/meminfo: memFree=32228232/32950904 swapFree=67082008/67111528
[pid=29567] ppid=29565 vsize=238160 CPUtime=12.69 cores=4,6
/proc/29567/stat : 29567 (qutersat_releas) R 29565 29567 29367 0 -1 4202496 37107 0 0 0 1265 4 0 0 25 0 1 0 339798927 243875840 37040 33554432000 4194304 6016207 140736080943200 18446744073709551615 4425389 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/29567/statm: 59540 37040 723 445 0 53084 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 238160

[startup+25.5007 s]
/proc/loadavg: 4.00 4.04 4.63 5/190 29575
/proc/meminfo: memFree=32028076/32950904 swapFree=67082008/67111528
[pid=29567] ppid=29565 vsize=368504 CPUtime=25.49 cores=4,6
/proc/29567/stat : 29567 (qutersat_releas) R 29565 29567 29367 0 -1 4202496 57193 0 0 0 2541 8 0 0 25 0 1 0 339798927 377348096 57126 33554432000 4194304 6016207 140736080943200 18446744073709551615 4425392 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/29567/statm: 92126 57126 727 445 0 85670 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 368504

[startup+51.1002 s]
/proc/loadavg: 4.00 4.04 4.61 5/190 29576
/proc/meminfo: memFree=31806916/32950904 swapFree=67082008/67111528
[pid=29567] ppid=29565 vsize=397176 CPUtime=51.09 cores=4,6
/proc/29567/stat : 29567 (qutersat_releas) R 29565 29567 29367 0 -1 4202496 79460 0 0 0 5098 11 0 0 25 0 1 0 339798927 406708224 79316 33554432000 4194304 6016207 140736080943200 18446744073709551615 4425151 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/29567/statm: 99294 79316 727 445 0 92838 0
Current children cumulated CPU time (s) 51.09
Current children cumulated vsize (KiB) 397176

[startup+102.307 s]
/proc/loadavg: 4.00 4.03 4.58 5/190 29586
/proc/meminfo: memFree=31575712/32950904 swapFree=67082008/67111528
[pid=29567] ppid=29565 vsize=457888 CPUtime=102.3 cores=4,6
/proc/29567/stat : 29567 (qutersat_releas) R 29565 29567 29367 0 -1 4202496 97006 0 0 0 10217 13 0 0 25 0 1 0 339798927 468877312 96574 33554432000 4194304 6016207 140736080943200 18446744073709551615 4425149 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/29567/statm: 114472 96574 727 445 0 108016 0
Current children cumulated CPU time (s) 102.3
Current children cumulated vsize (KiB) 457888

[startup+162.3 s]
/proc/loadavg: 4.00 4.02 4.54 5/190 29588
/proc/meminfo: memFree=31453652/32950904 swapFree=67082008/67111528
[pid=29567] ppid=29565 vsize=481056 CPUtime=162.3 cores=4,6
/proc/29567/stat : 29567 (qutersat_releas) R 29565 29567 29367 0 -1 4202496 104548 0 0 0 16215 15 0 0 25 0 1 0 339798927 492601344 104116 33554432000 4194304 6016207 140736080943200 18446744073709551615 4424309 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/29567/statm: 120264 104116 727 445 0 113808 0
Current children cumulated CPU time (s) 162.3
Current children cumulated vsize (KiB) 481056

[startup+222.301 s]
/proc/loadavg: 4.00 4.02 4.50 5/190 29589
/proc/meminfo: memFree=31360608/32950904 swapFree=67082008/67111528
[pid=29567] ppid=29565 vsize=560132 CPUtime=222.3 cores=4,6
/proc/29567/stat : 29567 (qutersat_releas) R 29565 29567 29367 0 -1 4202496 114245 0 0 0 22214 16 0 0 25 0 1 0 339798927 573575168 113757 33554432000 4194304 6016207 140736080943200 18446744073709551615 4425041 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/29567/statm: 140033 113757 727 445 0 133577 0
Current children cumulated CPU time (s) 222.3
Current children cumulated vsize (KiB) 560132

[startup+282.301 s]
/proc/loadavg: 4.00 4.01 4.47 5/190 29594
/proc/meminfo: memFree=31256528/32950904 swapFree=67082008/67111528
[pid=29567] ppid=29565 vsize=687076 CPUtime=282.3 cores=4,6
/proc/29567/stat : 29567 (qutersat_releas) R 29565 29567 29367 0 -1 4202496 127460 0 0 0 28211 19 0 0 25 0 1 0 339798927 703565824 126770 33554432000 4194304 6016207 140736080943200 18446744073709551615 4425832 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/29567/statm: 171769 126770 727 445 0 165313 0
Current children cumulated CPU time (s) 282.3
Current children cumulated vsize (KiB) 687076

[startup+342.3 s]
/proc/loadavg: 4.00 4.01 4.43 5/190 29595
/proc/meminfo: memFree=31124220/32950904 swapFree=67082008/67111528
[pid=29567] ppid=29565 vsize=813716 CPUtime=342.3 cores=4,6
/proc/29567/stat : 29567 (qutersat_releas) R 29565 29567 29367 0 -1 4202496 147739 0 0 0 34207 23 0 0 25 0 1 0 339798927 833245184 147049 33554432000 4194304 6016207 140736080943200 18446744073709551615 4425079 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/29567/statm: 203429 147049 727 445 0 196973 0
Current children cumulated CPU time (s) 342.3
Current children cumulated vsize (KiB) 813716

[startup+402.301 s]
/proc/loadavg: 4.03 4.02 4.41 5/190 29597
/proc/meminfo: memFree=31095920/32950904 swapFree=67082008/67111528
[pid=29567] ppid=29565 vsize=813716 CPUtime=402.3 cores=4,6
/proc/29567/stat : 29567 (qutersat_releas) R 29565 29567 29367 0 -1 4202496 148673 0 0 0 40207 23 0 0 25 0 1 0 339798927 833245184 140157 33554432000 4194304 6016207 140736080943200 18446744073709551615 4425705 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/29567/statm: 203429 140157 727 445 0 196973 0
Current children cumulated CPU time (s) 402.3
Current children cumulated vsize (KiB) 813716

[startup+462.301 s]
/proc/loadavg: 4.08 4.03 4.39 5/190 29599
/proc/meminfo: memFree=31085588/32950904 swapFree=67082008/67111528
[pid=29567] ppid=29565 vsize=813844 CPUtime=462.3 cores=4,6
/proc/29567/stat : 29567 (qutersat_releas) R 29565 29567 29367 0 -1 4202496 149245 0 0 0 46207 23 0 0 25 0 1 0 339798927 833376256 140729 33554432000 4194304 6016207 140736080943200 18446744073709551615 4426948 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/29567/statm: 203461 140729 727 445 0 197005 0
Current children cumulated CPU time (s) 462.3
Current children cumulated vsize (KiB) 813844

[startup+522.3 s]
/proc/loadavg: 4.03 4.02 4.36 5/190 29600
/proc/meminfo: memFree=31052068/32950904 swapFree=67082008/67111528
[pid=29567] ppid=29565 vsize=813844 CPUtime=522.3 cores=4,6
/proc/29567/stat : 29567 (qutersat_releas) R 29565 29567 29367 0 -1 4202496 151459 0 0 0 52206 24 0 0 25 0 1 0 339798927 833376256 142943 33554432000 4194304 6016207 140736080943200 18446744073709551615 4424353 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/29567/statm: 203461 142943 727 445 0 197005 0
Current children cumulated CPU time (s) 522.3
Current children cumulated vsize (KiB) 813844

[startup+582.301 s]
/proc/loadavg: 4.01 4.02 4.33 5/190 29602
/proc/meminfo: memFree=30990156/32950904 swapFree=67082008/67111528
[pid=29567] ppid=29565 vsize=813844 CPUtime=582.31 cores=4,6
/proc/29567/stat : 29567 (qutersat_releas) R 29565 29567 29367 0 -1 4202496 154256 0 0 0 58206 25 0 0 25 0 1 0 339798927 833376256 145740 33554432000 4194304 6016207 140736080943200 18446744073709551615 4379452 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/29567/statm: 203461 145740 727 445 0 197005 0
Current children cumulated CPU time (s) 582.31
Current children cumulated vsize (KiB) 813844

[startup+642.301 s]
/proc/loadavg: 4.00 4.01 4.31 5/190 29603
/proc/meminfo: memFree=30938052/32950904 swapFree=67082008/67111528
[pid=29567] ppid=29565 vsize=813844 CPUtime=642.31 cores=4,6
/proc/29567/stat : 29567 (qutersat_releas) R 29565 29567 29367 0 -1 4202496 154760 0 0 0 64206 25 0 0 25 0 1 0 339798927 833376256 146244 33554432000 4194304 6016207 140736080943200 18446744073709551615 4425659 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/29567/statm: 203461 146244 727 445 0 197005 0
Current children cumulated CPU time (s) 642.31
Current children cumulated vsize (KiB) 813844

[startup+702.3 s]
/proc/loadavg: 4.00 4.00 4.29 5/190 29605
/proc/meminfo: memFree=30924256/32950904 swapFree=67082008/67111528
[pid=29567] ppid=29565 vsize=813844 CPUtime=702.31 cores=4,6
/proc/29567/stat : 29567 (qutersat_releas) R 29565 29567 29367 0 -1 4202496 155244 0 0 0 70206 25 0 0 25 0 1 0 339798927 833376256 146728 33554432000 4194304 6016207 140736080943200 18446744073709551615 4424136 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/29567/statm: 203461 146728 727 445 0 197005 0
Current children cumulated CPU time (s) 702.31
Current children cumulated vsize (KiB) 813844

[startup+762.307 s]
/proc/loadavg: 4.00 4.00 4.27 5/190 29607
/proc/meminfo: memFree=30805560/32950904 swapFree=67082008/67111528
[pid=29567] ppid=29565 vsize=813844 CPUtime=762.32 cores=4,6
/proc/29567/stat : 29567 (qutersat_releas) R 29565 29567 29367 0 -1 4202496 155928 0 0 0 76207 25 0 0 25 0 1 0 339798927 833376256 147412 33554432000 4194304 6016207 140736080943200 18446744073709551615 4425176 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/29567/statm: 203461 147412 727 445 0 197005 0
Current children cumulated CPU time (s) 762.32
Current children cumulated vsize (KiB) 813844

[startup+822.301 s]
/proc/loadavg: 4.00 4.00 4.25 5/190 29608
/proc/meminfo: memFree=30785428/32950904 swapFree=67082008/67111528
[pid=29567] ppid=29565 vsize=813844 CPUtime=822.31 cores=4,6
/proc/29567/stat : 29567 (qutersat_releas) R 29565 29567 29367 0 -1 4202496 156576 0 0 0 82206 25 0 0 25 0 1 0 339798927 833376256 148060 33554432000 4194304 6016207 140736080943200 18446744073709551615 4425530 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/29567/statm: 203461 148060 727 445 0 197005 0
Current children cumulated CPU time (s) 822.31
Current children cumulated vsize (KiB) 813844

[startup+882.3 s]
/proc/loadavg: 4.00 4.00 4.23 5/190 29610
/proc/meminfo: memFree=30755760/32950904 swapFree=67082008/67111528
[pid=29567] ppid=29565 vsize=813844 CPUtime=882.31 cores=4,6
/proc/29567/stat : 29567 (qutersat_releas) R 29565 29567 29367 0 -1 4202496 157048 0 0 0 88206 25 0 0 25 0 1 0 339798927 833376256 148532 33554432000 4194304 6016207 140736080943200 18446744073709551615 4425659 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/29567/statm: 203461 148532 727 445 0 197005 0
Current children cumulated CPU time (s) 882.31
Current children cumulated vsize (KiB) 813844

[startup+942.301 s]
/proc/loadavg: 4.05 4.01 4.22 5/190 29611
/proc/meminfo: memFree=30701532/32950904 swapFree=67082008/67111528
[pid=29567] ppid=29565 vsize=880292 CPUtime=942.32 cores=4,6
/proc/29567/stat : 29567 (qutersat_releas) R 29565 29567 29367 0 -1 4202496 170066 0 0 0 94204 28 0 0 25 0 1 0 339798927 901419008 161550 33554432000 4194304 6016207 140736080943200 18446744073709551615 4426152 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/29567/statm: 220073 161550 727 445 0 213617 0
Current children cumulated CPU time (s) 942.32
Current children cumulated vsize (KiB) 880292

[startup+1002.3 s]
/proc/loadavg: 4.02 4.01 4.20 5/190 29613
/proc/meminfo: memFree=30614940/32950904 swapFree=67082008/67111528
[pid=29567] ppid=29565 vsize=880292 CPUtime=1002.31 cores=4,6
/proc/29567/stat : 29567 (qutersat_releas) R 29565 29567 29367 0 -1 4202496 186240 0 0 0 100200 31 0 0 25 0 1 0 339798927 901419008 177724 33554432000 4194304 6016207 140736080943200 18446744073709551615 4425389 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/29567/statm: 220073 177724 727 445 0 213617 0
Current children cumulated CPU time (s) 1002.31
Current children cumulated vsize (KiB) 880292

[startup+1062.3 s]
/proc/loadavg: 4.04 4.02 4.19 5/190 29615
/proc/meminfo: memFree=30580300/32950904 swapFree=67082008/67111528
[pid=29567] ppid=29565 vsize=947680 CPUtime=1062.32 cores=4,6
/proc/29567/stat : 29567 (qutersat_releas) R 29565 29567 29367 0 -1 4202496 188102 0 0 0 106200 32 0 0 25 0 1 0 339798927 970424320 179586 33554432000 4194304 6016207 140736080943200 18446744073709551615 4377997 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/29567/statm: 236920 179586 727 445 0 230464 0
Current children cumulated CPU time (s) 1062.32
Current children cumulated vsize (KiB) 947680

[startup+1122.3 s]
/proc/loadavg: 4.01 4.01 4.17 5/190 29616
/proc/meminfo: memFree=30462948/32950904 swapFree=67082008/67111528
[pid=29567] ppid=29565 vsize=948192 CPUtime=1122.32 cores=4,6
/proc/29567/stat : 29567 (qutersat_releas) R 29565 29567 29367 0 -1 4202496 200350 0 0 0 112198 34 0 0 25 0 1 0 339798927 970948608 191834 33554432000 4194304 6016207 140736080943200 18446744073709551615 4425389 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/29567/statm: 237048 191834 727 445 0 230592 0
Current children cumulated CPU time (s) 1122.32
Current children cumulated vsize (KiB) 948192

[startup+1182.3 s]
/proc/loadavg: 4.00 4.01 4.16 5/190 29618
/proc/meminfo: memFree=30405380/32950904 swapFree=67082008/67111528
[pid=29567] ppid=29565 vsize=948192 CPUtime=1182.32 cores=4,6
/proc/29567/stat : 29567 (qutersat_releas) R 29565 29567 29367 0 -1 4202496 205028 0 0 0 118197 35 0 0 25 0 1 0 339798927 970948608 196512 33554432000 4194304 6016207 140736080943200 18446744073709551615 4425705 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/29567/statm: 237048 196512 727 445 0 230592 0
Current children cumulated CPU time (s) 1182.32
Current children cumulated vsize (KiB) 948192

[startup+1242.3 s]
/proc/loadavg: 4.00 4.00 4.15 5/190 29619
/proc/meminfo: memFree=30324252/32950904 swapFree=67082008/67111528
[pid=29567] ppid=29565 vsize=1210848 CPUtime=1242.32 cores=4,6
/proc/29567/stat : 29567 (qutersat_releas) R 29565 29567 29367 0 -1 4202496 206567 0 0 0 124197 35 0 0 25 0 1 0 339798927 1239908352 198051 33554432000 4194304 6016207 140736080943200 18446744073709551615 4378013 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/29567/statm: 302712 198051 727 445 0 296256 0
Current children cumulated CPU time (s) 1242.32
Current children cumulated vsize (KiB) 1210848



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 4.00 4.00 4.14 3/186 29623
/proc/meminfo: memFree=31070988/32950904 swapFree=67082008/67111528
[pid=29567] ppid=29565 vsize=1210848 CPUtime=1300.03 cores=4,6
/proc/29567/stat : 29567 (qutersat_releas) R 29565 29567 29367 0 -1 4202496 206614 0 0 0 129968 35 0 0 25 0 1 0 339798927 1239908352 198098 33554432000 4194304 6016207 140736080943200 18446744073709551615 4426994 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/29567/statm: 302712 198098 727 445 0 296256 0
Current children cumulated CPU time (s) 1300.03
Current children cumulated vsize (KiB) 1210848

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child status: 1
Real time (s): 1300.04
CPU time (s): 1300.07
CPU user time (s): 1299.68
CPU system time (s): 0.382941
CPU usage (%): 100.002
Max. virtual memory (cumulated for all children) (KiB): 1210848

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1299.68
system time used= 0.382941
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 206619
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 7
involuntary context switches= 1623

runsolver used 2.13767 second user time and 4.84226 second system time

The end

Launcher Data 

Begin job on node121 at 2011-04-08 18:59:52
IDJOB=3188537
IDBENCH=82668
IDSOLVER=1607
FILE ID=node121/3188537-1302281991
RUNJOBID= node121-1302280689-29386
PBS_JOBID= 12919087
Free space on /tmp= 72148 MiB

SOLVER NAME= QuteRSat 2011-03-01
BENCH NAME= SAT11/random/large/unif-k3-r4.2-v40000-c168000-S1920335371-069-UNKNOWN.cnf
COMMAND LINE= qutersat_release BENCHNAME RANDOMSEED
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3188537-1302281991/watcher-3188537-1302281991 -o /tmp/evaluation-result-3188537-1302281991/solver-3188537-1302281991 -C 2400 -W 1300 -M 7680  qutersat_release HOME/instance-3188537-1302281991.cnf 1412993962

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 7680 MiB
NBCORE= 2

MD5SUM BENCH= 2df42d61a6b217e160d2447861596d0d
RANDOM SEED=1412993962

node121.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.63
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950904 kB
MemFree:      32599112 kB
Buffers:          5048 kB
Cached:         104832 kB
SwapCached:       2900 kB
Active:         135256 kB
Inactive:        96872 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950904 kB
LowFree:      32599112 kB
SwapTotal:    67111528 kB
SwapFree:     67082008 kB
Dirty:           13264 kB
Writeback:           0 kB
AnonPages:      120840 kB
Mapped:          16628 kB
Slab:            54724 kB
PageTables:       5124 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586980 kB
Committed_AS:   319048 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72148 MiB
End job on node121 at 2011-04-08 19:21:34