Trace number 3384351

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
QuteRSat 2011-05-12 (fixed)? (TO) 5000.32 5000.26

General information on the benchmark

Nameapplication/rintanen/SATPlanning/
transport-transport-three-cities-sequential-14nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.020-NOTKNOWN.cnf
MD5SUM5d1253e2dcc0e3e55992672756beadbc
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark2556.24
Satisfiable
(Un)Satisfiability was proved
Number of variables756832
Number of clauses4116966
Sum of the clauses size9765566
Maximum clause length1178
Minimum clause length1
Number of clauses of size 1846
Number of clauses of size 24082840
Number of clauses of size 3640
Number of clauses of size 4800
Number of clauses of size 5800
Number of clauses of size over 531040

Solver Data 

0.00/0.00	c Set FPU double precision.
1.48/1.57	c Parse Cnf success: #var: 756832 #clause: 4116966
1.48/1.57	c Find Units :        846
1.91/1.94	c Find Invs  :          0
2.19/2.25	c Find Ands  :        320 AvgFaninNum: 2
2.19/2.26	c Find Xors  :          0 AvgFaninNum: nan
2.19/2.26	c Find Ite   :          0
2.19/2.26	c UnDirect variable: 0
2.19/2.26	c UnDirect to Direct Gate: 0
2.19/2.26	c Forced Direct Gate: 0 Unuse unDirect Gate: 0
2.19/2.27	c Break Cycle : 0
2.19/2.27	c Total Root : 320 Undef Var: 756512
2.19/2.29	c After covering, Total Root: 320 Leaf: 1166
2.19/2.29	c Variable( cover/uncovered/unused ): 1486 755346 0
2.19/2.29	c Unit Clauses: 846
2.19/2.29	c Binary Clauses( cover/uncovered ): 640 4082200
2.19/2.29	c Clauses( cover/uncovered ): 320 32960
2.19/2.29	c Total Clauses( cover/uncovered ): 1806 4115160 0.0438673%
2.19/2.29	c Covered Ands: 320 Invs: 0 Xors: 0 Ites: 0
4.79/4.80	c Uncover Clauses avg size: 2.37232 max size: 1178
4.79/4.86	c Final circuit: i/l/o/s  755666       0 3398953   4169092
4.79/4.86	c CnfToAig: Time: 4.85 s
7.49/7.54	c TmMap: Set choices finish.
9.50/9.54	c TmMap: Set big and: 3529839
9.50/9.54	c TmMap: Origin: 4924759 ClauseNum: 12507276 --> New: 4285740 ClauseNum: 11231901
9.50/9.54	c TmMap: Time: 2.37
10.09/10.14	c Try to Add: #clause: 7060767 #xorclause: 0
11.09/11.16	c #var: 886786 #clauses: 213168 Solving... 
5000.01/4999.91	c Time Out !!
5000.01/4999.91	s UNKNOWN

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3384351-1305545200/watcher-3384351-1305545200 -o /tmp/evaluation-result-3384351-1305545200/solver-3384351-1305545200 -C 5000 -W 5100 -M 15500 qutersat_release HOME/instance-3384351-1305545200.cnf 590367528 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 5000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 5030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.92 2.00 1.98 3/436 5583
/proc/meminfo: memFree=24714984/32951124 swapFree=64205392/67111528
[pid=5583] ppid=5581 vsize=50104 CPUtime=0 cores=0,2,4,6
/proc/5583/stat : 5583 (qutersat_releas) R 5581 5583 5259 0 -1 4202496 2359 0 0 0 0 0 0 0 22 0 1 0 666118271 51306496 2295 33554432000 4194304 6014671 140737369535760 18446744073709551615 4271044 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/5583/statm: 12526 2310 370 445 0 6071 0

[startup+0.0974729 s]
/proc/loadavg: 1.92 2.00 1.98 3/436 5583
/proc/meminfo: memFree=24714984/32951124 swapFree=64205392/67111528
[pid=5583] ppid=5581 vsize=72632 CPUtime=0.09 cores=0,2,4,6
/proc/5583/stat : 5583 (qutersat_releas) R 5581 5583 5259 0 -1 4202496 11427 0 0 0 8 1 0 0 22 0 1 0 666118271 74375168 11363 33554432000 4194304 6014671 140737369535760 18446744073709551615 4778066 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/5583/statm: 18158 11363 378 445 0 11703 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 72632

[startup+0.100458 s]
/proc/loadavg: 1.92 2.00 1.98 3/436 5583
/proc/meminfo: memFree=24714984/32951124 swapFree=64205392/67111528
[pid=5583] ppid=5581 vsize=72632 CPUtime=0.09 cores=0,2,4,6
/proc/5583/stat : 5583 (qutersat_releas) R 5581 5583 5259 0 -1 4202496 11502 0 0 0 8 1 0 0 22 0 1 0 666118271 74375168 11438 33554432000 4194304 6014671 140737369535760 18446744073709551615 4778066 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/5583/statm: 18158 11439 378 445 0 11703 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 72632

[startup+0.3004 s]
/proc/loadavg: 1.92 2.00 1.98 3/436 5583
/proc/meminfo: memFree=24714984/32951124 swapFree=64205392/67111528
[pid=5583] ppid=5581 vsize=97336 CPUtime=0.29 cores=0,2,4,6
/proc/5583/stat : 5583 (qutersat_releas) R 5581 5583 5259 0 -1 4202496 17850 0 0 0 27 2 0 0 23 0 1 0 666118271 99672064 17786 33554432000 4194304 6014671 140737369535760 18446744073709551615 4277980 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/5583/statm: 24334 17786 378 445 0 17879 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 97336

[startup+1.23024 s]
/proc/loadavg: 1.92 2.00 1.98 3/436 5583
/proc/meminfo: memFree=24714984/32951124 swapFree=64205392/67111528
[pid=5583] ppid=5581 vsize=245688 CPUtime=1.22 cores=0,2,4,6
/proc/5583/stat : 5583 (qutersat_releas) R 5581 5583 5259 0 -1 4202496 52929 0 0 0 115 7 0 0 25 0 1 0 666118271 251584512 52865 33554432000 4194304 6014671 140737369535760 18446744073709551615 4277980 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/5583/statm: 61422 52865 378 445 0 54967 0
Current children cumulated CPU time (s) 1.22
Current children cumulated vsize (KiB) 245688

[startup+1.50022 s]
/proc/loadavg: 1.92 2.00 1.98 3/436 5583
/proc/meminfo: memFree=24714984/32951124 swapFree=64205392/67111528
[pid=5583] ppid=5581 vsize=245816 CPUtime=1.48 cores=0,2,4,6
/proc/5583/stat : 5583 (qutersat_releas) R 5581 5583 5259 0 -1 4202496 54727 0 0 0 141 7 0 0 25 0 1 0 666118271 251715584 54663 33554432000 4194304 6014671 140737369535760 18446744073709551615 4277980 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/5583/statm: 61454 54664 378 445 0 54999 0
Current children cumulated CPU time (s) 1.48
Current children cumulated vsize (KiB) 245816

[startup+3.10094 s]
/proc/loadavg: 2.09 2.03 2.00 3/437 5584
/proc/meminfo: memFree=24494736/32951124 swapFree=64205392/67111528
[pid=5583] ppid=5581 vsize=311480 CPUtime=3.09 cores=0,2,4,6
/proc/5583/stat : 5583 (qutersat_releas) R 5581 5583 5259 0 -1 4202496 70152 0 0 0 299 10 0 0 25 0 1 0 666118271 318955520 70088 33554432000 4194304 6014671 140737369535760 18446744073709551615 4314304 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/5583/statm: 77870 70088 398 445 0 71415 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 311480

[startup+6.31637 s]
/proc/loadavg: 2.08 2.03 2.00 3/437 5584
/proc/meminfo: memFree=23753108/32951124 swapFree=64205392/67111528
[pid=5583] ppid=5581 vsize=1050208 CPUtime=6.31 cores=0,2,4,6
/proc/5583/stat : 5583 (qutersat_releas) R 5581 5583 5259 0 -1 4202496 262817 0 0 0 600 31 0 0 25 0 1 0 666118271 1075412992 246344 33554432000 4194304 6014671 140737369535760 18446744073709551615 4778066 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/5583/statm: 262552 246345 668 445 0 256097 0
Current children cumulated CPU time (s) 6.31
Current children cumulated vsize (KiB) 1050208

[startup+12.7003 s]
/proc/loadavg: 2.07 2.03 2.00 3/437 5584
/proc/meminfo: memFree=22942296/32951124 swapFree=64205392/67111528
[pid=5583] ppid=5581 vsize=1949536 CPUtime=12.69 cores=0,2,4,6
/proc/5583/stat : 5583 (qutersat_releas) R 5581 5583 5259 0 -1 4202496 459190 0 0 0 1217 52 0 0 25 0 1 0 666118271 1996324864 442717 33554432000 4194304 6014671 140737369535760 18446744073709551615 228244042703 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/5583/statm: 487384 442717 701 445 0 480929 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 1949536

[startup+25.501 s]
/proc/loadavg: 2.06 2.03 2.00 3/437 5585
/proc/meminfo: memFree=22929572/32951124 swapFree=64205392/67111528
[pid=5583] ppid=5581 vsize=2278932 CPUtime=25.49 cores=0,2,4,6
/proc/5583/stat : 5583 (qutersat_releas) R 5581 5583 5259 0 -1 4202496 487591 0 0 0 2495 54 0 0 25 0 1 0 666118271 2333626368 470937 33554432000 4194304 6014671 140737369535760 18446744073709551615 228244045579 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/5583/statm: 569733 470938 715 445 0 563278 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 2278932

[startup+51.1005 s]
/proc/loadavg: 2.04 2.03 2.00 3/437 5585
/proc/meminfo: memFree=22408416/32951124 swapFree=64205392/67111528
[pid=5583] ppid=5581 vsize=2499404 CPUtime=51.09 cores=0,2,4,6
/proc/5583/stat : 5583 (qutersat_releas) R 5581 5583 5259 0 -1 4202496 586536 0 0 0 5042 67 0 0 25 0 1 0 666118271 2559389696 569834 33554432000 4194304 6014671 140737369535760 18446744073709551615 4372155 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/5583/statm: 624851 569834 723 445 0 618396 0
Current children cumulated CPU time (s) 51.09
Current children cumulated vsize (KiB) 2499404

[startup+102.301 s]
/proc/loadavg: 2.01 2.02 2.00 3/437 5587
/proc/meminfo: memFree=22280600/32951124 swapFree=64205392/67111528
[pid=5583] ppid=5581 vsize=2811988 CPUtime=102.29 cores=0,2,4,6
/proc/5583/stat : 5583 (qutersat_releas) R 5581 5583 5259 0 -1 4202496 612416 0 0 0 10158 71 0 0 25 0 1 0 666118271 2879475712 593663 33554432000 4194304 6014671 140737369535760 18446744073709551615 4379528 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/5583/statm: 702997 593663 724 445 0 696542 0
Current children cumulated CPU time (s) 102.29
Current children cumulated vsize (KiB) 2811988

[startup+162.301 s]
/proc/loadavg: 2.00 2.01 2.00 3/437 5588
/proc/meminfo: memFree=22012696/32951124 swapFree=64205392/67111528
[pid=5583] ppid=5581 vsize=2853304 CPUtime=162.3 cores=0,2,4,6
/proc/5583/stat : 5583 (qutersat_releas) R 5581 5583 5259 0 -1 4202496 673590 0 0 0 16152 78 0 0 25 0 1 0 666118271 2921783296 654837 33554432000 4194304 6014671 140737369535760 18446744073709551615 4423875 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/5583/statm: 713326 654837 728 445 0 706871 0
Current children cumulated CPU time (s) 162.3
Current children cumulated vsize (KiB) 2853304

[startup+222.3 s]
/proc/loadavg: 2.00 2.01 2.00 3/437 5590
/proc/meminfo: memFree=21544776/32951124 swapFree=64205392/67111528
[pid=5583] ppid=5581 vsize=3523208 CPUtime=222.29 cores=0,2,4,6
/proc/5583/stat : 5583 (qutersat_releas) R 5581 5583 5259 0 -1 4202496 790307 0 0 0 22139 90 0 0 25 0 1 0 666118271 3607764992 771554 33554432000 4194304 6014671 140737369535760 18446744073709551615 4372165 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/5583/statm: 880802 771554 728 445 0 874347 0
Current children cumulated CPU time (s) 222.29
Current children cumulated vsize (KiB) 3523208

[startup+282.301 s]
/proc/loadavg: 2.00 2.00 2.00 3/437 5591
/proc/meminfo: memFree=21106864/32951124 swapFree=64205392/67111528
[pid=5583] ppid=5581 vsize=4177304 CPUtime=282.3 cores=0,2,4,6
/proc/5583/stat : 5583 (qutersat_releas) R 5581 5583 5259 0 -1 4202496 899443 0 0 0 28128 102 0 0 25 0 1 0 666118271 4277559296 880690 33554432000 4194304 6014671 140737369535760 18446744073709551615 4537068 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/5583/statm: 1044326 880690 728 445 0 1037871 0
Current children cumulated CPU time (s) 282.3
Current children cumulated vsize (KiB) 4177304

[startup+342.3 s]
/proc/loadavg: 2.10 2.03 2.00 3/437 5593
/proc/meminfo: memFree=20995316/32951124 swapFree=64205392/67111528
[pid=5583] ppid=5581 vsize=4459756 CPUtime=342.29 cores=0,2,4,6
/proc/5583/stat : 5583 (qutersat_releas) R 5581 5583 5259 0 -1 4202496 926943 0 0 0 34124 105 0 0 25 0 1 0 666118271 4566790144 908188 33554432000 4194304 6014671 140737369535760 18446744073709551615 4424351 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/5583/statm: 1114939 908188 729 445 0 1108484 0
Current children cumulated CPU time (s) 342.29
Current children cumulated vsize (KiB) 4459756

[startup+402.317 s]
/proc/loadavg: 2.13 2.05 2.01 3/437 5595
/proc/meminfo: memFree=20767464/32951124 swapFree=64205392/67111528
[pid=5583] ppid=5581 vsize=4536496 CPUtime=402.31 cores=0,2,4,6
/proc/5583/stat : 5583 (qutersat_releas) R 5581 5583 5259 0 -1 4202496 983018 0 0 0 40118 113 0 0 25 0 1 0 666118271 4645371904 964249 33554432000 4194304 6014671 140737369535760 18446744073709551615 4667172 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/5583/statm: 1134124 964249 729 445 0 1127669 0
Current children cumulated CPU time (s) 402.31
Current children cumulated vsize (KiB) 4536496

[startup+462.301 s]
/proc/loadavg: 2.04 2.04 2.00 3/437 5596
/proc/meminfo: memFree=20342576/32951124 swapFree=64205392/67111528
[pid=5583] ppid=5581 vsize=5215596 CPUtime=462.3 cores=0,2,4,6
/proc/5583/stat : 5583 (qutersat_releas) R 5581 5583 5259 0 -1 4202496 1087982 0 0 0 46104 126 0 0 25 0 1 0 666118271 5340770304 1069197 33554432000 4194304 6014671 140737369535760 18446744073709551615 4383654 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/5583/statm: 1303899 1069197 729 445 0 1297444 0
Current children cumulated CPU time (s) 462.3
Current children cumulated vsize (KiB) 5215596

[startup+522.301 s]
/proc/loadavg: 2.01 2.03 2.00 3/437 5598
/proc/meminfo: memFree=20292772/32951124 swapFree=64205392/67111528
[pid=5583] ppid=5581 vsize=5215724 CPUtime=522.3 cores=0,2,4,6
/proc/5583/stat : 5583 (qutersat_releas) R 5581 5583 5259 0 -1 4202496 1100411 0 0 0 52102 128 0 0 25 0 1 0 666118271 5340901376 1081626 33554432000 4194304 6014671 140737369535760 18446744073709551615 4372165 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/5583/statm: 1303931 1081626 729 445 0 1297476 0
Current children cumulated CPU time (s) 522.3
Current children cumulated vsize (KiB) 5215724

[startup+582.301 s]
/proc/loadavg: 2.00 2.02 2.00 3/437 5599
/proc/meminfo: memFree=19836392/32951124 swapFree=64205392/67111528
[pid=5583] ppid=5581 vsize=5622704 CPUtime=582.31 cores=0,2,4,6
/proc/5583/stat : 5583 (qutersat_releas) R 5581 5583 5259 0 -1 4202496 1217502 0 0 0 58089 142 0 0 25 0 1 0 666118271 5757648896 1198717 33554432000 4194304 6014671 140737369535760 18446744073709551615 4566286 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/5583/statm: 1405676 1198717 729 445 0 1399221 0
Current children cumulated CPU time (s) 582.31
Current children cumulated vsize (KiB) 5622704

[startup+642.301 s]

################
# More data... #
################

[startup+4062.3 s]
/proc/loadavg: 2.00 2.01 2.00 3/437 5732
/proc/meminfo: memFree=17630924/32951124 swapFree=64205392/67111528
[pid=5583] ppid=5581 vsize=8991188 CPUtime=4062.38 cores=0,2,4,6
/proc/5583/stat : 5583 (qutersat_releas) R 5581 5583 5259 0 -1 4202496 1891004 0 0 0 406001 237 0 0 25 0 1 0 666118271 9206976512 1834302 33554432000 4194304 6014671 140737369535760 18446744073709551615 4423315 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/5583/statm: 2247797 1834302 729 445 0 2241342 0
Current children cumulated CPU time (s) 4062.38
Current children cumulated vsize (KiB) 8991188

[startup+4122.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/437 5734
/proc/meminfo: memFree=17600484/32951124 swapFree=64205392/67111528
[pid=5583] ppid=5581 vsize=8991444 CPUtime=4122.38 cores=0,2,4,6
/proc/5583/stat : 5583 (qutersat_releas) R 5581 5583 5259 0 -1 4202496 1891625 0 0 0 412001 237 0 0 25 0 1 0 666118271 9207238656 1834923 33554432000 4194304 6014671 140737369535760 18446744073709551615 4372224 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/5583/statm: 2247861 1834923 729 445 0 2241406 0
Current children cumulated CPU time (s) 4122.38
Current children cumulated vsize (KiB) 8991444

[startup+4182.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/437 5735
/proc/meminfo: memFree=17576892/32951124 swapFree=64205392/67111528
[pid=5583] ppid=5581 vsize=8991444 CPUtime=4182.39 cores=0,2,4,6
/proc/5583/stat : 5583 (qutersat_releas) R 5581 5583 5259 0 -1 4202496 1897546 0 0 0 418001 238 0 0 25 0 1 0 666118271 9207238656 1840844 33554432000 4194304 6014671 140737369535760 18446744073709551615 4372224 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/5583/statm: 2247861 1840844 729 445 0 2241406 0
Current children cumulated CPU time (s) 4182.39
Current children cumulated vsize (KiB) 8991444

[startup+4242.3 s]
/proc/loadavg: 2.09 2.03 2.01 3/437 5737
/proc/meminfo: memFree=17478888/32951124 swapFree=64205392/67111528
[pid=5583] ppid=5581 vsize=8991444 CPUtime=4242.39 cores=0,2,4,6
/proc/5583/stat : 5583 (qutersat_releas) R 5581 5583 5259 0 -1 4202496 1921284 0 0 0 423997 242 0 0 25 0 1 0 666118271 9207238656 1864582 33554432000 4194304 6014671 140737369535760 18446744073709551615 4377923 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/5583/statm: 2247861 1864582 729 445 0 2241406 0
Current children cumulated CPU time (s) 4242.39
Current children cumulated vsize (KiB) 8991444

[startup+4302.3 s]
/proc/loadavg: 2.07 2.03 2.01 3/437 5739
/proc/meminfo: memFree=17474872/32951124 swapFree=64205392/67111528
[pid=5583] ppid=5581 vsize=8991444 CPUtime=4302.38 cores=0,2,4,6
/proc/5583/stat : 5583 (qutersat_releas) R 5581 5583 5259 0 -1 4202496 1922179 0 0 0 429996 242 0 0 25 0 1 0 666118271 9207238656 1865477 33554432000 4194304 6014671 140737369535760 18446744073709551615 4383630 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/5583/statm: 2247861 1865477 729 445 0 2241406 0
Current children cumulated CPU time (s) 4302.38
Current children cumulated vsize (KiB) 8991444

[startup+4362.32 s]
/proc/loadavg: 2.13 2.06 2.01 3/437 5740
/proc/meminfo: memFree=17412948/32951124 swapFree=64205392/67111528
[pid=5583] ppid=5581 vsize=8991444 CPUtime=4362.41 cores=0,2,4,6
/proc/5583/stat : 5583 (qutersat_releas) R 5581 5583 5259 0 -1 4202496 1937739 0 0 0 435996 245 0 0 25 0 1 0 666118271 9207238656 1881037 33554432000 4194304 6014671 140737369535760 18446744073709551615 4372372 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/5583/statm: 2247861 1881037 729 445 0 2241406 0
Current children cumulated CPU time (s) 4362.41
Current children cumulated vsize (KiB) 8991444

[startup+4422.3 s]
/proc/loadavg: 2.09 2.06 2.01 3/437 5742
/proc/meminfo: memFree=17312680/32951124 swapFree=64205392/67111528
[pid=5583] ppid=5581 vsize=9254228 CPUtime=4422.39 cores=0,2,4,6
/proc/5583/stat : 5583 (qutersat_releas) R 5581 5583 5259 0 -1 4202496 1962946 0 0 0 441991 248 0 0 25 0 1 0 666118271 9476329472 1906244 33554432000 4194304 6014671 140737369535760 18446744073709551615 4423315 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/5583/statm: 2313557 1906244 729 445 0 2307102 0
Current children cumulated CPU time (s) 4422.39
Current children cumulated vsize (KiB) 9254228

[startup+4482.3 s]
/proc/loadavg: 2.03 2.05 2.01 3/437 5743
/proc/meminfo: memFree=17276816/32951124 swapFree=64205392/67111528
[pid=5583] ppid=5581 vsize=9254228 CPUtime=4482.39 cores=0,2,4,6
/proc/5583/stat : 5583 (qutersat_releas) R 5581 5583 5259 0 -1 4202496 1971676 0 0 0 447989 250 0 0 25 0 1 0 666118271 9476329472 1914974 33554432000 4194304 6014671 140737369535760 18446744073709551615 4377892 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/5583/statm: 2313557 1914974 729 445 0 2307102 0
Current children cumulated CPU time (s) 4482.39
Current children cumulated vsize (KiB) 9254228

[startup+4542.3 s]
/proc/loadavg: 2.01 2.03 2.00 3/437 5745
/proc/meminfo: memFree=17207700/32951124 swapFree=64205392/67111528
[pid=5583] ppid=5581 vsize=9254228 CPUtime=4542.4 cores=0,2,4,6
/proc/5583/stat : 5583 (qutersat_releas) R 5581 5583 5259 0 -1 4202496 1989075 0 0 0 453986 254 0 0 25 0 1 0 666118271 9476329472 1932373 33554432000 4194304 6014671 140737369535760 18446744073709551615 4372121 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/5583/statm: 2313557 1932373 729 445 0 2307102 0
Current children cumulated CPU time (s) 4542.4
Current children cumulated vsize (KiB) 9254228

[startup+4602.3 s]
/proc/loadavg: 2.00 2.03 2.00 3/437 5747
/proc/meminfo: memFree=17135976/32951124 swapFree=64205392/67111528
[pid=5583] ppid=5581 vsize=9516884 CPUtime=4602.39 cores=0,2,4,6
/proc/5583/stat : 5583 (qutersat_releas) R 5581 5583 5259 0 -1 4202496 2006614 0 0 0 459983 256 0 0 25 0 1 0 666118271 9745289216 1949912 33554432000 4194304 6014671 140737369535760 18446744073709551615 4423856 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/5583/statm: 2379221 1949912 729 445 0 2372766 0
Current children cumulated CPU time (s) 4602.39
Current children cumulated vsize (KiB) 9516884

[startup+4662.3 s]
/proc/loadavg: 2.00 2.02 2.00 3/437 5748
/proc/meminfo: memFree=17072308/32951124 swapFree=64205392/67111528
[pid=5583] ppid=5581 vsize=9516884 CPUtime=4662.4 cores=0,2,4,6
/proc/5583/stat : 5583 (qutersat_releas) R 5581 5583 5259 0 -1 4202496 2022895 0 0 0 465981 259 0 0 25 0 1 0 666118271 9745289216 1966193 33554432000 4194304 6014671 140737369535760 18446744073709551615 4422808 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/5583/statm: 2379221 1966193 729 445 0 2372766 0
Current children cumulated CPU time (s) 4662.4
Current children cumulated vsize (KiB) 9516884

[startup+4722.3 s]
/proc/loadavg: 2.00 2.01 2.00 3/437 5750
/proc/meminfo: memFree=16996484/32951124 swapFree=64205392/67111528
[pid=5583] ppid=5581 vsize=9516884 CPUtime=4722.39 cores=0,2,4,6
/proc/5583/stat : 5583 (qutersat_releas) R 5581 5583 5259 0 -1 4202496 2040542 0 0 0 471976 263 0 0 25 0 1 0 666118271 9745289216 1983840 33554432000 4194304 6014671 140737369535760 18446744073709551615 4372077 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/5583/statm: 2379221 1983840 729 445 0 2372766 0
Current children cumulated CPU time (s) 4722.39
Current children cumulated vsize (KiB) 9516884

[startup+4782.3 s]
/proc/loadavg: 2.00 2.01 2.00 3/437 5751
/proc/meminfo: memFree=16933584/32951124 swapFree=64205392/67111528
[pid=5583] ppid=5581 vsize=9516884 CPUtime=4782.39 cores=0,2,4,6
/proc/5583/stat : 5583 (qutersat_releas) R 5581 5583 5259 0 -1 4202496 2056011 0 0 0 477973 266 0 0 25 0 1 0 666118271 9745289216 1999309 33554432000 4194304 6014671 140737369535760 18446744073709551615 4372352 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/5583/statm: 2379221 1999309 729 445 0 2372766 0
Current children cumulated CPU time (s) 4782.39
Current children cumulated vsize (KiB) 9516884

[startup+4842.3 s]
/proc/loadavg: 2.06 2.02 2.00 3/437 5753
/proc/meminfo: memFree=16886416/32951124 swapFree=64205392/67111528
[pid=5583] ppid=5581 vsize=9516884 CPUtime=4842.4 cores=0,2,4,6
/proc/5583/stat : 5583 (qutersat_releas) R 5581 5583 5259 0 -1 4202496 2067573 0 0 0 483972 268 0 0 25 0 1 0 666118271 9745289216 2010871 33554432000 4194304 6014671 140737369535760 18446744073709551615 4371954 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/5583/statm: 2379221 2010871 729 445 0 2372766 0
Current children cumulated CPU time (s) 4842.4
Current children cumulated vsize (KiB) 9516884

[startup+4902.3 s]
/proc/loadavg: 2.17 2.05 2.01 3/437 5755
/proc/meminfo: memFree=16878812/32951124 swapFree=64205392/67111528
[pid=5583] ppid=5581 vsize=9516884 CPUtime=4902.4 cores=0,2,4,6
/proc/5583/stat : 5583 (qutersat_releas) R 5581 5583 5259 0 -1 4202496 2068464 0 0 0 489972 268 0 0 25 0 1 0 666118271 9745289216 2011762 33554432000 4194304 6014671 140737369535760 18446744073709551615 4372452 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/5583/statm: 2379221 2011762 729 445 0 2372766 0
Current children cumulated CPU time (s) 4902.4
Current children cumulated vsize (KiB) 9516884

[startup+4962.3 s]
/proc/loadavg: 2.13 2.05 2.01 3/437 5756
/proc/meminfo: memFree=16875412/32951124 swapFree=64205392/67111528
[pid=5583] ppid=5581 vsize=9516884 CPUtime=4962.4 cores=0,2,4,6
/proc/5583/stat : 5583 (qutersat_releas) R 5581 5583 5259 0 -1 4202496 2069221 0 0 0 495972 268 0 0 25 0 1 0 666118271 9745289216 2012519 33554432000 4194304 6014671 140737369535760 18446744073709551615 4422760 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/5583/statm: 2379221 2012519 729 445 0 2372766 0
Current children cumulated CPU time (s) 4962.4
Current children cumulated vsize (KiB) 9516884



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+4999.9 s]
/proc/loadavg: 2.06 2.04 2.01 3/437 5757
/proc/meminfo: memFree=16875384/32951124 swapFree=64205392/67111528
[pid=5583] ppid=5581 vsize=9516884 CPUtime=5000.01 cores=0,2,4,6
/proc/5583/stat : 5583 (qutersat_releas) R 5581 5583 5259 0 -1 4202496 2069227 0 0 0 499733 268 0 0 25 0 1 0 666118271 9745289216 2012525 33554432000 4194304 6014671 140737369535760 18446744073709551615 4372109 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/5583/statm: 2379221 2012525 729 445 0 2372766 0
Current children cumulated CPU time (s) 5000.01
Current children cumulated vsize (KiB) 9516884

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5000.2 s]
/proc/loadavg: 2.06 2.04 2.01 3/438 5758
/proc/meminfo: memFree=24663816/32951124 swapFree=64205392/67111528
[pid=5583] ppid=5581 vsize=0 CPUtime=5000.31 cores=0,2,4,6
/proc/5583/stat : 5583 (qutersat_releas) R 5581 5583 5259 0 -1 4202500 2069231 0 0 0 499734 297 0 0 25 0 1 0 666118271 0 0 33554432000 0 0 0 0 0 0 16384 4096 16386 18446744073709551615 0 0 17 4 0 0 0
/proc/5583/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 5000.31
Current children cumulated vsize (KiB) 0

Child status: 1
Real time (s): 5000.26
CPU time (s): 5000.32
CPU user time (s): 4997.34
CPU system time (s): 2.98255
CPU usage (%): 100.001
Max. virtual memory (cumulated for all children) (KiB): 9516884

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4997.34
system time used= 2.98255
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 2069231
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 13
involuntary context switches= 10279

runsolver used 22.9205 second user time and 49.5635 second system time

The end

Launcher Data 

Begin job on node136 at 2011-05-16 13:26:43
IDJOB=3384351
IDBENCH=82387
IDSOLVER=1868
FILE ID=node136/3384351-1305545200
RUNJOBID= node136-1305540197-5277
PBS_JOBID= 13329217
Free space on /tmp= 72892 MiB

SOLVER NAME= QuteRSat 2011-05-12 (fixed)
BENCH NAME= SAT11/application/rintanen/SATPlanning/transport-transport-three-cities-sequential-14nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.020-NOTKNOWN.cnf
COMMAND LINE= qutersat_release BENCHNAME RANDOMSEED
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3384351-1305545200/watcher-3384351-1305545200 -o /tmp/evaluation-result-3384351-1305545200/solver-3384351-1305545200 -C 5000 -W 5100 -M 15500  qutersat_release HOME/instance-3384351-1305545200.cnf 590367528

TIME LIMIT= 5000 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 5d1253e2dcc0e3e55992672756beadbc
RANDOM SEED=590367528

node136.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      24715132 kB
Buffers:         15172 kB
Cached:         617980 kB
SwapCached:      24924 kB
Active:        1605036 kB
Inactive:      6423632 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      24715132 kB
SwapTotal:    67111528 kB
SwapFree:     64205392 kB
Dirty:           80372 kB
Writeback:           0 kB
AnonPages:     7376668 kB
Mapped:          34792 kB
Slab:            87820 kB
PageTables:      53612 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 123241768 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72888 MiB
End job on node136 at 2011-05-16 14:50:05