Trace number 3384352

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
QuteRSat 2011-05-12 (fixed)? (TO) 5000.56 5000.82

General information on the benchmark

Nameapplication/rintanen/SATPlanning/
transport-transport-city-sequential-35nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.050-SAT.cnf
MD5SUM48f03e5fbe31fc85b9a464480fc8aa5a
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark745.077
Satisfiable
(Un)Satisfiability was proved
Number of variables1575206
Number of clauses8464620
Sum of the clauses size20118920
Maximum clause length982
Minimum clause length1
Number of clauses of size 1720
Number of clauses of size 28393300
Number of clauses of size 3400
Number of clauses of size 41600
Number of clauses of size 54000
Number of clauses of size over 564600

Solver Data 

0.00/0.00	c Set FPU double precision.
4.39/4.43	c Parse Cnf success: #var: 1575206 #clause: 8464620
4.39/4.43	c Find Units :        720
5.09/5.17	c Find Invs  :          0
5.59/5.69	c Find Ands  :        200 AvgFaninNum: 2
5.69/5.70	c Find Xors  :          0 AvgFaninNum: nan
5.69/5.70	c Find Ite   :          0
5.69/5.71	c UnDirect variable: 0
5.69/5.71	c UnDirect to Direct Gate: 0
5.69/5.71	c Forced Direct Gate: 0 Unuse unDirect Gate: 0
5.69/5.73	c Break Cycle : 0
5.69/5.73	c Total Root : 200 Undef Var: 1575006
5.69/5.77	c After covering, Total Root: 200 Leaf: 920
5.69/5.77	c Variable( cover/uncovered/unused ): 1120 1574086 0
5.69/5.77	c Unit Clauses: 720
5.69/5.77	c Binary Clauses( cover/uncovered ): 400 8392900
5.69/5.77	c Clauses( cover/uncovered ): 200 70400
5.69/5.77	c Total Clauses( cover/uncovered ): 1320 8463300 0.0155943%
5.69/5.77	c Covered Ands: 200 Invs: 0 Xors: 0 Ites: 0
12.58/12.63	c Uncover Clauses avg size: 2.37695 max size: 982
12.68/12.78	c Final circuit: i/l/o/s 1574286       0 7817640   9725283
12.68/12.78	c CnfToAig: Time: 12.76 s
19.38/19.49	c TmMap: Set choices finish.
24.59/24.61	c TmMap: Set big and: 8197445
24.59/24.61	c TmMap: Origin: 11299570 ClauseNum: 29175849 --> New: 9771924 ClauseNum: 26125614
24.59/24.61	c TmMap: Time: 6.09
26.18/26.21	c Try to Add: #clause: 16395848 #xorclause: 0
29.08/29.12	c #var: 1954283 #clauses: 513694 Solving... 
5000.05/5000.31	c Time Out !!
5000.05/5000.31	s UNKNOWN

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3384352-1305545201/watcher-3384352-1305545201 -o /tmp/evaluation-result-3384352-1305545201/solver-3384352-1305545201 -C 5000 -W 5100 -M 15500 qutersat_release HOME/instance-3384352-1305545201.cnf 590367528 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 5000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 5030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.00 2.02 2.00 2/343 4493
/proc/meminfo: memFree=10512740/32951124 swapFree=65222232/67111528
[pid=4493] ppid=4491 vsize=69284 CPUtime=0 cores=0,2,4,6
/proc/4493/stat : 4493 (qutersat_releas) R 4491 4493 4225 0 -1 4202496 4927 0 0 0 0 0 0 0 23 0 1 0 666118470 70946816 4863 33554432000 4194304 6014671 140737136190800 18446744073709551615 4271051 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/4493/statm: 17321 4877 370 445 0 10866 0

[startup+0.0756681 s]
/proc/loadavg: 2.00 2.02 2.00 2/343 4493
/proc/meminfo: memFree=10512740/32951124 swapFree=65222232/67111528
[pid=4493] ppid=4491 vsize=80548 CPUtime=0.07 cores=0,2,4,6
/proc/4493/stat : 4493 (qutersat_releas) R 4491 4493 4225 0 -1 4202496 13920 0 0 0 6 1 0 0 23 0 1 0 666118470 82481152 13856 33554432000 4194304 6014671 140737136190800 18446744073709551615 255377301248 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/4493/statm: 20137 13857 378 445 0 13682 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 80548

[startup+0.100667 s]
/proc/loadavg: 2.00 2.02 2.00 2/343 4493
/proc/meminfo: memFree=10512740/32951124 swapFree=65222232/67111528
[pid=4493] ppid=4491 vsize=92836 CPUtime=0.09 cores=0,2,4,6
/proc/4493/stat : 4493 (qutersat_releas) R 4491 4493 4225 0 -1 4202496 16570 0 0 0 8 1 0 0 23 0 1 0 666118470 95064064 16506 33554432000 4194304 6014671 140737136190800 18446744073709551615 4308338 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/4493/statm: 23209 16506 378 445 0 16754 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 92836

[startup+0.300629 s]
/proc/loadavg: 2.00 2.02 2.00 2/343 4493
/proc/meminfo: memFree=10512740/32951124 swapFree=65222232/67111528
[pid=4493] ppid=4491 vsize=117540 CPUtime=0.29 cores=0,2,4,6
/proc/4493/stat : 4493 (qutersat_releas) R 4491 4493 4225 0 -1 4202496 22865 0 0 0 26 3 0 0 25 0 1 0 666118470 120360960 22801 33554432000 4194304 6014671 140737136190800 18446744073709551615 255377301248 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/4493/statm: 29385 22802 378 445 0 22930 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 117540

[startup+0.700525 s]
/proc/loadavg: 2.00 2.02 2.00 2/343 4493
/proc/meminfo: memFree=10512740/32951124 swapFree=65222232/67111528
[pid=4493] ppid=4491 vsize=167332 CPUtime=0.68 cores=0,2,4,6
/proc/4493/stat : 4493 (qutersat_releas) R 4491 4493 4225 0 -1 4202496 35300 0 0 0 64 4 0 0 25 0 1 0 666118470 171347968 35236 33554432000 4194304 6014671 140737136190800 18446744073709551615 4309366 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/4493/statm: 41833 35236 378 445 0 35378 0
Current children cumulated CPU time (s) 0.68
Current children cumulated vsize (KiB) 167332

[startup+2.36723 s]
/proc/loadavg: 2.00 2.02 2.00 2/343 4493
/proc/meminfo: memFree=10512740/32951124 swapFree=65222232/67111528
[pid=4493] ppid=4491 vsize=463524 CPUtime=2.36 cores=0,2,4,6
/proc/4493/stat : 4493 (qutersat_releas) R 4491 4493 4225 0 -1 4202496 103307 0 0 0 220 16 0 0 25 0 1 0 666118470 474648576 103243 33554432000 4194304 6014671 140737136190800 18446744073709551615 4277219 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/4493/statm: 115881 103244 378 445 0 109426 0
Current children cumulated CPU time (s) 2.36
Current children cumulated vsize (KiB) 463524

[startup+3.10108 s]
/proc/loadavg: 2.16 2.05 2.01 3/344 4494
/proc/meminfo: memFree=10094484/32951124 swapFree=65222232/67111528
[pid=4493] ppid=4491 vsize=463908 CPUtime=3.09 cores=0,2,4,6
/proc/4493/stat : 4493 (qutersat_releas) R 4491 4493 4225 0 -1 4202496 108146 0 0 0 291 18 0 0 25 0 1 0 666118470 475041792 108082 33554432000 4194304 6014671 140737136190800 18446744073709551615 4309366 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/4493/statm: 115977 108082 378 445 0 109522 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 463908

[startup+6.30053 s]
/proc/loadavg: 2.16 2.05 2.01 3/344 4494
/proc/meminfo: memFree=9811576/32951124 swapFree=65222232/67111528
[pid=4493] ppid=4491 vsize=857892 CPUtime=6.28 cores=0,2,4,6
/proc/4493/stat : 4493 (qutersat_releas) R 4491 4493 4225 0 -1 4202496 195445 0 0 0 600 28 0 0 25 0 1 0 666118470 878481408 178998 33554432000 4194304 6014671 140737136190800 18446744073709551615 4313890 0 0 4096 16386 0 0 0 17 0 0 0 0
/proc/4493/statm: 214473 179012 398 445 0 208018 0
Current children cumulated CPU time (s) 6.28
Current children cumulated vsize (KiB) 857892

[startup+12.7003 s]
/proc/loadavg: 2.13 2.05 2.01 3/344 4495
/proc/meminfo: memFree=9153880/32951124 swapFree=65222232/67111528
[pid=4493] ppid=4491 vsize=1449252 CPUtime=12.68 cores=0,2,4,6
/proc/4493/stat : 4493 (qutersat_releas) R 4491 4493 4225 0 -1 4202496 356349 0 0 0 1220 48 0 0 25 0 1 0 666118470 1484034048 339901 33554432000 4194304 6014671 140737136190800 18446744073709551615 4313985 0 0 4096 16386 0 0 0 17 0 0 0 0
/proc/4493/statm: 362313 339901 398 445 0 355858 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 1449252

[startup+25.501 s]
/proc/loadavg: 2.11 2.04 2.01 3/344 4495
/proc/meminfo: memFree=6505832/32951124 swapFree=65222232/67111528
[pid=4493] ppid=4491 vsize=4246248 CPUtime=25.48 cores=0,2,4,6
/proc/4493/stat : 4493 (qutersat_releas) R 4491 4493 4225 0 -1 4202496 1029892 0 0 0 2410 138 0 0 25 0 1 0 666118470 4348157952 1000948 33554432000 4194304 6014671 140737136190800 18446744073709551615 4259098 0 0 4096 16386 0 0 0 17 0 0 0 0
/proc/4493/statm: 1061562 1000948 670 445 0 1055107 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 4246248

[startup+51.1012 s]
/proc/loadavg: 2.07 2.04 2.01 3/344 4496
/proc/meminfo: memFree=6501708/32951124 swapFree=65222232/67111528
[pid=4493] ppid=4491 vsize=4246248 CPUtime=51.08 cores=0,2,4,6
/proc/4493/stat : 4493 (qutersat_releas) R 4491 4493 4225 0 -1 4202496 1030425 0 0 0 4970 138 0 0 25 0 1 0 666118470 4348157952 1000988 33554432000 4194304 6014671 140737136190800 18446744073709551615 4555913 0 0 4096 16386 0 0 0 17 0 0 0 0
/proc/4493/statm: 1061562 1000988 716 445 0 1055107 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 4246248

[startup+102.301 s]
/proc/loadavg: 2.10 2.05 2.01 3/344 4497
/proc/meminfo: memFree=6505464/32951124 swapFree=65222232/67111528
[pid=4493] ppid=4491 vsize=4249320 CPUtime=102.28 cores=0,2,4,6
/proc/4493/stat : 4493 (qutersat_releas) R 4491 4493 4225 0 -1 4202496 1030898 0 0 0 10089 139 0 0 25 0 1 0 666118470 4351303680 1001461 33554432000 4194304 6014671 140737136190800 18446744073709551615 4423856 0 0 4096 16386 0 0 0 17 0 0 0 0
/proc/4493/statm: 1062330 1001461 723 445 0 1055875 0
Current children cumulated CPU time (s) 102.28
Current children cumulated vsize (KiB) 4249320

[startup+162.301 s]
/proc/loadavg: 2.04 2.03 2.00 3/344 4527
/proc/meminfo: memFree=7185980/32951124 swapFree=65222232/67111528
[pid=4493] ppid=4491 vsize=4532456 CPUtime=162.29 cores=0,2,4,6
/proc/4493/stat : 4493 (qutersat_releas) R 4491 4493 4225 0 -1 4202496 1048339 0 0 0 16086 143 0 0 25 0 1 0 666118470 4641234944 1018902 33554432000 4194304 6014671 140737136190800 18446744073709551615 4372262 0 0 4096 16386 0 0 0 17 0 0 0 0
/proc/4493/statm: 1133114 1018902 723 445 0 1126659 0
Current children cumulated CPU time (s) 162.29
Current children cumulated vsize (KiB) 4532456

[startup+222.301 s]
/proc/loadavg: 2.01 2.03 2.00 3/344 4528
/proc/meminfo: memFree=7057416/32951124 swapFree=65222232/67111528
[pid=4493] ppid=4491 vsize=4603576 CPUtime=222.29 cores=0,2,4,6
/proc/4493/stat : 4493 (qutersat_releas) R 4491 4493 4225 0 -1 4202496 1074993 0 0 0 22081 148 0 0 25 0 1 0 666118470 4714061824 1045488 33554432000 4194304 6014671 140737136190800 18446744073709551615 4372236 0 0 4096 16386 0 0 0 17 0 0 0 0
/proc/4493/statm: 1150894 1045488 724 445 0 1144439 0
Current children cumulated CPU time (s) 222.29
Current children cumulated vsize (KiB) 4603576

[startup+282.3 s]
/proc/loadavg: 2.06 2.03 2.00 3/344 4530
/proc/meminfo: memFree=6964236/32951124 swapFree=65222232/67111528
[pid=4493] ppid=4491 vsize=4603576 CPUtime=282.29 cores=0,2,4,6
/proc/4493/stat : 4493 (qutersat_releas) R 4491 4493 4225 0 -1 4202496 1094616 0 0 0 28078 151 0 0 25 0 1 0 666118470 4714061824 1065111 33554432000 4194304 6014671 140737136190800 18446744073709551615 4385249 0 0 4096 16386 0 0 0 17 0 0 0 0
/proc/4493/statm: 1150894 1065111 728 445 0 1144439 0
Current children cumulated CPU time (s) 282.29
Current children cumulated vsize (KiB) 4603576

[startup+342.3 s]
/proc/loadavg: 2.02 2.03 2.00 3/344 4585
/proc/meminfo: memFree=6845120/32951124 swapFree=65222232/67111528
[pid=4493] ppid=4491 vsize=4990376 CPUtime=342.29 cores=0,2,4,6
/proc/4493/stat : 4493 (qutersat_releas) R 4491 4493 4225 0 -1 4202496 1205602 0 0 0 34060 169 0 0 25 0 1 0 666118470 5110145024 1176097 33554432000 4194304 6014671 140737136190800 18446744073709551615 4372446 0 0 4096 16386 0 0 0 17 0 0 0 0
/proc/4493/statm: 1247594 1176097 728 445 0 1241139 0
Current children cumulated CPU time (s) 342.29
Current children cumulated vsize (KiB) 4990376

[startup+402.301 s]
/proc/loadavg: 2.04 2.03 2.00 3/344 4614
/proc/meminfo: memFree=6493552/32951124 swapFree=65222232/67111528
[pid=4493] ppid=4491 vsize=5304344 CPUtime=402.3 cores=0,2,4,6
/proc/4493/stat : 4493 (qutersat_releas) R 4491 4493 4225 0 -1 4202496 1267335 0 0 0 40050 180 0 0 25 0 1 0 666118470 5431648256 1237830 33554432000 4194304 6014671 140737136190800 18446744073709551615 4423856 0 0 4096 16386 0 0 0 17 0 0 0 0
/proc/4493/statm: 1326086 1237830 728 445 0 1319631 0
Current children cumulated CPU time (s) 402.3
Current children cumulated vsize (KiB) 5304344

[startup+462.301 s]
/proc/loadavg: 2.08 2.04 2.00 3/344 4616
/proc/meminfo: memFree=6155036/32951124 swapFree=65222232/67111528
[pid=4493] ppid=4491 vsize=5639896 CPUtime=462.31 cores=0,2,4,6
/proc/4493/stat : 4493 (qutersat_releas) R 4491 4493 4225 0 -1 4202496 1335560 0 0 0 46040 191 0 0 25 0 1 0 666118470 5775253504 1306045 33554432000 4194304 6014671 140737136190800 18446744073709551615 4372452 0 0 4096 16386 0 0 0 17 0 0 0 0
/proc/4493/statm: 1409974 1306045 728 445 0 1403519 0
Current children cumulated CPU time (s) 462.31
Current children cumulated vsize (KiB) 5639896

[startup+522.301 s]
/proc/loadavg: 2.03 2.03 2.00 3/344 4617
/proc/meminfo: memFree=6141396/32951124 swapFree=65222232/67111528
[pid=4493] ppid=4491 vsize=5640024 CPUtime=522.3 cores=0,2,4,6
/proc/4493/stat : 4493 (qutersat_releas) R 4491 4493 4225 0 -1 4202496 1335568 0 0 0 52039 191 0 0 25 0 1 0 666118470 5775384576 1306053 33554432000 4194304 6014671 140737136190800 18446744073709551615 4423853 0 0 4096 16386 0 0 0 17 0 0 0 0
/proc/4493/statm: 1410006 1306053 728 445 0 1403551 0
Current children cumulated CPU time (s) 522.3
Current children cumulated vsize (KiB) 5640024

[startup+582.313 s]
/proc/loadavg: 2.20 2.07 2.01 3/344 4619
/proc/meminfo: memFree=5645828/32951124 swapFree=65222232/67111528
[pid=4493] ppid=4491 vsize=6273840 CPUtime=582.32 cores=0,2,4,6
/proc/4493/stat : 4493 (qutersat_releas) R 4491 4493 4225 0 -1 4202496 1449498 0 0 0 58025 207 0 0 25 0 1 0 666118470 6424412160 1419983 33554432000 4194304 6014671 140737136190800 18446744073709551615 4536732 0 0 4096 16386 0 0 0 17 0 0 0 0
/proc/4493/statm: 1568460 1419983 728 445 0 1562005 0
Current children cumulated CPU time (s) 582.32
Current children cumulated vsize (KiB) 6273840

[startup+642.301 s]

################
# More data... #
################

[startup+4182.3 s]
/proc/loadavg: 2.09 2.05 2.01 3/344 4727
/proc/meminfo: memFree=93200/32951124 swapFree=64404548/67111528
[pid=4493] ppid=4491 vsize=13447888 CPUtime=4182.12 cores=0,2,4,6
/proc/4493/stat : 4493 (qutersat_releas) R 4491 4493 4225 0 -1 4202496 3064550 0 0 0 417709 503 0 0 25 0 1 0 666118470 13770637312 2951365 33554432000 4194304 6014671 140737136190800 18446744073709551615 4372390 0 0 4096 16386 0 0 0 17 4 0 0 12
/proc/4493/statm: 3361972 2951365 728 445 0 3355517 0
Current children cumulated CPU time (s) 4182.12
Current children cumulated vsize (KiB) 13447888

[startup+4242.3 s]
/proc/loadavg: 2.08 2.06 2.01 3/344 4728
/proc/meminfo: memFree=96896/32951124 swapFree=64289280/67111528
[pid=4493] ppid=4491 vsize=13448016 CPUtime=4242.09 cores=0,2,4,6
/proc/4493/stat : 4493 (qutersat_releas) R 4491 4493 4225 0 -1 4202496 3092413 0 0 0 423699 510 0 0 25 0 1 0 666118470 13770768384 2979228 33554432000 4194304 6014671 140737136190800 18446744073709551615 4372366 0 0 4096 16386 0 0 0 17 4 0 0 12
/proc/4493/statm: 3362004 2979228 728 445 0 3355549 0
Current children cumulated CPU time (s) 4242.09
Current children cumulated vsize (KiB) 13448016

[startup+4302.3 s]
/proc/loadavg: 2.10 2.06 2.01 3/344 4730
/proc/meminfo: memFree=94464/32951124 swapFree=64208344/67111528
[pid=4493] ppid=4491 vsize=13679632 CPUtime=4302.08 cores=0,2,4,6
/proc/4493/stat : 4493 (qutersat_releas) R 4491 4493 4225 0 -1 4202496 3114184 0 0 0 429694 514 0 0 25 0 1 0 666118470 14007943168 3000999 33554432000 4194304 6014671 140737136190800 18446744073709551615 4424123 0 0 4096 16386 0 0 0 17 4 0 0 12
/proc/4493/statm: 3419908 3000999 728 445 0 3413453 0
Current children cumulated CPU time (s) 4302.08
Current children cumulated vsize (KiB) 13679632

[startup+4362.3 s]
/proc/loadavg: 2.08 2.06 2.00 3/344 4732
/proc/meminfo: memFree=94880/32951124 swapFree=64088784/67111528
[pid=4493] ppid=4491 vsize=13679632 CPUtime=4362.07 cores=0,2,4,6
/proc/4493/stat : 4493 (qutersat_releas) R 4491 4493 4225 0 -1 4202496 3139674 0 0 0 435689 518 0 0 25 0 1 0 666118470 14007943168 3026489 33554432000 4194304 6014671 140737136190800 18446744073709551615 4372248 0 0 4096 16386 0 0 0 17 4 0 0 12
/proc/4493/statm: 3419908 3026489 728 445 0 3413453 0
Current children cumulated CPU time (s) 4362.07
Current children cumulated vsize (KiB) 13679632

[startup+4422.3 s]
/proc/loadavg: 2.13 2.08 2.01 3/344 4733
/proc/meminfo: memFree=96560/32951124 swapFree=64015968/67111528
[pid=4493] ppid=4491 vsize=13679760 CPUtime=4422.06 cores=0,2,4,6
/proc/4493/stat : 4493 (qutersat_releas) R 4491 4493 4225 0 -1 4202496 3163641 0 0 0 441683 523 0 0 25 0 1 0 666118470 14008074240 3050456 33554432000 4194304 6014671 140737136190800 18446744073709551615 4372165 0 0 4096 16386 0 0 0 17 4 0 0 12
/proc/4493/statm: 3419940 3050456 728 445 0 3413485 0
Current children cumulated CPU time (s) 4422.06
Current children cumulated vsize (KiB) 13679760

[startup+4482.3 s]
/proc/loadavg: 2.05 2.06 2.00 3/344 4735
/proc/meminfo: memFree=95836/32951124 swapFree=63925040/67111528
[pid=4493] ppid=4491 vsize=13918700 CPUtime=4482.03 cores=0,2,4,6
/proc/4493/stat : 4493 (qutersat_releas) R 4491 4493 4225 0 -1 4202496 3186492 0 0 0 447674 529 0 0 25 0 1 0 666118470 14252748800 3073307 33554432000 4194304 6014671 140737136190800 18446744073709551615 4372162 0 0 4096 16386 0 0 0 17 0 0 0 12
/proc/4493/statm: 3479675 3073307 728 445 0 3473220 0
Current children cumulated CPU time (s) 4482.03
Current children cumulated vsize (KiB) 13918700

[startup+4542.31 s]
/proc/loadavg: 2.02 2.05 2.00 3/344 4736
/proc/meminfo: memFree=97260/32951124 swapFree=63835580/67111528
[pid=4493] ppid=4491 vsize=13918828 CPUtime=4542.04 cores=0,2,4,6
/proc/4493/stat : 4493 (qutersat_releas) R 4491 4493 4225 0 -1 4202496 3207582 0 0 0 453670 534 0 0 25 0 1 0 666118470 14252879872 3094397 33554432000 4194304 6014671 140737136190800 18446744073709551615 255376998511 0 0 4096 16386 0 0 0 17 0 0 0 12
/proc/4493/statm: 3479707 3094397 728 445 0 3473252 0
Current children cumulated CPU time (s) 4542.04
Current children cumulated vsize (KiB) 13918828

[startup+4602.3 s]
/proc/loadavg: 2.00 2.04 2.00 3/344 4738
/proc/meminfo: memFree=96288/32951124 swapFree=63767096/67111528
[pid=4493] ppid=4491 vsize=14164044 CPUtime=4602.03 cores=0,2,4,6
/proc/4493/stat : 4493 (qutersat_releas) R 4491 4493 4225 0 -1 4202496 3225056 0 0 0 459666 537 0 0 25 0 1 0 666118470 14503981056 3111871 33554432000 4194304 6014671 140737136190800 18446744073709551615 4424339 0 0 4096 16386 0 0 0 17 0 0 0 12
/proc/4493/statm: 3541011 3111871 728 445 0 3534556 0
Current children cumulated CPU time (s) 4602.03
Current children cumulated vsize (KiB) 14164044

[startup+4662.3 s]
/proc/loadavg: 2.00 2.03 2.00 3/344 4740
/proc/meminfo: memFree=97608/32951124 swapFree=63654648/67111528
[pid=4493] ppid=4491 vsize=14164044 CPUtime=4662.03 cores=0,2,4,6
/proc/4493/stat : 4493 (qutersat_releas) R 4491 4493 4225 0 -1 4202496 3248680 0 0 0 465661 542 0 0 25 0 1 0 666118470 14503981056 3135495 33554432000 4194304 6014671 140737136190800 18446744073709551615 4423994 0 0 4096 16386 0 0 0 17 0 0 0 12
/proc/4493/statm: 3541011 3135495 728 445 0 3534556 0
Current children cumulated CPU time (s) 4662.03
Current children cumulated vsize (KiB) 14164044

[startup+4722.3 s]
/proc/loadavg: 2.00 2.02 2.00 3/344 4741
/proc/meminfo: memFree=93228/32951124 swapFree=63564592/67111528
[pid=4493] ppid=4491 vsize=14164044 CPUtime=4722.03 cores=0,2,4,6
/proc/4493/stat : 4493 (qutersat_releas) R 4491 4493 4225 0 -1 4202496 3272808 0 0 0 471656 547 0 0 25 0 1 0 666118470 14503981056 3159623 33554432000 4194304 6014671 140737136190800 18446744073709551615 4372095 0 0 4096 16386 0 0 0 17 0 0 0 12
/proc/4493/statm: 3541011 3159623 728 445 0 3534556 0
Current children cumulated CPU time (s) 4722.03
Current children cumulated vsize (KiB) 14164044

[startup+4782.3 s]
/proc/loadavg: 2.00 2.02 2.00 3/344 4743
/proc/meminfo: memFree=215332/32951124 swapFree=63526400/67111528
[pid=4493] ppid=4491 vsize=14415640 CPUtime=4782.04 cores=0,2,4,6
/proc/4493/stat : 4493 (qutersat_releas) R 4491 4493 4225 0 -1 4202496 3290789 0 0 0 477651 553 0 0 25 0 1 0 666118470 14761615360 3130439 33554432000 4194304 6014671 140737136190800 18446744073709551615 4372248 0 0 4096 16386 0 0 0 17 0 0 0 12
/proc/4493/statm: 3603910 3130439 728 445 0 3597455 0
Current children cumulated CPU time (s) 4782.04
Current children cumulated vsize (KiB) 14415640

[startup+4842.3 s]
/proc/loadavg: 2.00 2.01 2.00 3/344 4744
/proc/meminfo: memFree=94112/32951124 swapFree=63526400/67111528
[pid=4493] ppid=4491 vsize=14415640 CPUtime=4842.03 cores=0,2,4,6
/proc/4493/stat : 4493 (qutersat_releas) R 4491 4493 4225 0 -1 4202496 3314104 0 0 0 483645 558 0 0 25 0 1 0 666118470 14761615360 3153754 33554432000 4194304 6014671 140737136190800 18446744073709551615 4372266 0 0 4096 16386 0 0 0 17 0 0 0 12
/proc/4493/statm: 3603910 3153754 728 445 0 3597455 0
Current children cumulated CPU time (s) 4842.03
Current children cumulated vsize (KiB) 14415640

[startup+4902.3 s]
/proc/loadavg: 2.06 2.02 2.00 3/344 4746
/proc/meminfo: memFree=97812/32951124 swapFree=63461036/67111528
[pid=4493] ppid=4491 vsize=14673660 CPUtime=4902.04 cores=0,2,4,6
/proc/4493/stat : 4493 (qutersat_releas) R 4491 4493 4225 0 -1 4202496 3332923 0 0 0 489640 564 0 0 25 0 1 0 666118470 15025827840 3172573 33554432000 4194304 6014671 140737136190800 18446744073709551615 4372121 0 0 4096 16386 0 0 0 17 0 0 0 12
/proc/4493/statm: 3668415 3172573 728 445 0 3661960 0
Current children cumulated CPU time (s) 4902.04
Current children cumulated vsize (KiB) 14673660

[startup+4962.3 s]
/proc/loadavg: 2.02 2.01 2.00 3/344 4748
/proc/meminfo: memFree=95384/32951124 swapFree=63364208/67111528
[pid=4493] ppid=4491 vsize=14673788 CPUtime=4962.04 cores=0,2,4,6
/proc/4493/stat : 4493 (qutersat_releas) R 4491 4493 4225 0 -1 4202496 3356528 0 0 0 495635 569 0 0 25 0 1 0 666118470 15025958912 3196178 33554432000 4194304 6014671 140737136190800 18446744073709551615 4372165 0 0 4096 16386 0 0 0 17 0 0 0 12
/proc/4493/statm: 3668447 3196178 728 445 0 3661992 0
Current children cumulated CPU time (s) 4962.04
Current children cumulated vsize (KiB) 14673788



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5000.3 s]
/proc/loadavg: 2.06 2.03 2.00 3/344 4749
/proc/meminfo: memFree=94096/32951124 swapFree=63308188/67111528
[pid=4493] ppid=4491 vsize=14673788 CPUtime=5000.05 cores=0,2,4,6
/proc/4493/stat : 4493 (qutersat_releas) R 4491 4493 4225 0 -1 4202496 3369777 0 0 0 499434 571 0 0 25 0 1 0 666118470 15025958912 3209427 33554432000 4194304 6014671 140737136190800 18446744073709551615 4372405 0 0 4096 16386 0 0 0 17 0 0 0 12
/proc/4493/statm: 3668447 3209427 728 445 0 3661992 0
Current children cumulated CPU time (s) 5000.05
Current children cumulated vsize (KiB) 14673788

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5000.5 s]
/proc/loadavg: 2.06 2.03 2.00 3/344 4749
/proc/meminfo: memFree=94096/32951124 swapFree=63308188/67111528
[pid=4493] ppid=4491 vsize=0 CPUtime=5000.24 cores=0,2,4,6
/proc/4493/stat : 4493 (qutersat_releas) R 4491 4493 4225 0 -1 4194308 3369781 0 0 0 499434 590 0 0 25 0 1 0 666118470 0 0 33554432000 0 0 0 0 0 0 16384 4096 16386 18446744073709551615 0 0 17 0 0 0 12
/proc/4493/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 5000.24
Current children cumulated vsize (KiB) 0

[startup+5000.7 s]
/proc/loadavg: 2.06 2.03 2.00 3/344 4749
/proc/meminfo: memFree=94096/32951124 swapFree=63308188/67111528
[pid=4493] ppid=4491 vsize=0 CPUtime=5000.44 cores=0,2,4,6
/proc/4493/stat : 4493 (qutersat_releas) R 4491 4493 4225 0 -1 4194308 3369781 0 0 0 499434 610 0 0 25 0 1 0 666118470 0 0 33554432000 0 0 0 0 0 0 16384 4096 16386 18446744073709551615 0 0 17 0 0 0 12
/proc/4493/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 5000.44
Current children cumulated vsize (KiB) 0

[startup+5000.8 s]
/proc/loadavg: 2.06 2.03 2.00 3/344 4749
/proc/meminfo: memFree=94096/32951124 swapFree=63308188/67111528
[pid=4493] ppid=4491 vsize=0 CPUtime=5000.54 cores=0,2,4,6
/proc/4493/stat : 4493 (qutersat_releas) R 4491 4493 4225 0 -1 4194308 3369781 0 0 0 499434 620 0 0 25 0 1 0 666118470 0 0 33554432000 0 0 0 0 0 0 16384 4096 16386 18446744073709551615 0 0 17 0 0 0 12
/proc/4493/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 5000.54
Current children cumulated vsize (KiB) 0

Child status: 1
Real time (s): 5000.82
CPU time (s): 5000.56
CPU user time (s): 4994.35
CPU system time (s): 6.21805
CPU usage (%): 99.995
Max. virtual memory (cumulated for all children) (KiB): 14673788

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4994.35
system time used= 6.21805
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3369781
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 15
involuntary context switches= 7358

runsolver used 17.0694 second user time and 37.5023 second system time

The end

Launcher Data 

Begin job on node135 at 2011-05-16 13:26:46
IDJOB=3384352
IDBENCH=82388
IDSOLVER=1868
FILE ID=node135/3384352-1305545201
RUNJOBID= node135-1305540197-4243
PBS_JOBID= 13329218
Free space on /tmp= 73360 MiB

SOLVER NAME= QuteRSat 2011-05-12 (fixed)
BENCH NAME= SAT11/application/rintanen/SATPlanning/transport-transport-city-sequential-35nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.050-SAT.cnf
COMMAND LINE= qutersat_release BENCHNAME RANDOMSEED
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3384352-1305545201/watcher-3384352-1305545201 -o /tmp/evaluation-result-3384352-1305545201/solver-3384352-1305545201 -C 5000 -W 5100 -M 15500  qutersat_release HOME/instance-3384352-1305545201.cnf 590367528

TIME LIMIT= 5000 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 48f03e5fbe31fc85b9a464480fc8aa5a
RANDOM SEED=590367528

node135.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 6640.14
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.78
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      10512888 kB
Buffers:        317760 kB
Cached:        6624456 kB
SwapCached:      60528 kB
Active:       12080004 kB
Inactive:     10087900 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      10512888 kB
SwapTotal:    67111528 kB
SwapFree:     65222232 kB
Dirty:          172720 kB
Writeback:           0 kB
AnonPages:    15170416 kB
Mapped:          23680 kB
Slab:           150648 kB
PageTables:      55260 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 81571828 kB
VmallocTotal: 34359738367 kB
VmallocUsed:     33868 kB
VmallocChunk: 34359703231 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73348 MiB
End job on node135 at 2011-05-16 14:50:08