Trace number 3348813

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
minisat hack: minisat_psm 2011-04-01? (TO) 1299.99 1300.03

General information on the benchmark

Nameapplication/rintanen/SATPlanning/
transport-transport-three-cities-sequential-14nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.020-NOTKNOWN.cnf
MD5SUM5d1253e2dcc0e3e55992672756beadbc
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark2074.86
Satisfiable
(Un)Satisfiability was proved
Number of variables756832
Number of clauses4116966
Sum of the clauses size9765566
Maximum clause length1178
Minimum clause length1
Number of clauses of size 1846
Number of clauses of size 24082840
Number of clauses of size 3640
Number of clauses of size 4800
Number of clauses of size 5800
Number of clauses of size over 531040

Solver Data 

0.00/0.00	c Parsing...
0.00/1.32	c ==============================================================================
0.00/1.32	c |           |     ORIGINAL     |              LEARNT              |          |
0.00/1.32	c | Conflicts | Clauses Literals |   Limit Clauses Literals  Lit/Cl | Progress |
0.00/1.32	c ==============================================================================
0.00/1.32	c |         0 | 3028353  7134510 |  908505       0        0     nan |  0.000 % |
3.29/3.32	c |         0 | 2570144  6111727 |      --       0       --      -- |     --   | -156456/-307529
3.29/3.33	c ==============================================================================
3.29/3.33	c Result  :   #vars: 365932   #clauses: 2570144   #literals: 6111727
3.29/3.33	c CPU time:   3.04354 s
3.29/3.33	c ==============================================================================

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3348813-1304970516/watcher-3348813-1304970516 -o /tmp/evaluation-result-3348813-1304970516/solver-3348813-1304970516 -C 2400 -W 1300 -M 7680 ./esg_static.sh HOME/instance-3348813-1304970516.cnf 

running on 2 cores: 1,3

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 7864320 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 7915520 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.95 4.01 3.70 4/354 783
/proc/meminfo: memFree=10384272/32951124 swapFree=67082152/67111528
[pid=783] ppid=781 vsize=8700 CPUtime=0 cores=1,3
/proc/783/stat : 783 (esg_static.sh) S 781 783 32720 0 -1 4202496 328 0 0 0 0 0 0 0 22 0 1 0 608649835 8908800 250 33554432000 4194304 4922060 140737226785680 18446744073709551615 228244167813 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/783/statm: 2175 250 209 178 0 68 0

[startup+0.0319659 s]
/proc/loadavg: 3.95 4.01 3.70 4/354 783
/proc/meminfo: memFree=10384272/32951124 swapFree=67082152/67111528
[pid=783] ppid=781 vsize=8700 CPUtime=0 cores=1,3
/proc/783/stat : 783 (esg_static.sh) S 781 783 32720 0 -1 4202496 328 0 0 0 0 0 0 0 22 0 1 0 608649835 8908800 250 33554432000 4194304 4922060 140737226785680 18446744073709551615 228244167813 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/783/statm: 2175 250 209 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.100954 s]
/proc/loadavg: 3.95 4.01 3.70 4/354 783
/proc/meminfo: memFree=10384272/32951124 swapFree=67082152/67111528
[pid=783] ppid=781 vsize=8700 CPUtime=0 cores=1,3
/proc/783/stat : 783 (esg_static.sh) S 781 783 32720 0 -1 4202496 328 0 0 0 0 0 0 0 22 0 1 0 608649835 8908800 250 33554432000 4194304 4922060 140737226785680 18446744073709551615 228244167813 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/783/statm: 2175 250 209 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.300947 s]
/proc/loadavg: 3.95 4.01 3.70 4/354 783
/proc/meminfo: memFree=10384272/32951124 swapFree=67082152/67111528
[pid=783] ppid=781 vsize=8700 CPUtime=0 cores=1,3
/proc/783/stat : 783 (esg_static.sh) S 781 783 32720 0 -1 4202496 328 0 0 0 0 0 0 0 22 0 1 0 608649835 8908800 250 33554432000 4194304 4922060 140737226785680 18446744073709551615 228244167813 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/783/statm: 2175 250 209 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+1.35874 s]
/proc/loadavg: 3.95 4.01 3.70 4/354 783
/proc/meminfo: memFree=10384272/32951124 swapFree=67082152/67111528
[pid=783] ppid=781 vsize=8700 CPUtime=0 cores=1,3
/proc/783/stat : 783 (esg_static.sh) S 781 783 32720 0 -1 4202496 328 0 0 0 0 0 0 0 22 0 1 0 608649835 8908800 250 33554432000 4194304 4922060 140737226785680 18446744073709551615 228244167813 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/783/statm: 2175 250 209 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+1.50071 s]
/proc/loadavg: 3.95 4.01 3.70 4/354 783
/proc/meminfo: memFree=10384272/32951124 swapFree=67082152/67111528
[pid=783] ppid=781 vsize=8700 CPUtime=0 cores=1,3
/proc/783/stat : 783 (esg_static.sh) S 781 783 32720 0 -1 4202496 328 0 0 0 0 0 0 0 22 0 1 0 608649835 8908800 250 33554432000 4194304 4922060 140737226785680 18446744073709551615 228244167813 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/783/statm: 2175 250 209 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+3.11343 s]
/proc/loadavg: 4.12 4.04 3.71 5/356 785
/proc/meminfo: memFree=10066060/32951124 swapFree=67082152/67111528
[pid=783] ppid=781 vsize=8700 CPUtime=0 cores=1,3
/proc/783/stat : 783 (esg_static.sh) S 781 783 32720 0 -1 4202496 328 0 0 0 0 0 0 0 22 0 1 0 608649835 8908800 250 33554432000 4194304 4922060 140737226785680 18446744073709551615 228244167813 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/783/statm: 2175 250 209 178 0 68 0
[pid=784] ppid=783 vsize=439068 CPUtime=3.1 cores=1,3
/proc/784/stat : 784 (SatELite_releas) R 783 783 32720 0 -1 4202496 121370 0 0 0 286 24 0 0 25 0 1 0 608649835 449605632 92705 33554432000 134512640 135144242 4289776112 18446744073709551615 134605627 0 0 4096 3 0 0 0 17 1 0 0 0
/proc/784/statm: 109767 92705 77 155 0 109610 0
Current children cumulated CPU time (s) 3.1
Current children cumulated vsize (KiB) 447768

[startup+6.30088 s]
/proc/loadavg: 4.19 4.06 3.72 5/356 786
/proc/meminfo: memFree=10182052/32951124 swapFree=67082152/67111528
[pid=783] ppid=781 vsize=8700 CPUtime=4.47 cores=1,3
/proc/783/stat : 783 (esg_static.sh) S 781 783 32720 0 -1 4202496 352 153237 0 0 0 0 412 35 18 0 1 0 608649835 8908800 252 33554432000 4194304 4922060 140737226785680 18446744073709551615 228244167813 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/783/statm: 2175 252 209 178 0 68 0
[pid=786] ppid=783 vsize=200312 CPUtime=1.8 cores=1,3
/proc/786/stat : 786 (minisat_static) R 783 783 32720 0 -1 4202496 47133 0 0 0 173 7 0 0 25 0 1 0 608650284 205119488 38940 33554432000 4194304 4256717 140735196679168 18446744073709551615 4209216 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/786/statm: 50078 38940 251 16 0 46720 0
Current children cumulated CPU time (s) 6.27
Current children cumulated vsize (KiB) 209012

[startup+12.7007 s]
/proc/loadavg: 4.17 4.06 3.72 5/356 786
/proc/meminfo: memFree=10129608/32951124 swapFree=67082152/67111528
[pid=783] ppid=781 vsize=8700 CPUtime=4.47 cores=1,3
/proc/783/stat : 783 (esg_static.sh) S 781 783 32720 0 -1 4202496 352 153237 0 0 0 0 412 35 18 0 1 0 608649835 8908800 252 33554432000 4194304 4922060 140737226785680 18446744073709551615 228244167813 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/783/statm: 2175 252 209 178 0 68 0
[pid=786] ppid=783 vsize=205372 CPUtime=8.2 cores=1,3
/proc/786/stat : 786 (minisat_static) R 783 783 32720 0 -1 4202496 51866 0 0 0 812 8 0 0 25 0 1 0 608650284 210300928 43664 33554432000 4194304 4256717 140735196679168 18446744073709551615 4214149 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/786/statm: 51343 43664 251 16 0 47985 0
Current children cumulated CPU time (s) 12.67
Current children cumulated vsize (KiB) 214072

[startup+25.5005 s]
/proc/loadavg: 4.14 4.06 3.73 5/356 787
/proc/meminfo: memFree=10093408/32951124 swapFree=67082152/67111528
[pid=783] ppid=781 vsize=8700 CPUtime=4.47 cores=1,3
/proc/783/stat : 783 (esg_static.sh) S 781 783 32720 0 -1 4202496 352 153237 0 0 0 0 412 35 18 0 1 0 608649835 8908800 252 33554432000 4194304 4922060 140737226785680 18446744073709551615 228244167813 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/783/statm: 2175 252 209 178 0 68 0
[pid=786] ppid=783 vsize=258636 CPUtime=20.99 cores=1,3
/proc/786/stat : 786 (minisat_static) R 783 783 32720 0 -1 4202496 84918 0 0 0 2087 12 0 0 25 0 1 0 608650284 264843264 48267 33554432000 4194304 4256717 140735196679168 18446744073709551615 4209152 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/786/statm: 64659 48267 252 16 0 61301 0
Current children cumulated CPU time (s) 25.46
Current children cumulated vsize (KiB) 267336

[startup+51.101 s]
/proc/loadavg: 4.09 4.05 3.73 5/356 787
/proc/meminfo: memFree=10088384/32951124 swapFree=67082152/67111528
[pid=783] ppid=781 vsize=8700 CPUtime=4.47 cores=1,3
/proc/783/stat : 783 (esg_static.sh) S 781 783 32720 0 -1 4202496 352 153237 0 0 0 0 412 35 18 0 1 0 608649835 8908800 252 33554432000 4194304 4922060 140737226785680 18446744073709551615 228244167813 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/783/statm: 2175 252 209 178 0 68 0
[pid=786] ppid=783 vsize=260220 CPUtime=46.6 cores=1,3
/proc/786/stat : 786 (minisat_static) R 783 783 32720 0 -1 4202496 152598 0 0 0 4639 21 0 0 25 0 1 0 608650284 266465280 49722 33554432000 4194304 4256717 140735196679168 18446744073709551615 4209198 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/786/statm: 65055 49722 252 16 0 61697 0
Current children cumulated CPU time (s) 51.07
Current children cumulated vsize (KiB) 268920

[startup+102.301 s]
/proc/loadavg: 4.04 4.04 3.74 5/356 789
/proc/meminfo: memFree=10121752/32951124 swapFree=67082152/67111528
[pid=783] ppid=781 vsize=8700 CPUtime=4.47 cores=1,3
/proc/783/stat : 783 (esg_static.sh) S 781 783 32720 0 -1 4202496 352 153237 0 0 0 0 412 35 18 0 1 0 608649835 8908800 252 33554432000 4194304 4922060 140737226785680 18446744073709551615 228244167813 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/783/statm: 2175 252 209 178 0 68 0
[pid=786] ppid=783 vsize=213880 CPUtime=97.8 cores=1,3
/proc/786/stat : 786 (minisat_static) R 783 783 32720 0 -1 4202496 322659 0 0 0 9738 42 0 0 25 0 1 0 608650284 219013120 47822 33554432000 4194304 4256717 140735196679168 18446744073709551615 4209152 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/786/statm: 53470 47822 252 16 0 50112 0
Current children cumulated CPU time (s) 102.27
Current children cumulated vsize (KiB) 222580

[startup+162.3 s]
/proc/loadavg: 4.01 4.03 3.75 5/356 790
/proc/meminfo: memFree=9969972/32951124 swapFree=67082152/67111528
[pid=783] ppid=781 vsize=8700 CPUtime=4.47 cores=1,3
/proc/783/stat : 783 (esg_static.sh) S 781 783 32720 0 -1 4202496 352 153237 0 0 0 0 412 35 18 0 1 0 608649835 8908800 252 33554432000 4194304 4922060 140737226785680 18446744073709551615 228244167813 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/783/statm: 2175 252 209 178 0 68 0
[pid=786] ppid=783 vsize=266408 CPUtime=157.8 cores=1,3
/proc/786/stat : 786 (minisat_static) R 783 783 32720 0 -1 4202496 457446 0 0 0 15720 60 0 0 25 0 1 0 608650284 272801792 56536 33554432000 4194304 4256717 140735196679168 18446744073709551615 4209138 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/786/statm: 66602 56536 252 16 0 63244 0
Current children cumulated CPU time (s) 162.27
Current children cumulated vsize (KiB) 275108

[startup+222.301 s]
/proc/loadavg: 4.23 4.07 3.78 5/356 792
/proc/meminfo: memFree=10010772/32951124 swapFree=67082152/67111528
[pid=783] ppid=781 vsize=8700 CPUtime=4.47 cores=1,3
/proc/783/stat : 783 (esg_static.sh) S 781 783 32720 0 -1 4202496 352 153237 0 0 0 0 412 35 18 0 1 0 608649835 8908800 252 33554432000 4194304 4922060 140737226785680 18446744073709551615 228244167813 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/783/statm: 2175 252 209 178 0 68 0
[pid=786] ppid=783 vsize=351884 CPUtime=217.8 cores=1,3
/proc/786/stat : 786 (minisat_static) R 783 783 32720 0 -1 4202496 629053 0 0 0 21698 82 0 0 25 0 1 0 608650284 360329216 62944 33554432000 4194304 4256717 140735196679168 18446744073709551615 4213445 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/786/statm: 87971 62944 252 16 0 84613 0
Current children cumulated CPU time (s) 222.27
Current children cumulated vsize (KiB) 360584

[startup+282.3 s]
/proc/loadavg: 4.23 4.09 3.80 5/356 794
/proc/meminfo: memFree=9983848/32951124 swapFree=67082152/67111528
[pid=783] ppid=781 vsize=8700 CPUtime=4.47 cores=1,3
/proc/783/stat : 783 (esg_static.sh) S 781 783 32720 0 -1 4202496 352 153237 0 0 0 0 412 35 18 0 1 0 608649835 8908800 252 33554432000 4194304 4922060 140737226785680 18446744073709551615 228244167813 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/783/statm: 2175 252 209 178 0 68 0
[pid=786] ppid=783 vsize=354160 CPUtime=277.8 cores=1,3
/proc/786/stat : 786 (minisat_static) R 783 783 32720 0 -1 4202496 752711 0 0 0 27682 98 0 0 25 0 1 0 608650284 362659840 64774 33554432000 4194304 4256717 140735196679168 18446744073709551615 4209038 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/786/statm: 88540 64774 252 16 0 85182 0
Current children cumulated CPU time (s) 282.27
Current children cumulated vsize (KiB) 362860

[startup+342.301 s]
/proc/loadavg: 4.08 4.07 3.82 5/356 795
/proc/meminfo: memFree=9963344/32951124 swapFree=67082152/67111528
[pid=783] ppid=781 vsize=8700 CPUtime=4.47 cores=1,3
/proc/783/stat : 783 (esg_static.sh) S 781 783 32720 0 -1 4202496 352 153237 0 0 0 0 412 35 18 0 1 0 608649835 8908800 252 33554432000 4194304 4922060 140737226785680 18446744073709551615 228244167813 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/783/statm: 2175 252 209 178 0 68 0
[pid=786] ppid=783 vsize=274008 CPUtime=337.8 cores=1,3
/proc/786/stat : 786 (minisat_static) R 783 783 32720 0 -1 4202496 925471 0 0 0 33661 119 0 0 25 0 1 0 608650284 280584192 61391 33554432000 4194304 4256717 140735196679168 18446744073709551615 4219668 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/786/statm: 68502 61392 252 16 0 65144 0
Current children cumulated CPU time (s) 342.27
Current children cumulated vsize (KiB) 282708

[startup+402.301 s]
/proc/loadavg: 4.09 4.07 3.83 5/356 797
/proc/meminfo: memFree=9875780/32951124 swapFree=67082152/67111528
[pid=783] ppid=781 vsize=8700 CPUtime=4.47 cores=1,3
/proc/783/stat : 783 (esg_static.sh) S 781 783 32720 0 -1 4202496 352 153237 0 0 0 0 412 35 18 0 1 0 608649835 8908800 252 33554432000 4194304 4922060 140737226785680 18446744073709551615 228244167813 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/783/statm: 2175 252 209 178 0 68 0
[pid=786] ppid=783 vsize=358000 CPUtime=397.8 cores=1,3

################
# More data... #
################

/proc/786/statm: 91350 79715 252 16 0 87992 0
Current children cumulated CPU time (s) 642.27
Current children cumulated vsize (KiB) 374100

[startup+702.3 s]
/proc/loadavg: 4.00 4.02 3.86 5/356 805
/proc/meminfo: memFree=9711496/32951124 swapFree=67082152/67111528
[pid=783] ppid=781 vsize=8700 CPUtime=4.47 cores=1,3
/proc/783/stat : 783 (esg_static.sh) S 781 783 32720 0 -1 4202496 352 153237 0 0 0 0 412 35 18 0 1 0 608649835 8908800 252 33554432000 4194304 4922060 140737226785680 18446744073709551615 228244167813 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/783/statm: 2175 252 209 178 0 68 0
[pid=786] ppid=783 vsize=499984 CPUtime=697.81 cores=1,3
/proc/786/stat : 786 (minisat_static) R 783 783 32720 0 -1 4202496 1865232 0 0 0 69534 247 0 0 25 0 1 0 608650284 511983616 88551 33554432000 4194304 4256717 140735196679168 18446744073709551615 4209364 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/786/statm: 124996 88551 252 16 0 121638 0
Current children cumulated CPU time (s) 702.28
Current children cumulated vsize (KiB) 508684

[startup+762.301 s]
/proc/loadavg: 3.85 3.98 3.85 4/349 833
/proc/meminfo: memFree=9957676/32951124 swapFree=67082152/67111528
[pid=783] ppid=781 vsize=8700 CPUtime=4.47 cores=1,3
/proc/783/stat : 783 (esg_static.sh) S 781 783 32720 0 -1 4202496 352 153237 0 0 0 0 412 35 18 0 1 0 608649835 8908800 252 33554432000 4194304 4922060 140737226785680 18446744073709551615 228244167813 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/783/statm: 2175 252 209 178 0 68 0
[pid=786] ppid=783 vsize=368964 CPUtime=757.8 cores=1,3
/proc/786/stat : 786 (minisat_static) R 783 783 32720 0 -1 4202496 2081432 0 0 0 75505 275 0 0 25 0 1 0 608650284 377819136 72116 33554432000 4194304 4256717 140735196679168 18446744073709551615 4209126 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/786/statm: 92241 72116 252 16 0 88883 0
Current children cumulated CPU time (s) 762.27
Current children cumulated vsize (KiB) 377664

[startup+822.3 s]
/proc/loadavg: 3.38 3.83 3.81 4/349 844
/proc/meminfo: memFree=9931612/32951124 swapFree=67082152/67111528
[pid=783] ppid=781 vsize=8700 CPUtime=4.47 cores=1,3
/proc/783/stat : 783 (esg_static.sh) S 781 783 32720 0 -1 4202496 352 153237 0 0 0 0 412 35 18 0 1 0 608649835 8908800 252 33554432000 4194304 4922060 140737226785680 18446744073709551615 228244167813 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/783/statm: 2175 252 209 178 0 68 0
[pid=786] ppid=783 vsize=501224 CPUtime=817.8 cores=1,3
/proc/786/stat : 786 (minisat_static) R 783 783 32720 0 -1 4202496 2206482 0 0 0 81488 292 0 0 25 0 1 0 608650284 513253376 87879 33554432000 4194304 4256717 140735196679168 18446744073709551615 4209058 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/786/statm: 125306 87879 252 16 0 121948 0
Current children cumulated CPU time (s) 822.27
Current children cumulated vsize (KiB) 509924

[startup+882.301 s]
/proc/loadavg: 3.17 3.69 3.76 4/349 846
/proc/meminfo: memFree=9899104/32951124 swapFree=67082152/67111528
[pid=783] ppid=781 vsize=8700 CPUtime=4.47 cores=1,3
/proc/783/stat : 783 (esg_static.sh) S 781 783 32720 0 -1 4202496 352 153237 0 0 0 0 412 35 18 0 1 0 608649835 8908800 252 33554432000 4194304 4922060 140737226785680 18446744073709551615 228244167813 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/783/statm: 2175 252 209 178 0 68 0
[pid=786] ppid=783 vsize=502732 CPUtime=877.8 cores=1,3
/proc/786/stat : 786 (minisat_static) R 783 783 32720 0 -1 4202496 2333299 0 0 0 87470 310 0 0 25 0 1 0 608650284 514797568 89500 33554432000 4194304 4256717 140735196679168 18446744073709551615 4209093 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/786/statm: 125683 89500 252 16 0 122325 0
Current children cumulated CPU time (s) 882.27
Current children cumulated vsize (KiB) 511432

[startup+942.3 s]
/proc/loadavg: 3.06 3.56 3.71 4/349 849
/proc/meminfo: memFree=9835596/32951124 swapFree=67082152/67111528
[pid=783] ppid=781 vsize=8700 CPUtime=4.47 cores=1,3
/proc/783/stat : 783 (esg_static.sh) S 781 783 32720 0 -1 4202496 352 153237 0 0 0 0 412 35 18 0 1 0 608649835 8908800 252 33554432000 4194304 4922060 140737226785680 18446744073709551615 228244167813 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/783/statm: 2175 252 209 178 0 68 0
[pid=786] ppid=783 vsize=371704 CPUtime=937.8 cores=1,3
/proc/786/stat : 786 (minisat_static) R 783 783 32720 0 -1 4202496 2505704 0 0 0 93447 333 0 0 25 0 1 0 608650284 380624896 82319 33554432000 4194304 4256717 140735196679168 18446744073709551615 4209126 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/786/statm: 92926 82319 252 16 0 89568 0
Current children cumulated CPU time (s) 942.27
Current children cumulated vsize (KiB) 380404

[startup+1002.3 s]
/proc/loadavg: 3.08 3.48 3.67 4/349 858
/proc/meminfo: memFree=9776820/32951124 swapFree=67082152/67111528
[pid=783] ppid=781 vsize=8700 CPUtime=4.47 cores=1,3
/proc/783/stat : 783 (esg_static.sh) S 781 783 32720 0 -1 4202496 352 153237 0 0 0 0 412 35 18 0 1 0 608649835 8908800 252 33554432000 4194304 4922060 140737226785680 18446744073709551615 228244167813 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/783/statm: 2175 252 209 178 0 68 0
[pid=786] ppid=783 vsize=372916 CPUtime=997.8 cores=1,3
/proc/786/stat : 786 (minisat_static) R 783 783 32720 0 -1 4202496 2685890 0 0 0 99422 358 0 0 25 0 1 0 608650284 381865984 80941 33554432000 4194304 4256717 140735196679168 18446744073709551615 4209126 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/786/statm: 93229 80941 252 16 0 89871 0
Current children cumulated CPU time (s) 1002.27
Current children cumulated vsize (KiB) 381616

[startup+1062.3 s]
/proc/loadavg: 2.81 3.34 3.61 3/342 878
/proc/meminfo: memFree=10588540/32951124 swapFree=67082152/67111528
[pid=783] ppid=781 vsize=8700 CPUtime=4.47 cores=1,3
/proc/783/stat : 783 (esg_static.sh) S 781 783 32720 0 -1 4202496 352 153237 0 0 0 0 412 35 18 0 1 0 608649835 8908800 252 33554432000 4194304 4922060 140737226785680 18446744073709551615 228244167813 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/783/statm: 2175 252 209 178 0 68 0
[pid=786] ppid=783 vsize=374308 CPUtime=1057.8 cores=1,3
/proc/786/stat : 786 (minisat_static) R 783 783 32720 0 -1 4202496 2814015 0 0 0 105406 374 0 0 25 0 1 0 608650284 383291392 85540 33554432000 4194304 4256717 140735196679168 18446744073709551615 4209075 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/786/statm: 93577 85540 252 16 0 90219 0
Current children cumulated CPU time (s) 1062.27
Current children cumulated vsize (KiB) 383008

[startup+1122.3 s]
/proc/loadavg: 2.29 3.10 3.51 3/342 880
/proc/meminfo: memFree=10622488/32951124 swapFree=67082152/67111528
[pid=783] ppid=781 vsize=8700 CPUtime=4.47 cores=1,3
/proc/783/stat : 783 (esg_static.sh) S 781 783 32720 0 -1 4202496 352 153237 0 0 0 0 412 35 18 0 1 0 608649835 8908800 252 33554432000 4194304 4922060 140737226785680 18446744073709551615 228244167813 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/783/statm: 2175 252 209 178 0 68 0
[pid=786] ppid=783 vsize=507968 CPUtime=1117.79 cores=1,3
/proc/786/stat : 786 (minisat_static) R 783 783 32720 0 -1 4202496 2951481 0 0 0 111386 393 0 0 25 0 1 0 608650284 520159232 93561 33554432000 4194304 4256717 140735196679168 18446744073709551615 4209105 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/786/statm: 126992 93561 252 16 0 123634 0
Current children cumulated CPU time (s) 1122.26
Current children cumulated vsize (KiB) 516668

[startup+1182.31 s]
/proc/loadavg: 2.11 2.89 3.41 3/342 882
/proc/meminfo: memFree=10604720/32951124 swapFree=67082152/67111528
[pid=783] ppid=781 vsize=8700 CPUtime=4.47 cores=1,3
/proc/783/stat : 783 (esg_static.sh) S 781 783 32720 0 -1 4202496 352 153237 0 0 0 0 412 35 18 0 1 0 608649835 8908800 252 33554432000 4194304 4922060 140737226785680 18446744073709551615 228244167813 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/783/statm: 2175 252 209 178 0 68 0
[pid=786] ppid=783 vsize=507968 CPUtime=1177.81 cores=1,3
/proc/786/stat : 786 (minisat_static) R 783 783 32720 0 -1 4202496 3091295 0 0 0 117367 414 0 0 25 0 1 0 608650284 520159232 97480 33554432000 4194304 4256717 140735196679168 18446744073709551615 4209126 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/786/statm: 126992 97480 252 16 0 123634 0
Current children cumulated CPU time (s) 1182.28
Current children cumulated vsize (KiB) 516668

[startup+1242.3 s]
/proc/loadavg: 1.82 2.68 3.30 2/335 901
/proc/meminfo: memFree=11067948/32951124 swapFree=67082152/67111528
[pid=783] ppid=781 vsize=8700 CPUtime=4.47 cores=1,3
/proc/783/stat : 783 (esg_static.sh) S 781 783 32720 0 -1 4202496 352 153237 0 0 0 0 412 35 18 0 1 0 608649835 8908800 252 33554432000 4194304 4922060 140737226785680 18446744073709551615 228244167813 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/783/statm: 2175 252 209 178 0 68 0
[pid=786] ppid=783 vsize=377144 CPUtime=1237.8 cores=1,3
/proc/786/stat : 786 (minisat_static) R 783 783 32720 0 -1 4202496 3280825 0 0 0 123340 440 0 0 25 0 1 0 608650284 386195456 81077 33554432000 4194304 4256717 140735196679168 18446744073709551615 4209058 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/786/statm: 94286 81077 252 16 0 90928 0
Current children cumulated CPU time (s) 1242.27
Current children cumulated vsize (KiB) 385844



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300.01 s]
/proc/loadavg: 1.32 2.39 3.17 2/335 903
/proc/meminfo: memFree=11008768/32951124 swapFree=67082152/67111528
[pid=783] ppid=781 vsize=8700 CPUtime=4.47 cores=1,3
/proc/783/stat : 783 (esg_static.sh) S 781 783 32720 0 -1 4202496 352 153237 0 0 0 0 412 35 18 0 1 0 608649835 8908800 252 33554432000 4194304 4922060 140737226785680 18446744073709551615 228244167813 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/783/statm: 2175 252 209 178 0 68 0
[pid=786] ppid=783 vsize=509404 CPUtime=1295.52 cores=1,3
/proc/786/stat : 786 (minisat_static) R 783 783 32720 0 -1 4202496 3433128 0 0 0 129089 463 0 0 25 0 1 0 608650284 521629696 95330 33554432000 4194304 4256717 140735196679168 18446744073709551615 4233419 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/786/statm: 127351 95330 252 16 0 123993 0
Current children cumulated CPU time (s) 1299.99
Current children cumulated vsize (KiB) 518104

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1300.01 s]
/proc/loadavg: 1.32 2.39 3.17 2/335 903
/proc/meminfo: memFree=11008768/32951124 swapFree=67082152/67111528
[pid=783] ppid=781 vsize=8700 CPUtime=4.47 cores=1,3
/proc/783/stat : 783 (esg_static.sh) S 781 783 32720 0 -1 4202496 352 153237 0 0 0 0 412 35 18 0 1 0 608649835 8908800 252 33554432000 4194304 4922060 140737226785680 18446744073709551615 228244167813 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/783/statm: 2175 252 209 178 0 68 0
[pid=786] ppid=783 vsize=509404 CPUtime=1295.52 cores=1,3
/proc/786/stat : 786 (minisat_static) R 783 783 32720 0 -1 4202496 3433128 0 0 0 129089 463 0 0 25 0 1 0 608650284 521629696 95330 33554432000 4194304 4256717 140735196679168 18446744073709551615 4233419 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/786/statm: 127351 95330 252 16 0 123993 0
Current children cumulated CPU time (s) 1299.99
Current children cumulated vsize (KiB) 518104

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 783 and gives
#  childrusage.ru_utime.tv_sec=4
#  childrusage.ru_utime.tv_usec=130372
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=357945
# CPU time returned by wait4() is 4.48832
# while last known CPU time is 1299.99
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1300.03
CPU time (s): 1299.99
CPU user time (s): 1295.01
CPU system time (s): 4.98
CPU usage (%): 99.9969
Max. virtual memory (cumulated for all children) (KiB): 729720

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4.13037
system time used= 0.357945
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 153589
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 7
involuntary context switches= 17

runsolver used 4.24335 second user time and 10.4914 second system time

The end

Launcher Data 

Begin job on node136 at 2011-05-09 21:48:39
IDJOB=3348813
IDBENCH=82387
IDSOLVER=1811
FILE ID=node136/3348813-1304970516
RUNJOBID= node136-1304968094-32740
PBS_JOBID= 13285614
Free space on /tmp= 44320 MiB

SOLVER NAME= minisat hack: minisat_psm 2011-04-01
BENCH NAME= SAT11/application/rintanen/SATPlanning/transport-transport-three-cities-sequential-14nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.020-NOTKNOWN.cnf
COMMAND LINE= ./esg_static.sh BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3348813-1304970516/watcher-3348813-1304970516 -o /tmp/evaluation-result-3348813-1304970516/solver-3348813-1304970516 -C 2400 -W 1300 -M 7680  ./esg_static.sh HOME/instance-3348813-1304970516.cnf

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 7680 MiB
NBCORE= 2

MD5SUM BENCH= 5d1253e2dcc0e3e55992672756beadbc
RANDOM SEED=1333167756

node136.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      10384544 kB
Buffers:        216532 kB
Cached:       11895188 kB
SwapCached:       2708 kB
Active:       11140932 kB
Inactive:     10939172 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      10384544 kB
SwapTotal:    67111528 kB
SwapFree:     67082152 kB
Dirty:          274324 kB
Writeback:           0 kB
AnonPages:     9966588 kB
Mapped:          28056 kB
Slab:           381164 kB
PageTables:      41884 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 70890272 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 44468 MiB
End job on node136 at 2011-05-09 22:10:21