Trace number 3292017

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
rcl 2011-04-01? (TO) 1295.09 1300.01

General information on the benchmark

NameSAT04/industrial/velev/vliw_unsat_2.0/
9dlx_vliw_at_b_iq6.used-as.sat04-347.cnf
MD5SUM580dc3969c4e46e50013253fd4ac9139
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark333.205
Satisfiable
(Un)Satisfiability was proved
Number of variables209724
Number of clauses3634677
Sum of the clauses size10547961
Maximum clause length169
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 23415202
Number of clauses of size 349840
Number of clauses of size 46998
Number of clauses of size 514973
Number of clauses of size over 5147663

Solver Data 

0.00/0.13	c Parsing...
1.38/1.56	c ==============================================================================
1.38/1.56	c |           |     ORIGINAL     |              LEARNT              |          |
1.38/1.56	c | Conflicts | Clauses Literals |   Limit Clauses Literals  Lit/Cl | Progress |
1.38/1.56	c ==============================================================================
1.38/1.56	c |         0 | 3634676 10547960 | 1090402       0        0     nan |  0.000 % |
25.68/27.84	c |         0 | 3532144 10927904 |      --       0       --      -- |     --   | -102383/383223
25.68/27.84	c ==============================================================================
25.68/27.84	c Result  :   #vars: 168000   #clauses: 3532144   #literals: 10927904
25.68/27.84	c CPU time:   25.2962 s
25.68/27.84	c ==============================================================================

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3292017-1303781595/watcher-3292017-1303781595 -o /tmp/evaluation-result-3292017-1303781595/solver-3292017-1303781595 -C 2400 -W 1300 -M 7680 ./esg_static.sh HOME/instance-3292017-1303781595.cnf 

running on 2 cores: 1,3

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 7864320 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 7915520 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 4.01 3.96 3.91 7/190 631
/proc/meminfo: memFree=17214832/32951132 swapFree=67111528/67111528
[pid=631] ppid=629 vsize=11800 CPUtime=0 cores=1,3
/proc/631/stat : 631 (runsolver) R 629 631 524 0 -1 4202560 42 0 0 0 0 0 0 0 22 0 1 0 489759404 12083200 51 33554432000 4194304 5434984 140734843785520 18446744073709551615 4881607 0 2147483391 4096 24578 0 0 0 17 3 0 0 0
/proc/631/statm: 2950 51 31 303 0 2644 0

[startup+0.0914059 s]
/proc/loadavg: 4.01 3.96 3.91 7/190 631
/proc/meminfo: memFree=17214832/32951132 swapFree=67111528/67111528
[pid=631] ppid=629 vsize=8700 CPUtime=0 cores=1,3
/proc/631/stat : 631 (esg_static.sh) S 629 631 524 0 -1 4202496 328 0 0 0 0 0 0 0 22 0 1 0 489759404 8908800 249 33554432000 4194304 4922060 140733904798240 18446744073709551615 274664627333 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/631/statm: 2175 249 209 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.100406 s]
/proc/loadavg: 4.01 3.96 3.91 7/190 631
/proc/meminfo: memFree=17214832/32951132 swapFree=67111528/67111528
[pid=631] ppid=629 vsize=8700 CPUtime=0 cores=1,3
/proc/631/stat : 631 (esg_static.sh) S 629 631 524 0 -1 4202496 328 0 0 0 0 0 0 0 22 0 1 0 489759404 8908800 249 33554432000 4194304 4922060 140733904798240 18446744073709551615 274664627333 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/631/statm: 2175 249 209 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.30034 s]
/proc/loadavg: 4.01 3.96 3.91 7/190 631
/proc/meminfo: memFree=17214832/32951132 swapFree=67111528/67111528
[pid=631] ppid=629 vsize=8700 CPUtime=0 cores=1,3
/proc/631/stat : 631 (esg_static.sh) S 629 631 524 0 -1 4202496 328 0 0 0 0 0 0 0 22 0 1 0 489759404 8908800 249 33554432000 4194304 4922060 140733904798240 18446744073709551615 274664627333 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/631/statm: 2175 249 209 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.70027 s]
/proc/loadavg: 4.01 3.96 3.91 7/190 631
/proc/meminfo: memFree=17214832/32951132 swapFree=67111528/67111528
[pid=631] ppid=629 vsize=8700 CPUtime=0 cores=1,3
/proc/631/stat : 631 (esg_static.sh) S 629 631 524 0 -1 4202496 328 0 0 0 0 0 0 0 22 0 1 0 489759404 8908800 249 33554432000 4194304 4922060 140733904798240 18446744073709551615 274664627333 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/631/statm: 2175 249 209 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+1.50013 s]
/proc/loadavg: 4.25 4.01 3.92 5/192 633
/proc/meminfo: memFree=17083628/32951132 swapFree=67111528/67111528
[pid=631] ppid=629 vsize=8700 CPUtime=0 cores=1,3
/proc/631/stat : 631 (esg_static.sh) S 629 631 524 0 -1 4202496 328 0 0 0 0 0 0 0 22 0 1 0 489759404 8908800 249 33554432000 4194304 4922060 140733904798240 18446744073709551615 274664627333 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/631/statm: 2175 249 209 178 0 68 0
[pid=633] ppid=631 vsize=235524 CPUtime=1.38 cores=1,3
/proc/633/stat : 633 (SatELite_releas) R 631 631 524 0 -1 4202496 56113 0 0 0 115 23 0 0 25 0 1 0 489759405 241176576 56068 33554432000 134512640 135144242 4286801168 18446744073709551615 134553417 0 0 4096 3 0 0 0 17 3 0 0 0
/proc/633/statm: 58881 56068 54 155 0 58724 0
Current children cumulated CPU time (s) 1.38
Current children cumulated vsize (KiB) 244224

[startup+3.10085 s]
/proc/loadavg: 4.25 4.01 3.92 5/192 633
/proc/meminfo: memFree=16968312/32951132 swapFree=67111528/67111528
[pid=631] ppid=629 vsize=8700 CPUtime=0 cores=1,3
/proc/631/stat : 631 (esg_static.sh) S 629 631 524 0 -1 4202496 328 0 0 0 0 0 0 0 22 0 1 0 489759404 8908800 249 33554432000 4194304 4922060 140733904798240 18446744073709551615 274664627333 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/631/statm: 2175 249 209 178 0 68 0
[pid=633] ppid=631 vsize=254212 CPUtime=2.82 cores=1,3
/proc/633/stat : 633 (SatELite_releas) R 631 631 524 0 -1 4202496 68591 0 0 0 256 26 0 0 25 0 1 0 489759405 260313088 60933 33554432000 134512640 135144242 4286801168 18446744073709551615 134555768 0 0 4096 3 0 0 0 17 3 0 0 0
/proc/633/statm: 63553 60933 77 155 0 63396 0
Current children cumulated CPU time (s) 2.82
Current children cumulated vsize (KiB) 262912

[startup+6.3003 s]
/proc/loadavg: 4.25 4.01 3.92 6/192 633
/proc/meminfo: memFree=16943700/32951132 swapFree=67111528/67111528
[pid=631] ppid=629 vsize=8700 CPUtime=0 cores=1,3
/proc/631/stat : 631 (esg_static.sh) S 629 631 524 0 -1 4202496 328 0 0 0 0 0 0 0 22 0 1 0 489759404 8908800 249 33554432000 4194304 4922060 140733904798240 18446744073709551615 274664627333 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/631/statm: 2175 249 209 178 0 68 0
[pid=633] ppid=631 vsize=297340 CPUtime=5.98 cores=1,3
/proc/633/stat : 633 (SatELite_releas) R 631 631 524 0 -1 4202496 75501 0 0 0 569 29 0 0 25 0 1 0 489759405 304476160 67843 33554432000 134512640 135144242 4286801168 18446744073709551615 134555768 0 0 4096 3 0 0 0 17 3 0 0 0
/proc/633/statm: 74335 67843 77 155 0 74178 0
Current children cumulated CPU time (s) 5.98
Current children cumulated vsize (KiB) 306040

[startup+12.7002 s]
/proc/loadavg: 4.67 4.11 3.96 5/192 633
/proc/meminfo: memFree=16887896/32951132 swapFree=67111528/67111528
[pid=631] ppid=629 vsize=8700 CPUtime=0 cores=1,3
/proc/631/stat : 631 (esg_static.sh) S 629 631 524 0 -1 4202496 328 0 0 0 0 0 0 0 22 0 1 0 489759404 8908800 249 33554432000 4194304 4922060 140733904798240 18446744073709551615 274664627333 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/631/statm: 2175 249 209 178 0 68 0
[pid=633] ppid=631 vsize=359128 CPUtime=11.59 cores=1,3
/proc/633/stat : 633 (SatELite_releas) R 631 631 524 0 -1 4202496 87041 0 0 0 1123 36 0 0 25 0 1 0 489759405 367747072 78815 33554432000 134512640 135144242 4286801168 18446744073709551615 134555060 0 0 4096 3 0 0 0 17 3 0 0 0
/proc/633/statm: 89782 78815 77 155 0 89625 0
Current children cumulated CPU time (s) 11.59
Current children cumulated vsize (KiB) 367828

[startup+25.501 s]
/proc/loadavg: 5.03 4.20 3.99 5/192 634
/proc/meminfo: memFree=16886880/32951132 swapFree=67111528/67111528
[pid=631] ppid=629 vsize=8700 CPUtime=0 cores=1,3
/proc/631/stat : 631 (esg_static.sh) S 629 631 524 0 -1 4202496 328 0 0 0 0 0 0 0 22 0 1 0 489759404 8908800 249 33554432000 4194304 4922060 140733904798240 18446744073709551615 274664627333 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/631/statm: 2175 249 209 178 0 68 0
[pid=633] ppid=631 vsize=359736 CPUtime=23.47 cores=1,3
/proc/633/stat : 633 (SatELite_releas) R 631 631 524 0 -1 4202496 87145 0 0 0 2306 41 0 0 25 0 1 0 489759405 368369664 78919 33554432000 134512640 135144242 4286801168 18446744073709551615 134588165 0 0 4096 3 0 0 0 17 3 0 0 0
/proc/633/statm: 89934 78919 77 155 0 89777 0
Current children cumulated CPU time (s) 23.47
Current children cumulated vsize (KiB) 368436

[startup+51.1005 s]
/proc/loadavg: 5.86 4.46 4.08 5/192 665
/proc/meminfo: memFree=16542548/32951132 swapFree=67111528/67111528
[pid=631] ppid=629 vsize=8700 CPUtime=27.71 cores=1,3
/proc/631/stat : 631 (esg_static.sh) S 629 631 524 0 -1 4202496 353 94761 0 0 0 0 2710 61 18 0 1 0 489759404 8908800 252 33554432000 4194304 4922060 140733904798240 18446744073709551615 274664627333 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/631/statm: 2175 252 209 178 0 68 0
[pid=657] ppid=631 vsize=113596 CPUtime=19.98 cores=1,3
/proc/657/stat : 657 (cdcl) R 631 631 524 0 -1 4202496 26210 0 0 0 1968 30 0 0 25 0 1 0 489762405 116322304 26028 33554432000 4194304 4218580 140735014862432 18446744073709551615 4213922 0 0 4096 24578 0 0 0 17 3 0 0 0
/proc/657/statm: 28399 26028 131 6 0 26869 0
Current children cumulated CPU time (s) 47.69
Current children cumulated vsize (KiB) 122296

[startup+102.307 s]
/proc/loadavg: 7.62 5.17 4.34 5/192 667
/proc/meminfo: memFree=16511268/32951132 swapFree=67111528/67111528
[pid=631] ppid=629 vsize=8700 CPUtime=27.71 cores=1,3
/proc/631/stat : 631 (esg_static.sh) S 629 631 524 0 -1 4202496 353 94761 0 0 0 0 2710 61 18 0 1 0 489759404 8908800 252 33554432000 4194304 4922060 140733904798240 18446744073709551615 274664627333 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/631/statm: 2175 252 209 178 0 68 0
[pid=657] ppid=631 vsize=122028 CPUtime=69.78 cores=1,3
/proc/657/stat : 657 (cdcl) R 631 631 524 0 -1 4202496 28287 0 0 0 6908 70 0 0 25 0 1 0 489762405 124956672 28104 33554432000 4194304 4218580 140735014862432 18446744073709551615 4200231 0 0 4096 24578 0 0 0 17 3 0 0 0
/proc/657/statm: 30507 28104 131 6 0 28977 0
Current children cumulated CPU time (s) 97.49
Current children cumulated vsize (KiB) 130728

[startup+162.3 s]
/proc/loadavg: 6.89 5.48 4.50 5/192 668
/proc/meminfo: memFree=16505420/32951132 swapFree=67111528/67111528
[pid=631] ppid=629 vsize=8700 CPUtime=27.71 cores=1,3
/proc/631/stat : 631 (esg_static.sh) S 629 631 524 0 -1 4202496 353 94761 0 0 0 0 2710 61 18 0 1 0 489759404 8908800 252 33554432000 4194304 4922060 140733904798240 18446744073709551615 274664627333 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/631/statm: 2175 252 209 178 0 68 0
[pid=657] ppid=631 vsize=124812 CPUtime=129.67 cores=1,3
/proc/657/stat : 657 (cdcl) R 631 631 524 0 -1 4202496 29018 0 0 0 12885 82 0 0 25 0 1 0 489762405 127807488 28802 33554432000 4194304 4218580 140735014862432 18446744073709551615 4208186 0 0 4096 24578 0 0 0 17 1 0 0 0
/proc/657/statm: 31203 28802 131 6 0 29673 0
Current children cumulated CPU time (s) 157.38
Current children cumulated vsize (KiB) 133512

[startup+222.301 s]
/proc/loadavg: 5.06 5.21 4.46 5/192 670
/proc/meminfo: memFree=16493964/32951132 swapFree=67111528/67111528
[pid=631] ppid=629 vsize=8700 CPUtime=27.71 cores=1,3
/proc/631/stat : 631 (esg_static.sh) S 629 631 524 0 -1 4202496 353 94761 0 0 0 0 2710 61 18 0 1 0 489759404 8908800 252 33554432000 4194304 4922060 140733904798240 18446744073709551615 274664627333 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/631/statm: 2175 252 209 178 0 68 0
[pid=657] ppid=631 vsize=126300 CPUtime=189.66 cores=1,3
/proc/657/stat : 657 (cdcl) R 631 631 524 0 -1 4202496 29420 0 0 0 18883 83 0 0 25 0 1 0 489762405 129331200 29178 33554432000 4194304 4218580 140735014862432 18446744073709551615 4210509 0 0 4096 24578 0 0 0 17 1 0 0 0
/proc/657/statm: 31575 29178 131 6 0 30045 0
Current children cumulated CPU time (s) 217.37
Current children cumulated vsize (KiB) 135000

[startup+282.301 s]
/proc/loadavg: 4.39 4.98 4.43 5/192 672
/proc/meminfo: memFree=16441844/32951132 swapFree=67111528/67111528
[pid=631] ppid=629 vsize=8700 CPUtime=27.71 cores=1,3
/proc/631/stat : 631 (esg_static.sh) S 629 631 524 0 -1 4202496 353 94761 0 0 0 0 2710 61 18 0 1 0 489759404 8908800 252 33554432000 4194304 4922060 140733904798240 18446744073709551615 274664627333 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/631/statm: 2175 252 209 178 0 68 0
[pid=657] ppid=631 vsize=134640 CPUtime=249.66 cores=1,3
/proc/657/stat : 657 (cdcl) R 631 631 524 0 -1 4202496 31606 0 0 0 24883 83 0 0 25 0 1 0 489762405 137871360 31266 33554432000 4194304 4218580 140735014862432 18446744073709551615 4210517 0 0 4096 24578 0 0 0 17 1 0 0 0
/proc/657/statm: 33660 31266 131 6 0 32130 0
Current children cumulated CPU time (s) 277.37
Current children cumulated vsize (KiB) 143340

[startup+342.301 s]
/proc/loadavg: 4.20 4.82 4.41 5/192 673
/proc/meminfo: memFree=16433300/32951132 swapFree=67111528/67111528
[pid=631] ppid=629 vsize=8700 CPUtime=27.71 cores=1,3
/proc/631/stat : 631 (esg_static.sh) S 629 631 524 0 -1 4202496 353 94761 0 0 0 0 2710 61 18 0 1 0 489759404 8908800 252 33554432000 4194304 4922060 140733904798240 18446744073709551615 274664627333 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/631/statm: 2175 252 209 178 0 68 0
[pid=657] ppid=631 vsize=141836 CPUtime=309.66 cores=1,3
/proc/657/stat : 657 (cdcl) R 631 631 524 0 -1 4202496 33495 0 0 0 30882 84 0 0 25 0 1 0 489762405 145240064 33098 33554432000 4194304 4218580 140735014862432 18446744073709551615 4210496 0 0 4096 24578 0 0 0 17 1 0 0 0
/proc/657/statm: 35459 33098 131 6 0 33929 0
Current children cumulated CPU time (s) 337.37
Current children cumulated vsize (KiB) 150536

[startup+402.301 s]
/proc/loadavg: 4.07 4.67 4.38 5/192 675
/proc/meminfo: memFree=16430284/32951132 swapFree=67111528/67111528
[pid=631] ppid=629 vsize=8700 CPUtime=27.71 cores=1,3

################
# More data... #
################

/proc/657/statm: 51066 48706 131 6 0 49536 0
Current children cumulated CPU time (s) 637.38
Current children cumulated vsize (KiB) 212964

[startup+702.301 s]
/proc/loadavg: 4.02 4.25 4.27 5/192 683
/proc/meminfo: memFree=16353872/32951132 swapFree=67111528/67111528
[pid=631] ppid=629 vsize=8700 CPUtime=27.71 cores=1,3
/proc/631/stat : 631 (esg_static.sh) S 629 631 524 0 -1 4202496 353 94761 0 0 0 0 2710 61 18 0 1 0 489759404 8908800 252 33554432000 4194304 4922060 140733904798240 18446744073709551615 274664627333 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/631/statm: 2175 252 209 178 0 68 0
[pid=657] ppid=631 vsize=204456 CPUtime=669.67 cores=1,3
/proc/657/stat : 657 (cdcl) R 631 631 524 0 -1 4202496 49790 0 0 0 66877 90 0 0 25 0 1 0 489762405 209362944 48753 33554432000 4194304 4218580 140735014862432 18446744073709551615 4208272 0 0 4096 24578 0 0 0 17 1 0 0 0
/proc/657/statm: 51114 48753 131 6 0 49584 0
Current children cumulated CPU time (s) 697.38
Current children cumulated vsize (KiB) 213156

[startup+762.3 s]
/proc/loadavg: 4.01 4.20 4.25 5/192 684
/proc/meminfo: memFree=16326092/32951132 swapFree=67111528/67111528
[pid=631] ppid=629 vsize=8700 CPUtime=27.71 cores=1,3
/proc/631/stat : 631 (esg_static.sh) S 629 631 524 0 -1 4202496 353 94761 0 0 0 0 2710 61 18 0 1 0 489759404 8908800 252 33554432000 4194304 4922060 140733904798240 18446744073709551615 274664627333 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/631/statm: 2175 252 209 178 0 68 0
[pid=657] ppid=631 vsize=204392 CPUtime=729.67 cores=1,3
/proc/657/stat : 657 (cdcl) R 631 631 524 0 -1 4202496 49934 0 0 0 72877 90 0 0 25 0 1 0 489762405 209297408 48738 33554432000 4194304 4218580 140735014862432 18446744073709551615 4210517 0 0 4096 24578 0 0 0 17 1 0 0 0
/proc/657/statm: 51098 48738 131 6 0 49568 0
Current children cumulated CPU time (s) 757.38
Current children cumulated vsize (KiB) 213092

[startup+822.301 s]
/proc/loadavg: 4.00 4.16 4.23 5/192 686
/proc/meminfo: memFree=16321532/32951132 swapFree=67111528/67111528
[pid=631] ppid=629 vsize=8700 CPUtime=27.71 cores=1,3
/proc/631/stat : 631 (esg_static.sh) S 629 631 524 0 -1 4202496 353 94761 0 0 0 0 2710 61 18 0 1 0 489759404 8908800 252 33554432000 4194304 4922060 140733904798240 18446744073709551615 274664627333 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/631/statm: 2175 252 209 178 0 68 0
[pid=657] ppid=631 vsize=204360 CPUtime=789.67 cores=1,3
/proc/657/stat : 657 (cdcl) R 631 631 524 0 -1 4202496 50058 0 0 0 78877 90 0 0 25 0 1 0 489762405 209264640 48730 33554432000 4194304 4218580 140735014862432 18446744073709551615 4210037 0 0 4096 24578 0 0 0 17 1 0 0 0
/proc/657/statm: 51090 48730 131 6 0 49560 0
Current children cumulated CPU time (s) 817.38
Current children cumulated vsize (KiB) 213060

[startup+882.3 s]
/proc/loadavg: 4.00 4.13 4.21 5/192 688
/proc/meminfo: memFree=16320288/32951132 swapFree=67111528/67111528
[pid=631] ppid=629 vsize=8700 CPUtime=27.71 cores=1,3
/proc/631/stat : 631 (esg_static.sh) S 629 631 524 0 -1 4202496 353 94761 0 0 0 0 2710 61 18 0 1 0 489759404 8908800 252 33554432000 4194304 4922060 140733904798240 18446744073709551615 274664627333 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/631/statm: 2175 252 209 178 0 68 0
[pid=657] ppid=631 vsize=204456 CPUtime=849.67 cores=1,3
/proc/657/stat : 657 (cdcl) R 631 631 524 0 -1 4202496 50176 0 0 0 84877 90 0 0 25 0 1 0 489762405 209362944 48751 33554432000 4194304 4218580 140735014862432 18446744073709551615 4208235 0 0 4096 24578 0 0 0 17 1 0 0 0
/proc/657/statm: 51114 48751 131 6 0 49584 0
Current children cumulated CPU time (s) 877.38
Current children cumulated vsize (KiB) 213156

[startup+942.301 s]
/proc/loadavg: 4.00 4.10 4.20 5/192 689
/proc/meminfo: memFree=16320312/32951132 swapFree=67111528/67111528
[pid=631] ppid=629 vsize=8700 CPUtime=27.71 cores=1,3
/proc/631/stat : 631 (esg_static.sh) S 629 631 524 0 -1 4202496 353 94761 0 0 0 0 2710 61 18 0 1 0 489759404 8908800 252 33554432000 4194304 4922060 140733904798240 18446744073709551615 274664627333 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/631/statm: 2175 252 209 178 0 68 0
[pid=657] ppid=631 vsize=204424 CPUtime=909.67 cores=1,3
/proc/657/stat : 657 (cdcl) R 631 631 524 0 -1 4202496 50336 0 0 0 90877 90 0 0 25 0 1 0 489762405 209330176 48742 33554432000 4194304 4218580 140735014862432 18446744073709551615 4210517 0 0 4096 24578 0 0 0 17 1 0 0 0
/proc/657/statm: 51106 48742 131 6 0 49576 0
Current children cumulated CPU time (s) 937.38
Current children cumulated vsize (KiB) 213124

[startup+1002.3 s]
/proc/loadavg: 4.03 4.10 4.18 5/192 691
/proc/meminfo: memFree=16319436/32951132 swapFree=67111528/67111528
[pid=631] ppid=629 vsize=8700 CPUtime=27.71 cores=1,3
/proc/631/stat : 631 (esg_static.sh) S 629 631 524 0 -1 4202496 353 94761 0 0 0 0 2710 61 18 0 1 0 489759404 8908800 252 33554432000 4194304 4922060 140733904798240 18446744073709551615 274664627333 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/631/statm: 2175 252 209 178 0 68 0
[pid=657] ppid=631 vsize=204488 CPUtime=969.67 cores=1,3
/proc/657/stat : 657 (cdcl) R 631 631 524 0 -1 4202496 50492 0 0 0 96877 90 0 0 25 0 1 0 489762405 209395712 48759 33554432000 4194304 4218580 140735014862432 18446744073709551615 4208446 0 0 4096 24578 0 0 0 17 1 0 0 0
/proc/657/statm: 51122 48759 131 6 0 49592 0
Current children cumulated CPU time (s) 997.38
Current children cumulated vsize (KiB) 213188

[startup+1062.3 s]
/proc/loadavg: 4.01 4.08 4.17 5/192 692
/proc/meminfo: memFree=16309136/32951132 swapFree=67111528/67111528
[pid=631] ppid=629 vsize=8700 CPUtime=27.71 cores=1,3
/proc/631/stat : 631 (esg_static.sh) S 629 631 524 0 -1 4202496 353 94761 0 0 0 0 2710 61 18 0 1 0 489759404 8908800 252 33554432000 4194304 4922060 140733904798240 18446744073709551615 274664627333 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/631/statm: 2175 252 209 178 0 68 0
[pid=657] ppid=631 vsize=214928 CPUtime=1029.67 cores=1,3
/proc/657/stat : 657 (cdcl) R 631 631 524 0 -1 4202496 53222 0 0 0 102877 90 0 0 25 0 1 0 489762405 220086272 51344 33554432000 4194304 4218580 140735014862432 18446744073709551615 4208446 0 0 4096 24578 0 0 0 17 1 0 0 0
/proc/657/statm: 53732 51344 131 6 0 52202 0
Current children cumulated CPU time (s) 1057.38
Current children cumulated vsize (KiB) 223628

[startup+1122.3 s]
/proc/loadavg: 4.00 4.06 4.16 5/192 694
/proc/meminfo: memFree=16297460/32951132 swapFree=67111528/67111528
[pid=631] ppid=629 vsize=8700 CPUtime=27.71 cores=1,3
/proc/631/stat : 631 (esg_static.sh) S 629 631 524 0 -1 4202496 353 94761 0 0 0 0 2710 61 18 0 1 0 489759404 8908800 252 33554432000 4194304 4922060 140733904798240 18446744073709551615 274664627333 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/631/statm: 2175 252 209 178 0 68 0
[pid=657] ppid=631 vsize=214992 CPUtime=1089.68 cores=1,3
/proc/657/stat : 657 (cdcl) R 631 631 524 0 -1 4202496 53339 0 0 0 108877 91 0 0 25 0 1 0 489762405 220151808 51359 33554432000 4194304 4218580 140735014862432 18446744073709551615 4208255 0 0 4096 24578 0 0 0 17 1 0 0 0
/proc/657/statm: 53748 51359 131 6 0 52218 0
Current children cumulated CPU time (s) 1117.39
Current children cumulated vsize (KiB) 223692

[startup+1182.3 s]
/proc/loadavg: 4.00 4.05 4.15 5/192 696
/proc/meminfo: memFree=16297076/32951132 swapFree=67111528/67111528
[pid=631] ppid=629 vsize=8700 CPUtime=27.71 cores=1,3
/proc/631/stat : 631 (esg_static.sh) S 629 631 524 0 -1 4202496 353 94761 0 0 0 0 2710 61 18 0 1 0 489759404 8908800 252 33554432000 4194304 4922060 140733904798240 18446744073709551615 274664627333 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/631/statm: 2175 252 209 178 0 68 0
[pid=657] ppid=631 vsize=214896 CPUtime=1149.68 cores=1,3
/proc/657/stat : 657 (cdcl) R 631 631 524 0 -1 4202496 53487 0 0 0 114877 91 0 0 25 0 1 0 489762405 220053504 51336 33554432000 4194304 4218580 140735014862432 18446744073709551615 4208446 0 0 4096 24578 0 0 0 17 1 0 0 0
/proc/657/statm: 53724 51336 131 6 0 52194 0
Current children cumulated CPU time (s) 1177.39
Current children cumulated vsize (KiB) 223596

[startup+1242.31 s]
/proc/loadavg: 4.04 4.05 4.14 5/192 697
/proc/meminfo: memFree=16295696/32951132 swapFree=67111528/67111528
[pid=631] ppid=629 vsize=8700 CPUtime=27.71 cores=1,3
/proc/631/stat : 631 (esg_static.sh) S 629 631 524 0 -1 4202496 353 94761 0 0 0 0 2710 61 18 0 1 0 489759404 8908800 252 33554432000 4194304 4922060 140733904798240 18446744073709551615 274664627333 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/631/statm: 2175 252 209 178 0 68 0
[pid=657] ppid=631 vsize=214768 CPUtime=1209.68 cores=1,3
/proc/657/stat : 657 (cdcl) R 631 631 524 0 -1 4202496 53692 0 0 0 120877 91 0 0 25 0 1 0 489762405 219922432 51306 33554432000 4194304 4218580 140735014862432 18446744073709551615 4210509 0 0 4096 24578 0 0 0 17 1 0 0 0
/proc/657/statm: 53692 51306 131 6 0 52162 0
Current children cumulated CPU time (s) 1237.39
Current children cumulated vsize (KiB) 223468



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 4.20 4.09 4.15 5/192 759
/proc/meminfo: memFree=16643164/32951132 swapFree=67111528/67111528
[pid=631] ppid=629 vsize=8700 CPUtime=27.71 cores=1,3
/proc/631/stat : 631 (esg_static.sh) S 629 631 524 0 -1 4202496 353 94761 0 0 0 0 2710 61 18 0 1 0 489759404 8908800 252 33554432000 4194304 4922060 140733904798240 18446744073709551615 274664627333 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/631/statm: 2175 252 209 178 0 68 0
[pid=657] ppid=631 vsize=294612 CPUtime=1267.38 cores=1,3
/proc/657/stat : 657 (cdcl) R 631 631 524 0 -1 4202496 73839 0 0 0 126643 95 0 0 25 0 1 0 489762405 301682688 71295 33554432000 4194304 4218580 140735014862432 18446744073709551615 4208255 0 0 4096 24578 0 0 0 17 1 0 0 0
/proc/657/statm: 73653 71295 131 6 0 72123 0
Current children cumulated CPU time (s) 1295.09
Current children cumulated vsize (KiB) 303312

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1300 s]
/proc/loadavg: 4.20 4.09 4.15 5/192 759
/proc/meminfo: memFree=16643164/32951132 swapFree=67111528/67111528
[pid=631] ppid=629 vsize=8700 CPUtime=27.71 cores=1,3
/proc/631/stat : 631 (esg_static.sh) S 629 631 524 0 -1 4202496 353 94761 0 0 0 0 2710 61 18 0 1 0 489759404 8908800 252 33554432000 4194304 4922060 140733904798240 18446744073709551615 274664627333 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/631/statm: 2175 252 209 178 0 68 0
[pid=657] ppid=631 vsize=294612 CPUtime=1267.38 cores=1,3
/proc/657/stat : 657 (cdcl) R 631 631 524 0 -1 4202496 73839 0 0 0 126643 95 0 0 25 0 1 0 489762405 301682688 71295 33554432000 4194304 4218580 140735014862432 18446744073709551615 4208255 0 0 4096 24578 0 0 0 17 1 0 0 0
/proc/657/statm: 73653 71295 131 6 0 72123 0
Current children cumulated CPU time (s) 1295.09
Current children cumulated vsize (KiB) 303312

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 631 and gives
#  childrusage.ru_utime.tv_sec=27
#  childrusage.ru_utime.tv_usec=107878
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=611906
# CPU time returned by wait4() is 27.7198
# while last known CPU time is 1295.09
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1300.01
CPU time (s): 1295.09
CPU user time (s): 1293.53
CPU system time (s): 1.56
CPU usage (%): 99.6214
Max. virtual memory (cumulated for all children) (KiB): 368436

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 27.1079
system time used= 0.611906
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 95114
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 7
involuntary context switches= 354

runsolver used 1.93171 second user time and 5.06723 second system time

The end

Launcher Data 

Begin job on node131 at 2011-04-26 03:33:17
IDJOB=3292017
IDBENCH=85007
IDSOLVER=1609
FILE ID=node131/3292017-1303781595
RUNJOBID= node131-1303781575-544
PBS_JOBID= 13157225
Free space on /tmp= 71680 MiB

SOLVER NAME= rcl 2011-04-01
BENCH NAME= SAT04/industrial/velev/vliw_unsat_2.0/9dlx_vliw_at_b_iq6.used-as.sat04-347.cnf
COMMAND LINE= ./esg_static.sh BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3292017-1303781595/watcher-3292017-1303781595 -o /tmp/evaluation-result-3292017-1303781595/solver-3292017-1303781595 -C 2400 -W 1300 -M 7680  ./esg_static.sh HOME/instance-3292017-1303781595.cnf

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 7680 MiB
NBCORE= 2

MD5SUM BENCH= 580dc3969c4e46e50013253fd4ac9139
RANDOM SEED=473717972

node131.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951132 kB
MemFree:      17215596 kB
Buffers:       1010592 kB
Cached:       13905552 kB
SwapCached:          0 kB
Active:        5254564 kB
Inactive:      9952800 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951132 kB
LowFree:      17215596 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:          241856 kB
Writeback:           0 kB
AnonPages:      290540 kB
Mapped:          15444 kB
Slab:           463380 kB
PageTables:       5904 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587092 kB
Committed_AS:   481376 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296000 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71540 MiB
End job on node131 at 2011-04-26 03:55:00