Trace number 3281348

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio par? (MO) 4707.49 1178.51

General information on the benchmark

Nameindustrial/vliw_unsat_2.0/
9dlx_vliw_at_b_iq7.cnf
MD5SUM0fbc00fde383cec371bb97d621c5e7e5
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark485.526
Satisfiable
(Un)Satisfiability was proved
Number of variables306095
Number of clauses6069108
Sum of the clauses size17675754
Maximum clause length163
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 25745111
Number of clauses of size 366910
Number of clauses of size 44878
Number of clauses of size 518476
Number of clauses of size over 5233732

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 4 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] lingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	[5] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 0
0.00/0.00	Starting clasp 1.3.6 on core(s) 4
0.00/0.00	Starting TNM 2009 on core(s) 6
0.00/0.00	Starting lingeling 276-6264d55-100731 on core(s) 2
0.00/0.00	Starting march_hi 2009 on core(s) 6
0.00/0.84

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3281348-1304032539/watcher-3281348-1304032539 -o /tmp/evaluation-result-3281348-1304032539/solver-3281348-1304032539 -C 4800 -W 1300 -M 15500 ppfolio HOME/instance-3281348-1304032539.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 4.06 5.83 7.02 6/182 31501
/proc/meminfo: memFree=16185148/32951124 swapFree=67111528/67111528
[pid=31501] ppid=31499 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/31501/stat : 31501 (ppfolio) R 31499 31501 31124 0 -1 4202496 521 0 0 0 0 0 0 0 24 0 1 0 514854784 18763776 390 33554432000 4194304 4287625 140734953711792 18446744073709551615 230809185807 0 0 4096 65536 0 0 0 17 4 0 0 0
/proc/31501/statm: 4581 390 341 23 0 91 0

[startup+0.118131 s]
/proc/loadavg: 4.06 5.83 7.02 6/182 31501
/proc/meminfo: memFree=16185148/32951124 swapFree=67111528/67111528
[pid=31501] ppid=31499 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/31501/stat : 31501 (ppfolio) S 31499 31501 31124 0 -1 4202496 525 214 0 0 0 0 0 0 24 0 1 0 514854784 18763776 391 33554432000 4194304 4287625 140734953711792 18446744073709551615 230809185807 0 0 4096 65536 9224195386380386304 0 0 17 4 0 0 0
/proc/31501/statm: 4581 391 342 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.201115 s]
/proc/loadavg: 4.06 5.83 7.02 6/182 31501
/proc/meminfo: memFree=16185148/32951124 swapFree=67111528/67111528
[pid=31501] ppid=31499 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/31501/stat : 31501 (ppfolio) S 31499 31501 31124 0 -1 4202496 525 214 0 0 0 0 0 0 24 0 1 0 514854784 18763776 391 33554432000 4194304 4287625 140734953711792 18446744073709551615 230809185807 0 0 4096 65536 9224195386380386304 0 0 17 4 0 0 0
/proc/31501/statm: 4581 391 342 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.301097 s]
/proc/loadavg: 4.06 5.83 7.02 6/182 31501
/proc/meminfo: memFree=16185148/32951124 swapFree=67111528/67111528
[pid=31501] ppid=31499 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/31501/stat : 31501 (ppfolio) S 31499 31501 31124 0 -1 4202496 525 214 0 0 0 0 0 0 24 0 1 0 514854784 18763776 391 33554432000 4194304 4287625 140734953711792 18446744073709551615 230809185807 0 0 4096 65536 9224195386380386304 0 0 17 4 0 0 0
/proc/31501/statm: 4581 391 342 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.701024 s]
/proc/loadavg: 4.06 5.83 7.02 6/182 31501
/proc/meminfo: memFree=16185148/32951124 swapFree=67111528/67111528
[pid=31501] ppid=31499 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/31501/stat : 31501 (ppfolio) S 31499 31501 31124 0 -1 4202496 525 214 0 0 0 0 0 0 24 0 1 0 514854784 18763776 391 33554432000 4194304 4287625 140734953711792 18446744073709551615 230809185807 0 0 4096 65536 9224195386380386304 0 0 17 4 0 0 0
/proc/31501/statm: 4581 391 342 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50088 s]
/proc/loadavg: 4.06 5.83 7.02 10/187 31507
/proc/meminfo: memFree=15634920/32951124 swapFree=67111528/67111528
[pid=31501] ppid=31499 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/31501/stat : 31501 (ppfolio) S 31499 31501 31124 0 -1 4202496 525 214 0 0 0 0 0 0 24 0 1 0 514854784 18763776 391 33554432000 4194304 4287625 140734953711792 18446744073709551615 230809185807 0 0 4096 65536 9224195386380386304 0 0 17 4 0 0 0
/proc/31501/statm: 4581 391 342 23 0 91 0
[pid=31502] ppid=31501 vsize=350676 CPUtime=1.48 cores=0
/proc/31502/stat : 31502 (cryptominisat) R 31501 31501 31124 0 -1 4202496 73733 0 0 0 136 12 0 0 25 0 1 0 514854784 359092224 73192 33554432000 4194304 4587354 140737007893152 18446744073709551615 230808826565 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/31502/statm: 87669 73192 287 96 0 84231 0
[pid=31503] ppid=31501 vsize=144740 CPUtime=1.49 cores=4
/proc/31503/stat : 31503 (clasp) R 31501 31501 31124 0 -1 4202496 34977 0 0 0 141 8 0 0 25 0 1 0 514854784 148213760 32626 33554432000 4194304 4785740 140737405882752 18446744073709551615 230808826565 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/31503/statm: 36185 32626 308 145 0 33230 0
[pid=31505] ppid=31501 vsize=101504 CPUtime=1.47 cores=2
/proc/31505/stat : 31505 (lingeling) R 31501 31501 31124 0 -1 4202496 24728 0 0 0 141 6 0 0 20 0 1 0 514854784 103940096 24543 33554432000 4194304 4352236 140735461159008 18446744073709551615 230809165568 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/31505/statm: 25376 24543 101 39 0 24456 0
[pid=31506] ppid=31501 vsize=191740 CPUtime=1.48 cores=6
/proc/31506/stat : 31506 (march_hi) R 31501 31501 31124 0 -1 4194304 42702 0 0 0 141 7 0 0 25 0 1 0 514854784 196341760 42597 33554432000 4194304 4331988 140736995702464 18446744073709551615 230808713775 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/31506/statm: 47935 42597 113 34 0 46377 0
Current children cumulated CPU time (s) 5.92
Current children cumulated vsize (KiB) 806984

[startup+3.10059 s]
/proc/loadavg: 4.06 5.83 7.02 10/187 31507
/proc/meminfo: memFree=15239364/32951124 swapFree=67111528/67111528
[pid=31501] ppid=31499 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/31501/stat : 31501 (ppfolio) S 31499 31501 31124 0 -1 4202496 525 214 0 0 0 0 0 0 18 0 1 0 514854784 18763776 391 33554432000 4194304 4287625 140734953711792 18446744073709551615 230809185807 0 0 4096 65536 9224195738567704576 0 0 17 4 0 0 0
/proc/31501/statm: 4581 391 342 23 0 91 0
[pid=31502] ppid=31501 vsize=489372 CPUtime=3.08 cores=0
/proc/31502/stat : 31502 (cryptominisat) R 31501 31501 31124 0 -1 4202496 108941 0 0 0 291 17 0 0 25 0 1 0 514854784 501116928 108075 33554432000 4194304 4587354 140737007893152 18446744073709551615 4248764 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/31502/statm: 122343 108075 306 96 0 118905 0
[pid=31503] ppid=31501 vsize=185288 CPUtime=3.08 cores=4
/proc/31503/stat : 31503 (clasp) R 31501 31501 31124 0 -1 4202496 51300 0 0 0 298 10 0 0 25 0 1 0 514854784 189734912 42895 33554432000 4194304 4785740 140737405882752 18446744073709551615 4538896 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/31503/statm: 46322 42895 329 145 0 43367 0
[pid=31505] ppid=31501 vsize=178928 CPUtime=3.06 cores=2
/proc/31505/stat : 31505 (lingeling) R 31501 31501 31124 0 -1 4202496 49474 0 0 0 293 13 0 0 25 0 1 0 514854784 183222272 43905 33554432000 4194304 4352236 140735461159008 18446744073709551615 4235610 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/31505/statm: 44732 43905 107 39 0 43812 0
[pid=31506] ppid=31501 vsize=279388 CPUtime=3.07 cores=6
/proc/31506/stat : 31506 (march_hi) R 31501 31501 31124 0 -1 4194304 67135 0 0 0 295 12 0 0 25 0 1 0 514854784 286093312 67030 33554432000 4194304 4331988 140736995702464 18446744073709551615 230808713735 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/31506/statm: 69847 67030 113 34 0 68289 0
Current children cumulated CPU time (s) 12.29
Current children cumulated vsize (KiB) 1151300

[startup+6.301 s]
/proc/loadavg: 4.45 5.89 7.04 10/187 31507
/proc/meminfo: memFree=14745848/32951124 swapFree=67111528/67111528
[pid=31501] ppid=31499 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/31501/stat : 31501 (ppfolio) S 31499 31501 31124 0 -1 4202496 525 214 0 0 0 0 0 0 15 0 1 0 514854784 18763776 391 33554432000 4194304 4287625 140734953711792 18446744073709551615 230809185807 0 0 4096 65536 9224195742862639362 0 0 17 4 0 0 0
/proc/31501/statm: 4581 391 342 23 0 91 0
[pid=31502] ppid=31501 vsize=691088 CPUtime=6.29 cores=0
/proc/31502/stat : 31502 (cryptominisat) R 31501 31501 31124 0 -1 4202496 157703 0 0 0 604 25 0 0 25 0 1 0 514854784 707674112 156833 33554432000 4194304 4587354 140737007893152 18446744073709551615 4363836 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/31502/statm: 172772 156833 310 96 0 169334 0
[pid=31503] ppid=31501 vsize=192224 CPUtime=6.29 cores=4
/proc/31503/stat : 31503 (clasp) R 31501 31501 31124 0 -1 4202496 53022 0 0 0 618 11 0 0 25 0 1 0 514854784 196837376 44617 33554432000 4194304 4785740 140737405882752 18446744073709551615 4287019 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/31503/statm: 48056 44617 336 145 0 45101 0
[pid=31505] ppid=31501 vsize=188188 CPUtime=6.25 cores=2
/proc/31505/stat : 31505 (lingeling) R 31501 31501 31124 0 -1 4202496 76180 0 0 0 609 16 0 0 25 0 1 0 514854784 192704512 46199 33554432000 4194304 4352236 140735461159008 18446744073709551615 4312749 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/31505/statm: 47047 46199 118 39 0 46127 0
[pid=31506] ppid=31501 vsize=652616 CPUtime=6.26 cores=6
/proc/31506/stat : 31506 (march_hi) R 31501 31501 31124 0 -1 4194304 124657 0 0 0 604 22 0 0 25 0 1 0 514854784 668278784 96501 33554432000 4194304 4331988 140736995702464 18446744073709551615 4257065 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/31506/statm: 163154 96501 125 34 0 161596 0
Current children cumulated CPU time (s) 25.09
Current children cumulated vsize (KiB) 1742440

[startup+12.7008 s]
/proc/loadavg: 4.82 5.94 7.05 10/187 31507
/proc/meminfo: memFree=14612944/32951124 swapFree=67111528/67111528
[pid=31501] ppid=31499 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/31501/stat : 31501 (ppfolio) S 31499 31501 31124 0 -1 4202496 525 214 0 0 0 0 0 0 15 0 1 0 514854784 18763776 391 33554432000 4194304 4287625 140734953711792 18446744073709551615 230809185807 0 0 4096 65536 9224195742862639362 0 0 17 4 0 0 0
/proc/31501/statm: 4581 391 342 23 0 91 0
[pid=31502] ppid=31501 vsize=692204 CPUtime=12.69 cores=0
/proc/31502/stat : 31502 (cryptominisat) R 31501 31501 31124 0 -1 4202496 158197 0 0 0 1244 25 0 0 25 0 1 0 514854784 708816896 157327 33554432000 4194304 4587354 140737007893152 18446744073709551615 4357632 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/31502/statm: 173051 157327 311 96 0 169613 0
[pid=31503] ppid=31501 vsize=199068 CPUtime=12.68 cores=4
/proc/31503/stat : 31503 (clasp) R 31501 31501 31124 0 -1 4202496 54742 0 0 0 1257 11 0 0 25 0 1 0 514854784 203845632 46337 33554432000 4194304 4785740 140737405882752 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/31503/statm: 49767 46337 336 145 0 46812 0
[pid=31505] ppid=31501 vsize=208932 CPUtime=12.66 cores=2
/proc/31505/stat : 31505 (lingeling) R 31501 31501 31124 0 -1 4202496 80356 0 0 0 1249 17 0 0 25 0 1 0 514854784 213946368 50375 33554432000 4194304 4352236 140735461159008 18446744073709551615 4267881 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/31505/statm: 52233 50375 125 39 0 51313 0
[pid=31506] ppid=31501 vsize=630160 CPUtime=12.61 cores=6
/proc/31506/stat : 31506 (march_hi) R 31501 31501 31124 0 -1 4194304 239829 0 0 0 1221 40 0 0 25 0 1 0 514854784 645283840 96835 33554432000 4194304 4331988 140736995702464 18446744073709551615 4261443 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/31506/statm: 157540 96835 128 34 0 155982 0
Current children cumulated CPU time (s) 50.64
Current children cumulated vsize (KiB) 1748688

[startup+25.5005 s]
/proc/loadavg: 5.89 6.12 7.09 10/187 31508
/proc/meminfo: memFree=14456580/32951124 swapFree=67111528/67111528
[pid=31501] ppid=31499 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/31501/stat : 31501 (ppfolio) S 31499 31501 31124 0 -1 4202496 525 214 0 0 0 0 0 0 15 0 1 0 514854784 18763776 391 33554432000 4194304 4287625 140734953711792 18446744073709551615 230809185807 0 0 4096 65536 9224195742862639362 0 0 17 4 0 0 0
/proc/31501/statm: 4581 391 342 23 0 91 0
[pid=31502] ppid=31501 vsize=692204 CPUtime=25.49 cores=0
/proc/31502/stat : 31502 (cryptominisat) R 31501 31501 31124 0 -1 4202496 158198 0 0 0 2524 25 0 0 25 0 1 0 514854784 708816896 157328 33554432000 4194304 4587354 140737007893152 18446744073709551615 4248764 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/31502/statm: 173051 157328 311 96 0 169613 0
[pid=31503] ppid=31501 vsize=215952 CPUtime=25.49 cores=4
/proc/31503/stat : 31503 (clasp) R 31501 31501 31124 0 -1 4202496 58880 0 0 0 2536 13 0 0 25 0 1 0 514854784 221134848 50475 33554432000 4194304 4785740 140737405882752 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/31503/statm: 53988 50475 336 145 0 51033 0
[pid=31505] ppid=31501 vsize=233160 CPUtime=25.46 cores=2
/proc/31505/stat : 31505 (lingeling) R 31501 31501 31124 0 -1 4202496 86454 0 0 0 2528 18 0 0 25 0 1 0 514854784 238755840 56434 33554432000 4194304 4352236 140735461159008 18446744073709551615 4328079 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/31505/statm: 58290 56434 127 39 0 57370 0
[pid=31506] ppid=31501 vsize=640916 CPUtime=25.34 cores=6
/proc/31506/stat : 31506 (march_hi) R 31501 31501 31124 0 -1 4202496 531830 0 0 0 2447 87 0 0 25 0 1 0 514854784 656297984 99511 33554432000 4194304 4331988 140736995702464 18446744073709551615 4251963 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/31506/statm: 160229 99511 147 34 0 158671 0
Current children cumulated CPU time (s) 101.78
Current children cumulated vsize (KiB) 1800556

[startup+51.1008 s]
/proc/loadavg: 6.95 6.35 7.14 10/187 31508
/proc/meminfo: memFree=14414608/32951124 swapFree=67111528/67111528
[pid=31501] ppid=31499 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/31501/stat : 31501 (ppfolio) S 31499 31501 31124 0 -1 4202496 525 214 0 0 0 0 0 0 15 0 1 0 514854784 18763776 391 33554432000 4194304 4287625 140734953711792 18446744073709551615 230809185807 0 0 4096 65536 9224195742862639362 0 0 17 4 0 0 0
/proc/31501/statm: 4581 391 342 23 0 91 0
[pid=31502] ppid=31501 vsize=682636 CPUtime=51.08 cores=0
/proc/31502/stat : 31502 (cryptominisat) R 31501 31501 31124 0 -1 4202496 158868 0 0 0 5083 25 0 0 25 0 1 0 514854784 699019264 155596 33554432000 4194304 4587354 140737007893152 18446744073709551615 4237467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/31502/statm: 170659 155596 325 96 0 167221 0
[pid=31503] ppid=31501 vsize=243776 CPUtime=51.09 cores=4
/proc/31503/stat : 31503 (clasp) R 31501 31501 31124 0 -1 4202496 65816 0 0 0 5094 15 0 0 25 0 1 0 514854784 249626624 57411 33554432000 4194304 4785740 140737405882752 18446744073709551615 4312619 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/31503/statm: 60944 57411 336 145 0 57989 0
[pid=31505] ppid=31501 vsize=245552 CPUtime=51.06 cores=2
/proc/31505/stat : 31505 (lingeling) R 31501 31501 31124 0 -1 4202496 113820 0 0 0 5084 22 0 0 25 0 1 0 514854784 251445248 60555 33554432000 4194304 4352236 140735461159008 18446744073709551615 4207619 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/31505/statm: 61388 60555 127 39 0 60468 0
[pid=31506] ppid=31501 vsize=775744 CPUtime=50.8 cores=6
/proc/31506/stat : 31506 (march_hi) R 31501 31501 31124 0 -1 4202496 713310 0 0 0 4966 114 0 0 25 0 1 0 514854784 794361856 132597 33554432000 4194304 4331988 140736995702464 18446744073709551615 4226642 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/31506/statm: 193936 132597 150 34 0 192378 0
Current children cumulated CPU time (s) 204.03
Current children cumulated vsize (KiB) 1966032

[startup+102.3 s]
/proc/loadavg: 8.20 6.79 7.24 10/187 31510
/proc/meminfo: memFree=13890864/32951124 swapFree=67111528/67111528
[pid=31501] ppid=31499 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/31501/stat : 31501 (ppfolio) S 31499 31501 31124 0 -1 4202496 525 214 0 0 0 0 0 0 15 0 1 0 514854784 18763776 391 33554432000 4194304 4287625 140734953711792 18446744073709551615 230809185807 0 0 4096 65536 9224195742862639362 0 0 17 4 0 0 0
/proc/31501/statm: 4581 391 342 23 0 91 0
[pid=31502] ppid=31501 vsize=932996 CPUtime=102.26 cores=0
/proc/31502/stat : 31502 (cryptominisat) R 31501 31501 31124 0 -1 4202496 246829 0 0 0 10188 38 0 0 25 0 1 0 514854784 955387904 204935 33554432000 4194304 4587354 140737007893152 18446744073709551615 4357555 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/31502/statm: 233249 204935 338 96 0 229811 0
[pid=31503] ppid=31501 vsize=510500 CPUtime=102.3 cores=4

################
# More data... #
################


[startup+822.301 s]
/proc/loadavg: 9.17 8.90 8.22 10/187 31561
/proc/meminfo: memFree=4525696/32951124 swapFree=67111528/67111528
[pid=31501] ppid=31499 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/31501/stat : 31501 (ppfolio) S 31499 31501 31124 0 -1 4202496 525 214 0 0 0 0 0 0 15 0 1 0 514854784 18763776 391 33554432000 4194304 4287625 140734953711792 18446744073709551615 230809185807 0 0 4096 65536 9224195742862639362 0 0 17 4 0 0 0
/proc/31501/statm: 4581 391 342 23 0 91 0
[pid=31502] ppid=31501 vsize=970324 CPUtime=822.28 cores=0
/proc/31502/stat : 31502 (cryptominisat) R 31501 31501 31124 0 -1 4202496 886736 0 0 0 82093 135 0 0 25 0 1 0 514854784 993611776 216240 33554432000 4194304 4587354 140737007893152 18446744073709551615 4238101 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/31502/statm: 242581 216240 338 96 0 239143 0
[pid=31503] ppid=31501 vsize=3300024 CPUtime=822.31 cores=4
/proc/31503/stat : 31503 (clasp) R 31501 31501 31124 0 -1 4202496 825725 0 0 0 82089 142 0 0 25 0 1 0 514854784 3379224576 817320 33554432000 4194304 4785740 140737405882752 18446744073709551615 4286953 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/31503/statm: 825006 817320 336 145 0 822051 0
[pid=31505] ppid=31501 vsize=190712 CPUtime=822.28 cores=2
/proc/31505/stat : 31505 (lingeling) R 31501 31501 31124 0 -1 4202496 272741 0 0 0 82183 45 0 0 25 0 1 0 514854784 195289088 46453 33554432000 4194304 4352236 140735461159008 18446744073709551615 4238970 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/31505/statm: 47678 46453 127 39 0 46758 0
[pid=31506] ppid=31501 vsize=6977884 CPUtime=817.75 cores=6
/proc/31506/stat : 31506 (march_hi) R 31501 31501 31124 0 -1 4202496 2220928 0 0 0 81344 431 0 0 25 0 1 0 514854784 7145353216 1640215 33554432000 4194304 4331988 140736995702464 18446744073709551615 4226625 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/31506/statm: 1744471 1640215 151 34 0 1742913 0
Current children cumulated CPU time (s) 3284.62
Current children cumulated vsize (KiB) 11457268

[startup+882.307 s]
/proc/loadavg: 9.13 8.93 8.27 10/187 31562
/proc/meminfo: memFree=3870004/32951124 swapFree=67111528/67111528
[pid=31501] ppid=31499 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/31501/stat : 31501 (ppfolio) S 31499 31501 31124 0 -1 4202496 525 214 0 0 0 0 0 0 15 0 1 0 514854784 18763776 391 33554432000 4194304 4287625 140734953711792 18446744073709551615 230809185807 0 0 4096 65536 9224195742862639362 0 0 17 4 0 0 0
/proc/31501/statm: 4581 391 342 23 0 91 0
[pid=31502] ppid=31501 vsize=2448420 CPUtime=882.28 cores=0
/proc/31502/stat : 31502 (cryptominisat) R 31501 31501 31124 0 -1 4202496 898956 0 0 0 88090 138 0 0 25 0 1 0 514854784 2507182080 215879 33554432000 4194304 4587354 140737007893152 18446744073709551615 4238593 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/31502/statm: 612105 215879 338 96 0 608667 0
[pid=31503] ppid=31501 vsize=3627476 CPUtime=882.32 cores=4
/proc/31503/stat : 31503 (clasp) R 31501 31501 31124 0 -1 4202496 906906 0 0 0 88076 156 0 0 25 0 1 0 514854784 3714535424 898501 33554432000 4194304 4785740 140737405882752 18446744073709551615 4553344 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/31503/statm: 906869 898501 336 145 0 903914 0
[pid=31505] ppid=31501 vsize=211120 CPUtime=882.28 cores=2
/proc/31505/stat : 31505 (lingeling) R 31501 31501 31124 0 -1 4202496 285428 0 0 0 88181 47 0 0 25 0 1 0 514854784 216186880 50924 33554432000 4194304 4352236 140735461159008 18446744073709551615 4207874 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/31505/statm: 52780 50924 127 39 0 51860 0
[pid=31506] ppid=31501 vsize=7262080 CPUtime=877.42 cores=6
/proc/31506/stat : 31506 (march_hi) R 31501 31501 31124 0 -1 4202496 2294957 0 0 0 87293 449 0 0 25 0 1 0 514854784 7436369920 1714244 33554432000 4194304 4331988 140736995702464 18446744073709551615 4226642 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/31506/statm: 1815520 1714244 151 34 0 1813962 0
Current children cumulated CPU time (s) 3524.3
Current children cumulated vsize (KiB) 13567420

[startup+942.301 s]
/proc/loadavg: 9.15 8.97 8.32 10/187 31564
/proc/meminfo: memFree=3103588/32951124 swapFree=67111528/67111528
[pid=31501] ppid=31499 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/31501/stat : 31501 (ppfolio) S 31499 31501 31124 0 -1 4202496 525 214 0 0 0 0 0 0 15 0 1 0 514854784 18763776 391 33554432000 4194304 4287625 140734953711792 18446744073709551615 230809185807 0 0 4096 65536 9224195742862639362 0 0 17 4 0 0 0
/proc/31501/statm: 4581 391 342 23 0 91 0
[pid=31502] ppid=31501 vsize=1724568 CPUtime=942.27 cores=0
/proc/31502/stat : 31502 (cryptominisat) R 31501 31501 31124 0 -1 4202496 910801 0 0 0 94086 141 0 0 25 0 1 0 514854784 1765957632 215215 33554432000 4194304 4587354 140737007893152 18446744073709551615 4237679 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/31502/statm: 431142 215215 338 96 0 427704 0
[pid=31503] ppid=31501 vsize=3922320 CPUtime=942.31 cores=4
/proc/31503/stat : 31503 (clasp) R 31501 31501 31124 0 -1 4202496 980405 0 0 0 94063 168 0 0 25 0 1 0 514854784 4016455680 972000 33554432000 4194304 4785740 140737405882752 18446744073709551615 4278129 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/31503/statm: 980580 972000 336 145 0 977625 0
[pid=31505] ppid=31501 vsize=194964 CPUtime=942.28 cores=2
/proc/31505/stat : 31505 (lingeling) R 31501 31501 31124 0 -1 4202496 293621 0 0 0 94180 48 0 0 25 0 1 0 514854784 199643136 46885 33554432000 4194304 4352236 140735461159008 18446744073709551615 4233918 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/31505/statm: 48741 46885 127 39 0 47821 0
[pid=31506] ppid=31501 vsize=7684612 CPUtime=937.09 cores=6
/proc/31506/stat : 31506 (march_hi) R 31501 31501 31124 0 -1 4202496 2404187 0 0 0 93233 476 0 0 25 0 1 0 514854784 7869042688 1823474 33554432000 4194304 4331988 140736995702464 18446744073709551615 4226645 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/31506/statm: 1921153 1823474 151 34 0 1919595 0
Current children cumulated CPU time (s) 3763.95
Current children cumulated vsize (KiB) 13544788

[startup+1002.3 s]
/proc/loadavg: 9.19 9.00 8.37 10/187 31566
/proc/meminfo: memFree=2613988/32951124 swapFree=67111528/67111528
[pid=31501] ppid=31499 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/31501/stat : 31501 (ppfolio) S 31499 31501 31124 0 -1 4202496 525 214 0 0 0 0 0 0 15 0 1 0 514854784 18763776 391 33554432000 4194304 4287625 140734953711792 18446744073709551615 230809185807 0 0 4096 65536 9224195742862639362 0 0 17 4 0 0 0
/proc/31501/statm: 4581 391 342 23 0 91 0
[pid=31502] ppid=31501 vsize=1808988 CPUtime=1002.28 cores=0
/proc/31502/stat : 31502 (cryptominisat) R 31501 31501 31124 0 -1 4202496 932495 0 0 0 100081 147 0 0 25 0 1 0 514854784 1852403712 214419 33554432000 4194304 4587354 140737007893152 18446744073709551615 4237467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/31502/statm: 452247 214419 338 96 0 448809 0
[pid=31503] ppid=31501 vsize=4182900 CPUtime=1002.32 cores=4
/proc/31503/stat : 31503 (clasp) R 31501 31501 31124 0 -1 4202496 1045432 0 0 0 100051 181 0 0 25 0 1 0 514854784 4283289600 1037027 33554432000 4194304 4785740 140737405882752 18446744073709551615 4278544 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/31503/statm: 1045725 1037027 336 145 0 1042770 0
[pid=31505] ppid=31501 vsize=194876 CPUtime=1002.28 cores=2
/proc/31505/stat : 31505 (lingeling) R 31501 31501 31124 0 -1 4202496 297251 0 0 0 100179 49 0 0 25 0 1 0 514854784 199553024 46863 33554432000 4194304 4352236 140735461159008 18446744073709551615 4208050 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/31505/statm: 48719 46863 127 39 0 47799 0
[pid=31506] ppid=31501 vsize=7898980 CPUtime=996.75 cores=6
/proc/31506/stat : 31506 (march_hi) R 31501 31501 31124 0 -1 4202496 2460870 0 0 0 99184 491 0 0 25 0 1 0 514854784 8088555520 1880157 33554432000 4194304 4331988 140736995702464 18446744073709551615 4271154 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/31506/statm: 1974745 1880157 151 34 0 1973187 0
Current children cumulated CPU time (s) 4003.63
Current children cumulated vsize (KiB) 14104068

[startup+1062.3 s]
/proc/loadavg: 9.07 9.00 8.41 10/187 31567
/proc/meminfo: memFree=2091244/32951124 swapFree=67111528/67111528
[pid=31501] ppid=31499 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/31501/stat : 31501 (ppfolio) S 31499 31501 31124 0 -1 4202496 525 214 0 0 0 0 0 0 15 0 1 0 514854784 18763776 391 33554432000 4194304 4287625 140734953711792 18446744073709551615 230809185807 0 0 4096 65536 9224195742862639362 0 0 17 4 0 0 0
/proc/31501/statm: 4581 391 342 23 0 91 0
[pid=31502] ppid=31501 vsize=1864356 CPUtime=1062.28 cores=0
/proc/31502/stat : 31502 (cryptominisat) R 31501 31501 31124 0 -1 4202496 945091 0 0 0 106078 150 0 0 25 0 1 0 514854784 1909100544 226977 33554432000 4194304 4587354 140737007893152 18446744073709551615 4365241 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/31502/statm: 466089 226977 338 96 0 462651 0
[pid=31503] ppid=31501 vsize=4458244 CPUtime=1062.32 cores=4
/proc/31503/stat : 31503 (clasp) R 31501 31501 31124 0 -1 4202496 1114326 0 0 0 106038 194 0 0 25 0 1 0 514854784 4565241856 1105921 33554432000 4194304 4785740 140737405882752 18446744073709551615 4550319 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/31503/statm: 1114561 1105921 336 145 0 1111606 0
[pid=31505] ppid=31501 vsize=194036 CPUtime=1062.28 cores=2
/proc/31505/stat : 31505 (lingeling) R 31501 31501 31124 0 -1 4202496 313637 0 0 0 106177 51 0 0 25 0 1 0 514854784 198692864 46653 33554432000 4194304 4352236 140735461159008 18446744073709551615 4327902 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/31505/statm: 48509 46653 127 39 0 47589 0
[pid=31506] ppid=31501 vsize=8047480 CPUtime=1056.42 cores=6
/proc/31506/stat : 31506 (march_hi) R 31501 31501 31124 0 -1 4202496 2500273 0 0 0 105140 502 0 0 25 0 1 0 514854784 8240619520 1919560 33554432000 4194304 4331988 140736995702464 18446744073709551615 4271136 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/31506/statm: 2011870 1919560 151 34 0 2010312 0
Current children cumulated CPU time (s) 4243.3
Current children cumulated vsize (KiB) 14582440

[startup+1122.3 s]
/proc/loadavg: 9.20 9.04 8.46 10/187 31569
/proc/meminfo: memFree=1599916/32951124 swapFree=67111528/67111528
[pid=31501] ppid=31499 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/31501/stat : 31501 (ppfolio) S 31499 31501 31124 0 -1 4202496 525 214 0 0 0 0 0 0 15 0 1 0 514854784 18763776 391 33554432000 4194304 4287625 140734953711792 18446744073709551615 230809185807 0 0 4096 65536 9224195742862639362 0 0 17 4 0 0 0
/proc/31501/statm: 4581 391 342 23 0 91 0
[pid=31502] ppid=31501 vsize=1777000 CPUtime=1122.28 cores=0
/proc/31502/stat : 31502 (cryptominisat) R 31501 31501 31124 0 -1 4202496 966407 0 0 0 112073 155 0 0 25 0 1 0 514854784 1819648000 215013 33554432000 4194304 4587354 140737007893152 18446744073709551615 4238578 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/31502/statm: 444250 215013 338 96 0 440812 0
[pid=31503] ppid=31501 vsize=4874112 CPUtime=1122.32 cores=4
/proc/31503/stat : 31503 (clasp) R 31501 31501 31124 0 -1 4202496 1218207 0 0 0 112020 212 0 0 25 0 1 0 514854784 4991090688 1209802 33554432000 4194304 4785740 140737405882752 18446744073709551615 4279309 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/31503/statm: 1218528 1209804 336 145 0 1215573 0
[pid=31505] ppid=31501 vsize=207556 CPUtime=1122.29 cores=2
/proc/31505/stat : 31505 (lingeling) R 31501 31501 31124 0 -1 4202496 317030 0 0 0 112177 52 0 0 25 0 1 0 514854784 212537344 50033 33554432000 4194304 4352236 140735461159008 18446744073709551615 4327902 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/31505/statm: 51889 50033 127 39 0 50969 0
[pid=31506] ppid=31501 vsize=8194792 CPUtime=1116.09 cores=6
/proc/31506/stat : 31506 (march_hi) R 31501 31501 31124 0 -1 4202496 2539579 0 0 0 111095 514 0 0 25 0 1 0 514854784 8391467008 1958866 33554432000 4194304 4331988 140736995702464 18446744073709551615 4271136 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/31506/statm: 2048698 1958866 151 34 0 2047140 0
Current children cumulated CPU time (s) 4482.98
Current children cumulated vsize (KiB) 15071784



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+1178.5 s]
/proc/loadavg: 9.14 9.05 8.49 10/187 31570
/proc/meminfo: memFree=1102224/32951124 swapFree=67111528/67111528
[pid=31501] ppid=31499 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/31501/stat : 31501 (ppfolio) S 31499 31501 31124 0 -1 4202496 525 214 0 0 0 0 0 0 15 0 1 0 514854784 18763776 391 33554432000 4194304 4287625 140734953711792 18446744073709551615 230809185807 0 0 4096 65536 9224195742862639362 0 0 17 4 0 0 0
/proc/31501/statm: 4581 391 342 23 0 91 0
[pid=31502] ppid=31501 vsize=3203232 CPUtime=1178.49 cores=0
/proc/31502/stat : 31502 (cryptominisat) R 31501 31501 31124 0 -1 4202496 987623 0 0 0 117689 160 0 0 25 0 1 0 514854784 3280109568 226722 33554432000 4194304 4587354 140737007893152 18446744073709551615 47280726856855 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/31502/statm: 800808 226722 338 96 0 797370 0
[pid=31503] ppid=31501 vsize=5190260 CPUtime=1178.53 cores=4
/proc/31503/stat : 31503 (clasp) R 31501 31501 31124 0 -1 4202496 1297256 0 0 0 117628 225 0 0 25 0 1 0 514854784 5314826240 1288851 33554432000 4194304 4785740 140737405882752 18446744073709551615 4553243 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/31503/statm: 1297565 1288851 336 145 0 1294610 0
[pid=31505] ppid=31501 vsize=193568 CPUtime=1178.49 cores=2
/proc/31505/stat : 31505 (lingeling) R 31501 31501 31124 0 -1 4202496 326191 0 0 0 117796 53 0 0 25 0 1 0 514854784 198213632 47504 33554432000 4194304 4352236 140735461159008 18446744073709551615 4328114 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/31505/statm: 48392 47504 127 39 0 47472 0
[pid=31506] ppid=31501 vsize=8289964 CPUtime=1171.98 cores=6
/proc/31506/stat : 31506 (march_hi) R 31501 31501 31124 0 -1 4202496 2564960 0 0 0 116675 523 0 0 25 0 1 0 514854784 8488923136 1984247 33554432000 4194304 4331988 140736995702464 18446744073709551615 4271184 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/31506/statm: 2072491 1984247 151 34 0 2070933 0
Current children cumulated CPU time (s) 4707.49
Current children cumulated vsize (KiB) 16895348

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 31501 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=1999
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=1999
# CPU time returned by wait4() is 0.003998
# while last known CPU time is 4707.49
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1178.51
CPU time (s): 4707.49
CPU user time (s): 4697.88
CPU system time (s): 9.61
CPU usage (%): 399.443
Max. virtual memory (cumulated for all children) (KiB): 16895348

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.001999
system time used= 0.001999
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 739
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 240
involuntary context switches= 10

runsolver used 1.82572 second user time and 4.6123 second system time

The end

Launcher Data 

Begin job on node104 at 2011-04-29 01:15:43
IDJOB=3281348
IDBENCH=20580
IDSOLVER=1612
FILE ID=node104/3281348-1304032539
RUNJOBID= node104-1304032539-31476
PBS_JOBID= 13170348
Free space on /tmp= 71400 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT07/industrial/vliw_unsat_2.0/9dlx_vliw_at_b_iq7.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3281348-1304032539/watcher-3281348-1304032539 -o /tmp/evaluation-result-3281348-1304032539/solver-3281348-1304032539 -C 4800 -W 1300 -M 15500  ppfolio HOME/instance-3281348-1304032539.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 0fbc00fde383cec371bb97d621c5e7e5
RANDOM SEED=1444970246

node104.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.71
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5293.18
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      16185180 kB
Buffers:       2207512 kB
Cached:       13572068 kB
SwapCached:          0 kB
Active:        4097276 kB
Inactive:     12076184 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      16185180 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:          162584 kB
Writeback:           0 kB
AnonPages:      393252 kB
Mapped:          16588 kB
Slab:           527680 kB
PageTables:       5684 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:  1034828 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71392 MiB
End job on node104 at 2011-04-29 01:35:24