Trace number 3191486

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio seq? (TO) 1300.01 1300.03

General information on the benchmark

Namerandom/large/
unif-k3-r4.2-v40000-c168000-S64788608-008-UNKNOWN.cnf
MD5SUMc0e1e71ade06eb64bd0f5dbaf6b892a1
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark138.192
Satisfiable
(Un)Satisfiability was proved
Number of variables40000
Number of clauses168000
Sum of the clauses size504000
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 3168000
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.00/0.01	This is pico-portfolio, a naive parallel portfolio
0.00/0.01	Copyright (C) 2011 Olivier Roussel
0.00/0.01	Using 1 processing units
0.00/0.01	This portfolio uses the following solvers:
0.00/0.01	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.01	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.01	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.01	Starting cryptominisat 2.7.1 on core(s) 5
0.00/0.01	Starting clasp 1.3.6 on core(s) 5
0.00/0.01	Starting TNM 2009 on core(s) 5

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 893)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3191486-1302537403/watcher-3191486-1302537403 -o /tmp/evaluation-result-3191486-1302537403/solver-3191486-1302537403 -C 2400 -W 1300 -M 7680 ppfolio --nbcore=1 HOME/instance-3191486-1302537403.cnf 

running on 2 cores: 5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 7864320 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 7915520 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 12.00 10.60 6.41 10/198 12722
/proc/meminfo: memFree=12902060/32951124 swapFree=67111528/67111528
[pid=12722] ppid=12720 vsize=18324 CPUtime=0 cores=5,7
/proc/12722/stat : 12722 (ppfolio) R 12720 12722 12576 0 -1 4202496 486 0 0 0 0 0 0 0 24 0 1 0 346155755 18763776 391 33554432000 4194304 4287625 140736240128624 18446744073709551615 228095271317 0 0 4096 65536 0 0 0 17 5 0 0 0
/proc/12722/statm: 4581 391 343 23 0 91 0

[startup+0.0934849 s]
/proc/loadavg: 12.00 10.60 6.41 10/198 12722
/proc/meminfo: memFree=12902060/32951124 swapFree=67111528/67111528
[pid=12722] ppid=12720 vsize=18324 CPUtime=0 cores=5,7
/proc/12722/stat : 12722 (ppfolio) S 12720 12722 12576 0 -1 4202496 501 0 0 0 0 0 0 0 24 0 1 0 346155755 18763776 393 33554432000 4194304 4287625 140736240128624 18446744073709551615 228095471119 0 0 4096 65536 4347410981282873608 0 0 17 7 0 0 0
/proc/12722/statm: 4581 393 345 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.100483 s]
/proc/loadavg: 12.00 10.60 6.41 10/198 12722
/proc/meminfo: memFree=12902060/32951124 swapFree=67111528/67111528
[pid=12722] ppid=12720 vsize=18324 CPUtime=0 cores=5,7
/proc/12722/stat : 12722 (ppfolio) S 12720 12722 12576 0 -1 4202496 501 0 0 0 0 0 0 0 24 0 1 0 346155755 18763776 393 33554432000 4194304 4287625 140736240128624 18446744073709551615 228095471119 0 0 4096 65536 4347410981282873608 0 0 17 7 0 0 0
/proc/12722/statm: 4581 393 345 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.300449 s]
/proc/loadavg: 12.00 10.60 6.41 10/198 12722
/proc/meminfo: memFree=12902060/32951124 swapFree=67111528/67111528
[pid=12722] ppid=12720 vsize=18324 CPUtime=0 cores=5,7
/proc/12722/stat : 12722 (ppfolio) S 12720 12722 12576 0 -1 4202496 502 0 0 0 0 0 0 0 23 0 1 0 346155755 18763776 393 33554432000 4194304 4287625 140736240128624 18446744073709551615 228095471119 0 0 4096 65536 0 0 0 17 7 0 0 0
/proc/12722/statm: 4581 393 345 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.700377 s]
/proc/loadavg: 12.00 10.60 6.41 10/198 12722
/proc/meminfo: memFree=12902060/32951124 swapFree=67111528/67111528
[pid=12722] ppid=12720 vsize=18324 CPUtime=0 cores=5,7
/proc/12722/stat : 12722 (ppfolio) S 12720 12722 12576 0 -1 4202496 502 0 0 0 0 0 0 0 23 0 1 0 346155755 18763776 393 33554432000 4194304 4287625 140736240128624 18446744073709551615 228095471119 0 0 4096 65536 0 0 0 17 7 0 0 0
/proc/12722/statm: 4581 393 345 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50123 s]
/proc/loadavg: 12.00 10.60 6.41 13/202 12726
/proc/meminfo: memFree=12825892/32951124 swapFree=67111528/67111528
[pid=12722] ppid=12720 vsize=18324 CPUtime=0 cores=5,7
/proc/12722/stat : 12722 (ppfolio) S 12720 12722 12576 0 -1 4202496 502 0 0 0 0 0 0 0 15 0 1 0 346155755 18763776 393 33554432000 4194304 4287625 140736240128624 18446744073709551615 228095471119 0 0 4096 65536 4336021960669528064 0 0 17 7 0 0 0
/proc/12722/statm: 4581 393 345 23 0 91 0
[pid=12723] ppid=12722 vsize=61320 CPUtime=0.49 cores=5
/proc/12723/stat : 12723 (cryptominisat) R 12722 12722 12576 0 -1 4202496 12483 0 0 0 48 1 0 0 25 0 1 0 346155756 62791680 10578 33554432000 4194304 4587354 140735423918848 18446744073709551615 4380425 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/12723/statm: 15330 10578 314 96 0 11892 0
[pid=12724] ppid=12722 vsize=33772 CPUtime=0.44 cores=5
/proc/12724/stat : 12724 (clasp) R 12722 12722 12576 0 -1 4202496 7737 0 0 0 44 0 0 0 25 0 1 0 346155756 34582528 5650 33554432000 4194304 4785740 140734653238208 18446744073709551615 4553032 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/12724/statm: 8443 5650 332 145 0 5488 0
[pid=12725] ppid=12722 vsize=467968 CPUtime=0.54 cores=5
/proc/12725/stat : 12725 (TNM) R 12722 12722 12576 0 -1 4202496 6720 0 0 0 54 0 0 0 25 0 1 0 346155756 479199232 6617 33554432000 134512640 134534564 4289592656 18446744073709551615 134529352 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/12725/statm: 116992 6617 95 6 0 115658 0
Current children cumulated CPU time (s) 1.47
Current children cumulated vsize (KiB) 581384

[startup+3.10095 s]
/proc/loadavg: 12.00 10.60 6.41 13/202 12726
/proc/meminfo: memFree=12808532/32951124 swapFree=67111528/67111528
[pid=12722] ppid=12720 vsize=18324 CPUtime=0 cores=5,7
/proc/12722/stat : 12722 (ppfolio) S 12720 12722 12576 0 -1 4202496 502 0 0 0 0 0 0 0 15 0 1 0 346155755 18763776 393 33554432000 4194304 4287625 140736240128624 18446744073709551615 228095471119 0 0 4096 65536 0 0 0 17 7 0 0 0
/proc/12722/statm: 4581 393 345 23 0 91 0
[pid=12723] ppid=12722 vsize=60012 CPUtime=0.99 cores=5
/proc/12723/stat : 12723 (cryptominisat) R 12722 12722 12576 0 -1 4202496 13460 0 0 0 98 1 0 0 25 0 1 0 346155756 61452288 10272 33554432000 4194304 4587354 140735423918848 18446744073709551615 4238268 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/12723/statm: 15003 10272 326 96 0 11565 0
[pid=12724] ppid=12722 vsize=33772 CPUtime=0.96 cores=5
/proc/12724/stat : 12724 (clasp) R 12722 12722 12576 0 -1 4202496 7745 0 0 0 96 0 0 0 25 0 1 0 346155756 34582528 5658 33554432000 4194304 4785740 140734653238208 18446744073709551615 4552970 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/12724/statm: 8443 5658 340 145 0 5488 0
[pid=12725] ppid=12722 vsize=467968 CPUtime=1.11 cores=5
/proc/12725/stat : 12725 (TNM) R 12722 12722 12576 0 -1 4202496 6720 0 0 0 111 0 0 0 25 0 1 0 346155756 479199232 6617 33554432000 134512640 134534564 4289592656 18446744073709551615 134529651 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/12725/statm: 116992 6617 95 6 0 115658 0
Current children cumulated CPU time (s) 3.06
Current children cumulated vsize (KiB) 580076

[startup+6.30035 s]
/proc/loadavg: 12.00 10.62 6.44 13/202 12726
/proc/meminfo: memFree=12758248/32951124 swapFree=67111528/67111528
[pid=12722] ppid=12720 vsize=18324 CPUtime=0 cores=5,7
/proc/12722/stat : 12722 (ppfolio) S 12720 12722 12576 0 -1 4202496 502 0 0 0 0 0 0 0 15 0 1 0 346155755 18763776 393 33554432000 4194304 4287625 140736240128624 18446744073709551615 228095471119 0 0 4096 65536 0 0 0 17 7 0 0 0
/proc/12722/statm: 4581 393 345 23 0 91 0
[pid=12723] ppid=12722 vsize=60012 CPUtime=2.09 cores=5
/proc/12723/stat : 12723 (cryptominisat) R 12722 12722 12576 0 -1 4202496 14217 0 0 0 207 2 0 0 25 0 1 0 346155756 61452288 11026 33554432000 4194304 4587354 140735423918848 18446744073709551615 4248764 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/12723/statm: 15003 11026 326 96 0 11565 0
[pid=12724] ppid=12722 vsize=34048 CPUtime=2.04 cores=5
/proc/12724/stat : 12724 (clasp) R 12722 12722 12576 0 -1 4202496 7853 0 0 0 204 0 0 0 25 0 1 0 346155756 34865152 5766 33554432000 4194304 4785740 140734653238208 18446744073709551615 4553088 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/12724/statm: 8512 5766 340 145 0 5557 0
[pid=12725] ppid=12722 vsize=467968 CPUtime=2.14 cores=5
/proc/12725/stat : 12725 (TNM) R 12722 12722 12576 0 -1 4202496 6720 0 0 0 214 0 0 0 25 0 1 0 346155756 479199232 6617 33554432000 134512640 134534564 4289592656 18446744073709551615 134530701 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/12725/statm: 116992 6617 95 6 0 115658 0
Current children cumulated CPU time (s) 6.27
Current children cumulated vsize (KiB) 580352

[startup+12.7012 s]
/proc/loadavg: 12.00 10.65 6.47 13/202 12726
/proc/meminfo: memFree=12733904/32951124 swapFree=67111528/67111528
[pid=12722] ppid=12720 vsize=18324 CPUtime=0 cores=5,7
/proc/12722/stat : 12722 (ppfolio) S 12720 12722 12576 0 -1 4202496 502 0 0 0 0 0 0 0 15 0 1 0 346155755 18763776 393 33554432000 4194304 4287625 140736240128624 18446744073709551615 228095471119 0 0 4096 65536 4336022785303248896 0 0 17 7 0 0 0
/proc/12722/statm: 4581 393 345 23 0 91 0
[pid=12723] ppid=12722 vsize=97516 CPUtime=4.19 cores=5
/proc/12723/stat : 12723 (cryptominisat) R 12722 12722 12576 0 -1 4202496 15516 0 0 0 417 2 0 0 25 0 1 0 346155756 99856384 12319 33554432000 4194304 4587354 140735423918848 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/12723/statm: 24379 12319 326 96 0 20941 0
[pid=12724] ppid=12722 vsize=42528 CPUtime=4.17 cores=5
/proc/12724/stat : 12724 (clasp) R 12722 12722 12576 0 -1 4202496 9970 0 0 0 416 1 0 0 25 0 1 0 346155756 43548672 7883 33554432000 4194304 4785740 140734653238208 18446744073709551615 4553032 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/12724/statm: 10632 7883 340 145 0 7677 0
[pid=12725] ppid=12722 vsize=467968 CPUtime=4.31 cores=5
/proc/12725/stat : 12725 (TNM) R 12722 12722 12576 0 -1 4202496 6720 0 0 0 431 0 0 0 25 0 1 0 346155756 479199232 6617 33554432000 134512640 134534564 4289592656 18446744073709551615 134529640 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/12725/statm: 116992 6617 95 6 0 115658 0
Current children cumulated CPU time (s) 12.67
Current children cumulated vsize (KiB) 626336

[startup+25.5008 s]
/proc/loadavg: 12.00 10.71 6.55 13/202 12726
/proc/meminfo: memFree=12842236/32951124 swapFree=67111528/67111528
[pid=12722] ppid=12720 vsize=18324 CPUtime=0 cores=5,7
/proc/12722/stat : 12722 (ppfolio) S 12720 12722 12576 0 -1 4202496 502 0 0 0 0 0 0 0 15 0 1 0 346155755 18763776 393 33554432000 4194304 4287625 140736240128624 18446744073709551615 228095471119 0 0 4096 65536 4336023060181155840 0 0 17 7 0 0 0
/proc/12722/statm: 4581 393 345 23 0 91 0
[pid=12723] ppid=12722 vsize=97516 CPUtime=8.49 cores=5
/proc/12723/stat : 12723 (cryptominisat) R 12722 12722 12576 0 -1 4202496 18151 0 0 0 846 3 0 0 25 0 1 0 346155756 99856384 14945 33554432000 4194304 4587354 140735423918848 18446744073709551615 4238271 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/12723/statm: 24379 14945 326 96 0 20941 0
[pid=12724] ppid=12722 vsize=60280 CPUtime=8.44 cores=5
/proc/12724/stat : 12724 (clasp) R 12722 12722 12576 0 -1 4202496 14403 0 0 0 842 2 0 0 25 0 1 0 346155756 61726720 12316 33554432000 4194304 4785740 140734653238208 18446744073709551615 4277472 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/12724/statm: 15070 12316 340 145 0 12115 0
[pid=12725] ppid=12722 vsize=467968 CPUtime=8.54 cores=5
/proc/12725/stat : 12725 (TNM) R 12722 12722 12576 0 -1 4202496 6720 0 0 0 854 0 0 0 25 0 1 0 346155756 479199232 6617 33554432000 134512640 134534564 4289592656 18446744073709551615 134528295 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/12725/statm: 116992 6617 95 6 0 115658 0
Current children cumulated CPU time (s) 25.47
Current children cumulated vsize (KiB) 644088

[startup+51.1011 s]
/proc/loadavg: 12.00 10.81 6.70 13/202 12727
/proc/meminfo: memFree=12770520/32951124 swapFree=67111528/67111528
[pid=12722] ppid=12720 vsize=18324 CPUtime=0 cores=5,7
/proc/12722/stat : 12722 (ppfolio) S 12720 12722 12576 0 -1 4202496 502 0 0 0 0 0 0 0 15 0 1 0 346155755 18763776 393 33554432000 4194304 4287625 140736240128624 18446744073709551615 228095471119 0 0 4096 65536 4336022785303248896 0 0 17 7 0 0 0
/proc/12722/statm: 4581 393 345 23 0 91 0
[pid=12723] ppid=12722 vsize=238648 CPUtime=16.98 cores=5
/proc/12723/stat : 12723 (cryptominisat) R 12722 12722 12576 0 -1 4202496 47584 0 0 0 1692 6 0 0 25 0 1 0 346155756 244375552 37766 33554432000 4194304 4587354 140735423918848 18446744073709551615 4364784 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/12723/statm: 59662 37766 337 96 0 56224 0
[pid=12724] ppid=12722 vsize=96200 CPUtime=16.97 cores=5
/proc/12724/stat : 12724 (clasp) R 12722 12722 12576 0 -1 4202496 23384 0 0 0 1693 4 0 0 25 0 1 0 346155756 98508800 21297 33554432000 4194304 4785740 140734653238208 18446744073709551615 4553402 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/12724/statm: 24050 21297 340 145 0 21095 0
[pid=12725] ppid=12722 vsize=467968 CPUtime=17.11 cores=5
/proc/12725/stat : 12725 (TNM) R 12722 12722 12576 0 -1 4202496 6720 0 0 0 1711 0 0 0 25 0 1 0 346155756 479199232 6617 33554432000 134512640 134534564 4289592656 18446744073709551615 134530367 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/12725/statm: 116992 6617 95 6 0 115658 0
Current children cumulated CPU time (s) 51.06
Current children cumulated vsize (KiB) 821140

[startup+102.308 s]
/proc/loadavg: 12.00 10.99 6.97 13/202 12728
/proc/meminfo: memFree=12789808/32951124 swapFree=67111528/67111528
[pid=12722] ppid=12720 vsize=18324 CPUtime=0 cores=5,7
/proc/12722/stat : 12722 (ppfolio) S 12720 12722 12576 0 -1 4202496 502 0 0 0 0 0 0 0 15 0 1 0 346155755 18763776 393 33554432000 4194304 4287625 140736240128624 18446744073709551615 228095471119 0 0 4096 65536 4336021685791621120 0 0 17 7 0 0 0
/proc/12722/statm: 4581 393 345 23 0 91 0
[pid=12723] ppid=12722 vsize=149704 CPUtime=34.09 cores=5
/proc/12723/stat : 12723 (cryptominisat) R 12722 12722 12576 0 -1 4202496 71915 0 0 0 3397 12 0 0 25 0 1 0 346155756 153296896 17405 33554432000 4194304 4587354 140735423918848 18446744073709551615 4238271 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/12723/statm: 37426 17405 337 96 0 33988 0
[pid=12724] ppid=12722 vsize=154600 CPUtime=34.03 cores=5
/proc/12724/stat : 12724 (clasp) R 12722 12722 12576 0 -1 4202496 37868 0 0 0 3396 7 0 0 25 0 1 0 346155756 158310400 35781 33554432000 4194304 4785740 140734653238208 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/12724/statm: 38650 35781 340 145 0 35695 0
[pid=12725] ppid=12722 vsize=467968 CPUtime=34.16 cores=5
/proc/12725/stat : 12725 (TNM) R 12722 12722 12576 0 -1 4202496 6720 0 0 0 3416 0 0 0 25 0 1 0 346155756 479199232 6617 33554432000 134512640 134534564 4289592656 18446744073709551615 134530659 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/12725/statm: 116992 6617 95 6 0 115658 0
Current children cumulated CPU time (s) 102.28
Current children cumulated vsize (KiB) 790596

[startup+162.301 s]
/proc/loadavg: 12.00 11.17 7.29 13/202 12730
/proc/meminfo: memFree=12755576/32951124 swapFree=67111528/67111528
[pid=12722] ppid=12720 vsize=18324 CPUtime=0 cores=5,7
/proc/12722/stat : 12722 (ppfolio) S 12720 12722 12576 0 -1 4202496 502 0 0 0 0 0 0 0 15 0 1 0 346155755 18763776 393 33554432000 4194304 4287625 140736240128624 18446744073709551615 228095471119 0 0 4096 65536 4336022510425341952 0 0 17 7 0 0 0
/proc/12722/statm: 4581 393 345 23 0 91 0
[pid=12723] ppid=12722 vsize=989948 CPUtime=54.08 cores=5
/proc/12723/stat : 12723 (cryptominisat) R 12722 12722 12576 0 -1 4202496 97818 0 0 0 5391 17 0 0 25 0 1 0 346155756 1013706752 17599 33554432000 4194304 4587354 140735423918848 18446744073709551615 4238334 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/12723/statm: 247487 17599 337 96 0 244049 0
[pid=12724] ppid=12722 vsize=157424 CPUtime=54.03 cores=5

################
# More data... #
################

/proc/12725/statm: 116992 6617 95 6 0 115658 0
Current children cumulated CPU time (s) 822.29
Current children cumulated vsize (KiB) 1818456

[startup+882.301 s]
/proc/loadavg: 11.95 11.84 9.77 13/202 12880
/proc/meminfo: memFree=12697308/32951124 swapFree=67111528/67111528
[pid=12722] ppid=12720 vsize=18324 CPUtime=0 cores=5,7
/proc/12722/stat : 12722 (ppfolio) S 12720 12722 12576 0 -1 4202496 502 0 0 0 0 0 0 0 15 0 1 0 346155755 18763776 393 33554432000 4194304 4287625 140736240128624 18446744073709551615 228095471119 0 0 4096 65536 4336022647864295424 0 0 17 7 0 0 0
/proc/12722/statm: 4581 393 345 23 0 91 0
[pid=12723] ppid=12722 vsize=1001500 CPUtime=294.05 cores=5
/proc/12723/stat : 12723 (cryptominisat) R 12722 12722 12576 0 -1 4202496 318629 0 0 0 29348 57 0 0 25 0 1 0 346155756 1025536000 22521 33554432000 4194304 4587354 140735423918848 18446744073709551615 4238299 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/12723/statm: 250375 22521 337 96 0 246937 0
[pid=12724] ppid=12722 vsize=329012 CPUtime=294.08 cores=5
/proc/12724/stat : 12724 (clasp) R 12722 12722 12576 0 -1 4202496 80551 0 0 0 29391 17 0 0 25 0 1 0 346155756 336908288 78464 33554432000 4194304 4785740 140734653238208 18446744073709551615 4550456 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/12724/statm: 82253 78464 340 145 0 79298 0
[pid=12725] ppid=12722 vsize=467968 CPUtime=294.17 cores=5
/proc/12725/stat : 12725 (TNM) R 12722 12722 12576 0 -1 4202496 6720 0 0 0 29417 0 0 0 25 0 1 0 346155756 479199232 6617 33554432000 134512640 134534564 4289592656 18446744073709551615 134530551 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/12725/statm: 116992 6617 95 6 0 115658 0
Current children cumulated CPU time (s) 882.3
Current children cumulated vsize (KiB) 1816804

[startup+942.301 s]
/proc/loadavg: 11.98 11.87 9.91 13/202 12881
/proc/meminfo: memFree=12701264/32951124 swapFree=67111528/67111528
[pid=12722] ppid=12720 vsize=18324 CPUtime=0 cores=5,7
/proc/12722/stat : 12722 (ppfolio) S 12720 12722 12576 0 -1 4202496 502 0 0 0 0 0 0 0 15 0 1 0 346155755 18763776 393 33554432000 4194304 4287625 140736240128624 18446744073709551615 228095471119 0 0 4096 65536 4336022785303248896 0 0 17 7 0 0 0
/proc/12722/statm: 4581 393 345 23 0 91 0
[pid=12723] ppid=12722 vsize=1011556 CPUtime=314.04 cores=5
/proc/12723/stat : 12723 (cryptominisat) R 12722 12722 12576 0 -1 4202496 326759 0 0 0 31346 58 0 0 25 0 1 0 346155756 1035833344 23535 33554432000 4194304 4587354 140735423918848 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/12723/statm: 252889 23535 337 96 0 249451 0
[pid=12724] ppid=12722 vsize=329012 CPUtime=314.08 cores=5
/proc/12724/stat : 12724 (clasp) R 12722 12722 12576 0 -1 4202496 80555 0 0 0 31391 17 0 0 25 0 1 0 346155756 336908288 78468 33554432000 4194304 4785740 140734653238208 18446744073709551615 4546105 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/12724/statm: 82253 78468 340 145 0 79298 0
[pid=12725] ppid=12722 vsize=467968 CPUtime=314.17 cores=5
/proc/12725/stat : 12725 (TNM) R 12722 12722 12576 0 -1 4202496 6720 0 0 0 31417 0 0 0 25 0 1 0 346155756 479199232 6617 33554432000 134512640 134534564 4289592656 18446744073709551615 134528687 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/12725/statm: 116992 6617 95 6 0 115658 0
Current children cumulated CPU time (s) 942.29
Current children cumulated vsize (KiB) 1826860

[startup+1002.3 s]
/proc/loadavg: 11.99 11.89 10.04 13/202 12883
/proc/meminfo: memFree=12535588/32951124 swapFree=67111528/67111528
[pid=12722] ppid=12720 vsize=18324 CPUtime=0 cores=5,7
/proc/12722/stat : 12722 (ppfolio) S 12720 12722 12576 0 -1 4202496 502 0 0 0 0 0 0 0 15 0 1 0 346155755 18763776 393 33554432000 4194304 4287625 140736240128624 18446744073709551615 228095471119 0 0 4096 65536 4336022098108481536 0 0 17 7 0 0 0
/proc/12722/statm: 4581 393 345 23 0 91 0
[pid=12723] ppid=12722 vsize=995552 CPUtime=334.04 cores=5
/proc/12723/stat : 12723 (cryptominisat) R 12722 12722 12576 0 -1 4202496 371750 0 0 0 33339 65 0 0 25 0 1 0 346155756 1019445248 20955 33554432000 4194304 4587354 140735423918848 18446744073709551615 4238736 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/12723/statm: 248888 20955 337 96 0 245450 0
[pid=12724] ppid=12722 vsize=337896 CPUtime=334.08 cores=5
/proc/12724/stat : 12724 (clasp) R 12722 12722 12576 0 -1 4202496 82407 0 0 0 33391 17 0 0 25 0 1 0 346155756 346005504 80320 33554432000 4194304 4785740 140734653238208 18446744073709551615 4552910 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/12724/statm: 84474 80320 340 145 0 81519 0
[pid=12725] ppid=12722 vsize=467968 CPUtime=334.16 cores=5
/proc/12725/stat : 12725 (TNM) R 12722 12722 12576 0 -1 4202496 6720 0 0 0 33416 0 0 0 25 0 1 0 346155756 479199232 6617 33554432000 134512640 134534564 4289592656 18446744073709551615 134530632 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/12725/statm: 116992 6617 95 6 0 115658 0
Current children cumulated CPU time (s) 1002.28
Current children cumulated vsize (KiB) 1819740

[startup+1062.3 s]
/proc/loadavg: 11.99 11.91 10.16 13/202 12885
/proc/meminfo: memFree=12635884/32951124 swapFree=67111528/67111528
[pid=12722] ppid=12720 vsize=18324 CPUtime=0 cores=5,7
/proc/12722/stat : 12722 (ppfolio) S 12720 12722 12576 0 -1 4202496 502 0 0 0 0 0 0 0 15 0 1 0 346155755 18763776 393 33554432000 4194304 4287625 140736240128624 18446744073709551615 228095471119 0 0 4096 65536 4336022647864295424 0 0 17 7 0 0 0
/proc/12722/statm: 4581 393 345 23 0 91 0
[pid=12723] ppid=12722 vsize=166828 CPUtime=354.05 cores=5
/proc/12723/stat : 12723 (cryptominisat) R 12722 12722 12576 0 -1 4202496 384196 0 0 0 35337 68 0 0 25 0 1 0 346155756 170831872 26070 33554432000 4194304 4587354 140735423918848 18446744073709551615 4248764 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/12723/statm: 41707 26070 337 96 0 38269 0
[pid=12724] ppid=12722 vsize=363580 CPUtime=354.08 cores=5
/proc/12724/stat : 12724 (clasp) R 12722 12722 12576 0 -1 4202496 88844 0 0 0 35390 18 0 0 25 0 1 0 346155756 372305920 86757 33554432000 4194304 4785740 140734653238208 18446744073709551615 4546105 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/12724/statm: 90895 86757 340 145 0 87940 0
[pid=12725] ppid=12722 vsize=467968 CPUtime=354.16 cores=5
/proc/12725/stat : 12725 (TNM) R 12722 12722 12576 0 -1 4202496 6720 0 0 0 35416 0 0 0 25 0 1 0 346155756 479199232 6617 33554432000 134512640 134534564 4289592656 18446744073709551615 134525949 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/12725/statm: 116992 6617 95 6 0 115658 0
Current children cumulated CPU time (s) 1062.29
Current children cumulated vsize (KiB) 1016700

[startup+1122.3 s]
/proc/loadavg: 12.05 11.94 10.27 13/202 12886
/proc/meminfo: memFree=12620116/32951124 swapFree=67111528/67111528
[pid=12722] ppid=12720 vsize=18324 CPUtime=0 cores=5,7
/proc/12722/stat : 12722 (ppfolio) S 12720 12722 12576 0 -1 4202496 502 0 0 0 0 0 0 0 15 0 1 0 346155755 18763776 393 33554432000 4194304 4287625 140736240128624 18446744073709551615 228095471119 0 0 4096 65536 4336022785303248896 0 0 17 7 0 0 0
/proc/12722/statm: 4581 393 345 23 0 91 0
[pid=12723] ppid=12722 vsize=166904 CPUtime=374.06 cores=5
/proc/12723/stat : 12723 (cryptominisat) R 12722 12722 12576 0 -1 4202496 392276 0 0 0 37335 71 0 0 25 0 1 0 346155756 170909696 26566 33554432000 4194304 4587354 140735423918848 18446744073709551615 4237467 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/12723/statm: 41726 26566 337 96 0 38288 0
[pid=12724] ppid=12722 vsize=404080 CPUtime=374.09 cores=5
/proc/12724/stat : 12724 (clasp) R 12722 12722 12576 0 -1 4202496 98932 0 0 0 37388 21 0 0 25 0 1 0 346155756 413777920 96845 33554432000 4194304 4785740 140734653238208 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/12724/statm: 101020 96845 340 145 0 98065 0
[pid=12725] ppid=12722 vsize=467968 CPUtime=374.16 cores=5
/proc/12725/stat : 12725 (TNM) R 12722 12722 12576 0 -1 4202496 6720 0 0 0 37416 0 0 0 25 0 1 0 346155756 479199232 6617 33554432000 134512640 134534564 4289592656 18446744073709551615 10497248 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/12725/statm: 116992 6617 95 6 0 115658 0
Current children cumulated CPU time (s) 1122.31
Current children cumulated vsize (KiB) 1057276

[startup+1182.3 s]
/proc/loadavg: 12.02 11.94 10.38 13/202 12888
/proc/meminfo: memFree=12515940/32951124 swapFree=67111528/67111528
[pid=12722] ppid=12720 vsize=18324 CPUtime=0 cores=5,7
/proc/12722/stat : 12722 (ppfolio) S 12720 12722 12576 0 -1 4202496 502 0 0 0 0 0 0 0 15 0 1 0 346155755 18763776 393 33554432000 4194304 4287625 140736240128624 18446744073709551615 228095471119 0 0 4096 65536 4336022922742202368 0 0 17 7 0 0 0
/proc/12722/statm: 4581 393 345 23 0 91 0
[pid=12723] ppid=12722 vsize=1051780 CPUtime=394.06 cores=5
/proc/12723/stat : 12723 (cryptominisat) R 12722 12722 12576 0 -1 4202496 400382 0 0 0 39333 73 0 0 25 0 1 0 346155756 1077022720 26650 33554432000 4194304 4587354 140735423918848 18446744073709551615 4237467 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/12723/statm: 262945 26650 337 96 0 259507 0
[pid=12724] ppid=12722 vsize=404716 CPUtime=394.08 cores=5
/proc/12724/stat : 12724 (clasp) R 12722 12722 12576 0 -1 4202496 99069 0 0 0 39387 21 0 0 25 0 1 0 346155756 414429184 96982 33554432000 4194304 4785740 140734653238208 18446744073709551615 4287019 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/12724/statm: 101179 96982 340 145 0 98224 0
[pid=12725] ppid=12722 vsize=467968 CPUtime=394.15 cores=5
/proc/12725/stat : 12725 (TNM) R 12722 12722 12576 0 -1 4202496 6720 0 0 0 39415 0 0 0 25 0 1 0 346155756 479199232 6617 33554432000 134512640 134534564 4289592656 18446744073709551615 134528957 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/12725/statm: 116992 6617 95 6 0 115658 0
Current children cumulated CPU time (s) 1182.29
Current children cumulated vsize (KiB) 1942788

[startup+1242.3 s]
/proc/loadavg: 12.00 11.95 10.48 13/202 12889
/proc/meminfo: memFree=12506504/32951124 swapFree=67111528/67111528
[pid=12722] ppid=12720 vsize=18324 CPUtime=0 cores=5,7
/proc/12722/stat : 12722 (ppfolio) S 12720 12722 12576 0 -1 4202496 502 0 0 0 0 0 0 0 15 0 1 0 346155755 18763776 393 33554432000 4194304 4287625 140736240128624 18446744073709551615 228095471119 0 0 4096 65536 4336023060181155840 0 0 17 7 0 0 0
/proc/12722/statm: 4581 393 345 23 0 91 0
[pid=12723] ppid=12722 vsize=1012772 CPUtime=414.07 cores=5
/proc/12723/stat : 12723 (cryptominisat) R 12722 12722 12576 0 -1 4202496 407744 0 0 0 41331 76 0 0 25 0 1 0 346155756 1037078528 25693 33554432000 4194304 4587354 140735423918848 18446744073709551615 4237679 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/12723/statm: 253193 25693 337 96 0 249755 0
[pid=12724] ppid=12722 vsize=405452 CPUtime=414.08 cores=5
/proc/12724/stat : 12724 (clasp) R 12722 12722 12576 0 -1 4202496 99235 0 0 0 41387 21 0 0 25 0 1 0 346155756 415182848 97148 33554432000 4194304 4785740 140734653238208 18446744073709551615 4552940 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/12724/statm: 101363 97148 340 145 0 98408 0
[pid=12725] ppid=12722 vsize=467968 CPUtime=414.15 cores=5
/proc/12725/stat : 12725 (TNM) R 12722 12722 12576 0 -1 4202496 6720 0 0 0 41415 0 0 0 25 0 1 0 346155756 479199232 6617 33554432000 134512640 134534564 4289592656 18446744073709551615 134528638 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/12725/statm: 116992 6617 95 6 0 115658 0
Current children cumulated CPU time (s) 1242.3
Current children cumulated vsize (KiB) 1904516



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 12.00 11.96 10.57 13/202 12922
/proc/meminfo: memFree=12774876/32951124 swapFree=67111528/67111528
[pid=12722] ppid=12720 vsize=18324 CPUtime=0 cores=5,7
/proc/12722/stat : 12722 (ppfolio) S 12720 12722 12576 0 -1 4202496 502 0 0 0 0 0 0 0 15 0 1 0 346155755 18763776 393 33554432000 4194304 4287625 140736240128624 18446744073709551615 228095471119 0 0 4096 65536 4336023060181155840 0 0 17 7 0 0 0
/proc/12722/statm: 4581 393 345 23 0 91 0
[pid=12723] ppid=12722 vsize=1003084 CPUtime=433.32 cores=5
/proc/12723/stat : 12723 (cryptominisat) R 12722 12722 12576 0 -1 4202496 414977 0 0 0 43254 78 0 0 25 0 1 0 346155756 1027158016 24426 33554432000 4194304 4587354 140735423918848 18446744073709551615 4237695 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/12723/statm: 250771 24426 337 96 0 247333 0
[pid=12724] ppid=12722 vsize=425792 CPUtime=433.28 cores=5
/proc/12724/stat : 12724 (clasp) R 12722 12722 12576 0 -1 4202496 104256 0 0 0 43305 23 0 0 25 0 1 0 346155756 436011008 102169 33554432000 4194304 4785740 140734653238208 18446744073709551615 4287241 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/12724/statm: 106448 102169 340 145 0 103493 0
[pid=12725] ppid=12722 vsize=467968 CPUtime=433.41 cores=5
/proc/12725/stat : 12725 (TNM) R 12722 12722 12576 0 -1 4202496 6720 0 0 0 43341 0 0 0 25 0 1 0 346155756 479199232 6617 33554432000 134512640 134534564 4289592656 18446744073709551615 134529084 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/12725/statm: 116992 6617 95 6 0 115658 0
Current children cumulated CPU time (s) 1300.01
Current children cumulated vsize (KiB) 1915168

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 12722 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=2999
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=999
# CPU time returned by wait4() is 0.003998
# while last known CPU time is 1300.01
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1300.03
CPU time (s): 1300.01
CPU user time (s): 1299
CPU system time (s): 1.01
CPU usage (%): 99.9986
Max. virtual memory (cumulated for all children) (KiB): 2760344

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.002999
system time used= 0.000999
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 502
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 185
involuntary context switches= 3

runsolver used 2.01969 second user time and 5.13322 second system time

The end

Launcher Data 

Begin job on node142 at 2011-04-11 17:56:43
IDJOB=3191486
IDBENCH=82617
IDSOLVER=1613
FILE ID=node142/3191486-1302537403
RUNJOBID= node142-1302536786-12597
PBS_JOBID= 12951113
Free space on /tmp= 71076 MiB

SOLVER NAME= ppfolio seq
BENCH NAME= SAT11/random/large/unif-k3-r4.2-v40000-c168000-S64788608-008-UNKNOWN.cnf
COMMAND LINE= ppfolio --nbcore=1 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3191486-1302537403/watcher-3191486-1302537403 -o /tmp/evaluation-result-3191486-1302537403/solver-3191486-1302537403 -C 2400 -W 1300 -M 7680  ppfolio --nbcore=1 HOME/instance-3191486-1302537403.cnf

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 7680 MiB
NBCORE= 2

MD5SUM BENCH= c0e1e71ade06eb64bd0f5dbaf6b892a1
RANDOM SEED=234073650

node142.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5131.95
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.81
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      12902348 kB
Buffers:        721764 kB
Cached:       18196828 kB
SwapCached:          0 kB
Active:       10636224 kB
Inactive:      8997036 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      12902348 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:           24504 kB
Writeback:           0 kB
AnonPages:      714224 kB
Mapped:          17816 kB
Slab:           350328 kB
PageTables:       7808 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:  6036320 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71068 MiB
End job on node142 at 2011-04-11 18:18:25