Trace number 3220786

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio seq? (TO) 5000.02 4999.91

General information on the benchmark

Namerandom/medium/
unif-k3-r4.26-v550-c2343-S1694067460-072.UNKNOWN.cnf
MD5SUMf2d2b125797e776fb2e7099729714d99
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark1906.91
Satisfiable
(Un)Satisfiability was proved
Number of variables550
Number of clauses2343
Sum of the clauses size7029
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 32343
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 1 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 1
0.00/0.00	Starting clasp 1.3.6 on core(s) 1
0.00/0.00	Starting TNM 2009 on core(s) 1

Verifier Data

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3220786-1303278341/watcher-3220786-1303278341 -o /tmp/evaluation-result-3220786-1303278341/solver-3220786-1303278341 -C 5000 -W 5000 -M 15500 ppfolio --nbcore=1 HOME/instance-3220786-1303278341.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 5000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 5030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 5.47 5.83 5.80 5/180 19576
/proc/meminfo: memFree=15331808/32951124 swapFree=67111528/67111528
[pid=19576] ppid=19574 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/19576/stat : 19576 (ppfolio) S 19574 19576 17741 0 -1 4202496 498 0 0 0 0 0 0 0 25 0 1 0 439434592 18763776 394 33554432000 4194304 4287625 140733828754336 18446744073709551615 230809185807 0 0 4096 65536 5921411904223281416 0 0 17 3 0 0 0
/proc/19576/statm: 4581 394 345 23 0 91 0

[startup+0.0845529 s]
/proc/loadavg: 5.47 5.83 5.80 5/180 19576
/proc/meminfo: memFree=15331808/32951124 swapFree=67111528/67111528
[pid=19576] ppid=19574 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/19576/stat : 19576 (ppfolio) S 19574 19576 17741 0 -1 4202496 498 0 0 0 0 0 0 0 25 0 1 0 439434592 18763776 394 33554432000 4194304 4287625 140733828754336 18446744073709551615 230809185807 0 0 4096 65536 5921411904223281416 0 0 17 3 0 0 0
/proc/19576/statm: 4581 394 345 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.10055 s]
/proc/loadavg: 5.47 5.83 5.80 5/180 19576
/proc/meminfo: memFree=15331808/32951124 swapFree=67111528/67111528
[pid=19576] ppid=19574 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/19576/stat : 19576 (ppfolio) S 19574 19576 17741 0 -1 4202496 498 0 0 0 0 0 0 0 25 0 1 0 439434592 18763776 394 33554432000 4194304 4287625 140733828754336 18446744073709551615 230809185807 0 0 4096 65536 5921411904223281416 0 0 17 3 0 0 0
/proc/19576/statm: 4581 394 345 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.300512 s]
/proc/loadavg: 5.47 5.83 5.80 5/180 19576
/proc/meminfo: memFree=15331808/32951124 swapFree=67111528/67111528
[pid=19576] ppid=19574 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/19576/stat : 19576 (ppfolio) S 19574 19576 17741 0 -1 4202496 500 0 0 0 0 0 0 0 24 0 1 0 439434592 18763776 394 33554432000 4194304 4287625 140733828754336 18446744073709551615 230809185807 0 0 4096 65536 0 0 0 17 3 0 0 0
/proc/19576/statm: 4581 394 345 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.700443 s]
/proc/loadavg: 5.47 5.83 5.80 5/180 19576
/proc/meminfo: memFree=15331808/32951124 swapFree=67111528/67111528
[pid=19576] ppid=19574 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/19576/stat : 19576 (ppfolio) S 19574 19576 17741 0 -1 4202496 500 0 0 0 0 0 0 0 20 0 1 0 439434592 18763776 394 33554432000 4194304 4287625 140733828754336 18446744073709551615 230809185807 0 0 4096 65536 4604712640806125568 0 0 17 3 0 0 0
/proc/19576/statm: 4581 394 345 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50029 s]
/proc/loadavg: 5.47 5.83 5.80 7/184 19580
/proc/meminfo: memFree=15328304/32951124 swapFree=67111528/67111528
[pid=19576] ppid=19574 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/19576/stat : 19576 (ppfolio) S 19574 19576 17741 0 -1 4202496 500 0 0 0 0 0 0 0 17 0 1 0 439434592 18763776 394 33554432000 4194304 4287625 140733828754336 18446744073709551615 230809185807 0 0 4096 65536 4604712778245079040 0 0 17 3 0 0 0
/proc/19576/statm: 4581 394 345 23 0 91 0
[pid=19577] ppid=19576 vsize=1557924 CPUtime=0.99 cores=1
/proc/19577/stat : 19577 (cryptominisat) R 19576 19576 17741 0 -1 4202496 1821 0 0 0 99 0 0 0 19 0 1 0 439434592 1595314176 996 33554432000 4194304 4587354 140737292791840 18446744073709551615 4238459 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/19577/statm: 389481 996 327 96 0 386043 0
[pid=19578] ppid=19576 vsize=12824 CPUtime=0.14 cores=1
/proc/19578/stat : 19578 (clasp) R 19576 19576 17741 0 -1 4202496 680 0 0 0 14 0 0 0 24 0 1 0 439434593 13131776 567 33554432000 4194304 4785740 140734917461008 18446744073709551615 4309555 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/19578/statm: 3206 567 340 145 0 251 0
[pid=19579] ppid=19576 vsize=455964 CPUtime=0.34 cores=1
/proc/19579/stat : 19579 (TNM) R 19576 19576 17741 0 -1 4202496 344 0 0 0 34 0 0 0 25 0 1 0 439434593 466907136 241 33554432000 134512640 134534564 4290824032 18446744073709551615 134528404 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/19579/statm: 113991 241 95 6 0 112657 0
Current children cumulated CPU time (s) 1.47
Current children cumulated vsize (KiB) 2045036

[startup+3.101 s]
/proc/loadavg: 5.47 5.83 5.80 7/184 19580
/proc/meminfo: memFree=15326476/32951124 swapFree=67111528/67111528
[pid=19576] ppid=19574 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/19576/stat : 19576 (ppfolio) S 19574 19576 17741 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 439434592 18763776 394 33554432000 4194304 4287625 140733828754336 18446744073709551615 230809185807 0 0 4096 65536 0 0 0 17 3 0 0 0
/proc/19576/statm: 4581 394 345 23 0 91 0
[pid=19577] ppid=19576 vsize=1564812 CPUtime=1.49 cores=1
/proc/19577/stat : 19577 (cryptominisat) R 19576 19576 17741 0 -1 4202496 3746 0 0 0 149 0 0 0 20 0 1 0 439434592 1602367488 2546 33554432000 4194304 4587354 140737292791840 18446744073709551615 4238578 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/19577/statm: 391203 2546 337 96 0 387765 0
[pid=19578] ppid=19576 vsize=13616 CPUtime=0.69 cores=1
/proc/19578/stat : 19578 (clasp) R 19576 19576 17741 0 -1 4202496 862 0 0 0 69 0 0 0 25 0 1 0 439434593 13942784 749 33554432000 4194304 4785740 140734917461008 18446744073709551615 4287030 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/19578/statm: 3404 749 340 145 0 449 0
[pid=19579] ppid=19576 vsize=455964 CPUtime=0.89 cores=1
/proc/19579/stat : 19579 (TNM) R 19576 19576 17741 0 -1 4202496 344 0 0 0 89 0 0 0 25 0 1 0 439434593 466907136 241 33554432000 134512640 134534564 4290824032 18446744073709551615 134529042 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/19579/statm: 113991 241 95 6 0 112657 0
Current children cumulated CPU time (s) 3.07
Current children cumulated vsize (KiB) 2052716

[startup+6.30042 s]
/proc/loadavg: 5.51 5.84 5.80 7/184 19580
/proc/meminfo: memFree=15318664/32951124 swapFree=67111528/67111528
[pid=19576] ppid=19574 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/19576/stat : 19576 (ppfolio) S 19574 19576 17741 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 439434592 18763776 394 33554432000 4194304 4287625 140733828754336 18446744073709551615 230809185807 0 0 4096 65536 4604710854099730432 0 0 17 3 0 0 0
/proc/19576/statm: 4581 394 345 23 0 91 0
[pid=19577] ppid=19576 vsize=1564996 CPUtime=2.59 cores=1
/proc/19577/stat : 19577 (cryptominisat) R 19576 19576 17741 0 -1 4202496 4620 0 0 0 259 0 0 0 22 0 1 0 439434592 1602555904 2569 33554432000 4194304 4587354 140737292791840 18446744073709551615 4241168 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/19577/statm: 391249 2569 337 96 0 387811 0
[pid=19578] ppid=19576 vsize=14428 CPUtime=1.74 cores=1
/proc/19578/stat : 19578 (clasp) R 19576 19576 17741 0 -1 4202496 1063 0 0 0 174 0 0 0 25 0 1 0 439434593 14774272 950 33554432000 4194304 4785740 140734917461008 18446744073709551615 4553224 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/19578/statm: 3607 950 340 145 0 652 0
[pid=19579] ppid=19576 vsize=455964 CPUtime=1.94 cores=1
/proc/19579/stat : 19579 (TNM) R 19576 19576 17741 0 -1 4202496 344 0 0 0 194 0 0 0 25 0 1 0 439434593 466907136 241 33554432000 134512640 134534564 4290824032 18446744073709551615 134530494 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/19579/statm: 113991 241 95 6 0 112657 0
Current children cumulated CPU time (s) 6.27
Current children cumulated vsize (KiB) 2053712

[startup+12.7003 s]
/proc/loadavg: 5.55 5.84 5.80 7/184 19580
/proc/meminfo: memFree=15314340/32951124 swapFree=67111528/67111528
[pid=19576] ppid=19574 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/19576/stat : 19576 (ppfolio) S 19574 19576 17741 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 439434592 18763776 394 33554432000 4194304 4287625 140733828754336 18446744073709551615 230809185807 0 0 4096 65536 4604710854099730432 0 0 17 3 0 0 0
/proc/19576/statm: 4581 394 345 23 0 91 0
[pid=19577] ppid=19576 vsize=1568648 CPUtime=4.69 cores=1
/proc/19577/stat : 19577 (cryptominisat) R 19576 19576 17741 0 -1 4202496 6565 0 0 0 469 0 0 0 25 0 1 0 439434592 1606295552 3489 33554432000 4194304 4587354 140737292791840 18446744073709551615 4238252 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/19577/statm: 392162 3489 337 96 0 388724 0
[pid=19578] ppid=19576 vsize=15236 CPUtime=3.89 cores=1
/proc/19578/stat : 19578 (clasp) R 19576 19576 17741 0 -1 4202496 1274 0 0 0 389 0 0 0 25 0 1 0 439434593 15601664 1161 33554432000 4194304 4785740 140734917461008 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/19578/statm: 3809 1161 340 145 0 854 0
[pid=19579] ppid=19576 vsize=455964 CPUtime=4.09 cores=1
/proc/19579/stat : 19579 (TNM) R 19576 19576 17741 0 -1 4202496 344 0 0 0 409 0 0 0 25 0 1 0 439434593 466907136 241 33554432000 134512640 134534564 4290824032 18446744073709551615 134528464 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/19579/statm: 113991 241 95 6 0 112657 0
Current children cumulated CPU time (s) 12.67
Current children cumulated vsize (KiB) 2058172

[startup+25.5009 s]
/proc/loadavg: 5.65 5.85 5.80 7/184 19580
/proc/meminfo: memFree=15312964/32951124 swapFree=67111528/67111528
[pid=19576] ppid=19574 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/19576/stat : 19576 (ppfolio) S 19574 19576 17741 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 439434592 18763776 394 33554432000 4194304 4287625 140733828754336 18446744073709551615 230809185807 0 0 4096 65536 4604711403855544320 0 0 17 3 0 0 0
/proc/19576/statm: 4581 394 345 23 0 91 0
[pid=19577] ppid=19576 vsize=1568596 CPUtime=8.89 cores=1
/proc/19577/stat : 19577 (cryptominisat) R 19576 19576 17741 0 -1 4202496 8990 0 0 0 888 1 0 0 25 0 1 0 439434592 1606242304 3442 33554432000 4194304 4587354 140737292791840 18446744073709551615 4238654 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/19577/statm: 392149 3442 337 96 0 388711 0
[pid=19578] ppid=19576 vsize=16608 CPUtime=8.19 cores=1
/proc/19578/stat : 19578 (clasp) R 19576 19576 17741 0 -1 4202496 1599 0 0 0 819 0 0 0 25 0 1 0 439434593 17006592 1486 33554432000 4194304 4785740 140734917461008 18446744073709551615 4287241 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/19578/statm: 4152 1486 340 145 0 1197 0
[pid=19579] ppid=19576 vsize=455964 CPUtime=8.39 cores=1
/proc/19579/stat : 19579 (TNM) R 19576 19576 17741 0 -1 4202496 344 0 0 0 839 0 0 0 25 0 1 0 439434593 466907136 241 33554432000 134512640 134534564 4290824032 18446744073709551615 134528422 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/19579/statm: 113991 241 95 6 0 112657 0
Current children cumulated CPU time (s) 25.47
Current children cumulated vsize (KiB) 2059492

[startup+51.1002 s]
/proc/loadavg: 5.77 5.86 5.81 7/184 19581
/proc/meminfo: memFree=15300908/32951124 swapFree=67111528/67111528
[pid=19576] ppid=19574 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/19576/stat : 19576 (ppfolio) S 19574 19576 17741 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 439434592 18763776 394 33554432000 4194304 4287625 140733828754336 18446744073709551615 230809185807 0 0 4096 65536 4604711266416590848 0 0 17 3 0 0 0
/proc/19576/statm: 4581 394 345 23 0 91 0
[pid=19577] ppid=19576 vsize=1571004 CPUtime=17.44 cores=1
/proc/19577/stat : 19577 (cryptominisat) R 19576 19576 17741 0 -1 4202496 13204 0 0 0 1743 1 0 0 25 0 1 0 439434592 1608708096 4507 33554432000 4194304 4587354 140737292791840 18446744073709551615 4238271 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/19577/statm: 392751 4507 337 96 0 389313 0
[pid=19578] ppid=19576 vsize=17748 CPUtime=16.69 cores=1
/proc/19578/stat : 19578 (clasp) R 19576 19576 17741 0 -1 4202496 1882 0 0 0 1669 0 0 0 25 0 1 0 439434593 18173952 1769 33554432000 4194304 4785740 140734917461008 18446744073709551615 4287241 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/19578/statm: 4437 1769 340 145 0 1482 0
[pid=19579] ppid=19576 vsize=455964 CPUtime=16.94 cores=1
/proc/19579/stat : 19579 (TNM) R 19576 19576 17741 0 -1 4202496 344 0 0 0 1694 0 0 0 25 0 1 0 439434593 466907136 241 33554432000 134512640 134534564 4290824032 18446744073709551615 134529675 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/19579/statm: 113991 241 95 6 0 112657 0
Current children cumulated CPU time (s) 51.07
Current children cumulated vsize (KiB) 2063040

[startup+102.307 s]
/proc/loadavg: 5.90 5.88 5.82 7/184 19583
/proc/meminfo: memFree=15286008/32951124 swapFree=67111528/67111528
[pid=19576] ppid=19574 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/19576/stat : 19576 (ppfolio) S 19574 19576 17741 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 439434592 18763776 394 33554432000 4194304 4287625 140733828754336 18446744073709551615 230809185807 0 0 4096 65536 4604711541294497792 0 0 17 3 0 0 0
/proc/19576/statm: 4581 394 345 23 0 91 0
[pid=19577] ppid=19576 vsize=1576216 CPUtime=34.49 cores=1
/proc/19577/stat : 19577 (cryptominisat) R 19576 19576 17741 0 -1 4202496 20561 0 0 0 3446 3 0 0 25 0 1 0 439434592 1614045184 5845 33554432000 4194304 4587354 140737292791840 18446744073709551615 4238668 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/19577/statm: 394054 5845 337 96 0 390616 0
[pid=19578] ppid=19576 vsize=19776 CPUtime=33.79 cores=1
/proc/19578/stat : 19578 (clasp) R 19576 19576 17741 0 -1 4202496 2353 0 0 0 3379 0 0 0 25 0 1 0 439434593 20250624 2240 33554432000 4194304 4785740 140734917461008 18446744073709551615 4552961 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/19578/statm: 4944 2240 340 145 0 1989 0
[pid=19579] ppid=19576 vsize=455964 CPUtime=34.01 cores=1
/proc/19579/stat : 19579 (TNM) R 19576 19576 17741 0 -1 4202496 344 0 0 0 3401 0 0 0 25 0 1 0 439434593 466907136 241 33554432000 134512640 134534564 4290824032 18446744073709551615 134528302 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/19579/statm: 113991 241 95 6 0 112657 0
Current children cumulated CPU time (s) 102.29
Current children cumulated vsize (KiB) 2070280

[startup+162.301 s]
/proc/loadavg: 5.96 5.90 5.82 7/184 19584
/proc/meminfo: memFree=15287484/32951124 swapFree=67111528/67111528
[pid=19576] ppid=19574 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/19576/stat : 19576 (ppfolio) S 19574 19576 17741 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 439434592 18763776 394 33554432000 4194304 4287625 140733828754336 18446744073709551615 230809185807 0 0 4096 65536 4604711541294497792 0 0 17 3 0 0 0
/proc/19576/statm: 4581 394 345 23 0 91 0
[pid=19577] ppid=19576 vsize=1597876 CPUtime=54.49 cores=1
/proc/19577/stat : 19577 (cryptominisat) R 19576 19576 17741 0 -1 4202496 29578 0 0 0 5444 5 0 0 25 0 1 0 439434592 1636225024 8435 33554432000 4194304 4587354 140737292791840 18446744073709551615 4238499 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/19577/statm: 399469 8435 337 96 0 396031 0
[pid=19578] ppid=19576 vsize=21844 CPUtime=53.78 cores=1

################
# More data... #
################

/proc/19579/statm: 113992 250 103 6 0 112658 0
Current children cumulated CPU time (s) 4602.42
Current children cumulated vsize (KiB) 2159216

[startup+4662.3 s]
/proc/loadavg: 6.00 6.00 5.96 7/184 19756
/proc/meminfo: memFree=15257688/32951124 swapFree=67111528/67111528
[pid=19576] ppid=19574 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/19576/stat : 19576 (ppfolio) S 19574 19576 17741 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 439434592 18763776 394 33554432000 4194304 4287625 140733828754336 18446744073709551615 230809185807 0 0 4096 65536 4604712091050311680 0 0 17 3 0 0 0
/proc/19576/statm: 4581 394 345 23 0 91 0
[pid=19577] ppid=19576 vsize=1641684 CPUtime=1554.56 cores=1
/proc/19577/stat : 19577 (cryptominisat) R 19576 19576 17741 0 -1 4202496 189092 0 0 0 155416 40 0 0 25 0 1 0 439434592 1681084416 19790 33554432000 4194304 4587354 140737292791840 18446744073709551615 4238423 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/19577/statm: 410421 19790 337 96 0 406983 0
[pid=19578] ppid=19576 vsize=43408 CPUtime=1553.85 cores=1
/proc/19578/stat : 19578 (clasp) R 19576 19576 17741 0 -1 4202496 7843 0 0 0 155383 2 0 0 25 0 1 0 439434593 44449792 7730 33554432000 4194304 4785740 140734917461008 18446744073709551615 4287204 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/19578/statm: 10852 7730 341 145 0 7897 0
[pid=19579] ppid=19576 vsize=455968 CPUtime=1554.01 cores=1
/proc/19579/stat : 19579 (TNM) R 19576 19576 17741 0 -1 4202496 353 0 0 0 155401 0 0 0 25 0 1 0 439434593 466911232 250 33554432000 134512640 134534564 4290824032 18446744073709551615 134528608 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/19579/statm: 113992 250 103 6 0 112658 0
Current children cumulated CPU time (s) 4662.42
Current children cumulated vsize (KiB) 2159384

[startup+4722.31 s]
/proc/loadavg: 6.00 6.00 5.96 7/184 19761
/proc/meminfo: memFree=15234684/32951124 swapFree=67111528/67111528
[pid=19576] ppid=19574 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/19576/stat : 19576 (ppfolio) S 19574 19576 17741 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 439434592 18763776 394 33554432000 4194304 4287625 140733828754336 18446744073709551615 230809185807 0 0 4096 65536 4604712091050311680 0 0 17 3 0 0 0
/proc/19576/statm: 4581 394 345 23 0 91 0
[pid=19577] ppid=19576 vsize=1642664 CPUtime=1574.55 cores=1
/proc/19577/stat : 19577 (cryptominisat) R 19576 19576 17741 0 -1 4202496 192193 0 0 0 157414 41 0 0 25 0 1 0 439434592 1682087936 22416 33554432000 4194304 4587354 140737292791840 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/19577/statm: 410666 22416 337 96 0 407228 0
[pid=19578] ppid=19576 vsize=43408 CPUtime=1573.85 cores=1
/proc/19578/stat : 19578 (clasp) R 19576 19576 17741 0 -1 4202496 7859 0 0 0 157383 2 0 0 25 0 1 0 439434593 44449792 7746 33554432000 4194304 4785740 140734917461008 18446744073709551615 4287053 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/19578/statm: 10852 7746 341 145 0 7897 0
[pid=19579] ppid=19576 vsize=455968 CPUtime=1574.02 cores=1
/proc/19579/stat : 19579 (TNM) R 19576 19576 17741 0 -1 4202496 353 0 0 0 157402 0 0 0 25 0 1 0 439434593 466911232 250 33554432000 134512640 134534564 4290824032 18446744073709551615 134528875 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/19579/statm: 113992 250 103 6 0 112658 0
Current children cumulated CPU time (s) 4722.42
Current children cumulated vsize (KiB) 2160364

[startup+4782.3 s]
/proc/loadavg: 6.00 6.00 5.96 7/184 19762
/proc/meminfo: memFree=15236944/32951124 swapFree=67111528/67111528
[pid=19576] ppid=19574 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/19576/stat : 19576 (ppfolio) S 19574 19576 17741 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 439434592 18763776 394 33554432000 4194304 4287625 140733828754336 18446744073709551615 230809185807 0 0 4096 65536 4604712091050311680 0 0 17 3 0 0 0
/proc/19576/statm: 4581 394 345 23 0 91 0
[pid=19577] ppid=19576 vsize=1642664 CPUtime=1594.54 cores=1
/proc/19577/stat : 19577 (cryptominisat) R 19576 19576 17741 0 -1 4202496 193796 0 0 0 159413 41 0 0 25 0 1 0 439434592 1682087936 23965 33554432000 4194304 4587354 140737292791840 18446744073709551615 4238568 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/19577/statm: 410666 23965 337 96 0 407228 0
[pid=19578] ppid=19576 vsize=43408 CPUtime=1593.85 cores=1
/proc/19578/stat : 19578 (clasp) R 19576 19576 17741 0 -1 4202496 7860 0 0 0 159383 2 0 0 25 0 1 0 439434593 44449792 7747 33554432000 4194304 4785740 140734917461008 18446744073709551615 4323795 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/19578/statm: 10852 7747 341 145 0 7897 0
[pid=19579] ppid=19576 vsize=455968 CPUtime=1594.02 cores=1
/proc/19579/stat : 19579 (TNM) R 19576 19576 17741 0 -1 4202496 353 0 0 0 159402 0 0 0 25 0 1 0 439434593 466911232 250 33554432000 134512640 134534564 4290824032 18446744073709551615 134528659 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/19579/statm: 113992 250 103 6 0 112658 0
Current children cumulated CPU time (s) 4782.41
Current children cumulated vsize (KiB) 2160364

[startup+4842.3 s]
/proc/loadavg: 6.00 6.00 5.96 7/184 19764
/proc/meminfo: memFree=15256524/32951124 swapFree=67111528/67111528
[pid=19576] ppid=19574 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/19576/stat : 19576 (ppfolio) S 19574 19576 17741 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 439434592 18763776 394 33554432000 4194304 4287625 140733828754336 18446744073709551615 230809185807 0 0 4096 65536 4604712091050311680 0 0 17 3 0 0 0
/proc/19576/statm: 4581 394 345 23 0 91 0
[pid=19577] ppid=19576 vsize=1644688 CPUtime=1614.55 cores=1
/proc/19577/stat : 19577 (cryptominisat) R 19576 19576 17741 0 -1 4202496 194174 0 0 0 161413 42 0 0 25 0 1 0 439434592 1684160512 19790 33554432000 4194304 4587354 140737292791840 18446744073709551615 4239320 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/19577/statm: 411172 19790 337 96 0 407734 0
[pid=19578] ppid=19576 vsize=43700 CPUtime=1613.85 cores=1
/proc/19578/stat : 19578 (clasp) R 19576 19576 17741 0 -1 4202496 7911 0 0 0 161383 2 0 0 25 0 1 0 439434593 44748800 7798 33554432000 4194304 4785740 140734917461008 18446744073709551615 4553003 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/19578/statm: 10925 7798 341 145 0 7970 0
[pid=19579] ppid=19576 vsize=455968 CPUtime=1614.03 cores=1
/proc/19579/stat : 19579 (TNM) R 19576 19576 17741 0 -1 4202496 353 0 0 0 161403 0 0 0 25 0 1 0 439434593 466911232 250 33554432000 134512640 134534564 4290824032 18446744073709551615 134529253 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/19579/statm: 113992 250 103 6 0 112658 0
Current children cumulated CPU time (s) 4842.43
Current children cumulated vsize (KiB) 2162680

[startup+4902.3 s]
/proc/loadavg: 6.00 6.00 5.96 7/184 19766
/proc/meminfo: memFree=15251920/32951124 swapFree=67111528/67111528
[pid=19576] ppid=19574 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/19576/stat : 19576 (ppfolio) S 19574 19576 17741 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 439434592 18763776 394 33554432000 4194304 4287625 140733828754336 18446744073709551615 230809185807 0 0 4096 65536 4604712091050311680 0 0 17 3 0 0 0
/proc/19576/statm: 4581 394 345 23 0 91 0
[pid=19577] ppid=19576 vsize=1644688 CPUtime=1634.55 cores=1
/proc/19577/stat : 19577 (cryptominisat) R 19576 19576 17741 0 -1 4202496 194341 0 0 0 163413 42 0 0 25 0 1 0 439434592 1684160512 19953 33554432000 4194304 4587354 140737292791840 18446744073709551615 4248785 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/19577/statm: 411172 19953 337 96 0 407734 0
[pid=19578] ppid=19576 vsize=43700 CPUtime=1633.84 cores=1
/proc/19578/stat : 19578 (clasp) R 19576 19576 17741 0 -1 4202496 7917 0 0 0 163382 2 0 0 25 0 1 0 439434593 44748800 7804 33554432000 4194304 4785740 140734917461008 18446744073709551615 4286912 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/19578/statm: 10925 7804 341 145 0 7970 0
[pid=19579] ppid=19576 vsize=455968 CPUtime=1634.03 cores=1
/proc/19579/stat : 19579 (TNM) R 19576 19576 17741 0 -1 4202496 353 0 0 0 163403 0 0 0 25 0 1 0 439434593 466911232 250 33554432000 134512640 134534564 4290824032 18446744073709551615 134529758 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/19579/statm: 113992 250 103 6 0 112658 0
Current children cumulated CPU time (s) 4902.42
Current children cumulated vsize (KiB) 2162680

[startup+4962.3 s]
/proc/loadavg: 6.00 6.00 5.96 7/184 19767
/proc/meminfo: memFree=15245088/32951124 swapFree=67111528/67111528
[pid=19576] ppid=19574 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/19576/stat : 19576 (ppfolio) S 19574 19576 17741 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 439434592 18763776 394 33554432000 4194304 4287625 140733828754336 18446744073709551615 230809185807 0 0 4096 65536 4604712091050311680 0 0 17 3 0 0 0
/proc/19576/statm: 4581 394 345 23 0 91 0
[pid=19577] ppid=19576 vsize=1642788 CPUtime=1654.54 cores=1
/proc/19577/stat : 19577 (cryptominisat) R 19576 19576 17741 0 -1 4202496 197620 0 0 0 165412 42 0 0 25 0 1 0 439434592 1682214912 22636 33554432000 4194304 4587354 140737292791840 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/19577/statm: 410697 22636 337 96 0 407259 0
[pid=19578] ppid=19576 vsize=43840 CPUtime=1653.84 cores=1
/proc/19578/stat : 19578 (clasp) R 19576 19576 17741 0 -1 4202496 7951 0 0 0 165382 2 0 0 25 0 1 0 439434593 44892160 7838 33554432000 4194304 4785740 140734917461008 18446744073709551615 4287008 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/19578/statm: 10960 7838 341 145 0 8005 0
[pid=19579] ppid=19576 vsize=455968 CPUtime=1654.04 cores=1
/proc/19579/stat : 19579 (TNM) R 19576 19576 17741 0 -1 4202496 353 0 0 0 165404 0 0 0 25 0 1 0 439434593 466911232 250 33554432000 134512640 134534564 4290824032 18446744073709551615 134530736 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/19579/statm: 113992 250 103 6 0 112658 0
Current children cumulated CPU time (s) 4962.42
Current children cumulated vsize (KiB) 2160920



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+4999.9 s]
/proc/loadavg: 6.00 6.00 5.96 7/184 19768
/proc/meminfo: memFree=15241108/32951124 swapFree=67111528/67111528
[pid=19576] ppid=19574 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/19576/stat : 19576 (ppfolio) S 19574 19576 17741 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 439434592 18763776 394 33554432000 4194304 4287625 140733828754336 18446744073709551615 230809185807 0 0 4096 65536 4604712091050311680 0 0 17 3 0 0 0
/proc/19576/statm: 4581 394 345 23 0 91 0
[pid=19577] ppid=19576 vsize=1642788 CPUtime=1667.09 cores=1
/proc/19577/stat : 19577 (cryptominisat) R 19576 19576 17741 0 -1 4202496 198634 0 0 0 166667 42 0 0 25 0 1 0 439434592 1682214912 23607 33554432000 4194304 4587354 140737292791840 18446744073709551615 4238431 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/19577/statm: 410697 23607 337 96 0 407259 0
[pid=19578] ppid=19576 vsize=43988 CPUtime=1666.34 cores=1
/proc/19578/stat : 19578 (clasp) R 19576 19576 17741 0 -1 4202496 7959 0 0 0 166632 2 0 0 25 0 1 0 439434593 45043712 7846 33554432000 4194304 4785740 140734917461008 18446744073709551615 4286976 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/19578/statm: 10997 7846 341 145 0 8042 0
[pid=19579] ppid=19576 vsize=455968 CPUtime=1666.59 cores=1
/proc/19579/stat : 19579 (TNM) R 19576 19576 17741 0 -1 4202496 353 0 0 0 166659 0 0 0 25 0 1 0 439434593 466911232 250 33554432000 134512640 134534564 4290824032 18446744073709551615 134530360 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/19579/statm: 113992 250 103 6 0 112658 0
Current children cumulated CPU time (s) 5000.02
Current children cumulated vsize (KiB) 2161068

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+4999.9 s]
/proc/loadavg: 6.00 6.00 5.96 7/184 19768
/proc/meminfo: memFree=15241108/32951124 swapFree=67111528/67111528
[pid=19576] ppid=19574 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/19576/stat : 19576 (ppfolio) S 19574 19576 17741 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 439434592 18763776 394 33554432000 4194304 4287625 140733828754336 18446744073709551615 230809185807 0 0 4096 65536 4604712091050311680 0 0 17 3 0 0 0
/proc/19576/statm: 4581 394 345 23 0 91 0
[pid=19577] ppid=19576 vsize=1642788 CPUtime=1667.09 cores=1
/proc/19577/stat : 19577 (cryptominisat) R 19576 19576 17741 0 -1 4202496 198634 0 0 0 166667 42 0 0 25 0 1 0 439434592 1682214912 23607 33554432000 4194304 4587354 140737292791840 18446744073709551615 4238431 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/19577/statm: 410697 23607 337 96 0 407259 0
[pid=19578] ppid=19576 vsize=43988 CPUtime=1666.34 cores=1
/proc/19578/stat : 19578 (clasp) R 19576 19576 17741 0 -1 4202496 7959 0 0 0 166632 2 0 0 25 0 1 0 439434593 45043712 7846 33554432000 4194304 4785740 140734917461008 18446744073709551615 4286976 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/19578/statm: 10997 7846 341 145 0 8042 0
[pid=19579] ppid=19576 vsize=455968 CPUtime=1666.59 cores=1
/proc/19579/stat : 19579 (TNM) R 19576 19576 17741 0 -1 4202496 353 0 0 0 166659 0 0 0 25 0 1 0 439434593 466911232 250 33554432000 134512640 134534564 4290824032 18446744073709551615 134530360 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/19579/statm: 113992 250 103 6 0 112658 0
Current children cumulated CPU time (s) 5000.02
Current children cumulated vsize (KiB) 2161068

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 19576 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=1999
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=1999
# CPU time returned by wait4() is 0.003998
# while last known CPU time is 5000.02
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 4999.91
CPU time (s): 5000.02
CPU user time (s): 4999.58
CPU system time (s): 0.44
CPU usage (%): 100.002
Max. virtual memory (cumulated for all children) (KiB): 13025516

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.001999
system time used= 0.001999
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 500
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 217
involuntary context switches= 4

runsolver used 8.44671 second user time and 18.6082 second system time

The end

Launcher Data

Begin job on node104 at 2011-04-20 07:45:41
IDJOB=3220786
IDBENCH=82814
IDSOLVER=1639
FILE ID=node104/3220786-1303278341
RUNJOBID= node104-1303259275-17760
PBS_JOBID= 13049517
Free space on /tmp= 71600 MiB

SOLVER NAME= ppfolio seq
BENCH NAME= SAT11/random/medium/unif-k3-r4.26-v550-c2343-S1694067460-072.UNKNOWN.cnf
COMMAND LINE= ppfolio --nbcore=1 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3220786-1303278341/watcher-3220786-1303278341 -o /tmp/evaluation-result-3220786-1303278341/solver-3220786-1303278341 -C 5000 -W 5000 -M 15500  ppfolio --nbcore=1 HOME/instance-3220786-1303278341.cnf

TIME LIMIT= 5000 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= f2d2b125797e776fb2e7099729714d99
RANDOM SEED=1107283016

node104.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.71
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5293.18
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      15331964 kB
Buffers:        695712 kB
Cached:       16396972 kB
SwapCached:          0 kB
Active:        8995248 kB
Inactive:      8273456 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      15331964 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:           10104 kB
Writeback:           0 kB
AnonPages:      176188 kB
Mapped:          16472 kB
Slab:           287144 kB
PageTables:       5192 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:  2144284 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71588 MiB
End job on node104 at 2011-04-20 09:09:03