Trace number 3190951

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio par? (TO) 4800.35 1201.71

General information on the benchmark

Namerandom/large/
unif-k3-r4.2-v15000-c63000-S619136916-059-UNKNOWN.cnf
MD5SUM17341e8eb76284acaef626682c91dea1
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark16.4195
Satisfiable
(Un)Satisfiability was proved
Number of variables15000
Number of clauses63000
Sum of the clauses size189000
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 363000
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 4 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] lingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	[5] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 1
0.00/0.00	Starting clasp 1.3.6 on core(s) 5
0.00/0.00	Starting TNM 2009 on core(s) 7
0.00/0.00	Starting lingeling 276-6264d55-100731 on core(s) 3
0.00/0.00	Starting march_hi 2009 on core(s) 7

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3190951-1304047790/watcher-3190951-1304047790 -o /tmp/evaluation-result-3190951-1304047790/solver-3190951-1304047790 -C 4800 -W 1300 -M 15500 ppfolio HOME/instance-3190951-1304047790.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 5.26 7.80 8.42 1/171 21324
/proc/meminfo: memFree=22616480/32950928 swapFree=67087032/67111528
[pid=21324] ppid=21322 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/21324/stat : 21324 (ppfolio) R 21322 21324 16886 0 -1 4202496 517 0 0 0 0 0 0 0 24 0 1 0 516376106 18763776 389 33554432000 4194304 4287625 140734934989760 18446744073709551615 239476715023 0 0 4096 65536 0 0 0 17 5 0 0 0
/proc/21324/statm: 4581 389 341 23 0 91 0

[startup+0.0445351 s]
/proc/loadavg: 5.26 7.80 8.42 1/171 21324
/proc/meminfo: memFree=22616480/32950928 swapFree=67087032/67111528
[pid=21324] ppid=21322 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/21324/stat : 21324 (ppfolio) R 21322 21324 16886 0 -1 4202496 519 0 0 0 0 0 0 0 24 0 1 0 516376106 18763776 389 33554432000 4194304 4287625 140734934989760 18446744073709551615 239476715023 0 0 4096 65536 0 0 0 17 5 0 0 0
/proc/21324/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.100526 s]
/proc/loadavg: 5.26 7.80 8.42 1/171 21324
/proc/meminfo: memFree=22616480/32950928 swapFree=67087032/67111528
[pid=21324] ppid=21322 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/21324/stat : 21324 (ppfolio) R 21322 21324 16886 0 -1 4202496 519 0 0 0 0 0 0 0 24 0 1 0 516376106 18763776 389 33554432000 4194304 4287625 140734934989760 18446744073709551615 239476715023 0 0 4096 65536 0 0 0 17 5 0 0 0
/proc/21324/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.300489 s]
/proc/loadavg: 5.26 7.80 8.42 1/171 21324
/proc/meminfo: memFree=22616480/32950928 swapFree=67087032/67111528
[pid=21324] ppid=21322 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/21324/stat : 21324 (ppfolio) R 21322 21324 16886 0 -1 4202496 519 0 0 0 0 0 0 0 24 0 1 0 516376106 18763776 389 33554432000 4194304 4287625 140734934989760 18446744073709551615 239476715023 0 0 4096 65536 0 0 0 17 5 0 0 0
/proc/21324/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.700411 s]
/proc/loadavg: 5.26 7.80 8.42 1/171 21324
/proc/meminfo: memFree=22616480/32950928 swapFree=67087032/67111528
[pid=21324] ppid=21322 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/21324/stat : 21324 (ppfolio) S 21322 21324 16886 0 -1 4202496 519 0 0 0 0 0 0 0 23 0 1 0 516376106 18763776 389 33554432000 4194304 4287625 140734934989760 18446744073709551615 239476715023 0 0 4096 65536 4605414820714381311 0 0 17 5 0 0 0
/proc/21324/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50126 s]
/proc/loadavg: 5.26 7.80 8.42 6/177 21330
/proc/meminfo: memFree=22556788/32950928 swapFree=67087032/67111528
[pid=21324] ppid=21322 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/21324/stat : 21324 (ppfolio) S 21322 21324 16886 0 -1 4202496 519 0 0 0 0 0 0 0 17 0 1 0 516376106 18763776 389 33554432000 4194304 4287625 140734934989760 18446744073709551615 239476715023 0 0 4096 65536 4605414820714381311 0 0 17 5 0 0 0
/proc/21324/statm: 4581 389 341 23 0 91 0
[pid=21325] ppid=21324 vsize=38608 CPUtime=1.49 cores=1
/proc/21325/stat : 21325 (cryptominisat) R 21324 21324 16886 0 -1 4202496 6826 0 0 0 148 1 0 0 25 0 1 0 516376106 39534592 5339 33554432000 4194304 4587354 140735243940400 18446744073709551615 239476391691 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/21325/statm: 9652 5339 326 96 0 6214 0
[pid=21326] ppid=21324 vsize=25560 CPUtime=1.49 cores=5
/proc/21326/stat : 21326 (clasp) R 21324 21324 16886 0 -1 4202496 4536 0 0 0 149 0 0 0 25 0 1 0 516376106 26173440 3711 33554432000 4194304 4785740 140733263490560 18446744073709551615 4553003 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/21326/statm: 6390 3711 340 145 0 3435 0
[pid=21327] ppid=21324 vsize=457964 CPUtime=0.77 cores=7
/proc/21327/stat : 21327 (TNM) R 21324 21324 16886 0 -1 4202496 2681 0 0 0 77 0 0 0 25 0 1 0 516376106 468955136 2578 33554432000 134512640 134534564 4289274480 18446744073709551615 134530307 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/21327/statm: 114491 2578 95 6 0 113157 0
[pid=21328] ppid=21324 vsize=10112 CPUtime=1.49 cores=3
/proc/21328/stat : 21328 (lingeling) R 21324 21324 16886 0 -1 4202496 2832 0 0 0 149 0 0 0 25 0 1 0 516376106 10354688 1717 33554432000 4194304 4352236 140734718757760 18446744073709551615 4328105 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/21328/statm: 2528 1717 127 39 0 1608 0
[pid=21329] ppid=21324 vsize=36444 CPUtime=0.69 cores=7
/proc/21329/stat : 21329 (march_hi) R 21324 21324 16886 0 -1 4202496 20438 0 0 0 67 2 0 0 25 0 1 0 516376106 37318656 6843 33554432000 4194304 4331988 140734087792208 18446744073709551615 4229292 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/21329/statm: 9111 6843 173 34 0 7553 0
Current children cumulated CPU time (s) 5.93
Current children cumulated vsize (KiB) 587012

[startup+3.10095 s]
/proc/loadavg: 5.26 7.80 8.42 6/177 21330
/proc/meminfo: memFree=22533372/32950928 swapFree=67087032/67111528
[pid=21324] ppid=21322 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/21324/stat : 21324 (ppfolio) S 21322 21324 16886 0 -1 4202496 519 0 0 0 0 0 0 0 15 0 1 0 516376106 18763776 389 33554432000 4194304 4287625 140734934989760 18446744073709551615 239476715023 0 0 4096 65536 4605414820714381311 0 0 17 5 0 0 0
/proc/21324/statm: 4581 389 341 23 0 91 0
[pid=21325] ppid=21324 vsize=76112 CPUtime=3.09 cores=1
/proc/21325/stat : 21325 (cryptominisat) R 21324 21324 16886 0 -1 4202496 8096 0 0 0 308 1 0 0 25 0 1 0 516376106 77938688 6598 33554432000 4194304 4587354 140735243940400 18446744073709551615 4254272 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/21325/statm: 19028 6598 326 96 0 15590 0
[pid=21326] ppid=21324 vsize=33256 CPUtime=3.08 cores=5
/proc/21326/stat : 21326 (clasp) R 21324 21324 16886 0 -1 4202496 6466 0 0 0 308 0 0 0 25 0 1 0 516376106 34054144 5641 33554432000 4194304 4785740 140733263490560 18446744073709551615 4553402 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/21326/statm: 8314 5641 340 145 0 5359 0
[pid=21327] ppid=21324 vsize=457964 CPUtime=1.57 cores=7
/proc/21327/stat : 21327 (TNM) R 21324 21324 16886 0 -1 4202496 2681 0 0 0 157 0 0 0 25 0 1 0 516376106 468955136 2578 33554432000 134512640 134534564 4289274480 18446744073709551615 134525938 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/21327/statm: 114491 2578 95 6 0 113157 0
[pid=21328] ppid=21324 vsize=10112 CPUtime=3.09 cores=3
/proc/21328/stat : 21328 (lingeling) R 21324 21324 16886 0 -1 4202496 2832 0 0 0 309 0 0 0 25 0 1 0 516376106 10354688 1717 33554432000 4194304 4352236 140734718757760 18446744073709551615 4276518 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/21328/statm: 2528 1717 127 39 0 1608 0
[pid=21329] ppid=21324 vsize=39040 CPUtime=1.49 cores=7
/proc/21329/stat : 21329 (march_hi) R 21324 21324 16886 0 -1 4202496 21089 0 0 0 146 3 0 0 25 0 1 0 516376106 39976960 7494 33554432000 4194304 4331988 140734087792208 18446744073709551615 4211509 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/21329/statm: 9760 7494 173 34 0 8202 0
Current children cumulated CPU time (s) 12.32
Current children cumulated vsize (KiB) 634808

[startup+6.30034 s]
/proc/loadavg: 5.24 7.75 8.40 6/177 21330
/proc/meminfo: memFree=22514832/32950928 swapFree=67087032/67111528
[pid=21324] ppid=21322 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/21324/stat : 21324 (ppfolio) S 21322 21324 16886 0 -1 4202496 519 0 0 0 0 0 0 0 15 0 1 0 516376106 18763776 389 33554432000 4194304 4287625 140734934989760 18446744073709551615 239476715023 0 0 4096 65536 4605414820714381311 0 0 17 5 0 0 0
/proc/21324/statm: 4581 389 341 23 0 91 0
[pid=21325] ppid=21324 vsize=42992 CPUtime=6.29 cores=1
/proc/21325/stat : 21325 (cryptominisat) R 21324 21324 16886 0 -1 4202496 11437 0 0 0 627 2 0 0 25 0 1 0 516376106 44023808 5707 33554432000 4194304 4587354 140735243940400 18446744073709551615 4244609 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/21325/statm: 10748 5707 331 96 0 7310 0
[pid=21326] ppid=21324 vsize=43264 CPUtime=6.29 cores=5
/proc/21326/stat : 21326 (clasp) R 21324 21324 16886 0 -1 4202496 8947 0 0 0 628 1 0 0 25 0 1 0 516376106 44302336 8122 33554432000 4194304 4785740 140733263490560 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/21326/statm: 10816 8122 340 145 0 7861 0
[pid=21327] ppid=21324 vsize=457964 CPUtime=3.15 cores=7
/proc/21327/stat : 21327 (TNM) R 21324 21324 16886 0 -1 4202496 2681 0 0 0 315 0 0 0 25 0 1 0 516376106 468955136 2578 33554432000 134512640 134534564 4289274480 18446744073709551615 134525873 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/21327/statm: 114491 2578 95 6 0 113157 0
[pid=21328] ppid=21324 vsize=13252 CPUtime=6.29 cores=3
/proc/21328/stat : 21328 (lingeling) R 21324 21324 16886 0 -1 4202496 3594 0 0 0 629 0 0 0 25 0 1 0 516376106 13570048 2479 33554432000 4194304 4352236 140734718757760 18446744073709551615 4327902 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/21328/statm: 3313 2479 127 39 0 2393 0
[pid=21329] ppid=21324 vsize=40628 CPUtime=3.09 cores=7
/proc/21329/stat : 21329 (march_hi) R 21324 21324 16886 0 -1 4202496 21514 0 0 0 306 3 0 0 25 0 1 0 516376106 41603072 7919 33554432000 4194304 4331988 140734087792208 18446744073709551615 4291853 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/21329/statm: 10157 7919 173 34 0 8599 0
Current children cumulated CPU time (s) 25.11
Current children cumulated vsize (KiB) 616424

[startup+12.7011 s]
/proc/loadavg: 5.22 7.71 8.38 6/177 21330
/proc/meminfo: memFree=22473696/32950928 swapFree=67087032/67111528
[pid=21324] ppid=21322 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/21324/stat : 21324 (ppfolio) S 21322 21324 16886 0 -1 4202496 519 0 0 0 0 0 0 0 15 0 1 0 516376106 18763776 389 33554432000 4194304 4287625 140734934989760 18446744073709551615 239476715023 0 0 4096 65536 4605414820714381311 0 0 17 5 0 0 0
/proc/21324/statm: 4581 389 341 23 0 91 0
[pid=21325] ppid=21324 vsize=45608 CPUtime=12.69 cores=1
/proc/21325/stat : 21325 (cryptominisat) R 21324 21324 16886 0 -1 4202496 30154 0 0 0 1263 6 0 0 25 0 1 0 516376106 46702592 7967 33554432000 4194304 4587354 140735243940400 18446744073709551615 4238690 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/21325/statm: 11402 7967 337 96 0 7964 0
[pid=21326] ppid=21324 vsize=51296 CPUtime=12.68 cores=5
/proc/21326/stat : 21326 (clasp) R 21324 21324 16886 0 -1 4202496 10936 0 0 0 1267 1 0 0 25 0 1 0 516376106 52527104 10111 33554432000 4194304 4785740 140733263490560 18446744073709551615 4553411 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/21326/statm: 12824 10111 340 145 0 9869 0
[pid=21327] ppid=21324 vsize=457964 CPUtime=6.32 cores=7
/proc/21327/stat : 21327 (TNM) R 21324 21324 16886 0 -1 4202496 2681 0 0 0 632 0 0 0 25 0 1 0 516376106 468955136 2578 33554432000 134512640 134534564 4289274480 18446744073709551615 134528504 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/21327/statm: 114491 2578 95 6 0 113157 0
[pid=21328] ppid=21324 vsize=15000 CPUtime=12.69 cores=3
/proc/21328/stat : 21328 (lingeling) R 21324 21324 16886 0 -1 4202496 4031 0 0 0 1269 0 0 0 25 0 1 0 516376106 15360000 2916 33554432000 4194304 4352236 140734718757760 18446744073709551615 4280882 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/21328/statm: 3750 2916 127 39 0 2830 0
[pid=21329] ppid=21324 vsize=41156 CPUtime=6.29 cores=7
/proc/21329/stat : 21329 (march_hi) R 21324 21324 16886 0 -1 4202496 21653 0 0 0 626 3 0 0 25 0 1 0 516376106 42143744 8058 33554432000 4194304 4331988 140734087792208 18446744073709551615 4228994 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/21329/statm: 10289 8058 173 34 0 8731 0
Current children cumulated CPU time (s) 50.67
Current children cumulated vsize (KiB) 629348

[startup+25.5007 s]
/proc/loadavg: 5.17 7.57 8.33 6/177 21330
/proc/meminfo: memFree=22459228/32950928 swapFree=67087032/67111528
[pid=21324] ppid=21322 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/21324/stat : 21324 (ppfolio) S 21322 21324 16886 0 -1 4202496 519 0 0 0 0 0 0 0 15 0 1 0 516376106 18763776 389 33554432000 4194304 4287625 140734934989760 18446744073709551615 239476715023 0 0 4096 65536 4605414820714381311 0 0 17 5 0 0 0
/proc/21324/statm: 4581 389 341 23 0 91 0
[pid=21325] ppid=21324 vsize=119796 CPUtime=25.49 cores=1
/proc/21325/stat : 21325 (cryptominisat) R 21324 21324 16886 0 -1 4202496 50527 0 0 0 2538 11 0 0 25 0 1 0 516376106 122671104 12069 33554432000 4194304 4587354 140735243940400 18446744073709551615 4238690 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/21325/statm: 29949 12069 337 96 0 26511 0
[pid=21326] ppid=21324 vsize=69072 CPUtime=25.48 cores=5
/proc/21326/stat : 21326 (clasp) R 21324 21324 16886 0 -1 4202496 15336 0 0 0 2545 3 0 0 25 0 1 0 516376106 70729728 14511 33554432000 4194304 4785740 140733263490560 18446744073709551615 4553003 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/21326/statm: 17268 14511 340 145 0 14313 0
[pid=21327] ppid=21324 vsize=457964 CPUtime=12.69 cores=7
/proc/21327/stat : 21327 (TNM) R 21324 21324 16886 0 -1 4202496 2681 0 0 0 1269 0 0 0 25 0 1 0 516376106 468955136 2578 33554432000 134512640 134534564 4289274480 18446744073709551615 134530126 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/21327/statm: 114491 2578 95 6 0 113157 0
[pid=21328] ppid=21324 vsize=15000 CPUtime=25.49 cores=3
/proc/21328/stat : 21328 (lingeling) R 21324 21324 16886 0 -1 4202496 4031 0 0 0 2549 0 0 0 25 0 1 0 516376106 15360000 2916 33554432000 4194304 4352236 140734718757760 18446744073709551615 4281102 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/21328/statm: 3750 2916 127 39 0 2830 0
[pid=21329] ppid=21324 vsize=41684 CPUtime=12.64 cores=7
/proc/21329/stat : 21329 (march_hi) R 21324 21324 16886 0 -1 4202496 21789 0 0 0 1261 3 0 0 25 0 1 0 516376106 42684416 8194 33554432000 4194304 4331988 140734087792208 18446744073709551615 4228836 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/21329/statm: 10421 8194 173 34 0 8863 0
Current children cumulated CPU time (s) 101.79
Current children cumulated vsize (KiB) 721840

[startup+51.1008 s]
/proc/loadavg: 5.11 7.37 8.24 6/177 21331
/proc/meminfo: memFree=22434268/32950928 swapFree=67087032/67111528
[pid=21324] ppid=21322 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/21324/stat : 21324 (ppfolio) S 21322 21324 16886 0 -1 4202496 519 0 0 0 0 0 0 0 15 0 1 0 516376106 18763776 389 33554432000 4194304 4287625 140734934989760 18446744073709551615 239476715023 0 0 4096 65536 4605414820714381311 0 0 17 5 0 0 0
/proc/21324/statm: 4581 389 341 23 0 91 0
[pid=21325] ppid=21324 vsize=2058644 CPUtime=51.09 cores=1
/proc/21325/stat : 21325 (cryptominisat) R 21324 21324 16886 0 -1 4202496 80859 0 0 0 5090 19 0 0 25 0 1 0 516376106 2108051456 13709 33554432000 4194304 4587354 140735243940400 18446744073709551615 4238271 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/21325/statm: 514661 13709 337 96 0 511223 0
[pid=21326] ppid=21324 vsize=89416 CPUtime=51.09 cores=5
/proc/21326/stat : 21326 (clasp) R 21324 21324 16886 0 -1 4202496 20361 0 0 0 5102 7 0 0 25 0 1 0 516376106 91561984 19536 33554432000 4194304 4785740 140733263490560 18446744073709551615 4552550 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/21326/statm: 22354 19536 340 145 0 19399 0
[pid=21327] ppid=21324 vsize=457964 CPUtime=25.41 cores=7
/proc/21327/stat : 21327 (TNM) R 21324 21324 16886 0 -1 4202496 2681 0 0 0 2541 0 0 0 25 0 1 0 516376106 468955136 2578 33554432000 134512640 134534564 4289274480 18446744073709551615 134530551 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/21327/statm: 114491 2578 95 6 0 113157 0
[pid=21328] ppid=21324 vsize=15680 CPUtime=51.09 cores=3

################
# More data... #
################

/proc/21329/statm: 11180 8972 173 34 0 9622 0
Current children cumulated CPU time (s) 3764.12
Current children cumulated vsize (KiB) 895820

[startup+1002.3 s]
/proc/loadavg: 5.05 5.16 6.18 6/177 21356
/proc/meminfo: memFree=22269832/32950928 swapFree=67087032/67111528
[pid=21324] ppid=21322 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/21324/stat : 21324 (ppfolio) S 21322 21324 16886 0 -1 4202496 519 0 0 0 0 0 0 0 15 0 1 0 516376106 18763776 389 33554432000 4194304 4287625 140734934989760 18446744073709551615 239476715023 0 0 4096 65536 4605414820714381311 0 0 17 5 0 0 0
/proc/21324/statm: 4581 389 341 23 0 91 0
[pid=21325] ppid=21324 vsize=2141256 CPUtime=1002.33 cores=1
/proc/21325/stat : 21325 (cryptominisat) R 21324 21324 16886 0 -1 4202496 618445 0 0 0 99944 289 0 0 25 0 1 0 516376106 2192646144 17846 33554432000 4194304 4587354 140735243940400 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/21325/statm: 535314 17846 337 96 0 531876 0
[pid=21326] ppid=21324 vsize=225220 CPUtime=1002.32 cores=5
/proc/21326/stat : 21326 (clasp) R 21324 21324 16886 0 -1 4202496 53550 0 0 0 100212 20 0 0 25 0 1 0 516376106 230625280 52725 33554432000 4194304 4785740 140733263490560 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/21326/statm: 56305 52725 340 145 0 53350 0
[pid=21327] ppid=21324 vsize=457964 CPUtime=498.44 cores=7
/proc/21327/stat : 21327 (TNM) R 21324 21324 16886 0 -1 4202496 2681 0 0 0 49844 0 0 0 25 0 1 0 516376106 468955136 2578 33554432000 134512640 134534564 4289274480 18446744073709551615 134530659 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/21327/statm: 114491 2578 95 6 0 113157 0
[pid=21328] ppid=21324 vsize=24388 CPUtime=1002.3 cores=3
/proc/21328/stat : 21328 (lingeling) R 21324 21324 16886 0 -1 4202496 11242 0 0 0 100229 1 0 0 25 0 1 0 516376106 24973312 5263 33554432000 4194304 4352236 140734718757760 18446744073709551615 4327902 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/21328/statm: 6097 5263 127 39 0 5177 0
[pid=21329] ppid=21324 vsize=44852 CPUtime=498.42 cores=7
/proc/21329/stat : 21329 (march_hi) R 21324 21324 16886 0 -1 4202496 22585 0 0 0 49838 4 0 0 25 0 1 0 516376106 45928448 8990 33554432000 4194304 4331988 140734087792208 18446744073709551615 4292045 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/21329/statm: 11213 8990 173 34 0 9655 0
Current children cumulated CPU time (s) 4003.81
Current children cumulated vsize (KiB) 2912004

[startup+1062.3 s]
/proc/loadavg: 5.10 5.14 6.11 6/177 21358
/proc/meminfo: memFree=22274540/32950928 swapFree=67087032/67111528
[pid=21324] ppid=21322 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/21324/stat : 21324 (ppfolio) S 21322 21324 16886 0 -1 4202496 519 0 0 0 0 0 0 0 15 0 1 0 516376106 18763776 389 33554432000 4194304 4287625 140734934989760 18446744073709551615 239476715023 0 0 4096 65536 4605414820714381311 0 0 17 5 0 0 0
/proc/21324/statm: 4581 389 341 23 0 91 0
[pid=21325] ppid=21324 vsize=2088520 CPUtime=1062.33 cores=1
/proc/21325/stat : 21325 (cryptominisat) R 21324 21324 16886 0 -1 4202496 646168 0 0 0 105928 305 0 0 25 0 1 0 516376106 2138644480 15931 33554432000 4194304 4587354 140735243940400 18446744073709551615 4237470 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/21325/statm: 522130 15931 337 96 0 518692 0
[pid=21326] ppid=21324 vsize=229152 CPUtime=1062.31 cores=5
/proc/21326/stat : 21326 (clasp) R 21324 21324 16886 0 -1 4202496 54533 0 0 0 106211 20 0 0 25 0 1 0 516376106 234651648 53708 33554432000 4194304 4785740 140733263490560 18446744073709551615 4287028 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/21326/statm: 57288 53708 340 145 0 54333 0
[pid=21327] ppid=21324 vsize=457964 CPUtime=528.31 cores=7
/proc/21327/stat : 21327 (TNM) R 21324 21324 16886 0 -1 4202496 2681 0 0 0 52831 0 0 0 25 0 1 0 516376106 468955136 2578 33554432000 134512640 134534564 4289274480 18446744073709551615 134525956 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/21327/statm: 114491 2578 95 6 0 113157 0
[pid=21328] ppid=21324 vsize=24388 CPUtime=1062.3 cores=3
/proc/21328/stat : 21328 (lingeling) R 21324 21324 16886 0 -1 4202496 11754 0 0 0 106229 1 0 0 25 0 1 0 516376106 24973312 5263 33554432000 4194304 4352236 140734718757760 18446744073709551615 4328194 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/21328/statm: 6097 5263 127 39 0 5177 0
[pid=21329] ppid=21324 vsize=44852 CPUtime=528.22 cores=7
/proc/21329/stat : 21329 (march_hi) R 21324 21324 16886 0 -1 4202496 22599 0 0 0 52818 4 0 0 25 0 1 0 516376106 45928448 9004 33554432000 4194304 4331988 140734087792208 18446744073709551615 4265367 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/21329/statm: 11213 9004 173 34 0 9655 0
Current children cumulated CPU time (s) 4243.47
Current children cumulated vsize (KiB) 2863200

[startup+1122.3 s]
/proc/loadavg: 5.03 5.11 6.04 6/177 21360
/proc/meminfo: memFree=22235712/32950928 swapFree=67087032/67111528
[pid=21324] ppid=21322 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/21324/stat : 21324 (ppfolio) S 21322 21324 16886 0 -1 4202496 519 0 0 0 0 0 0 0 15 0 1 0 516376106 18763776 389 33554432000 4194304 4287625 140734934989760 18446744073709551615 239476715023 0 0 4096 65536 4605414820714381311 0 0 17 5 0 0 0
/proc/21324/statm: 4581 389 341 23 0 91 0
[pid=21325] ppid=21324 vsize=2079044 CPUtime=1122.33 cores=1
/proc/21325/stat : 21325 (cryptominisat) R 21324 21324 16886 0 -1 4202496 685875 0 0 0 111908 325 0 0 25 0 1 0 516376106 2128941056 23844 33554432000 4194304 4587354 140735243940400 18446744073709551615 4243659 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/21325/statm: 519761 23844 337 96 0 516323 0
[pid=21326] ppid=21324 vsize=235648 CPUtime=1122.32 cores=5
/proc/21326/stat : 21326 (clasp) R 21324 21324 16886 0 -1 4202496 56111 0 0 0 112211 21 0 0 25 0 1 0 516376106 241303552 55286 33554432000 4194304 4785740 140733263490560 18446744073709551615 4553402 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/21326/statm: 58912 55286 340 145 0 55957 0
[pid=21327] ppid=21324 vsize=457964 CPUtime=558.11 cores=7
/proc/21327/stat : 21327 (TNM) R 21324 21324 16886 0 -1 4202496 2681 0 0 0 55811 0 0 0 25 0 1 0 516376106 468955136 2578 33554432000 134512640 134534564 4289274480 18446744073709551615 134528504 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/21327/statm: 114491 2578 95 6 0 113157 0
[pid=21328] ppid=21324 vsize=24388 CPUtime=1122.3 cores=3
/proc/21328/stat : 21328 (lingeling) R 21324 21324 16886 0 -1 4202496 12266 0 0 0 112229 1 0 0 25 0 1 0 516376106 24973312 5263 33554432000 4194304 4352236 140734718757760 18446744073709551615 4207589 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/21328/statm: 6097 5263 127 39 0 5177 0
[pid=21329] ppid=21324 vsize=44984 CPUtime=558.1 cores=7
/proc/21329/stat : 21329 (march_hi) R 21324 21324 16886 0 -1 4202496 22613 0 0 0 55806 4 0 0 25 0 1 0 516376106 46063616 9018 33554432000 4194304 4331988 140734087792208 18446744073709551615 4297280 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/21329/statm: 11246 9018 173 34 0 9688 0
Current children cumulated CPU time (s) 4483.16
Current children cumulated vsize (KiB) 2860352

[startup+1182.3 s]
/proc/loadavg: 5.08 5.11 5.98 6/177 21361
/proc/meminfo: memFree=22236316/32950928 swapFree=67087032/67111528
[pid=21324] ppid=21322 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/21324/stat : 21324 (ppfolio) S 21322 21324 16886 0 -1 4202496 519 0 0 0 0 0 0 0 15 0 1 0 516376106 18763776 389 33554432000 4194304 4287625 140734934989760 18446744073709551615 239476715023 0 0 4096 65536 4605414820714381311 0 0 17 5 0 0 0
/proc/21324/statm: 4581 389 341 23 0 91 0
[pid=21325] ppid=21324 vsize=2063940 CPUtime=1182.34 cores=1
/proc/21325/stat : 21325 (cryptominisat) R 21324 21324 16886 0 -1 4202496 713529 0 0 0 117889 345 0 0 25 0 1 0 516376106 2113474560 20529 33554432000 4194304 4587354 140735243940400 18446744073709551615 4238591 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/21325/statm: 515985 20529 337 96 0 512547 0
[pid=21326] ppid=21324 vsize=247432 CPUtime=1182.32 cores=5
/proc/21326/stat : 21326 (clasp) R 21324 21324 16886 0 -1 4202496 58955 0 0 0 118209 23 0 0 25 0 1 0 516376106 253370368 58130 33554432000 4194304 4785740 140733263490560 18446744073709551615 4287204 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/21326/statm: 61858 58130 340 145 0 58903 0
[pid=21327] ppid=21324 vsize=457964 CPUtime=587.98 cores=7
/proc/21327/stat : 21327 (TNM) R 21324 21324 16886 0 -1 4202496 2681 0 0 0 58798 0 0 0 25 0 1 0 516376106 468955136 2578 33554432000 134512640 134534564 4289274480 18446744073709551615 134528661 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/21327/statm: 114491 2578 95 6 0 113157 0
[pid=21328] ppid=21324 vsize=26436 CPUtime=1182.3 cores=3
/proc/21328/stat : 21328 (lingeling) R 21324 21324 16886 0 -1 4202496 13802 0 0 0 118229 1 0 0 25 0 1 0 516376106 27070464 5775 33554432000 4194304 4352236 140734718757760 18446744073709551615 4231252 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/21328/statm: 6609 5775 127 39 0 5689 0
[pid=21329] ppid=21324 vsize=44984 CPUtime=587.9 cores=7
/proc/21329/stat : 21329 (march_hi) R 21324 21324 16886 0 -1 4202496 22624 0 0 0 58786 4 0 0 25 0 1 0 516376106 46063616 9029 33554432000 4194304 4331988 140734087792208 18446744073709551615 4228847 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/21329/statm: 11246 9029 173 34 0 9688 0
Current children cumulated CPU time (s) 4722.84
Current children cumulated vsize (KiB) 2859080



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.7 s]
/proc/loadavg: 5.06 5.10 5.96 6/177 21362
/proc/meminfo: memFree=22255660/32950928 swapFree=67087032/67111528
[pid=21324] ppid=21322 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/21324/stat : 21324 (ppfolio) S 21322 21324 16886 0 -1 4202496 519 0 0 0 0 0 0 0 15 0 1 0 516376106 18763776 389 33554432000 4194304 4287625 140734934989760 18446744073709551615 239476715023 0 0 4096 65536 4605414820714381311 0 0 17 5 0 0 0
/proc/21324/statm: 4581 389 341 23 0 91 0
[pid=21325] ppid=21324 vsize=2053572 CPUtime=1201.75 cores=1
/proc/21325/stat : 21325 (cryptominisat) R 21324 21324 16886 0 -1 4202496 722525 0 0 0 119824 351 0 0 25 0 1 0 516376106 2102857728 13784 33554432000 4194304 4587354 140735243940400 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/21325/statm: 513393 13784 337 96 0 509955 0
[pid=21326] ppid=21324 vsize=253688 CPUtime=1201.72 cores=5
/proc/21326/stat : 21326 (clasp) R 21324 21324 16886 0 -1 4202496 60497 0 0 0 120149 23 0 0 25 0 1 0 516376106 259776512 59672 33554432000 4194304 4785740 140733263490560 18446744073709551615 4287030 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/21326/statm: 63422 59672 340 145 0 60467 0
[pid=21327] ppid=21324 vsize=457964 CPUtime=597.6 cores=7
/proc/21327/stat : 21327 (TNM) R 21324 21324 16886 0 -1 4202496 2681 0 0 0 59760 0 0 0 25 0 1 0 516376106 468955136 2578 33554432000 134512640 134534564 4289274480 18446744073709551615 134528913 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/21327/statm: 114491 2578 95 6 0 113157 0
[pid=21328] ppid=21324 vsize=26436 CPUtime=1201.71 cores=3
/proc/21328/stat : 21328 (lingeling) R 21324 21324 16886 0 -1 4202496 13802 0 0 0 120170 1 0 0 25 0 1 0 516376106 27070464 5775 33554432000 4194304 4352236 140734718757760 18446744073709551615 4328026 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/21328/statm: 6609 5775 127 39 0 5689 0
[pid=21329] ppid=21324 vsize=44984 CPUtime=597.57 cores=7
/proc/21329/stat : 21329 (march_hi) R 21324 21324 16886 0 -1 4202496 22629 0 0 0 59753 4 0 0 25 0 1 0 516376106 46063616 9034 33554432000 4194304 4331988 140734087792208 18446744073709551615 4228970 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/21329/statm: 11246 9034 173 34 0 9688 0
Current children cumulated CPU time (s) 4800.35
Current children cumulated vsize (KiB) 2854968

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1201.7 s]
/proc/loadavg: 5.06 5.10 5.96 6/177 21362
/proc/meminfo: memFree=22255660/32950928 swapFree=67087032/67111528
[pid=21324] ppid=21322 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/21324/stat : 21324 (ppfolio) S 21322 21324 16886 0 -1 4202496 519 0 0 0 0 0 0 0 15 0 1 0 516376106 18763776 389 33554432000 4194304 4287625 140734934989760 18446744073709551615 239476715023 0 0 4096 65536 4605414820714381311 0 0 17 5 0 0 0
/proc/21324/statm: 4581 389 341 23 0 91 0
[pid=21325] ppid=21324 vsize=2053572 CPUtime=1201.75 cores=1
/proc/21325/stat : 21325 (cryptominisat) R 21324 21324 16886 0 -1 4202496 722525 0 0 0 119824 351 0 0 25 0 1 0 516376106 2102857728 13784 33554432000 4194304 4587354 140735243940400 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/21325/statm: 513393 13784 337 96 0 509955 0
[pid=21326] ppid=21324 vsize=253688 CPUtime=1201.72 cores=5
/proc/21326/stat : 21326 (clasp) R 21324 21324 16886 0 -1 4202496 60497 0 0 0 120149 23 0 0 25 0 1 0 516376106 259776512 59672 33554432000 4194304 4785740 140733263490560 18446744073709551615 4287030 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/21326/statm: 63422 59672 340 145 0 60467 0
[pid=21327] ppid=21324 vsize=457964 CPUtime=597.6 cores=7
/proc/21327/stat : 21327 (TNM) R 21324 21324 16886 0 -1 4202496 2681 0 0 0 59760 0 0 0 25 0 1 0 516376106 468955136 2578 33554432000 134512640 134534564 4289274480 18446744073709551615 134528913 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/21327/statm: 114491 2578 95 6 0 113157 0
[pid=21328] ppid=21324 vsize=26436 CPUtime=1201.71 cores=3
/proc/21328/stat : 21328 (lingeling) R 21324 21324 16886 0 -1 4202496 13802 0 0 0 120170 1 0 0 25 0 1 0 516376106 27070464 5775 33554432000 4194304 4352236 140734718757760 18446744073709551615 4328026 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/21328/statm: 6609 5775 127 39 0 5689 0
[pid=21329] ppid=21324 vsize=44984 CPUtime=597.57 cores=7
/proc/21329/stat : 21329 (march_hi) R 21324 21324 16886 0 -1 4202496 22629 0 0 0 59753 4 0 0 25 0 1 0 516376106 46063616 9034 33554432000 4194304 4331988 140734087792208 18446744073709551615 4228970 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/21329/statm: 11246 9034 173 34 0 9688 0
Current children cumulated CPU time (s) 4800.35
Current children cumulated vsize (KiB) 2854968

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 21324 and gives
#  childrusage.ru_utime.tv_sec=3595
#  childrusage.ru_utime.tv_usec=97462
#  childrusage.ru_stime.tv_sec=3
#  childrusage.ru_stime.tv_usec=596453
# CPU time returned by wait4() is 3598.69
# while last known CPU time is 4800.35
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1201.71
CPU time (s): 4800.35
CPU user time (s): 4796.56
CPU system time (s): 3.79
CPU usage (%): 399.459
Max. virtual memory (cumulated for all children) (KiB): 4910648

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3595.1
system time used= 3.59645
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 762158
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 297
involuntary context switches= 27696

runsolver used 1.90971 second user time and 4.64729 second system time

The end

Launcher Data 

Begin job on node148 at 2011-04-29 05:29:50
IDJOB=3190951
IDBENCH=82682
IDSOLVER=1612
FILE ID=node148/3190951-1304047790
RUNJOBID= node148-1304046409-21148
PBS_JOBID= 13170304
Free space on /tmp= 71432 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT11/random/large/unif-k3-r4.2-v15000-c63000-S619136916-059-UNKNOWN.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3190951-1304047790/watcher-3190951-1304047790 -o /tmp/evaluation-result-3190951-1304047790/solver-3190951-1304047790 -C 4800 -W 1300 -M 15500  ppfolio HOME/instance-3190951-1304047790.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 17341e8eb76284acaef626682c91dea1
RANDOM SEED=1752284918

node148.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      22616760 kB
Buffers:       2016556 kB
Cached:        7713720 kB
SwapCached:       3548 kB
Active:        1732796 kB
Inactive:      8039696 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      22616760 kB
SwapTotal:    67111528 kB
SwapFree:     67087032 kB
Dirty:           11428 kB
Writeback:           0 kB
AnonPages:       40620 kB
Mapped:          13480 kB
Slab:           498428 kB
PageTables:       4492 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   187648 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71424 MiB
End job on node148 at 2011-04-29 05:49:54