Trace number 3282452

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio par? (TO) 4800.36 1201.71

General information on the benchmark

NameAPPLICATIONS/
bitverif/maxxor/maxxor128.cnf
MD5SUM065c126f0d55807310a398728b44423f
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables200440
Number of clauses599015
Sum of the clauses size1397699
Maximum clause length3
Minimum clause length1
Number of clauses of size 12
Number of clauses of size 2399342
Number of clauses of size 3199671
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 4 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] lingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	[5] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 1
0.00/0.00	Starting clasp 1.3.6 on core(s) 5
0.00/0.00	Starting TNM 2009 on core(s) 7
0.00/0.00	Starting lingeling 276-6264d55-100731 on core(s) 3
0.00/0.00	Starting march_hi 2009 on core(s) 7

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3282452-1304032810/watcher-3282452-1304032810 -o /tmp/evaluation-result-3282452-1304032810/solver-3282452-1304032810 -C 4800 -W 1300 -M 15500 ppfolio HOME/instance-3282452-1304032810.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.77 5.53 6.86 7/182 11435
/proc/meminfo: memFree=15118532/32951124 swapFree=67111528/67111528
[pid=11435] ppid=11433 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/11435/stat : 11435 (ppfolio) R 11433 11435 10991 0 -1 4202496 518 0 0 0 0 0 0 0 25 0 1 0 495696651 18763776 389 33554432000 4194304 4287625 140737090308656 18446744073709551615 264726425103 0 0 4096 65536 0 0 0 17 1 0 0 0
/proc/11435/statm: 4581 389 341 23 0 91 0

[startup+0.027472 s]
/proc/loadavg: 3.77 5.53 6.86 7/182 11435
/proc/meminfo: memFree=15118532/32951124 swapFree=67111528/67111528
[pid=11435] ppid=11433 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/11435/stat : 11435 (ppfolio) R 11433 11435 10991 0 -1 4202496 518 0 0 0 0 0 0 0 25 0 1 0 495696651 18763776 389 33554432000 4194304 4287625 140737090308656 18446744073709551615 264726425103 0 0 4096 65536 0 0 0 17 1 0 0 0
/proc/11435/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.100458 s]
/proc/loadavg: 3.77 5.53 6.86 7/182 11435
/proc/meminfo: memFree=15118532/32951124 swapFree=67111528/67111528
[pid=11435] ppid=11433 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/11435/stat : 11435 (ppfolio) S 11433 11435 10991 0 -1 4202496 520 0 0 0 0 0 0 0 25 0 1 0 495696651 18763776 389 33554432000 4194304 4287625 140737090308656 18446744073709551615 264726425103 0 0 4096 65536 2826088513535 0 0 17 1 0 0 0
/proc/11435/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.300421 s]
/proc/loadavg: 3.77 5.53 6.86 7/182 11435
/proc/meminfo: memFree=15118532/32951124 swapFree=67111528/67111528
[pid=11435] ppid=11433 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/11435/stat : 11435 (ppfolio) S 11433 11435 10991 0 -1 4202496 520 0 0 0 0 0 0 0 24 0 1 0 495696651 18763776 389 33554432000 4194304 4287625 140737090308656 18446744073709551615 264726425103 0 0 4096 65536 4607711013310038015 0 0 17 1 0 0 0
/proc/11435/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.700346 s]
/proc/loadavg: 3.77 5.53 6.86 7/182 11435
/proc/meminfo: memFree=15118532/32951124 swapFree=67111528/67111528
[pid=11435] ppid=11433 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/11435/stat : 11435 (ppfolio) S 11433 11435 10991 0 -1 4202496 520 0 0 0 0 0 0 0 24 0 1 0 495696651 18763776 389 33554432000 4194304 4287625 140737090308656 18446744073709551615 264726425103 0 0 4096 65536 4607711013310038015 0 0 17 1 0 0 0
/proc/11435/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.5012 s]
/proc/loadavg: 4.43 5.64 6.89 11/188 11441
/proc/meminfo: memFree=14777488/32951124 swapFree=67111528/67111528
[pid=11435] ppid=11433 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/11435/stat : 11435 (ppfolio) S 11433 11435 10991 0 -1 4202496 520 0 0 0 0 0 0 0 24 0 1 0 495696651 18763776 389 33554432000 4194304 4287625 140737090308656 18446744073709551615 264726425103 0 0 4096 65536 4607711013310038015 0 0 17 1 0 0 0
/proc/11435/statm: 4581 389 341 23 0 91 0
[pid=11436] ppid=11435 vsize=89320 CPUtime=1.49 cores=1
/proc/11436/stat : 11436 (cryptominisat) R 11435 11435 10991 0 -1 4202496 17789 0 0 0 146 3 0 0 25 0 1 0 495696651 91463680 17253 33554432000 4194304 4587354 140733595727600 18446744073709551615 4237679 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/11436/statm: 22330 17253 306 96 0 18892 0
[pid=11437] ppid=11435 vsize=140860 CPUtime=1.48 cores=5
/proc/11437/stat : 11437 (clasp) R 11435 11435 10991 0 -1 4202496 36861 0 0 0 143 5 0 0 25 0 1 0 495696651 144240640 31757 33554432000 4194304 4785740 140733329477360 18446744073709551615 264726065861 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/11437/statm: 35215 31757 319 145 0 32260 0
[pid=11438] ppid=11435 vsize=487636 CPUtime=0.78 cores=7
/proc/11438/stat : 11438 (TNM) R 11435 11435 10991 0 -1 4202496 12517 0 0 0 76 2 0 0 25 0 1 0 495696651 499339264 12414 33554432000 134512640 134534564 4289368048 18446744073709551615 134524491 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/11438/statm: 121909 12414 91 6 0 120575 0
[pid=11439] ppid=11435 vsize=44720 CPUtime=1.48 cores=3
/proc/11439/stat : 11439 (lingeling) R 11435 11435 10991 0 -1 4202496 21600 0 0 0 146 2 0 0 25 0 1 0 495696651 45793280 10331 33554432000 4194304 4352236 140735244286640 18446744073709551615 4255140 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/11439/statm: 11180 10331 116 39 0 10260 0
[pid=11440] ppid=11435 vsize=131736 CPUtime=0.69 cores=7
/proc/11440/stat : 11440 (march_hi) R 11435 11435 10991 0 -1 4194304 32025 0 0 0 65 4 0 0 25 0 1 0 495696651 134897664 25629 33554432000 4194304 4331988 140734484655408 18446744073709551615 4252207 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/11440/statm: 32934 25629 127 34 0 31376 0
Current children cumulated CPU time (s) 5.92
Current children cumulated vsize (KiB) 912596

[startup+3.10089 s]
/proc/loadavg: 4.43 5.64 6.89 11/188 11441
/proc/meminfo: memFree=14720696/32951124 swapFree=67111528/67111528
[pid=11435] ppid=11433 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/11435/stat : 11435 (ppfolio) S 11433 11435 10991 0 -1 4202496 520 0 0 0 0 0 0 0 17 0 1 0 495696651 18763776 389 33554432000 4194304 4287625 140737090308656 18446744073709551615 264726425103 0 0 4096 65536 4607711013310038015 0 0 17 1 0 0 0
/proc/11435/statm: 4581 389 341 23 0 91 0
[pid=11436] ppid=11435 vsize=123516 CPUtime=3.09 cores=1
/proc/11436/stat : 11436 (cryptominisat) R 11435 11435 10991 0 -1 4202496 26359 0 0 0 305 4 0 0 25 0 1 0 495696651 126480384 25823 33554432000 4194304 4587354 140733595727600 18446744073709551615 4421069 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/11436/statm: 30879 25823 312 96 0 27441 0
[pid=11437] ppid=11435 vsize=141520 CPUtime=3.08 cores=5
/proc/11437/stat : 11437 (clasp) R 11435 11435 10991 0 -1 4202496 37043 0 0 0 303 5 0 0 25 0 1 0 495696651 144916480 31939 33554432000 4194304 4785740 140733329477360 18446744073709551615 4495294 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/11437/statm: 35380 31939 319 145 0 32425 0
[pid=11438] ppid=11435 vsize=493604 CPUtime=1.56 cores=7
/proc/11438/stat : 11438 (TNM) R 11435 11435 10991 0 -1 4202496 20739 0 0 0 154 2 0 0 25 0 1 0 495696651 505450496 20636 33554432000 134512640 134534564 4289368048 18446744073709551615 134529964 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/11438/statm: 123401 20636 95 6 0 122067 0
[pid=11439] ppid=11435 vsize=44720 CPUtime=3.08 cores=3
/proc/11439/stat : 11439 (lingeling) R 11435 11435 10991 0 -1 4202496 21605 0 0 0 306 2 0 0 25 0 1 0 495696651 45793280 10336 33554432000 4194304 4352236 140735244286640 18446744073709551615 4287523 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/11439/statm: 11180 10336 121 39 0 10260 0
[pid=11440] ppid=11435 vsize=130944 CPUtime=1.5 cores=7
/proc/11440/stat : 11440 (march_hi) R 11435 11435 10991 0 -1 4202496 71510 0 0 0 140 10 0 0 25 0 1 0 495696651 134086656 25446 33554432000 4194304 4331988 140734484655408 18446744073709551615 4252204 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/11440/statm: 32736 25446 140 34 0 31178 0
Current children cumulated CPU time (s) 12.31
Current children cumulated vsize (KiB) 952628

[startup+6.30129 s]
/proc/loadavg: 4.43 5.64 6.89 11/188 11441
/proc/meminfo: memFree=14635308/32951124 swapFree=67111528/67111528
[pid=11435] ppid=11433 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/11435/stat : 11435 (ppfolio) S 11433 11435 10991 0 -1 4202496 520 0 0 0 0 0 0 0 17 0 1 0 495696651 18763776 389 33554432000 4194304 4287625 140737090308656 18446744073709551615 264726425103 0 0 4096 65536 4607711013310038015 0 0 17 1 0 0 0
/proc/11435/statm: 4581 389 341 23 0 91 0
[pid=11436] ppid=11435 vsize=123516 CPUtime=6.29 cores=1
/proc/11436/stat : 11436 (cryptominisat) R 11435 11435 10991 0 -1 4202496 26359 0 0 0 625 4 0 0 25 0 1 0 495696651 126480384 25823 33554432000 4194304 4587354 140733595727600 18446744073709551615 4248764 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/11436/statm: 30879 25823 312 96 0 27441 0
[pid=11437] ppid=11435 vsize=134536 CPUtime=6.29 cores=5
/proc/11437/stat : 11437 (clasp) R 11435 11435 10991 0 -1 4202496 38655 0 0 0 623 6 0 0 25 0 1 0 495696651 137764864 30423 33554432000 4194304 4785740 140733329477360 18446744073709551615 4553003 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/11437/statm: 33634 30423 340 145 0 30679 0
[pid=11438] ppid=11435 vsize=493604 CPUtime=3.15 cores=7
/proc/11438/stat : 11438 (TNM) R 11435 11435 10991 0 -1 4202496 20739 0 0 0 313 2 0 0 25 0 1 0 495696651 505450496 20636 33554432000 134512640 134534564 4289368048 18446744073709551615 134529374 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/11438/statm: 123401 20636 95 6 0 122067 0
[pid=11439] ppid=11435 vsize=68708 CPUtime=6.29 cores=3
/proc/11439/stat : 11439 (lingeling) R 11435 11435 10991 0 -1 4202496 27612 0 0 0 626 3 0 0 25 0 1 0 495696651 70356992 16343 33554432000 4194304 4352236 140735244286640 18446744073709551615 4228410 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/11439/statm: 17177 16343 125 39 0 16257 0
[pid=11440] ppid=11435 vsize=117436 CPUtime=3.09 cores=7
/proc/11440/stat : 11440 (march_hi) R 11435 11435 10991 0 -1 4202496 130407 0 0 0 290 19 0 0 25 0 1 0 495696651 120254464 22059 33554432000 4194304 4331988 140734484655408 18446744073709551615 264726072284 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/11440/statm: 29359 22059 146 34 0 27801 0
Current children cumulated CPU time (s) 25.11
Current children cumulated vsize (KiB) 956124

[startup+12.7011 s]
/proc/loadavg: 5.28 5.78 6.93 11/188 11441
/proc/meminfo: memFree=14326012/32951124 swapFree=67111528/67111528
[pid=11435] ppid=11433 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/11435/stat : 11435 (ppfolio) S 11433 11435 10991 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 495696651 18763776 389 33554432000 4194304 4287625 140737090308656 18446744073709551615 264726425103 0 0 4096 65536 4607711013310038015 0 0 17 1 0 0 0
/proc/11435/statm: 4581 389 341 23 0 91 0
[pid=11436] ppid=11435 vsize=261840 CPUtime=12.69 cores=1
/proc/11436/stat : 11436 (cryptominisat) R 11435 11435 10991 0 -1 4202496 65664 0 0 0 1260 9 0 0 25 0 1 0 495696651 268124160 53755 33554432000 4194304 4587354 140733595727600 18446744073709551615 4237519 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/11436/statm: 65460 53755 329 96 0 62022 0
[pid=11437] ppid=11435 vsize=134536 CPUtime=12.69 cores=5
/proc/11437/stat : 11437 (clasp) R 11435 11435 10991 0 -1 4202496 38656 0 0 0 1263 6 0 0 25 0 1 0 495696651 137764864 30424 33554432000 4194304 4785740 140733329477360 18446744073709551615 4553001 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/11437/statm: 33634 30424 340 145 0 30679 0
[pid=11438] ppid=11435 vsize=493604 CPUtime=6.31 cores=7
/proc/11438/stat : 11438 (TNM) R 11435 11435 10991 0 -1 4202496 20739 0 0 0 629 2 0 0 25 0 1 0 495696651 505450496 20636 33554432000 134512640 134534564 4289368048 18446744073709551615 134529366 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/11438/statm: 123401 20636 95 6 0 122067 0
[pid=11439] ppid=11435 vsize=68152 CPUtime=12.69 cores=3
/proc/11439/stat : 11439 (lingeling) R 11435 11435 10991 0 -1 4202496 27614 0 0 0 1266 3 0 0 25 0 1 0 495696651 69787648 16206 33554432000 4194304 4352236 140735244286640 18446744073709551615 4328000 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/11439/statm: 17038 16206 127 39 0 16118 0
[pid=11440] ppid=11435 vsize=387880 CPUtime=6.29 cores=7
/proc/11440/stat : 11440 (march_hi) R 11435 11435 10991 0 -1 4202496 199893 0 0 0 601 28 0 0 25 0 1 0 495696651 397189120 74039 33554432000 4194304 4331988 140734484655408 18446744073709551615 4229294 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/11440/statm: 96970 74039 173 34 0 95412 0
Current children cumulated CPU time (s) 50.67
Current children cumulated vsize (KiB) 1364336

[startup+25.5007 s]
/proc/loadavg: 6.01 5.92 6.96 11/188 11441
/proc/meminfo: memFree=14214444/32951124 swapFree=67111528/67111528
[pid=11435] ppid=11433 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/11435/stat : 11435 (ppfolio) S 11433 11435 10991 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 495696651 18763776 389 33554432000 4194304 4287625 140737090308656 18446744073709551615 264726425103 0 0 4096 65536 4607711013310038015 0 0 17 1 0 0 0
/proc/11435/statm: 4581 389 341 23 0 91 0
[pid=11436] ppid=11435 vsize=261840 CPUtime=25.48 cores=1
/proc/11436/stat : 11436 (cryptominisat) R 11435 11435 10991 0 -1 4202496 67533 0 0 0 2538 10 0 0 25 0 1 0 495696651 268124160 55616 33554432000 4194304 4587354 140733595727600 18446744073709551615 4237679 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/11436/statm: 65460 55616 329 96 0 62022 0
[pid=11437] ppid=11435 vsize=134536 CPUtime=25.49 cores=5
/proc/11437/stat : 11437 (clasp) R 11435 11435 10991 0 -1 4202496 38656 0 0 0 2543 6 0 0 25 0 1 0 495696651 137764864 30424 33554432000 4194304 4785740 140733329477360 18446744073709551615 4552553 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/11437/statm: 33634 30424 340 145 0 30679 0
[pid=11438] ppid=11435 vsize=493604 CPUtime=12.7 cores=7
/proc/11438/stat : 11438 (TNM) R 11435 11435 10991 0 -1 4202496 20739 0 0 0 1268 2 0 0 25 0 1 0 495696651 505450496 20636 33554432000 134512640 134534564 4289368048 18446744073709551615 134530736 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/11438/statm: 123401 20636 95 6 0 122067 0
[pid=11439] ppid=11435 vsize=72248 CPUtime=25.48 cores=3
/proc/11439/stat : 11439 (lingeling) R 11435 11435 10991 0 -1 4202496 28638 0 0 0 2545 3 0 0 25 0 1 0 495696651 73981952 17230 33554432000 4194304 4352236 140735244286640 18446744073709551615 4327949 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/11439/statm: 18062 17230 127 39 0 17142 0
[pid=11440] ppid=11435 vsize=406768 CPUtime=12.64 cores=7
/proc/11440/stat : 11440 (march_hi) R 11435 11435 10991 0 -1 4202496 215552 0 0 0 1234 30 0 0 25 0 1 0 495696651 416530432 89698 33554432000 4194304 4331988 140734484655408 18446744073709551615 4229357 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/11440/statm: 101692 89698 173 34 0 100134 0
Current children cumulated CPU time (s) 101.79
Current children cumulated vsize (KiB) 1387320

[startup+51.1008 s]
/proc/loadavg: 7.51 6.28 7.05 11/188 11442
/proc/meminfo: memFree=14164996/32951124 swapFree=67111528/67111528
[pid=11435] ppid=11433 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/11435/stat : 11435 (ppfolio) S 11433 11435 10991 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 495696651 18763776 389 33554432000 4194304 4287625 140737090308656 18446744073709551615 264726425103 0 0 4096 65536 4607711013310038015 0 0 17 1 0 0 0
/proc/11435/statm: 4581 389 341 23 0 91 0
[pid=11436] ppid=11435 vsize=276152 CPUtime=51.09 cores=1
/proc/11436/stat : 11436 (cryptominisat) R 11435 11435 10991 0 -1 4202496 73394 0 0 0 5097 12 0 0 25 0 1 0 495696651 282779648 61344 33554432000 4194304 4587354 140733595727600 18446744073709551615 4237467 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/11436/statm: 69038 61344 338 96 0 65600 0
[pid=11437] ppid=11435 vsize=135860 CPUtime=51.09 cores=5
/proc/11437/stat : 11437 (clasp) R 11435 11435 10991 0 -1 4202496 39087 0 0 0 5103 6 0 0 25 0 1 0 495696651 139120640 30855 33554432000 4194304 4785740 140733329477360 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/11437/statm: 33965 30855 340 145 0 31010 0
[pid=11438] ppid=11435 vsize=493604 CPUtime=25.41 cores=7
/proc/11438/stat : 11438 (TNM) R 11435 11435 10991 0 -1 4202496 20739 0 0 0 2539 2 0 0 25 0 1 0 495696651 505450496 20636 33554432000 134512640 134534564 4289368048 18446744073709551615 134529651 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/11438/statm: 123401 20636 95 6 0 122067 0
[pid=11439] ppid=11435 vsize=72248 CPUtime=51.09 cores=3

################
# More data... #
################

/proc/11440/statm: 106203 94264 173 34 0 104645 0
Current children cumulated CPU time (s) 3764.13
Current children cumulated vsize (KiB) 1693308

[startup+1002.3 s]
/proc/loadavg: 10.20 10.00 9.03 11/188 11470
/proc/meminfo: memFree=13658508/32951124 swapFree=67111528/67111528
[pid=11435] ppid=11433 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/11435/stat : 11435 (ppfolio) S 11433 11435 10991 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 495696651 18763776 389 33554432000 4194304 4287625 140737090308656 18446744073709551615 264726425103 0 0 4096 65536 4607711013310038015 0 0 17 1 0 0 0
/proc/11435/statm: 4581 389 341 23 0 91 0
[pid=11436] ppid=11435 vsize=522836 CPUtime=1002.32 cores=1
/proc/11436/stat : 11436 (cryptominisat) R 11435 11435 10991 0 -1 4202496 251813 0 0 0 100163 69 0 0 25 0 1 0 495696651 535384064 76193 33554432000 4194304 4587354 140733595727600 18446744073709551615 4237679 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/11436/statm: 130709 76193 338 96 0 127271 0
[pid=11437] ppid=11435 vsize=351208 CPUtime=1002.32 cores=5
/proc/11437/stat : 11437 (clasp) R 11435 11435 10991 0 -1 4202496 92154 0 0 0 100202 30 0 0 25 0 1 0 495696651 359636992 83922 33554432000 4194304 4785740 140733329477360 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/11437/statm: 87802 83922 340 145 0 84847 0
[pid=11438] ppid=11435 vsize=493604 CPUtime=498.42 cores=7
/proc/11438/stat : 11438 (TNM) R 11435 11435 10991 0 -1 4202496 20739 0 0 0 49840 2 0 0 25 0 1 0 495696651 505450496 20636 33554432000 134512640 134534564 4289368048 18446744073709551615 134529031 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/11438/statm: 123401 20636 95 6 0 122067 0
[pid=11439] ppid=11435 vsize=88612 CPUtime=1002.33 cores=3
/proc/11439/stat : 11439 (lingeling) R 11435 11435 10991 0 -1 4202496 39371 0 0 0 100228 5 0 0 25 0 1 0 495696651 90738688 21321 33554432000 4194304 4352236 140735244286640 18446744073709551615 4328026 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/11439/statm: 22153 21321 127 39 0 21233 0
[pid=11440] ppid=11435 vsize=424812 CPUtime=498.41 cores=7
/proc/11440/stat : 11440 (march_hi) R 11435 11435 10991 0 -1 4202496 220118 0 0 0 49810 31 0 0 25 0 1 0 495696651 435007488 94264 33554432000 4194304 4331988 140734484655408 18446744073709551615 4229363 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/11440/statm: 106203 94264 173 34 0 104645 0
Current children cumulated CPU time (s) 4003.8
Current children cumulated vsize (KiB) 1899396

[startup+1062.3 s]
/proc/loadavg: 10.20 10.03 9.10 11/188 11472
/proc/meminfo: memFree=13634652/32951124 swapFree=67111528/67111528
[pid=11435] ppid=11433 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/11435/stat : 11435 (ppfolio) S 11433 11435 10991 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 495696651 18763776 389 33554432000 4194304 4287625 140737090308656 18446744073709551615 264726425103 0 0 4096 65536 4607711013310038015 0 0 17 1 0 0 0
/proc/11435/statm: 4581 389 341 23 0 91 0
[pid=11436] ppid=11435 vsize=2273616 CPUtime=1062.32 cores=1
/proc/11436/stat : 11436 (cryptominisat) R 11435 11435 10991 0 -1 4202496 265402 0 0 0 106158 74 0 0 25 0 1 0 495696651 2328182784 74906 33554432000 4194304 4587354 140733595727600 18446744073709551615 4238273 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/11436/statm: 568404 74906 338 96 0 564966 0
[pid=11437] ppid=11435 vsize=372588 CPUtime=1062.32 cores=5
/proc/11437/stat : 11437 (clasp) R 11435 11435 10991 0 -1 4202496 97336 0 0 0 106200 32 0 0 25 0 1 0 495696651 381530112 89104 33554432000 4194304 4785740 140733329477360 18446744073709551615 4277472 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/11437/statm: 93147 89104 340 145 0 90192 0
[pid=11438] ppid=11435 vsize=493604 CPUtime=528.3 cores=7
/proc/11438/stat : 11438 (TNM) R 11435 11435 10991 0 -1 4202496 20739 0 0 0 52828 2 0 0 25 0 1 0 495696651 505450496 20636 33554432000 134512640 134534564 4289368048 18446744073709551615 134530606 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/11438/statm: 123401 20636 95 6 0 122067 0
[pid=11439] ppid=11435 vsize=88612 CPUtime=1062.33 cores=3
/proc/11439/stat : 11439 (lingeling) R 11435 11435 10991 0 -1 4202496 39371 0 0 0 106228 5 0 0 25 0 1 0 495696651 90738688 21321 33554432000 4194304 4352236 140735244286640 18446744073709551615 4207636 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/11439/statm: 22153 21321 127 39 0 21233 0
[pid=11440] ppid=11435 vsize=424812 CPUtime=528.21 cores=7
/proc/11440/stat : 11440 (march_hi) R 11435 11435 10991 0 -1 4202496 220118 0 0 0 52790 31 0 0 25 0 1 0 495696651 435007488 94264 33554432000 4194304 4331988 140734484655408 18446744073709551615 4229533 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/11440/statm: 106203 94264 173 34 0 104645 0
Current children cumulated CPU time (s) 4243.48
Current children cumulated vsize (KiB) 3671556

[startup+1122.3 s]
/proc/loadavg: 10.22 10.07 9.17 11/188 11474
/proc/meminfo: memFree=13653824/32951124 swapFree=67111528/67111528
[pid=11435] ppid=11433 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/11435/stat : 11435 (ppfolio) S 11433 11435 10991 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 495696651 18763776 389 33554432000 4194304 4287625 140737090308656 18446744073709551615 264726425103 0 0 4096 65536 4607711013310038015 0 0 17 1 0 0 0
/proc/11435/statm: 4581 389 341 23 0 91 0
[pid=11436] ppid=11435 vsize=2520320 CPUtime=1122.32 cores=1
/proc/11436/stat : 11436 (cryptominisat) R 11435 11435 10991 0 -1 4202496 278481 0 0 0 112153 79 0 0 25 0 1 0 495696651 2580807680 71793 33554432000 4194304 4587354 140733595727600 18446744073709551615 4237679 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/11436/statm: 630080 71793 338 96 0 626642 0
[pid=11437] ppid=11435 vsize=372588 CPUtime=1122.32 cores=5
/proc/11437/stat : 11437 (clasp) R 11435 11435 10991 0 -1 4202496 97341 0 0 0 112200 32 0 0 25 0 1 0 495696651 381530112 89109 33554432000 4194304 4785740 140733329477360 18446744073709551615 4277464 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/11437/statm: 93147 89109 340 145 0 90192 0
[pid=11438] ppid=11435 vsize=493604 CPUtime=558.11 cores=7
/proc/11438/stat : 11438 (TNM) R 11435 11435 10991 0 -1 4202496 20739 0 0 0 55809 2 0 0 25 0 1 0 495696651 505450496 20636 33554432000 134512640 134534564 4289368048 18446744073709551615 134528250 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/11438/statm: 123401 20636 95 6 0 122067 0
[pid=11439] ppid=11435 vsize=91684 CPUtime=1122.33 cores=3
/proc/11439/stat : 11439 (lingeling) R 11435 11435 10991 0 -1 4202496 40139 0 0 0 112228 5 0 0 25 0 1 0 495696651 93884416 22089 33554432000 4194304 4352236 140735244286640 18446744073709551615 4328026 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/11439/statm: 22921 22089 127 39 0 22001 0
[pid=11440] ppid=11435 vsize=424812 CPUtime=558.07 cores=7
/proc/11440/stat : 11440 (march_hi) R 11435 11435 10991 0 -1 4202496 220118 0 0 0 55776 31 0 0 25 0 1 0 495696651 435007488 94264 33554432000 4194304 4331988 140734484655408 18446744073709551615 4229623 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/11440/statm: 106203 94264 173 34 0 104645 0
Current children cumulated CPU time (s) 4483.15
Current children cumulated vsize (KiB) 3921332

[startup+1182.3 s]
/proc/loadavg: 10.26 10.10 9.23 11/188 11475
/proc/meminfo: memFree=13606924/32951124 swapFree=67111528/67111528
[pid=11435] ppid=11433 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/11435/stat : 11435 (ppfolio) S 11433 11435 10991 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 495696651 18763776 389 33554432000 4194304 4287625 140737090308656 18446744073709551615 264726425103 0 0 4096 65536 4607711013310038015 0 0 17 1 0 0 0
/proc/11435/statm: 4581 389 341 23 0 91 0
[pid=11436] ppid=11435 vsize=2518116 CPUtime=1182.33 cores=1
/proc/11436/stat : 11436 (cryptominisat) R 11435 11435 10991 0 -1 4202496 287639 0 0 0 118150 83 0 0 25 0 1 0 495696651 2578550784 74732 33554432000 4194304 4587354 140733595727600 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/11436/statm: 629529 74732 338 96 0 626091 0
[pid=11437] ppid=11435 vsize=372588 CPUtime=1182.33 cores=5
/proc/11437/stat : 11437 (clasp) R 11435 11435 10991 0 -1 4202496 97343 0 0 0 118201 32 0 0 25 0 1 0 495696651 381530112 89111 33554432000 4194304 4785740 140733329477360 18446744073709551615 4319144 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/11437/statm: 93147 89111 340 145 0 90192 0
[pid=11438] ppid=11435 vsize=493604 CPUtime=587.96 cores=7
/proc/11438/stat : 11438 (TNM) R 11435 11435 10991 0 -1 4202496 20739 0 0 0 58794 2 0 0 25 0 1 0 495696651 505450496 20636 33554432000 134512640 134534564 4289368048 18446744073709551615 134525938 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/11438/statm: 123401 20636 95 6 0 122067 0
[pid=11439] ppid=11435 vsize=91684 CPUtime=1182.33 cores=3
/proc/11439/stat : 11439 (lingeling) R 11435 11435 10991 0 -1 4202496 40139 0 0 0 118228 5 0 0 25 0 1 0 495696651 93884416 22089 33554432000 4194304 4352236 140735244286640 18446744073709551615 4328100 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/11439/statm: 22921 22089 127 39 0 22001 0
[pid=11440] ppid=11435 vsize=424812 CPUtime=587.9 cores=7
/proc/11440/stat : 11440 (march_hi) R 11435 11435 10991 0 -1 4202496 220118 0 0 0 58759 31 0 0 25 0 1 0 495696651 435007488 94264 33554432000 4194304 4331988 140734484655408 18446744073709551615 4229294 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/11440/statm: 106203 94264 173 34 0 104645 0
Current children cumulated CPU time (s) 4722.85
Current children cumulated vsize (KiB) 3919128



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.7 s]
/proc/loadavg: 10.18 10.09 9.25 6/181 11477
/proc/meminfo: memFree=13941032/32951124 swapFree=67111528/67111528
[pid=11435] ppid=11433 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/11435/stat : 11435 (ppfolio) S 11433 11435 10991 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 495696651 18763776 389 33554432000 4194304 4287625 140737090308656 18446744073709551615 264726425103 0 0 4096 65536 4607711013310038015 0 0 17 1 0 0 0
/proc/11435/statm: 4581 389 341 23 0 91 0
[pid=11436] ppid=11435 vsize=2518116 CPUtime=1201.73 cores=1
/proc/11436/stat : 11436 (cryptominisat) R 11435 11435 10991 0 -1 4202496 289196 0 0 0 120088 85 0 0 25 0 1 0 495696651 2578550784 76271 33554432000 4194304 4587354 140733595727600 18446744073709551615 4236606 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/11436/statm: 629529 76271 338 96 0 626091 0
[pid=11437] ppid=11435 vsize=372588 CPUtime=1201.73 cores=5
/proc/11437/stat : 11437 (clasp) R 11435 11435 10991 0 -1 4202496 97343 0 0 0 120141 32 0 0 25 0 1 0 495696651 381530112 89111 33554432000 4194304 4785740 140733329477360 18446744073709551615 4312619 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/11437/statm: 93147 89111 340 145 0 90192 0
[pid=11438] ppid=11435 vsize=493604 CPUtime=597.61 cores=7
/proc/11438/stat : 11438 (TNM) R 11435 11435 10991 0 -1 4202496 20739 0 0 0 59759 2 0 0 25 0 1 0 495696651 505450496 20636 33554432000 134512640 134534564 4289368048 18446744073709551615 134530659 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/11438/statm: 123401 20636 95 6 0 122067 0
[pid=11439] ppid=11435 vsize=91684 CPUtime=1201.74 cores=3
/proc/11439/stat : 11439 (lingeling) R 11435 11435 10991 0 -1 4202496 40139 0 0 0 120169 5 0 0 25 0 1 0 495696651 93884416 22089 33554432000 4194304 4352236 140735244286640 18446744073709551615 4234240 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/11439/statm: 22921 22089 127 39 0 22001 0
[pid=11440] ppid=11435 vsize=424812 CPUtime=597.55 cores=7
/proc/11440/stat : 11440 (march_hi) R 11435 11435 10991 0 -1 4202496 220118 0 0 0 59724 31 0 0 25 0 1 0 495696651 435007488 94264 33554432000 4194304 4331988 140734484655408 18446744073709551615 4229539 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/11440/statm: 106203 94264 173 34 0 104645 0
Current children cumulated CPU time (s) 4800.36
Current children cumulated vsize (KiB) 3919128

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1201.7 s]
/proc/loadavg: 10.18 10.09 9.25 6/181 11477
/proc/meminfo: memFree=13941032/32951124 swapFree=67111528/67111528
[pid=11435] ppid=11433 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/11435/stat : 11435 (ppfolio) S 11433 11435 10991 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 495696651 18763776 389 33554432000 4194304 4287625 140737090308656 18446744073709551615 264726425103 0 0 4096 65536 4607711013310038015 0 0 17 1 0 0 0
/proc/11435/statm: 4581 389 341 23 0 91 0
[pid=11436] ppid=11435 vsize=2518116 CPUtime=1201.73 cores=1
/proc/11436/stat : 11436 (cryptominisat) R 11435 11435 10991 0 -1 4202496 289196 0 0 0 120088 85 0 0 25 0 1 0 495696651 2578550784 76271 33554432000 4194304 4587354 140733595727600 18446744073709551615 4236606 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/11436/statm: 629529 76271 338 96 0 626091 0
[pid=11437] ppid=11435 vsize=372588 CPUtime=1201.73 cores=5
/proc/11437/stat : 11437 (clasp) R 11435 11435 10991 0 -1 4202496 97343 0 0 0 120141 32 0 0 25 0 1 0 495696651 381530112 89111 33554432000 4194304 4785740 140733329477360 18446744073709551615 4312619 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/11437/statm: 93147 89111 340 145 0 90192 0
[pid=11438] ppid=11435 vsize=493604 CPUtime=597.61 cores=7
/proc/11438/stat : 11438 (TNM) R 11435 11435 10991 0 -1 4202496 20739 0 0 0 59759 2 0 0 25 0 1 0 495696651 505450496 20636 33554432000 134512640 134534564 4289368048 18446744073709551615 134530659 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/11438/statm: 123401 20636 95 6 0 122067 0
[pid=11439] ppid=11435 vsize=91684 CPUtime=1201.74 cores=3
/proc/11439/stat : 11439 (lingeling) R 11435 11435 10991 0 -1 4202496 40139 0 0 0 120169 5 0 0 25 0 1 0 495696651 93884416 22089 33554432000 4194304 4352236 140735244286640 18446744073709551615 4234240 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/11439/statm: 22921 22089 127 39 0 22001 0
[pid=11440] ppid=11435 vsize=424812 CPUtime=597.55 cores=7
/proc/11440/stat : 11440 (march_hi) R 11435 11435 10991 0 -1 4202496 220118 0 0 0 59724 31 0 0 25 0 1 0 495696651 435007488 94264 33554432000 4194304 4331988 140734484655408 18446744073709551615 4229539 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/11440/statm: 106203 94264 173 34 0 104645 0
Current children cumulated CPU time (s) 4800.36
Current children cumulated vsize (KiB) 3919128

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 11435 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=2999
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=1999
# CPU time returned by wait4() is 0.004998
# while last known CPU time is 4800.36
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1201.71
CPU time (s): 4800.36
CPU user time (s): 4798.81
CPU system time (s): 1.55
CPU usage (%): 399.46
Max. virtual memory (cumulated for all children) (KiB): 6223652

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.002999
system time used= 0.001999
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 520
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 247
involuntary context switches= 6

runsolver used 1.89371 second user time and 4.67229 second system time

The end

Launcher Data 

Begin job on node141 at 2011-04-29 01:20:10
IDJOB=3282452
IDBENCH=70815
IDSOLVER=1612
FILE ID=node141/3282452-1304032810
RUNJOBID= node141-1304032810-11411
PBS_JOBID= 13170311
Free space on /tmp= 71404 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT09/APPLICATIONS/bitverif/maxxor/maxxor128.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3282452-1304032810/watcher-3282452-1304032810 -o /tmp/evaluation-result-3282452-1304032810/solver-3282452-1304032810 -C 4800 -W 1300 -M 15500  ppfolio HOME/instance-3282452-1304032810.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 065c126f0d55807310a398728b44423f
RANDOM SEED=1706792074

node141.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5362.96
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      15118564 kB
Buffers:       1622040 kB
Cached:       15530120 kB
SwapCached:          0 kB
Active:        7917664 kB
Inactive:      9331104 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      15118564 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:           31076 kB
Writeback:           0 kB
AnonPages:       96772 kB
Mapped:          16032 kB
Slab:           519160 kB
PageTables:       5136 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   701420 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71396 MiB
End job on node141 at 2011-04-29 01:40:14