Trace number 3221908

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio seq? (TO) 5000.02 4999.91

General information on the benchmark

Namerandom/medium/
unif-k3-r4.26-v500-c2130-S247862791-097.UNKNOWN.cnf
MD5SUM6b69f72e1046222baee8c8d817a4adac
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark444.867
Satisfiable
(Un)Satisfiability was proved
Number of variables500
Number of clauses2130
Sum of the clauses size6390
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 32130
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.00/0.01	This is pico-portfolio, a naive parallel portfolio
0.00/0.01	Copyright (C) 2011 Olivier Roussel
0.00/0.01	Using 1 processing units
0.00/0.01	This portfolio uses the following solvers:
0.00/0.01	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.01	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.01	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.01	Starting cryptominisat 2.7.1 on core(s) 1
0.00/0.01	Starting clasp 1.3.6 on core(s) 1
0.00/0.01	Starting TNM 2009 on core(s) 1

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3221908-1303297919/watcher-3221908-1303297919 -o /tmp/evaluation-result-3221908-1303297919/solver-3221908-1303297919 -C 5000 -W 5000 -M 15500 ppfolio --nbcore=1 HOME/instance-3221908-1303297919.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 5000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 5030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 6.01 5.73 5.33 4/180 27272
/proc/meminfo: memFree=29352188/32950928 swapFree=67071984/67111528
[pid=27272] ppid=27270 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/27272/stat : 27272 (ppfolio) R 27270 27272 26704 0 -1 4202496 485 0 0 0 0 0 0 0 25 0 1 0 520022611 18763776 392 33554432000 4194304 4287625 140735081546640 18446744073709551615 260905214357 0 0 4096 65536 0 0 0 17 1 0 0 0
/proc/27272/statm: 4581 392 343 23 0 91 0

[startup+0.067173 s]
/proc/loadavg: 6.01 5.73 5.33 4/180 27272
/proc/meminfo: memFree=29352188/32950928 swapFree=67071984/67111528
[pid=27272] ppid=27270 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/27272/stat : 27272 (ppfolio) S 27270 27272 26704 0 -1 4202496 500 0 0 0 0 0 0 0 25 0 1 0 520022611 18763776 394 33554432000 4194304 4287625 140735081546640 18446744073709551615 260905414159 0 0 4096 65536 4466312993344291076 0 0 17 7 0 0 0
/proc/27272/statm: 4581 394 345 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.100166 s]
/proc/loadavg: 6.01 5.73 5.33 4/180 27272
/proc/meminfo: memFree=29352188/32950928 swapFree=67071984/67111528
[pid=27272] ppid=27270 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/27272/stat : 27272 (ppfolio) S 27270 27272 26704 0 -1 4202496 500 0 0 0 0 0 0 0 25 0 1 0 520022611 18763776 394 33554432000 4194304 4287625 140735081546640 18446744073709551615 260905414159 0 0 4096 65536 4466312993344291076 0 0 17 7 0 0 0
/proc/27272/statm: 4581 394 345 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.300129 s]
/proc/loadavg: 6.01 5.73 5.33 4/180 27272
/proc/meminfo: memFree=29352188/32950928 swapFree=67071984/67111528
[pid=27272] ppid=27270 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/27272/stat : 27272 (ppfolio) S 27270 27272 26704 0 -1 4202496 501 0 0 0 0 0 0 0 24 0 1 0 520022611 18763776 394 33554432000 4194304 4287625 140735081546640 18446744073709551615 260905414159 0 0 4096 65536 0 0 0 17 7 0 0 0
/proc/27272/statm: 4581 394 345 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.700056 s]
/proc/loadavg: 6.01 5.73 5.33 4/180 27272
/proc/meminfo: memFree=29352188/32950928 swapFree=67071984/67111528
[pid=27272] ppid=27270 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/27272/stat : 27272 (ppfolio) S 27270 27272 26704 0 -1 4202496 501 0 0 0 0 0 0 0 21 0 1 0 520022611 18763776 394 33554432000 4194304 4287625 140735081546640 18446744073709551615 260905414159 0 0 4096 65536 4608772312613781504 0 0 17 7 0 0 0
/proc/27272/statm: 4581 394 345 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50091 s]
/proc/loadavg: 6.01 5.73 5.33 7/184 27276
/proc/meminfo: memFree=29347692/32950928 swapFree=67071984/67111528
[pid=27272] ppid=27270 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/27272/stat : 27272 (ppfolio) S 27270 27272 26704 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 520022611 18763776 394 33554432000 4194304 4287625 140735081546640 18446744073709551615 260905414159 0 0 4096 65536 4608770251029479424 0 0 17 7 0 0 0
/proc/27272/statm: 4581 394 345 23 0 91 0
[pid=27273] ppid=27272 vsize=454764 CPUtime=0.5 cores=1
/proc/27273/stat : 27273 (cryptominisat) R 27272 27272 26704 0 -1 4202496 1267 0 0 0 50 0 0 0 25 0 1 0 520022611 465678336 777 33554432000 4194304 4587354 140735456927264 18446744073709551615 4238755 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/27273/statm: 113691 777 327 96 0 110253 0
[pid=27274] ppid=27272 vsize=13220 CPUtime=0.39 cores=1
/proc/27274/stat : 27274 (clasp) R 27272 27272 26704 0 -1 4202496 761 0 0 0 39 0 0 0 25 0 1 0 520022611 13537280 649 33554432000 4194304 4785740 140733916996592 18446744073709551615 4553437 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/27274/statm: 3305 649 340 145 0 350 0
[pid=27275] ppid=27272 vsize=455828 CPUtime=0.59 cores=1
/proc/27275/stat : 27275 (TNM) R 27272 27272 26704 0 -1 4202496 337 0 0 0 59 0 0 0 25 0 1 0 520022611 466767872 234 33554432000 134512640 134534564 4290641952 18446744073709551615 134528612 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/27275/statm: 113957 234 95 6 0 112623 0
Current children cumulated CPU time (s) 1.48
Current children cumulated vsize (KiB) 942136

[startup+3.10062 s]
/proc/loadavg: 6.01 5.73 5.33 7/184 27276
/proc/meminfo: memFree=29346080/32950928 swapFree=67071984/67111528
[pid=27272] ppid=27270 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/27272/stat : 27272 (ppfolio) S 27270 27272 26704 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 520022611 18763776 394 33554432000 4194304 4287625 140735081546640 18446744073709551615 260905414159 0 0 4096 65536 4608770388468432896 0 0 17 7 0 0 0
/proc/27272/statm: 4581 394 345 23 0 91 0
[pid=27273] ppid=27272 vsize=455792 CPUtime=0.99 cores=1
/proc/27273/stat : 27273 (cryptominisat) R 27272 27272 26704 0 -1 4202496 1749 0 0 0 99 0 0 0 25 0 1 0 520022611 466731008 961 33554432000 4194304 4587354 140735456927264 18446744073709551615 4238355 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/27273/statm: 113948 961 327 96 0 110510 0
[pid=27274] ppid=27272 vsize=13620 CPUtime=0.94 cores=1
/proc/27274/stat : 27274 (clasp) R 27272 27272 26704 0 -1 4202496 874 0 0 0 94 0 0 0 25 0 1 0 520022611 13946880 762 33554432000 4194304 4785740 140733916996592 18446744073709551615 4546087 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/27274/statm: 3405 762 340 145 0 450 0
[pid=27275] ppid=27272 vsize=455828 CPUtime=1.14 cores=1
/proc/27275/stat : 27275 (TNM) R 27272 27272 26704 0 -1 4202496 337 0 0 0 114 0 0 0 25 0 1 0 520022611 466767872 234 33554432000 134512640 134534564 4290641952 18446744073709551615 134528697 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/27275/statm: 113957 234 95 6 0 112623 0
Current children cumulated CPU time (s) 3.07
Current children cumulated vsize (KiB) 943564

[startup+6.30103 s]
/proc/loadavg: 6.01 5.73 5.33 7/184 27276
/proc/meminfo: memFree=29338076/32950928 swapFree=67071984/67111528
[pid=27272] ppid=27270 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/27272/stat : 27272 (ppfolio) S 27270 27272 26704 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 520022611 18763776 394 33554432000 4194304 4287625 140735081546640 18446744073709551615 260905414159 0 0 4096 65536 4608770525907386368 0 0 17 7 0 0 0
/proc/27272/statm: 4581 394 345 23 0 91 0
[pid=27273] ppid=27272 vsize=462196 CPUtime=2.09 cores=1
/proc/27273/stat : 27273 (cryptominisat) R 27272 27272 26704 0 -1 4202496 4049 0 0 0 209 0 0 0 25 0 1 0 520022611 473288704 2517 33554432000 4194304 4587354 140735456927264 18446744073709551615 4238571 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/27273/statm: 115549 2517 337 96 0 112111 0
[pid=27274] ppid=27272 vsize=14148 CPUtime=1.99 cores=1
/proc/27274/stat : 27274 (clasp) R 27272 27272 26704 0 -1 4202496 1009 0 0 0 199 0 0 0 25 0 1 0 520022611 14487552 897 33554432000 4194304 4785740 140733916996592 18446744073709551615 4546113 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/27274/statm: 3537 897 340 145 0 582 0
[pid=27275] ppid=27272 vsize=455828 CPUtime=2.19 cores=1
/proc/27275/stat : 27275 (TNM) R 27272 27272 26704 0 -1 4202496 337 0 0 0 219 0 0 0 25 0 1 0 520022611 466767872 234 33554432000 134512640 134534564 4290641952 18446744073709551615 134530360 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/27275/statm: 113957 234 95 6 0 112623 0
Current children cumulated CPU time (s) 6.27
Current children cumulated vsize (KiB) 950496

[startup+12.7009 s]
/proc/loadavg: 6.09 5.75 5.34 7/184 27276
/proc/meminfo: memFree=29333008/32950928 swapFree=67071984/67111528
[pid=27272] ppid=27270 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/27272/stat : 27272 (ppfolio) S 27270 27272 26704 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 520022611 18763776 394 33554432000 4194304 4287625 140735081546640 18446744073709551615 260905414159 0 0 4096 65536 4608770800785293312 0 0 17 7 0 0 0
/proc/27272/statm: 4581 394 345 23 0 91 0
[pid=27273] ppid=27272 vsize=465832 CPUtime=4.19 cores=1
/proc/27273/stat : 27273 (cryptominisat) R 27272 27272 26704 0 -1 4202496 6155 0 0 0 419 0 0 0 25 0 1 0 520022611 477011968 3214 33554432000 4194304 4587354 140735456927264 18446744073709551615 4238763 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/27273/statm: 116458 3214 337 96 0 113020 0
[pid=27274] ppid=27272 vsize=14824 CPUtime=4.14 cores=1
/proc/27274/stat : 27274 (clasp) R 27272 27272 26704 0 -1 4202496 1171 0 0 0 414 0 0 0 25 0 1 0 520022611 15179776 1059 33554432000 4194304 4785740 140733916996592 18446744073709551615 4550518 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/27274/statm: 3706 1059 340 145 0 751 0
[pid=27275] ppid=27272 vsize=455828 CPUtime=4.34 cores=1
/proc/27275/stat : 27275 (TNM) R 27272 27272 26704 0 -1 4202496 337 0 0 0 434 0 0 0 25 0 1 0 520022611 466767872 234 33554432000 134512640 134534564 4290641952 18446744073709551615 134528436 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/27275/statm: 113957 234 95 6 0 112623 0
Current children cumulated CPU time (s) 12.67
Current children cumulated vsize (KiB) 954808

[startup+25.5005 s]
/proc/loadavg: 6.07 5.76 5.35 7/184 27277
/proc/meminfo: memFree=29332228/32950928 swapFree=67071984/67111528
[pid=27272] ppid=27270 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/27272/stat : 27272 (ppfolio) S 27270 27272 26704 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 520022611 18763776 394 33554432000 4194304 4287625 140735081546640 18446744073709551615 260905414159 0 0 4096 65536 4608771213102153728 0 0 17 7 0 0 0
/proc/27272/statm: 4581 394 345 23 0 91 0
[pid=27273] ppid=27272 vsize=467740 CPUtime=8.49 cores=1
/proc/27273/stat : 27273 (cryptominisat) R 27272 27272 26704 0 -1 4202496 8393 0 0 0 848 1 0 0 25 0 1 0 520022611 478965760 3630 33554432000 4194304 4587354 140735456927264 18446744073709551615 4238593 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/27273/statm: 116935 3630 337 96 0 113497 0
[pid=27274] ppid=27272 vsize=15908 CPUtime=8.39 cores=1
/proc/27274/stat : 27274 (clasp) R 27272 27272 26704 0 -1 4202496 1447 0 0 0 839 0 0 0 25 0 1 0 520022611 16289792 1335 33554432000 4194304 4785740 140733916996592 18446744073709551615 4287248 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/27274/statm: 3977 1335 340 145 0 1022 0
[pid=27275] ppid=27272 vsize=455828 CPUtime=8.59 cores=1
/proc/27275/stat : 27275 (TNM) R 27272 27272 26704 0 -1 4202496 337 0 0 0 859 0 0 0 25 0 1 0 520022611 466767872 234 33554432000 134512640 134534564 4290641952 18446744073709551615 134529651 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/27275/statm: 113957 234 95 6 0 112623 0
Current children cumulated CPU time (s) 25.47
Current children cumulated vsize (KiB) 957800

[startup+51.1008 s]
/proc/loadavg: 6.04 5.78 5.37 7/184 27277
/proc/meminfo: memFree=29326744/32950928 swapFree=67071984/67111528
[pid=27272] ppid=27270 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/27272/stat : 27272 (ppfolio) S 27270 27272 26704 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 520022611 18763776 394 33554432000 4194304 4287625 140735081546640 18446744073709551615 260905414159 0 0 4096 65536 4608771350541107200 0 0 17 7 0 0 0
/proc/27272/statm: 4581 394 345 23 0 91 0
[pid=27273] ppid=27272 vsize=467852 CPUtime=16.98 cores=1
/proc/27273/stat : 27273 (cryptominisat) R 27272 27272 26704 0 -1 4202496 12679 0 0 0 1697 1 0 0 25 0 1 0 520022611 479080448 4228 33554432000 4194304 4587354 140735456927264 18446744073709551615 4238690 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/27273/statm: 116963 4228 337 96 0 113525 0
[pid=27274] ppid=27272 vsize=17428 CPUtime=16.95 cores=1
/proc/27274/stat : 27274 (clasp) R 27272 27272 26704 0 -1 4202496 1804 0 0 0 1695 0 0 0 25 0 1 0 520022611 17846272 1692 33554432000 4194304 4785740 140733916996592 18446744073709551615 4287204 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/27274/statm: 4357 1692 340 145 0 1402 0
[pid=27275] ppid=27272 vsize=455828 CPUtime=17.14 cores=1
/proc/27275/stat : 27275 (TNM) R 27272 27272 26704 0 -1 4202496 337 0 0 0 1714 0 0 0 25 0 1 0 520022611 466767872 234 33554432000 134512640 134534564 4290641952 18446744073709551615 134530353 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/27275/statm: 113957 234 95 6 0 112623 0
Current children cumulated CPU time (s) 51.07
Current children cumulated vsize (KiB) 959432

[startup+102.306 s]
/proc/loadavg: 6.02 5.81 5.40 7/184 27279
/proc/meminfo: memFree=29320008/32950928 swapFree=67071984/67111528
[pid=27272] ppid=27270 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/27272/stat : 27272 (ppfolio) S 27270 27272 26704 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 520022611 18763776 394 33554432000 4194304 4287625 140735081546640 18446744073709551615 260905414159 0 0 4096 65536 4608771625419014144 0 0 17 7 0 0 0
/proc/27272/statm: 4581 394 345 23 0 91 0
[pid=27273] ppid=27272 vsize=480848 CPUtime=34.08 cores=1
/proc/27273/stat : 27273 (cryptominisat) R 27272 27272 26704 0 -1 4202496 19514 0 0 0 3405 3 0 0 25 0 1 0 520022611 492388352 5373 33554432000 4194304 4587354 140735456927264 18446744073709551615 4238578 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/27273/statm: 120212 5373 337 96 0 116774 0
[pid=27274] ppid=27272 vsize=19108 CPUtime=33.99 cores=1
/proc/27274/stat : 27274 (clasp) R 27272 27272 26704 0 -1 4202496 2220 0 0 0 3399 0 0 0 25 0 1 0 520022611 19566592 2108 33554432000 4194304 4785740 140733916996592 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/27274/statm: 4777 2108 341 145 0 1822 0
[pid=27275] ppid=27272 vsize=455828 CPUtime=34.21 cores=1
/proc/27275/stat : 27275 (TNM) R 27272 27272 26704 0 -1 4202496 337 0 0 0 3421 0 0 0 25 0 1 0 520022611 466767872 234 33554432000 134512640 134534564 4290641952 18446744073709551615 134528726 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/27275/statm: 113957 234 95 6 0 112623 0
Current children cumulated CPU time (s) 102.28
Current children cumulated vsize (KiB) 974108

[startup+162.3 s]
/proc/loadavg: 6.00 5.84 5.43 7/184 27280
/proc/meminfo: memFree=29307672/32950928 swapFree=67071984/67111528
[pid=27272] ppid=27270 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/27272/stat : 27272 (ppfolio) S 27270 27272 26704 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 520022611 18763776 394 33554432000 4194304 4287625 140735081546640 18446744073709551615 260905414159 0 0 4096 65536 4608771762857967616 0 0 17 7 0 0 0
/proc/27272/statm: 4581 394 345 23 0 91 0
[pid=27273] ppid=27272 vsize=493392 CPUtime=54.09 cores=1
/proc/27273/stat : 27273 (cryptominisat) R 27272 27272 26704 0 -1 4202496 28057 0 0 0 5403 6 0 0 25 0 1 0 520022611 505233408 7940 33554432000 4194304 4587354 140735456927264 18446744073709551615 4238616 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/27273/statm: 123348 7940 337 96 0 119910 0
[pid=27274] ppid=27272 vsize=20680 CPUtime=53.98 cores=1

################
# More data... #
################

/proc/27275/statm: 113958 243 103 6 0 112624 0
Current children cumulated CPU time (s) 4602.43
Current children cumulated vsize (KiB) 1126316

[startup+4662.3 s]
/proc/loadavg: 5.89 5.95 5.92 7/184 27533
/proc/meminfo: memFree=29266776/32950928 swapFree=67071984/67111528
[pid=27272] ppid=27270 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/27272/stat : 27272 (ppfolio) S 27270 27272 26704 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 520022611 18763776 394 33554432000 4194304 4287625 140735081546640 18446744073709551615 260905414159 0 0 4096 65536 4608770800785293312 0 0 17 7 0 0 0
/proc/27272/statm: 4581 394 345 23 0 91 0
[pid=27273] ppid=27272 vsize=536140 CPUtime=1554.16 cores=1
/proc/27273/stat : 27273 (cryptominisat) R 27272 27272 26704 0 -1 4202496 165542 0 0 0 155384 32 0 0 25 0 1 0 520022611 549007360 22143 33554432000 4194304 4587354 140735456927264 18446744073709551615 4238538 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/27273/statm: 134035 22143 337 96 0 130597 0
[pid=27274] ppid=27272 vsize=39808 CPUtime=1554.06 cores=1
/proc/27274/stat : 27274 (clasp) R 27272 27272 26704 0 -1 4202496 7044 0 0 0 155405 1 0 0 25 0 1 0 520022611 40763392 6932 33554432000 4194304 4785740 140733916996592 18446744073709551615 4287008 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/27274/statm: 9952 6932 341 145 0 6997 0
[pid=27275] ppid=27272 vsize=455832 CPUtime=1554.21 cores=1
/proc/27275/stat : 27275 (TNM) R 27272 27272 26704 0 -1 4202496 346 0 0 0 155421 0 0 0 25 0 1 0 520022611 466771968 243 33554432000 134512640 134534564 4290641952 18446744073709551615 134528288 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/27275/statm: 113958 243 103 6 0 112624 0
Current children cumulated CPU time (s) 4662.43
Current children cumulated vsize (KiB) 1050104

[startup+4722.31 s]
/proc/loadavg: 5.96 5.96 5.92 7/184 27535
/proc/meminfo: memFree=29240204/32950928 swapFree=67071984/67111528
[pid=27272] ppid=27270 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/27272/stat : 27272 (ppfolio) S 27270 27272 26704 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 520022611 18763776 394 33554432000 4194304 4287625 140735081546640 18446744073709551615 260905414159 0 0 4096 65536 4608770800785293312 0 0 17 7 0 0 0
/proc/27272/statm: 4581 394 345 23 0 91 0
[pid=27273] ppid=27272 vsize=536140 CPUtime=1574.15 cores=1
/proc/27273/stat : 27273 (cryptominisat) R 27272 27272 26704 0 -1 4202496 166765 0 0 0 157383 32 0 0 25 0 1 0 520022611 549007360 23316 33554432000 4194304 4587354 140735456927264 18446744073709551615 4232120 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/27273/statm: 134035 23316 337 96 0 130597 0
[pid=27274] ppid=27272 vsize=40004 CPUtime=1574.05 cores=1
/proc/27274/stat : 27274 (clasp) R 27272 27272 26704 0 -1 4202496 7073 0 0 0 157404 1 0 0 25 0 1 0 520022611 40964096 6961 33554432000 4194304 4785740 140733916996592 18446744073709551615 4287204 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/27274/statm: 10001 6961 341 145 0 7046 0
[pid=27275] ppid=27272 vsize=455832 CPUtime=1574.22 cores=1
/proc/27275/stat : 27275 (TNM) R 27272 27272 26704 0 -1 4202496 346 0 0 0 157422 0 0 0 25 0 1 0 520022611 466771968 243 33554432000 134512640 134534564 4290641952 18446744073709551615 134528730 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/27275/statm: 113958 243 103 6 0 112624 0
Current children cumulated CPU time (s) 4722.42
Current children cumulated vsize (KiB) 1050300

[startup+4782.3 s]
/proc/loadavg: 5.98 5.97 5.92 7/184 27536
/proc/meminfo: memFree=29254408/32950928 swapFree=67071984/67111528
[pid=27272] ppid=27270 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/27272/stat : 27272 (ppfolio) S 27270 27272 26704 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 520022611 18763776 394 33554432000 4194304 4287625 140735081546640 18446744073709551615 260905414159 0 0 4096 65536 4608770800785293312 0 0 17 7 0 0 0
/proc/27272/statm: 4581 394 345 23 0 91 0
[pid=27273] ppid=27272 vsize=523360 CPUtime=1594.15 cores=1
/proc/27273/stat : 27273 (cryptominisat) R 27272 27272 26704 0 -1 4202496 166766 0 0 0 159383 32 0 0 25 0 1 0 520022611 535920640 19016 33554432000 4194304 4587354 140735456927264 18446744073709551615 4238690 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/27273/statm: 130840 19016 337 96 0 127402 0
[pid=27274] ppid=27272 vsize=40004 CPUtime=1594.05 cores=1
/proc/27274/stat : 27274 (clasp) R 27272 27272 26704 0 -1 4202496 7085 0 0 0 159404 1 0 0 25 0 1 0 520022611 40964096 6973 33554432000 4194304 4785740 140733916996592 18446744073709551615 4551048 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/27274/statm: 10001 6973 341 145 0 7046 0
[pid=27275] ppid=27272 vsize=455832 CPUtime=1594.22 cores=1
/proc/27275/stat : 27275 (TNM) R 27272 27272 26704 0 -1 4202496 346 0 0 0 159422 0 0 0 25 0 1 0 520022611 466771968 243 33554432000 134512640 134534564 4290641952 18446744073709551615 134529777 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/27275/statm: 113958 243 103 6 0 112624 0
Current children cumulated CPU time (s) 4782.42
Current children cumulated vsize (KiB) 1037520

[startup+4842.3 s]
/proc/loadavg: 5.99 5.97 5.92 7/184 27538
/proc/meminfo: memFree=29247548/32950928 swapFree=67071984/67111528
[pid=27272] ppid=27270 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/27272/stat : 27272 (ppfolio) S 27270 27272 26704 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 520022611 18763776 394 33554432000 4194304 4287625 140735081546640 18446744073709551615 260905414159 0 0 4096 65536 4608770800785293312 0 0 17 7 0 0 0
/proc/27272/statm: 4581 394 345 23 0 91 0
[pid=27273] ppid=27272 vsize=523360 CPUtime=1614.14 cores=1
/proc/27273/stat : 27273 (cryptominisat) R 27272 27272 26704 0 -1 4202496 167084 0 0 0 161382 32 0 0 25 0 1 0 520022611 535920640 19323 33554432000 4194304 4587354 140735456927264 18446744073709551615 4231728 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/27273/statm: 130840 19323 337 96 0 127402 0
[pid=27274] ppid=27272 vsize=40004 CPUtime=1614.05 cores=1
/proc/27274/stat : 27274 (clasp) R 27272 27272 26704 0 -1 4202496 7103 0 0 0 161404 1 0 0 25 0 1 0 520022611 40964096 6991 33554432000 4194304 4785740 140733916996592 18446744073709551615 4287008 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/27274/statm: 10001 6991 341 145 0 7046 0
[pid=27275] ppid=27272 vsize=455832 CPUtime=1614.23 cores=1
/proc/27275/stat : 27275 (TNM) R 27272 27272 26704 0 -1 4202496 346 0 0 0 161423 0 0 0 25 0 1 0 520022611 466771968 243 33554432000 134512640 134534564 4290641952 18446744073709551615 134528988 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/27275/statm: 113958 243 103 6 0 112624 0
Current children cumulated CPU time (s) 4842.42
Current children cumulated vsize (KiB) 1037520

[startup+4902.3 s]
/proc/loadavg: 5.99 5.97 5.92 7/184 27540
/proc/meminfo: memFree=29222088/32950928 swapFree=67071984/67111528
[pid=27272] ppid=27270 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/27272/stat : 27272 (ppfolio) S 27270 27272 26704 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 520022611 18763776 394 33554432000 4194304 4287625 140735081546640 18446744073709551615 260905414159 0 0 4096 65536 4608770800785293312 0 0 17 7 0 0 0
/proc/27272/statm: 4581 394 345 23 0 91 0
[pid=27273] ppid=27272 vsize=535124 CPUtime=1634.14 cores=1
/proc/27273/stat : 27273 (cryptominisat) R 27272 27272 26704 0 -1 4202496 170279 0 0 0 163381 33 0 0 25 0 1 0 520022611 547966976 22147 33554432000 4194304 4587354 140735456927264 18446744073709551615 4237665 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/27273/statm: 133781 22147 337 96 0 130343 0
[pid=27274] ppid=27272 vsize=40172 CPUtime=1634.04 cores=1
/proc/27274/stat : 27274 (clasp) R 27272 27272 26704 0 -1 4202496 7116 0 0 0 163403 1 0 0 25 0 1 0 520022611 41136128 7004 33554432000 4194304 4785740 140733916996592 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/27274/statm: 10043 7004 341 145 0 7088 0
[pid=27275] ppid=27272 vsize=455832 CPUtime=1634.24 cores=1
/proc/27275/stat : 27275 (TNM) R 27272 27272 26704 0 -1 4202496 346 0 0 0 163424 0 0 0 25 0 1 0 520022611 466771968 243 33554432000 134512640 134534564 4290641952 18446744073709551615 134528957 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/27275/statm: 113958 243 103 6 0 112624 0
Current children cumulated CPU time (s) 4902.42
Current children cumulated vsize (KiB) 1049452

[startup+4962.3 s]
/proc/loadavg: 6.05 5.99 5.92 7/184 27541
/proc/meminfo: memFree=29210876/32950928 swapFree=67071984/67111528
[pid=27272] ppid=27270 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/27272/stat : 27272 (ppfolio) S 27270 27272 26704 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 520022611 18763776 394 33554432000 4194304 4287625 140735081546640 18446744073709551615 260905414159 0 0 4096 65536 4608770800785293312 0 0 17 7 0 0 0
/proc/27272/statm: 4581 394 345 23 0 91 0
[pid=27273] ppid=27272 vsize=535124 CPUtime=1654.14 cores=1
/proc/27273/stat : 27273 (cryptominisat) R 27272 27272 26704 0 -1 4202496 171649 0 0 0 165381 33 0 0 25 0 1 0 520022611 547966976 23467 33554432000 4194304 4587354 140735456927264 18446744073709551615 4231914 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/27273/statm: 133781 23467 337 96 0 130343 0
[pid=27274] ppid=27272 vsize=40172 CPUtime=1654.04 cores=1
/proc/27274/stat : 27274 (clasp) R 27272 27272 26704 0 -1 4202496 7130 0 0 0 165403 1 0 0 25 0 1 0 520022611 41136128 7018 33554432000 4194304 4785740 140733916996592 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/27274/statm: 10043 7018 341 145 0 7088 0
[pid=27275] ppid=27272 vsize=455832 CPUtime=1654.25 cores=1
/proc/27275/stat : 27275 (TNM) R 27272 27272 26704 0 -1 4202496 346 0 0 0 165425 0 0 0 25 0 1 0 520022611 466771968 243 33554432000 134512640 134534564 4290641952 18446744073709551615 134530712 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/27275/statm: 113958 243 103 6 0 112624 0
Current children cumulated CPU time (s) 4962.43
Current children cumulated vsize (KiB) 1049452



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+4999.9 s]
/proc/loadavg: 6.03 5.99 5.92 7/184 27542
/proc/meminfo: memFree=29226844/32950928 swapFree=67071984/67111528
[pid=27272] ppid=27270 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/27272/stat : 27272 (ppfolio) S 27270 27272 26704 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 520022611 18763776 394 33554432000 4194304 4287625 140735081546640 18446744073709551615 260905414159 0 0 4096 65536 4608770800785293312 0 0 17 7 0 0 0
/proc/27272/statm: 4581 394 345 23 0 91 0
[pid=27273] ppid=27272 vsize=521608 CPUtime=1666.63 cores=1
/proc/27273/stat : 27273 (cryptominisat) R 27272 27272 26704 0 -1 4202496 171650 0 0 0 166630 33 0 0 25 0 1 0 520022611 534126592 19016 33554432000 4194304 4587354 140735456927264 18446744073709551615 4238423 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/27273/statm: 130402 19016 337 96 0 126964 0
[pid=27274] ppid=27272 vsize=40172 CPUtime=1666.6 cores=1
/proc/27274/stat : 27274 (clasp) R 27272 27272 26704 0 -1 4202496 7142 0 0 0 166659 1 0 0 25 0 1 0 520022611 41136128 7030 33554432000 4194304 4785740 140733916996592 18446744073709551615 4553344 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/27274/statm: 10043 7030 341 145 0 7088 0
[pid=27275] ppid=27272 vsize=455832 CPUtime=1666.79 cores=1
/proc/27275/stat : 27275 (TNM) R 27272 27272 26704 0 -1 4202496 346 0 0 0 166679 0 0 0 25 0 1 0 520022611 466771968 243 33554432000 134512640 134534564 4290641952 18446744073709551615 134528436 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/27275/statm: 113958 243 103 6 0 112624 0
Current children cumulated CPU time (s) 5000.02
Current children cumulated vsize (KiB) 1035936

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+4999.9 s]
/proc/loadavg: 6.03 5.99 5.92 7/184 27542
/proc/meminfo: memFree=29226844/32950928 swapFree=67071984/67111528
[pid=27272] ppid=27270 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/27272/stat : 27272 (ppfolio) S 27270 27272 26704 0 -1 4202496 501 0 0 0 0 0 0 0 15 0 1 0 520022611 18763776 394 33554432000 4194304 4287625 140735081546640 18446744073709551615 260905414159 0 0 4096 65536 4608770800785293312 0 0 17 7 0 0 0
/proc/27272/statm: 4581 394 345 23 0 91 0
[pid=27273] ppid=27272 vsize=521608 CPUtime=1666.63 cores=1
/proc/27273/stat : 27273 (cryptominisat) R 27272 27272 26704 0 -1 4202496 171650 0 0 0 166630 33 0 0 25 0 1 0 520022611 534126592 19016 33554432000 4194304 4587354 140735456927264 18446744073709551615 4238423 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/27273/statm: 130402 19016 337 96 0 126964 0
[pid=27274] ppid=27272 vsize=40172 CPUtime=1666.6 cores=1
/proc/27274/stat : 27274 (clasp) R 27272 27272 26704 0 -1 4202496 7142 0 0 0 166659 1 0 0 25 0 1 0 520022611 41136128 7030 33554432000 4194304 4785740 140733916996592 18446744073709551615 4553344 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/27274/statm: 10043 7030 341 145 0 7088 0
[pid=27275] ppid=27272 vsize=455832 CPUtime=1666.79 cores=1
/proc/27275/stat : 27275 (TNM) R 27272 27272 26704 0 -1 4202496 346 0 0 0 166679 0 0 0 25 0 1 0 520022611 466771968 243 33554432000 134512640 134534564 4290641952 18446744073709551615 134528436 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/27275/statm: 113958 243 103 6 0 112624 0
Current children cumulated CPU time (s) 5000.02
Current children cumulated vsize (KiB) 1035936

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 27272 and gives
#  childrusage.ru_utime.tv_sec=3332
#  childrusage.ru_utime.tv_usec=910320
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=358945
# CPU time returned by wait4() is 3333.27
# while last known CPU time is 5000.02
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 4999.91
CPU time (s): 5000.02
CPU user time (s): 4999.68
CPU system time (s): 0.34
CPU usage (%): 100.002
Max. virtual memory (cumulated for all children) (KiB): 1596336

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3332.91
system time used= 0.358945
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 179308
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 229
involuntary context switches= 36860

runsolver used 7.79981 second user time and 17.5923 second system time

The end

Launcher Data 

Begin job on node116 at 2011-04-20 13:11:59
IDJOB=3221908
IDBENCH=83001
IDSOLVER=1639
FILE ID=node116/3221908-1303297919
RUNJOBID= node116-1303292522-26723
PBS_JOBID= 13049627
Free space on /tmp= 72612 MiB

SOLVER NAME= ppfolio seq
BENCH NAME= SAT11/random/medium/unif-k3-r4.26-v500-c2130-S247862791-097.UNKNOWN.cnf
COMMAND LINE= ppfolio --nbcore=1 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3221908-1303297919/watcher-3221908-1303297919 -o /tmp/evaluation-result-3221908-1303297919/solver-3221908-1303297919 -C 5000 -W 5000 -M 15500  ppfolio --nbcore=1 HOME/instance-3221908-1303297919.cnf

TIME LIMIT= 5000 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 6b69f72e1046222baee8c8d817a4adac
RANDOM SEED=447009139

node116.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      29352344 kB
Buffers:        114680 kB
Cached:        3243488 kB
SwapCached:       9616 kB
Active:         669888 kB
Inactive:      2767700 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      29352344 kB
SwapTotal:    67111528 kB
SwapFree:     67071984 kB
Dirty:           10076 kB
Writeback:           0 kB
AnonPages:       73464 kB
Mapped:          15408 kB
Slab:            97992 kB
PageTables:       5180 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   984920 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72604 MiB
End job on node116 at 2011-04-20 14:35:21