Trace number 3191018

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio par? (TO) 4800.34 1201.71

General information on the benchmark

Namerandom/medium/
unif-k5-r21.3-v150-c3195-S207562876-057.UNKNOWN.cnf
MD5SUM04148c6828d9f9ccd74e3efaedcb8c52
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables150
Number of clauses3195
Sum of the clauses size15975
Maximum clause length5
Minimum clause length5
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 53195
Number of clauses of size over 50

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 4 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] lingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	[5] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 1
0.00/0.00	Starting clasp 1.3.6 on core(s) 5
0.00/0.00	Starting TNM 2009 on core(s) 7
0.00/0.00	Starting lingeling 276-6264d55-100731 on core(s) 3
0.00/0.00	Starting march_hi 2009 on core(s) 7

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3191018-1304053355/watcher-3191018-1304053355 -o /tmp/evaluation-result-3191018-1304053355/solver-3191018-1304053355 -C 4800 -W 1300 -M 15500 ppfolio HOME/instance-3191018-1304053355.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 5.06 5.16 6.38 1/171 20501
/proc/meminfo: memFree=18471680/32950928 swapFree=67111524/67111528
[pid=20501] ppid=20499 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/20501/stat : 20501 (ppfolio) R 20499 20501 18457 0 -1 4202496 519 0 0 0 0 0 0 0 25 0 1 0 595566217 18763776 390 33554432000 4194304 4287625 140734455406016 18446744073709551615 256415411727 0 0 4096 65536 0 0 0 17 1 0 0 0
/proc/20501/statm: 4581 390 341 23 0 91 0

[startup+0.135429 s]
/proc/loadavg: 5.06 5.16 6.38 1/171 20501
/proc/meminfo: memFree=18471680/32950928 swapFree=67111524/67111528
[pid=20501] ppid=20499 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/20501/stat : 20501 (ppfolio) S 20499 20501 18457 0 -1 4202496 520 0 0 0 0 0 0 0 25 0 1 0 595566217 18763776 390 33554432000 4194304 4287625 140734455406016 18446744073709551615 256415411727 0 0 4096 65536 374010979110879231 0 0 17 1 0 0 0
/proc/20501/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.200417 s]
/proc/loadavg: 5.06 5.16 6.38 1/171 20501
/proc/meminfo: memFree=18471680/32950928 swapFree=67111524/67111528
[pid=20501] ppid=20499 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/20501/stat : 20501 (ppfolio) R 20499 20501 18457 0 -1 4202496 520 0 0 0 0 0 0 0 25 0 1 0 595566217 18763776 390 33554432000 4194304 4287625 140734455406016 18446744073709551615 256415411727 0 0 4096 65536 0 0 0 17 1 0 0 0
/proc/20501/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.300398 s]
/proc/loadavg: 5.06 5.16 6.38 1/171 20501
/proc/meminfo: memFree=18471680/32950928 swapFree=67111524/67111528
[pid=20501] ppid=20499 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/20501/stat : 20501 (ppfolio) R 20499 20501 18457 0 -1 4202496 520 0 0 0 0 0 0 0 25 0 1 0 595566217 18763776 390 33554432000 4194304 4287625 140734455406016 18446744073709551615 256415411727 0 0 4096 65536 0 0 0 17 1 0 0 0
/proc/20501/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.700324 s]
/proc/loadavg: 5.06 5.16 6.38 1/171 20501
/proc/meminfo: memFree=18471680/32950928 swapFree=67111524/67111528
[pid=20501] ppid=20499 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/20501/stat : 20501 (ppfolio) S 20499 20501 18457 0 -1 4202496 520 0 0 0 0 0 0 0 21 0 1 0 595566217 18763776 390 33554432000 4194304 4287625 140734455406016 18446744073709551615 256415411727 0 0 4096 65536 374010979110879231 0 0 17 1 0 0 0
/proc/20501/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50118 s]
/proc/loadavg: 5.06 5.16 6.38 6/177 20507
/proc/meminfo: memFree=18461712/32950928 swapFree=67111524/67111528
[pid=20501] ppid=20499 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/20501/stat : 20501 (ppfolio) S 20499 20501 18457 0 -1 4202496 520 0 0 0 0 0 0 0 16 0 1 0 595566217 18763776 390 33554432000 4194304 4287625 140734455406016 18446744073709551615 256415411727 0 0 4096 65536 374010979110879231 0 0 17 1 0 0 0
/proc/20501/statm: 4581 390 341 23 0 91 0
[pid=20502] ppid=20501 vsize=186352 CPUtime=1.49 cores=1
/proc/20502/stat : 20502 (cryptominisat) R 20501 20501 18457 0 -1 4202496 4443 0 0 0 149 0 0 0 25 0 1 0 595566217 190824448 2933 33554432000 4194304 4587354 140735636101328 18446744073709551615 4364908 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/20502/statm: 46588 2933 337 96 0 43150 0
[pid=20503] ppid=20501 vsize=14360 CPUtime=1.49 cores=5
/proc/20503/stat : 20503 (clasp) R 20501 20501 18457 0 -1 4202496 1049 0 0 0 149 0 0 0 25 0 1 0 595566217 14704640 940 33554432000 4194304 4785740 140736061700576 18446744073709551615 4287024 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/20503/statm: 3590 940 340 145 0 635 0
[pid=20504] ppid=20501 vsize=456092 CPUtime=0.78 cores=7
/proc/20504/stat : 20504 (TNM) R 20501 20501 18457 0 -1 4202496 389 0 0 0 78 0 0 0 25 0 1 0 595566217 467038208 286 33554432000 134512640 134534564 4291585024 18446744073709551615 134528295 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/20504/statm: 114023 286 95 6 0 112689 0
[pid=20505] ppid=20501 vsize=6356 CPUtime=1.49 cores=3
/proc/20505/stat : 20505 (lingeling) R 20501 20501 18457 0 -1 4202496 1110 0 0 0 149 0 0 0 25 0 1 0 595566217 6508544 783 33554432000 4194304 4352236 140736102300624 18446744073709551615 4271184 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/20505/statm: 1589 783 127 39 0 669 0
[pid=20506] ppid=20501 vsize=7616 CPUtime=0.7 cores=7
/proc/20506/stat : 20506 (march_hi) R 20501 20501 18457 0 -1 4202496 551 0 0 0 70 0 0 0 25 0 1 0 595566217 7798784 431 33554432000 4194304 4331988 140735762339696 18446744073709551615 4239602 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/20506/statm: 1904 431 174 34 0 346 0
Current children cumulated CPU time (s) 5.95
Current children cumulated vsize (KiB) 689100

[startup+3.10088 s]
/proc/loadavg: 5.06 5.16 6.38 6/177 20507
/proc/meminfo: memFree=18451680/32950928 swapFree=67111524/67111528
[pid=20501] ppid=20499 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/20501/stat : 20501 (ppfolio) S 20499 20501 18457 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 595566217 18763776 390 33554432000 4194304 4287625 140734455406016 18446744073709551615 256415411727 0 0 4096 65536 374010979110879231 0 0 17 1 0 0 0
/proc/20501/statm: 4581 390 341 23 0 91 0
[pid=20502] ppid=20501 vsize=188404 CPUtime=3.09 cores=1
/proc/20502/stat : 20502 (cryptominisat) R 20501 20501 18457 0 -1 4202496 6100 0 0 0 309 0 0 0 25 0 1 0 595566217 192925696 3514 33554432000 4194304 4587354 140735636101328 18446744073709551615 4357604 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/20502/statm: 47101 3514 337 96 0 43663 0
[pid=20503] ppid=20501 vsize=15180 CPUtime=3.09 cores=5
/proc/20503/stat : 20503 (clasp) R 20501 20501 18457 0 -1 4202496 1237 0 0 0 309 0 0 0 25 0 1 0 595566217 15544320 1128 33554432000 4194304 4785740 140736061700576 18446744073709551615 4287252 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/20503/statm: 3795 1128 340 145 0 840 0
[pid=20504] ppid=20501 vsize=456092 CPUtime=1.57 cores=7
/proc/20504/stat : 20504 (TNM) R 20501 20501 18457 0 -1 4202496 389 0 0 0 157 0 0 0 25 0 1 0 595566217 467038208 286 33554432000 134512640 134534564 4291585024 18446744073709551615 134530659 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/20504/statm: 114023 286 95 6 0 112689 0
[pid=20505] ppid=20501 vsize=7480 CPUtime=3.09 cores=3
/proc/20505/stat : 20505 (lingeling) R 20501 20501 18457 0 -1 4202496 1559 0 0 0 309 0 0 0 25 0 1 0 595566217 7659520 1064 33554432000 4194304 4352236 140736102300624 18446744073709551615 4328194 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/20505/statm: 1870 1064 127 39 0 950 0
[pid=20506] ppid=20501 vsize=7868 CPUtime=1.5 cores=7
/proc/20506/stat : 20506 (march_hi) R 20501 20501 18457 0 -1 4202496 600 0 0 0 150 0 0 0 25 0 1 0 595566217 8056832 480 33554432000 4194304 4331988 140735762339696 18446744073709551615 4226263 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/20506/statm: 1967 480 175 34 0 409 0
Current children cumulated CPU time (s) 12.34
Current children cumulated vsize (KiB) 693348

[startup+6.30027 s]
/proc/loadavg: 5.05 5.16 6.37 6/177 20507
/proc/meminfo: memFree=18447240/32950928 swapFree=67111524/67111528
[pid=20501] ppid=20499 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/20501/stat : 20501 (ppfolio) S 20499 20501 18457 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 595566217 18763776 390 33554432000 4194304 4287625 140734455406016 18446744073709551615 256415411727 0 0 4096 65536 374010979110879231 0 0 17 1 0 0 0
/proc/20501/statm: 4581 390 341 23 0 91 0
[pid=20502] ppid=20501 vsize=189352 CPUtime=6.28 cores=1
/proc/20502/stat : 20502 (cryptominisat) R 20501 20501 18457 0 -1 4202496 8587 0 0 0 628 0 0 0 25 0 1 0 595566217 193896448 4027 33554432000 4194304 4587354 140735636101328 18446744073709551615 4238690 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/20502/statm: 47338 4027 337 96 0 43900 0
[pid=20503] ppid=20501 vsize=16060 CPUtime=6.29 cores=5
/proc/20503/stat : 20503 (clasp) R 20501 20501 18457 0 -1 4202496 1443 0 0 0 629 0 0 0 25 0 1 0 595566217 16445440 1334 33554432000 4194304 4785740 140736061700576 18446744073709551615 4549837 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/20503/statm: 4015 1334 340 145 0 1060 0
[pid=20504] ppid=20501 vsize=456092 CPUtime=3.16 cores=7
/proc/20504/stat : 20504 (TNM) R 20501 20501 18457 0 -1 4202496 389 0 0 0 316 0 0 0 25 0 1 0 595566217 467038208 286 33554432000 134512640 134534564 4291585024 18446744073709551615 134530630 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/20504/statm: 114023 286 95 6 0 112689 0
[pid=20505] ppid=20501 vsize=7640 CPUtime=6.29 cores=3
/proc/20505/stat : 20505 (lingeling) R 20501 20501 18457 0 -1 4202496 1951 0 0 0 629 0 0 0 25 0 1 0 595566217 7823360 1104 33554432000 4194304 4352236 140736102300624 18446744073709551615 4329024 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/20505/statm: 1910 1104 127 39 0 990 0
[pid=20506] ppid=20501 vsize=8436 CPUtime=3.1 cores=7
/proc/20506/stat : 20506 (march_hi) R 20501 20501 18457 0 -1 4202496 696 0 0 0 310 0 0 0 25 0 1 0 595566217 8638464 576 33554432000 4194304 4331988 140735762339696 18446744073709551615 4299264 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/20506/statm: 2109 576 175 34 0 551 0
Current children cumulated CPU time (s) 25.12
Current children cumulated vsize (KiB) 695904

[startup+12.7011 s]
/proc/loadavg: 5.05 5.15 6.37 6/177 20507
/proc/meminfo: memFree=18438804/32950928 swapFree=67111524/67111528
[pid=20501] ppid=20499 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/20501/stat : 20501 (ppfolio) S 20499 20501 18457 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 595566217 18763776 390 33554432000 4194304 4287625 140734455406016 18446744073709551615 256415411727 0 0 4096 65536 374010979110879231 0 0 17 1 0 0 0
/proc/20501/statm: 4581 390 341 23 0 91 0
[pid=20502] ppid=20501 vsize=11818216 CPUtime=12.69 cores=1
/proc/20502/stat : 20502 (cryptominisat) R 20501 20501 18457 0 -1 4202496 13513 0 0 0 1268 1 0 0 25 0 1 0 595566217 12101853184 4704 33554432000 4194304 4587354 140735636101328 18446744073709551615 4237695 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/20502/statm: 2954554 4704 337 96 0 2951116 0
[pid=20503] ppid=20501 vsize=17344 CPUtime=12.69 cores=5
/proc/20503/stat : 20503 (clasp) R 20501 20501 18457 0 -1 4202496 1766 0 0 0 1269 0 0 0 25 0 1 0 595566217 17760256 1657 33554432000 4194304 4785740 140736061700576 18446744073709551615 4553380 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/20503/statm: 4336 1657 340 145 0 1381 0
[pid=20504] ppid=20501 vsize=456092 CPUtime=6.32 cores=7
/proc/20504/stat : 20504 (TNM) R 20501 20501 18457 0 -1 4202496 389 0 0 0 632 0 0 0 25 0 1 0 595566217 467038208 286 33554432000 134512640 134534564 4291585024 18446744073709551615 134530632 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/20504/statm: 114023 286 95 6 0 112689 0
[pid=20505] ppid=20501 vsize=10332 CPUtime=12.69 cores=3
/proc/20505/stat : 20505 (lingeling) R 20501 20501 18457 0 -1 4202496 3168 0 0 0 1269 0 0 0 25 0 1 0 595566217 10579968 1777 33554432000 4194304 4352236 140736102300624 18446744073709551615 4328194 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/20505/statm: 2583 1777 127 39 0 1663 0
[pid=20506] ppid=20501 vsize=8948 CPUtime=6.3 cores=7
/proc/20506/stat : 20506 (march_hi) R 20501 20501 18457 0 -1 4202496 884 0 0 0 630 0 0 0 25 0 1 0 595566217 9162752 764 33554432000 4194304 4331988 140735762339696 18446744073709551615 4226260 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/20506/statm: 2237 764 175 34 0 679 0
Current children cumulated CPU time (s) 50.69
Current children cumulated vsize (KiB) 12329256

[startup+25.5007 s]
/proc/loadavg: 5.04 5.14 6.34 6/177 20507
/proc/meminfo: memFree=18431728/32950928 swapFree=67111524/67111528
[pid=20501] ppid=20499 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/20501/stat : 20501 (ppfolio) S 20499 20501 18457 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 595566217 18763776 390 33554432000 4194304 4287625 140734455406016 18446744073709551615 256415411727 0 0 4096 65536 374010979110879231 0 0 17 1 0 0 0
/proc/20501/statm: 4581 390 341 23 0 91 0
[pid=20502] ppid=20501 vsize=206500 CPUtime=25.49 cores=1
/proc/20502/stat : 20502 (cryptominisat) R 20501 20501 18457 0 -1 4202496 21645 0 0 0 2547 2 0 0 25 0 1 0 595566217 211456000 6091 33554432000 4194304 4587354 140735636101328 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/20502/statm: 51625 6091 337 96 0 48187 0
[pid=20503] ppid=20501 vsize=19252 CPUtime=25.49 cores=5
/proc/20503/stat : 20503 (clasp) R 20501 20501 18457 0 -1 4202496 2194 0 0 0 2549 0 0 0 25 0 1 0 595566217 19714048 2085 33554432000 4194304 4785740 140736061700576 18446744073709551615 4287017 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/20503/statm: 4813 2085 340 145 0 1858 0
[pid=20504] ppid=20501 vsize=456092 CPUtime=12.72 cores=7
/proc/20504/stat : 20504 (TNM) R 20501 20501 18457 0 -1 4202496 389 0 0 0 1272 0 0 0 25 0 1 0 595566217 467038208 286 33554432000 134512640 134534564 4291585024 18446744073709551615 134528955 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/20504/statm: 114023 286 95 6 0 112689 0
[pid=20505] ppid=20501 vsize=8672 CPUtime=25.49 cores=3
/proc/20505/stat : 20505 (lingeling) R 20501 20501 18457 0 -1 4202496 4481 0 0 0 2548 1 0 0 25 0 1 0 595566217 8880128 1362 33554432000 4194304 4352236 140736102300624 18446744073709551615 4328116 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/20505/statm: 2168 1362 127 39 0 1248 0
[pid=20506] ppid=20501 vsize=10864 CPUtime=12.63 cores=7
/proc/20506/stat : 20506 (march_hi) R 20501 20501 18457 0 -1 4202496 1213 0 0 0 1263 0 0 0 25 0 1 0 595566217 11124736 1093 33554432000 4194304 4331988 140735762339696 18446744073709551615 4299264 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/20506/statm: 2716 1093 175 34 0 1158 0
Current children cumulated CPU time (s) 101.82
Current children cumulated vsize (KiB) 719704

[startup+51.1009 s]
/proc/loadavg: 5.10 5.15 6.31 6/177 20508
/proc/meminfo: memFree=18412628/32950928 swapFree=67111524/67111528
[pid=20501] ppid=20499 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/20501/stat : 20501 (ppfolio) S 20499 20501 18457 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 595566217 18763776 390 33554432000 4194304 4287625 140734455406016 18446744073709551615 256415411727 0 0 4096 65536 374010979110879231 0 0 17 1 0 0 0
/proc/20501/statm: 4581 390 341 23 0 91 0
[pid=20502] ppid=20501 vsize=208952 CPUtime=51.08 cores=1
/proc/20502/stat : 20502 (cryptominisat) R 20501 20501 18457 0 -1 4202496 29906 0 0 0 5105 3 0 0 25 0 1 0 595566217 213966848 8690 33554432000 4194304 4587354 140735636101328 18446744073709551615 4238568 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/20502/statm: 52238 8690 337 96 0 48800 0
[pid=20503] ppid=20501 vsize=21392 CPUtime=51.09 cores=5
/proc/20503/stat : 20503 (clasp) R 20501 20501 18457 0 -1 4202496 2680 0 0 0 5109 0 0 0 25 0 1 0 595566217 21905408 2571 33554432000 4194304 4785740 140736061700576 18446744073709551615 4287244 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/20503/statm: 5348 2571 341 145 0 2393 0
[pid=20504] ppid=20501 vsize=456092 CPUtime=25.42 cores=7
/proc/20504/stat : 20504 (TNM) R 20501 20501 18457 0 -1 4202496 389 0 0 0 2542 0 0 0 25 0 1 0 595566217 467038208 286 33554432000 134512640 134534564 4291585024 18446744073709551615 134528288 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/20504/statm: 114023 286 95 6 0 112689 0
[pid=20505] ppid=20501 vsize=11876 CPUtime=51.09 cores=3

################
# More data... #
################

/proc/20506/statm: 24967 21542 175 34 0 23409 0
Current children cumulated CPU time (s) 3524.44
Current children cumulated vsize (KiB) 859508

[startup+942.301 s]
/proc/loadavg: 5.20 5.13 5.56 6/177 20532
/proc/meminfo: memFree=18242484/32950928 swapFree=67111524/67111528
[pid=20501] ppid=20499 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/20501/stat : 20501 (ppfolio) S 20499 20501 18457 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 595566217 18763776 390 33554432000 4194304 4287625 140734455406016 18446744073709551615 256415411727 0 0 4096 65536 374010979110879231 0 0 17 1 0 0 0
/proc/20501/statm: 4581 390 341 23 0 91 0
[pid=20502] ppid=20501 vsize=264020 CPUtime=942.29 cores=1
/proc/20502/stat : 20502 (cryptominisat) R 20501 20501 18457 0 -1 4202496 202459 0 0 0 94157 72 0 0 25 0 1 0 595566217 270356480 22020 33554432000 4194304 4587354 140735636101328 18446744073709551615 4238481 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/20502/statm: 66005 22020 337 96 0 62567 0
[pid=20503] ppid=20501 vsize=37272 CPUtime=942.32 cores=5
/proc/20503/stat : 20503 (clasp) R 20501 20501 18457 0 -1 4202496 6411 0 0 0 94231 1 0 0 25 0 1 0 595566217 38166528 6302 33554432000 4194304 4785740 140736061700576 18446744073709551615 4287038 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/20503/statm: 9318 6302 341 145 0 6363 0
[pid=20504] ppid=20501 vsize=456092 CPUtime=468.65 cores=7
/proc/20504/stat : 20504 (TNM) R 20501 20501 18457 0 -1 4202496 389 0 0 0 46865 0 0 0 25 0 1 0 595566217 467038208 286 33554432000 134512640 134534564 4291585024 18446744073709551615 134530549 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/20504/statm: 114023 286 95 6 0 112689 0
[pid=20505] ppid=20501 vsize=30124 CPUtime=942.33 cores=3
/proc/20505/stat : 20505 (lingeling) R 20501 20501 18457 0 -1 4202496 65316 0 0 0 94223 10 0 0 25 0 1 0 595566217 30846976 6725 33554432000 4194304 4352236 140736102300624 18446744073709551615 4328194 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/20505/statm: 7531 6725 127 39 0 6611 0
[pid=20506] ppid=20501 vsize=99868 CPUtime=468.53 cores=7
/proc/20506/stat : 20506 (march_hi) R 20501 20501 18457 0 -1 4202496 22914 0 0 0 46842 11 0 0 25 0 1 0 595566217 102264832 22794 33554432000 4194304 4331988 140735762339696 18446744073709551615 4226560 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/20506/statm: 24967 22794 175 34 0 23409 0
Current children cumulated CPU time (s) 3764.12
Current children cumulated vsize (KiB) 905700

[startup+1002.3 s]
/proc/loadavg: 5.14 5.12 5.52 6/177 20533
/proc/meminfo: memFree=18243560/32950928 swapFree=67111524/67111528
[pid=20501] ppid=20499 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/20501/stat : 20501 (ppfolio) S 20499 20501 18457 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 595566217 18763776 390 33554432000 4194304 4287625 140734455406016 18446744073709551615 256415411727 0 0 4096 65536 374010979110879231 0 0 17 1 0 0 0
/proc/20501/statm: 4581 390 341 23 0 91 0
[pid=20502] ppid=20501 vsize=256380 CPUtime=1002.29 cores=1
/proc/20502/stat : 20502 (cryptominisat) R 20501 20501 18457 0 -1 4202496 203389 0 0 0 100156 73 0 0 25 0 1 0 595566217 262533120 22369 33554432000 4194304 4587354 140735636101328 18446744073709551615 4238668 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/20502/statm: 64095 22369 337 96 0 60657 0
[pid=20503] ppid=20501 vsize=37480 CPUtime=1002.32 cores=5
/proc/20503/stat : 20503 (clasp) R 20501 20501 18457 0 -1 4202496 6470 0 0 0 100231 1 0 0 25 0 1 0 595566217 38379520 6361 33554432000 4194304 4785740 140736061700576 18446744073709551615 4287076 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/20503/statm: 9370 6361 341 145 0 6415 0
[pid=20504] ppid=20501 vsize=456092 CPUtime=498.44 cores=7
/proc/20504/stat : 20504 (TNM) R 20501 20501 18457 0 -1 4202496 389 0 0 0 49844 0 0 0 25 0 1 0 595566217 467038208 286 33554432000 134512640 134534564 4291585024 18446744073709551615 134530367 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/20504/statm: 114023 286 95 6 0 112689 0
[pid=20505] ppid=20501 vsize=22956 CPUtime=1002.33 cores=3
/proc/20505/stat : 20505 (lingeling) R 20501 20501 18457 0 -1 4202496 66692 0 0 0 100223 10 0 0 25 0 1 0 595566217 23506944 4933 33554432000 4194304 4352236 140736102300624 18446744073709551615 4328194 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/20505/statm: 5739 4933 127 39 0 4819 0
[pid=20506] ppid=20501 vsize=144068 CPUtime=498.41 cores=7
/proc/20506/stat : 20506 (march_hi) R 20501 20501 18457 0 -1 4202496 24100 0 0 0 49829 12 0 0 25 0 1 0 595566217 147525632 23980 33554432000 4194304 4331988 140735762339696 18446744073709551615 4212625 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/20506/statm: 36017 23980 175 34 0 34459 0
Current children cumulated CPU time (s) 4003.79
Current children cumulated vsize (KiB) 935300

[startup+1062.3 s]
/proc/loadavg: 5.15 5.12 5.50 6/177 20535
/proc/meminfo: memFree=18224432/32950928 swapFree=67111524/67111528
[pid=20501] ppid=20499 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/20501/stat : 20501 (ppfolio) S 20499 20501 18457 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 595566217 18763776 390 33554432000 4194304 4287625 140734455406016 18446744073709551615 256415411727 0 0 4096 65536 374010979110879231 0 0 17 1 0 0 0
/proc/20501/statm: 4581 390 341 23 0 91 0
[pid=20502] ppid=20501 vsize=364288 CPUtime=1062.29 cores=1
/proc/20502/stat : 20502 (cryptominisat) R 20501 20501 18457 0 -1 4202496 207789 0 0 0 106154 75 0 0 25 0 1 0 595566217 373030912 25752 33554432000 4194304 4587354 140735636101328 18446744073709551615 4239234 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/20502/statm: 91072 25752 337 96 0 87634 0
[pid=20503] ppid=20501 vsize=37736 CPUtime=1062.32 cores=5
/proc/20503/stat : 20503 (clasp) R 20501 20501 18457 0 -1 4202496 6551 0 0 0 106231 1 0 0 25 0 1 0 595566217 38641664 6442 33554432000 4194304 4785740 140736061700576 18446744073709551615 4286912 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/20503/statm: 9434 6442 341 145 0 6479 0
[pid=20504] ppid=20501 vsize=456092 CPUtime=528.32 cores=7
/proc/20504/stat : 20504 (TNM) R 20501 20501 18457 0 -1 4202496 389 0 0 0 52832 0 0 0 25 0 1 0 595566217 467038208 286 33554432000 134512640 134534564 4291585024 18446744073709551615 134528730 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/20504/statm: 114023 286 95 6 0 112689 0
[pid=20505] ppid=20501 vsize=24876 CPUtime=1062.32 cores=3
/proc/20505/stat : 20505 (lingeling) R 20501 20501 18457 0 -1 4202496 70596 0 0 0 106222 10 0 0 25 0 1 0 595566217 25473024 5413 33554432000 4194304 4352236 140736102300624 18446744073709551615 4328026 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/20505/statm: 6219 5413 127 39 0 5299 0
[pid=20506] ppid=20501 vsize=144068 CPUtime=528.22 cores=7
/proc/20506/stat : 20506 (march_hi) R 20501 20501 18457 0 -1 4202496 25237 0 0 0 52809 13 0 0 25 0 1 0 595566217 147525632 25117 33554432000 4194304 4331988 140735762339696 18446744073709551615 4299275 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/20506/statm: 36017 25117 175 34 0 34459 0
Current children cumulated CPU time (s) 4243.47
Current children cumulated vsize (KiB) 1045384

[startup+1122.3 s]
/proc/loadavg: 5.13 5.12 5.47 6/177 20537
/proc/meminfo: memFree=18220796/32950928 swapFree=67111524/67111528
[pid=20501] ppid=20499 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/20501/stat : 20501 (ppfolio) S 20499 20501 18457 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 595566217 18763776 390 33554432000 4194304 4287625 140734455406016 18446744073709551615 256415411727 0 0 4096 65536 374010979110879231 0 0 17 1 0 0 0
/proc/20501/statm: 4581 390 341 23 0 91 0
[pid=20502] ppid=20501 vsize=347944 CPUtime=1122.29 cores=1
/proc/20502/stat : 20502 (cryptominisat) R 20501 20501 18457 0 -1 4202496 209578 0 0 0 112152 77 0 0 25 0 1 0 595566217 356294656 22371 33554432000 4194304 4587354 140735636101328 18446744073709551615 4238600 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/20502/statm: 86986 22371 337 96 0 83548 0
[pid=20503] ppid=20501 vsize=38240 CPUtime=1122.32 cores=5
/proc/20503/stat : 20503 (clasp) R 20501 20501 18457 0 -1 4202496 6630 0 0 0 112231 1 0 0 25 0 1 0 595566217 39157760 6521 33554432000 4194304 4785740 140736061700576 18446744073709551615 4287158 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/20503/statm: 9560 6521 341 145 0 6605 0
[pid=20504] ppid=20501 vsize=456092 CPUtime=558.13 cores=7
/proc/20504/stat : 20504 (TNM) R 20501 20501 18457 0 -1 4202496 389 0 0 0 55813 0 0 0 25 0 1 0 595566217 467038208 286 33554432000 134512640 134534564 4291585024 18446744073709551615 134528523 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/20504/statm: 114023 286 95 6 0 112689 0
[pid=20505] ppid=20501 vsize=34604 CPUtime=1122.32 cores=3
/proc/20505/stat : 20505 (lingeling) R 20501 20501 18457 0 -1 4202496 74148 0 0 0 112222 10 0 0 25 0 1 0 595566217 35434496 7845 33554432000 4194304 4352236 140736102300624 18446744073709551615 4329165 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/20505/statm: 8651 7845 127 39 0 7731 0
[pid=20506] ppid=20501 vsize=147984 CPUtime=558.07 cores=7
/proc/20506/stat : 20506 (march_hi) R 20501 20501 18457 0 -1 4202496 26733 0 0 0 55793 14 0 0 25 0 1 0 595566217 151535616 26613 33554432000 4194304 4331988 140735762339696 18446744073709551615 4210516 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/20506/statm: 36996 26613 175 34 0 35438 0
Current children cumulated CPU time (s) 4483.13
Current children cumulated vsize (KiB) 1043188

[startup+1182.3 s]
/proc/loadavg: 5.10 5.11 5.44 6/177 20538
/proc/meminfo: memFree=18225840/32950928 swapFree=67111524/67111528
[pid=20501] ppid=20499 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/20501/stat : 20501 (ppfolio) S 20499 20501 18457 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 595566217 18763776 390 33554432000 4194304 4287625 140734455406016 18446744073709551615 256415411727 0 0 4096 65536 374010979110879231 0 0 17 1 0 0 0
/proc/20501/statm: 4581 390 341 23 0 91 0
[pid=20502] ppid=20501 vsize=256380 CPUtime=1182.29 cores=1
/proc/20502/stat : 20502 (cryptominisat) R 20501 20501 18457 0 -1 4202496 210697 0 0 0 118151 78 0 0 25 0 1 0 595566217 262533120 22374 33554432000 4194304 4587354 140735636101328 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/20502/statm: 64095 22374 337 96 0 60657 0
[pid=20503] ppid=20501 vsize=38492 CPUtime=1182.32 cores=5
/proc/20503/stat : 20503 (clasp) R 20501 20501 18457 0 -1 4202496 6678 0 0 0 118231 1 0 0 25 0 1 0 595566217 39415808 6569 33554432000 4194304 4785740 140736061700576 18446744073709551615 4287055 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/20503/statm: 9623 6569 341 145 0 6668 0
[pid=20504] ppid=20501 vsize=456092 CPUtime=587.98 cores=7
/proc/20504/stat : 20504 (TNM) R 20501 20501 18457 0 -1 4202496 389 0 0 0 58798 0 0 0 25 0 1 0 595566217 467038208 286 33554432000 134512640 134534564 4291585024 18446744073709551615 134528511 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/20504/statm: 114023 286 95 6 0 112689 0
[pid=20505] ppid=20501 vsize=22956 CPUtime=1182.33 cores=3
/proc/20505/stat : 20505 (lingeling) R 20501 20501 18457 0 -1 4202496 76036 0 0 0 118222 11 0 0 25 0 1 0 595566217 23506944 4933 33554432000 4194304 4352236 140736102300624 18446744073709551615 4329205 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/20505/statm: 5739 4933 127 39 0 4819 0
[pid=20506] ppid=20501 vsize=147984 CPUtime=587.91 cores=7
/proc/20506/stat : 20506 (march_hi) R 20501 20501 18457 0 -1 4202496 28148 0 0 0 58776 15 0 0 25 0 1 0 595566217 151535616 28028 33554432000 4194304 4331988 140735762339696 18446744073709551615 4210468 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/20506/statm: 36996 28028 175 34 0 35438 0
Current children cumulated CPU time (s) 4722.83
Current children cumulated vsize (KiB) 940228



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.7 s]
/proc/loadavg: 5.07 5.10 5.43 6/177 20539
/proc/meminfo: memFree=18212308/32950928 swapFree=67111524/67111528
[pid=20501] ppid=20499 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/20501/stat : 20501 (ppfolio) S 20499 20501 18457 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 595566217 18763776 390 33554432000 4194304 4287625 140734455406016 18446744073709551615 256415411727 0 0 4096 65536 374010979110879231 0 0 17 1 0 0 0
/proc/20501/statm: 4581 390 341 23 0 91 0
[pid=20502] ppid=20501 vsize=256380 CPUtime=1201.69 cores=1
/proc/20502/stat : 20502 (cryptominisat) R 20501 20501 18457 0 -1 4202496 211352 0 0 0 120091 78 0 0 25 0 1 0 595566217 262533120 23014 33554432000 4194304 4587354 140735636101328 18446744073709551615 4232088 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/20502/statm: 64095 23014 337 96 0 60657 0
[pid=20503] ppid=20501 vsize=38492 CPUtime=1201.73 cores=5
/proc/20503/stat : 20503 (clasp) R 20501 20501 18457 0 -1 4202496 6682 0 0 0 120172 1 0 0 25 0 1 0 595566217 39415808 6573 33554432000 4194304 4785740 140736061700576 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/20503/statm: 9623 6573 341 145 0 6668 0
[pid=20504] ppid=20501 vsize=456092 CPUtime=597.63 cores=7
/proc/20504/stat : 20504 (TNM) R 20501 20501 18457 0 -1 4202496 389 0 0 0 59763 0 0 0 25 0 1 0 595566217 467038208 286 33554432000 134512640 134534564 4291585024 18446744073709551615 134528737 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/20504/statm: 114023 286 95 6 0 112689 0
[pid=20505] ppid=20501 vsize=33068 CPUtime=1201.74 cores=3
/proc/20505/stat : 20505 (lingeling) R 20501 20501 18457 0 -1 4202496 78564 0 0 0 120163 11 0 0 25 0 1 0 595566217 33861632 7461 33554432000 4194304 4352236 140736102300624 18446744073709551615 4328194 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/20505/statm: 8267 7461 127 39 0 7347 0
[pid=20506] ppid=20501 vsize=147984 CPUtime=597.55 cores=7
/proc/20506/stat : 20506 (march_hi) R 20501 20501 18457 0 -1 4202496 28630 0 0 0 59740 15 0 0 25 0 1 0 595566217 151535616 28510 33554432000 4194304 4331988 140735762339696 18446744073709551615 4299282 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/20506/statm: 36996 28510 175 34 0 35438 0
Current children cumulated CPU time (s) 4800.34
Current children cumulated vsize (KiB) 950340

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 20501 and gives
#  childrusage.ru_utime.tv_sec=1201
#  childrusage.ru_utime.tv_usec=733308
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=28995
# CPU time returned by wait4() is 1201.76
# while last known CPU time is 4800.34
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1201.71
CPU time (s): 4800.34
CPU user time (s): 4799.29
CPU system time (s): 1.05
CPU usage (%): 399.458
Max. virtual memory (cumulated for all children) (KiB): 12330796

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1201.73
system time used= 0.028995
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 7218
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 443
involuntary context switches= 13781

runsolver used 1.72174 second user time and 4.83626 second system time

The end

Launcher Data 

Begin job on node115 at 2011-04-29 07:02:35
IDJOB=3191018
IDBENCH=82749
IDSOLVER=1612
FILE ID=node115/3191018-1304053355
RUNJOBID= node115-1304049737-19994
PBS_JOBID= 13170384
Free space on /tmp= 72732 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT11/random/medium/unif-k5-r21.3-v150-c3195-S207562876-057.UNKNOWN.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3191018-1304053355/watcher-3191018-1304053355 -o /tmp/evaluation-result-3191018-1304053355/solver-3191018-1304053355 -C 4800 -W 1300 -M 15500  ppfolio HOME/instance-3191018-1304053355.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 04148c6828d9f9ccd74e3efaedcb8c52
RANDOM SEED=3706325

node115.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.62
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      18472084 kB
Buffers:       2319084 kB
Cached:       11542060 kB
SwapCached:          4 kB
Active:        6812968 kB
Inactive:      7112232 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      18472084 kB
SwapTotal:    67111528 kB
SwapFree:     67111524 kB
Dirty:           10300 kB
Writeback:           0 kB
AnonPages:       63712 kB
Mapped:          14784 kB
Slab:           490140 kB
PageTables:       4168 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   185820 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72724 MiB
End job on node115 at 2011-04-29 07:22:39