Trace number 3715879

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
npSolver inc-topdown-quickBound? (TO) 1800.09 1800.82

General information on the benchmark

Name/SOFT-BIGINT-LIN/PB10/oliveras/j90/
normalized-j9015_10-unsat--soft-0-100-0.wbo
MD5SUM8a2cbb62b727a1b33685f0cffed53856
Bench CategorySOFT-BIGINT-LIN (only soft constraints, big integers, linear constraints)
Best result obtained on this benchmarkMOPT
Best cost obtained on this benchmark11
Best CPU time to get the best result obtained on this benchmark2.5926
Max-Satisfiable
Max-(Un)Satisfiability was proved
Best value of the cost
Optimality of the best cost was proved
Number of variables14196
Total number of constraints44553
Number of soft constraints44553
Number of constraints which are clauses44245
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints308
Minimum length of a constraint1
Maximum length of a constraint90
Top cost 2254044
Min constraint cost 1
Max constraint cost 100
Sum of constraints costs 2254043
Biggest number in a constraint 66
Number of bits of the biggest number in a constraint 7
Biggest sum of numbers in a constraint 565
Number of bits of the biggest sum of numbers10
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

4.39/4.45	c run usual solver
42.44/42.73	o 16367
42.44/42.73	c starting approximation
42.44/42.73	c factor = 2
42.44/42.73	c factor still to low - shrinking to 2202.72
42.44/42.73	c approx number of clauses: 1e+06
42.44/42.73	c current bound: 8183
121.15/121.44	c current bound: 8183
199.84/200.15	c current bound: 8183
280.74/281.21	c current bound: 8183
360.62/361.08	c current bound: 8183
440.26/440.73	c current bound: 8183
519.96/520.46	c current bound: 8183
599.58/600.10	c current bound: 8183
679.23/679.73	c current bound: 8183
758.97/759.47	c current bound: 8183
838.76/839.35	c current bound: 8183
918.26/918.95	c current bound: 8183
997.95/998.65	c current bound: 8183
1077.63/1078.34	c current bound: 8183
1157.28/1157.99	c current bound: 8183
1237.20/1237.93	c current bound: 8183
1316.95/1317.71	c current bound: 8183
1396.87/1397.65	c current bound: 8183
1476.67/1477.44	c current bound: 8183
1556.44/1557.24	c current bound: 8183
1636.26/1637.07	c current bound: 8183
1716.07/1716.89	c current bound: 8183
1795.84/1796.67	c current bound: 8183
1800.09/1800.81	c error: unexpected solver exit code
1800.09/1800.81	s UNKNOWN

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3715879-1338215431/watcher-3715879-1338215431 -o /tmp/evaluation-result-3715879-1338215431/solver-3715879-1338215431 -C 1800 -W 1900 -M 15500 HOME/npSolver-wbo-Itdqb.sh HOME/instance-3715879-1338215431.wbo 1383540514 HOME HOME 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.29 2.33 2.27 4/177 25093
/proc/meminfo: memFree=29753104/32873648 swapFree=7368/7368
[pid=25093] ppid=25091 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/25093/stat : 25093 (npSolver-wbo-It) S 25091 25093 20320 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 287667180 9367552 274 33554432000 4194304 5064252 140736322243824 140736322242736 251052844622 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/25093/statm: 2287 274 233 213 0 72 0

[startup+0.101768 s]
/proc/loadavg: 2.29 2.33 2.27 4/177 25093
/proc/meminfo: memFree=29753104/32873648 swapFree=7368/7368
[pid=25093] ppid=25091 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/25093/stat : 25093 (npSolver-wbo-It) S 25091 25093 20320 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 287667180 9367552 274 33554432000 4194304 5064252 140736322243824 140736322242736 251052844622 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/25093/statm: 2287 274 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.200269 s]
/proc/loadavg: 2.29 2.33 2.27 4/177 25093
/proc/meminfo: memFree=29753104/32873648 swapFree=7368/7368
[pid=25093] ppid=25091 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/25093/stat : 25093 (npSolver-wbo-It) S 25091 25093 20320 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 287667180 9367552 274 33554432000 4194304 5064252 140736322243824 140736322242736 251052844622 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/25093/statm: 2287 274 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.300301 s]
/proc/loadavg: 2.29 2.33 2.27 4/177 25093
/proc/meminfo: memFree=29753104/32873648 swapFree=7368/7368
[pid=25093] ppid=25091 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/25093/stat : 25093 (npSolver-wbo-It) S 25091 25093 20320 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 287667180 9367552 274 33554432000 4194304 5064252 140736322243824 140736322242736 251052844622 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/25093/statm: 2287 274 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.70027 s]
/proc/loadavg: 2.29 2.33 2.27 4/177 25093
/proc/meminfo: memFree=29753104/32873648 swapFree=7368/7368
[pid=25093] ppid=25091 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/25093/stat : 25093 (npSolver-wbo-It) S 25091 25093 20320 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 287667180 9367552 274 33554432000 4194304 5064252 140736322243824 140736322242736 251052844622 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/25093/statm: 2287 274 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+1.50025 s]
/proc/loadavg: 2.29 2.33 2.27 3/180 25096
/proc/meminfo: memFree=29587464/32873648 swapFree=7368/7368
[pid=25093] ppid=25091 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/25093/stat : 25093 (npSolver-wbo-It) S 25091 25093 20320 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 287667180 9367552 274 33554432000 4194304 5064252 140736322243824 140736322242736 251052844622 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/25093/statm: 2287 274 233 213 0 72 0
[pid=25094] ppid=25093 vsize=166464 CPUtime=1.49 cores=0,2,4,6
/proc/25094/stat : 25094 (npSolver-wbo) R 25093 25093 20320 0 -1 4202496 7580 0 0 0 145 4 0 0 20 0 1 0 287667181 170459136 33595 33554432000 4194304 5990268 140736592373696 140736592369576 4401317 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/25094/statm: 41616 33595 145 439 0 41173 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 175612

[startup+3.10022 s]
/proc/loadavg: 2.29 2.33 2.27 3/182 25098
/proc/meminfo: memFree=29383988/32873648 swapFree=7368/7368
[pid=25093] ppid=25091 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/25093/stat : 25093 (npSolver-wbo-It) S 25091 25093 20320 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 287667180 9367552 274 33554432000 4194304 5064252 140736322243824 140736322242736 251052844622 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/25093/statm: 2287 274 233 213 0 72 0
[pid=25094] ppid=25093 vsize=166464 CPUtime=3.09 cores=0,2,4,6
/proc/25094/stat : 25094 (npSolver-wbo) R 25093 25093 20320 0 -1 4202496 7580 0 0 0 305 4 0 0 20 0 1 0 287667181 170459136 33595 33554432000 4194304 5990268 140736592373696 140736592369576 4523105 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/25094/statm: 41616 33595 145 439 0 41173 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 175612

[startup+6.3004 s]
/proc/loadavg: 2.27 2.33 2.27 3/184 25100
/proc/meminfo: memFree=28816116/32873648 swapFree=7368/7368
[pid=25093] ppid=25091 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/25093/stat : 25093 (npSolver-wbo-It) S 25091 25093 20320 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 287667180 9367552 274 33554432000 4194304 5064252 140736322243824 140736322242736 251052844622 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/25093/statm: 2287 274 233 213 0 72 0
[pid=25094] ppid=25093 vsize=232000 CPUtime=4.52 cores=0,2,4,6
/proc/25094/stat : 25094 (npSolver-wbo) S 25093 25093 20320 0 -1 4202496 8711 0 0 0 429 23 0 0 20 0 1 0 287667181 237568000 38211 33554432000 4194304 5990268 140736592373696 140736592366848 5173822 0 65536 4102 0 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/25094/statm: 58000 38211 153 439 0 57557 0
[pid=25099] ppid=25094 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/25099/stat : 25099 (cp2_pre.sh) S 25094 25093 20320 0 -1 4202496 608 0 0 0 0 0 0 0 20 0 1 0 287667633 9367552 277 33554432000 4194304 5064252 140737349210592 140737349209296 251052844622 0 65536 4100 65538 18446744071579302229 0 0 17 6 0 0 0 0 0
/proc/25099/statm: 2287 277 234 213 0 72 0
[pid=25100] ppid=25099 vsize=546328 CPUtime=1.76 cores=0,2,4,6
/proc/25100/stat : 25100 (coprocessor) R 25099 25093 20320 0 -1 4202496 42288 0 0 0 164 12 0 0 20 0 1 0 287667634 559439872 116876 33554432000 4194304 6586260 140736826966560 140736826962824 5631619 0 0 4096 8404994 0 0 0 17 2 0 0 0 0 0
/proc/25100/statm: 136582 116876 164 584 0 135994 0
Current children cumulated CPU time (s) 6.28
Current children cumulated vsize (KiB) 796624

[startup+12.7003 s]
/proc/loadavg: 2.25 2.32 2.27 3/182 25107
/proc/meminfo: memFree=28739248/32873648 swapFree=7368/7368
[pid=25093] ppid=25091 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/25093/stat : 25093 (npSolver-wbo-It) S 25091 25093 20320 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 287667180 9367552 274 33554432000 4194304 5064252 140736322243824 140736322242736 251052844622 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/25093/statm: 2287 274 233 213 0 72 0
[pid=25094] ppid=25093 vsize=232000 CPUtime=4.52 cores=0,2,4,6
/proc/25094/stat : 25094 (npSolver-wbo) S 25093 25093 20320 0 -1 4202496 8711 0 0 0 429 23 0 0 20 0 1 0 287667181 237568000 38211 33554432000 4194304 5990268 140736592373696 140736592366848 5173822 0 65536 4102 0 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/25094/statm: 58000 38211 153 439 0 57557 0
[pid=25099] ppid=25094 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/25099/stat : 25099 (cp2_pre.sh) S 25094 25093 20320 0 -1 4202496 608 0 0 0 0 0 0 0 20 0 1 0 287667633 9367552 277 33554432000 4194304 5064252 140737349210592 140737349209296 251052844622 0 65536 4100 65538 18446744071579302229 0 0 17 6 0 0 0 0 0
/proc/25099/statm: 2287 277 234 213 0 72 0
[pid=25100] ppid=25099 vsize=736244 CPUtime=8.15 cores=0,2,4,6
/proc/25100/stat : 25100 (coprocessor) R 25099 25093 20320 0 -1 4202496 71204 0 0 0 798 17 0 0 20 0 1 0 287667634 753913856 178491 33554432000 4194304 6586260 140736826966560 140736826962424 5599454 0 0 4096 8404994 0 0 0 17 2 0 0 0 0 0
/proc/25100/statm: 184061 178491 189 584 0 183473 0
Current children cumulated CPU time (s) 12.67
Current children cumulated vsize (KiB) 986540

[startup+25.5004 s]
/proc/loadavg: 2.19 2.31 2.27 3/185 25211
/proc/meminfo: memFree=28710212/32873648 swapFree=7368/7368
[pid=25093] ppid=25091 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/25093/stat : 25093 (npSolver-wbo-It) S 25091 25093 20320 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 287667180 9367552 274 33554432000 4194304 5064252 140736322243824 140736322242736 251052844622 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/25093/statm: 2287 274 233 213 0 72 0
[pid=25094] ppid=25093 vsize=232000 CPUtime=4.52 cores=0,2,4,6
/proc/25094/stat : 25094 (npSolver-wbo) S 25093 25093 20320 0 -1 4202496 8711 0 0 0 429 23 0 0 20 0 1 0 287667181 237568000 38211 33554432000 4194304 5990268 140736592373696 140736592366848 5173822 0 65536 4102 0 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/25094/statm: 58000 38211 153 439 0 57557 0
[pid=25099] ppid=25094 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/25099/stat : 25099 (cp2_pre.sh) S 25094 25093 20320 0 -1 4202496 608 0 0 0 0 0 0 0 20 0 1 0 287667633 9367552 277 33554432000 4194304 5064252 140737349210592 140737349209296 251052844622 0 65536 4100 65538 18446744071579302229 0 0 17 6 0 0 0 0 0
/proc/25099/statm: 2287 277 234 213 0 72 0
[pid=25100] ppid=25099 vsize=736376 CPUtime=20.95 cores=0,2,4,6
/proc/25100/stat : 25100 (coprocessor) R 25099 25093 20320 0 -1 4202496 71249 0 0 0 2078 17 0 0 20 0 1 0 287667634 754049024 178536 33554432000 4194304 6586260 140736826966560 140736826961880 5599492 0 0 4096 8404994 0 0 0 17 2 0 0 0 0 0
/proc/25100/statm: 184094 178536 189 584 0 183506 0
Current children cumulated CPU time (s) 25.47
Current children cumulated vsize (KiB) 986672

[startup+51.1004 s]
/proc/loadavg: 2.13 2.28 2.26 2/183 25417
/proc/meminfo: memFree=28989912/32873648 swapFree=7368/7368
[pid=25093] ppid=25091 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/25093/stat : 25093 (npSolver-wbo-It) S 25091 25093 20320 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 287667180 9367552 274 33554432000 4194304 5064252 140736322243824 140736322242736 251052844622 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/25093/statm: 2287 274 233 213 0 72 0
[pid=25094] ppid=25093 vsize=233840 CPUtime=42.67 cores=0,2,4,6
/proc/25094/stat : 25094 (npSolver-wbo) S 25093 25093 20320 0 -1 4202496 12316 133564 0 0 516 366 3316 69 20 0 1 0 287667181 239452160 38312 33554432000 4194304 5990268 140736592373696 140736592365104 5173822 0 65536 4102 0 18446744071579302229 0 0 17 2 0 0 12 0 0
/proc/25094/statm: 58460 38312 176 439 0 58017 0
[pid=25357] ppid=25094 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/25357/stat : 25357 (satsolver.sh) S 25094 25093 20320 0 -1 4202496 596 0 0 0 0 0 0 0 20 0 1 0 287671463 9367552 266 33554432000 4194304 5064252 140734094404768 140734094403680 251052844622 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/25357/statm: 2287 266 226 213 0 72 0
[pid=25358] ppid=25357 vsize=385596 CPUtime=8.25 cores=0,2,4,6
/proc/25358/stat : 25358 (glucose) R 25357 25093 20320 0 -1 4202496 54901 0 0 0 814 11 0 0 20 0 1 0 287671464 394850304 80755 33554432000 4194304 5208918 140735983569536 140735983567208 4211570 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/25358/statm: 96399 80755 95 248 0 96148 0
Current children cumulated CPU time (s) 50.92
Current children cumulated vsize (KiB) 637732

[startup+102.3 s]
/proc/loadavg: 2.05 2.23 2.24 3/184 25844
/proc/meminfo: memFree=28998540/32873648 swapFree=7368/7368
[pid=25093] ppid=25091 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/25093/stat : 25093 (npSolver-wbo-It) S 25091 25093 20320 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 287667180 9367552 274 33554432000 4194304 5064252 140736322243824 140736322242736 251052844622 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/25093/statm: 2287 274 233 213 0 72 0
[pid=25094] ppid=25093 vsize=233840 CPUtime=42.67 cores=0,2,4,6
/proc/25094/stat : 25094 (npSolver-wbo) S 25093 25093 20320 0 -1 4202496 12316 133564 0 0 516 366 3316 69 20 0 1 0 287667181 239452160 38312 33554432000 4194304 5990268 140736592373696 140736592365104 5173822 0 65536 4102 0 18446744071579302229 0 0 17 2 0 0 12 0 0
/proc/25094/statm: 58460 38312 176 439 0 58017 0
[pid=25357] ppid=25094 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/25357/stat : 25357 (satsolver.sh) S 25094 25093 20320 0 -1 4202496 596 0 0 0 0 0 0 0 20 0 1 0 287671463 9367552 266 33554432000 4194304 5064252 140734094404768 140734094403680 251052844622 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/25357/statm: 2287 266 226 213 0 72 0
[pid=25358] ppid=25357 vsize=385596 CPUtime=59.45 cores=0,2,4,6
/proc/25358/stat : 25358 (glucose) R 25357 25093 20320 0 -1 4202496 54935 0 0 0 5934 11 0 0 20 0 1 0 287671464 394850304 81300 33554432000 4194304 5208918 140735983569536 140735983567208 4211744 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/25358/statm: 96399 81300 95 248 0 96148 0
Current children cumulated CPU time (s) 102.12
Current children cumulated vsize (KiB) 637732

[startup+162.3 s]
/proc/loadavg: 1.94 2.17 2.22 3/183 26334
/proc/meminfo: memFree=28981060/32873648 swapFree=7368/7368
[pid=25093] ppid=25091 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/25093/stat : 25093 (npSolver-wbo-It) S 25091 25093 20320 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 287667180 9367552 274 33554432000 4194304 5064252 140736322243824 140736322242736 251052844622 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/25093/statm: 2287 274 233 213 0 72 0
[pid=25094] ppid=25093 vsize=246128 CPUtime=121.38 cores=0,2,4,6
/proc/25094/stat : 25094 (npSolver-wbo) S 25093 25093 20320 0 -1 4202496 15383 199014 0 0 533 367 11124 114 20 0 1 0 287667181 252035072 41011 33554432000 4194304 5990268 140736592373696 140736592365104 5173822 0 65536 4102 0 18446744071579302229 0 0 17 2 0 0 12 0 0
/proc/25094/statm: 61532 41011 177 439 0 61089 0
[pid=26008] ppid=25094 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/26008/stat : 26008 (satsolver.sh) S 25094 25093 20320 0 -1 4202496 597 0 0 0 0 0 0 0 20 0 1 0 287679335 9367552 267 33554432000 4194304 5064252 140735701199120 140735701198032 251052844622 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/26008/statm: 2287 267 226 213 0 72 0
[pid=26009] ppid=26008 vsize=385600 CPUtime=40.74 cores=0,2,4,6
/proc/26009/stat : 26009 (glucose) R 26008 25093 20320 0 -1 4202496 54940 0 0 0 4060 14 0 0 20 0 1 0 287679335 394854400 80932 33554432000 4194304 5208918 140736475312496 140736475310168 4211635 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/26009/statm: 96400 80932 95 248 0 96149 0
Current children cumulated CPU time (s) 162.12
Current children cumulated vsize (KiB) 650024

[startup+222.307 s]
/proc/loadavg: 2.06 2.17 2.21 3/184 26824
/proc/meminfo: memFree=28983908/32873648 swapFree=7368/7368
[pid=25093] ppid=25091 vsize=9148 CPUtime=0 cores=0,2,4,6

################
# More data... #
################

/proc/4120/stat : 4120 (glucose) R 4118 25093 20320 0 -1 4202496 55744 0 0 0 2441 13 0 0 20 0 1 0 287806956 394850304 80959 33554432000 4194304 5208918 140733556260752 140733556258424 4211553 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/4120/statm: 96399 80959 95 248 0 96148 0
Current children cumulated CPU time (s) 1421.65
Current children cumulated vsize (KiB) 650020

[startup+1482.3 s]
/proc/loadavg: 2.01 2.03 2.07 3/184 4801
/proc/meminfo: memFree=29007112/32873648 swapFree=7368/7368
[pid=25093] ppid=25091 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/25093/stat : 25093 (npSolver-wbo-It) S 25091 25093 20320 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 287667180 9367552 274 33554432000 4194304 5064252 140736322243824 140736322242736 251052844622 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/25093/statm: 2287 274 233 213 0 72 0
[pid=25094] ppid=25093 vsize=246128 CPUtime=1476.89 cores=0,2,4,6
/proc/25094/stat : 25094 (npSolver-wbo) S 25093 25093 20320 0 -1 4202496 67488 1303778 0 0 816 391 145621 861 20 0 1 0 287667181 252035072 41011 33554432000 4194304 5990268 140736592373696 140736592365104 5173822 0 65536 4102 0 18446744071579302229 0 0 17 2 0 0 12 0 0
/proc/25094/statm: 61532 41011 177 439 0 61089 0
[pid=4772] ppid=25094 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/4772/stat : 4772 (satsolver.sh) S 25094 25093 20320 0 -1 4202496 596 0 0 0 0 0 0 0 20 0 1 0 287814935 9367552 267 33554432000 4194304 5064252 140735749691248 140735749690160 251052844622 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/4772/statm: 2287 267 226 213 0 72 0
[pid=4773] ppid=4772 vsize=385596 CPUtime=4.74 cores=0,2,4,6
/proc/4773/stat : 4773 (glucose) R 4772 25093 20320 0 -1 4202496 54379 0 0 0 462 12 0 0 20 0 1 0 287814935 394850304 80739 33554432000 4194304 5208918 140733673726944 140733673724792 4211580 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/4773/statm: 96399 80739 95 248 0 96148 0
Current children cumulated CPU time (s) 1481.63
Current children cumulated vsize (KiB) 650020

[startup+1542.31 s]
/proc/loadavg: 2.02 2.03 2.07 3/183 5299
/proc/meminfo: memFree=28966840/32873648 swapFree=7368/7368
[pid=25093] ppid=25091 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/25093/stat : 25093 (npSolver-wbo-It) S 25091 25093 20320 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 287667180 9367552 274 33554432000 4194304 5064252 140736322243824 140736322242736 251052844622 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/25093/statm: 2287 274 233 213 0 72 0
[pid=25094] ppid=25093 vsize=246128 CPUtime=1476.89 cores=0,2,4,6
/proc/25094/stat : 25094 (npSolver-wbo) S 25093 25093 20320 0 -1 4202496 67488 1303778 0 0 816 391 145621 861 20 0 1 0 287667181 252035072 41011 33554432000 4194304 5990268 140736592373696 140736592365104 5173822 0 65536 4102 0 18446744071579302229 0 0 17 2 0 0 12 0 0
/proc/25094/statm: 61532 41011 177 439 0 61089 0
[pid=4772] ppid=25094 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/4772/stat : 4772 (satsolver.sh) S 25094 25093 20320 0 -1 4202496 596 0 0 0 0 0 0 0 20 0 1 0 287814935 9367552 267 33554432000 4194304 5064252 140735749691248 140735749690160 251052844622 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/4772/statm: 2287 267 226 213 0 72 0
[pid=4773] ppid=4772 vsize=387296 CPUtime=64.73 cores=0,2,4,6
/proc/4773/stat : 4773 (glucose) R 4772 25093 20320 0 -1 4202496 54886 0 0 0 6461 12 0 0 20 0 1 0 287814935 396591104 81757 33554432000 4194304 5208918 140733673726944 140733673724888 4229319 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/4773/statm: 96824 81757 102 248 0 96573 0
Current children cumulated CPU time (s) 1541.62
Current children cumulated vsize (KiB) 651720

[startup+1602.3 s]
/proc/loadavg: 2.01 2.02 2.06 3/181 5790
/proc/meminfo: memFree=29014236/32873648 swapFree=7368/7368
[pid=25093] ppid=25091 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/25093/stat : 25093 (npSolver-wbo-It) S 25091 25093 20320 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 287667180 9367552 274 33554432000 4194304 5064252 140736322243824 140736322242736 251052844622 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/25093/statm: 2287 274 233 213 0 72 0
[pid=25094] ppid=25093 vsize=246128 CPUtime=1556.67 cores=0,2,4,6
/proc/25094/stat : 25094 (npSolver-wbo) S 25093 25093 20320 0 -1 4202496 70553 1368439 0 0 832 393 153536 906 20 0 1 0 287667181 252035072 41011 33554432000 4194304 5990268 140736592373696 140736592365104 5173822 0 65536 4102 0 18446744071579302229 0 0 17 2 0 0 12 0 0
/proc/25094/statm: 61532 41011 177 439 0 61089 0
[pid=5431] ppid=25094 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/5431/stat : 5431 (satsolver.sh) S 25094 25093 20320 0 -1 4202496 598 0 0 0 0 0 0 0 20 0 1 0 287822914 9367552 267 33554432000 4194304 5064252 140737188435408 140737188434320 251052844622 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/5431/statm: 2287 267 226 213 0 72 0
[pid=5432] ppid=5431 vsize=385596 CPUtime=44.94 cores=0,2,4,6
/proc/5432/stat : 5432 (glucose) R 5431 25093 20320 0 -1 4202496 55923 0 0 0 4483 11 0 0 20 0 1 0 287822915 394850304 80703 33554432000 4194304 5208918 140734823594800 140734823592472 4211584 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/5432/statm: 96399 80703 95 248 0 96148 0
Current children cumulated CPU time (s) 1601.61
Current children cumulated vsize (KiB) 650020

[startup+1662.3 s]
/proc/loadavg: 1.95 2.00 2.05 3/183 6290
/proc/meminfo: memFree=28937560/32873648 swapFree=7368/7368
[pid=25093] ppid=25091 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/25093/stat : 25093 (npSolver-wbo-It) S 25091 25093 20320 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 287667180 9367552 274 33554432000 4194304 5064252 140736322243824 140736322242736 251052844622 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/25093/statm: 2287 274 233 213 0 72 0
[pid=25094] ppid=25093 vsize=246128 CPUtime=1636.48 cores=0,2,4,6
/proc/25094/stat : 25094 (npSolver-wbo) S 25093 25093 20320 0 -1 4202496 73618 1435088 0 0 849 394 161457 948 20 0 1 0 287667181 252035072 41011 33554432000 4194304 5990268 140736592373696 140736592365104 5173822 0 65536 4102 0 18446744071579302229 0 0 17 2 0 0 12 0 0
/proc/25094/statm: 61532 41011 177 439 0 61089 0
[pid=6090] ppid=25094 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/6090/stat : 6090 (satsolver.sh) S 25094 25093 20320 0 -1 4202496 598 0 0 0 0 0 0 0 20 0 1 0 287830897 9367552 267 33554432000 4194304 5064252 140734586893360 140734586892272 251052844622 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/6090/statm: 2287 267 226 213 0 72 0
[pid=6091] ppid=6090 vsize=385600 CPUtime=25.11 cores=0,2,4,6
/proc/6091/stat : 6091 (glucose) R 6090 25093 20320 0 -1 4202496 54805 0 0 0 2497 14 0 0 20 0 1 0 287830898 394854400 81177 33554432000 4194304 5208918 140734150543472 140734150541144 4211732 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/6091/statm: 96400 81177 95 248 0 96149 0
Current children cumulated CPU time (s) 1661.59
Current children cumulated vsize (KiB) 650024

[startup+1722.3 s]
/proc/loadavg: 1.94 1.98 2.04 3/183 6780
/proc/meminfo: memFree=28936944/32873648 swapFree=7368/7368
[pid=25093] ppid=25091 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/25093/stat : 25093 (npSolver-wbo-It) S 25091 25093 20320 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 287667180 9367552 274 33554432000 4194304 5064252 140736322243824 140736322242736 251052844622 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/25093/statm: 2287 274 233 213 0 72 0
[pid=25094] ppid=25093 vsize=246128 CPUtime=1716.3 cores=0,2,4,6
/proc/25094/stat : 25094 (npSolver-wbo) S 25093 25093 20320 0 -1 4202496 76683 1500046 0 0 866 395 169373 996 20 0 1 0 287667181 252035072 41011 33554432000 4194304 5990268 140736592373696 140736592365104 5173822 0 65536 4102 0 18446744071579302229 0 0 17 2 0 0 12 0 0
/proc/25094/statm: 61532 41011 177 439 0 61089 0
[pid=6751] ppid=25094 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/6751/stat : 6751 (satsolver.sh) S 25094 25093 20320 0 -1 4202496 596 0 0 0 0 0 0 0 20 0 1 0 287838879 9367552 266 33554432000 4194304 5064252 140734527750848 140734527749760 251052844622 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/6751/statm: 2287 266 226 213 0 72 0
[pid=6752] ppid=6751 vsize=385600 CPUtime=5.3 cores=0,2,4,6
/proc/6752/stat : 6752 (glucose) R 6751 25093 20320 0 -1 4202496 54821 0 0 0 517 13 0 0 20 0 1 0 287838880 394854400 81063 33554432000 4194304 5208918 140735578168352 140735578166024 4211888 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/6752/statm: 96400 81063 95 248 0 96149 0
Current children cumulated CPU time (s) 1721.6
Current children cumulated vsize (KiB) 650024

[startup+1782.3 s]
/proc/loadavg: 1.89 1.96 2.02 3/185 7283
/proc/meminfo: memFree=28969116/32873648 swapFree=7368/7368
[pid=25093] ppid=25091 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/25093/stat : 25093 (npSolver-wbo-It) S 25091 25093 20320 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 287667180 9367552 274 33554432000 4194304 5064252 140736322243824 140736322242736 251052844622 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/25093/statm: 2287 274 233 213 0 72 0
[pid=25094] ppid=25093 vsize=246128 CPUtime=1716.3 cores=0,2,4,6
/proc/25094/stat : 25094 (npSolver-wbo) S 25093 25093 20320 0 -1 4202496 76683 1500046 0 0 866 395 169373 996 20 0 1 0 287667181 252035072 41011 33554432000 4194304 5990268 140736592373696 140736592365104 5173822 0 65536 4102 0 18446744071579302229 0 0 17 2 0 0 12 0 0
/proc/25094/statm: 61532 41011 177 439 0 61089 0
[pid=6751] ppid=25094 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/6751/stat : 6751 (satsolver.sh) S 25094 25093 20320 0 -1 4202496 596 0 0 0 0 0 0 0 20 0 1 0 287838879 9367552 266 33554432000 4194304 5064252 140734527750848 140734527749760 251052844622 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/6751/statm: 2287 266 226 213 0 72 0
[pid=6752] ppid=6751 vsize=387300 CPUtime=65.28 cores=0,2,4,6
/proc/6752/stat : 6752 (glucose) R 6751 25093 20320 0 -1 4202496 55331 0 0 0 6515 13 0 0 20 0 1 0 287838880 396595200 82078 33554432000 4194304 5208918 140735578168352 140735578166296 4211744 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/6752/statm: 96825 82078 102 248 0 96574 0
Current children cumulated CPU time (s) 1781.58
Current children cumulated vsize (KiB) 651724



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.81 s]
/proc/loadavg: 2.22 2.02 2.04 3/185 7437
/proc/meminfo: memFree=28969364/32873648 swapFree=7368/7368
[pid=25093] ppid=25091 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/25093/stat : 25093 (npSolver-wbo-It) S 25091 25093 20320 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 287667180 9367552 274 33554432000 4194304 5064252 140736322243824 140736322242736 251052844622 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/25093/statm: 2287 274 233 213 0 72 0
[pid=25094] ppid=25093 vsize=246128 CPUtime=1796.07 cores=0,2,4,6
/proc/25094/stat : 25094 (npSolver-wbo) S 25093 25093 20320 0 -1 4202496 79748 1565243 0 0 882 397 177285 1043 20 0 1 0 287667181 252035072 41011 33554432000 4194304 5990268 140736592373696 140736592365104 5173822 0 65536 4102 0 18446744071579302229 0 0 17 2 0 0 12 0 0
/proc/25094/statm: 61532 41011 177 439 0 61089 0
[pid=7412] ppid=25094 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/7412/stat : 7412 (satsolver.sh) S 25094 25093 20320 0 -1 4202496 596 0 0 0 0 0 0 0 20 0 1 0 287846857 9367552 267 33554432000 4194304 5064252 140735227435488 140735227434400 251052844622 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/7412/statm: 2287 267 226 213 0 72 0
[pid=7413] ppid=7412 vsize=385444 CPUtime=4.02 cores=0,2,4,6
/proc/7413/stat : 7413 (glucose) R 7412 25093 20320 0 -1 4202496 54492 0 0 0 391 11 0 0 20 0 1 0 287846857 394694656 80840 33554432000 4194304 5208918 140734199532496 140734199530344 4211599 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/7413/statm: 96361 80840 95 248 0 96110 0
Current children cumulated CPU time (s) 1800.09
Current children cumulated vsize (KiB) 649868

Sending SIGTERM to process tree (bottom up)

Solver just ended. Dumping a history of the last processes samples

[startup+1800.81 s]
/proc/loadavg: 2.22 2.02 2.04 3/185 7437
/proc/meminfo: memFree=28969364/32873648 swapFree=7368/7368
[pid=25093] ppid=25091 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/25093/stat : 25093 (npSolver-wbo-It) S 25091 25093 20320 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 287667180 9367552 274 33554432000 4194304 5064252 140736322243824 140736322242736 251052844622 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/25093/statm: 2287 274 233 213 0 72 0
[pid=25094] ppid=25093 vsize=246128 CPUtime=1796.07 cores=0,2,4,6
/proc/25094/stat : 25094 (npSolver-wbo) S 25093 25093 20320 0 -1 4202496 79748 1565243 0 0 882 397 177285 1043 20 0 1 0 287667181 252035072 41011 33554432000 4194304 5990268 140736592373696 140736592365104 5173822 0 65536 4102 0 18446744071579302229 0 0 17 2 0 0 12 0 0
/proc/25094/statm: 61532 41011 177 439 0 61089 0
[pid=7412] ppid=25094 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/7412/stat : 7412 (satsolver.sh) S 25094 25093 20320 0 -1 4202496 596 0 0 0 0 0 0 0 20 0 1 0 287846857 9367552 267 33554432000 4194304 5064252 140735227435488 140735227434400 251052844622 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/7412/statm: 2287 267 226 213 0 72 0
[pid=7413] ppid=7412 vsize=385444 CPUtime=4.02 cores=0,2,4,6
/proc/7413/stat : 7413 (glucose) R 7412 25093 20320 0 -1 4202496 54492 0 0 0 391 11 0 0 20 0 1 0 287846857 394694656 80840 33554432000 4194304 5208918 140734199532496 140734199530344 4211599 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/7413/statm: 96361 80840 95 248 0 96110 0
Current children cumulated CPU time (s) 1800.09
Current children cumulated vsize (KiB) 649868

Child status: 0

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 25093 and gives
#  childrusage.ru_utime.tv_sec=1781
#  childrusage.ru_utime.tv_usec=677143
#  childrusage.ru_stime.tv_sec=14
#  childrusage.ru_stime.tv_usec=415808
# CPU time returned by wait4() is 1796.09
# while last known CPU time is 1800.09
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1800.82
CPU time (s): 1800.09
CPU user time (s): 1785.58
CPU system time (s): 14.51
CPU usage (%): 99.9595
Max. virtual memory (cumulated for all children) (KiB): 986808

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1781.68
system time used= 14.4158
maximum resident set size= 744036
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1645967
page faults= 0
swaps= 0
block input operations= 0
block output operations= 4765816
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 62649
involuntary context switches= 2166

runsolver used 3.43648 second user time and 8.75467 second system time

The end

Launcher Data 

Begin job on node149 at 2012-05-28 16:30:31
IDJOB=3715879
IDBENCH=79133
IDSOLVER=2297
FILE ID=node149/3715879-1338215431
RUNJOBID= node149-1338215431-25065
PBS_JOBID= 14624573
Free space on /tmp= 71692 MiB

SOLVER NAME= npSolver inc-topdown-quickBound
BENCH NAME= PB10/normalized-PB10/SOFT-BIGINT-LIN/PB10/oliveras/j90/normalized-j9015_10-unsat--soft-0-100-0.wbo
COMMAND LINE= DIR/npSolver-wbo-Itdqb.sh BENCHNAME RANDOMSEED TMPDIR DIR
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3715879-1338215431/watcher-3715879-1338215431 -o /tmp/evaluation-result-3715879-1338215431/solver-3715879-1338215431 -C 1800 -W 1900 -M 15500  HOME/npSolver-wbo-Itdqb.sh HOME/instance-3715879-1338215431.wbo 1383540514 HOME HOME

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 8a2cbb62b727a1b33685f0cffed53856
RANDOM SEED=1383540514

node149.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.145
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.29
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.145
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.145
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5438.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.145
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.145
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.145
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5438.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.145
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.145
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873648 kB
MemFree:        29754392 kB
Buffers:          503668 kB
Cached:          1763576 kB
SwapCached:         2476 kB
Active:           995176 kB
Inactive:        1285424 kB
Active(anon):       2288 kB
Inactive(anon):     9372 kB
Active(file):     992888 kB
Inactive(file):  1276052 kB
Unevictable:        7368 kB
Mlocked:            7368 kB
SwapTotal:      67108856 kB
SwapFree:       67104884 kB
Dirty:             19660 kB
Writeback:             0 kB
AnonPages:         14840 kB
Mapped:            13512 kB
Shmem:                96 kB
Slab:             700972 kB
SReclaimable:     144232 kB
SUnreclaim:       556740 kB
KernelStack:        1416 kB
PageTables:         4372 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545680 kB
Committed_AS:     104948 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346400 kB
VmallocChunk:   34341988052 kB
HardwareCorrupted:     0 kB
AnonHugePages:         0 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7680 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71500 MiB
End job on node149 at 2012-05-28 17:00:32