Trace number 3274381

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SAT09 reference solver: SATzilla2009_C 2009-03-22? (TO) 1299.97 1300.01

General information on the benchmark

Namecrafted/skvortsov/automata-synchronization/
crn_40_1520_u.cnf
MD5SUMac02a3a5c06227748ecf75dd451ebb7e
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables63840
Number of clauses123900
Sum of the clauses size369320
Maximum clause length3
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 22380
Number of clauses of size 3121520
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

23.64/23.71	c SATzilla is building models for class 2
23.64/23.71	c run presolver march_dl2004 for 5 seconds ... 
23.64/23.71	c Bin: Executing march_dl2004
23.64/23.71	c spawning binary file with 5 seconds ...
23.64/23.71	c child exit by a signal
23.64/23.71	c march_dl2004 returned code 137.
23.64/23.71	c run presolver mxc-sr08 for 5 seconds ... 
23.64/23.71	c Bin: Executing mxc-sr08
23.64/23.71	c spawning binary file with 5 seconds ...
23.64/23.71	c child exit by a signal
23.64/23.71	c mxc-sr08 returned code 137.
23.64/23.71	c Orignal number of varibales is 63840, number of clauses is 123900 
23.64/23.71	c predicted feature computation time is 19.430431 
23.64/23.71	c Bin: Executing satelite
23.64/23.71	c spawning binary file with 240 seconds ...
23.64/23.71	c child exited successfully
23.64/23.71	c satzilla computing base features
23.64/23.71	c Number of variabe is: 31516, Number of clause is : 117774 
23.64/23.71	c Initializing...
23.64/23.71	c satzilla compute diameter ...
23.64/23.71	c start diameter features ...
23.64/23.71	c satzilla doing clause learning
23.64/23.71	c start clause learning features ...
23.64/23.71	c Bin: Executing zchaff07
23.64/23.71	c spawning binary file with 2 seconds ...
23.64/23.71	c child exit by a signal
23.64/23.71	c satzilla doing survey propogation probe
23.64/23.71	c do survay propogation for 2 second ...
23.64/23.71	c satzilla doing local search probe
23.64/23.71	c satzilla doing lobjois search-space size estimate
23.64/23.71	c features are:63840 123900 31516 117774 1.02564 0.0520149 0.267597 0.257444 0.987052 0.832085 0.000125637 0.0583254 6.34598e-05 0.00012692 0.163017 0.00726816 0.0331652 0.000125637 2.09959 4.24542e-05 0.00132457 0.588494 0.0173465 0.0584498 0 0.902439 0.400804 3.23226e-05 2.09117 8.49084e-06 0.000339634 0.213314 0.261314 0.000113503 1.13152 5.0945e-05 0.000687758 747.02 0.00632501 740 759 2.83214 1729.5 0.220584 1348 2111 2111 1348 2111 1348 2111 335.727 0.691761 103.484 567.97 567.97 103.484 567.97 103.484 567.97 0.0191951 3.11721 1.91672e-08 0.93572 0.121355 7.30159e-05 0.00686274 7.92346e-05 0.000226931 0.315103 0.228723 1.00393e-08 0.357535 0.332533 0.328353 0.332533 0.331608 0.332524 927.25 1.00932 4331.75 0.00750511 4332 4292 4337 0.257778 1.43411 0.751309 0.155464 0.0644861 0.128828 
23.64/23.71	c satzilla's ranking:
23.64/23.71	c 1) march_dl2004: 3.601611
23.64/23.71	c 2) mxc-sr08: 3.300106
23.64/23.71	c 3) zchaff_rand: 0.373565
23.64/23.71	c 4) tts-4-0: 0.025127
23.64/23.71	c 5) minisat20: -0.881764
23.64/23.71	c 6) minisat20SAT07: -4.067897
23.64/23.71	c 7) vallst: -8.569248
23.64/23.71	c 8) SATenstein: -10000.000000
23.64/23.71	c 9) gnovelty+: -10000.000000
23.64/23.71	c 10) adaptg2wsat+: -10000.000000
23.64/23.71	c 11) adaptg2wsat0: -10000.000000
23.64/23.71	c 12) picosat846: -10000.000000
23.64/23.71	c 13) kcnfs04SAT07: -10000.000000
23.64/23.71	c satzilla running march_dl2004 ...

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3274381-1303603199/watcher-3274381-1303603199 -o /tmp/evaluation-result-3274381-1303603199/solver-3274381-1303603199 -C 2400 -W 1300 -M 7680 HOME/SATzilla2009_C HOME/instance-3274381-1303603199.cnf 

running on 2 cores: 0,2

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 7864320 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 7915520 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.92 1.01 1.48 5/186 26051
/proc/meminfo: memFree=25911376/32950928 swapFree=67071984/67111528
[pid=26049] ppid=26042 vsize=2136 CPUtime=0 cores=0,2
/proc/26049/stat : 26049 (SATzilla2009_C) S 26042 26049 25767 0 -1 4202496 163 0 0 0 0 0 0 0 20 0 1 0 550550738 2187264 114 33554432000 134512640 136149437 4291570192 18446744073709551615 135542781 0 0 4096 0 18446744071562232103 0 0 17 2 0 0 0
/proc/26049/statm: 534 114 97 400 0 131 0

[startup+0.0383701 s]
/proc/loadavg: 0.92 1.01 1.48 5/186 26051
/proc/meminfo: memFree=25911376/32950928 swapFree=67071984/67111528
[pid=26049] ppid=26042 vsize=2136 CPUtime=0 cores=0,2
/proc/26049/stat : 26049 (SATzilla2009_C) S 26042 26049 25767 0 -1 4202496 163 0 0 0 0 0 0 0 20 0 1 0 550550738 2187264 114 33554432000 134512640 136149437 4291570192 18446744073709551615 135542781 0 0 4096 0 18446744071562232103 0 0 17 2 0 0 0
/proc/26049/statm: 534 114 97 400 0 131 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 2136

[startup+0.100359 s]
/proc/loadavg: 0.92 1.01 1.48 5/186 26051
/proc/meminfo: memFree=25911376/32950928 swapFree=67071984/67111528
[pid=26049] ppid=26042 vsize=2136 CPUtime=0 cores=0,2
/proc/26049/stat : 26049 (SATzilla2009_C) S 26042 26049 25767 0 -1 4202496 163 0 0 0 0 0 0 0 20 0 1 0 550550738 2187264 114 33554432000 134512640 136149437 4291570192 18446744073709551615 135542781 0 0 4096 0 18446744071562232103 0 0 17 2 0 0 0
/proc/26049/statm: 534 114 97 400 0 131 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 2136

[startup+0.300327 s]
/proc/loadavg: 0.92 1.01 1.48 5/186 26051
/proc/meminfo: memFree=25911376/32950928 swapFree=67071984/67111528
[pid=26049] ppid=26042 vsize=2136 CPUtime=0 cores=0,2
/proc/26049/stat : 26049 (SATzilla2009_C) S 26042 26049 25767 0 -1 4202496 163 0 0 0 0 0 0 0 20 0 1 0 550550738 2187264 114 33554432000 134512640 136149437 4291570192 18446744073709551615 135542781 0 0 4096 0 18446744071562232103 0 0 17 2 0 0 0
/proc/26049/statm: 534 114 97 400 0 131 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 2136

[startup+0.700253 s]
/proc/loadavg: 0.92 1.01 1.48 5/186 26051
/proc/meminfo: memFree=25911376/32950928 swapFree=67071984/67111528
[pid=26049] ppid=26042 vsize=2136 CPUtime=0 cores=0,2
/proc/26049/stat : 26049 (SATzilla2009_C) S 26042 26049 25767 0 -1 4202496 163 0 0 0 0 0 0 0 20 0 1 0 550550738 2187264 114 33554432000 134512640 136149437 4291570192 18446744073709551615 135542781 0 0 4096 0 18446744071562232103 0 0 17 2 0 0 0
/proc/26049/statm: 534 114 97 400 0 131 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 2136

[startup+1.5011 s]
/proc/loadavg: 1.17 1.06 1.49 6/194 26059
/proc/meminfo: memFree=25846076/32950928 swapFree=67071984/67111528
[pid=26049] ppid=26042 vsize=2136 CPUtime=0 cores=0,2
/proc/26049/stat : 26049 (SATzilla2009_C) S 26042 26049 25767 0 -1 4202496 163 0 0 0 0 0 0 0 20 0 1 0 550550738 2187264 114 33554432000 134512640 136149437 4291570192 18446744073709551615 135542781 0 0 4096 0 18446744071562232103 0 0 17 2 0 0 0
/proc/26049/statm: 534 114 97 400 0 131 0
[pid=26054] ppid=26049 vsize=63220 CPUtime=1.48 cores=0,2
/proc/26054/stat : 26054 (march_dl2004) R 26049 26049 25767 0 -1 4202496 28621 0 0 0 107 41 0 0 25 0 1 0 550550738 64737280 15011 33554432000 134512640 134996440 4290807328 18446744073709551615 134675049 0 0 8392704 0 0 0 0 17 0 0 0 0
/proc/26054/statm: 15805 15011 73 119 0 15684 0
Current children cumulated CPU time (s) 1.48
Current children cumulated vsize (KiB) 65356

[startup+3.10088 s]
/proc/loadavg: 1.17 1.06 1.49 8/194 26059
/proc/meminfo: memFree=25843596/32950928 swapFree=67071984/67111528
[pid=26049] ppid=26042 vsize=2136 CPUtime=0 cores=0,2
/proc/26049/stat : 26049 (SATzilla2009_C) S 26042 26049 25767 0 -1 4202496 163 0 0 0 0 0 0 0 20 0 1 0 550550738 2187264 114 33554432000 134512640 136149437 4291570192 18446744073709551615 135542781 0 0 4096 0 18446744071562232103 0 0 17 2 0 0 0
/proc/26049/statm: 534 114 97 400 0 131 0
[pid=26054] ppid=26049 vsize=77700 CPUtime=3.09 cores=0,2
/proc/26054/stat : 26054 (march_dl2004) R 26049 26049 25767 0 -1 4202496 43176 0 0 0 235 74 0 0 25 0 1 0 550550738 79564800 16134 33554432000 134512640 134996440 4290807328 18446744073709551615 134544613 0 0 8392704 0 0 0 0 17 0 0 0 0
/proc/26054/statm: 19425 16134 73 119 0 19304 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 79836

[startup+6.30023 s]
/proc/loadavg: 1.17 1.06 1.49 7/192 26063
/proc/meminfo: memFree=25863592/32950928 swapFree=67071984/67111528
[pid=26049] ppid=26042 vsize=2136 CPUtime=5 cores=0,2
/proc/26049/stat : 26049 (SATzilla2009_C) S 26042 26049 25767 0 -1 4202496 187 48796 0 0 0 0 425 75 18 0 1 0 550550738 2187264 127 33554432000 134512640 136149437 4291570192 18446744073709551615 135542781 0 0 4096 0 18446744071562232103 0 0 17 0 0 0 0
/proc/26049/statm: 534 127 108 400 0 131 0
[pid=26063] ppid=26049 vsize=37864 CPUtime=1.28 cores=0,2
/proc/26063/stat : 26063 (mxc-sr08) R 26049 26049 25767 0 -1 4202496 10451 0 0 0 128 0 0 0 22 0 1 0 550551238 38772736 8717 33554432000 134512640 135078026 4293832048 18446744073709551615 134534237 0 0 8392704 0 0 0 0 17 2 0 0 0
/proc/26063/statm: 9466 8717 73 139 0 9325 0
Current children cumulated CPU time (s) 6.28
Current children cumulated vsize (KiB) 40000

[startup+12.7011 s]
/proc/loadavg: 1.75 1.19 1.53 7/193 26097
/proc/meminfo: memFree=25876472/32950928 swapFree=67071984/67111528
[pid=26049] ppid=26042 vsize=15424 CPUtime=12.66 cores=0,2
/proc/26049/stat : 26049 (SATzilla2009_C) R 26042 26049 25767 0 -1 4202496 3500 68625 0 0 204 0 983 79 18 0 1 0 550550738 15794176 3422 33554432000 134512640 136149437 4291570192 18446744073709551615 134535653 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/26049/statm: 3856 3422 136 400 0 3453 0
Current children cumulated CPU time (s) 12.66
Current children cumulated vsize (KiB) 15424

[startup+25.5007 s]
/proc/loadavg: 2.09 1.28 1.55 7/194 26104
/proc/meminfo: memFree=25797336/32950928 swapFree=67071984/67111528
[pid=26049] ppid=26042 vsize=22556 CPUtime=23.65 cores=0,2
/proc/26049/stat : 26049 (SATzilla2009_C) S 26042 26049 25767 0 -1 4202496 9441 74160 0 0 1095 9 1181 80 25 0 1 0 550550738 23097344 5366 33554432000 134512640 136149437 4291570192 18446744073709551615 135542781 0 0 4096 3 18446744071562232103 0 0 17 0 0 0 0
/proc/26049/statm: 5639 5366 221 400 0 5236 0
[pid=26104] ppid=26049 vsize=63220 CPUtime=1.77 cores=0,2
/proc/26104/stat : 26104 (march_dl2004) R 26049 26049 25767 0 -1 4202496 28620 0 0 0 120 57 0 0 25 0 1 0 550553109 64737280 15010 33554432000 134512640 134996440 4288391872 18446744073709551615 134675049 0 0 8392704 0 0 0 0 17 0 0 0 0
/proc/26104/statm: 15805 15010 73 119 0 15684 0
Current children cumulated CPU time (s) 25.42
Current children cumulated vsize (KiB) 85776

[startup+51.101 s]
/proc/loadavg: 2.84 1.54 1.63 7/194 26105
/proc/meminfo: memFree=25714616/32950928 swapFree=67071984/67111528
[pid=26049] ppid=26042 vsize=22556 CPUtime=23.65 cores=0,2
/proc/26049/stat : 26049 (SATzilla2009_C) S 26042 26049 25767 0 -1 4202496 9441 74160 0 0 1095 9 1181 80 25 0 1 0 550550738 23097344 5366 33554432000 134512640 136149437 4291570192 18446744073709551615 135542781 0 0 4096 3 18446744071562232103 0 0 17 0 0 0 0
/proc/26049/statm: 5639 5366 221 400 0 5236 0
[pid=26104] ppid=26049 vsize=126304 CPUtime=27.37 cores=0,2
/proc/26104/stat : 26104 (march_dl2004) R 26049 26049 25767 0 -1 4202496 58072 0 0 0 2656 81 0 0 25 0 1 0 550553109 129335296 27390 33554432000 134512640 134996440 4288391872 18446744073709551615 134532993 0 0 8392704 0 0 0 0 17 0 0 0 0
/proc/26104/statm: 31576 27390 75 119 0 31455 0
Current children cumulated CPU time (s) 51.02
Current children cumulated vsize (KiB) 148860

[startup+102.308 s]
/proc/loadavg: 3.50 1.92 1.75 7/194 26115
/proc/meminfo: memFree=25587484/32950928 swapFree=67071984/67111528
[pid=26049] ppid=26042 vsize=22556 CPUtime=23.65 cores=0,2
/proc/26049/stat : 26049 (SATzilla2009_C) S 26042 26049 25767 0 -1 4202496 9441 74160 0 0 1095 9 1181 80 25 0 1 0 550550738 23097344 5366 33554432000 134512640 136149437 4291570192 18446744073709551615 135542781 0 0 4096 3 18446744071562232103 0 0 17 0 0 0 0
/proc/26049/statm: 5639 5366 221 400 0 5236 0
[pid=26104] ppid=26049 vsize=191872 CPUtime=78.58 cores=0,2
/proc/26104/stat : 26104 (march_dl2004) R 26049 26049 25767 0 -1 4202496 76416 0 0 0 7774 84 0 0 25 0 1 0 550553109 196476928 45734 33554432000 134512640 134996440 4288391872 18446744073709551615 134533010 0 0 8392704 0 0 0 0 17 0 0 0 0
/proc/26104/statm: 47968 45734 75 119 0 47847 0
Current children cumulated CPU time (s) 102.23
Current children cumulated vsize (KiB) 214428

[startup+162.301 s]
/proc/loadavg: 3.81 2.29 1.89 7/194 26117
/proc/meminfo: memFree=25478956/32950928 swapFree=67071984/67111528
[pid=26049] ppid=26042 vsize=22556 CPUtime=23.65 cores=0,2
/proc/26049/stat : 26049 (SATzilla2009_C) S 26042 26049 25767 0 -1 4202496 9441 74160 0 0 1095 9 1181 80 25 0 1 0 550550738 23097344 5366 33554432000 134512640 136149437 4291570192 18446744073709551615 135542781 0 0 4096 3 18446744071562232103 0 0 17 0 0 0 0
/proc/26049/statm: 5639 5366 221 400 0 5236 0
[pid=26104] ppid=26049 vsize=275428 CPUtime=138.57 cores=0,2
/proc/26104/stat : 26104 (march_dl2004) R 26049 26049 25767 0 -1 4202496 91362 0 0 0 13771 86 0 0 25 0 1 0 550553109 282038272 60680 33554432000 134512640 134996440 4288391872 18446744073709551615 134533000 0 0 8392704 0 0 0 0 17 0 0 0 0
/proc/26104/statm: 68857 60680 75 119 0 68736 0
Current children cumulated CPU time (s) 162.22
Current children cumulated vsize (KiB) 297984

[startup+222.301 s]
/proc/loadavg: 3.93 2.60 2.02 6/194 26151
/proc/meminfo: memFree=25388528/32950928 swapFree=67071984/67111528
[pid=26049] ppid=26042 vsize=22556 CPUtime=23.65 cores=0,2
/proc/26049/stat : 26049 (SATzilla2009_C) S 26042 26049 25767 0 -1 4202496 9441 74160 0 0 1095 9 1181 80 25 0 1 0 550550738 23097344 5366 33554432000 134512640 136149437 4291570192 18446744073709551615 135542781 0 0 4096 3 18446744071562232103 0 0 17 0 0 0 0
/proc/26049/statm: 5639 5366 221 400 0 5236 0
[pid=26104] ppid=26049 vsize=299848 CPUtime=198.58 cores=0,2
/proc/26104/stat : 26104 (march_dl2004) R 26049 26049 25767 0 -1 4202496 102410 0 0 0 19770 88 0 0 25 0 1 0 550553109 307044352 71728 33554432000 134512640 134996440 4288391872 18446744073709551615 134527302 0 0 8392704 0 0 0 0 17 0 0 0 0
/proc/26104/statm: 74962 71728 75 119 0 74841 0
Current children cumulated CPU time (s) 222.23
Current children cumulated vsize (KiB) 322404

[startup+282.301 s]
/proc/loadavg: 3.97 2.85 2.14 7/194 26152
/proc/meminfo: memFree=25309264/32950928 swapFree=67071984/67111528
[pid=26049] ppid=26042 vsize=22556 CPUtime=23.65 cores=0,2
/proc/26049/stat : 26049 (SATzilla2009_C) S 26042 26049 25767 0 -1 4202496 9441 74160 0 0 1095 9 1181 80 25 0 1 0 550550738 23097344 5366 33554432000 134512640 136149437 4291570192 18446744073709551615 135542781 0 0 4096 3 18446744071562232103 0 0 17 0 0 0 0
/proc/26049/statm: 5639 5366 221 400 0 5236 0
[pid=26104] ppid=26049 vsize=416240 CPUtime=258.58 cores=0,2
/proc/26104/stat : 26104 (march_dl2004) R 26049 26049 25767 0 -1 4202496 110728 0 0 0 25769 89 0 0 25 0 1 0 550553109 426229760 80046 33554432000 134512640 134996440 4288391872 18446744073709551615 134533010 0 0 8392704 0 0 0 0 17 0 0 0 0
/proc/26104/statm: 104060 80046 75 119 0 103939 0
Current children cumulated CPU time (s) 282.23
Current children cumulated vsize (KiB) 438796

[startup+342.301 s]
/proc/loadavg: 3.99 3.06 2.25 6/194 26154
/proc/meminfo: memFree=25222292/32950928 swapFree=67071984/67111528
[pid=26049] ppid=26042 vsize=22556 CPUtime=23.65 cores=0,2
/proc/26049/stat : 26049 (SATzilla2009_C) S 26042 26049 25767 0 -1 4202496 9441 74160 0 0 1095 9 1181 80 25 0 1 0 550550738 23097344 5366 33554432000 134512640 136149437 4291570192 18446744073709551615 135542781 0 0 4096 3 18446744071562232103 0 0 17 0 0 0 0
/proc/26049/statm: 5639 5366 221 400 0 5236 0
[pid=26104] ppid=26049 vsize=431508 CPUtime=318.58 cores=0,2
/proc/26104/stat : 26104 (march_dl2004) R 26049 26049 25767 0 -1 4202496 117898 0 0 0 31767 91 0 0 25 0 1 0 550553109 441864192 87216 33554432000 134512640 134996440 4288391872 18446744073709551615 134533013 0 0 8392704 0 0 0 0 17 0 0 0 0
/proc/26104/statm: 107877 87216 75 119 0 107756 0
Current children cumulated CPU time (s) 342.23
Current children cumulated vsize (KiB) 454064

[startup+402.301 s]
/proc/loadavg: 3.99 3.23 2.36 7/194 26155
/proc/meminfo: memFree=25165476/32950928 swapFree=67071984/67111528
[pid=26049] ppid=26042 vsize=22556 CPUtime=23.65 cores=0,2
/proc/26049/stat : 26049 (SATzilla2009_C) S 26042 26049 25767 0 -1 4202496 9441 74160 0 0 1095 9 1181 80 25 0 1 0 550550738 23097344 5366 33554432000 134512640 136149437 4291570192 18446744073709551615 135542781 0 0 4096 3 18446744071562232103 0 0 17 0 0 0 0
/proc/26049/statm: 5639 5366 221 400 0 5236 0
[pid=26104] ppid=26049 vsize=443616 CPUtime=378.59 cores=0,2

################
# More data... #
################

/proc/26104/statm: 120257 109961 75 119 0 120136 0
Current children cumulated CPU time (s) 582.24
Current children cumulated vsize (KiB) 503584

[startup+642.301 s]
/proc/loadavg: 3.99 3.65 2.72 6/194 26162
/proc/meminfo: memFree=24939932/32950928 swapFree=67071984/67111528
[pid=26049] ppid=26042 vsize=22556 CPUtime=23.65 cores=0,2
/proc/26049/stat : 26049 (SATzilla2009_C) S 26042 26049 25767 0 -1 4202496 9441 74160 0 0 1095 9 1181 80 25 0 1 0 550550738 23097344 5366 33554432000 134512640 136149437 4291570192 18446744073709551615 135542781 0 0 4096 3 18446744071562232103 0 0 17 0 0 0 0
/proc/26049/statm: 5639 5366 221 400 0 5236 0
[pid=26104] ppid=26049 vsize=495524 CPUtime=618.6 cores=0,2
/proc/26104/stat : 26104 (march_dl2004) R 26049 26049 25767 0 -1 4202496 146635 0 0 0 61763 97 0 0 25 0 1 0 550553109 507416576 115953 33554432000 134512640 134996440 4288391872 18446744073709551615 134533001 0 0 8392704 0 0 0 0 17 0 0 0 0
/proc/26104/statm: 123881 115953 75 119 0 123760 0
Current children cumulated CPU time (s) 642.25
Current children cumulated vsize (KiB) 518080

[startup+702.301 s]
/proc/loadavg: 4.04 3.72 2.81 7/194 26163
/proc/meminfo: memFree=24881996/32950928 swapFree=67071984/67111528
[pid=26049] ppid=26042 vsize=22556 CPUtime=23.65 cores=0,2
/proc/26049/stat : 26049 (SATzilla2009_C) S 26042 26049 25767 0 -1 4202496 9441 74160 0 0 1095 9 1181 80 25 0 1 0 550550738 23097344 5366 33554432000 134512640 136149437 4291570192 18446744073709551615 135542781 0 0 4096 3 18446744071562232103 0 0 17 0 0 0 0
/proc/26049/statm: 5639 5366 221 400 0 5236 0
[pid=26104] ppid=26049 vsize=509292 CPUtime=678.6 cores=0,2
/proc/26104/stat : 26104 (march_dl2004) R 26049 26049 25767 0 -1 4202496 152334 0 0 0 67762 98 0 0 25 0 1 0 550553109 521515008 121652 33554432000 134512640 134996440 4288391872 18446744073709551615 134533016 0 0 8392704 0 0 0 0 17 0 0 0 0
/proc/26104/statm: 127323 121652 75 119 0 127202 0
Current children cumulated CPU time (s) 702.25
Current children cumulated vsize (KiB) 531848

[startup+762.307 s]
/proc/loadavg: 4.01 3.77 2.88 7/194 26165
/proc/meminfo: memFree=24829268/32950928 swapFree=67071984/67111528
[pid=26049] ppid=26042 vsize=22556 CPUtime=23.65 cores=0,2
/proc/26049/stat : 26049 (SATzilla2009_C) S 26042 26049 25767 0 -1 4202496 9441 74160 0 0 1095 9 1181 80 25 0 1 0 550550738 23097344 5366 33554432000 134512640 136149437 4291570192 18446744073709551615 135542781 0 0 4096 3 18446744071562232103 0 0 17 0 0 0 0
/proc/26049/statm: 5639 5366 221 400 0 5236 0
[pid=26104] ppid=26049 vsize=523532 CPUtime=738.6 cores=0,2
/proc/26104/stat : 26104 (march_dl2004) R 26049 26049 25767 0 -1 4202496 158312 0 0 0 73761 99 0 0 25 0 1 0 550553109 536096768 127630 33554432000 134512640 134996440 4288391872 18446744073709551615 134533013 0 0 8392704 0 0 0 0 17 0 0 0 0
/proc/26104/statm: 130883 127630 75 119 0 130762 0
Current children cumulated CPU time (s) 762.25
Current children cumulated vsize (KiB) 546088

[startup+822.301 s]
/proc/loadavg: 4.00 3.81 2.94 7/194 26167
/proc/meminfo: memFree=24778652/32950928 swapFree=67071984/67111528
[pid=26049] ppid=26042 vsize=22556 CPUtime=23.65 cores=0,2
/proc/26049/stat : 26049 (SATzilla2009_C) S 26042 26049 25767 0 -1 4202496 9441 74160 0 0 1095 9 1181 80 25 0 1 0 550550738 23097344 5366 33554432000 134512640 136149437 4291570192 18446744073709551615 135542781 0 0 4096 3 18446744071562232103 0 0 17 0 0 0 0
/proc/26049/statm: 5639 5366 221 400 0 5236 0
[pid=26104] ppid=26049 vsize=733060 CPUtime=798.6 cores=0,2
/proc/26104/stat : 26104 (march_dl2004) R 26049 26049 25767 0 -1 4202496 163765 0 0 0 79760 100 0 0 25 0 1 0 550553109 750653440 133083 33554432000 134512640 134996440 4288391872 18446744073709551615 134533001 0 0 8392704 0 0 0 0 17 0 0 0 0
/proc/26104/statm: 183265 133083 75 119 0 183144 0
Current children cumulated CPU time (s) 822.25
Current children cumulated vsize (KiB) 755616

[startup+882.301 s]
/proc/loadavg: 4.05 3.86 3.01 7/194 26200
/proc/meminfo: memFree=24733176/32950928 swapFree=67071984/67111528
[pid=26049] ppid=26042 vsize=22556 CPUtime=23.65 cores=0,2
/proc/26049/stat : 26049 (SATzilla2009_C) S 26042 26049 25767 0 -1 4202496 9441 74160 0 0 1095 9 1181 80 25 0 1 0 550550738 23097344 5366 33554432000 134512640 136149437 4291570192 18446744073709551615 135542781 0 0 4096 3 18446744071562232103 0 0 17 0 0 0 0
/proc/26049/statm: 5639 5366 221 400 0 5236 0
[pid=26104] ppid=26049 vsize=745540 CPUtime=858.6 cores=0,2
/proc/26104/stat : 26104 (march_dl2004) R 26049 26049 25767 0 -1 4202496 169083 0 0 0 85759 101 0 0 25 0 1 0 550553109 763432960 138401 33554432000 134512640 134996440 4288391872 18446744073709551615 134527302 0 0 8392704 0 0 0 0 17 0 0 0 0
/proc/26104/statm: 186385 138401 75 119 0 186264 0
Current children cumulated CPU time (s) 882.25
Current children cumulated vsize (KiB) 768096

[startup+942.301 s]
/proc/loadavg: 4.02 3.88 3.07 7/194 26202
/proc/meminfo: memFree=24684036/32950928 swapFree=67071984/67111528
[pid=26049] ppid=26042 vsize=22556 CPUtime=23.65 cores=0,2
/proc/26049/stat : 26049 (SATzilla2009_C) S 26042 26049 25767 0 -1 4202496 9441 74160 0 0 1095 9 1181 80 25 0 1 0 550550738 23097344 5366 33554432000 134512640 136149437 4291570192 18446744073709551615 135542781 0 0 4096 3 18446744071562232103 0 0 17 0 0 0 0
/proc/26049/statm: 5639 5366 221 400 0 5236 0
[pid=26104] ppid=26049 vsize=758100 CPUtime=918.6 cores=0,2
/proc/26104/stat : 26104 (march_dl2004) R 26049 26049 25767 0 -1 4202496 174436 0 0 0 91758 102 0 0 25 0 1 0 550553109 776294400 143754 33554432000 134512640 134996440 4288391872 18446744073709551615 134533013 0 0 8392704 0 0 0 0 17 0 0 0 0
/proc/26104/statm: 189525 143754 75 119 0 189404 0
Current children cumulated CPU time (s) 942.25
Current children cumulated vsize (KiB) 780656

[startup+1002.3 s]
/proc/loadavg: 4.00 3.90 3.13 6/194 26203
/proc/meminfo: memFree=24634524/32950928 swapFree=67071984/67111528
[pid=26049] ppid=26042 vsize=22556 CPUtime=23.65 cores=0,2
/proc/26049/stat : 26049 (SATzilla2009_C) S 26042 26049 25767 0 -1 4202496 9441 74160 0 0 1095 9 1181 80 25 0 1 0 550550738 23097344 5366 33554432000 134512640 136149437 4291570192 18446744073709551615 135542781 0 0 4096 3 18446744071562232103 0 0 17 0 0 0 0
/proc/26049/statm: 5639 5366 221 400 0 5236 0
[pid=26104] ppid=26049 vsize=769724 CPUtime=978.6 cores=0,2
/proc/26104/stat : 26104 (march_dl2004) R 26049 26049 25767 0 -1 4202496 179432 0 0 0 97758 102 0 0 25 0 1 0 550553109 788197376 148750 33554432000 134512640 134996440 4288391872 18446744073709551615 134532993 0 0 8392704 0 0 0 0 17 0 0 0 0
/proc/26104/statm: 192431 148750 75 119 0 192310 0
Current children cumulated CPU time (s) 1002.25
Current children cumulated vsize (KiB) 792280

[startup+1062.3 s]
/proc/loadavg: 4.00 3.91 3.18 7/194 26205
/proc/meminfo: memFree=24589348/32950928 swapFree=67071984/67111528
[pid=26049] ppid=26042 vsize=22556 CPUtime=23.65 cores=0,2
/proc/26049/stat : 26049 (SATzilla2009_C) S 26042 26049 25767 0 -1 4202496 9441 74160 0 0 1095 9 1181 80 25 0 1 0 550550738 23097344 5366 33554432000 134512640 136149437 4291570192 18446744073709551615 135542781 0 0 4096 3 18446744071562232103 0 0 17 0 0 0 0
/proc/26049/statm: 5639 5366 221 400 0 5236 0
[pid=26104] ppid=26049 vsize=779964 CPUtime=1038.61 cores=0,2
/proc/26104/stat : 26104 (march_dl2004) R 26049 26049 25767 0 -1 4202496 183842 0 0 0 103758 103 0 0 25 0 1 0 550553109 798683136 153160 33554432000 134512640 134996440 4288391872 18446744073709551615 134533005 0 0 8392704 0 0 0 0 17 0 0 0 0
/proc/26104/statm: 194991 153160 75 119 0 194870 0
Current children cumulated CPU time (s) 1062.26
Current children cumulated vsize (KiB) 802520

[startup+1122.3 s]
/proc/loadavg: 4.00 3.93 3.23 7/194 26207
/proc/meminfo: memFree=24542564/32950928 swapFree=67071984/67111528
[pid=26049] ppid=26042 vsize=22556 CPUtime=23.65 cores=0,2
/proc/26049/stat : 26049 (SATzilla2009_C) S 26042 26049 25767 0 -1 4202496 9441 74160 0 0 1095 9 1181 80 25 0 1 0 550550738 23097344 5366 33554432000 134512640 136149437 4291570192 18446744073709551615 135542781 0 0 4096 3 18446744071562232103 0 0 17 0 0 0 0
/proc/26049/statm: 5639 5366 221 400 0 5236 0
[pid=26104] ppid=26049 vsize=790732 CPUtime=1098.6 cores=0,2
/proc/26104/stat : 26104 (march_dl2004) R 26049 26049 25767 0 -1 4202496 188509 0 0 0 109757 103 0 0 25 0 1 0 550553109 809709568 157827 33554432000 134512640 134996440 4288391872 18446744073709551615 134533013 0 0 8392704 0 0 0 0 17 0 0 0 0
/proc/26104/statm: 197683 157827 75 119 0 197562 0
Current children cumulated CPU time (s) 1122.25
Current children cumulated vsize (KiB) 813288

[startup+1182.3 s]
/proc/loadavg: 4.00 3.94 3.27 6/194 26208
/proc/meminfo: memFree=24500368/32950928 swapFree=67071984/67111528
[pid=26049] ppid=26042 vsize=22556 CPUtime=23.65 cores=0,2
/proc/26049/stat : 26049 (SATzilla2009_C) S 26042 26049 25767 0 -1 4202496 9441 74160 0 0 1095 9 1181 80 25 0 1 0 550550738 23097344 5366 33554432000 134512640 136149437 4291570192 18446744073709551615 135542781 0 0 4096 3 18446744071562232103 0 0 17 0 0 0 0
/proc/26049/statm: 5639 5366 221 400 0 5236 0
[pid=26104] ppid=26049 vsize=802196 CPUtime=1158.61 cores=0,2
/proc/26104/stat : 26104 (march_dl2004) R 26049 26049 25767 0 -1 4202496 193469 0 0 0 115756 105 0 0 25 0 1 0 550553109 821448704 162787 33554432000 134512640 134996440 4288391872 18446744073709551615 134533013 0 0 8392704 0 0 0 0 17 0 0 0 0
/proc/26104/statm: 200549 162787 75 119 0 200428 0
Current children cumulated CPU time (s) 1182.26
Current children cumulated vsize (KiB) 824752

[startup+1242.3 s]
/proc/loadavg: 4.00 3.95 3.31 7/194 26210
/proc/meminfo: memFree=24463748/32950928 swapFree=67071984/67111528
[pid=26049] ppid=26042 vsize=22556 CPUtime=23.65 cores=0,2
/proc/26049/stat : 26049 (SATzilla2009_C) S 26042 26049 25767 0 -1 4202496 9441 74160 0 0 1095 9 1181 80 25 0 1 0 550550738 23097344 5366 33554432000 134512640 136149437 4291570192 18446744073709551615 135542781 0 0 4096 3 18446744071562232103 0 0 17 0 0 0 0
/proc/26049/statm: 5639 5366 221 400 0 5236 0
[pid=26104] ppid=26049 vsize=812544 CPUtime=1218.61 cores=0,2
/proc/26104/stat : 26104 (march_dl2004) R 26049 26049 25767 0 -1 4202496 197804 0 0 0 121756 105 0 0 25 0 1 0 550553109 832045056 167122 33554432000 134512640 134996440 4288391872 18446744073709551615 134532993 0 0 8392704 0 0 0 0 17 0 0 0 0
/proc/26104/statm: 203136 167122 75 119 0 203015 0
Current children cumulated CPU time (s) 1242.26
Current children cumulated vsize (KiB) 835100



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 4.00 3.95 3.35 6/194 26211
/proc/meminfo: memFree=24430848/32950928 swapFree=67071984/67111528
[pid=26049] ppid=26042 vsize=22556 CPUtime=23.65 cores=0,2
/proc/26049/stat : 26049 (SATzilla2009_C) S 26042 26049 25767 0 -1 4202496 9441 74160 0 0 1095 9 1181 80 25 0 1 0 550550738 23097344 5366 33554432000 134512640 136149437 4291570192 18446744073709551615 135542781 0 0 4096 3 18446744071562232103 0 0 17 0 0 0 0
/proc/26049/statm: 5639 5366 221 400 0 5236 0
[pid=26104] ppid=26049 vsize=821956 CPUtime=1276.32 cores=0,2
/proc/26104/stat : 26104 (march_dl2004) R 26049 26049 25767 0 -1 4202496 201929 0 0 0 127526 106 0 0 25 0 1 0 550553109 841682944 171247 33554432000 134512640 134996440 4288391872 18446744073709551615 134533010 0 0 8392704 0 0 0 0 17 0 0 0 0
/proc/26104/statm: 205489 171247 75 119 0 205368 0
Current children cumulated CPU time (s) 1299.97
Current children cumulated vsize (KiB) 844512

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 26049 and gives
#  childrusage.ru_utime.tv_sec=22
#  childrusage.ru_utime.tv_usec=771538
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=908861
# CPU time returned by wait4() is 23.6804
# while last known CPU time is 1299.97
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1300.01
CPU time (s): 1299.97
CPU user time (s): 1298.02
CPU system time (s): 1.95
CPU usage (%): 99.9966
Max. virtual memory (cumulated for all children) (KiB): 844512

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 22.7715
system time used= 0.908861
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 83601
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 17
involuntary context switches= 441

runsolver used 2.17267 second user time and 4.91025 second system time

The end

Launcher Data 

Begin job on node116 at 2011-04-24 01:59:59
IDJOB=3274381
IDBENCH=83198
IDSOLVER=1675
FILE ID=node116/3274381-1303603199
RUNJOBID= node116-1303603199-26012
PBS_JOBID= 13150580
Free space on /tmp= 72612 MiB

SOLVER NAME= SAT09 reference solver: SATzilla2009_C 2009-03-22
BENCH NAME= SAT11/crafted/skvortsov/automata-synchronization/crn_40_1520_u.cnf
COMMAND LINE= HOME/SATzilla2009_C BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3274381-1303603199/watcher-3274381-1303603199 -o /tmp/evaluation-result-3274381-1303603199/solver-3274381-1303603199 -C 2400 -W 1300 -M 7680  HOME/SATzilla2009_C HOME/instance-3274381-1303603199.cnf

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 7680 MiB
NBCORE= 2

MD5SUM BENCH= ac02a3a5c06227748ecf75dd451ebb7e
RANDOM SEED=2000571248

node116.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      25912628 kB
Buffers:       1829148 kB
Cached:        4753268 kB
SwapCached:       9728 kB
Active:        3111360 kB
Inactive:      3510408 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      25912628 kB
SwapTotal:    67111528 kB
SwapFree:     67071984 kB
Dirty:          128492 kB
Writeback:           0 kB
AnonPages:       33876 kB
Mapped:          13488 kB
Slab:           353992 kB
PageTables:       5892 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   191696 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72488 MiB
End job on node116 at 2011-04-24 02:21:43