Trace number 3280223

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Black Hole SAT 2011-03-08? (TO) 1300.06 1300.02

General information on the benchmark

Nameindustrial/anbulagan/
hard-sat/partial-10-13-s.cnf
MD5SUMd90571b4b69632567da9d3ebfd25979e
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark200.647
Satisfiable
(Un)Satisfiability was proved
Number of variables234673
Number of clauses1071339
Sum of the clauses size2453820
Maximum clause length10
Minimum clause length1
Number of clauses of size 117679
Number of clauses of size 2856659
Number of clauses of size 3153061
Number of clauses of size 44880
Number of clauses of size 519520
Number of clauses of size over 519540

Solver Data

1.59/1.60	c RESTART
1.99/2.06	c RESTART
2.99/3.05	c RESTART
3.59/3.68	c RESTART
3.89/3.98	c RESTART
4.69/4.73	c RESTART
5.39/5.50	c RESTART
5.99/6.00	c RESTART
6.59/6.65	c RESTART
6.89/6.95	c RESTART
7.39/7.42	c RESTART
7.69/7.76	c RESTART
8.59/8.63	c RESTART
9.09/9.13	c RESTART
9.69/9.79	c RESTART
11.19/11.27	c RESTART
13.59/13.63	c RESTART
14.29/14.32	c RESTART
16.39/16.43	c RESTART
47.89/47.94	c RESTART
50.49/50.53	c RESTART
52.99/53.06	c RESTART
53.69/53.77	c RESTART
54.99/55.06	c RESTART
58.69/58.70	c RESTART
62.29/62.31	c RESTART
66.89/66.93	c RESTART
68.19/68.21	c RESTART
70.09/70.14	c RESTART
79.89/79.96	c RESTART
81.59/81.62	c RESTART
88.49/88.58	c RESTART
92.69/92.73	c RESTART
94.49/94.50	c RESTART
99.49/99.51	c RESTART
100.19/100.27	c RESTART
101.49/101.55	c RESTART
102.09/102.14	c RESTART
103.59/103.62	c RESTART
104.79/104.84	c RESTART
105.39/105.47	c RESTART
107.19/107.21	c RESTART
108.90/108.96	c RESTART
113.09/113.12	c RESTART
114.09/114.18	c RESTART
115.89/115.90	c RESTART
121.19/121.27	c RESTART
129.39/129.44	c RESTART
135.30/135.39	c RESTART
136.49/136.55	c RESTART
147.59/147.63	c RESTART
150.79/150.89	c RESTART
153.39/153.48	c RESTART
153.90/153.95	c RESTART
158.40/158.44	c RESTART
160.50/160.52	c RESTART
161.29/161.39	c RESTART
163.29/163.33	c RESTART
165.29/165.36	c RESTART
167.10/167.13	c RESTART
169.70/169.71	c RESTART
174.50/174.53	c RESTART
177.01/177.07	c RESTART
180.80/180.87	c RESTART
183.50/183.53	c RESTART
186.00/186.07	c RESTART
186.50/186.51	c RESTART
189.40/189.45	c RESTART
190.80/190.86	c RESTART
193.60/193.62	c RESTART
195.00/195.05	c RESTART
197.00/197.02	c RESTART
198.20/198.21	c RESTART
199.00/199.05	c RESTART
200.69/200.73	c RESTART
202.69/202.71	c RESTART
204.99/205.05	c RESTART
210.79/210.80	c RESTART
214.40/214.46	c RESTART
215.89/215.93	c RESTART
217.09/217.19	c RESTART
220.00/220.03	c RESTART
221.10/221.17	c RESTART
230.19/230.27	c RESTART
231.89/231.92	c RESTART
233.79/233.84	c RESTART
237.69/237.77	c RESTART
239.29/239.38	c RESTART
243.39/243.49	c RESTART
244.59/244.67	c RESTART
245.79/245.89	c RESTART
246.49/246.59	c RESTART
248.79/248.80	c RESTART
252.19/252.20	c RESTART
253.19/253.28	c RESTART
254.29/254.34	c RESTART
256.09/256.20	c RESTART
266.89/266.97	c RESTART
273.90/273.91	c RESTART
277.99/278.06	c RESTART
296.09/296.15	c RESTART
303.39/303.41	c RESTART
303.89/303.97	c RESTART
305.29/305.33	c RESTART
307.19/307.29	c RESTART
308.79/308.81	c RESTART
309.49/309.51	c RESTART
310.20/310.24	c RESTART
311.59/311.68	c RESTART
314.51/314.56	c RESTART
315.71/315.74	c RESTART
318.10/318.19	c RESTART
324.00/324.06	c RESTART
326.80/326.85	c RESTART
333.70/333.77	c RESTART
337.20/337.22	c RESTART
341.50/341.52	c RESTART
346.70/346.79	c RESTART
348.71/348.79	c RESTART
367.60/367.65	c RESTART
370.40/370.45	c RESTART
372.00/372.08	c RESTART
373.40/373.45	c RESTART
376.50/376.51	c RESTART
377.80/377.87	c RESTART
381.90/381.99	c RESTART
385.01/385.02	c RESTART
391.20/391.24	c RESTART
393.90/393.90	c RESTART
395.70/395.79	c RESTART
399.40/399.44	c RESTART
401.00/401.06	c RESTART
403.80/403.80	c RESTART
413.51/413.55	c RESTART
415.50/415.52	c RESTART
426.60/426.62	c RESTART
430.20/430.21	c RESTART
437.81/437.88	c RESTART
452.31/452.34	c RESTART
485.51/485.58	c RESTART
495.91/495.96	c RESTART
503.81/503.89	c RESTART
506.51/506.50	c RESTART
508.91/508.95	c RESTART
511.51/511.53	c RESTART
515.81/515.87	c RESTART
519.11/519.10	c RESTART
522.81/522.88	c RESTART
524.41/524.47	c RESTART
525.91/525.91	c RESTART
527.71/527.72	c RESTART
529.30/529.36	c RESTART
531.60/531.64	c RESTART
532.60/532.68	c RESTART
533.90/533.95	c RESTART
535.10/535.11	c RESTART
536.20/536.20	c RESTART
573.60/573.69	c RESTART
613.91/613.97	c RESTART
616.01/616.08	c RESTART
628.31/628.36	c RESTART
630.01/630.01	c RESTART
631.11/631.12	c RESTART
632.61/632.65	c RESTART
633.11/633.14	c RESTART
635.11/635.18	c RESTART
637.01/637.03	c RESTART
639.31/639.36	c RESTART
640.31/640.32	c RESTART
642.51/642.57	c RESTART
656.91/656.94	c RESTART
660.81/660.83	c RESTART
675.21/675.20	c RESTART
677.71/677.77	c RESTART
679.61/679.63	c RESTART
681.11/681.13	c RESTART
682.71/682.72	c RESTART
684.71/684.74	c RESTART
686.61/686.64	c RESTART
687.91/687.91	c RESTART
690.81/690.86	c RESTART
691.71/691.79	c RESTART
693.41/693.46	c RESTART
694.31/694.38	c RESTART
695.71/695.78	c RESTART
697.51/697.56	c RESTART
699.41/699.42	c RESTART
711.81/711.89	c RESTART
719.21/719.24	c RESTART
721.61/721.65	c RESTART
725.41/725.44	c RESTART
727.31/727.32	c RESTART
728.61/728.66	c RESTART
731.81/731.90	c RESTART
734.72/734.73	c RESTART
735.72/735.74	c RESTART
740.11/740.19	c RESTART
740.91/740.91	c RESTART
742.02/742.09	c RESTART
743.71/743.75	c RESTART
745.01/745.05	c RESTART
746.82/746.85	c RESTART
749.02/749.09	c RESTART
750.71/750.77	c RESTART
753.42/753.49	c RESTART
756.31/756.32	c RESTART
760.41/760.42	c RESTART
762.01/762.01	c RESTART
762.91/762.98	c RESTART
765.52/765.58	c RESTART
771.51/771.53	c RESTART
772.51/772.58	c RESTART
775.11/775.13	c RESTART
776.71/776.79	c RESTART
778.21/778.26	c RESTART
780.92/780.91	c RESTART
782.51/782.50	c RESTART
783.71/783.71	c RESTART
785.81/785.83	c RESTART
787.11/787.11	c RESTART
791.11/791.18	c RESTART
798.31/798.37	c RESTART
799.01/799.03	c RESTART
804.12/804.15	c RESTART
812.61/812.61	c RESTART
814.02/814.07	c RESTART
823.01/823.01	c RESTART
824.21/824.25	c RESTART
824.92/824.94	c RESTART
847.82/847.83	c RESTART
853.02/853.02	c RESTART
862.72/862.79	c RESTART
867.62/867.62	c RESTART
868.92/868.98	c RESTART
876.02/876.00	c RESTART
885.02/885.05	c RESTART
892.12/892.12	c RESTART
895.72/895.75	c RESTART
901.12/901.19	c RESTART
903.41/903.45	c RESTART
905.91/905.98	c RESTART
907.31/907.34	c RESTART
908.52/908.56	c RESTART
910.01/910.03	c RESTART
915.12/915.16	c RESTART
916.91/916.98	c RESTART
921.41/921.43	c RESTART
932.21/932.27	c RESTART
935.51/935.52	c RESTART
936.61/936.62	c RESTART
946.81/946.84	c RESTART
947.61/947.68	c RESTART
948.51/948.59	c RESTART
950.71/950.70	c RESTART
952.02/952.00	c RESTART
953.52/953.56	c RESTART
957.32/957.34	c RESTART
958.72/958.75	c RESTART
961.02/961.02	c RESTART
962.82/962.85	c RESTART
965.02/965.06	c RESTART
973.22/973.25	c RESTART
976.92/976.93	c RESTART
981.13/981.11	c RESTART
994.92/994.97	c RESTART
1003.42/1003.42	c RESTART
1008.73/1008.79	c RESTART
1013.62/1013.68	c RESTART
1014.62/1014.60	c RESTART
1015.62/1015.64	c RESTART
1017.62/1017.69	c RESTART
1020.32/1020.36	c RESTART
1021.52/1021.58	c RESTART
1023.52/1023.54	c RESTART
1025.02/1025.04	c RESTART
1027.42/1027.41	c RESTART
1037.02/1037.00	c RESTART
1051.02/1051.05	c RESTART
1063.52/1063.53	c RESTART
1072.12/1072.17	c RESTART
1078.22/1078.24	c RESTART
1080.52/1080.58	c RESTART
1081.62/1081.69	c RESTART
1093.62/1093.62	c RESTART
1096.12/1096.14	c RESTART
1098.02/1098.09	c RESTART
1109.02/1109.01	c RESTART
1116.22/1116.22	c RESTART
1116.82/1116.84	c RESTART
1131.93/1131.91	c RESTART
1134.13/1134.18	c RESTART
1136.62/1136.65	c RESTART
1138.22/1138.26	c RESTART
1143.42/1143.41	c RESTART
1147.52/1147.52	c RESTART
1149.53/1149.58	c RESTART
1153.12/1153.19	c RESTART
1157.23/1157.21	c RESTART
1163.22/1163.27	c RESTART
1167.82/1167.85	c RESTART
1177.42/1177.49	c RESTART
1181.22/1181.23	c RESTART
1186.22/1186.21	c RESTART
1187.82/1187.83	c RESTART
1188.72/1188.75	c RESTART
1190.92/1190.93	c RESTART
1193.43/1193.44	c RESTART
1195.22/1195.20	c RESTART
1197.93/1197.93	c RESTART
1204.32/1204.33	c RESTART
1206.12/1206.13	c RESTART
1213.92/1213.95	c RESTART
1220.62/1220.62	c RESTART
1223.52/1223.58	c RESTART
1226.43/1226.47	c RESTART
1232.92/1232.90	c RESTART
1236.22/1236.27	c RESTART
1238.22/1238.26	c RESTART
1247.12/1247.16	c RESTART
1263.12/1263.10	c RESTART
1265.22/1265.29	c RESTART
1267.23/1267.24	c RESTART
1270.82/1270.81	c RESTART
1273.83/1273.84	c RESTART
1275.43/1275.42	c RESTART
1278.23/1278.27	c RESTART
1282.43/1282.41	c RESTART
1284.12/1284.16	c RESTART
1288.73/1288.72	c RESTART
1291.12/1291.14	c RESTART
1295.33/1295.37	c RESTART

Verifier Data

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3280223-1303746811/watcher-3280223-1303746811 -o /tmp/evaluation-result-3280223-1303746811/solver-3280223-1303746811 -C 2400 -W 1300 -M 7680 saturn HOME/instance-3280223-1303746811.cnf 

running on 2 cores: 4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 7864320 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 7915520 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.00 0.00 0.00 6/189 7957
/proc/meminfo: memFree=25283368/32950928 swapFree=67071984/67111528
[pid=7957] ppid=7955 vsize=54700 CPUtime=0 cores=4,6
/proc/7957/stat : 7957 (saturn) R 7955 7957 7897 0 -1 4202496 3051 0 0 0 0 0 0 0 21 0 1 0 564911948 56012800 2993 33554432000 4194304 4210924 140735004316672 18446744073709551615 4206849 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/7957/statm: 13675 3000 94 5 0 7364 0

[startup+0.039723 s]
/proc/loadavg: 0.00 0.00 0.00 6/189 7957
/proc/meminfo: memFree=25283368/32950928 swapFree=67071984/67111528
[pid=7957] ppid=7955 vsize=124212 CPUtime=0.02 cores=4,6
/proc/7957/stat : 7957 (saturn) R 7955 7957 7897 0 -1 4202496 9241 0 0 0 2 0 0 0 21 0 1 0 564911948 127193088 9183 33554432000 4194304 4210924 140735004316672 18446744073709551615 4197908 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/7957/statm: 31053 9187 282 5 0 24742 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 124212

[startup+0.100729 s]
/proc/loadavg: 0.00 0.00 0.00 6/189 7957
/proc/meminfo: memFree=25283368/32950928 swapFree=67071984/67111528
[pid=7957] ppid=7955 vsize=135432 CPUtime=0.09 cores=4,6
/proc/7957/stat : 7957 (saturn) R 7955 7957 7897 0 -1 4202496 13656 0 0 0 8 1 0 0 21 0 1 0 564911948 138682368 13598 33554432000 4194304 4210924 140735004316672 18446744073709551615 260905054917 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/7957/statm: 33858 13600 728 5 0 27547 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 135432

[startup+0.300727 s]
/proc/loadavg: 0.00 0.00 0.00 6/189 7957
/proc/meminfo: memFree=25283368/32950928 swapFree=67071984/67111528
[pid=7957] ppid=7955 vsize=168432 CPUtime=0.29 cores=4,6
/proc/7957/stat : 7957 (saturn) R 7955 7957 7897 0 -1 4202496 26777 0 0 0 26 3 0 0 22 0 1 0 564911948 172474368 26719 33554432000 4194304 4210924 140735004316672 18446744073709551615 4197908 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/7957/statm: 42108 26721 2200 5 0 35797 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 168432

[startup+0.700651 s]
/proc/loadavg: 0.00 0.00 0.00 6/189 7957
/proc/meminfo: memFree=25283368/32950928 swapFree=67071984/67111528
[pid=7957] ppid=7955 vsize=201708 CPUtime=0.69 cores=4,6
/proc/7957/stat : 7957 (saturn) R 7955 7957 7897 0 -1 4202496 49041 0 0 0 64 5 0 0 24 0 1 0 564911948 206548992 43773 33554432000 4194304 4210924 140735004316672 18446744073709551615 4206988 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/7957/statm: 50427 43773 95 5 0 48898 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 201708

[startup+1.50044 s]
/proc/loadavg: 0.00 0.00 0.00 5/190 7958
/proc/meminfo: memFree=25103940/32950928 swapFree=67071984/67111528
[pid=7957] ppid=7955 vsize=201708 CPUtime=1.49 cores=4,6
/proc/7957/stat : 7957 (saturn) R 7955 7957 7897 0 -1 4202496 49401 0 0 0 144 5 0 0 25 0 1 0 564911948 206548992 44103 33554432000 4194304 4210924 140735004316672 18446744073709551615 4198608 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/7957/statm: 50427 44103 96 5 0 48898 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 201708

[startup+3.10015 s]
/proc/loadavg: 0.32 0.07 0.02 5/190 7958
/proc/meminfo: memFree=25103524/32950928 swapFree=67071984/67111528
[pid=7957] ppid=7955 vsize=201840 CPUtime=3.09 cores=4,6
/proc/7957/stat : 7957 (saturn) R 7955 7957 7897 0 -1 4202496 49447 0 0 0 304 5 0 0 25 0 1 0 564911948 206684160 44149 33554432000 4194304 4210924 140735004316672 18446744073709551615 4198608 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/7957/statm: 50460 44149 102 5 0 48931 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 201840

[startup+6.30063 s]
/proc/loadavg: 0.32 0.07 0.02 5/190 7958
/proc/meminfo: memFree=25101664/32950928 swapFree=67071984/67111528
[pid=7957] ppid=7955 vsize=202236 CPUtime=6.29 cores=4,6
/proc/7957/stat : 7957 (saturn) R 7955 7957 7897 0 -1 4202496 49607 0 0 0 624 5 0 0 25 0 1 0 564911948 207089664 44309 33554432000 4194304 4210924 140735004316672 18446744073709551615 4204590 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/7957/statm: 50559 44309 102 5 0 49030 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 202236

[startup+12.7005 s]
/proc/loadavg: 0.61 0.13 0.04 5/190 7959
/proc/meminfo: memFree=25095232/32950928 swapFree=67071984/67111528
[pid=7957] ppid=7955 vsize=203692 CPUtime=12.69 cores=4,6
/proc/7957/stat : 7957 (saturn) R 7955 7957 7897 0 -1 4202496 49972 0 0 0 1264 5 0 0 25 0 1 0 564911948 208580608 44674 33554432000 4194304 4210924 140735004316672 18446744073709551615 4198674 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/7957/statm: 50923 44674 103 5 0 49394 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 203692

[startup+25.5011 s]
/proc/loadavg: 1.36 0.32 0.11 5/190 7959
/proc/meminfo: memFree=25089240/32950928 swapFree=67071984/67111528
[pid=7957] ppid=7955 vsize=204104 CPUtime=25.49 cores=4,6
/proc/7957/stat : 7957 (saturn) R 7955 7957 7897 0 -1 4202496 50062 0 0 0 2544 5 0 0 25 0 1 0 564911948 209002496 44764 33554432000 4194304 4210924 140735004316672 18446744073709551615 4204590 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/7957/statm: 51026 44764 103 5 0 49497 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 204104

[startup+51.1004 s]
/proc/loadavg: 2.26 0.62 0.21 5/190 7960
/proc/meminfo: memFree=25081432/32950928 swapFree=67071984/67111528
[pid=7957] ppid=7955 vsize=204508 CPUtime=51.09 cores=4,6
/proc/7957/stat : 7957 (saturn) R 7955 7957 7897 0 -1 4202496 50189 0 0 0 5104 5 0 0 25 0 1 0 564911948 209416192 44891 33554432000 4194304 4210924 140735004316672 18446744073709551615 4206991 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/7957/statm: 51127 44891 103 5 0 49598 0
Current children cumulated CPU time (s) 51.09
Current children cumulated vsize (KiB) 204508

[startup+102.307 s]
/proc/loadavg: 3.30 1.18 0.42 5/190 7961
/proc/meminfo: memFree=25052056/32950928 swapFree=67071984/67111528
[pid=7957] ppid=7955 vsize=214568 CPUtime=102.3 cores=4,6
/proc/7957/stat : 7957 (saturn) R 7955 7957 7897 0 -1 4202496 52688 0 0 0 10225 5 0 0 25 0 1 0 564911948 219717632 47390 33554432000 4194304 4210924 140735004316672 18446744073709551615 4206991 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/7957/statm: 53642 47390 104 5 0 52113 0
Current children cumulated CPU time (s) 102.3
Current children cumulated vsize (KiB) 214568

[startup+162.301 s]
/proc/loadavg: 3.72 1.65 0.63 5/190 7963
/proc/meminfo: memFree=25033024/32950928 swapFree=67071984/67111528
[pid=7957] ppid=7955 vsize=224220 CPUtime=162.29 cores=4,6
/proc/7957/stat : 7957 (saturn) R 7955 7957 7897 0 -1 4202496 55089 0 0 0 16224 5 0 0 25 0 1 0 564911948 229601280 49791 33554432000 4194304 4210924 140735004316672 18446744073709551615 4204579 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/7957/statm: 56055 49791 104 5 0 54526 0
Current children cumulated CPU time (s) 162.29
Current children cumulated vsize (KiB) 224220

[startup+222.301 s]
/proc/loadavg: 3.90 2.11 0.85 5/190 7964
/proc/meminfo: memFree=25001732/32950928 swapFree=67071984/67111528
[pid=7957] ppid=7955 vsize=238720 CPUtime=222.29 cores=4,6
/proc/7957/stat : 7957 (saturn) R 7955 7957 7897 0 -1 4202496 58728 0 0 0 22223 6 0 0 25 0 1 0 564911948 244449280 53430 33554432000 4194304 4210924 140735004316672 18446744073709551615 4198608 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/7957/statm: 59680 53430 104 5 0 58151 0
Current children cumulated CPU time (s) 222.29
Current children cumulated vsize (KiB) 238720

[startup+282.301 s]
/proc/loadavg: 3.96 2.43 1.03 5/190 7966
/proc/meminfo: memFree=24988188/32950928 swapFree=67071984/67111528
[pid=7957] ppid=7955 vsize=248180 CPUtime=282.29 cores=4,6
/proc/7957/stat : 7957 (saturn) R 7955 7957 7897 0 -1 4202496 61118 0 0 0 28223 6 0 0 25 0 1 0 564911948 254136320 55820 33554432000 4194304 4210924 140735004316672 18446744073709551615 4206991 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/7957/statm: 62045 55820 104 5 0 60516 0
Current children cumulated CPU time (s) 282.29
Current children cumulated vsize (KiB) 248180

[startup+342.301 s]
/proc/loadavg: 3.98 2.71 1.21 5/190 7967
/proc/meminfo: memFree=24979596/32950928 swapFree=67071984/67111528
[pid=7957] ppid=7955 vsize=251380 CPUtime=342.3 cores=4,6
/proc/7957/stat : 7957 (saturn) R 7955 7957 7897 0 -1 4202496 61894 0 0 0 34223 7 0 0 25 0 1 0 564911948 257413120 56596 33554432000 4194304 4210924 140735004316672 18446744073709551615 4204590 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/7957/statm: 62845 56596 104 5 0 61316 0
Current children cumulated CPU time (s) 342.3
Current children cumulated vsize (KiB) 251380

[startup+402.3 s]
/proc/loadavg: 4.07 2.96 1.39 5/190 7969
/proc/meminfo: memFree=24962212/32950928 swapFree=67071984/67111528
[pid=7957] ppid=7955 vsize=258612 CPUtime=402.3 cores=4,6
/proc/7957/stat : 7957 (saturn) R 7955 7957 7897 0 -1 4202496 63717 0 0 0 40223 7 0 0 25 0 1 0 564911948 264818688 58419 33554432000 4194304 4210924 140735004316672 18446744073709551615 4204579 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/7957/statm: 64653 58419 104 5 0 63124 0
Current children cumulated CPU time (s) 402.3
Current children cumulated vsize (KiB) 258612

[startup+462.3 s]
/proc/loadavg: 4.06 3.16 1.56 5/190 7980
/proc/meminfo: memFree=24956800/32950928 swapFree=67071984/67111528
[pid=7957] ppid=7955 vsize=258612 CPUtime=462.3 cores=4,6
/proc/7957/stat : 7957 (saturn) R 7955 7957 7897 0 -1 4202496 63717 0 0 0 46223 7 0 0 25 0 1 0 564911948 264818688 58419 33554432000 4194304 4210924 140735004316672 18446744073709551615 4204590 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/7957/statm: 64653 58419 104 5 0 63124 0
Current children cumulated CPU time (s) 462.3
Current children cumulated vsize (KiB) 258612

[startup+522.3 s]
/proc/loadavg: 4.02 3.31 1.71 5/190 7981
/proc/meminfo: memFree=24943600/32950928 swapFree=67071984/67111528
[pid=7957] ppid=7955 vsize=261384 CPUtime=522.31 cores=4,6
/proc/7957/stat : 7957 (saturn) R 7955 7957 7897 0 -1 4202496 64407 0 0 0 52224 7 0 0 25 0 1 0 564911948 267657216 59109 33554432000 4194304 4210924 140735004316672 18446744073709551615 4207051 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/7957/statm: 65346 59109 104 5 0 63817 0
Current children cumulated CPU time (s) 522.31
Current children cumulated vsize (KiB) 261384

[startup+582.3 s]
/proc/loadavg: 4.01 3.43 1.85 5/190 7983
/proc/meminfo: memFree=24920620/32950928 swapFree=67071984/67111528
[pid=7957] ppid=7955 vsize=268960 CPUtime=582.3 cores=4,6
/proc/7957/stat : 7957 (saturn) R 7955 7957 7897 0 -1 4202496 66293 0 0 0 58223 7 0 0 25 0 1 0 564911948 275415040 60995 33554432000 4194304 4210924 140735004316672 18446744073709551615 4206991 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/7957/statm: 67240 60995 104 5 0 65711 0
Current children cumulated CPU time (s) 582.3
Current children cumulated vsize (KiB) 268960

[startup+642.3 s]
/proc/loadavg: 4.00 3.54 1.99 5/190 7984
/proc/meminfo: memFree=24901120/32950928 swapFree=67071984/67111528
[pid=7957] ppid=7955 vsize=273452 CPUtime=642.32 cores=4,6
/proc/7957/stat : 7957 (saturn) R 7955 7957 7897 0 -1 4202496 67437 0 0 0 64224 8 0 0 25 0 1 0 564911948 280014848 62139 33554432000 4194304 4210924 140735004316672 18446744073709551615 4206991 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/7957/statm: 68363 62139 104 5 0 66834 0
Current children cumulated CPU time (s) 642.32
Current children cumulated vsize (KiB) 273452

[startup+702.3 s]
/proc/loadavg: 4.07 3.63 2.11 5/190 7986
/proc/meminfo: memFree=24869452/32950928 swapFree=67071984/67111528
[pid=7957] ppid=7955 vsize=286448 CPUtime=702.31 cores=4,6
/proc/7957/stat : 7957 (saturn) R 7955 7957 7897 0 -1 4202496 70669 0 0 0 70223 8 0 0 25 0 1 0 564911948 293322752 65371 33554432000 4194304 4210924 140735004316672 18446744073709551615 4204590 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/7957/statm: 71612 65371 104 5 0 70083 0
Current children cumulated CPU time (s) 702.31
Current children cumulated vsize (KiB) 286448

[startup+762.307 s]
/proc/loadavg: 4.02 3.70 2.23 5/190 7988
/proc/meminfo: memFree=24850708/32950928 swapFree=67071984/67111528
[pid=7957] ppid=7955 vsize=301676 CPUtime=762.32 cores=4,6
/proc/7957/stat : 7957 (saturn) R 7955 7957 7897 0 -1 4202496 74469 0 0 0 76223 9 0 0 25 0 1 0 564911948 308916224 69171 33554432000 4194304 4210924 140735004316672 18446744073709551615 4206192 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/7957/statm: 75419 69171 104 5 0 73890 0
Current children cumulated CPU time (s) 762.32
Current children cumulated vsize (KiB) 301676

[startup+822.3 s]
/proc/loadavg: 4.01 3.75 2.33 5/190 7989
/proc/meminfo: memFree=24843480/32950928 swapFree=67071984/67111528
[pid=7957] ppid=7955 vsize=303180 CPUtime=822.31 cores=4,6
/proc/7957/stat : 7957 (saturn) R 7955 7957 7897 0 -1 4202496 74852 0 0 0 82222 9 0 0 25 0 1 0 564911948 310456320 69554 33554432000 4194304 4210924 140735004316672 18446744073709551615 4204590 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/7957/statm: 75795 69554 104 5 0 74266 0
Current children cumulated CPU time (s) 822.31
Current children cumulated vsize (KiB) 303180

[startup+882.3 s]
/proc/loadavg: 4.00 3.80 2.44 5/190 7991
/proc/meminfo: memFree=24835136/32950928 swapFree=67071984/67111528
[pid=7957] ppid=7955 vsize=304144 CPUtime=882.32 cores=4,6
/proc/7957/stat : 7957 (saturn) R 7955 7957 7897 0 -1 4202496 75117 0 0 0 88223 9 0 0 25 0 1 0 564911948 311443456 69819 33554432000 4194304 4210924 140735004316672 18446744073709551615 4204579 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/7957/statm: 76036 69819 104 5 0 74507 0
Current children cumulated CPU time (s) 882.32
Current children cumulated vsize (KiB) 304144

[startup+942.3 s]
/proc/loadavg: 4.00 3.83 2.53 5/190 7992
/proc/meminfo: memFree=24820976/32950928 swapFree=67071984/67111528
[pid=7957] ppid=7955 vsize=311580 CPUtime=942.31 cores=4,6
/proc/7957/stat : 7957 (saturn) R 7955 7957 7897 0 -1 4202496 76948 0 0 0 94222 9 0 0 25 0 1 0 564911948 319057920 71650 33554432000 4194304 4210924 140735004316672 18446744073709551615 4206988 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/7957/statm: 77895 71650 104 5 0 76366 0
Current children cumulated CPU time (s) 942.31
Current children cumulated vsize (KiB) 311580

[startup+1002.3 s]
/proc/loadavg: 4.04 3.87 2.63 5/190 7994
/proc/meminfo: memFree=24803328/32950928 swapFree=67071984/67111528
[pid=7957] ppid=7955 vsize=316924 CPUtime=1002.32 cores=4,6
/proc/7957/stat : 7957 (saturn) R 7955 7957 7897 0 -1 4202496 78306 0 0 0 100222 10 0 0 25 0 1 0 564911948 324530176 73008 33554432000 4194304 4210924 140735004316672 18446744073709551615 4204749 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/7957/statm: 79231 73008 104 5 0 77702 0
Current children cumulated CPU time (s) 1002.32
Current children cumulated vsize (KiB) 316924

[startup+1062.3 s]
/proc/loadavg: 4.01 3.89 2.71 5/190 7996
/proc/meminfo: memFree=24789788/32950928 swapFree=67071984/67111528
[pid=7957] ppid=7955 vsize=321864 CPUtime=1062.32 cores=4,6
/proc/7957/stat : 7957 (saturn) R 7955 7957 7897 0 -1 4202496 79522 0 0 0 106222 10 0 0 25 0 1 0 564911948 329588736 74224 33554432000 4194304 4210924 140735004316672 18446744073709551615 4206489 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/7957/statm: 80466 74224 104 5 0 78937 0
Current children cumulated CPU time (s) 1062.32
Current children cumulated vsize (KiB) 321864

[startup+1122.3 s]
/proc/loadavg: 4.00 3.91 2.79 5/190 7997
/proc/meminfo: memFree=24787264/32950928 swapFree=67071984/67111528
[pid=7957] ppid=7955 vsize=322924 CPUtime=1122.32 cores=4,6
/proc/7957/stat : 7957 (saturn) R 7955 7957 7897 0 -1 4202496 79807 0 0 0 112222 10 0 0 25 0 1 0 564911948 330674176 74509 33554432000 4194304 4210924 140735004316672 18446744073709551615 4198608 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/7957/statm: 80731 74509 104 5 0 79202 0
Current children cumulated CPU time (s) 1122.32
Current children cumulated vsize (KiB) 322924

[startup+1182.3 s]
/proc/loadavg: 4.00 3.92 2.86 5/190 7999
/proc/meminfo: memFree=24780292/32950928 swapFree=67071984/67111528
[pid=7957] ppid=7955 vsize=324032 CPUtime=1182.32 cores=4,6
/proc/7957/stat : 7957 (saturn) R 7955 7957 7897 0 -1 4202496 80069 0 0 0 118222 10 0 0 25 0 1 0 564911948 331808768 74771 33554432000 4194304 4210924 140735004316672 18446744073709551615 4198608 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/7957/statm: 81008 74771 104 5 0 79479 0
Current children cumulated CPU time (s) 1182.32
Current children cumulated vsize (KiB) 324032

[startup+1242.3 s]
/proc/loadavg: 4.06 3.95 2.93 5/190 8000
/proc/meminfo: memFree=24752968/32950928 swapFree=67071984/67111528
[pid=7957] ppid=7955 vsize=327448 CPUtime=1242.32 cores=4,6
/proc/7957/stat : 7957 (saturn) R 7955 7957 7897 0 -1 4202496 80940 0 0 0 124222 10 0 0 25 0 1 0 564911948 335306752 75642 33554432000 4194304 4210924 140735004316672 18446744073709551615 4204579 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/7957/statm: 81862 75642 104 5 0 80333 0
Current children cumulated CPU time (s) 1242.32
Current children cumulated vsize (KiB) 327448



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 4.06 3.97 3.00 2/184 8005
/proc/meminfo: memFree=25482720/32950928 swapFree=67071984/67111528
[pid=7957] ppid=7955 vsize=329676 CPUtime=1300.03 cores=4,6
/proc/7957/stat : 7957 (saturn) R 7955 7957 7897 0 -1 4202496 81479 0 0 0 129993 10 0 0 25 0 1 0 564911948 337588224 76181 33554432000 4194304 4210924 140735004316672 18446744073709551615 4198608 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/7957/statm: 82419 76181 104 5 0 80890 0
Current children cumulated CPU time (s) 1300.03
Current children cumulated vsize (KiB) 329676

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1300.02
CPU time (s): 1300.06
CPU user time (s): 1299.94
CPU system time (s): 0.123981
CPU usage (%): 100.003
Max. virtual memory (cumulated for all children) (KiB): 329676

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1299.94
system time used= 0.123981
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 81479
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3
involuntary context switches= 1937

runsolver used 2.07768 second user time and 5.04223 second system time

The end

Launcher Data

Begin job on node116 at 2011-04-25 17:53:33
IDJOB=3280223
IDBENCH=20353
IDSOLVER=1583
FILE ID=node116/3280223-1303746811
RUNJOBID= node116-1303746808-7916
PBS_JOBID= 13154046
Free space on /tmp= 72548 MiB

SOLVER NAME= Black Hole SAT 2011-03-08
BENCH NAME= SAT07/industrial/anbulagan/hard-sat/partial-10-13-s.cnf
COMMAND LINE= saturn BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3280223-1303746811/watcher-3280223-1303746811 -o /tmp/evaluation-result-3280223-1303746811/solver-3280223-1303746811 -C 2400 -W 1300 -M 7680  saturn HOME/instance-3280223-1303746811.cnf

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 7680 MiB
NBCORE= 2

MD5SUM BENCH= d90571b4b69632567da9d3ebfd25979e
RANDOM SEED=2106019956

node116.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      25283648 kB
Buffers:       1855080 kB
Cached:        4842808 kB
SwapCached:       9732 kB
Active:        3678308 kB
Inactive:      3567040 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      25283648 kB
SwapTotal:    67111528 kB
SwapFree:     67071984 kB
Dirty:           75056 kB
Writeback:           0 kB
AnonPages:      541360 kB
Mapped:          14360 kB
Slab:           357208 kB
PageTables:       6304 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   815852 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72604 MiB
End job on node116 at 2011-04-25 18:15:15