Trace number 1578781

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SATzilla2009_I 2009-03-22? (exit code) 1199.53 1200.13

General information on the benchmark

NameAPPLICATIONS/diagnosis/
UTI-20-5p0.cnf
MD5SUM5588dd996576f939b8ae497437078705
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables225296
Number of clauses1192799
Sum of the clauses size2872868
Maximum clause length10
Minimum clause length1
Number of clauses of size 111403
Number of clauses of size 2852883
Number of clauses of size 3271793
Number of clauses of size 46300
Number of clauses of size 525200
Number of clauses of size over 525220

Solver Data

88.59/88.70	c SATzilla is building models for class 3
88.59/88.70	c run presolver mxc-sr08 for 10 seconds ... 
88.59/88.70	c Bin: Executing mxc-sr08
88.59/88.70	c spawning binary file with 10 seconds ...
88.59/88.70	c child exit by a signal
88.59/88.70	c mxc-sr08 returned code 137.
88.59/88.70	c run presolver picosat846 for 5 seconds ... 
88.59/88.70	c Bin: Executing picosat846
88.59/88.70	c spawning binary file with 5 seconds ...
88.59/88.70	c child exit by a signal
88.59/88.70	c picosat846 returned code 137.
88.59/88.70	c Orignal number of varibales is 225296, number of clauses is 1192799 
88.59/88.70	c predicted feature computation time is 31.237099 
88.59/88.70	c Bin: Executing satelite
88.59/88.70	c spawning binary file with 240 seconds ...
88.59/88.70	c child exited successfully
88.59/88.70	c satzilla computing base features
88.59/88.70	c Number of variabe is: 121563, Number of clause is : 824850 
88.59/88.70	c Initializing...
88.59/88.70	c satzilla doing clause learning
88.59/88.70	c start clause learning features ...
88.59/88.70	c Bin: Executing zchaff07
88.59/88.70	c spawning binary file with 2 seconds ...
88.59/88.70	c child exit by a signal
88.59/88.70	c satzilla doing survey propogation probe
88.59/88.70	c do survay propogation for 2 second ...
88.59/88.70	c satzilla doing local search probe
88.59/88.70	c features are:225296 1.1928e+06 121563 824850 0.853327 0.44608 0.147376 0.40184 0.915425 1.41322 2.30378e-05 0.441602 1.64524e-05 8.22619e-05 1.09066 0.52552 0.866967 2.30378e-05 0.734519 8.48639e-06 8.24392e-05 3.01845 0.223718 0.149021 0 0.833333 2.85449 1.29055e-05 0.84214 3.63702e-06 5.57677e-05 2.73284 0.697978 2.51977e-05 0.647014 6.06171e-06 9.09256e-05 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0.647549 0.474649 4.2381e-06 1 0.945692 0.171834 0.891543 0.346389 0.789575 0.0187641 0.985759 -1.26514e-16 0.0787949 0.0461262 8.12798e-07 0.0348171 0.00201902 0.00923582 46552 0 0 0 0 0 0 4.01898 0 1.46574 0 
88.59/88.70	c satzilla's ranking:
88.59/88.70	c 1) mxc-sr08: 2.716575
88.59/88.70	c 2) picosat846: 2.389905
88.59/88.70	c 3) minisat20SAT07: 1.274170
88.59/88.70	c 4) zchaff_rand: 1.131062
88.59/88.70	c 5) march_dl2004: 0.076224
88.59/88.70	c 6) SATenstein: -10000.000000
88.59/88.70	c 7) gnovelty+: -10000.000000
88.59/88.70	c 8) adaptg2wsat+: -10000.000000
88.59/88.70	c 9) adaptg2wsat0: -10000.000000
88.59/88.70	c 10) tts-4-0: -10000.000000
88.59/88.70	c 11) vallst: -10000.000000
88.59/88.70	c 12) minisat20: -10000.000000
88.59/88.70	c 13) kcnfs04SAT07: -10000.000000
88.59/88.70	c satzilla running mxc-sr08 ... 
1199.47/1200.10	c Bin: Executing mxc-sr08
1199.47/1200.10	c spawning binary file with 1111 seconds ...
1199.47/1200.10	c child exit by a signal
1199.47/1200.10	c mxc-sr08 returned code 137.
1199.47/1200.10	c satzilla running picosat846 ... 
1199.47/1200.10	c Bin: Executing picosat846
1199.47/1200.10	c picosat846 returned code 1.
1199.47/1200.10	c satzilla running minisat20SAT07 ... 
1199.47/1200.10	c Bin: Executing minisat20SAT07
1199.47/1200.10	c minisat20SAT07 returned code 1.
1199.47/1200.10	c satzilla running zchaff_rand ... 
1199.47/1200.10	c Bin: Executing zchaff_rand
1199.47/1200.10	c zchaff_rand returned code 1.
1199.47/1200.10	c satzilla running march_dl2004 ... 
1199.47/1200.10	c Bin: Executing march_dl2004
1199.47/1200.10	c march_dl2004 returned code 1.
1199.47/1200.10	c satzilla running SATenstein ... 
1199.47/1200.10	c Bin: Executing SATenstein
1199.47/1200.10	c SATenstein returned code 1.
1199.47/1200.10	c satzilla running gnovelty+ ... 
1199.47/1200.10	c Bin: Executing gnovelty+
1199.47/1200.10	c gnovelty+ returned code 1.
1199.47/1200.10	c satzilla running adaptg2wsat+ ... 
1199.47/1200.10	c Bin: Executing adaptg2wsat+
1199.47/1200.10	c adaptg2wsat+ returned code 1.
1199.47/1200.10	c satzilla running adaptg2wsat0 ... 
1199.47/1200.10	c Bin: Executing adaptg2wsat0
1199.47/1200.10	c adaptg2wsat0 returned code 1.
1199.47/1200.10	c satzilla running tts-4-0 ... 
1199.47/1200.10	c Bin: Executing tts-4-0
1199.47/1200.10	c tts-4-0 returned code 1.
1199.47/1200.10	c satzilla running vallst ... 
1199.47/1200.10	c Bin: Executing vallst
1199.47/1200.10	c vallst returned code 1.
1199.47/1200.10	c satzilla running minisat20 ... 
1199.47/1200.10	c Bin: Executing minisat20
1199.47/1200.10	c minisat20 returned code 1.
1199.47/1200.10	c satzilla running kcnfs04SAT07 ... 
1199.47/1200.10	c Bin: Executing kcnfs04SAT07
1199.47/1200.10	c kcnfs04SAT07 returned code 1.
1199.47/1200.10	c ERROR: All Failed! 
1199.47/1200.10	c SATZILLA_TIME=1199.670000

Verifier Data

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data

runsolver version 3.2.9 (svn:492) (c) roussel@cril.univ-artois.fr

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-1578781-1238900880/watcher-1578781-1238900880 -o /tmp/evaluation-result-1578781-1238900880/solver-1578781-1238900880 -C 1200 -W 1800 -M 1800 --output-limit 1,15 HOME/SATzilla2009_I HOME/instance-1578781-1238900880.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1200 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1230 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.86 0.97 0.99 3/65 29771
/proc/meminfo: memFree=1574632/2055920 swapFree=4178712/4192956
[pid=29771] ppid=29769 vsize=2056 CPUtime=0
/proc/29771/stat : 29771 (SATzilla2009_I) S 29769 29771 29734 0 -1 4194304 132 0 0 0 0 0 0 0 18 0 1 0 516422070 2105344 112 1992294400 134512640 136149169 4294956224 18446744073709551615 135542605 0 0 4096 0 18446744071563356171 0 0 17 0 0 0
/proc/29771/statm: 514 112 96 399 0 111 0
[pid=29772] ppid=29771 vsize=23140 CPUtime=0
/proc/29772/stat : 29772 (mxc-sr08) R 29771 29771 29734 0 -1 4194304 718 0 0 0 0 0 0 0 19 0 1 0 516422070 23695360 714 1992294400 134512640 135078026 4294956192 18446744073709551615 4294960144 0 0 8392704 0 0 0 0 17 0 0 0
/proc/29772/statm: 5785 720 44 138 0 5644 0

[startup+0.073696 s]
/proc/loadavg: 0.86 0.97 0.99 3/65 29771
/proc/meminfo: memFree=1574632/2055920 swapFree=4178712/4192956
[pid=29771] ppid=29769 vsize=2056 CPUtime=0
/proc/29771/stat : 29771 (SATzilla2009_I) S 29769 29771 29734 0 -1 4194304 132 0 0 0 0 0 0 0 18 0 1 0 516422070 2105344 112 1992294400 134512640 136149169 4294956224 18446744073709551615 135542605 0 0 4096 0 18446744071563356171 0 0 17 0 0 0
/proc/29771/statm: 514 112 96 399 0 111 0
[pid=29772] ppid=29771 vsize=52064 CPUtime=0.06
/proc/29772/stat : 29772 (mxc-sr08) R 29771 29771 29734 0 -1 4194304 11156 0 0 0 1 5 0 0 19 0 1 0 516422070 53313536 11150 1992294400 134512640 135078026 4294956192 18446744073709551615 134555093 0 0 8392704 0 0 0 0 17 0 0 0
/proc/29772/statm: 13016 11153 52 138 0 12875 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 54120

[startup+0.101699 s]
/proc/loadavg: 0.86 0.97 0.99 3/65 29771
/proc/meminfo: memFree=1574632/2055920 swapFree=4178712/4192956
[pid=29771] ppid=29769 vsize=2056 CPUtime=0
/proc/29771/stat : 29771 (SATzilla2009_I) S 29769 29771 29734 0 -1 4194304 132 0 0 0 0 0 0 0 18 0 1 0 516422070 2105344 112 1992294400 134512640 136149169 4294956224 18446744073709551615 135542605 0 0 4096 0 18446744071563356171 0 0 17 0 0 0
/proc/29771/statm: 514 112 96 399 0 111 0
[pid=29772] ppid=29771 vsize=62584 CPUtime=0.09
/proc/29772/stat : 29772 (mxc-sr08) R 29771 29771 29734 0 -1 4194304 13391 0 0 0 3 6 0 0 19 0 1 0 516422070 64086016 13363 1992294400 134512640 135078026 4294956192 18446744073709551615 134554925 0 0 8392704 0 0 0 0 17 0 0 0
/proc/29772/statm: 15646 13366 52 138 0 15505 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 64640

[startup+0.30172 s]
/proc/loadavg: 0.86 0.97 0.99 3/65 29771
/proc/meminfo: memFree=1574632/2055920 swapFree=4178712/4192956
[pid=29771] ppid=29769 vsize=2056 CPUtime=0
/proc/29771/stat : 29771 (SATzilla2009_I) S 29769 29771 29734 0 -1 4194304 132 0 0 0 0 0 0 0 18 0 1 0 516422070 2105344 112 1992294400 134512640 136149169 4294956224 18446744073709551615 135542605 0 0 4096 0 18446744071563356171 0 0 17 0 0 0
/proc/29771/statm: 514 112 96 399 0 111 0
[pid=29772] ppid=29771 vsize=80324 CPUtime=0.29
/proc/29772/stat : 29772 (mxc-sr08) R 29771 29771 29734 0 -1 4194304 17450 0 0 0 22 7 0 0 21 0 1 0 516422070 82251776 17378 1992294400 134512640 135078026 4294956192 18446744073709551615 134565915 0 0 8392704 0 0 0 0 17 0 0 0
/proc/29772/statm: 20081 17379 54 138 0 19940 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 82380

[startup+0.701766 s]
/proc/loadavg: 0.86 0.97 0.99 3/65 29771
/proc/meminfo: memFree=1574632/2055920 swapFree=4178712/4192956
[pid=29771] ppid=29769 vsize=2056 CPUtime=0
/proc/29771/stat : 29771 (SATzilla2009_I) S 29769 29771 29734 0 -1 4194304 132 0 0 0 0 0 0 0 18 0 1 0 516422070 2105344 112 1992294400 134512640 136149169 4294956224 18446744073709551615 135542605 0 0 4096 0 18446744071563356171 0 0 17 0 0 0
/proc/29771/statm: 514 112 96 399 0 111 0
[pid=29772] ppid=29771 vsize=92644 CPUtime=0.69
/proc/29772/stat : 29772 (mxc-sr08) R 29771 29771 29734 0 -1 4194304 20483 0 0 0 61 8 0 0 25 0 1 0 516422070 94867456 20411 1992294400 134512640 135078026 4294956192 18446744073709551615 134722554 0 0 8392704 0 0 0 0 17 0 0 0
/proc/29772/statm: 23161 20412 54 138 0 23020 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 94700

[startup+1.50186 s]
/proc/loadavg: 0.86 0.97 0.99 2/67 29773
/proc/meminfo: memFree=1484632/2055920 swapFree=4178712/4192956
[pid=29771] ppid=29769 vsize=2056 CPUtime=0
/proc/29771/stat : 29771 (SATzilla2009_I) S 29769 29771 29734 0 -1 4194304 132 0 0 0 0 0 0 0 18 0 1 0 516422070 2105344 112 1992294400 134512640 136149169 4294956224 18446744073709551615 135542605 0 0 4096 0 18446744071563356171 0 0 17 0 0 0
/proc/29771/statm: 514 112 96 399 0 111 0
[pid=29772] ppid=29771 vsize=114892 CPUtime=1.49
/proc/29772/stat : 29772 (mxc-sr08) R 29771 29771 29734 0 -1 4194304 25543 0 0 0 138 11 0 0 25 0 1 0 516422070 117649408 25471 1992294400 134512640 135078026 4294956192 18446744073709551615 134722554 0 0 8392704 0 0 0 0 17 0 0 0
/proc/29772/statm: 28723 25472 54 138 0 28582 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 116948

[startup+3.10105 s]
/proc/loadavg: 0.86 0.97 0.99 2/67 29773
/proc/meminfo: memFree=1469592/2055920 swapFree=4178712/4192956
[pid=29771] ppid=29769 vsize=2056 CPUtime=0
/proc/29771/stat : 29771 (SATzilla2009_I) S 29769 29771 29734 0 -1 4194304 132 0 0 0 0 0 0 0 18 0 1 0 516422070 2105344 112 1992294400 134512640 136149169 4294956224 18446744073709551615 135542605 0 0 4096 0 18446744071563356171 0 0 17 0 0 0
/proc/29771/statm: 514 112 96 399 0 111 0
[pid=29772] ppid=29771 vsize=122648 CPUtime=3.09
/proc/29772/stat : 29772 (mxc-sr08) R 29771 29771 29734 0 -1 4194304 33177 0 0 0 294 15 0 0 25 0 1 0 516422070 125591552 27503 1992294400 134512640 135078026 4294956192 18446744073709551615 134722554 0 0 8392704 0 0 0 0 17 1 0 0
/proc/29772/statm: 30662 27503 55 138 0 30521 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 124704

[startup+6.3014 s]
/proc/loadavg: 0.95 0.98 0.99 2/67 29773
/proc/meminfo: memFree=1457624/2055920 swapFree=4178712/4192956
[pid=29771] ppid=29769 vsize=2056 CPUtime=0
/proc/29771/stat : 29771 (SATzilla2009_I) S 29769 29771 29734 0 -1 4194304 132 0 0 0 0 0 0 0 18 0 1 0 516422070 2105344 112 1992294400 134512640 136149169 4294956224 18446744073709551615 135542605 0 0 4096 0 18446744071563356171 0 0 17 0 0 0
/proc/29771/statm: 514 112 96 399 0 111 0
[pid=29772] ppid=29771 vsize=126076 CPUtime=6.27
/proc/29772/stat : 29772 (mxc-sr08) R 29771 29771 29734 0 -1 4194304 39483 0 0 0 608 19 0 0 25 0 1 0 516422070 129101824 29377 1992294400 134512640 135078026 4294956192 18446744073709551615 134534209 0 0 8392704 0 0 0 0 17 0 0 0
/proc/29772/statm: 31519 29377 71 138 0 31378 0
Current children cumulated CPU time (s) 6.27
Current children cumulated vsize (KiB) 128132

[startup+12.7011 s]
/proc/loadavg: 0.95 0.98 0.99 2/67 29774
/proc/meminfo: memFree=1518496/2055920 swapFree=4178712/4192956
[pid=29771] ppid=29769 vsize=2056 CPUtime=10.01
/proc/29771/stat : 29771 (SATzilla2009_I) S 29769 29771 29734 0 -1 4194304 152 39486 0 0 0 0 980 21 19 0 1 0 516422070 2105344 121 1992294400 134512640 136149169 4294956224 18446744073709551615 135542605 0 0 4096 0 18446744071563356171 0 0 17 0 0 0
/proc/29771/statm: 514 121 104 399 0 111 0
[pid=29774] ppid=29771 vsize=63472 CPUtime=2.66
/proc/29774/stat : 29774 (picosat846) R 29771 29771 29734 0 -1 4194304 14507 0 0 0 258 8 0 0 25 0 1 0 516423073 64995328 14470 1992294400 134512640 134570484 4294956192 18446744073709551615 134552746 0 0 8392704 0 0 0 0 17 0 0 0
/proc/29774/statm: 15868 14470 85 14 0 15534 0
Current children cumulated CPU time (s) 12.67
Current children cumulated vsize (KiB) 65528

[startup+25.5016 s]
/proc/loadavg: 0.96 0.98 0.99 2/66 29775
/proc/meminfo: memFree=1508008/2055920 swapFree=4178712/4192956
[pid=29771] ppid=29769 vsize=77008 CPUtime=25.44
/proc/29771/stat : 29771 (SATzilla2009_I) R 29769 29771 29734 0 -1 4194304 18225 96747 0 0 142 9 2329 64 25 0 1 0 516422070 78856192 18176 1992294400 134512640 136149169 4294956224 18446744073709551615 134535492 0 0 4096 0 0 0 0 17 0 0 0
/proc/29771/statm: 19252 18176 135 399 0 18849 0
Current children cumulated CPU time (s) 25.44
Current children cumulated vsize (KiB) 77008

[startup+51.1015 s]
/proc/loadavg: 0.97 0.98 0.99 2/66 29775
/proc/meminfo: memFree=1484520/2055920 swapFree=4178712/4192956
[pid=29771] ppid=29769 vsize=77008 CPUtime=51.03
/proc/29771/stat : 29771 (SATzilla2009_I) R 29769 29771 29734 0 -1 4194304 18512 96747 0 0 2700 10 2329 64 25 0 1 0 516422070 78856192 18463 1992294400 134512640 136149169 4294956224 18446744073709551615 134535043 0 0 4096 0 0 0 0 17 0 0 0
/proc/29771/statm: 19252 18463 135 399 0 18849 0
Current children cumulated CPU time (s) 51.03
Current children cumulated vsize (KiB) 77008

[startup+102.305 s]
/proc/loadavg: 0.99 0.98 0.99 2/67 29777
/proc/meminfo: memFree=1350112/2055920 swapFree=4178712/4192956
[pid=29771] ppid=29769 vsize=92824 CPUtime=88.61
/proc/29771/stat : 29771 (SATzilla2009_I) S 29769 29771 29734 0 -1 4194304 36585 114133 0 0 6246 22 2521 72 25 0 1 0 516422070 95051776 22864 1992294400 134512640 136149169 4294956224 18446744073709551615 135542605 0 0 4096 3 18446744071563356171 0 0 17 0 0 0
/proc/29771/statm: 23206 22864 216 399 0 22803 0
[pid=29777] ppid=29771 vsize=126076 CPUtime=13.58
/proc/29777/stat : 29777 (mxc-sr08) R 29771 29771 29734 0 -1 4194304 39487 0 0 0 1340 18 0 0 25 0 1 0 516430940 129101824 29381 1992294400 134512640 135078026 4294956192 18446744073709551615 134539566 0 0 8392704 0 0 0 0 17 0 0 0
/proc/29777/statm: 31519 29381 71 138 0 31378 0
Current children cumulated CPU time (s) 102.19
Current children cumulated vsize (KiB) 218900

[startup+162.301 s]
/proc/loadavg: 0.99 0.98 0.99 2/67 29777
/proc/meminfo: memFree=1346976/2055920 swapFree=4178712/4192956
[pid=29771] ppid=29769 vsize=92824 CPUtime=88.61
/proc/29771/stat : 29771 (SATzilla2009_I) S 29769 29771 29734 0 -1 4194304 36585 114133 0 0 6246 22 2521 72 25 0 1 0 516422070 95051776 22864 1992294400 134512640 136149169 4294956224 18446744073709551615 135542605 0 0 4096 3 18446744071563356171 0 0 17 0 0 0
/proc/29771/statm: 23206 22864 216 399 0 22803 0
[pid=29777] ppid=29771 vsize=129244 CPUtime=73.54
/proc/29777/stat : 29777 (mxc-sr08) R 29771 29771 29734 0 -1 4194304 40266 0 0 0 7335 19 0 0 25 0 1 0 516430940 132345856 30160 1992294400 134512640 135078026 4294956192 18446744073709551615 134534209 0 0 8392704 0 0 0 0 17 0 0 0
/proc/29777/statm: 32311 30160 71 138 0 32170 0
Current children cumulated CPU time (s) 162.15
Current children cumulated vsize (KiB) 222068

[startup+222.302 s]
/proc/loadavg: 0.99 0.98 0.99 2/67 29777
/proc/meminfo: memFree=1340576/2055920 swapFree=4178712/4192956
[pid=29771] ppid=29769 vsize=92824 CPUtime=88.61
/proc/29771/stat : 29771 (SATzilla2009_I) S 29769 29771 29734 0 -1 4194304 36585 114133 0 0 6246 22 2521 72 25 0 1 0 516422070 95051776 22864 1992294400 134512640 136149169 4294956224 18446744073709551615 135542605 0 0 4096 3 18446744071563356171 0 0 17 0 0 0
/proc/29771/statm: 23206 22864 216 399 0 22803 0
[pid=29777] ppid=29771 vsize=135580 CPUtime=133.51
/proc/29777/stat : 29777 (mxc-sr08) R 29771 29771 29734 0 -1 4194304 41856 0 0 0 13330 21 0 0 25 0 1 0 516430940 138833920 31750 1992294400 134512640 135078026 4294956192 18446744073709551615 134540379 0 0 8392704 0 0 0 0 17 0 0 0
/proc/29777/statm: 33895 31750 71 138 0 33754 0
Current children cumulated CPU time (s) 222.12
Current children cumulated vsize (KiB) 228404

[startup+282.302 s]
/proc/loadavg: 0.99 0.98 0.99 2/67 29777
/proc/meminfo: memFree=1326304/2055920 swapFree=4178712/4192956
[pid=29771] ppid=29769 vsize=92824 CPUtime=88.61
/proc/29771/stat : 29771 (SATzilla2009_I) S 29769 29771 29734 0 -1 4194304 36585 114133 0 0 6246 22 2521 72 25 0 1 0 516422070 95051776 22864 1992294400 134512640 136149169 4294956224 18446744073709551615 135542605 0 0 4096 3 18446744071563356171 0 0 17 0 0 0
/proc/29771/statm: 23206 22864 216 399 0 22803 0
[pid=29777] ppid=29771 vsize=149832 CPUtime=193.49
/proc/29777/stat : 29777 (mxc-sr08) R 29771 29771 29734 0 -1 4194304 45415 0 0 0 19324 25 0 0 25 0 1 0 516430940 153427968 35309 1992294400 134512640 135078026 4294956192 18446744073709551615 134523981 0 0 8392704 0 0 0 0 17 0 0 0
/proc/29777/statm: 37458 35309 71 138 0 37317 0
Current children cumulated CPU time (s) 282.1
Current children cumulated vsize (KiB) 242656

[startup+342.302 s]
/proc/loadavg: 0.99 0.98 0.99 2/67 29777
/proc/meminfo: memFree=1310112/2055920 swapFree=4178712/4192956
[pid=29771] ppid=29769 vsize=92824 CPUtime=88.61
/proc/29771/stat : 29771 (SATzilla2009_I) S 29769 29771 29734 0 -1 4194304 36585 114133 0 0 6246 22 2521 72 25 0 1 0 516422070 95051776 22864 1992294400 134512640 136149169 4294956224 18446744073709551615 135542605 0 0 4096 3 18446744071563356171 0 0 17 0 0 0
/proc/29771/statm: 23206 22864 216 399 0 22803 0
[pid=29777] ppid=29771 vsize=166340 CPUtime=253.45
/proc/29777/stat : 29777 (mxc-sr08) R 29771 29771 29734 0 -1 4194304 49531 0 0 0 25316 29 0 0 25 0 1 0 516430940 170332160 39425 1992294400 134512640 135078026 4294956192 18446744073709551615 134534640 0 0 8392704 0 0 0 0 17 0 0 0
/proc/29777/statm: 41585 39425 71 138 0 41444 0
Current children cumulated CPU time (s) 342.06
Current children cumulated vsize (KiB) 259164

[startup+402.301 s]
/proc/loadavg: 0.99 0.98 0.99 2/67 29777
/proc/meminfo: memFree=1298528/2055920 swapFree=4178712/4192956

################
# More data... #
################


[startup+762.305 s]
/proc/loadavg: 0.99 0.98 0.99 2/67 29777
/proc/meminfo: memFree=1229536/2055920 swapFree=4178712/4192956
[pid=29771] ppid=29769 vsize=92824 CPUtime=88.61
/proc/29771/stat : 29771 (SATzilla2009_I) S 29769 29771 29734 0 -1 4194304 36585 114133 0 0 6246 22 2521 72 25 0 1 0 516422070 95051776 22864 1992294400 134512640 136149169 4294956224 18446744073709551615 135542605 0 0 4096 3 18446744071563356171 0 0 17 0 0 0
/proc/29771/statm: 23206 22864 216 399 0 22803 0
[pid=29777] ppid=29771 vsize=246480 CPUtime=673.26
/proc/29777/stat : 29777 (mxc-sr08) R 29771 29771 29734 0 -1 4194304 69575 0 0 0 67276 50 0 0 25 0 1 0 516430940 252395520 59469 1992294400 134512640 135078026 4294956192 18446744073709551615 134534209 0 0 8392704 0 0 0 0 17 0 0 0
/proc/29777/statm: 61620 59469 71 138 0 61479 0
Current children cumulated CPU time (s) 761.87
Current children cumulated vsize (KiB) 339304

[startup+822.302 s]
/proc/loadavg: 0.99 0.98 0.99 2/67 29777
/proc/meminfo: memFree=1209632/2055920 swapFree=4178712/4192956
[pid=29771] ppid=29769 vsize=92824 CPUtime=88.61
/proc/29771/stat : 29771 (SATzilla2009_I) S 29769 29771 29734 0 -1 4194304 36585 114133 0 0 6246 22 2521 72 25 0 1 0 516422070 95051776 22864 1992294400 134512640 136149169 4294956224 18446744073709551615 135542605 0 0 4096 3 18446744071563356171 0 0 17 0 0 0
/proc/29771/statm: 23206 22864 216 399 0 22803 0
[pid=29777] ppid=29771 vsize=266932 CPUtime=733.23
/proc/29777/stat : 29777 (mxc-sr08) R 29771 29771 29734 0 -1 4194304 74576 0 0 0 73267 56 0 0 25 0 1 0 516430940 273338368 64470 1992294400 134512640 135078026 4294956192 18446744073709551615 134523800 0 0 8392704 0 0 0 0 17 0 0 0
/proc/29777/statm: 66733 64470 71 138 0 66592 0
Current children cumulated CPU time (s) 821.84
Current children cumulated vsize (KiB) 359756

[startup+882.302 s]
/proc/loadavg: 0.99 0.98 0.99 2/67 29777
/proc/meminfo: memFree=1194336/2055920 swapFree=4178712/4192956
[pid=29771] ppid=29769 vsize=92824 CPUtime=88.61
/proc/29771/stat : 29771 (SATzilla2009_I) S 29769 29771 29734 0 -1 4194304 36585 114133 0 0 6246 22 2521 72 25 0 1 0 516422070 95051776 22864 1992294400 134512640 136149169 4294956224 18446744073709551615 135542605 0 0 4096 3 18446744071563356171 0 0 17 0 0 0
/proc/29771/statm: 23206 22864 216 399 0 22803 0
[pid=29777] ppid=29771 vsize=281868 CPUtime=793.2
/proc/29777/stat : 29777 (mxc-sr08) R 29771 29771 29734 0 -1 4194304 78338 0 0 0 79260 60 0 0 25 0 1 0 516430940 288632832 68232 1992294400 134512640 135078026 4294956192 18446744073709551615 134534660 0 0 8392704 0 0 0 0 17 0 0 0
/proc/29777/statm: 70467 68232 71 138 0 70326 0
Current children cumulated CPU time (s) 881.81
Current children cumulated vsize (KiB) 374692

[startup+942.302 s]
/proc/loadavg: 0.99 0.98 0.99 2/67 29777
/proc/meminfo: memFree=1194336/2055920 swapFree=4178712/4192956
[pid=29771] ppid=29769 vsize=92824 CPUtime=88.61
/proc/29771/stat : 29771 (SATzilla2009_I) S 29769 29771 29734 0 -1 4194304 36585 114133 0 0 6246 22 2521 72 25 0 1 0 516422070 95051776 22864 1992294400 134512640 136149169 4294956224 18446744073709551615 135542605 0 0 4096 3 18446744071563356171 0 0 17 0 0 0
/proc/29771/statm: 23206 22864 216 399 0 22803 0
[pid=29777] ppid=29771 vsize=281868 CPUtime=853.18
/proc/29777/stat : 29777 (mxc-sr08) R 29771 29771 29734 0 -1 4194304 78338 0 0 0 85258 60 0 0 25 0 1 0 516430940 288632832 68232 1992294400 134512640 135078026 4294956192 18446744073709551615 134523802 0 0 8392704 0 0 0 0 17 0 0 0
/proc/29777/statm: 70467 68232 71 138 0 70326 0
Current children cumulated CPU time (s) 941.79
Current children cumulated vsize (KiB) 374692

[startup+1002.3 s]
/proc/loadavg: 0.99 0.98 0.99 2/67 29777
/proc/meminfo: memFree=1194336/2055920 swapFree=4178712/4192956
[pid=29771] ppid=29769 vsize=92824 CPUtime=88.61
/proc/29771/stat : 29771 (SATzilla2009_I) S 29769 29771 29734 0 -1 4194304 36585 114133 0 0 6246 22 2521 72 25 0 1 0 516422070 95051776 22864 1992294400 134512640 136149169 4294956224 18446744073709551615 135542605 0 0 4096 3 18446744071563356171 0 0 17 0 0 0
/proc/29771/statm: 23206 22864 216 399 0 22803 0
[pid=29777] ppid=29771 vsize=281868 CPUtime=913.15
/proc/29777/stat : 29777 (mxc-sr08) R 29771 29771 29734 0 -1 4194304 78338 0 0 0 91255 60 0 0 25 0 1 0 516430940 288632832 68232 1992294400 134512640 135078026 4294956192 18446744073709551615 134522269 0 0 8392704 0 0 0 0 17 0 0 0
/proc/29777/statm: 70467 68232 71 138 0 70326 0
Current children cumulated CPU time (s) 1001.76
Current children cumulated vsize (KiB) 374692

[startup+1062.3 s]
/proc/loadavg: 0.99 0.98 0.99 2/67 29777
/proc/meminfo: memFree=1194272/2055920 swapFree=4178712/4192956
[pid=29771] ppid=29769 vsize=92824 CPUtime=88.61
/proc/29771/stat : 29771 (SATzilla2009_I) S 29769 29771 29734 0 -1 4194304 36585 114133 0 0 6246 22 2521 72 25 0 1 0 516422070 95051776 22864 1992294400 134512640 136149169 4294956224 18446744073709551615 135542605 0 0 4096 3 18446744071563356171 0 0 17 0 0 0
/proc/29771/statm: 23206 22864 216 399 0 22803 0
[pid=29777] ppid=29771 vsize=281868 CPUtime=973.12
/proc/29777/stat : 29777 (mxc-sr08) R 29771 29771 29734 0 -1 4194304 78339 0 0 0 97252 60 0 0 25 0 1 0 516430940 288632832 68233 1992294400 134512640 135078026 4294956192 18446744073709551615 134523784 0 0 8392704 0 0 0 0 17 0 0 0
/proc/29777/statm: 70467 68233 71 138 0 70326 0
Current children cumulated CPU time (s) 1061.73
Current children cumulated vsize (KiB) 374692

[startup+1122.3 s]
/proc/loadavg: 0.99 0.98 0.99 2/67 29777
/proc/meminfo: memFree=1190688/2055920 swapFree=4178712/4192956
[pid=29771] ppid=29769 vsize=92824 CPUtime=88.61
/proc/29771/stat : 29771 (SATzilla2009_I) S 29769 29771 29734 0 -1 4194304 36585 114133 0 0 6246 22 2521 72 25 0 1 0 516422070 95051776 22864 1992294400 134512640 136149169 4294956224 18446744073709551615 135542605 0 0 4096 3 18446744071563356171 0 0 17 0 0 0
/proc/29771/statm: 23206 22864 216 399 0 22803 0
[pid=29777] ppid=29771 vsize=285704 CPUtime=1033.1
/proc/29777/stat : 29777 (mxc-sr08) R 29771 29771 29734 0 -1 4194304 79281 0 0 0 103248 62 0 0 25 0 1 0 516430940 292560896 69175 1992294400 134512640 135078026 4294956192 18446744073709551615 134533727 0 0 8392704 0 0 0 0 17 0 0 0
/proc/29777/statm: 71426 69175 71 138 0 71285 0
Current children cumulated CPU time (s) 1121.71
Current children cumulated vsize (KiB) 378528

[startup+1182.3 s]
/proc/loadavg: 0.99 0.98 0.99 2/67 29777
/proc/meminfo: memFree=1172320/2055920 swapFree=4178712/4192956
[pid=29771] ppid=29769 vsize=92824 CPUtime=88.61
/proc/29771/stat : 29771 (SATzilla2009_I) S 29769 29771 29734 0 -1 4194304 36585 114133 0 0 6246 22 2521 72 25 0 1 0 516422070 95051776 22864 1992294400 134512640 136149169 4294956224 18446744073709551615 135542605 0 0 4096 3 18446744071563356171 0 0 17 0 0 0
/proc/29771/statm: 23206 22864 216 399 0 22803 0
[pid=29777] ppid=29771 vsize=304064 CPUtime=1093.07
/proc/29777/stat : 29777 (mxc-sr08) R 29771 29771 29734 0 -1 4194304 83908 0 0 0 109241 66 0 0 25 0 1 0 516430940 311361536 73802 1992294400 134512640 135078026 4294956192 18446744073709551615 134722554 0 0 8392704 0 0 0 0 17 0 0 0
/proc/29777/statm: 76016 73802 71 138 0 75875 0
Current children cumulated CPU time (s) 1181.68
Current children cumulated vsize (KiB) 396888

Solver just ended. Dumping a history of the last processes samples

[startup+1190.3 s]
/proc/loadavg: 0.99 0.98 0.99 2/67 29777
/proc/meminfo: memFree=1169248/2055920 swapFree=4178712/4192956
[pid=29771] ppid=29769 vsize=92824 CPUtime=88.61
/proc/29771/stat : 29771 (SATzilla2009_I) S 29769 29771 29734 0 -1 4194304 36585 114133 0 0 6246 22 2521 72 25 0 1 0 516422070 95051776 22864 1992294400 134512640 136149169 4294956224 18446744073709551615 135542605 0 0 4096 3 18446744071563356171 0 0 17 0 0 0
/proc/29771/statm: 23206 22864 216 399 0 22803 0
[pid=29777] ppid=29771 vsize=306836 CPUtime=1101.06
/proc/29777/stat : 29777 (mxc-sr08) R 29771 29771 29734 0 -1 4194304 84600 0 0 0 110039 67 0 0 25 0 1 0 516430940 314200064 74494 1992294400 134512640 135078026 4294956192 18446744073709551615 134534634 0 0 8392704 0 0 0 0 17 0 0 0
/proc/29777/statm: 76709 74494 71 138 0 76568 0
Current children cumulated CPU time (s) 1189.67
Current children cumulated vsize (KiB) 399660

[startup+1196.7 s]
/proc/loadavg: 0.99 0.98 0.99 2/67 29777
/proc/meminfo: memFree=1167392/2055920 swapFree=4178712/4192956
[pid=29771] ppid=29769 vsize=92824 CPUtime=88.61
/proc/29771/stat : 29771 (SATzilla2009_I) S 29769 29771 29734 0 -1 4194304 36585 114133 0 0 6246 22 2521 72 25 0 1 0 516422070 95051776 22864 1992294400 134512640 136149169 4294956224 18446744073709551615 135542605 0 0 4096 3 18446744071563356171 0 0 17 0 0 0
/proc/29771/statm: 23206 22864 216 399 0 22803 0
[pid=29777] ppid=29771 vsize=308684 CPUtime=1107.46
/proc/29777/stat : 29777 (mxc-sr08) R 29771 29771 29734 0 -1 4194304 85056 0 0 0 110679 67 0 0 25 0 1 0 516430940 316092416 74950 1992294400 134512640 135078026 4294956192 18446744073709551615 134533771 0 0 8392704 0 0 0 0 17 0 0 0
/proc/29777/statm: 77171 74950 71 138 0 77030 0
Current children cumulated CPU time (s) 1196.07
Current children cumulated vsize (KiB) 401508

[startup+1198.3 s]
/proc/loadavg: 0.99 0.98 0.99 2/67 29777
/proc/meminfo: memFree=1167136/2055920 swapFree=4178712/4192956
[pid=29771] ppid=29769 vsize=92824 CPUtime=88.61
/proc/29771/stat : 29771 (SATzilla2009_I) S 29769 29771 29734 0 -1 4194304 36585 114133 0 0 6246 22 2521 72 25 0 1 0 516422070 95051776 22864 1992294400 134512640 136149169 4294956224 18446744073709551615 135542605 0 0 4096 3 18446744071563356171 0 0 17 0 0 0
/proc/29771/statm: 23206 22864 216 399 0 22803 0
[pid=29777] ppid=29771 vsize=309080 CPUtime=1109.06
/proc/29777/stat : 29777 (mxc-sr08) R 29771 29771 29734 0 -1 4194304 85160 0 0 0 110839 67 0 0 25 0 1 0 516430940 316497920 75054 1992294400 134512640 135078026 4294956192 18446744073709551615 134533727 0 0 8392704 0 0 0 0 17 0 0 0
/proc/29777/statm: 77270 75054 71 138 0 77129 0
Current children cumulated CPU time (s) 1197.67
Current children cumulated vsize (KiB) 401904

[startup+1199.1 s]
/proc/loadavg: 0.99 0.98 0.99 2/67 29777
/proc/meminfo: memFree=1166816/2055920 swapFree=4178712/4192956
[pid=29771] ppid=29769 vsize=92824 CPUtime=88.61
/proc/29771/stat : 29771 (SATzilla2009_I) S 29769 29771 29734 0 -1 4194304 36585 114133 0 0 6246 22 2521 72 25 0 1 0 516422070 95051776 22864 1992294400 134512640 136149169 4294956224 18446744073709551615 135542605 0 0 4096 3 18446744071563356171 0 0 17 0 0 0
/proc/29771/statm: 23206 22864 216 399 0 22803 0
[pid=29777] ppid=29771 vsize=309344 CPUtime=1109.86
/proc/29777/stat : 29777 (mxc-sr08) R 29771 29771 29734 0 -1 4194304 85213 0 0 0 110918 68 0 0 25 0 1 0 516430940 316768256 75107 1992294400 134512640 135078026 4294956192 18446744073709551615 134523677 0 0 8392704 0 0 0 0 17 0 0 0
/proc/29777/statm: 77336 75107 71 138 0 77195 0
Current children cumulated CPU time (s) 1198.47
Current children cumulated vsize (KiB) 402168

[startup+1199.9 s]
/proc/loadavg: 0.99 0.98 0.99 2/67 29777
/proc/meminfo: memFree=1166816/2055920 swapFree=4178712/4192956
[pid=29771] ppid=29769 vsize=92824 CPUtime=88.61
/proc/29771/stat : 29771 (SATzilla2009_I) S 29769 29771 29734 0 -1 4194304 36585 114133 0 0 6246 22 2521 72 25 0 1 0 516422070 95051776 22864 1992294400 134512640 136149169 4294956224 18446744073709551615 135542605 0 0 4096 3 18446744071563356171 0 0 17 0 0 0
/proc/29771/statm: 23206 22864 216 399 0 22803 0
[pid=29777] ppid=29771 vsize=309476 CPUtime=1110.66
/proc/29777/stat : 29777 (mxc-sr08) R 29771 29771 29734 0 -1 4194304 85262 0 0 0 110998 68 0 0 25 0 1 0 516430940 316903424 75156 1992294400 134512640 135078026 4294956192 18446744073709551615 134533843 0 0 8392704 0 0 0 0 17 0 0 0
/proc/29777/statm: 77369 75156 71 138 0 77228 0
Current children cumulated CPU time (s) 1199.27
Current children cumulated vsize (KiB) 402300

[startup+1200.11 s]
/proc/loadavg: 0.99 0.98 0.99 2/67 29777
/proc/meminfo: memFree=1166560/2055920 swapFree=4178712/4192956
[pid=29771] ppid=29769 vsize=92824 CPUtime=88.61
/proc/29771/stat : 29771 (SATzilla2009_I) S 29769 29771 29734 0 -1 4194304 36585 114133 0 0 6246 22 2521 72 25 0 1 0 516422070 95051776 22864 1992294400 134512640 136149169 4294956224 18446744073709551615 135542605 0 0 4096 3 18446744071563356171 0 0 17 0 0 0
/proc/29771/statm: 23206 22864 216 399 0 22803 0
[pid=29777] ppid=29771 vsize=0 CPUtime=1110.86
/proc/29777/stat : 29777 (mxc-sr08) R 29771 29771 29734 0 -1 4195332 85273 0 0 0 111014 72 0 0 25 0 1 0 516430940 0 0 1992294400 0 0 0 0 0 256 0 8392704 0 0 0 0 17 0 0 0
/proc/29777/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 1199.47
Current children cumulated vsize (KiB) 92824

Child status: 17
Real time (s): 1200.13
CPU time (s): 1199.53
CPU user time (s): 1197.83
CPU system time (s): 1.70074
CPU usage (%): 99.9497
Max. virtual memory (cumulated for all children) (KiB): 402432

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1197.83
system time used= 1.70074
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 236009
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 17
involuntary context switches= 3907

runsolver used 1.01984 second user time and 3.35449 second system time

The end

Launcher Data

Begin job on node32 at 2009-04-05 05:08:02
IDJOB=1578781
IDBENCH=70985
IDSOLVER=528
FILE ID=node32/1578781-1238900880
PBS_JOBID= 9101346
Free space on /tmp= 66532 MiB

SOLVER NAME= SATzilla2009_I 2009-03-22
BENCH NAME= SAT09/APPLICATIONS/diagnosis/UTI-20-5p0.cnf
COMMAND LINE= HOME/SATzilla2009_I BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-1578781-1238900880/watcher-1578781-1238900880 -o /tmp/evaluation-result-1578781-1238900880/solver-1578781-1238900880 -C 1200 -W 1800 -M 1800 --output-limit 1,15  HOME/SATzilla2009_I HOME/instance-1578781-1238900880.cnf

TIME LIMIT= 1200 seconds
MEMORY LIMIT= 1800 MiB
MAX NB THREAD= 0

MD5SUM BENCH= 5588dd996576f939b8ae497437078705
RANDOM SEED=1097506555

node32.alineos.net Linux 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.234
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.234
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1575048 kB
Buffers:         48296 kB
Cached:         354544 kB
SwapCached:       7336 kB
Active:         210656 kB
Inactive:       200780 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1575048 kB
SwapTotal:     4192956 kB
SwapFree:      4178712 kB
Dirty:           53984 kB
Writeback:           0 kB
Mapped:          14240 kB
Slab:            55164 kB
Committed_AS:  2051144 kB
PageTables:       1488 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264960 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66500 MiB
End job on node32 at 2009-04-05 05:28:02