Trace number 3312326

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
STRUCTure 0.1? (TO) 4800.52 1205.64

General information on the benchmark

Namerandom/large/
unif-k3-r4.2-v15000-c63000-S1868678442-026-UNKNOWN.cnf
MD5SUM8991b7c0d56154e632c95327c4937cf5
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark25.2022
Satisfiable
(Un)Satisfiability was proved
Number of variables15000
Number of clauses63000
Sum of the clauses size189000
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 363000
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.10/0.11	57:18 INFO : Reading from input HOME/instance-3312326-1304110638.cnf
0.72/0.53	Executor set job limit to 1000000
0.72/0.53	Executor set job limit to 1000000
0.72/0.53	Executor set job limit to 1000000
0.72/0.53	Executor set job limit to 1000000
0.72/0.53	Starting Executor!
0.72/0.53	Starting Executor!
0.72/0.53	Starting Executor!
0.72/0.53	Starting Executor!
2.68/1.49	57:20 INFO : 14948 variables remaining out of 15000
2.68/1.49	57:20 INFO : 250512 literals remaining out of 252000

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3312326-1304110638/watcher-3312326-1304110638 -o /tmp/evaluation-result-3312326-1304110638/solver-3312326-1304110638 -C 4800 -W 1300 -M 15500 run 15000 4 HOME HOME HOME/instance-3312326-1304110638.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.18 7.91 8.01 4/194 19624
/proc/meminfo: memFree=30652052/32950928 swapFree=67111428/67111528
[pid=19624] ppid=19622 vsize=24004 CPUtime=0 cores=0,2,4,6
/proc/19624/stat : 19624 (java) S 19622 19624 19242 0 -1 4202496 1371 0 0 0 0 0 0 0 21 0 2 0 522663627 24580096 851 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101500901 0 0 4096 0 18446744073709551615 0 0 17 2 0 0 0
/proc/19624/statm: 6002 853 650 9 0 382 0
[pid=19624/tid=19625] ppid=19622 vsize=26140 CPUtime=0 cores=0,2,4,6
/proc/19624/task/19625/stat : 19625 (java) R 19622 19624 19242 0 -1 4202560 40 0 0 0 0 0 0 0 22 0 2 0 522663627 26767360 876 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248105673248 0 0 4096 0 0 0 0 -1 2 0 0 0

[startup+0.032639 s]
/proc/loadavg: 7.18 7.91 8.01 4/194 19624
/proc/meminfo: memFree=30652052/32950928 swapFree=67111428/67111528
[pid=19624] ppid=19622 vsize=15669784 CPUtime=0.02 cores=0,2,4,6
/proc/19624/stat : 19624 (java) S 19622 19624 19242 0 -1 4202496 3639 0 1 0 2 0 0 0 21 0 13 0 522663627 16045858816 3078 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101500901 0 0 0 16784584 18446744073709551615 0 0 17 2 0 0 0
/proc/19624/statm: 3917446 3081 1674 9 0 3908194 0
[pid=19624/tid=19625] ppid=19622 vsize=15669784 CPUtime=0.02 cores=0,2,4,6
/proc/19624/task/19625/stat : 19625 (java) R 19622 19624 19242 0 -1 4202560 2250 0 1 0 2 0 0 0 25 0 13 0 522663627 16045858816 3082 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 47784549747774 0 4 0 16784584 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 15669784

[startup+0.100673 s]
/proc/loadavg: 7.18 7.91 8.01 4/194 19624
/proc/meminfo: memFree=30652052/32950928 swapFree=67111428/67111528
[pid=19624] ppid=19622 vsize=15676752 CPUtime=0.1 cores=0,2,4,6
/proc/19624/stat : 19624 (java) S 19622 19624 19242 0 -1 4202496 5571 0 1 0 9 1 0 0 21 0 18 0 522663627 16052994048 5001 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101500901 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/19624/statm: 3919188 5002 2117 9 0 3909907 0
[pid=19624/tid=19625] ppid=19622 vsize=15676752 CPUtime=0.08 cores=0,2,4,6
/proc/19624/task/19625/stat : 19625 (java) R 19622 19624 19242 0 -1 4202560 3430 0 1 0 7 1 0 0 25 0 18 0 522663627 16052994048 5002 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101525047 0 4 0 16800975 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 15676752

[startup+0.300594 s]
/proc/loadavg: 7.18 7.91 8.01 4/194 19624
/proc/meminfo: memFree=30652052/32950928 swapFree=67111428/67111528
[pid=19624] ppid=19622 vsize=15682980 CPUtime=0.52 cores=0,2,4,6
/proc/19624/stat : 19624 (java) S 19622 19624 19242 0 -1 4202496 15513 0 1 0 49 3 0 0 21 0 18 0 522663627 16059371520 13757 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101500901 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/19624/statm: 3920745 13764 2207 9 0 3911464 0
[pid=19624/tid=19625] ppid=19622 vsize=15682980 CPUtime=0.28 cores=0,2,4,6
/proc/19624/task/19625/stat : 19625 (java) R 19622 19624 19242 0 -1 4202560 10437 0 1 0 26 2 0 0 18 0 18 0 522663627 16059371520 13767 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 46912505641329 0 4 0 16800975 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 0.52
Current children cumulated vsize (KiB) 15682980

[startup+0.700522 s]
/proc/loadavg: 7.18 7.91 8.01 4/194 19624
/proc/meminfo: memFree=30652052/32950928 swapFree=67111428/67111528
[pid=19624] ppid=19622 vsize=15687092 CPUtime=1.11 cores=0,2,4,6
/proc/19624/stat : 19624 (java) S 19622 19624 19242 0 -1 4202496 43114 0 1 0 106 5 0 0 21 0 22 0 522663627 16063582208 40062 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101500901 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/19624/statm: 3921773 40062 2255 9 0 3912492 0
[pid=19624/tid=19625] ppid=19622 vsize=15687092 CPUtime=0.67 cores=0,2,4,6
/proc/19624/task/19625/stat : 19625 (java) R 19622 19624 19242 0 -1 4202560 35631 0 1 0 63 4 0 0 19 0 22 0 522663627 16063582208 40062 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 46912505197432 0 4 0 16800975 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1.11
Current children cumulated vsize (KiB) 15687092

[startup+1.50142 s]
/proc/loadavg: 7.18 7.91 8.01 8/220 19650
/proc/meminfo: memFree=30317664/32950928 swapFree=67111428/67111528
[pid=19624] ppid=19622 vsize=15689252 CPUtime=2.86 cores=0,2,4,6
/proc/19624/stat : 19624 (java) S 19622 19624 19242 0 -1 4202496 54460 0 1 0 279 7 0 0 21 0 22 0 522663627 16065794048 47340 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101500901 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/19624/statm: 3922313 47340 2267 9 0 3913032 0
[pid=19624/tid=19625] ppid=19622 vsize=15689252 CPUtime=1.46 cores=0,2,4,6
/proc/19624/task/19625/stat : 19625 (java) S 19622 19624 19242 0 -1 4202560 35691 0 1 0 142 4 0 0 21 0 22 0 522663627 16065794048 47340 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514137 0 4 0 16800975 18446604440763583360 0 0 -1 0 0 0 0
[pid=19624/tid=19627] ppid=19622 vsize=15689252 CPUtime=0 cores=0,2,4,6
/proc/19624/task/19627/stat : 19627 (java) S 19622 19624 19242 0 -1 4202560 27 0 0 0 0 0 0 0 19 0 22 0 522663628 16065794048 47340 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514137 0 4 0 16800975 18446604440763583360 0 0 -1 6 0 0 0
[pid=19624/tid=19628] ppid=19622 vsize=15689252 CPUtime=0 cores=0,2,4,6
/proc/19624/task/19628/stat : 19628 (java) S 19622 19624 19242 0 -1 4202560 53 0 0 0 0 0 0 0 20 0 22 0 522663628 16065794048 47340 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514137 0 4 0 16800975 18446604440763583360 0 0 -1 6 0 0 0
[pid=19624/tid=19629] ppid=19622 vsize=15689252 CPUtime=0 cores=0,2,4,6
/proc/19624/task/19629/stat : 19629 (java) S 19622 19624 19242 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 22 0 522663628 16065794048 47340 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514137 0 4 0 16800975 18446604440763583360 0 0 -1 6 0 0 0
[pid=19624/tid=19630] ppid=19622 vsize=15689252 CPUtime=0 cores=0,2,4,6
/proc/19624/task/19630/stat : 19630 (java) S 19622 19624 19242 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 22 0 522663628 16065794048 47340 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514137 0 4 0 16800975 18446604440763583360 0 0 -1 6 0 0 0
[pid=19624/tid=19631] ppid=19622 vsize=15689252 CPUtime=0 cores=0,2,4,6
/proc/19624/task/19631/stat : 19631 (java) S 19622 19624 19242 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 22 0 522663628 16065794048 47340 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514137 0 4 0 16800975 18446604440763583360 0 0 -1 2 0 0 0
[pid=19624/tid=19632] ppid=19622 vsize=15689252 CPUtime=0 cores=0,2,4,6
/proc/19624/task/19632/stat : 19632 (java) S 19622 19624 19242 0 -1 4202560 2 0 0 0 0 0 0 0 21 0 22 0 522663628 16065794048 47340 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514137 0 4 0 16800975 18446604440763583360 0 0 -1 0 0 0 0
[pid=19624/tid=19633] ppid=19622 vsize=15689252 CPUtime=0 cores=0,2,4,6
/proc/19624/task/19633/stat : 19633 (java) S 19622 19624 19242 0 -1 4202560 337 0 0 0 0 0 0 0 21 0 22 0 522663628 16065794048 47340 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514137 0 4 0 16800975 18446604440763583360 0 0 -1 0 0 0 0
[pid=19624/tid=19634] ppid=19622 vsize=15689252 CPUtime=0 cores=0,2,4,6
/proc/19624/task/19634/stat : 19634 (java) S 19622 19624 19242 0 -1 4202560 2 0 0 0 0 0 0 0 21 0 22 0 522663628 16065794048 47340 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514137 0 4 0 16800975 18446604440763583360 0 0 -1 4 0 0 0
[pid=19624/tid=19635] ppid=19622 vsize=15689252 CPUtime=0 cores=0,2,4,6
/proc/19624/task/19635/stat : 19635 (java) S 19622 19624 19242 0 -1 4202560 10 0 0 0 0 0 0 0 15 0 22 0 522663629 16065794048 47340 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514752 0 0 0 16800975 18446604440763583360 0 0 -1 6 0 0 0
[pid=19624/tid=19636] ppid=19622 vsize=15689252 CPUtime=0 cores=0,2,4,6
/proc/19624/task/19636/stat : 19636 (java) S 19622 19624 19242 0 -1 4202560 17 0 0 0 0 0 0 0 21 0 22 0 522663629 16065794048 47340 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514137 0 4 0 16800975 18446604440763583360 0 0 -1 6 0 0 0
[pid=19624/tid=19637] ppid=19622 vsize=15689252 CPUtime=0 cores=0,2,4,6
/proc/19624/task/19637/stat : 19637 (java) S 19622 19624 19242 0 -1 4202560 8 0 0 0 0 0 0 0 21 0 22 0 522663629 16065794048 47340 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514137 0 4 0 16800975 18446604440763583360 0 0 -1 6 0 0 0
[pid=19624/tid=19638] ppid=19622 vsize=15689252 CPUtime=0 cores=0,2,4,6
/proc/19624/task/19638/stat : 19638 (java) S 19622 19624 19242 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 522663631 16065794048 47340 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101521841 0 4 0 16800975 18446604440763583360 0 0 -1 2 0 0 0
[pid=19624/tid=19639] ppid=19622 vsize=15689252 CPUtime=0.49 cores=0,2,4,6
/proc/19624/task/19639/stat : 19639 (java) S 19622 19624 19242 0 -1 4202560 3183 0 0 0 49 0 0 0 18 0 22 0 522663631 16065794048 47340 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514137 0 4 0 16800975 18446604440763583360 0 0 -1 6 0 0 0
[pid=19624/tid=19640] ppid=19622 vsize=15689252 CPUtime=0.88 cores=0,2,4,6
/proc/19624/task/19640/stat : 19640 (java) S 19622 19624 19242 0 -1 4202560 13724 0 0 0 86 2 0 0 16 0 22 0 522663631 16065794048 47340 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514137 0 4 0 16800975 18446604440763583360 0 0 -1 2 0 0 0
[pid=19624/tid=19641] ppid=19622 vsize=15689252 CPUtime=0 cores=0,2,4,6
/proc/19624/task/19641/stat : 19641 (java) S 19622 19624 19242 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 522663631 16065794048 47340 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514137 0 4 0 16800975 18446604440763583360 0 0 -1 2 0 0 0
[pid=19624/tid=19642] ppid=19622 vsize=15689252 CPUtime=0 cores=0,2,4,6
/proc/19624/task/19642/stat : 19642 (java) S 19622 19624 19242 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 522663631 16065794048 47340 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514752 0 4 0 16800975 18446604440763583360 0 0 -1 4 0 0 0
[pid=19624/tid=19647] ppid=19622 vsize=15689252 CPUtime=0 cores=0,2,4,6
/proc/19624/task/19647/stat : 19647 (java) S 19622 19624 19242 0 -1 4202560 14 0 0 0 0 0 0 0 15 0 22 0 522663680 16065794048 47340 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514752 0 4 0 16800975 18446604440763583360 0 0 -1 6 0 0 0
[pid=19624/tid=19648] ppid=19622 vsize=15689252 CPUtime=0 cores=0,2,4,6
/proc/19624/task/19648/stat : 19648 (java) S 19622 19624 19242 0 -1 4202560 13 0 0 0 0 0 0 0 15 0 22 0 522663680 16065794048 47340 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514752 0 4 0 16800975 18446604440763583360 0 0 -1 4 0 0 0
[pid=19624/tid=19649] ppid=19622 vsize=15689252 CPUtime=0 cores=0,2,4,6
/proc/19624/task/19649/stat : 19649 (java) S 19622 19624 19242 0 -1 4202560 8 0 0 0 0 0 0 0 15 0 22 0 522663681 16065794048 47340 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514752 0 4 0 16800975 18446604440763583360 0 0 -1 4 0 0 0
[pid=19624/tid=19650] ppid=19622 vsize=15689252 CPUtime=0 cores=0,2,4,6
/proc/19624/task/19650/stat : 19650 (java) S 19622 19624 19242 0 -1 4202560 7 0 0 0 0 0 0 0 15 0 22 0 522663681 16065794048 47340 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514752 0 4 0 16800975 18446604440763583360 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 2.86
Current children cumulated vsize (KiB) 15689252

[startup+3.10762 s]
/proc/loadavg: 7.18 7.91 8.01 14/220 19650
/proc/meminfo: memFree=30145676/32950928 swapFree=67111428/67111528
[pid=19624] ppid=19622 vsize=15691564 CPUtime=8.25 cores=0,2,4,6
/proc/19624/stat : 19624 (java) S 19622 19624 19242 0 -1 4202496 137636 0 1 0 806 19 0 0 21 0 22 0 522663627 16068161536 130265 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101500901 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/19624/statm: 3922891 130265 2275 9 0 3913610 0
[pid=19624/tid=19625] ppid=19622 vsize=15691564 CPUtime=1.46 cores=0,2,4,6
/proc/19624/task/19625/stat : 19625 (java) S 19622 19624 19242 0 -1 4202560 35691 0 1 0 142 4 0 0 21 0 22 0 522663627 16068161536 130265 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514137 0 4 0 16800975 18446604440763583360 0 0 -1 0 0 0 0
[pid=19624/tid=19627] ppid=19622 vsize=15691564 CPUtime=0.02 cores=0,2,4,6
/proc/19624/task/19627/stat : 19627 (java) S 19622 19624 19242 0 -1 4202560 2678 0 0 0 2 0 0 0 16 0 22 0 522663628 16068161536 130265 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514137 0 4 0 16800975 18446604440763583360 0 0 -1 0 0 0 0
[pid=19624/tid=19628] ppid=19622 vsize=15691564 CPUtime=0.02 cores=0,2,4,6
/proc/19624/task/19628/stat : 19628 (java) S 19622 19624 19242 0 -1 4202560 2357 0 0 0 2 0 0 0 16 0 22 0 522663628 16068161536 130265 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514137 0 4 0 16800975 18446604440763583360 0 0 -1 0 0 0 0
[pid=19624/tid=19629] ppid=19622 vsize=15691564 CPUtime=0.05 cores=0,2,4,6
/proc/19624/task/19629/stat : 19629 (java) R 19622 19624 19242 0 -1 4202560 10929 0 0 0 4 1 0 0 15 0 22 0 522663628 16068161536 130265 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248089651511 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=19624/tid=19630] ppid=19622 vsize=15691564 CPUtime=0.03 cores=0,2,4,6
/proc/19624/task/19630/stat : 19630 (java) R 19622 19624 19242 0 -1 4202560 6161 0 0 0 3 0 0 0 15 0 22 0 522663628 16068161536 130265 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248089651511 0 4 0 16800975 0 0 0 -1 6 0 0 0
[pid=19624/tid=19631] ppid=19622 vsize=15691564 CPUtime=0.04 cores=0,2,4,6
/proc/19624/task/19631/stat : 19631 (java) R 19622 19624 19242 0 -1 4202560 10298 0 0 0 3 1 0 0 15 0 22 0 522663628 16068161536 130265 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248089651511 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=19624/tid=19632] ppid=19622 vsize=15691564 CPUtime=0.05 cores=0,2,4,6
/proc/19624/task/19632/stat : 19632 (java) R 19622 19624 19242 0 -1 4202560 12588 0 0 0 4 1 0 0 15 0 22 0 522663628 16068161536 130265 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248089651511 0 4 0 16800975 0 0 0 -1 0 0 0 0
[pid=19624/tid=19633] ppid=19622 vsize=15691564 CPUtime=0.04 cores=0,2,4,6
/proc/19624/task/19633/stat : 19633 (java) R 19622 19624 19242 0 -1 4202560 10139 0 0 0 3 1 0 0 15 0 22 0 522663628 16068161536 130265 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514137 0 4 0 16800975 0 0 0 -1 6 0 0 0
[pid=19624/tid=19634] ppid=19622 vsize=15691564 CPUtime=0.03 cores=0,2,4,6
/proc/19624/task/19634/stat : 19634 (java) R 19622 19624 19242 0 -1 4202560 6557 0 0 0 3 0 0 0 15 0 22 0 522663628 16068161536 130265 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248089651511 0 4 0 16800975 0 0 0 -1 4 0 0 0
[pid=19624/tid=19635] ppid=19622 vsize=15691564 CPUtime=0 cores=0,2,4,6
/proc/19624/task/19635/stat : 19635 (java) S 19622 19624 19242 0 -1 4202560 262 0 0 0 0 0 0 0 16 0 22 0 522663629 16068161536 130265 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514137 0 0 0 16800975 18446604440763583360 0 0 -1 4 0 0 0
[pid=19624/tid=19636] ppid=19622 vsize=15691564 CPUtime=0 cores=0,2,4,6
/proc/19624/task/19636/stat : 19636 (java) S 19622 19624 19242 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 522663629 16068161536 130265 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514137 0 4 0 16800975 18446604440763583360 0 0 -1 6 0 0 0
[pid=19624/tid=19637] ppid=19622 vsize=15691564 CPUtime=0 cores=0,2,4,6
/proc/19624/task/19637/stat : 19637 (java) S 19622 19624 19242 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 522663629 16068161536 130265 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514137 0 4 0 16800975 18446604440763583360 0 0 -1 6 0 0 0
[pid=19624/tid=19638] ppid=19622 vsize=15691564 CPUtime=0 cores=0,2,4,6
/proc/19624/task/19638/stat : 19638 (java) S 19622 19624 19242 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 522663631 16068161536 130265 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101521841 0 4 0 16800975 18446604440763583360 0 0 -1 2 0 0 0
[pid=19624/tid=19639] ppid=19622 vsize=15691564 CPUtime=0.73 cores=0,2,4,6
/proc/19624/task/19639/stat : 19639 (java) S 19622 19624 19242 0 -1 4202560 3724 0 0 0 73 0 0 0 15 0 22 0 522663631 16068161536 130265 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514137 0 4 0 16800975 18446604440763583360 0 0 -1 6 0 0 0
[pid=19624/tid=19640] ppid=19622 vsize=15691564 CPUtime=1.01 cores=0,2,4,6
/proc/19624/task/19640/stat : 19640 (java) S 19622 19624 19242 0 -1 4202560 13744 0 0 0 99 2 0 0 15 0 22 0 522663631 16068161536 130265 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514137 0 4 0 16800975 18446604440763583360 0 0 -1 6 0 0 0
[pid=19624/tid=19641] ppid=19622 vsize=15691564 CPUtime=0 cores=0,2,4,6
/proc/19624/task/19641/stat : 19641 (java) S 19622 19624 19242 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 522663631 16068161536 130265 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514137 0 4 0 16800975 18446604440763583360 0 0 -1 2 0 0 0
[pid=19624/tid=19642] ppid=19622 vsize=15691564 CPUtime=0 cores=0,2,4,6
/proc/19624/task/19642/stat : 19642 (java) S 19622 19624 19242 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 22 0 522663631 16068161536 130265 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514752 0 4 0 16800975 18446604440763583360 0 0 -1 2 0 0 0
[pid=19624/tid=19647] ppid=19622 vsize=15691564 CPUtime=1.26 cores=0,2,4,6
/proc/19624/task/19647/stat : 19647 (java) S 19622 19624 19242 0 -1 4202560 4959 0 0 0 126 0 0 0 16 0 22 0 522663680 16068161536 130265 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514137 0 4 0 16800975 18446604440763583360 0 0 -1 2 0 0 0
[pid=19624/tid=19648] ppid=19622 vsize=15691564 CPUtime=0.98 cores=0,2,4,6
/proc/19624/task/19648/stat : 19648 (java) S 19622 19624 19242 0 -1 4202560 5549 0 0 0 98 0 0 0 16 0 22 0 522663680 16068161536 130265 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514137 0 4 0 16800975 18446604440763583360 0 0 -1 6 0 0 0
[pid=19624/tid=19649] ppid=19622 vsize=15691564 CPUtime=1.14 cores=0,2,4,6
/proc/19624/task/19649/stat : 19649 (java) S 19622 19624 19242 0 -1 4202560 4913 0 0 0 114 0 0 0 16 0 22 0 522663681 16068161536 130265 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514137 0 4 0 16800975 18446604440763583360 0 0 -1 4 0 0 0
[pid=19624/tid=19650] ppid=19622 vsize=15691564 CPUtime=1.2 cores=0,2,4,6
/proc/19624/task/19650/stat : 19650 (java) S 19622 19624 19242 0 -1 4202560 5701 0 0 0 119 1 0 0 16 0 22 0 522663681 16068161536 130265 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514137 0 4 0 16800975 18446604440763583360 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 8.25
Current children cumulated vsize (KiB) 15691564

[startup+6.30154 s]
/proc/loadavg: 7.33 7.93 8.01 11/220 19650
/proc/meminfo: memFree=28811724/32950928 swapFree=67111428/67111528
[pid=19624] ppid=19622 vsize=15691564 CPUtime=20.99 cores=0,2,4,6
/proc/19624/stat : 19624 (java) S 19622 19624 19242 0 -1 4202496 393302 0 1 0 2044 55 0 0 21 0 22 0 522663627 16068161536 384768 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101500901 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/19624/statm: 3922891 384768 2275 9 0 3913610 0
[pid=19624/tid=19625] ppid=19622 vsize=15691564 CPUtime=1.46 cores=0,2,4,6
/proc/19624/task/19625/stat : 19625 (java) S 19622 19624 19242 0 -1 4202560 35691 0 1 0 142 4 0 0 21 0 22 0 522663627 16068161536 384768 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514137 0 4 0 16800975 18446604440763583360 0 0 -1 0 0 0 0
[pid=19624/tid=19627] ppid=19622 vsize=15691564 CPUtime=0.06 cores=0,2,4,6
/proc/19624/task/19627/stat : 19627 (java) S 19622 19624 19242 0 -1 4202560 13330 0 0 0 5 1 0 0 15 0 22 0 522663628 16068161536 384768 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514137 0 4 0 16800975 18446604440763583360 0 0 -1 0 0 0 0
[pid=19624/tid=19628] ppid=19622 vsize=15691564 CPUtime=0.07 cores=0,2,4,6
/proc/19624/task/19628/stat : 19628 (java) S 19622 19624 19242 0 -1 4202560 8555 0 0 0 6 1 0 0 16 0 22 0 522663628 16068161536 384768 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514137 0 4 0 16800975 18446604440763583360 0 0 -1 0 0 0 0
[pid=19624/tid=19629] ppid=19622 vsize=15691564 CPUtime=0.16 cores=0,2,4,6
/proc/19624/task/19629/stat : 19629 (java) S 19622 19624 19242 0 -1 4202560 29505 0 0 0 12 4 0 0 16 0 22 0 522663628 16068161536 384768 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514137 0 4 0 16800975 18446604440763583360 0 0 -1 2 0 0 0
[pid=19624/tid=19630] ppid=19622 vsize=15691564 CPUtime=0.17 cores=0,2,4,6
/proc/19624/task/19630/stat : 19630 (java) S 19622 19624 19242 0 -1 4202560 35304 0 0 0 12 5 0 0 16 0 22 0 522663628 16068161536 384768 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514137 0 4 0 16800975 18446604440763583360 0 0 -1 4 0 0 0
[pid=19624/tid=19631] ppid=19622 vsize=15691564 CPUtime=0.09 cores=0,2,4,6
/proc/19624/task/19631/stat : 19631 (java) S 19622 19624 19242 0 -1 4202560 20381 0 0 0 7 2 0 0 16 0 22 0 522663628 16068161536 384768 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514137 0 4 0 16800975 18446604440763583360 0 0 -1 0 0 0 0
[pid=19624/tid=19632] ppid=19622 vsize=15691564 CPUtime=0.18 cores=0,2,4,6
/proc/19624/task/19632/stat : 19632 (java) S 19622 19624 19242 0 -1 4202560 40313 0 0 0 12 6 0 0 16 0 22 0 522663628 16068161536 384768 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514137 0 4 0 16800975 18446604440763583360 0 0 -1 6 0 0 0
[pid=19624/tid=19633] ppid=19622 vsize=15691564 CPUtime=0.09 cores=0,2,4,6
/proc/19624/task/19633/stat : 19633 (java) S 19622 19624 19242 0 -1 4202560 22709 0 0 0 6 3 0 0 16 0 22 0 522663628 16068161536 384768 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514137 0 4 0 16800975 18446604440763583360 0 0 -1 0 0 0 0
[pid=19624/tid=19634] ppid=19622 vsize=15691564 CPUtime=0.09 cores=0,2,4,6
/proc/19624/task/19634/stat : 19634 (java) S 19622 19624 19242 0 -1 4202560 17514 0 0 0 7 2 0 0 15 0 22 0 522663628 16068161536 384768 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514137 0 4 0 16800975 18446604440763583360 0 0 -1 6 0 0 0

################
# More data... #
################

/proc/meminfo: memFree=21182648/32950928 swapFree=67111428/67111528
[pid=19624] ppid=19622 vsize=15691564 CPUtime=4468.65 cores=0,2,4,6
/proc/19624/stat : 19624 (java) S 19622 19624 19242 0 -1 4202496 2723605 0 1 0 446417 448 0 0 21 0 22 0 522663627 16068161536 2159147 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101500901 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/19624/statm: 3922891 2159147 2293 9 0 3913610 0
[pid=19624/tid=19625] ppid=19622 vsize=15691564 CPUtime=1.46 cores=0,2,4,6
/proc/19624/task/19625/stat : 19625 (java) S 19622 19624 19242 0 -1 4202560 35691 0 1 0 142 4 0 0 21 0 22 0 522663627 16068161536 2159147 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514137 0 4 0 16800975 18446604440763583360 0 0 -1 0 0 0 0
[pid=19624/tid=19627] ppid=19622 vsize=15691564 CPUtime=3.62 cores=0,2,4,6
/proc/19624/task/19627/stat : 19627 (java) S 19622 19624 19242 0 -1 4202560 265508 0 0 0 319 43 0 0 16 0 22 0 522663628 16068161536 2159147 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514137 0 4 0 16800975 18446604440763583360 0 0 -1 0 0 0 0
[pid=19624/tid=19628] ppid=19622 vsize=15691564 CPUtime=4.01 cores=0,2,4,6
/proc/19624/task/19628/stat : 19628 (java) S 19622 19624 19242 0 -1 4202560 225868 0 0 0 359 42 0 0 16 0 22 0 522663628 16068161536 2159147 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514137 0 4 0 16800975 18446604440763583360 0 0 -1 6 0 0 0
[pid=19624/tid=19629] ppid=19622 vsize=15691564 CPUtime=4.39 cores=0,2,4,6
/proc/19624/task/19629/stat : 19629 (java) S 19622 19624 19242 0 -1 4202560 285490 0 0 0 387 52 0 0 16 0 22 0 522663628 16068161536 2159147 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514137 0 4 0 16800975 18446604440763583360 0 0 -1 4 0 0 0
[pid=19624/tid=19630] ppid=19622 vsize=15691564 CPUtime=3.56 cores=0,2,4,6
/proc/19624/task/19630/stat : 19630 (java) S 19622 19624 19242 0 -1 4202560 244751 0 0 0 313 43 0 0 16 0 22 0 522663628 16068161536 2159147 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514137 0 4 0 16800975 18446604440763583360 0 0 -1 4 0 0 0
[pid=19624/tid=19631] ppid=19622 vsize=15691564 CPUtime=3.84 cores=0,2,4,6
/proc/19624/task/19631/stat : 19631 (java) S 19622 19624 19242 0 -1 4202560 262206 0 0 0 337 47 0 0 16 0 22 0 522663628 16068161536 2159147 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514137 0 4 0 16800975 18446604440763583360 0 0 -1 4 0 0 0
[pid=19624/tid=19632] ppid=19622 vsize=15691564 CPUtime=3.49 cores=0,2,4,6
/proc/19624/task/19632/stat : 19632 (java) S 19622 19624 19242 0 -1 4202560 220846 0 0 0 308 41 0 0 16 0 22 0 522663628 16068161536 2159147 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514137 0 4 0 16800975 18446604440763583360 0 0 -1 0 0 0 0
[pid=19624/tid=19633] ppid=19622 vsize=15691564 CPUtime=3.5 cores=0,2,4,6
/proc/19624/task/19633/stat : 19633 (java) S 19622 19624 19242 0 -1 4202560 200148 0 0 0 314 36 0 0 16 0 22 0 522663628 16068161536 2159147 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514137 0 4 0 16800975 18446604440763583360 0 0 -1 6 0 0 0
[pid=19624/tid=19634] ppid=19622 vsize=15691564 CPUtime=3.69 cores=0,2,4,6
/proc/19624/task/19634/stat : 19634 (java) S 19622 19624 19242 0 -1 4202560 182807 0 0 0 335 34 0 0 16 0 22 0 522663628 16068161536 2159147 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514137 0 4 0 16800975 18446604440763583360 0 0 -1 2 0 0 0
[pid=19624/tid=19635] ppid=19622 vsize=15691564 CPUtime=3.24 cores=0,2,4,6
/proc/19624/task/19635/stat : 19635 (java) S 19622 19624 19242 0 -1 4202560 284078 0 0 0 290 34 0 0 15 0 22 0 522663629 16068161536 2159147 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514752 0 0 0 16800975 18446604440763583360 0 0 -1 2 0 0 0
[pid=19624/tid=19636] ppid=19622 vsize=15691564 CPUtime=0 cores=0,2,4,6
/proc/19624/task/19636/stat : 19636 (java) S 19622 19624 19242 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 522663629 16068161536 2159147 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514137 0 4 0 16800975 18446604440763583360 0 0 -1 6 0 0 0
[pid=19624/tid=19637] ppid=19622 vsize=15691564 CPUtime=0 cores=0,2,4,6
/proc/19624/task/19637/stat : 19637 (java) S 19622 19624 19242 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 522663629 16068161536 2159147 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514137 0 4 0 16800975 18446604440763583360 0 0 -1 6 0 0 0
[pid=19624/tid=19638] ppid=19622 vsize=15691564 CPUtime=0 cores=0,2,4,6
/proc/19624/task/19638/stat : 19638 (java) S 19622 19624 19242 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 522663631 16068161536 2159147 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101521841 0 4 0 16800975 18446604440763583360 0 0 -1 2 0 0 0
[pid=19624/tid=19639] ppid=19622 vsize=15691564 CPUtime=0.94 cores=0,2,4,6
/proc/19624/task/19639/stat : 19639 (java) S 19622 19624 19242 0 -1 4202560 3764 0 0 0 94 0 0 0 16 0 22 0 522663631 16068161536 2159147 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514137 0 4 0 16800975 18446604440763583360 0 0 -1 6 0 0 0
[pid=19624/tid=19640] ppid=19622 vsize=15691564 CPUtime=1.32 cores=0,2,4,6
/proc/19624/task/19640/stat : 19640 (java) S 19622 19624 19242 0 -1 4202560 13793 0 0 0 130 2 0 0 15 0 22 0 522663631 16068161536 2159147 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514137 0 4 0 16800975 18446604440763583360 0 0 -1 2 0 0 0
[pid=19624/tid=19641] ppid=19622 vsize=15691564 CPUtime=0 cores=0,2,4,6
/proc/19624/task/19641/stat : 19641 (java) S 19622 19624 19242 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 522663631 16068161536 2159147 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514137 0 4 0 16800975 18446604440763583360 0 0 -1 2 0 0 0
[pid=19624/tid=19642] ppid=19622 vsize=15691564 CPUtime=0 cores=0,2,4,6
/proc/19624/task/19642/stat : 19642 (java) S 19622 19624 19242 0 -1 4202560 67 0 0 0 0 0 0 0 15 0 22 0 522663631 16068161536 2159147 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514752 0 4 0 16800975 18446604440763583360 0 0 -1 2 0 0 0
[pid=19624/tid=19647] ppid=19622 vsize=15691564 CPUtime=1109.02 cores=0,2,4,6
/proc/19624/task/19647/stat : 19647 (java) R 19622 19624 19242 0 -1 4202560 126206 0 0 0 110887 15 0 0 25 0 22 0 522663680 16068161536 2159147 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 46912505852884 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=19624/tid=19648] ppid=19622 vsize=15691564 CPUtime=1107.77 cores=0,2,4,6
/proc/19624/task/19648/stat : 19648 (java) R 19622 19624 19242 0 -1 4202560 124414 0 0 0 110761 16 0 0 25 0 22 0 522663680 16068161536 2159147 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 46912506271309 0 4 0 16800975 0 0 0 -1 0 0 0 0
[pid=19624/tid=19649] ppid=19622 vsize=15691564 CPUtime=1106.34 cores=0,2,4,6
/proc/19624/task/19649/stat : 19649 (java) R 19622 19624 19242 0 -1 4202560 125126 0 0 0 110619 15 0 0 25 0 22 0 522663681 16068161536 2159147 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 18446744073699065971 0 4 0 16800975 0 0 0 -1 6 0 0 0
[pid=19624/tid=19650] ppid=19622 vsize=15691564 CPUtime=1108.3 cores=0,2,4,6
/proc/19624/task/19650/stat : 19650 (java) R 19622 19624 19242 0 -1 4202560 121457 0 0 0 110815 15 0 0 25 0 22 0 522663681 16068161536 2159147 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 46912505852272 0 4 0 16800975 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4468.65
Current children cumulated vsize (KiB) 15691564

[startup+1182.3 s]
/proc/loadavg: 8.07 8.08 8.05 9/220 19693
/proc/meminfo: memFree=21141684/32950928 swapFree=67111428/67111528
[pid=19624] ppid=19622 vsize=15691564 CPUtime=4708.28 cores=0,2,4,6
/proc/19624/stat : 19624 (java) S 19622 19624 19242 0 -1 4202496 2733625 0 1 0 470378 450 0 0 21 0 22 0 522663627 16068161536 2169046 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101500901 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/19624/statm: 3922891 2169046 2293 9 0 3913610 0
[pid=19624/tid=19625] ppid=19622 vsize=15691564 CPUtime=1.46 cores=0,2,4,6
/proc/19624/task/19625/stat : 19625 (java) S 19622 19624 19242 0 -1 4202560 35691 0 1 0 142 4 0 0 21 0 22 0 522663627 16068161536 2169046 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514137 0 4 0 16800975 18446604440763583360 0 0 -1 0 0 0 0
[pid=19624/tid=19627] ppid=19622 vsize=15691564 CPUtime=3.81 cores=0,2,4,6
/proc/19624/task/19627/stat : 19627 (java) S 19622 19624 19242 0 -1 4202560 265585 0 0 0 338 43 0 0 15 0 22 0 522663628 16068161536 2169046 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514137 0 4 0 16800975 18446604440763583360 0 0 -1 6 0 0 0
[pid=19624/tid=19628] ppid=19622 vsize=15691564 CPUtime=4.25 cores=0,2,4,6
/proc/19624/task/19628/stat : 19628 (java) S 19622 19624 19242 0 -1 4202560 226621 0 0 0 383 42 0 0 15 0 22 0 522663628 16068161536 2169046 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514137 0 4 0 16800975 18446604440763583360 0 0 -1 0 0 0 0
[pid=19624/tid=19629] ppid=19622 vsize=15691564 CPUtime=4.5 cores=0,2,4,6
/proc/19624/task/19629/stat : 19629 (java) S 19622 19624 19242 0 -1 4202560 285493 0 0 0 398 52 0 0 15 0 22 0 522663628 16068161536 2169046 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514137 0 4 0 16800975 18446604440763583360 0 0 -1 2 0 0 0
[pid=19624/tid=19630] ppid=19622 vsize=15691564 CPUtime=3.64 cores=0,2,4,6
/proc/19624/task/19630/stat : 19630 (java) S 19622 19624 19242 0 -1 4202560 247229 0 0 0 320 44 0 0 15 0 22 0 522663628 16068161536 2169046 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514137 0 4 0 16800975 18446604440763583360 0 0 -1 2 0 0 0
[pid=19624/tid=19631] ppid=19622 vsize=15691564 CPUtime=4.06 cores=0,2,4,6
/proc/19624/task/19631/stat : 19631 (java) S 19622 19624 19242 0 -1 4202560 262233 0 0 0 359 47 0 0 16 0 22 0 522663628 16068161536 2169046 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514137 0 4 0 16800975 18446604440763583360 0 0 -1 4 0 0 0
[pid=19624/tid=19632] ppid=19622 vsize=15691564 CPUtime=3.64 cores=0,2,4,6
/proc/19624/task/19632/stat : 19632 (java) S 19622 19624 19242 0 -1 4202560 220846 0 0 0 323 41 0 0 16 0 22 0 522663628 16068161536 2169046 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514137 0 4 0 16800975 18446604440763583360 0 0 -1 2 0 0 0
[pid=19624/tid=19633] ppid=19622 vsize=15691564 CPUtime=3.78 cores=0,2,4,6
/proc/19624/task/19633/stat : 19633 (java) S 19622 19624 19242 0 -1 4202560 202918 0 0 0 341 37 0 0 16 0 22 0 522663628 16068161536 2169046 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514137 0 4 0 16800975 18446604440763583360 0 0 -1 0 0 0 0
[pid=19624/tid=19634] ppid=19622 vsize=15691564 CPUtime=3.97 cores=0,2,4,6
/proc/19624/task/19634/stat : 19634 (java) S 19622 19624 19242 0 -1 4202560 186596 0 0 0 362 35 0 0 16 0 22 0 522663628 16068161536 2169046 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514137 0 4 0 16800975 18446604440763583360 0 0 -1 6 0 0 0
[pid=19624/tid=19635] ppid=19622 vsize=15691564 CPUtime=3.24 cores=0,2,4,6
/proc/19624/task/19635/stat : 19635 (java) S 19622 19624 19242 0 -1 4202560 284188 0 0 0 290 34 0 0 15 0 22 0 522663629 16068161536 2169046 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514752 0 0 0 16800975 18446604440763583360 0 0 -1 2 0 0 0
[pid=19624/tid=19636] ppid=19622 vsize=15691564 CPUtime=0 cores=0,2,4,6
/proc/19624/task/19636/stat : 19636 (java) S 19622 19624 19242 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 522663629 16068161536 2169046 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514137 0 4 0 16800975 18446604440763583360 0 0 -1 6 0 0 0
[pid=19624/tid=19637] ppid=19622 vsize=15691564 CPUtime=0 cores=0,2,4,6
/proc/19624/task/19637/stat : 19637 (java) S 19622 19624 19242 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 522663629 16068161536 2169046 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514137 0 4 0 16800975 18446604440763583360 0 0 -1 6 0 0 0
[pid=19624/tid=19638] ppid=19622 vsize=15691564 CPUtime=0 cores=0,2,4,6
/proc/19624/task/19638/stat : 19638 (java) S 19622 19624 19242 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 522663631 16068161536 2169046 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101521841 0 4 0 16800975 18446604440763583360 0 0 -1 2 0 0 0
[pid=19624/tid=19639] ppid=19622 vsize=15691564 CPUtime=0.94 cores=0,2,4,6
/proc/19624/task/19639/stat : 19639 (java) S 19622 19624 19242 0 -1 4202560 3764 0 0 0 94 0 0 0 16 0 22 0 522663631 16068161536 2169046 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514137 0 4 0 16800975 18446604440763583360 0 0 -1 6 0 0 0
[pid=19624/tid=19640] ppid=19622 vsize=15691564 CPUtime=1.32 cores=0,2,4,6
/proc/19624/task/19640/stat : 19640 (java) S 19622 19624 19242 0 -1 4202560 13793 0 0 0 130 2 0 0 15 0 22 0 522663631 16068161536 2169046 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514137 0 4 0 16800975 18446604440763583360 0 0 -1 2 0 0 0
[pid=19624/tid=19641] ppid=19622 vsize=15691564 CPUtime=0 cores=0,2,4,6
/proc/19624/task/19641/stat : 19641 (java) S 19622 19624 19242 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 522663631 16068161536 2169046 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514137 0 4 0 16800975 18446604440763583360 0 0 -1 2 0 0 0
[pid=19624/tid=19642] ppid=19622 vsize=15691564 CPUtime=0 cores=0,2,4,6
/proc/19624/task/19642/stat : 19642 (java) S 19622 19624 19242 0 -1 4202560 69 0 0 0 0 0 0 0 15 0 22 0 522663631 16068161536 2169046 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514752 0 4 0 16800975 18446604440763583360 0 0 -1 0 0 0 0
[pid=19624/tid=19647] ppid=19622 vsize=15691564 CPUtime=1168.61 cores=0,2,4,6
/proc/19624/task/19647/stat : 19647 (java) R 19622 19624 19242 0 -1 4202560 126209 0 0 0 116846 15 0 0 25 0 22 0 522663680 16068161536 2169046 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 46912505835662 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=19624/tid=19648] ppid=19622 vsize=15691564 CPUtime=1167.37 cores=0,2,4,6
/proc/19624/task/19648/stat : 19648 (java) R 19622 19624 19242 0 -1 4202560 124416 0 0 0 116721 16 0 0 25 0 22 0 522663680 16068161536 2169046 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 46912505852864 0 4 0 16800975 0 0 0 -1 0 0 0 0
[pid=19624/tid=19649] ppid=19622 vsize=15691564 CPUtime=1165.62 cores=0,2,4,6
/proc/19624/task/19649/stat : 19649 (java) R 19622 19624 19242 0 -1 4202560 125128 0 0 0 116547 15 0 0 25 0 22 0 522663681 16068161536 2169046 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 46912505853127 0 4 0 16800975 0 0 0 -1 6 0 0 0
[pid=19624/tid=19650] ppid=19622 vsize=15691564 CPUtime=1167.91 cores=0,2,4,6
/proc/19624/task/19650/stat : 19650 (java) R 19622 19624 19242 0 -1 4202560 121461 0 0 0 116776 15 0 0 25 0 22 0 522663681 16068161536 2169046 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 46912506080435 0 4 0 16800975 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4708.28
Current children cumulated vsize (KiB) 15691564



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1205.3 s]
/proc/loadavg: 8.10 8.09 8.06 5/197 19697
/proc/meminfo: memFree=21878020/32950928 swapFree=67111428/67111528
[pid=19624] ppid=19622 vsize=15691564 CPUtime=4800.16 cores=0,2,4,6
/proc/19624/stat : 19624 (java) S 19622 19624 19242 0 -1 4202496 2757417 0 1 0 479562 454 0 0 21 0 22 0 522663627 16068161536 2192700 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101500901 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/19624/statm: 3922891 2192700 2293 9 0 3913610 0
[pid=19624/tid=19625] ppid=19622 vsize=15691564 CPUtime=1.46 cores=0,2,4,6
/proc/19624/task/19625/stat : 19625 (java) S 19622 19624 19242 0 -1 4202560 35691 0 1 0 142 4 0 0 21 0 22 0 522663627 16068161536 2192700 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514137 0 4 0 16800975 18446604440763583360 0 0 -1 0 0 0 0
[pid=19624/tid=19627] ppid=19622 vsize=15691564 CPUtime=3.9 cores=0,2,4,6
/proc/19624/task/19627/stat : 19627 (java) S 19622 19624 19242 0 -1 4202560 270476 0 0 0 345 45 0 0 15 0 22 0 522663628 16068161536 2192700 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514137 0 4 0 16800975 18446604440763583360 0 0 -1 6 0 0 0
[pid=19624/tid=19628] ppid=19622 vsize=15691564 CPUtime=4.29 cores=0,2,4,6
/proc/19624/task/19628/stat : 19628 (java) S 19622 19624 19242 0 -1 4202560 226621 0 0 0 387 42 0 0 16 0 22 0 522663628 16068161536 2192700 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514137 0 4 0 16800975 18446604440763583360 0 0 -1 2 0 0 0
[pid=19624/tid=19629] ppid=19622 vsize=15691564 CPUtime=4.62 cores=0,2,4,6
/proc/19624/task/19629/stat : 19629 (java) S 19622 19624 19242 0 -1 4202560 293757 0 0 0 409 53 0 0 16 0 22 0 522663628 16068161536 2192700 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514137 0 4 0 16800975 18446604440763583360 0 0 -1 4 0 0 0
[pid=19624/tid=19630] ppid=19622 vsize=15691564 CPUtime=3.76 cores=0,2,4,6
/proc/19624/task/19630/stat : 19630 (java) S 19622 19624 19242 0 -1 4202560 250035 0 0 0 332 44 0 0 16 0 22 0 522663628 16068161536 2192700 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514137 0 4 0 16800975 18446604440763583360 0 0 -1 6 0 0 0
[pid=19624/tid=19631] ppid=19622 vsize=15691564 CPUtime=4.12 cores=0,2,4,6
/proc/19624/task/19631/stat : 19631 (java) S 19622 19624 19242 0 -1 4202560 267145 0 0 0 364 48 0 0 15 0 22 0 522663628 16068161536 2192700 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514137 0 4 0 16800975 18446604440763583360 0 0 -1 6 0 0 0
[pid=19624/tid=19632] ppid=19622 vsize=15691564 CPUtime=3.64 cores=0,2,4,6
/proc/19624/task/19632/stat : 19632 (java) S 19622 19624 19242 0 -1 4202560 220846 0 0 0 323 41 0 0 15 0 22 0 522663628 16068161536 2192700 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514137 0 4 0 16800975 18446604440763583360 0 0 -1 2 0 0 0
[pid=19624/tid=19633] ppid=19622 vsize=15691564 CPUtime=3.85 cores=0,2,4,6
/proc/19624/task/19633/stat : 19633 (java) S 19622 19624 19242 0 -1 4202560 205752 0 0 0 348 37 0 0 16 0 22 0 522663628 16068161536 2192700 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514137 0 4 0 16800975 18446604440763583360 0 0 -1 0 0 0 0
[pid=19624/tid=19634] ppid=19622 vsize=15691564 CPUtime=3.98 cores=0,2,4,6
/proc/19624/task/19634/stat : 19634 (java) S 19622 19624 19242 0 -1 4202560 186596 0 0 0 363 35 0 0 15 0 22 0 522663628 16068161536 2192700 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514137 0 4 0 16800975 18446604440763583360 0 0 -1 4 0 0 0
[pid=19624/tid=19635] ppid=19622 vsize=15691564 CPUtime=3.24 cores=0,2,4,6
/proc/19624/task/19635/stat : 19635 (java) S 19622 19624 19242 0 -1 4202560 284269 0 0 0 290 34 0 0 15 0 22 0 522663629 16068161536 2192700 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514752 0 0 0 16800975 18446604440763583360 0 0 -1 0 0 0 0
[pid=19624/tid=19636] ppid=19622 vsize=15691564 CPUtime=0 cores=0,2,4,6
/proc/19624/task/19636/stat : 19636 (java) S 19622 19624 19242 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 22 0 522663629 16068161536 2192700 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514137 0 4 0 16800975 18446604440763583360 0 0 -1 6 0 0 0
[pid=19624/tid=19637] ppid=19622 vsize=15691564 CPUtime=0 cores=0,2,4,6
/proc/19624/task/19637/stat : 19637 (java) S 19622 19624 19242 0 -1 4202560 8 0 0 0 0 0 0 0 18 0 22 0 522663629 16068161536 2192700 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514137 0 4 0 16800975 18446604440763583360 0 0 -1 6 0 0 0
[pid=19624/tid=19638] ppid=19622 vsize=15691564 CPUtime=0 cores=0,2,4,6
/proc/19624/task/19638/stat : 19638 (java) S 19622 19624 19242 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 522663631 16068161536 2192700 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101521841 0 4 0 16800975 18446604440763583360 0 0 -1 2 0 0 0
[pid=19624/tid=19639] ppid=19622 vsize=15691564 CPUtime=0.94 cores=0,2,4,6
/proc/19624/task/19639/stat : 19639 (java) S 19622 19624 19242 0 -1 4202560 3764 0 0 0 94 0 0 0 16 0 22 0 522663631 16068161536 2192700 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514137 0 4 0 16800975 18446604440763583360 0 0 -1 6 0 0 0
[pid=19624/tid=19640] ppid=19622 vsize=15691564 CPUtime=1.32 cores=0,2,4,6
/proc/19624/task/19640/stat : 19640 (java) S 19622 19624 19242 0 -1 4202560 13793 0 0 0 130 2 0 0 15 0 22 0 522663631 16068161536 2192700 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514137 0 4 0 16800975 18446604440763583360 0 0 -1 2 0 0 0
[pid=19624/tid=19641] ppid=19622 vsize=15691564 CPUtime=0 cores=0,2,4,6
/proc/19624/task/19641/stat : 19641 (java) S 19622 19624 19242 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 22 0 522663631 16068161536 2192700 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514137 0 4 0 16800975 18446604440763583360 0 0 -1 2 0 0 0
[pid=19624/tid=19642] ppid=19622 vsize=15691564 CPUtime=0 cores=0,2,4,6
/proc/19624/task/19642/stat : 19642 (java) S 19622 19624 19242 0 -1 4202560 71 0 0 0 0 0 0 0 15 0 22 0 522663631 16068161536 2192700 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 248101514752 0 4 0 16800975 18446604440763583360 0 0 -1 4 0 0 0
[pid=19624/tid=19647] ppid=19622 vsize=15691564 CPUtime=1191.48 cores=0,2,4,6
/proc/19624/task/19647/stat : 19647 (java) R 19622 19624 19242 0 -1 4202560 126210 0 0 0 119133 15 0 0 25 0 22 0 522663680 16068161536 2192700 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 46912505835146 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=19624/tid=19648] ppid=19622 vsize=15691564 CPUtime=1190.24 cores=0,2,4,6
/proc/19624/task/19648/stat : 19648 (java) R 19622 19624 19242 0 -1 4202560 124416 0 0 0 119008 16 0 0 25 0 22 0 522663680 16068161536 2192700 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 46912505852334 0 4 0 16800975 0 0 0 -1 0 0 0 0
[pid=19624/tid=19649] ppid=19622 vsize=15691564 CPUtime=1188.36 cores=0,2,4,6
/proc/19624/task/19649/stat : 19649 (java) R 19622 19624 19242 0 -1 4202560 125128 0 0 0 118821 15 0 0 25 0 22 0 522663681 16068161536 2192700 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 46912505835093 0 4 0 16800975 0 0 0 -1 6 0 0 0
[pid=19624/tid=19650] ppid=19622 vsize=15691564 CPUtime=1190.78 cores=0,2,4,6
/proc/19624/task/19650/stat : 19650 (java) R 19622 19624 19242 0 -1 4202560 121462 0 0 0 119063 15 0 0 25 0 22 0 522663681 16068161536 2192700 33554432000 1073741824 1073778376 140737223744992 18446744073709551615 46912505602031 0 4 0 16800975 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4800.16
Current children cumulated vsize (KiB) 15691564

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1205.6 s]
/proc/loadavg: 8.10 8.09 8.06 5/197 19697
/proc/meminfo: memFree=21878020/32950928 swapFree=67111428/67111528
[pid=19624] ppid=19622 vsize=0 CPUtime=4800.47 cores=0,2,4,6
/proc/19624/stat : 19624 (java) Z 19622 19624 19242 0 -1 4203548 2757444 0 1 0 479564 483 0 0 17 0 2 0 522663627 0 0 33554432000 0 0 0 0 0 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/19624/statm: 0 0 0 0 0 0 0
[pid=19624/tid=19649] ppid=19622 vsize=0 CPUtime=1188.66 cores=0,2,4,6
/proc/19624/task/19649/stat : 19649 (java) R 19622 19624 19242 0 -1 4203588 125128 0 0 0 118822 44 0 0 25 0 2 0 522663681 0 0 33554432000 0 0 0 0 0 0 4 0 16800975 18446744073709551615 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4800.47
Current children cumulated vsize (KiB) 0

Child status: 143
Real time (s): 1205.64
CPU time (s): 4800.52
CPU user time (s): 4795.65
CPU system time (s): 4.87226
CPU usage (%): 398.171
Max. virtual memory (cumulated for all children) (KiB): 15691564

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4795.64
system time used= 4.87226
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 2757444
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 29849
involuntary context switches= 75581

runsolver used 2.02169 second user time and 4.6113 second system time

The end

Launcher Data 

Begin job on node123 at 2011-04-29 22:57:18
IDJOB=3312326
IDBENCH=82511
IDSOLVER=1699
FILE ID=node123/3312326-1304110638
RUNJOBID= node123-1304110638-19587
PBS_JOBID= 13170665
Free space on /tmp= 72816 MiB

SOLVER NAME= STRUCTure 0.1
BENCH NAME= SAT11/random/large/unif-k3-r4.2-v15000-c63000-S1868678442-026-UNKNOWN.cnf
COMMAND LINE= run 15000 NBCORE TMPDIR DIR BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3312326-1304110638/watcher-3312326-1304110638 -o /tmp/evaluation-result-3312326-1304110638/solver-3312326-1304110638 -C 4800 -W 1300 -M 15500  run 15000 4 HOME HOME HOME/instance-3312326-1304110638.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 8991b7c0d56154e632c95327c4937cf5
RANDOM SEED=1656734938

node123.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      30652448 kB
Buffers:        573704 kB
Cached:        1289776 kB
SwapCached:        100 kB
Active:         135760 kB
Inactive:      1800776 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      30652448 kB
SwapTotal:    67111528 kB
SwapFree:     67111428 kB
Dirty:            4700 kB
Writeback:           0 kB
AnonPages:       72452 kB
Mapped:          21480 kB
Slab:           298360 kB
PageTables:       4692 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   777004 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72812 MiB
End job on node123 at 2011-04-29 23:17:26